Slow at the Course

Two men are trying to get in a quick eighteen holes, but there two women golfers in front of them who are taking quite a long time to play each hole.
The first guy says, “Why don’t you go over and ask if we can play through?” The second guy gets about halfway there, turns and comes back. The first guy says, “What’s wrong?”
He says, “One of them is my wife, and the other is my mistress.”
The first guy says, “That could be a problem. I’ll go over.” He gets about halfway there and he turns and comes back, too.
The second guy says, “What’s wrong?”
The first guy says, “Small world!”