I actually never have this problem because I am right handed but strongly left eye dominant. I shoot handguns like a right handed person using my left eye. I shoot long guns like a left-handed person (it is the reason why I avoid bolt actions and prefer leverguns and single-shots). So I carry my rifle on with my left hand on the grip and right hand on the forend but my holster is on the right. Now since this flap holster is also a cross-draw shoulder type I wouldn't use it that way with a rifle.That flap will also keep you from banging you rifle stock on your hand gun and scratching it up.