So am I gay or am I straight?

Gay, taken somewhat literally, is considered both a behavioral, mental, and ual term. It's not considered a physical term. So if you are don't act, think, or actually are gay, then you're not gay. If people only call you gay because of your body structure, then they're wrong.