If your significant other has that much control over your life, your relationship dynamic is not favorable. It reads like you're in an abusive relationship.
No person, regardless of the gender in the relationship, should get to tell their partner that they cannot participate in harmless activities.
This changes, entirely, if a female was flirting with you and she found out. 😐 I hope it is not that, bro.