Love and Sex.....

What are the unsaid reasons why sex outside a relationship is considered a CHRONIC threat to the relationship.... [Mind the saying.....If sex does not define love,why does it pose a problem when a partner cheats)

To me having sex with someone outside of the relationship is a betrayal of trust unless two people have agreed to have an 'open' relationship.