It's not black and white because it's all in context.

For example, with "a man losing his job for telling a female co-worker she looked beautiful." - why would anyone at work do that? Women are not at work to have their appearance appraised. They'd rather their work was complimented.

That's a start.