You must be her advocate; she's too young to even really know what's happening. You're clearly (and rightly) uncomfortable with it, so you get to set the rules.

The dementia will worsen, so I actually wouldn't be too comfortable with leaving her with him unless you have a conversation with your MIL. At this point you have to worry less about his feelings and more about the safety of your daughter.