In a moderated channel (mode +m) only members with privileges may send messages: https://modern.ircdocs.horse/#moderated-channel-mode

This requires us to know about the channel modes and our membership.