When Slack questions get annoying (and what I did to solve that)