Configure Slack Notification Message

As a Fintech, we sometimes have users send our support team PII or other sensitive data unprompted. Currently, our Slack integration also includes the user’s response when it notifies us that they responded to a conversation. Slack is not secure enough to store that kind of data, and it does not look like we can delete the notification.

I would love to have the ability to customize the Slack notification message, or just have it notify us that the user responded without giving the reply message in the thread.