You can stop sharing through the data controls page in your ChatGPT mobile app settings. Just toggle the “Improve voice for everyone” button to off.

Don’t see the toggle? Then you either haven’t yet been invited to share your audio or are using an outdated ChatGPT mobile app.