If you reset the keys, only the keys of app will be changed. The clients keys will not be changed so it wouldn’t work.
I didn’t resolve this problem but I think I can try some thing like this:
Add some feature which removes clients keys and set some flag on client side. Every time start the app, check the flag if the app should remove the keys. In this way, you could clear clients keys once. Some time after remove that feature from the app.