Removing staking,slashing and distro module

Hey there, in one of our project, we are thinking about to remove staking,slashing and distro modules from our app, so instead using staking to become validators , we would like to use our own way to appoint validators and rotate them , by removing staking, slashing and distro , make it easier for us to maintain our own validator set.

We did some experiment, feature wise it works fine, but given staking , slashing , distro these are some fundamental modules in the cosmos sdk , I am not sure by removing it will have other ramifications or not.
Will this open us to some attack?

Anyone here has done similar things can share your experience? is it a stupid idea?

Thanks for your help.