It makes little difference on the ///M, certainly it won't prevent pogoing when cold - only learning to engage the clutch carefully until the engine warms up will do that.
It doesn't really improve the stiff first to second gear change either, again that is a characteristic of the gearbox. If you are experiencing denied gear shifts, change to the VT engine mounts.
The greatest enemy of smooth driving in the ///M is the stupid fly-by-wire throttle. As the first part of the pedal travel has little effect on engine speed, those used to a throttle cable will need to learn to drive round it. Engaging Sport Mode makes for a night-and-day improvement in throttle response but even that is a poor substitute for a throttle cable.
I removed my CDV several years (and several tens of thousands of miles) ago and this seems to have caused no harm to the drivetrain. However, I wouldn't have bothered removing it had I know it has so little effect.
*I understand from other forum members that it has a really big effect on non-///Ms and it seems to on the Z3.