I run 18" wheels with F1 Asymmetric 2 Goodyear tyres and sport suspension and I generally find my car gets annoying on rougher roads.
In summer when the sun is high, the roads dry, then you can see ahead better and plan a nice route around the bumps/lumps in the road, and also feel more interested in putting the effort in to drive at a good pace and enjoy it all.
But in winter when it's likely wet and dark it's really tough to place the car around the dips/bumps/potholes, so you just slow down instead, and even then it can feel rough. In these conditions it's just generally a bit pants and I just start to find the car aggravating to drive on many roads due to the likelihood of unseen bumps and holes etc.
I think the Z4 is ok, but it's ride is probably it's worst characteristic. Iirc at the time Evo magazine ran a 3.0i with sport suspension on their fleet and came to the same conclusion. Ultimately ruined by being too stiff for no apparent benefit.
I can live with it but it could be better imo!