Yes, exactly that. Depending on how badly the dealer screwed your plate into the holder you'll have anywhere between 5 and 9 holes that need filling. Five screws hold the plate holder to the car, but if they've used screws too long to screw the plate to the holder they'll have made holes in the bumper with these too.
My car is black so I haven't bothered filling the holes yet.