I believe you are right about everything being semi-gloss. At least it is on my '65. Yeah, even when perfectly dry, when you pop those hubcaps back on, it will scratch the paint, but it won't show from the outside. That's just another reason to prime. Usually the black paint will be scratched, but the primer will remain, giving you some rust protection.