I find if you're careful you should be okay. I find it more of a problem the other way around; ie, its harder to keep the vinyl cleaner stuff off the paint (I generally use the 303 Auerospace stuff).
One tip I have heard thoguh, if you do get wax on your black plastic bits, apparently baby wipes will remove the wax.
