When I say remove them, I mean permanently remove them. Usually rubber trim like that will begin to oxidize around the edges.
If you don't want to remove them you will probably keep running into that issue, even if you blow out the cracks with air.
Polishing the paint will remove the marks but just be prepared to deal with it over and over again.