Yea, I'm sure it has a lot to do with the paint or the pressure you apply while drying or washing. Just try less pressure like other have said. Let the wash pad and drying towel do the work. It shouldn't take pressure to remove dirt or especially water. If dirt is stuck let some soapy water dwell on the area for a while maybe even try some waterless wash. I heard that works well for stuck on bugs. When drying try laying the towel and dragging it off and less of a buffing action maybe. The car that I just bought has super soft paint and noticed some swirls already after just one wash. So my technique needs a little work. My 04 Silverado had a lot harder clear coat than the new wrx I just got.