I'm trying to figure out why you would use anything with double stick tape on it on your paint that you're not planning on leaving there permanently. That stuff, if it's been on a while, is known to remove clear coat and a couple layers of paint when it's removed. All I can tell you is go gently, and if you see it pulling up your paint, leave the mirror caps where they are and live with them. If you do get them off, do a full correction on your mirrors. Let us know what happens.