Now, swirls and scratches are two different issues. How deep are the sratches, may need wet sanding ( don't try this a home boys and girls, unless you have much experience)
If your picking up the scratches with your finger nail you may have to accept them as is. OR wet sand.
Swirls, sounds like your on your way on these be patience black is very tough to get perfect if ever!