Buffing your paint finish is an abrasive process. It slowly removes "layers" of your clear coat. Your swirl's and very light scratches are usually very minimal in terms of depth. By buffing away the top "layers" you exposed a layer of solid clear. The process in doing so adds scratch's while it removes the "layers". If the scratch's are very deep into the clear coat you will not have enough clear coat left to remove the scratch. Depending on the thickness of your clear coat and condition of it. Buffing those will remove all the clear coat exposing the base coat color. If that happens you will need get a paint shop involved.
That is why its a good idea to use Junkmans "Slow Cut" process. It stays on the safe side with minimal clear coat removal. Its a fine art to judge how thick ones clear coat is without tools to do so.
Hope that helps some