AITA for sneaking a stray cat away from the security guard at my work?

There is this stray cat at in front of my work, and I have been feeding him for almost 3 weeks now. He is always hungry (judging by the way he hurriedly wolfs down all the food), and he is very affectionate with me and my colleagues. I have asked the shops around and they all said that he's a stray, and he always asks for food from them as well. I decided to post about him online and managed to find someone who is willing to adopt him.

On the day that I was supposed to bring the cat to the new owner, the security guard at my place made a scene and yelled at me about how he wants to keep the cat there to chase away the mice. I asked if he ever feeds the cats and he said it was none of my business (although judging by how hungry he is everytime I feed him I can tell the security never feeds the cat, and I never see him feeding the cat ever). He was adamant about not letting me take the cat.

When I left work at the end of the day, the cat followed me to where I park my motorbike, which happened to be away from the security's sight. I took the chance and put the cat in the carrier, and drove him to his new owner.

My colleagues who left after me said that the security was not happy, and he kept using bad words to talk about how I took the cat away, claiming that even though he doesn't own the cat, I have no rights to take him away.

Am I The Asshole?