AITA for ignoring my bf after our vacation because he brought his brother along?

I (M23) am a pharmacy student. My bf of four years (M32) is a lawyer. Between stress at school and the stress of his job we barely saw each other let alone had any intimate time. We decided to take a vacation where it would be about us and regaining that lost intimacy. So day 2 of 5 of our vacation in Turks and Caicos someone is knocking at our door, I thinks it’s cleaning so I open it. To my surprise and complete confusion it’s my boyfriend’s brother (M29). I ask what he was doing here thinking maybe this was a fantastical coincidence , he says that my bf invited him. My bf looks a bit sheepish but says that he thought it would be a nice bonding time for him and his brother if he tagged along.

Even though I was furious I decided that I could make it work we had a lot of things pre planned/prepaid so I figured his brother couldn’t come with us to those activities. Well he didn’t tag along because my bf decided to go with with brother. Horseback riding was traded for wakeboarding, couples massages was traded in for snorkeling and riding ATVs, getting a nice quiet table in the back of the restaurant for two turned into a nice quiet spot in the back for three. Intimate time in bed turned to a quickie in the shower so he could leave for golf. At that point I had enough. I pretty much spent the trip alone. As soon as the morning came to leave for home I didn’t utter a word to my bf. “Do you have the hotel keycard?” Silence. “Want me to carry to bags?” Silence. It didn’t say anything to him until he broke down a few hours after we got to our apartment. He’s been really pissed that I’m ignoring him but I can’t help but be so angry that I continue to do it. AITA?