AITA for not giving a young couple and their baby a ride home in the cold because I didn't know them?

Earlier this evening a young man came to my door asking if we could give a ride home for him, his partner and baby. They were waiting across the street and had a stroller as well as some groceries. He mentioned that the next bus wouldn't be for about an hour and that no taxis would come because of the stroller and said he could pay for gas, told me his address which is about a 20 minute drive.

I expressed I wasn't comfortable doing that, apologized, and checked my bus app which showed a bus coming in 3 minutes, told him that the bus was due and he left. They didn't end up getting on the bus, I later found out that bus is one of two routes at that stop and that only goes to a local grocery store along the route. If they took it they'd still have to wait 30 mins for the next bus that goes to where he told me they lived.

I feel really bad because they didn't look dressed for the weather, (~-10°C) and it was beginning to get dark. I feel like this could make mta because they now have to wait about 40 minutes with their baby in the cold for a bus to get home. But also I couldn't see if there was actually a baby, and they are total strangers to me so for all I know it could have been a way to get access to my vehicle or house (extremely unlikely but not totally unheard of in my city). I don't often Uber or Taxi but I also wasn't sure why they wouldn't be able to fold up the stroller to take one?

AITA?