Maybe they were just people that he talked at, were in a room with, rather than friends which would need some level of give/take, mutuality, etc that he may not be capable of maintaining.
Talking of friends that you don’t know about/don’t entirely exist may make him feel/appear more functional, that he has more than just you.
When he’s says told them about x you this may be to validate his own distorted frame of reference so suit his own narrative so he doesn’t have to take responsibility.. and they may back it up as he could make you sound outrageous and him calm and rational in the scenario.
Sounds like he’s protecting himself because he needs to ..