The fact that he notices when you are upset with him or distant shows that it's not a sign of aspergers. Aspergers affected person will be someone like Sheldon from Big Bang theory if you have seen that show.
Though it's not on autism spectrum but the symptoms are similar- robotic speech, tendency to talk fast or repeat words, inability to understand or express or care for non verbal communication or emotions. Weird eye contact in social situations.
I have a friend who has that and as much i love her I can see there is some issue with her. The whole demeanor is different from other people.
So many people are socially awkward, or like to socialize selectively. or don't have close friends especially guys. People have anxiety, some are just loners. Some people are unknowingly emotional abusers-or emotionally unavailable. Some people are just emotionally detached. Though in your case it doesn't look like it since you say your poi expresses that he loves you.
I don't know you or your POI.. but just some things to consider. i know it sucks when a reading changes your perception. When you are trying to let go of a person and a reader says he loves you or when it's going all good with a person and a reader says he is cheating or is emotionally unavailable. I guess Yona knows someone who has a similar condition so by what she heard she just said he displays signs of Aspergers. Because sometimes she sees something and interprets is differently.
