Really good advice here for Dexternumbers. I would add that it's tempting to feel like this relationship is super important, because it's relatively early on for you. But a good lesson for you to learn now is that everyone deserves to be with someone who wants to be with them, autistic people included. You don't want to have your wagons hitched to this guy any longer, because it means you won't be ready for when a good guy for you comes along. And when a guy doesn't want you to come over to his house, won't answer texts or phonecalls...move on up and move on out.
Please take a moment to reread Coneman's post, y'all.