Why people don't answer to invitations?

Maybe they're not that busy, maybe they just don't think it's fun going to your house, but they feel bad for not wanting to come, so they just avoid the "confrontation" feeling of even making an excuse alltogether. Try finding some different people to socialize with, the kind of people who have the same interests, and will respond to your invitations.