No, it doesn't sound like a game. It sounds like there was just a fairly routine amount of processing time. Before Fannie Mae will buy a loan, it needs to be duly recorded and bundled with other loans as well as meet some other requirements. That doesn't happen overnight. They can actually provide you with documentation to prove this if they wish. Usually, however, they just give out a copy of an assignment, possibly to MERS and tell you that's good enough. This sort of thing does catch some people. Sounds like you may be one of them. I wouldn't give up on refinancing yet, however. There are more programs out there that you might qualify for. Good luck.
Please be sure to mark the best answer to your question. My answers are general and do not form an attorney-client relationship. I'm happy to talk to prospective clients in my areas of concentration and geographical location.