No the batteries aren't loose! I don't know why they jut out like that when you insert the battery. It is annoying though. Would definitely have more room in there if they didn't do that. They're quite solid. I don't know. Maybe need to find better battery holders....