It should be there when you are not in an active video call so that you can select a contact to have a FaceTime conversation with. When you do start chatting with someone, it will go away and you'll have a nice full screen view.
Is this something new with the upgrade to iOS 5.0.1? Because it was not this way before. In fact, I can no longer get to the button to switch from back to front camera.