Sometimes they don't disappear due to an app being slightly buggy. If, like me, you don't like them and find them annoying you can go into settings, tap the notification side bar and then find said app and turn off notification badges.
Proud owner of a 32GB wifi iPad2 iOS5.