Some apps, like Settings, App Store, Game Center or Videos come with your iPad (built in apps) and can't be deleted. Your only option is to hide them: put them on a homescreen you don't use, or in a folder so that you don't have to see them.
You also could take a look at Settings - General - Restrictions. It's possible to restrict some of them, and they will disappear from your screens.