Or do you mean the apps that show in the multitask bar (that shows when you use a four-fingered swipe up gesture ... or double tap the home button)? Like this:
If that's what you mean, you can remove them by holding them down until they start to wiggle and you see a red circle with a minus sign on the upper left of each icon. Press that circle and the icon will be gone.