Settings/Safari/Clear History to remove the whole history.
If you want to clear history of a single site: Settings/Safari/Advanced/Website Data then slide a finger from right to left across the entry you want to remove. A red delete button will appear. Touch it to remove that history item.
If you want to prevent Safari from keeping a history Settings/Safari and turn Private Browsing ON.