Where the conversation is on the side bar, I just slid my finger sideways across the contact and a delete button appeared. Worked on iPad2?
If you want to delete a contact, do the same as if you were deleting an app. Hold your finger down on the contact - you then should be able to delete?