With iOS 8x:
Go to the My Books tab, choose the collection with the books (top, middle), tap "Select" at the top right. Then check mark the books you want to remove, or select "Select All" - also top right. "Delete" will turn red. Tap it to remove the books.