Are these wireless (Bluetooth) or wired phones? Several people in this Forum have noted that you need to push a (wired) headphone plug into the socket very firmly and, if you have a case fitted, sometimes the edge of the plug 'catches' on the case and restricts it from entering fully. When it's not fully inserted, you often get the sound coming from the iPad speaker and 'phones at the same time.
Tim
Scotland