Or:
Open the Music app again and tap the pause button.
Double tap the Home button for the Multitask bar, swipe it to the right, then tap the pause button.
But if you don't want the music to start playing again if you happen to tap the wrong thing (rare, but happens), close it as Kevin suggested.