Never tried it before, but when I tested, yes, it did the same thing.
You can start the music again by going to the multitask bar (four finger swipe up, or double tap the Home button), sliding the icons to the right to get the control bar, and taping the play icon.
This should work to restart any music app (last one opened) provided it supports background audio.