It comes down to a personal decision on whether you want to be on the latest jailbreakble version of IOS before the current exploits are shut down (which could be any day now), or if, as you seem to suggest, you are perfectly happy with the device on 5.x given your expected use of it. Nobody can really answer the question for you
Personally, I would update, as I believe you should always be on the most recent firmware your use dictates, but I've personally never run into a situation where that has produced any significant disadvantage in terms of performance.