Not sure why it is not wrong or you, I have iPad 2 plus the VGA connector hooked up to a VGA cable to my TV. Are you using the genuine Apple adapter or a generic one?
Remember, you need to select your PC input on the TV to get the VGA connection. You should get your iPad screen up on the TV (mirroring), then when playing in the Video app, it should play only on the TV.