Is this using the charger that came with your iPad?
It is important that the docking plug is seating squarely into the bottom of your iPad. If it does not make a solid connection, it may cause this problem.
Also, if you plug your iPad into your computer's USB port, it will say "Not Charging", but really, it will charge this way, but very slowly.