Even if you could turn off the backup feature, you probably don't want to! As far as the time factor, I have 16gb that is about half empty (as opposed to half full!) and the whole syncing process takes maybe 5 minutes at the most.
One factor might be the computer you are using. If it is older model and doesn't have a lot of memory, this would almost certainly slow down the whole syncing process.