Assuming your backup zips/compresses files, the size of the file is not what determines the speed of the backup. It's the number of records that are contained in the file that makes the difference. Blank space in a file is ignored when zipping/compressing.
Honestly, you shouldn't delete history just because your backups take too long. You should get a faster backup method.
Steve