Question - why are you manually updating your backup disk? You can save yourself a LOT of time by either using one of the many software options or by writing a script to handle and manage your backups for you. I used to have a script that would create a rolling weekly archive for all of my important documents. I may not be understanding your scenario properly, but it sounds like you're putting more effort into this than you need to.
Folders are just containers (specifically, they're delimited file paths). Folders do not have a size. The sum of the size of all the files within the folder determines the "Folder Size". If you've got a folder that contains several hundred files and two files have changed in filesize, but the sum total is the same, how do you tell the difference based on "folder size" alone? Your files contain the data. Make sure you're backing up the proper versions of the files and the folders themselves become meaningless (as long as your backup solution preserves relative file paths).
Or you could just use git. :awe: