fdupes Finds and Removes Duplicate FilesĪnother way to look for duplicates is with the fdupes command, whose only job in life is to find duplicate files, and to optionally delete them. At this point I could cobble up a compound command to move or delete the duplicates, but there are easier tools to do this. So I have 4301 unique photos, and 5554 duplicates to weed out. It finds only duplicates, and will not count files that are not duplicated: $ find Pictures/ -type f -exec md5sum '' dupes.txt |wc -l It finds duplicates by generating and matching an md5sum hash on each file, and then using sort and uniq to print all the photo filenames in a text file, with duplicates listed together and separated by a blank line. This incantation will take some time to run, depending on the speed of your computer and the size of your photo archives. So how many are duplicates? Again, we turn to find. This counts all the files in Pictures without counting directories: $ find Pictures/ -type f | wc -l All of my photos are in a single directory, Pictures, so I don’t have to search multiple directories. How many photos is that? Like, a way lot.
But I’m looking at 205GB of photos: $ du -sh Pictures/ Over the years I’ve created duplicates by dumping them onto my computer when I was in a hurry, and making backups without rhyme or reason, so I want to hunt down all the duplicates and get rid of them. Don’t worry, I won’t make you look at all of them. I have a 32GB card in my camera, which holds 1700+ RAW images at 18MB each. Now we can capture gigabytes of photos in just a few minutes, without reloading. In the olden days of photography we thought were ready for anything with a few 36-exposure film cassettes in our bags.
Text deduplicator plus tutorials how to#
Let’s learn how to find duplicates and organize all of your photos without making it your life’s work.īefore doing anything, please have a good backup of your photo files. Digital cameras make it easy to rack up gigabytes of photo archives.
0 kommentar(er)
