Tool to compare files (content)
Tool to compare files (content)
Author
Discussion

Church of Noise

Original Poster:

1,657 posts

267 months

Monday 7th December 2020
quotequote all
Lately, I've been getting all files / backups / pictures I had on several harddrives on 1 server.
However, it seems quite a few files are doubles (mainly pictures that exist more than once, but under different file names eg.)

Is there a good software tool to identify and clean up?

Thanks!

aka_kerrly

12,506 posts

240 months

Monday 7th December 2020
quotequote all
The two I've used before are clonespy on my home computer as it's a bit of freeware or at work I use Fast Duplicate Pro

Mr E

23,087 posts

289 months

Monday 7th December 2020
quotequote all
Checksums - md5sum is the same if the content is the same but the file names are different.

There is a mathematical chance of different contents having the same checksum, so don’t try on it for anything important.

I’d take the risk on personal photos/music files
I’d not take the risk on vaccination records for 70million people.

Church of Noise

Original Poster:

1,657 posts

267 months

Monday 7th December 2020
quotequote all
aka_kerrly said:
The two I've used before are clonespy on my home computer as it's a bit of freeware or at work I use Fast Duplicate Pro
Brilliant! Thanks for the quick reply, clonespy is running and looks to be doing exactly what I wanted!

21TonyK

13,363 posts

239 months

Monday 7th December 2020
quotequote all
Call me old fashioned but would the command line FC work?

ApexCult

4,922 posts

183 months

Tuesday 8th December 2020
quotequote all
21TonyK said:
Call me old fashioned but would the command line FC work?
Can that work en masse for dozens of folders? A quick google suggests it's only for individual files?

camel_landy

5,512 posts

213 months

Tuesday 8th December 2020
quotequote all
If you're keen, you could probably knock something up in Powershell (assuming you're running Windows).

M

Bullett

11,185 posts

214 months

Wednesday 9th December 2020
quotequote all
CCleaner has this feature I think.

Dave.

7,900 posts

283 months

Wednesday 9th December 2020
quotequote all
In the past, I've used a file rename to rename the file using the file data.

Ie "year-month-day-hour-min-sec-camera-dimensions-filesize.jpg" etc