Author Topic: File Duplicate Finder?  (Read 49 times)

Vesp

  • Administrator
  • Foundress Queen
  • *****
  • Posts: 3,130
File Duplicate Finder?
« on: April 27, 2010, 04:00:17 AM »
Hi, does any of you have experience with a program that finds duplicated files? I have had a few little computer issues and I have various files all over the place. I know some of them are duplicates, but I don't know how many, or where all of the duplicates would be located. I need a program that can find duplicates in various folders, and preferably tell if the file is a duplicate or not based not only on its name, but also the content inside of it.  This might be asking to much for an easy to get program, but is their anything similiar? I have not had success in finding one I'd trust.
I have found this one: http://www.easyduplicatefinder.com/ but I get the feeling it might cause some problems, or not really do its job like every other program the internet offers.

Anyways, hope you can help me out! :D
Bitcoin address: 1FVrHdXJBr6Z9uhtiQKy4g7c7yHtGKjyLy

Naf1

  • Foundress Queen
  • *****
  • Posts: 753
Re: File Duplicate Finder?
« Reply #1 on: April 27, 2010, 04:40:30 AM »

Vesp

  • Administrator
  • Foundress Queen
  • *****
  • Posts: 3,130
Re: File Duplicate Finder?
« Reply #2 on: April 27, 2010, 04:41:54 AM »
Oh nice! I really should start to use Demonoid more then I do.. :P
I think I might have found one that works now, but if not I'll go there first thing.
Bitcoin address: 1FVrHdXJBr6Z9uhtiQKy4g7c7yHtGKjyLy

Prepuce

  • Mighty Bhagwan
  • Subordinate Wasp
  • ***
  • Posts: 100
Re: File Duplicate Finder?
« Reply #3 on: April 27, 2010, 04:51:50 AM »
Let us know if  you find something good, Vesp. I've been looking for one for quite some time but haven't come across anything worth mentioning.

I used to have one that was freeware by PC Magazine, IIRC, and it would find use a checksums and find them even if they had different file names. You could set it to auto-delete, keep backups in a special directory, move files, etc. It was great, but that was back before terabyte drives.

The problem now is that it would take hours or maybe days to do a thorough check like that.

PP
Support the never ending quest for new and better hedonicants. Send your gift today to:

 N & B H Foundation, Attn. Bhagwan SP
 University of Massachusetts at Los Angeles
 PO Box 6.02 X 10^23
 Houston, MD 884411

Naf1

  • Foundress Queen
  • *****
  • Posts: 753
Re: File Duplicate Finder?
« Reply #4 on: April 27, 2010, 04:54:20 AM »
Hit that link I put up, Prepuce.

btw; Where does one d/l movies nowadays ???

Enkidu

  • Global Moderator
  • Foundress Queen
  • *****
  • Posts: 677
Re: File Duplicate Finder?
« Reply #5 on: April 27, 2010, 05:14:22 AM »
^ I used to use isohunt...

Naf1

  • Foundress Queen
  • *****
  • Posts: 753
Re: File Duplicate Finder?
« Reply #6 on: April 27, 2010, 05:38:50 AM »
Thanks have you checked lately? As all my old favorites dont have any music or movies anymore ??? Have you noticed that also? Maybe the new internet filter?

(nope just checked and its all good in iso town). Thanks Enk,

lugh

  • Global Moderator
  • Foundress Queen
  • *****
  • Posts: 876
Re: File Duplicate Finder?
« Reply #7 on: April 27, 2010, 12:37:37 PM »
Gizmo says these programs are supposed to be good for cleaning up one's hard drive:


Duplicate Cleaner has a very streamlined user interface divided into tabs. The scanning job sequentially progresses to the next tab. It also scans for files matching their CRC checksums. Scanning is very fast in comparison to Clone Spy. Scan results are shown as a list in the results tab, where you can select any file by looking at its name, size, date, location, or use ‘Selection Assistant’. The Selection Assistant selects files of older date, smaller/greater size, having a specific string in file name or file path. It offers image preview of common image formats, and has a music search mode which can involve bit rate and size. It can also create hard links of the deleted duplicate files to the single file which you opt to keep. Hard linked files behave like any standard files, but are cross linked to one single file.

h**p://www.digitalvolcano.co.uk/content/duplicate-cleaner

CloneSpy  is the one of the oldest programs in its class. It's certainly not the fastest, but it's definitely the smartest. You can specifically select what is to be scanned and this can include multiple drives, multiple folders, or just individual folders. It has the ability to detect duplicates by CRC, by file name, by CRC and file name, and by file name and size. It will also detect zero length files. The program does not need to be installed but can be run from the executable so it's a good candidate for your USB Flash drive toolkit. It also throws up duplicates in a way that at least makes you think about what you are deleting. Click-happy users may find this latter feature an annoyance; to me it's a safety feature.

h**p://www.clonespy.com/

Easy Duplicate Finder is another option. It is a little more generic than Duplicate Finder with a simple user interface. Does not have image previews, dedicated music search, Selection assistant, Hard Link creator like Duplicate Finder. For its standard job i.e. finding duplicates, it is really easy to use, search process is speedy, system files can be excluded. It's also more recently developed than both the above. Please read the help file and use with care. In particular do NOT include your Windows folder in your scan unless you are a (very) knowledgeable user.  Latest version does require registration.

h**p://www.easyduplicatefinder.com/

Anti-Twin is a small software application which compares files, i.e. it searches for duplicate or similar files on your hard disk drive. All similar or identical files that were found can either be sent to the recycle bin or directly deleted. This will increase the hard disk space on your computer.

h**p://www.joerg-rosenthal.com/en/antitwin/

 8)


« Last Edit: April 27, 2010, 12:44:01 PM by lugh »
Chemistry is our Covalent Bond

Prepuce

  • Mighty Bhagwan
  • Subordinate Wasp
  • ***
  • Posts: 100
Re: File Duplicate Finder?
« Reply #8 on: April 28, 2010, 07:16:25 PM »
Thanks for the link, Naf1. I see one on the list that I'm going to try.

I still use http://thepiratebay.org for movies. I know there are a lot of other resources, but if it's popular PB always has it and it will download quickly. They have no quota for UL/DL so you don't have to worry about that.

PP
« Last Edit: April 28, 2010, 07:21:04 PM by Prepuce »
Support the never ending quest for new and better hedonicants. Send your gift today to:

 N & B H Foundation, Attn. Bhagwan SP
 University of Massachusetts at Los Angeles
 PO Box 6.02 X 10^23
 Houston, MD 884411

Prepuce

  • Mighty Bhagwan
  • Subordinate Wasp
  • ***
  • Posts: 100
Re: File Duplicate Finder?
« Reply #9 on: April 28, 2010, 07:25:27 PM »
Lugh, thanks for the references. I've tried Clonespy and Easy Duplicate Finder, and wasn't impressed with either. I stopped both because they were relatively slow, even though I'm not sure that anything can do the job very quickly. The trouble is that it's a process I want to monitor before I commit to deleting files, but I don't want the computer tied up all day. That's why Duplicate Cleaner sounds like it might be a good choice, so I'll try that one as well.

PP
Support the never ending quest for new and better hedonicants. Send your gift today to:

 N & B H Foundation, Attn. Bhagwan SP
 University of Massachusetts at Los Angeles
 PO Box 6.02 X 10^23
 Houston, MD 884411

Quantum Dude

  • Subordinate Wasp
  • ***
  • Posts: 192
Re: File Duplicate Finder?
« Reply #10 on: April 28, 2010, 09:22:32 PM »
System Mechanic