Suggestions for eliminating duplicate files

GEC: Discuss gaming, computers and electronics and venture into the bizarre world of STGODs.

Moderator: Thanas

Post Reply
User avatar
Borgholio
Sith Acolyte
Posts: 6297
Joined: 2010-09-03 09:31pm
Location: Southern California

Suggestions for eliminating duplicate files

Post by Borgholio »

I'm out of hard drive space. It's due to the fact I have as many as 7 or 8 copies of a lot of my files...pictures, videos, documents, etc... This is typically because when I was going through old hard drives in the garage, I copied the contents to my current drive to sort through later in case there was something I wanted to keep. But now I'm out of room. Currently I'm using the duplicate file finder contained within the PerfectDisk program and it works...ok. But it's slow and kinda tedious to use. Does anybody have any suggestions on the best way to search for and eliminate duplicate files? Any recommended programs or tricks I can use? Thanks!
You will be assimilated...bunghole!
User avatar
Zixinus
Emperor's Hand
Posts: 6663
Joined: 2007-06-19 12:48pm
Location: In Seth the Blitzspear
Contact:

Re: Suggestions for eliminating duplicate files

Post by Zixinus »

CCleaner has such a functionality and there is also this one I use that's also free.
Credo!
Chat with me on Skype if you want to talk about writing, ideas or if you want a test-reader! PM for address.
User avatar
Elheru Aran
Emperor's Hand
Posts: 13073
Joined: 2004-03-04 01:15am
Location: Georgia

Re: Suggestions for eliminating duplicate files

Post by Elheru Aran »

And once you're done with cleaning up your dupes, find a external hard drive that's pretty durable and transfer everything to it, then use that as a long-term storage resource once you're done. I'm assuming the kind of thing you're trying to save are personal pictures, documents, work stuff, other records and what not. You don't need to keep duplicating that stuff.
It's a strange world. Let's keep it that way.
User avatar
Borgholio
Sith Acolyte
Posts: 6297
Joined: 2010-09-03 09:31pm
Location: Southern California

Re: Suggestions for eliminating duplicate files

Post by Borgholio »

Yeah I already use Crashplan to backup to an external drive on another computer as well as offsite cloud backup, so I have enough duplication as it is. Trouble is all the crap I found on my older hard drives. :)
You will be assimilated...bunghole!
User avatar
Sea Skimmer
Yankee Capitalist Air Pirate
Posts: 37390
Joined: 2002-07-03 11:49pm
Location: Passchendaele City, HAB

Re: Suggestions for eliminating duplicate files

Post by Sea Skimmer »

If you know you have lots of duplicate videos just start searching by the file extensions and sort that by name and size. That will clear up space quicker then anything else.
"This cult of special forces is as sensible as to form a Royal Corps of Tree Climbers and say that no soldier who does not wear its green hat with a bunch of oak leaves stuck in it should be expected to climb a tree"
— Field Marshal William Slim 1956
User avatar
The Infidel
Jedi Master
Posts: 1345
Joined: 2009-05-07 01:32pm
Location: Norway

Re: Suggestions for eliminating duplicate files

Post by The Infidel »

Elheru Aran wrote:And once you're done with cleaning up your dupes, find a external hard drive that's pretty durable and transfer everything to it, then use that as a long-term storage resource once you're done. I'm assuming the kind of thing you're trying to save are personal pictures, documents, work stuff, other records and what not. You don't need to keep duplicating that stuff.
This! You want a backup!
Sometimes a disk crashes, sometimes you delete by mistake, sometimes it's ransomware. I've had a disk crash. Probably the controller. It went dead in less than one second and nothing could be done on the low side of a few thousand dollars. Ransomware is an expanding "industry", and we will see more of this in 2017.
Image
Image
Where am I at in the post apocalypse draft? When do I start getting picks? Because I want this guy. This guy right here. I will regret not being able to claim the quote, "The first I noticed while burning weed, so I burned it, aiming at its head first. It wriggled for about 10 seconds. Too long... I then fetched an old machete [+LITERALLY ANYTHING]"
- Raw Shark on my slug hunting
User avatar
Zixinus
Emperor's Hand
Posts: 6663
Joined: 2007-06-19 12:48pm
Location: In Seth the Blitzspear
Contact:

Re: Suggestions for eliminating duplicate files

Post by Zixinus »

I second Infidel's: hard disk have a tendency to cough up and die. External hard drives too.

Use something like CrystalDiskInfo to check this. You might get a warning.

It is also recommended that you do defragmentation or a hard disk check with sector checking on them (even on flash drives from time to time).
Credo!
Chat with me on Skype if you want to talk about writing, ideas or if you want a test-reader! PM for address.
User avatar
Ace Pace
Hardware Lover
Posts: 8456
Joined: 2002-07-07 03:04am
Location: Wasting time instead of money
Contact:

Re: Suggestions for eliminating duplicate files

Post by Ace Pace »

Zixinus wrote: It is also recommended that you do defragmentation or a hard disk check with sector checking on them (even on flash drives from time to time).
no no no no no no
Just no. What the fuck is this 90s advice.

You should not defragment a flash drive. Ever.
You should not need to defragment a drive that is formatted with a modern file system (NTFS, ext3/4) and a modern OS (Win7 and up). In rare cases will it improve things.
Brotherhood of the Bear | HAB | Mess | SDnet archivist |
User avatar
Zixinus
Emperor's Hand
Posts: 6663
Joined: 2007-06-19 12:48pm
Location: In Seth the Blitzspear
Contact:

Re: Suggestions for eliminating duplicate files

Post by Zixinus »

The point isn't defragmentation but sector check. Which I should have said.
Credo!
Chat with me on Skype if you want to talk about writing, ideas or if you want a test-reader! PM for address.
Post Reply