You are reading a single comment by @CYOA and its replies.
Click here to read the full conversation.
London Fixed Gear and Single-Speed is a community of predominantly fixed gear and single-speed cyclists in and around London, UK.
This site is supported almost exclusively by donations. Please consider donating a small amount regularly.
vilms5000
@CYOA
I've utfg etc but can't find quite what I want. I've got a license of Hedge which, frankly, I hate. That doesn't do quite what I want either.
We have probably 50 terabytes of storage space across a couple of non-networked RAIDs. There are also maybe 30TB in single 1tb drives floating around. I'm in the process of binning off the 1TB drives so not that fussed about those for now as I update everything to SSD, however the 2 RAIDs are pretty crucial to us for archiving at the moment. There are occasions when a video project won't consolidate for whatever reason so we make a duplicate copy. I've always instructed anyone with access not to delete things from the RAID 'just in case' but it's reaching the stage where there are now surely at least 2 or 3 TB (or more) of unnecessarily duplicated files that should be cleaned up.
Question:
Is there some software that can scan a TB2 RAID, work out what duplicates there are and either flag them (if it can detect whether a file is 'complete' rather than a partial copy that'd be ideal) and if possible consolidate things automatically rather than just giving me a report of what to look for and where.
Ideally, I'd like to say "software, please look for a folder called X and a folder called Y and turn them into a new folder called Z with only original material in it; no duplicate files; keep the current folder/sub folder structures; and delete folders X & Y" (though even then that sounds horrendously risky...)