All times are UTC - 5 hours [ DST ]




Post new topic Reply to topic  [ 48 posts ]  Go to page Previous  1, 2, 3
Author Message
 Post subject: Re: Corrupted File Finder
PostPosted: November 28th, 2018, 14:17 
Offline
User avatar

Joined: April 22nd, 2015, 20:32
Posts: 225
Location: Portugal
Guys sorry for all the waiting but I've been debbuging some nasty bugs with some types of files.

I hope eveything will be ready in a weeks time.

_________________
BTC Wallet - 3AoQPTBsz9PbfoanCx44Lw76Y2TwtKa1x5


Top
 Profile  
 
 Post subject: Re: Corrupted File Finder
PostPosted: November 28th, 2018, 16:09 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 11556
Location: Australia
maximus wrote:
... there is a way to use the pro version of HDDSuperClone along with a Linux licensed copy of R-Studio to know exactly which files have the bad sectors. It involves using the virtual disk feature to present the recovery as a virtual block device to the system ... You then use R-Studio to extract the files from the virtual disk ...

Why do you need R-Studio for this? Why not just use "cat" to recursively copy each virtual file to dev/nul and record the results in a log file?

_________________
A backup a day keeps DR away.


Top
 Profile  
 
 Post subject: Re: Corrupted File Finder
PostPosted: November 28th, 2018, 18:22 
Offline

Joined: January 29th, 2012, 1:43
Posts: 588
Location: United States
fzabkar wrote:
maximus wrote:
... there is a way to use the pro version of HDDSuperClone along with a Linux licensed copy of R-Studio to know exactly which files have the bad sectors. It involves using the virtual disk feature to present the recovery as a virtual block device to the system ... You then use R-Studio to extract the files from the virtual disk ...

Why do you need R-Studio for this? Why not just use "cat" to recursively copy each virtual file to dev/nul and record the results in a log file?

That sounds good in theory, but what if there are errors in the file table? The OS can't handle that very well at all, and may not even list whole folders that R-Studio can find with ease. Besides, this is really meant for the actual file extraction from the image/clone. On a side note, DMDE does also work okay for this, but I found it clunky with too many pop-ups that I did not know how to answer when it encountered errors. I also tried TestDisk and it failed horribly (kept crashing). UFS Explorer wanted to scan the whole image with no option to do otherwise, so I don't consider it useful for file extraction through hddsuperclone.

If the issue is not having a good pattern to search for, but you can convert a map file to ddrescue to use with hddsuperclone, then another possibility would be to use the Fill Mark option. You would need to be sure the map conversion was correct (or you would overwrite good data), but the idea is that you image/clone the drive, convert the map to ddrescue, import that into hddsuperclone, then run the Fill Mark on the image/clone. That will make a very definite pattern you could find in the files after they are extracted with whatever tool you use. And that can be done with the free version of hddsuperclone, assuming you can convert the map file. And I guess you could even use ddrescue as it has a fill feature. Of course you would then need the nice tool this thread is about to search for the pattern :)

_________________
http://www.sdcomputingservice.com
Home of HDDSuperClone and HDDSuperTool


Top
 Profile  
 
 Post subject: Re: Corrupted File Finder
PostPosted: November 29th, 2018, 14:00 
Offline
User avatar

Joined: April 22nd, 2015, 20:32
Posts: 225
Location: Portugal
The product is now on beta release, I've implemented a key system that allows me to make updates without much hassle.

I'll be updating and releasing the tool here:

https://www.morde.pt/Products/CFF

bug reports are welcome so that fixed versions can be distributed to all the users with a valid key.

_________________
BTC Wallet - 3AoQPTBsz9PbfoanCx44Lw76Y2TwtKa1x5


Top
 Profile  
 
 Post subject: Re: Corrupted File Finder
PostPosted: November 29th, 2018, 23:25 
Offline

Joined: December 8th, 2010, 11:37
Posts: 643
Location: Ottawa, Canada
And it is FAST even on it's first release!

Quote:
My test job just completed: Scanned 668 Files, 92 Folders ( 556GB) in 1 hr 30 min. 28 sec. and found 68 Files corrupted files (45.3GB) which were moved to a Corrupted files folder. AMAZING! System is Win10 Pro x64, Core i7 @ 3.4Ghz, 8GB memory.

Congratulations!


These were video files averaging 832MB in length. Looking good, @DRUG! :D

_________________
Sabo Computer Repairs & Data Recovery


Top
 Profile  
 
 Post subject: Re: Corrupted File Finder
PostPosted: November 30th, 2018, 0:48 
Offline
User avatar

Joined: February 9th, 2009, 16:13
Posts: 2192
Location: Ontario, Canada
I guess I'm spooled with DDI and PC3000 verifying files in a matter of minutes.

That said, this is a great option for those who don't have the tools that do it automatically.

_________________
Luke
RAID Data Recovery


Top
 Profile  
 
 Post subject: Re: Corrupted File Finder
PostPosted: December 31st, 2018, 16:37 
Offline

Joined: March 20th, 2018, 7:55
Posts: 80
Location: Los Angeles
A log with file locations - (sorted by location), and the actual [bad-sectors-percent] ... even though you have a defined value for what 'instigates' the addition, for pictures or video, knowing the percent could be very useful.

A picture with bottom cut off of a dead relative is still desirable
... as would be
A 40 min video with 4 minutes corrupted ...

Ultimately, it's the client to decides the threshold; a binary answer can't mediate an agreement.

Maybe there's even a way to integrate the file generated at the end with devices such as the Atola, which I think (in addition to allowing you to fill irreparable areas) has a report at the end.

I'd assume there're many devices that do so, so having an API as well as including those devices which are most common would also increase your potential clientele.

Even though there're quite a few guys here who're are incredibly knowledgeable and able to write scripts such as that zip file in the first reply, some people (me for instance) would quickly get eliminated as 'potential client' the harder it gets to use it.

As a consumer of D.R. services, I've seen one shrewd "mediator" of the agreement to pay for services, which was a database created by NEOFINDER; you could confirm all things that were going to work, see which directories had the content and structure you wanted ... and it no doubt HUGELY mitigated the clients who'd bicker with him.

Then, there's the old project DeepSpar had, which was the entire pricing system and maybe even allowed payment gateway to be integrated... or the active project by HDDsurgery, would be interested in including it with their system, which manages parts, jobs, customers, etc. ? (In fact, I was evaluating making such a system as I've already has an associate create a Repairs module/inventory+unique transactions/invoicing/customerDB ... as well as a "recommerce" (buying product from customers as a trade-in, etc., including maintaining either a fingerprint on file for products that could fall within that category, as well as a means of showing "due diligence"... and can track products by the serial number -- we'd buy macs or subsidize purchases with trade ins, transfer their previous data or even do data recovery (which is how I stumbled in to this field).

Probably all SUBSTANTIALLY more than what you were thinking of when making a simplistic tool to solve a very narrow-focused problem. BUT! Once you start, the question is where cost-benefit dictates you stop.

Only one of, unfortunately, is web-based...the other is in FileMaker. But, that makes recreating v.2 much faster (programmatically) -- as it's substantially more detailed than most novice developers, creating out of necessity are adept at defining in a "functionality document." I could never be as granular as a completed project, "in animate" can be for someone to see what's desired vs. what wasn't good enough.

I have another friend (Eastern European guy... uber genius) who's made an INCREDIBLE program; this allows integration from the point of buying any product, automatic generation of auction content except the very product specifics until said product has been added once, to eBay or Amazon -- and then allows him to target specific competitors and to maintain being whatever amount under that person ... which he ALSO has a field to instruct it to wait [user defined] period to adjust the price, so that the person doesn't see it immediately, but when he later looks, he's #2 again for that exact item, OF people who have product volume [x], have feedback [y], with percentage positive minimum of [z], and so on. Essentially, it's such an intelligent platform that it'll teach people the logic of selling to a successful degree on ebay, etc. This is of course, integrated with his website, inventory, AND so on.

I've tried to work with him before on improving his repair webite's graphics but we didn't see eye to eye (it's so ugly that he probably wastes 50% of his traffic due to a lack of trust.

Anyway, I'll cut this off "here" as I doubt people read beyond paragraph 2.

Buena suerté Miguel, y mucha gracias.

Truman


Top
 Profile  
 
 Post subject: Re: Corrupted File Finder
PostPosted: December 31st, 2018, 17:56 
Offline
User avatar

Joined: December 19th, 2006, 8:49
Posts: 10828
Location: Portugal
If you have a imaging/cloning product that lets you select the pattern for the bad sectors just place there something unique like a bitcoin address + some random code. This will be written to the files that are partialy copied because of bad blocks.

When you are done imaging and extracting the files just use something like windows search to find the pattern that you did chose from the folder containing the recovered files. The files that do have your random pattern are the ones that are damaged.

Way better than using a zero pattern because some files might have that pattern on them. Way better to chose a random pattern that you are 100% sure that no file will have on them and then search for that pattern.

Regards.

_________________
1Q9xrDTzTddUXeJAFRn37aqh1Yr6buDCdw - (Bitcoin Donations)
paypal.me/Spildit - (PayPal Donations)
The HDD Oracle - Platform for OPEN research on Data Recovery.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 48 posts ]  Go to page Previous  1, 2, 3

All times are UTC - 5 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 0 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group