All times are UTC - 5 hours [ DST ]




Post new topic Reply to topic  [ 18 posts ] 
Author Message
 Post subject: HDDSuperClone - A new Linux hard drive cloning/imaging tool
PostPosted: April 16th, 2016, 22:24 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
I would like to introduce HDDSuperClone, a new advanced Linux based hard drive cloning/imaging tool. The current free version is comparable to gnu ddrescue, and should actually be better in some ways. Please visit the home page for more information.

http://www.sdcomputingservice.com/hddsuperclone


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: April 17th, 2016, 8:00 
Offline
User avatar

Joined: December 19th, 2006, 8:49
Posts: 7863
Location: Portugal
Thanks !!!
:D :D :D

_________________
1Q9xrDTzTddUXeJAFRn37aqh1Yr6buDCdw - (Bitcoin Donations)
The HDD Oracle - Platform for OPEN research on Data Recovery.


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: April 17th, 2016, 8:06 
Offline
User avatar

Joined: April 3rd, 2011, 0:19
Posts: 1615
Location: Providence, RI
There's a lot of discussion of the tool here already: https://www.data-medics.com/forum/hddsu ... t1262.html

Definitely is a cool project with a ton of potential.

_________________
Hard Drive & RAID Data Recovery Services
https://www.data-medics.com/raid-data-recovery/


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: July 13th, 2016, 20:56 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
I have received very little feedback on the free version of HDDSuperClone so far, so I am bumping this up to try to get more people interested in the cloning tool. Only one person (thank you!) has provided productive feedback and I have addressed the issues that were found so far. More need to try it out and test and provide feedback, that is the only way bugs can be found and improvements can be made.


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: July 24th, 2016, 10:51 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
It has been requested a few times and I have said I was not going to do it because it would be too much work and too time consuming. Well, I went ahead and did it anyway. I created a Live CD with my tools installed on it. It is available through the website. Enjoy!
http://www.sdcomputingservice.com/hddlivecd


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: July 31st, 2016, 15:20 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
A new version of HDDSuperClone free has been released. The biggest changes are that now ATA passthrough mode is enabled in the free version, which can help in cases where the Linux kernel performs extra retries or some other weird thing in SCSI passthrough mode. And the skip threshold time has also been enabled for the free version. This allows skipping of slow areas of a bad head when it is not producing enough or any errors that would otherwise induce the head skipping algorithm. Just be aware that now with the skip threshold enabled a drive that suffers from a slow response issue due to a firmware glitch will trigger runaway skipping that will cause skip resets, unless you set the skip threshold to a high time to disable it such as 60000ms (60 seconds).

HDDSuperClone Changelog
version 1.2 2016
* Added support for importing new style ddrescue log
* Now asks for progress file if not provided
* Image file is now an option for target choice
* ATA mode is now allowed in free version
* Skip threshold is now allowed in free version
* Removed options not available in free version
* Internal code changes to allow for future GUI


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: August 20th, 2016, 21:38 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
I finally have a report where HDDSuperClone free version very much outperformed ddrescue. The short version is that the drive appears to have one head out of four that is not reading any data at all. The user gave up trying with other cloning tools, including ddrescue, because they were taking too long with very little results, and gave HDDSuperClone a try. It recovered about 73.9% of the data in a reasonable amount of time (see the full report on the website for more info). The user also suffered a power loss during the recovery which caused a partially written progress log file, showing that the backup log file is very useful as the backup file was fully intact. The full version of this report can be viewed on the website at the following link:
http://www.sdcomputingservice.com/hddsu ... ss-stories


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: August 21st, 2016, 6:58 
Offline

Joined: August 18th, 2010, 17:35
Posts: 3058
Location: Massachusetts, USA
Great to hear. Congratulations.

I looked around on the site, but could not find info on the "head self-learning" component of the software. Please, can you expand on what this part of the technology is doing exactly?

_________________
Hard Drive and RAID Data Recovery Specialist in Massachusetts


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: August 21st, 2016, 9:53 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
From the HDDSuperClone main page:
Quote:
There is also another advantage of HDDSuperClone. It has an advanced self learning head skipping algorithm that will attempt to skip out of a bad head in about 7 bad reads. This can make getting the data from the good heads much faster. Hardware imagers can “turn off” a head and only read data from the good heads which is ideal, but that requires using special vendor specific commands. The head skipping algorithm of HDDSuperClone is about as close as one can hope to get to that without special commands.

And from the manual under Theory of Operation:
Quote:
Phase 1 is a copy pass forward with skipping. Phase 2 is a copy pass backward with skipping. Together they offer the best attempt to get the most good data first and fast from the good areas of the drive. The skipping is based on read errors and will skip when a read error is encountered, and self adjusts to try to skip out of a bad head in about 7 read errors. A read that takes longer then the –skip-threshold value will also trigger a skip event. The skipping starts out at –skip-size, and increases as needed per the algorithm, unless it hits –max-skip-size in which case it is reset back to –skip-size. These two passes are the money passes. If after these two passes you don’t have a percentage complete in the upper 90’s then you likely have a weak/damaged head, and the next phases could take a long time to complete.

From the Usage section of the manual, just to point out that the skipping could go crazy on a drive with a slow reading issue without changing a setting:
Quote:
‘--skip-threshold <ms>’

The time in milliseconds for a read that will trigger a skip event, the default is 2000 (2 seconds). This option only applies to copy phases 1 and 2. This is meant for drives that have very slow reading areas but not enough if any errors in those areas to trigger the skipping algorithm. Any read that takes longer than the value of the setting will trigger a skip event. Note that for drives that have a "slow responding" issue this will cause runaway skipping and you will see the skip reset count increase. If this happens you may need to use the –reset-status option and start over with adjusted options. To disable this threshold just set it to a high number such as 60000 (60 seconds).

And from the Understanding the Display section of the manual:
Quote:
Skip size is the current base skip size. This can grow if the head skipping algorithm is triggered. Skips is the total number of times the program has skipped since the program was started. Runs is how many skip runs have happened since the program was started. If you see the run count growing, it likely means there is a weak/damaged head. Resets is the number of times the skip size had to be reset. Under normal circumstances the reset count should remain at zero. If it is greater than zero it is an indication of a problem with either too large of an initial skip size, too small of a max skip size, or it is not reading much if any data, and you may need to adjust the skip size and max skip size to handle a special condition. Recent is the highest reported skip since the last display update. This can be greater than the base skip size as it is controlled by the skipping algorithm.


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: August 21st, 2016, 14:25 
Offline

Joined: August 18th, 2010, 17:35
Posts: 3058
Location: Massachusetts, USA
Great job on the explanations. These are very valuable, well, for those who will care enough to read. Thanks.

_________________
Hard Drive and RAID Data Recovery Specialist in Massachusetts


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: August 21st, 2016, 17:14 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 9615
Location: Australia
maximus wrote:
I finally have a report where HDDSuperClone free version very much outperformed ddrescue.

Nice! Congratulations.

_________________
A backup a day keeps DR away.


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: August 21st, 2016, 19:27 
Offline

Joined: December 8th, 2010, 11:37
Posts: 512
Location: Ottawa, Canada
"I finally have a report where HDDSuperClone free version very much outperformed ddrescue."

Congrats! Your dedication and hard work are bearing fruit. (I was going to say, paying off, but that comes with the paid version.) It must be very gratifying to see such excellent results. Kudos, well earned!

_________________
Sabo Computer Repairs & Data Recovery


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: November 28th, 2016, 21:06 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
It seems I missed posting on here for the last version, so now the newest version changelog:

HDDSuperClone Changelog

version 1.4 20161125
* Fixed the long option --progressfile
* Extra information has been added to the progess file
* It will now reload skip info from the progress file
* Fixed a bug with reverse in phase1
* Changed the recent skip to run size

version 1.3 20161015
* More internal code changes
* If log has errors it now mentions the repair option
* Fixed bug with exiting on device fault
* Fixed bug that produced log lines of same status
* Improved skipping algorithm
* Fixed a bug where imported ddrescue log was not repaired


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: November 28th, 2016, 21:07 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
Also, an update to HDDSuperTool:

HDDSuperTool Changelog

version 1.8-1.7 20161125
* Improved some IO code for direct mode
* Improved some of the WD VSC scripts
* Added the script wd_royl_read_rom
* Added the script wd_royl_check_rom
* Added the script wd_royl_write_rom


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: November 28th, 2016, 21:11 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
I have added the WD ROM read and write capability scripts for HDDSuperTool, with the hope that it could make it easier for someone to swap from a USB to SATA PC board. If the USB drive can be seen in Linux then there is a good chance that the ROM can be dumped. It may even be possible on drives that are SA locked, but that is yet to be seen. I would be interested to know if ROM can be read on the drives that cannot access SA (modules).


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: December 1st, 2016, 14:29 
Offline
User avatar

Joined: December 19th, 2006, 8:49
Posts: 7863
Location: Portugal
Thanks for the update !!!

_________________
1Q9xrDTzTddUXeJAFRn37aqh1Yr6buDCdw - (Bitcoin Donations)
The HDD Oracle - Platform for OPEN research on Data Recovery.


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: May 30th, 2017, 19:50 
Offline

Joined: January 29th, 2012, 1:43
Posts: 287
Location: United States
I have not been keeping up with updates on here very well. But I would like to announce that I have just released a beta GUI version of HDDSuperClone. At this time to run the GUI version you must use the --gui option on the command line. Or if you download the live CD, you can click an icon on the desktop. It still needs some work, but the GUI should operate as a fully functioning cloning tool.


Top
 Profile  
 
 Post subject: Re: HDDSuperClone - A new Linux hard drive cloning/imaging t
PostPosted: May 30th, 2017, 20:12 
Offline
User avatar

Joined: December 19th, 2006, 8:49
Posts: 7863
Location: Portugal
Thanks for the update !!!

_________________
1Q9xrDTzTddUXeJAFRn37aqh1Yr6buDCdw - (Bitcoin Donations)
The HDD Oracle - Platform for OPEN research on Data Recovery.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 18 posts ] 

All times are UTC - 5 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 6 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group