MultiDrive – free backup, clone & wipe disk utility from Atola Technology

All times are UTC - 5 hours [ DST ]




Post new topic Reply to topic  [ 9 posts ] 
Author Message
 Post subject: Copy 100 millon of files
PostPosted: June 6th, 2024, 17:40 
Offline

Joined: August 26th, 2021, 17:52
Posts: 71
Location: Brasil
I understand this might not be the right subforum for this question, and I apologize if I'm posting inappropriately.

This week, I completed a RAID recovery and extracted approximately 100 million files. It took me weeks to extract this information. My client has reviewed the data and wants to keep it. Now, I need advice on copying this vast amount of data. The total size is 2TB, but the challenge is the sheer number of files. I want to avoid a process that will take weeks.

I was considering using Norton Ghost, but I'm unsure if it can handle this volume of files and the partition size. The data is currently on a 22TB HDD. I also discovered that Norton Ghost hasn't had a new release since 2010. Does anyone have any suggestions for efficiently copying this large amount of data?

Thanks very much and my best regards


Top
 Profile  
 
 Post subject: Re: Copy 100 millon of files
PostPosted: June 6th, 2024, 20:43 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 16960
Location: Australia
Would it be faster if you were to compress the recovered files into one large archive, and then transfer that archive to the destination drive? If so, you could offer the client a discount for a smaller target drive.

_________________
A backup a day keeps DR away.


Top
 Profile  
 
 Post subject: Re: Copy 100 millon of files
PostPosted: June 6th, 2024, 20:48 
Offline
User avatar

Joined: May 13th, 2019, 7:50
Posts: 1150
Location: Nederland
Sell him that drive ;)

_________________
Joep - http://www.disktuna.com - video & photo repair & recovery service


Top
 Profile  
 
 Post subject: Re: Copy 100 millon of files
PostPosted: June 6th, 2024, 22:28 
Offline

Joined: November 1st, 2023, 13:36
Posts: 69
Location: Data Recovery
Why to copy when you can clone ?
I use my hardware imager for copying large data. A 2 TB disk cloning might take 2~3 hours max without bothering contents on the disk.
You can try software cloning tools like hddsuperclone


Top
 Profile  
 
 Post subject: Re: Copy 100 millon of files
PostPosted: June 7th, 2024, 6:36 
Offline

Joined: October 3rd, 2005, 0:40
Posts: 4753
Location: Hungary
@Misu: data was copied to a 22TB drive...

I see some potentially bad thing here. If that 22TB drive is SMR, no wonder it was slow to copy data out. However, if you compress it to a CMR drive, it might be faster now, coz no writing operation on the SMR is necessary.
I can't understand Franc's discount idea, could you pls make it clear? The OP already suffered a lot more than expected from a regular job, i guess he wasn't told the number of files... It is definitely a pain in the...

_________________
Adatmentés - Data recovery


Top
 Profile  
 
 Post subject: Re: Copy 100 millon of files
PostPosted: June 7th, 2024, 9:57 
Offline

Joined: November 1st, 2023, 13:36
Posts: 69
Location: Data Recovery
pepe wrote:
@Misu: data was copied to a 22TB drive...

I see some potentially bad thing here. If that 22TB drive is SMR, no wonder it was slow to copy data out. However, if you compress it to a CMR drive, it might be faster now, coz no writing operation on the SMR is necessary.
I can't understand Franc's discount idea, could you pls make it clear? The OP already suffered a lot more than expected from a regular job, i guess he wasn't told the number of files... It is definitely a pain in the...


Thanks pepe for correcting ,I thought its 2 TB disk.
Yes all drives coming are mostly SMR , I could not find any CMR disk anymore for my internal disk somehow I do not trust seagate / WD so only option left was Toshiba but they don't have any CMR


Top
 Profile  
 
 Post subject: Re: Copy 100 millon of files
PostPosted: June 7th, 2024, 10:09 
Offline

Joined: October 3rd, 2005, 0:40
Posts: 4753
Location: Hungary
there are cmr drives out there, like wd red plus, wd red pro, wd gold, and some seagate families too. Check datasheets, they usually note recording technology...

_________________
Adatmentés - Data recovery


Top
 Profile  
 
 Post subject: Re: Copy 100 millon of files
PostPosted: June 7th, 2024, 22:35 
Offline
User avatar

Joined: February 9th, 2009, 16:13
Posts: 2574
Location: Ontario, Canada
What about a smart partition copy with R-Studio?

_________________
Luke
Recovery Force Data Recovery


Top
 Profile  
 
 Post subject: Re: Copy 100 millon of files
PostPosted: June 19th, 2024, 12:10 
Offline

Joined: July 7th, 2014, 6:44
Posts: 225
Location: Switzerland
If your 22TB drive is not too much filled with other data, what about (defragmenting and) shrinking the partition to a smaller one (typically 2TB to 4TB), then cloning to a smaller drive with ddrescue or equivalent.
I assumed a NTFS partition where Windows would handle the shrinking quite well.

We would need to know more for the right guidance.

_________________
Data recovery in Geneva (Switzerland)
https://www.sosdonnees.ch/en


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 9 posts ] 

All times are UTC - 5 hours [ DST ]


Who is online

Users browsing this forum: ccc and 56 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group