All times are UTC - 5 hours [ DST ]


Forum rules


Please do not post questions about data recovery cases here (use this forum instead). This forum is for topics on finding new ways to recover data. Accessing firmware, writing programs, reading bits off the platter, recovering data from dust...



Post new topic Reply to topic  [ 101 posts ]  Go to page 1, 2, 3, 4, 5, 6  Next
Author Message
 Post subject: Head Map Parser
PostPosted: January 22nd, 2021, 14:40 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
Dear all, I have made a small program that parses
Create Sub Map using Head Info .map files into legacy binary maps.
With this little tool, one can parse the said .map files into larger binary maps that is acceptable in DDI.
This enabled me me parse maps of Seagate,Samsung, Charger,Palmer to my beloved DDI and enabled me to image such drives with control over switching off heads/ switching to next heads and all the other functionality that exist.

I tried to add more information regarding average zone size, skip size, amount of size covered per head etc... that would help to image the faulty drives by setting the parameters as per the summary generated by the parser ( one needs to manually set in DDI 'available configuration' tab.

It is noted that it is very essential for your utility that generates sub map using heads info to create sum of length of chains equal to the final LBA/Size of the drive.

To use this file, unzip it to a location... add your map file in the inputmap folder. Use DevC++ and edit the name of input file as per your file name on line number 61 of the To_Upload.cpp code
I will try to upload a small video of how to do the above steps and compile.

Let me know how it works for all of you. :)
Thanks

Sin
PS: Thanks Serge for allowing me to put this freely and being supportive of my small pursuit of parsing the maps so I can day in day out use my DDI solely for creating quality images of drives that cant be traditionally headmapped.

Thanks to sourcerer for mentoring me and getting the best out of me to have the outputs presentable enough and giving great inputs in the journey (i would post outputs of how it looked earlier in initial stage of dev and you can see how it looks now with so much of more info that we both could think of.)

thanks ACE for allowing me to share my small parser.

and last but not the least: Thanks PEPE! YOU ARE MY MAN.. I demanded some reference file from him and he instantly gave it to me.


Attachments:
File comment: Unzip. Put your submap in inputmap folder. Do necessary filepath edits and get going.
TOUPLOAD.zip [989.41 KiB]
Downloaded 899 times
Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 22nd, 2021, 14:48 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
Also, use it at your own risk! :P just in case if i missed mentioning that.


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 22nd, 2021, 16:15 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
video link https://youtu.be/EoTOXK3yyvc


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 22nd, 2021, 16:30 
Offline

Joined: February 2nd, 2019, 1:21
Posts: 192
Location: Sri Lanka
Congratulations.


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 22nd, 2021, 17:21 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
thanks! :)
Lastly, this was not coded by any of the mfgs.. They are gods...Gods don't code in such a messy way.... ok?


FYI
this is strictly a personal project for self learning....I no way take responsibility and all the mfgs stated are indemnified aswell :D
---


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 22nd, 2021, 18:49 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 15461
Location: Australia
Is there any reason why you should use DDI to image the drive rather than DE? Or have you written this tool so that PC3K users don't need to purchase DE if they already have DDI?

_________________
A backup a day keeps DR away.


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 3:20 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
fzabkar wrote:
Is there any reason why you should use DDI to image the drive rather than DE? Or have you written this tool so that PC3K users don't need to purchase DE if they already have DDI?


Hey, i am quite a novice DE user but an experienced DDI user. Apparently, this function of map interchangeability existed in the past till some point. How ever, the case is not the same any more.

One requires both the tools for parser to be useful.
I wrote it purely to have some fun and experiment. However, there is a serious research going on the conventional heads.map file which is far more complicated to parse. Won't say 'not possible' though.

The skill set gained just increases employ ability, i believe.

--


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 3:21 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
here you go : https://www.data-medics.com/forum/ddi-to-de-t2565.html


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 3:38 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 15461
Location: Australia
That makes sense. Thanks for the tool. Hopefully I'll learn something, too.

_________________
A backup a day keeps DR away.


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 7:34 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
you are so humble :)
<3
--


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 15:11 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 15461
Location: Australia
Just a couple of questions ...

There are sections of unicode text which you refer to as footers ("Head#n").

For example, this is "Head#1":

Code:
0600 4800 6500 6100 6400 2300 3100

It would appear that the first word is a character count, ie 6. AIUI, your code assumes that the maximum head number is 9 ("Head#9"). I'm wondering what would happen if there were a case where the head count were 10 or greater. Would the 10th head become "Head#A" or "Head#10"? In the latter case, would the word count become 0x0800 rather than 6?

IIUC, the MAP file consists of a short header followed by fixed length records of size 0x2A.

Here is an excerpt form palmertest.MAP:

Code:
Offset(h) 00   02   04   06   08   0A   0C   0E   10   12   14   16   18   1A   1C   1E   20   22   24   26   28

00000000  0000 0000 0000 0000 0000 0000 0000 0000 B81B 0000 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3000  ... H.e.a.d.#.0.
0000002A  B81B 0000 0000 0000 B01D 0000 0000 0000 C028 0000 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3000  ... H.e.a.d.#.0.
00000054  7844 0000 0000 0000 E8DE 0200 0000 0000 1809 0000 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3000  ... H.e.a.d.#.0.
0000007E  904D 0000 0000 0000 8019 0500 0000 0000 2823 0000 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3000  ... H.e.a.d.#.0.
000000A8  B870 0000 0000 0000 F89F 0F00 0000 0000 4804 0000 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3000  ... H.e.a.d.#.0.
000000D2  0075 0000 0000 0000 40A4 0F00 0000 0000 3813 0000 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3100  ... H.e.a.d.#.1.

AFAICT from your code, this is the structure of these records:

Code:
bytes 0 - 7    start LBA
bytes 8 - F    ??
bytes 10 - 17  size in LBAs
bytes 18 - 1B  always 0x00 ?
bytes 1C - 1D  number of unicode characters in "Head#n" footer
bytes 1E - 29  "Head#n" footer

Can you tell us what bytes 8 - F mean?

I notice that for other drives, eg Vinod.MAP, the first two parameters are always identical:
Code:
Offset(h) 00   02   04   06   08   0A   0C   0E   10   12   14   16   18   1A   1C   1E   20   22   24   26   28

000048AE  F09C 9BE6 0000 0000 F09C 9BE6 0000 0000 E0A7 E500 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3100  ... H.e.a.d.#.1.
000048D8  D044 81E7 0000 0000 D044 81E7 0000 0000 7029 FF00 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3000  ... H.e.a.d.#.0.
00004902  406E 80E8 0000 0000 406E 80E8 0000 0000 C085 2300 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3100  ... H.e.a.d.#.1.
0000492C  00F4 A3E8 0000 0000 00F4 A3E8 0000 0000 E0CF 2200 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3200  ... H.e.a.d.#.2.
00004956  E0C3 C6E8 0000 0000 E0C3 C6E8 0000 0000 D0C4 1900 0000 0000 0000 0000 0600 4800 6500 6100 6400 2300 3300  ... H.e.a.d.#.3.

Are bytes 18 - 1B always 0? Do you know their meaning?

_________________
A backup a day keeps DR away.


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 17:20 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
You are very correct. I have limited the parsing to just 10 heads. Infact I do not have any hard drives right now with me that have 10 heads. (Usual drives for recovery in my place are of 160GB to 4TB capacity, 4TB being really rare)
I guess a 4tb palmer/charger would have 10 heads but sadly I do not have any donated pieces by customers for any experimentation (yes openly ask for a donation from the client once the recovery is done and the client has checked his data+ backed it up else where. Some people love us enough to donate it :)


Generic record size that I could set was of 2A length, you are correct



For heads more than 9, It should ideally go up in its count as in 3A to signify 10 heads.. and thats where the footer count should increase intuitively (bytes 1E - 29)


bytes 0 - 7 start LBA ------------------->Is repeated in the same 7 bytes fro 08 to 0F
bytes 8 - F ?? --------------------> examine the heads footer at end of file, you will see 0-7 == 8-F i believe

bytes 10 - 17 size in LBAs
bytes 18 - 1B always 0x00 ? yes atleast for the ones i checked uptill 4tb
bytes 1C - 1D number of unicode characters in "Head#n" footer
bytes 1E - 29 "Head#n" footer ....never paid attention...but seems legit, need more heads to really verify.

Are bytes 18 - 1B always 0? Do you know their meaning? so far yes, they are empty .....empty across quite a few maps i checked.

I ignored the header for now completely as most of the job was getting done for the capacities that I got without accounting for the header.

It will be cool if people can test it with drives larger than 4tb and share the submap here.
:)


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 17:31 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
well wait a sec I was wrong.

Try to carve out a few segments from any mapfile

try below file


Attachments:
unt.zip [199 Bytes]
Downloaded 732 times
I was Wrong.png
I was Wrong.png [ 115.4 KiB | Viewed 28114 times ]
Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 17:34 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 15461
Location: Australia
ISTM that the head number is an ASCII code, eg "1" = 0x31 ASCII. Therefore 0x3A would be the ASCII code for a colon ":". Instead I would expect to see 0x41 (the ASCII code for "A"), if the head numbers were hexadecimal.

Otherwise, in the case of decimal numbers, I would expect to see "Head#10" -> 0x48,0x00,0x65,0x00,0x61,0x00,0x64,0x00,0x23,0x00,0x31,0x00,0x30,0x00

As for bytes 8 - F, look at the Palmer example.

_________________
A backup a day keeps DR away.


Last edited by fzabkar on January 23rd, 2021, 17:38, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 17:36 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
So just take any length of any example .map file provided.

Just in the .H.E.A.D.#.XX area put 3A and the parser would parse it as 10 heads. :)


just increase the size of the arrays which are globally declared to account for more than 10 heads. WOULD WORK IF THEY ARE USING HEX TO STORE IT THIS WAY

float data_sum_of_length = 0 ;
float GB_TOTAL =0 ;
float head_lba[10] = {0}; this one
float head_lba_total[10] = {0}; this one
int enable_debug = 0;
int save_lba_log = 1;
int number_of_zone = 0;

--


Last edited by sin on January 23rd, 2021, 17:39, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 17:37 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
Just try this..I have tried a hex value, it works..however not sure if thats how the company would store too
carve out a section...
however for more than 10 heads, you will need to increase the array sizes too for the code to work


Last edited by sin on January 23rd, 2021, 17:40, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 17:38 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
but as fact of matter, i really do not have an idea what methodology ACE is using to store...can be hex, can be ascii.
Hex seems reasonable though :P


Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 17:40 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 15461
Location: Australia
I don't think that is correct. I think the footer is a Unicode text string. It doesn't make sense to me any other way. I believe you are overthinking this parameter. :-)

_________________
A backup a day keeps DR away.


Last edited by fzabkar on January 23rd, 2021, 17:43, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 17:41 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
Also, the palmer example provided is a 1tb drive...2heads. I guess. Sorry..many things have not been documented in the right way..i need to learn good documentation for sure. :D


Last edited by sin on January 23rd, 2021, 17:50, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: Head Map Parser
PostPosted: January 23rd, 2021, 17:42 
Offline

Joined: September 17th, 2016, 16:06
Posts: 430
Location: India
correct, if it is unicode, which is reasonable too because they have it displayed in the ABOUT coloumn...parser wont work for more than 0x39 value.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 101 posts ]  Go to page 1, 2, 3, 4, 5, 6  Next

All times are UTC - 5 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 16 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group