NCQ Question

[Tech3300]

We have a couple dozen servers at work running CCTV systems that use raid controllers, and all have raid5 arrays. Besides a few Seagate array, most of them are all using the same wd3000fyyz-01ul1b1 drives with 01.01KX1 firmware.

The latest drives I bought from the same seller are the same model, but a different firmware - Q. They will not build into any of the controller arrays I tested due to queuing being needed. Apparently, in these new drives I bought, the NCQ features is not enabled two test software's and my controller's error log.

Looking into NCQ, I don't see an easy way to turn it on. It appears that this is done at the factory the firmware. Is getting this feature to be enabled, as simple as flashing the drives to a different fw? Or is there another way to enable this feature?

[Tech3300]

Firmware of the new NCQ disabled drives are 01.04Q.2

[peter67]

To resolve the issue with the new drives not supporting NCQ (Native Command Queuing), consider updating the firmware to a version that enables this feature. Flashing the drives with a compatible firmware should address the problem.

[fzabkar]

Can you dump the firmware using the demo version of WDMarvel?

Here is an example:

https://files.hddguru.com/download/PC-3000-UDMA%20Support/WDC%20Marvell%20family%20utility/Kojn%20RE/WDC%20WD3000FYYZ-01UL1B1-01-01K02-WD-WMC1F2089046.rar

Can you dump the Device Configuration Overlay (DCO) information using HDAT2? The solution may be as simple as flipping the NCQ Feature Set Supported bit in word 76.

[fzabkar]

I think these are the relevant excerpts from the ATA standards. I could be wrong, though.

Attachments

[Tech3300]

https://file.io/sWZM7G2Xvp8C is the PZU



Log data, also attached above.



12/6/2023 10:53:17 AM: Successfully read 7 modules
12/6/2023 10:53:35 AM: Error reading module ID5D, state - FM_ERR_HEADER_II_SIGNATURE_INVALID
12/6/2023 10:53:36 AM: Error reading module ID5D, state - FM_ERR_HEADER_II_SIGNATURE_INVALID
12/6/2023 10:53:51 AM: Error reading module ID5D, state - FM_ERR_HEADER_II_SIGNATURE_INVALID
12/6/2023 10:53:57 AM: Reading modules...
12/6/2023 10:53:57 AM: An exception has occurred!
Type: EAccessViolation App version: 4.0.4
Message: Access violation at address 001C2BA7 in module 'WDMarv.exe'. Write of address 02FCF4A0
------------------------------------------------------------------------ Call Stack ------------------------------------------------------------------------
> [001C2BA7] System.Move (Line 3287, "system.pas")
> [001C46C3] System.@HandleAnyException (Line 9362, "system.pas")
> [0039BE9D] ATATransport.ATA28CommandDataIn (Line 769, "ATATransport.pas")
> [001C8D24] Windows.CopyMemory (Line 30542, "Windows.pas")
> [004765C4] PZUModuls.TfmPZUModuls.Button2Click (Line 791, "PZUModuls.pas")
> [0023A0F8] Menus.TMenuItem.GetItem (Line 1658, "Menus.pas")
> [0023A5BD] Menus.TMenuItem.Click (Line 1787, "Menus.pas")
> [0023BD4D] Menus.TMenu.DispatchCommand (Line 2507, "Menus.pas")
> [00247199] Forms.TCustomForm.WMCommand (Line 4034, "Forms.pas")
> [00225177] Controls.TControl.WndProc (Line 4561, "Controls.pas")
> [00228CFE] Controls.TWinControl.WndProc (Line 6242, "Controls.pas")
------------------------------------------------------------------------------------------------------------------------------------------------------------



Format version = 0x0002
Controller firmware version = 01.2AQ
Servo firmware version = 04.0F
Overley firmware version = 01.2BQ
Surface format version = EX.A00
Read channel firmware version = G.00002A
Media count = 5
Physical head count = 10
Used head count = 9
Used head map =
Drive type = Enterprise 3.5 Inch
Zone count = 61
Servo wedges count = 384
SA track count = 256
Spindle motor RPM = 7200
UA track count = 0
Cylinder skew = 30
Head skew = 120
Cluster Skew = 200
Code Residence = 5
PCBA type = Entek
Interface type = Serial ATA
Installed memory = 64Mb

Parts info
Controller chip Vendor = 0x0000
Controller chip rev = 0x96C1
MicroP Vendor = 0x0000
MicroP Rev = 0x96C1
Channel Chip Vendor = 0x0099
Channel chip Rev = 0x0011
Preamp Vendor = 0x0001
Preamp Rev = 0x0003
Power IC vendor = 0x0000
Power IC Rev = 0xC025

ECC correction info
No. of interleaves in OTF ECC corr = 0
Number of bytes corrected by OTF = 0
Number of bytes corrected by FW burst corr = 0
No. of ecc bytes in read/write long sector = 0

Format info
Tracks per inch (in KTPI) = 0
Area density = 685Gb
Drive Format Type = 1

Media manufacturer code - E
Head manufacturer code - E

Drive config
Format version = 0x0300
DCM Selection = 0x0001
cur_stroke = 0x0001
used_heads = 00009
phy_heads = 0x000A
max_fmt_LBAs = 5987370816 - 3065Gb
max_target_LBAs = 5860533168 - 3000Gb
target_capacity = 0x0002
hq_capacity = 0x0002
max_HQ_LBAs = 5987370816 - 3065Gb
final_capacity = 0x0002
zone_count = 60

max_LBA_for_head_0 = 642030480 - 328Gb
Head 0 Zone TPI = 0x0C 0x0C 0x0C 0x0D 0x0D 0x0C 0x0D 0x0D 0x0D 0x0D 0x0E 0x0E 0x0E 0x0E 0x0F 0x0F 0x0F 0x0F 0x0F 0x10 0x10 0x10 0x10 0x10 0x10 0x11 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x13 0x13 0x13 0x13 0x13 0x12 0x12 0x12 0x12 0x12 0x12 0x11 0x11 0x11
Head 0 Zone Cap = 0x1F 0x1F 0x1F 0x1F 0x1F 0x1F 0x1F 0x1F 0x1F 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1E 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D

max_LBA_for_head_1 = 671702976 - 343Gb
Head 1 Zone TPI = 0x0D 0x0D 0x0E 0x0F 0x0F 0x0F 0x0F 0x10 0x10 0x10 0x10 0x11 0x11 0x12 0x12 0x12 0x13 0x13 0x13 0x13 0x13 0x14 0x14 0x14 0x14 0x14 0x14 0x14 0x14 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x14 0x13 0x13 0x13 0x13 0x13 0x13 0x13 0x12 0x12 0x12
Head 1 Zone Cap = 0x1B 0x1C 0x1C 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A

max_LBA_for_head_2 = 642030480 - 328Gb
Head 2 Zone TPI = 0x10 0x11 0x11 0x11 0x12 0x12 0x11 0x11 0x12 0x12 0x12 0x12 0x13 0x13 0x13 0x13 0x14 0x14 0x14 0x14 0x14 0x14 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x17 0x17 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x15 0x15 0x16 0x16 0x16
Head 2 Zone Cap = 0x1C 0x1C 0x1C 0x1C 0x1C 0x1D 0x1D 0x1D 0x1D 0x1D 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D 0x1D

max_LBA_for_head_3 = 671702976 - 343Gb
Head 3 Zone TPI = 0x0A 0x0A 0x0A 0x0C 0x0C 0x0C 0x0D 0x0D 0x0D 0x0D 0x0E 0x0E 0x0E 0x0E 0x0F 0x0F 0x0F 0x0F 0x0F 0x10 0x10 0x10 0x10 0x10 0x10 0x11 0x11 0x11 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x13 0x13 0x13 0x13 0x13 0x13 0x13 0x13 0x13 0x13 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12
Head 3 Zone Cap = 0x1C 0x1D 0x1D 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1C 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A

max_LBA_for_head_4 = 682548048 - 349Gb
Head 4 Zone TPI = 0x0F 0x0F 0x0F 0x0F 0x10 0x10 0x10 0x11 0x11 0x11 0x11 0x12 0x12 0x12 0x12 0x12 0x13 0x13 0x13 0x13 0x13 0x14 0x14 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x15 0x16 0x16 0x16 0x16 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x18 0x18 0x18 0x18 0x18 0x18 0x18 0x18 0x18 0x19 0x19 0x18 0x18
Head 4 Zone Cap = 0x1A 0x1A 0x1A 0x1A 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x1A 0x1A 0x1A 0x19 0x19 0x19

max_LBA_for_head_5 = 661552416 - 338Gb
Head 5 Zone TPI = 0x0B 0x0B 0x0A 0x0B 0x0B 0x0B 0x0C 0x0B 0x0B 0x0C 0x0C 0x0C 0x0C 0x0D 0x0D 0x0D 0x0D 0x0D 0x0E 0x0E 0x0E 0x0E 0x0D 0x0E 0x0E 0x0E 0x0E 0x0E 0x0E 0x0E 0x0E 0x0F 0x0F 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x0F 0x10 0x10 0x10 0x10 0x10 0x10 0x11 0x10 0x10 0x10 0x10 0x10 0x10 0x10
Head 5 Zone Cap = 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B

max_LBA_for_head_6 = 661552416 - 338Gb
Head 6 Zone TPI = 0x12 0x12 0x12 0x12 0x13 0x13 0x13 0x13 0x14 0x14 0x14 0x14 0x15 0x15 0x15 0x15 0x15 0x16 0x16 0x16 0x16 0x16 0x16 0x16 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x17 0x18 0x18 0x18 0x18 0x18 0x18 0x18 0x18 0x18 0x18 0x18 0x18 0x19 0x19 0x19 0x19 0x18 0x19 0x19 0x19 0x19 0x19 0x18 0x18
Head 6 Zone Cap = 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B

max_LBA_for_head_7 = 682548048 - 349Gb
Head 7 Zone TPI = 0x0D 0x0D 0x0D 0x0E 0x0D 0x0D 0x0E 0x0E 0x0D 0x0D 0x0E 0x0E 0x0E 0x0E 0x0F 0x0F 0x0F 0x0F 0x0F 0x0F 0x0F 0x0F 0x0F 0x0F 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x10 0x11 0x11 0x11 0x11 0x11 0x11 0x11 0x11 0x11 0x11 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12 0x12
Head 7 Zone Cap = 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1B 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19 0x19

max_LBA_for_head_8 = 671702976 - 343Gb
Head 8 Zone TPI = 0x0B 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0A 0x0B 0x0B 0x0B 0x0B 0x0B 0x0B 0x0B 0x0B 0x0C 0x0C 0x0C 0x0C 0x0D 0x0D 0x0D 0x0D 0x0D 0x0E 0x0E 0x0E 0x0E 0x0E 0x0E 0x0F 0x0F 0x0F 0x0F 0x10 0x10 0x10 0x11 0x11 0x11
Head 8 Zone Cap = 0x1B 0x1B 0x1B 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A 0x1A

max_LBA_for_head_9 = 0 - 0Gb
Head 9 Zone TPI = 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Head 9 Zone Cap = 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00

[fzabkar]

This is an excerpt from a later standard:

https://web.archive.org/web/20160701095638/http://www.t13.org/documents/UploadedDocuments/docs2011/d2015r7-ATAATAPI_Command_Set_-_2_ACS-2.pdf

Attachments

[Tech3300]

Intersting finds! Im sure thats what happened here, disabled for whatever reason...

Attachments

PZU.zip

(516.9 KiB) Downloaded 160 times

[Tech3300]

Log data

Attachments

wd.txt

(9.74 KiB) Downloaded 151 times

[fzabkar]

Your WDMarvel dump is limited to the ROM. That's of no use to us.

I think HDAT2 offers a better opportunity.

[Tech3300]

Just got out of HDAT. On all 4 drives, there is no DCO menu. No menu, nothing in the hidden area menu. Not frozen or hidden, just wasnt there.

Some dumps, but nothing dco related.

Attachments

SMARDATA.TXT

(3 KiB) Downloaded 170 times

IDENTIFY.TXT

(2.99 KiB) Downloaded 182 times

HDETECT.TXT

(2.19 KiB) Downloaded 152 times

[fzabkar]

That's disappointing.

Identify Device word #76 has a value of 0x840E. This means that the NCQ features were disabled for this drive.

The only other solution I can think of is to dump the firmware modules and compare the NCQ-enabled firmware against the NCQ-disabled. But that would mean that you would need to get WDMarvel working. Otherwise, if you are comfortable with Linux, there is a HDDSuperTool script to dump the firmware.

[Tech3300]

Ill work on WDMarvel. Any guides thatll help in the learning process?

[fzabkar]

None that I'm aware of.

There may be some information at hddoracle.com.