Switch to full style
Tools for hard drive diagnostics, repair, and data recovery
Post a reply

Software that can verify the integrity of files

June 7th, 2023, 13:38

Hello

Is there any software capable of verifying the integrity of files ?

I managed to recover the data to my clients and I transferred them to my external hard drive, but there are some files of photos, music, videos, word, excel, PDF that they are unreadable.

Do you know any software that can analyze the files with the problem to create a report and send it to the customer ?

Thanks your help

Re: Software that can verify the integrity of files

June 7th, 2023, 15:53

This works only clean if you create/have checksums before anything happens to compare a good state against.
https://en.wikipedia.org/wiki/Simple_file_verification

I don't know if such an allinone-tools exists, that would crawl over all files to check if it opens...

Some ideas:
Bad Peggy https://coderslagoon.com/

"File Integrity Checks" http://www.libpng.org/pub/png/pngintro.html

https://stackoverflow.com/questions/140 ... s-corrupte

https://mp3val.sourceforge.net/

Re: Software that can verify the integrity of files

June 7th, 2023, 16:27

Such an all-in-one tool would need to know about the internal of each and every file type in existence. Which makes it obvious such a tool is an illusion.

What type of drive were files recovered from and how was the data lost?

Re: Software that can verify the integrity of files

June 8th, 2023, 4:57

Hi mr44er

I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.

THANKS

Re: Software that can verify the integrity of files

June 8th, 2023, 17:18

If the files are compressed (eg xlsx, docx, zip, 7z, rar), then you could test the files from the command line using 7-Zip.

https://7ziphelp.com/7zip-command-line

I think this command should test all the XLSX files in the \Recovered directory, and then write each result to a log file (the "-r" may not be necessary):

Code:
for %i in (\Recovered\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt

Re: Software that can verify the integrity of files

June 9th, 2023, 4:58

You could use ffmpeg to copy video files into a new container and log the output into a file. If anything is broken, ffmpeg will detect it.

Some example:
Code:
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}newfile.mp4"; done
for f in *.mp4; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done


Edit:
I don't know how to script in Windows or if ffmpeg is available at all.
The manual way would be:
Code:
ffmpeg -i sourcefile.mp4 -vcodec copy -acodec copy output.mkv


Also I remember that MS-Office software does keep hidden copies/versions in the same folder per file (but not how many and/or for everything)...maybe this older version is available if everything fails.

Re: Software that can verify the integrity of files

June 9th, 2023, 6:27

This is a lot easier if you just produce a report of files with problem sectors from pc3000 or whatever tool you're using to to logical extraction. Trying to do things after the event are always going to be problematic.

Re: Software that can verify the integrity of files

June 9th, 2023, 7:40

Lardman wrote:This is a lot easier if you just produce a report of files with problem sectors from pc3000 or whatever tool you're using to to logical extraction. Trying to do things after the event are always going to be problematic.


Yes, exactly, this is why I was asking about the actual issue. If it's reasonable to assume file corruption, then why is this so? If bad sectors, then somehow map bad sectors to files and you have your answer. If not bad sectors when why suspect corrupt files, what reasons do you have for this?

So far the thread has come up with less than 10 creative solutions for detecting corruption in specific file types, so that leaves us with how many thousands of file types we can not check at this point?

And while we're send on a wild goose chase, OP remains silent and doesn't answer questions.

Re: Software that can verify the integrity of files

June 9th, 2023, 10:31

fzabkar wrote:If the files are compressed (eg xlsx, docx, zip, 7z, rar), then you could test the files from the command line using 7-Zip.

https://7ziphelp.com/7zip-command-line

I think this command should test all the XLSX files in the \Recovered directory, and then write each result to a log file (the "-r" may not be necessary):

Code:
for %i in (\Recovered\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt


Hi fzabkar

If I understood.
My Documents folder on external hard drive F:

in PowerShell
C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt

Error:
F:\Documents\*.xlsx: The term "F:\Documents\*.xlsx" is not recognized as a cmdlet name, function,
script file or executable program. Check the spelling of the name, or if a path exists, verify that
the path is correct and try again.
At Line:1 character: 40
+ C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t % ...
+ ~~~~~~~~~~~~~~~~~~~
+ CategoryInfo: ObjectNotFound: (F:\Documents\*.xlsx:String) [], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException

THANKS

Re: Software that can verify the integrity of files

June 9th, 2023, 10:33

hvd wrote:Hi mr44er

I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.

THANKS


If i remember well, AgentRansack is able to check if office files are logically corrupt by ticking "Office/PDF documents" option and enabling "deep search function".
I tried it few years ago!
https://forum.hddguru.com/viewtopic.php ... 82#p282282

Download link:
https://www.mythicsoft.com/filelocatorpro/download/

Re: Software that can verify the integrity of files

June 9th, 2023, 10:42

mr44er wrote:You could use ffmpeg to copy video files into a new container and log the output into a file. If anything is broken, ffmpeg will detect it.

Some example:
Code:
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}newfile.mp4"; done
for f in *.mp4; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done


Edit:
I don't know how to script in Windows or if ffmpeg is available at all.
The manual way would be:
Code:
ffmpeg -i sourcefile.mp4 -vcodec copy -acodec copy output.mkv


Also I remember that MS-Office software does keep hidden copies/versions in the same folder per file (but not how many and/or for everything)...maybe this older version is available if everything fails.


Hi

If I understood I downloaded ffmpeg https://www.ffmpeg.org/download.html#build-windows

I pasted in C:\ffmpeg , I do in PowerShell

PS C:\ffmpeg> ffmpeg -i F:\Documents\*.mp4 -vcodec copy -acodec copy output.mkv

error

ffmpeg: The term "ffmpeg" is not recognized as the name of a cmdlet, function, script file, or program
executable. Check the spelling of the name, or if a path exists, verify that the path is correct
and try again.
To Line:1 character : 1
+ ffmpeg -i F:\Documents\*.mp4 -vcodec copy -acodec copy output.mkv
+ ~~~~~~
+ CategoryInfo: ObjectNotFound: (ffmpeg:String)[], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException


THANKS

Re: Software that can verify the integrity of files

June 9th, 2023, 11:47

michael chiklis wrote:
hvd wrote:Hi mr44er

I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.

THANKS


If i remember well, AgentRansack is able to check if office files are logically corrupt by ticking "Office/PDF documents" option and enabling "deep search function".
I tried it few years ago!
https://forum.hddguru.com/viewtopic.php ... 82#p282282

Download link:
https://www.mythicsoft.com/filelocatorpro/download/


Hi michael chiklis

FileLocator Pro, It is a software that looks for the texts in the files, I read the subject that it is necessary MRT or DE of PC-3000. they sorted out the bad sectors and added the text to indicate the files with the problem sectors.

I am looking for a software that can find the file problem (Mp3, MP4, Avi, MPEG, Word, Excel, PDF...)

Currently I know to use search with RAW from DE from PC-3000 to sort files with problem sectors. The problem that we don't have the file name !

Re: Software that can verify the integrity of files

June 9th, 2023, 13:39

What is the "7za"?

hvd wrote:My Documents folder on external hard drive F:

in PowerShell
C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt

Error:
F:\Documents\*.xlsx: The term "F:\Documents\*.xlsx" is not recognized as a cmdlet name, function,
script file or executable program. Check the spelling of the name, or if a path exists, verify that
the path is correct and try again.
At Line:1 character: 40
+ C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t % ...
+ ~~~~~~~~~~~~~~~~~~~
+ CategoryInfo: ObjectNotFound: (F:\Documents\*.xlsx:String) [], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException

THANKS

I don't have any problem:

Code:
7-Zip 21.01 alpha (x86) : Copyright (c) 1999-2021 Igor Pavlov : 2021-03-09

Scanning the drive for archives:
1 file, 780106 bytes (762 KiB)

Testing archive: C:\test\FW-PPRO-6-0-4-Release.1032185.xlsx
--
Path = C:\test\FW-PPRO-6-0-4-Release.1032185.xlsx
Type = zip
Physical Size = 780106

Everything is Ok

Files: 12
Size:       4881639
Compressed: 780106

Re: Software that can verify the integrity of files

June 9th, 2023, 14:00

This also works and is far better:

Code:
7z t F:\Documents\*.xlsx > xlsx_test_log.txt

Re: Software that can verify the integrity of files

June 10th, 2023, 2:57

fzabkar wrote:This also works and is far better:

Code:
7z t F:\Documents\*.xlsx > xlsx_test_log.txt


Hi

I've had success with xls files, I've tried PDFs which it can't open.

7z t C:\check\*.pdf >> C:\check\test_log.txt

7-Zip 19.00 (x64): Copyright (c) 1999-2018 Igor Pavlov: 2019-02-21

Scanning the drive for archives:
2 files, 50394 bytes (50 KiB)

Testing archive: C:\check\Pdf1.pdf

Testing archive: C:\check\Pdf2.pdf

Archives: 2
OK archive: 0
Can't open as archive: 2
Files: 0
Size: 0
Compressed: 0

Thank

Re: Software that can verify the integrity of files

June 10th, 2023, 14:49

PDF is not an archive format.
Post a reply