HDD GURU FORUMS
http://forum.hddguru.com/

Software that can verify the integrity of files
http://forum.hddguru.com/viewtopic.php?f=7&t=43398
Page 1 of 1

Author:  hvd [ June 7th, 2023, 13:38 ]
Post subject:  Software that can verify the integrity of files

Hello

Is there any software capable of verifying the integrity of files ?

I managed to recover the data to my clients and I transferred them to my external hard drive, but there are some files of photos, music, videos, word, excel, PDF that they are unreadable.

Do you know any software that can analyze the files with the problem to create a report and send it to the customer ?

Thanks your help

Author:  mr44er [ June 7th, 2023, 15:53 ]
Post subject:  Re: Software that can verify the integrity of files

This works only clean if you create/have checksums before anything happens to compare a good state against.
https://en.wikipedia.org/wiki/Simple_file_verification

I don't know if such an allinone-tools exists, that would crawl over all files to check if it opens...

Some ideas:
Bad Peggy https://coderslagoon.com/

"File Integrity Checks" http://www.libpng.org/pub/png/pngintro.html

https://stackoverflow.com/questions/140 ... s-corrupte

https://mp3val.sourceforge.net/

Author:  Arch Stanton [ June 7th, 2023, 16:27 ]
Post subject:  Re: Software that can verify the integrity of files

Such an all-in-one tool would need to know about the internal of each and every file type in existence. Which makes it obvious such a tool is an illusion.

What type of drive were files recovered from and how was the data lost?

Author:  hvd [ June 8th, 2023, 4:57 ]
Post subject:  Re: Software that can verify the integrity of files

Hi mr44er

I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.

THANKS

Author:  fzabkar [ June 8th, 2023, 17:18 ]
Post subject:  Re: Software that can verify the integrity of files

If the files are compressed (eg xlsx, docx, zip, 7z, rar), then you could test the files from the command line using 7-Zip.

https://7ziphelp.com/7zip-command-line

I think this command should test all the XLSX files in the \Recovered directory, and then write each result to a log file (the "-r" may not be necessary):

Code:
for %i in (\Recovered\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt

Author:  mr44er [ June 9th, 2023, 4:58 ]
Post subject:  Re: Software that can verify the integrity of files

You could use ffmpeg to copy video files into a new container and log the output into a file. If anything is broken, ffmpeg will detect it.

Some example:
Code:
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}newfile.mp4"; done
for f in *.mp4; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done


Edit:
I don't know how to script in Windows or if ffmpeg is available at all.
The manual way would be:
Code:
ffmpeg -i sourcefile.mp4 -vcodec copy -acodec copy output.mkv


Also I remember that MS-Office software does keep hidden copies/versions in the same folder per file (but not how many and/or for everything)...maybe this older version is available if everything fails.

Author:  Lardman [ June 9th, 2023, 6:27 ]
Post subject:  Re: Software that can verify the integrity of files

This is a lot easier if you just produce a report of files with problem sectors from pc3000 or whatever tool you're using to to logical extraction. Trying to do things after the event are always going to be problematic.

Author:  Arch Stanton [ June 9th, 2023, 7:40 ]
Post subject:  Re: Software that can verify the integrity of files

Lardman wrote:
This is a lot easier if you just produce a report of files with problem sectors from pc3000 or whatever tool you're using to to logical extraction. Trying to do things after the event are always going to be problematic.


Yes, exactly, this is why I was asking about the actual issue. If it's reasonable to assume file corruption, then why is this so? If bad sectors, then somehow map bad sectors to files and you have your answer. If not bad sectors when why suspect corrupt files, what reasons do you have for this?

So far the thread has come up with less than 10 creative solutions for detecting corruption in specific file types, so that leaves us with how many thousands of file types we can not check at this point?

And while we're send on a wild goose chase, OP remains silent and doesn't answer questions.

Author:  hvd [ June 9th, 2023, 10:31 ]
Post subject:  Re: Software that can verify the integrity of files

fzabkar wrote:
If the files are compressed (eg xlsx, docx, zip, 7z, rar), then you could test the files from the command line using 7-Zip.

https://7ziphelp.com/7zip-command-line

I think this command should test all the XLSX files in the \Recovered directory, and then write each result to a log file (the "-r" may not be necessary):

Code:
for %i in (\Recovered\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt


Hi fzabkar

If I understood.
My Documents folder on external hard drive F:

in PowerShell
C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt

Error:
F:\Documents\*.xlsx: The term "F:\Documents\*.xlsx" is not recognized as a cmdlet name, function,
script file or executable program. Check the spelling of the name, or if a path exists, verify that
the path is correct and try again.
At Line:1 character: 40
+ C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t % ...
+ ~~~~~~~~~~~~~~~~~~~
+ CategoryInfo: ObjectNotFound: (F:\Documents\*.xlsx:String) [], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException

THANKS

Author:  michael chiklis [ June 9th, 2023, 10:33 ]
Post subject:  Re: Software that can verify the integrity of files

hvd wrote:
Hi mr44er

I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.

THANKS


If i remember well, AgentRansack is able to check if office files are logically corrupt by ticking "Office/PDF documents" option and enabling "deep search function".
I tried it few years ago!
https://forum.hddguru.com/viewtopic.php ... 82#p282282

Download link:
https://www.mythicsoft.com/filelocatorpro/download/

Author:  hvd [ June 9th, 2023, 10:42 ]
Post subject:  Re: Software that can verify the integrity of files

mr44er wrote:
You could use ffmpeg to copy video files into a new container and log the output into a file. If anything is broken, ffmpeg will detect it.

Some example:
Code:
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}newfile.mp4"; done
for f in *.mp4; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done


Edit:
I don't know how to script in Windows or if ffmpeg is available at all.
The manual way would be:
Code:
ffmpeg -i sourcefile.mp4 -vcodec copy -acodec copy output.mkv


Also I remember that MS-Office software does keep hidden copies/versions in the same folder per file (but not how many and/or for everything)...maybe this older version is available if everything fails.


Hi

If I understood I downloaded ffmpeg https://www.ffmpeg.org/download.html#build-windows

I pasted in C:\ffmpeg , I do in PowerShell

PS C:\ffmpeg> ffmpeg -i F:\Documents\*.mp4 -vcodec copy -acodec copy output.mkv

error

ffmpeg: The term "ffmpeg" is not recognized as the name of a cmdlet, function, script file, or program
executable. Check the spelling of the name, or if a path exists, verify that the path is correct
and try again.
To Line:1 character : 1
+ ffmpeg -i F:\Documents\*.mp4 -vcodec copy -acodec copy output.mkv
+ ~~~~~~
+ CategoryInfo: ObjectNotFound: (ffmpeg:String)[], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException


THANKS

Author:  hvd [ June 9th, 2023, 11:47 ]
Post subject:  Re: Software that can verify the integrity of files

michael chiklis wrote:
hvd wrote:
Hi mr44er

I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.

THANKS


If i remember well, AgentRansack is able to check if office files are logically corrupt by ticking "Office/PDF documents" option and enabling "deep search function".
I tried it few years ago!
https://forum.hddguru.com/viewtopic.php ... 82#p282282

Download link:
https://www.mythicsoft.com/filelocatorpro/download/


Hi michael chiklis

FileLocator Pro, It is a software that looks for the texts in the files, I read the subject that it is necessary MRT or DE of PC-3000. they sorted out the bad sectors and added the text to indicate the files with the problem sectors.

I am looking for a software that can find the file problem (Mp3, MP4, Avi, MPEG, Word, Excel, PDF...)

Currently I know to use search with RAW from DE from PC-3000 to sort files with problem sectors. The problem that we don't have the file name !

Author:  fzabkar [ June 9th, 2023, 13:39 ]
Post subject:  Re: Software that can verify the integrity of files

What is the "7za"?

hvd wrote:
My Documents folder on external hard drive F:

in PowerShell
C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt

Error:
F:\Documents\*.xlsx: The term "F:\Documents\*.xlsx" is not recognized as a cmdlet name, function,
script file or executable program. Check the spelling of the name, or if a path exists, verify that
the path is correct and try again.
At Line:1 character: 40
+ C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t % ...
+ ~~~~~~~~~~~~~~~~~~~
+ CategoryInfo: ObjectNotFound: (F:\Documents\*.xlsx:String) [], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException

THANKS

I don't have any problem:

Code:
7-Zip 21.01 alpha (x86) : Copyright (c) 1999-2021 Igor Pavlov : 2021-03-09

Scanning the drive for archives:
1 file, 780106 bytes (762 KiB)

Testing archive: C:\test\FW-PPRO-6-0-4-Release.1032185.xlsx
--
Path = C:\test\FW-PPRO-6-0-4-Release.1032185.xlsx
Type = zip
Physical Size = 780106

Everything is Ok

Files: 12
Size:       4881639
Compressed: 780106

Author:  fzabkar [ June 9th, 2023, 14:00 ]
Post subject:  Re: Software that can verify the integrity of files

This also works and is far better:

Code:
7z t F:\Documents\*.xlsx > xlsx_test_log.txt

Author:  hvd [ June 10th, 2023, 2:57 ]
Post subject:  Re: Software that can verify the integrity of files

fzabkar wrote:
This also works and is far better:

Code:
7z t F:\Documents\*.xlsx > xlsx_test_log.txt


Hi

I've had success with xls files, I've tried PDFs which it can't open.

7z t C:\check\*.pdf >> C:\check\test_log.txt

7-Zip 19.00 (x64): Copyright (c) 1999-2018 Igor Pavlov: 2019-02-21

Scanning the drive for archives:
2 files, 50394 bytes (50 KiB)

Testing archive: C:\check\Pdf1.pdf

Testing archive: C:\check\Pdf2.pdf

Archives: 2
OK archive: 0
Can't open as archive: 2
Files: 0
Size: 0
Compressed: 0

Thank

Author:  fzabkar [ June 10th, 2023, 14:49 ]
Post subject:  Re: Software that can verify the integrity of files

PDF is not an archive format.

Page 1 of 1 All times are UTC - 5 hours [ DST ]
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
http://www.phpbb.com/