Page 1 of 1
Software that can verify the integrity of files
Posted: June 7th, 2023, 13:38
by hvd
Hello
Is there any software capable of verifying the integrity of files ?
I managed to recover the data to my clients and I transferred them to my external hard drive, but there are some files of photos, music, videos, word, excel, PDF that they are unreadable.
Do you know any software that can analyze the files with the problem to create a report and send it to the customer ?
Thanks your help
Re: Software that can verify the integrity of files
Posted: June 7th, 2023, 15:53
by mr44er
This works only clean if you create/have checksums before anything happens to compare a good state against.
https://en.wikipedia.org/wiki/Simple_file_verificationI don't know if such an allinone-tools exists, that would crawl over all files to check if it opens...
Some ideas:
Bad Peggy
https://coderslagoon.com/"File Integrity Checks"
http://www.libpng.org/pub/png/pngintro.htmlhttps://stackoverflow.com/questions/140 ... s-corruptehttps://mp3val.sourceforge.net/
Re: Software that can verify the integrity of files
Posted: June 7th, 2023, 16:27
by Arch Stanton
Such an all-in-one tool would need to know about the internal of each and every file type in existence. Which makes it obvious such a tool is an illusion.
What type of drive were files recovered from and how was the data lost?
Re: Software that can verify the integrity of files
Posted: June 8th, 2023, 4:57
by hvd
Hi mr44er
I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.
THANKS
Re: Software that can verify the integrity of files
Posted: June 8th, 2023, 17:18
by fzabkar
If the files are compressed (eg xlsx, docx, zip, 7z, rar), then you could test the files from the command line using 7-Zip.
https://7ziphelp.com/7zip-command-lineI think this command should test all the XLSX files in the \Recovered directory, and then write each result to a log file (the "-r" may not be necessary):
- Code:
for %i in (\Recovered\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt
Re: Software that can verify the integrity of files
Posted: June 9th, 2023, 4:58
by mr44er
You could use ffmpeg to copy video files into a new container and log the output into a file. If anything is broken, ffmpeg will detect it.
Some example:
- Code:
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}newfile.mp4"; done
for f in *.mp4; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
Edit:
I don't know how to script in Windows or if ffmpeg is available at all.
The manual way would be:
- Code:
ffmpeg -i sourcefile.mp4 -vcodec copy -acodec copy output.mkv
Also I remember that MS-Office software does keep hidden copies/versions in the same folder per file (but not how many and/or for everything)...maybe this older version is available if everything fails.
Re: Software that can verify the integrity of files
Posted: June 9th, 2023, 6:27
by Lardman
This is a lot easier if you just produce a report of files with problem sectors from pc3000 or whatever tool you're using to to logical extraction. Trying to do things after the event are always going to be problematic.
Re: Software that can verify the integrity of files
Posted: June 9th, 2023, 7:40
by Arch Stanton
Lardman wrote:This is a lot easier if you just produce a report of files with problem sectors from pc3000 or whatever tool you're using to to logical extraction. Trying to do things after the event are always going to be problematic.
Yes, exactly, this is why I was asking about the actual issue. If it's reasonable to assume file corruption, then why is this so? If bad sectors, then somehow map bad sectors to files and you have your answer. If not bad sectors when why suspect corrupt files, what reasons do you have for this?
So far the thread has come up with less than 10 creative solutions for detecting corruption in specific file types, so that leaves us with how many thousands of file types we can not check at this point?
And while we're send on a wild goose chase, OP remains silent and doesn't answer questions.
Re: Software that can verify the integrity of files
Posted: June 9th, 2023, 10:31
by hvd
fzabkar wrote:If the files are compressed (eg xlsx, docx, zip, 7z, rar), then you could test the files from the command line using 7-Zip.
https://7ziphelp.com/7zip-command-lineI think this command should test all the XLSX files in the \Recovered directory, and then write each result to a log file (the "-r" may not be necessary):
- Code:
for %i in (\Recovered\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt
Hi fzabkar
If I understood.
My Documents folder on external hard drive F:
in PowerShell
C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt
Error:
F:\Documents\*.xlsx: The term "F:\Documents\*.xlsx" is not recognized as a cmdlet name, function,
script file or executable program. Check the spelling of the name, or if a path exists, verify that
the path is correct and try again.
At Line:1 character: 40
+ C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t % ...
+ ~~~~~~~~~~~~~~~~~~~
+ CategoryInfo: ObjectNotFound: (F:\Documents\*.xlsx:String) [], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException
THANKS
Re: Software that can verify the integrity of files
Posted: June 9th, 2023, 10:33
by michael chiklis
hvd wrote:Hi mr44er
I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.
THANKS
If i remember well, AgentRansack is able to check if office files are logically corrupt by ticking "Office/PDF documents" option and enabling "deep search function".
I tried it few years ago!
https://forum.hddguru.com/viewtopic.php ... 82#p282282Download link:
https://www.mythicsoft.com/filelocatorpro/download/
Re: Software that can verify the integrity of files
Posted: June 9th, 2023, 10:42
by hvd
mr44er wrote:You could use ffmpeg to copy video files into a new container and log the output into a file. If anything is broken, ffmpeg will detect it.
Some example:
- Code:
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}newfile.mp4"; done
for f in *.mp4; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
Edit:
I don't know how to script in Windows or if ffmpeg is available at all.
The manual way would be:
- Code:
ffmpeg -i sourcefile.mp4 -vcodec copy -acodec copy output.mkv
Also I remember that MS-Office software does keep hidden copies/versions in the same folder per file (but not how many and/or for everything)...maybe this older version is available if everything fails.
Hi
If I understood I downloaded ffmpeg
https://www.ffmpeg.org/download.html#build-windowsI pasted in C:\ffmpeg , I do in PowerShell
PS C:\ffmpeg> ffmpeg -i F:\Documents\*.mp4 -vcodec copy -acodec copy output.mkv
error
ffmpeg: The term "ffmpeg" is not recognized as the name of a cmdlet, function, script file, or program
executable. Check the spelling of the name, or if a path exists, verify that the path is correct
and try again.
To Line:1 character : 1
+ ffmpeg -i F:\Documents\*.mp4 -vcodec copy -acodec copy output.mkv
+ ~~~~~~
+ CategoryInfo: ObjectNotFound: (ffmpeg:String)[], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException
THANKS
Re: Software that can verify the integrity of files
Posted: June 9th, 2023, 11:47
by hvd
Hi michael chiklis
FileLocator Pro, It is a software that looks for the texts in the files, I read the subject that it is necessary MRT or DE of PC-3000. they sorted out the bad sectors and added the text to indicate the files with the problem sectors.
I am looking for a software that can find the file problem (Mp3, MP4, Avi, MPEG, Word, Excel, PDF...)
Currently I know to use search with RAW from DE from PC-3000 to sort files with problem sectors. The problem that we don't have the file name !
Re: Software that can verify the integrity of files
Posted: June 9th, 2023, 13:39
by fzabkar
What is the "7za"?
hvd wrote:My Documents folder on external hard drive F:
in PowerShell
C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt
Error:
F:\Documents\*.xlsx: The term "F:\Documents\*.xlsx" is not recognized as a cmdlet name, function,
script file or executable program. Check the spelling of the name, or if a path exists, verify that
the path is correct and try again.
At Line:1 character: 40
+ C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t % ...
+ ~~~~~~~~~~~~~~~~~~~
+ CategoryInfo: ObjectNotFound: (F:\Documents\*.xlsx:String) [], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException
THANKS
I don't have any problem:
- Code:
7-Zip 21.01 alpha (x86) : Copyright (c) 1999-2021 Igor Pavlov : 2021-03-09
Scanning the drive for archives:
1 file, 780106 bytes (762 KiB)
Testing archive: C:\test\FW-PPRO-6-0-4-Release.1032185.xlsx
--
Path = C:\test\FW-PPRO-6-0-4-Release.1032185.xlsx
Type = zip
Physical Size = 780106
Everything is Ok
Files: 12
Size: 4881639
Compressed: 780106
Re: Software that can verify the integrity of files
Posted: June 9th, 2023, 14:00
by fzabkar
This also works and is far better:
- Code:
7z t F:\Documents\*.xlsx > xlsx_test_log.txt
Re: Software that can verify the integrity of files
Posted: June 10th, 2023, 2:57
by hvd
fzabkar wrote:This also works and is far better:
- Code:
7z t F:\Documents\*.xlsx > xlsx_test_log.txt
Hi
I've had success with xls files, I've tried PDFs which it can't open.
7z t C:\check\*.pdf >> C:\check\test_log.txt
7-Zip 19.00 (x64): Copyright (c) 1999-2018 Igor Pavlov: 2019-02-21
Scanning the drive for archives:
2 files, 50394 bytes (50 KiB)
Testing archive: C:\check\Pdf1.pdf
Testing archive: C:\check\Pdf2.pdf
Archives: 2
OK archive: 0
Can't open as archive: 2
Files: 0
Size: 0
Compressed: 0
Thank
Re: Software that can verify the integrity of files
Posted: June 10th, 2023, 14:49
by fzabkar
PDF is not an archive format.