All times are UTC - 5 hours [ DST ]




Post new topic Reply to topic  [ 16 posts ] 
Author Message
 Post subject: Software that can verify the integrity of files
PostPosted: June 7th, 2023, 13:38 
Offline

Joined: October 22nd, 2013, 20:00
Posts: 84
Location: Paris, France
Hello

Is there any software capable of verifying the integrity of files ?

I managed to recover the data to my clients and I transferred them to my external hard drive, but there are some files of photos, music, videos, word, excel, PDF that they are unreadable.

Do you know any software that can analyze the files with the problem to create a report and send it to the customer ?

Thanks your help

_________________
Sorry from my English


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 7th, 2023, 15:53 
Offline
User avatar

Joined: May 29th, 2023, 13:54
Posts: 56
Location: /home/mr44er
This works only clean if you create/have checksums before anything happens to compare a good state against.
https://en.wikipedia.org/wiki/Simple_file_verification

I don't know if such an allinone-tools exists, that would crawl over all files to check if it opens...

Some ideas:
Bad Peggy https://coderslagoon.com/

"File Integrity Checks" http://www.libpng.org/pub/png/pngintro.html

https://stackoverflow.com/questions/140 ... s-corrupte

https://mp3val.sourceforge.net/


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 7th, 2023, 16:27 
Offline
User avatar

Joined: May 13th, 2019, 7:50
Posts: 907
Location: Nederland
Such an all-in-one tool would need to know about the internal of each and every file type in existence. Which makes it obvious such a tool is an illusion.

What type of drive were files recovered from and how was the data lost?

_________________
Joep - http://www.disktuna.com - video & photo repair & recovery service


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 8th, 2023, 4:57 
Offline

Joined: October 22nd, 2013, 20:00
Posts: 84
Location: Paris, France
Hi mr44er

I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.

THANKS

_________________
Sorry from my English


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 8th, 2023, 17:18 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 15463
Location: Australia
If the files are compressed (eg xlsx, docx, zip, 7z, rar), then you could test the files from the command line using 7-Zip.

https://7ziphelp.com/7zip-command-line

I think this command should test all the XLSX files in the \Recovered directory, and then write each result to a log file (the "-r" may not be necessary):

Code:
for %i in (\Recovered\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt

_________________
A backup a day keeps DR away.


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 9th, 2023, 4:58 
Offline
User avatar

Joined: May 29th, 2023, 13:54
Posts: 56
Location: /home/mr44er
You could use ffmpeg to copy video files into a new container and log the output into a file. If anything is broken, ffmpeg will detect it.

Some example:
Code:
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}newfile.mp4"; done
for f in *.mp4; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done


Edit:
I don't know how to script in Windows or if ffmpeg is available at all.
The manual way would be:
Code:
ffmpeg -i sourcefile.mp4 -vcodec copy -acodec copy output.mkv


Also I remember that MS-Office software does keep hidden copies/versions in the same folder per file (but not how many and/or for everything)...maybe this older version is available if everything fails.


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 9th, 2023, 6:27 
Offline

Joined: November 7th, 2020, 5:31
Posts: 1085
Location: The_UK
This is a lot easier if you just produce a report of files with problem sectors from pc3000 or whatever tool you're using to to logical extraction. Trying to do things after the event are always going to be problematic.

_________________
Data Recovery Services in the UK.
https://www.usbrecovery.co.uk/


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 9th, 2023, 7:40 
Offline
User avatar

Joined: May 13th, 2019, 7:50
Posts: 907
Location: Nederland
Lardman wrote:
This is a lot easier if you just produce a report of files with problem sectors from pc3000 or whatever tool you're using to to logical extraction. Trying to do things after the event are always going to be problematic.


Yes, exactly, this is why I was asking about the actual issue. If it's reasonable to assume file corruption, then why is this so? If bad sectors, then somehow map bad sectors to files and you have your answer. If not bad sectors when why suspect corrupt files, what reasons do you have for this?

So far the thread has come up with less than 10 creative solutions for detecting corruption in specific file types, so that leaves us with how many thousands of file types we can not check at this point?

And while we're send on a wild goose chase, OP remains silent and doesn't answer questions.

_________________
Joep - http://www.disktuna.com - video & photo repair & recovery service


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 9th, 2023, 10:31 
Offline

Joined: October 22nd, 2013, 20:00
Posts: 84
Location: Paris, France
fzabkar wrote:
If the files are compressed (eg xlsx, docx, zip, 7z, rar), then you could test the files from the command line using 7-Zip.

https://7ziphelp.com/7zip-command-line

I think this command should test all the XLSX files in the \Recovered directory, and then write each result to a log file (the "-r" may not be necessary):

Code:
for %i in (\Recovered\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt


Hi fzabkar

If I understood.
My Documents folder on external hard drive F:

in PowerShell
C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt

Error:
F:\Documents\*.xlsx: The term "F:\Documents\*.xlsx" is not recognized as a cmdlet name, function,
script file or executable program. Check the spelling of the name, or if a path exists, verify that
the path is correct and try again.
At Line:1 character: 40
+ C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t % ...
+ ~~~~~~~~~~~~~~~~~~~
+ CategoryInfo: ObjectNotFound: (F:\Documents\*.xlsx:String) [], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException

THANKS

_________________
Sorry from my English


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 9th, 2023, 10:33 
Offline

Joined: December 5th, 2011, 5:38
Posts: 1626
Location: Italy
hvd wrote:
Hi mr44er

I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.

THANKS


If i remember well, AgentRansack is able to check if office files are logically corrupt by ticking "Office/PDF documents" option and enabling "deep search function".
I tried it few years ago!
https://forum.hddguru.com/viewtopic.php ... 82#p282282

Download link:
https://www.mythicsoft.com/filelocatorpro/download/

_________________
My firmware database:
https://mega.nz/folder/O01DkBRI#MxP2J6ZNqXDcrX40I8MoQQ


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 9th, 2023, 10:42 
Offline

Joined: October 22nd, 2013, 20:00
Posts: 84
Location: Paris, France
mr44er wrote:
You could use ffmpeg to copy video files into a new container and log the output into a file. If anything is broken, ffmpeg will detect it.

Some example:
Code:
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done
for f in *.mov; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}newfile.mp4"; done
for f in *.mp4; do ffmpeg -i "${f}" -vcodec copy -acodec copy "${f%.*}.mkv"; done


Edit:
I don't know how to script in Windows or if ffmpeg is available at all.
The manual way would be:
Code:
ffmpeg -i sourcefile.mp4 -vcodec copy -acodec copy output.mkv


Also I remember that MS-Office software does keep hidden copies/versions in the same folder per file (but not how many and/or for everything)...maybe this older version is available if everything fails.


Hi

If I understood I downloaded ffmpeg https://www.ffmpeg.org/download.html#build-windows

I pasted in C:\ffmpeg , I do in PowerShell

PS C:\ffmpeg> ffmpeg -i F:\Documents\*.mp4 -vcodec copy -acodec copy output.mkv

error

ffmpeg: The term "ffmpeg" is not recognized as the name of a cmdlet, function, script file, or program
executable. Check the spelling of the name, or if a path exists, verify that the path is correct
and try again.
To Line:1 character : 1
+ ffmpeg -i F:\Documents\*.mp4 -vcodec copy -acodec copy output.mkv
+ ~~~~~~
+ CategoryInfo: ObjectNotFound: (ffmpeg:String)[], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException


THANKS

_________________
Sorry from my English


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 9th, 2023, 11:47 
Offline

Joined: October 22nd, 2013, 20:00
Posts: 84
Location: Paris, France
michael chiklis wrote:
hvd wrote:
Hi mr44er

I tested BadPeggy-2.4.0 software to verify photos and mp3val for mp3 that they work.
I am still looking for the software to check videos and word, excel.

THANKS


If i remember well, AgentRansack is able to check if office files are logically corrupt by ticking "Office/PDF documents" option and enabling "deep search function".
I tried it few years ago!
https://forum.hddguru.com/viewtopic.php ... 82#p282282

Download link:
https://www.mythicsoft.com/filelocatorpro/download/


Hi michael chiklis

FileLocator Pro, It is a software that looks for the texts in the files, I read the subject that it is necessary MRT or DE of PC-3000. they sorted out the bad sectors and added the text to indicate the files with the problem sectors.

I am looking for a software that can find the file problem (Mp3, MP4, Avi, MPEG, Word, Excel, PDF...)

Currently I know to use search with RAW from DE from PC-3000 to sort files with problem sectors. The problem that we don't have the file name !

_________________
Sorry from my English


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 9th, 2023, 13:39 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 15463
Location: Australia
What is the "7za"?

hvd wrote:
My Documents folder on external hard drive F:

in PowerShell
C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t %i -r >> xlsx_test_log.txt

Error:
F:\Documents\*.xlsx: The term "F:\Documents\*.xlsx" is not recognized as a cmdlet name, function,
script file or executable program. Check the spelling of the name, or if a path exists, verify that
the path is correct and try again.
At Line:1 character: 40
+ C:\Program Files\7-Zip> 7za for %i in (F:\Documents\*.xlsx) do 7z t % ...
+ ~~~~~~~~~~~~~~~~~~~
+ CategoryInfo: ObjectNotFound: (F:\Documents\*.xlsx:String) [], CommandNotFoundException
+ FullyQualifiedErrorId: CommandNotFoundException

THANKS

I don't have any problem:

Code:
7-Zip 21.01 alpha (x86) : Copyright (c) 1999-2021 Igor Pavlov : 2021-03-09

Scanning the drive for archives:
1 file, 780106 bytes (762 KiB)

Testing archive: C:\test\FW-PPRO-6-0-4-Release.1032185.xlsx
--
Path = C:\test\FW-PPRO-6-0-4-Release.1032185.xlsx
Type = zip
Physical Size = 780106

Everything is Ok

Files: 12
Size:       4881639
Compressed: 780106

_________________
A backup a day keeps DR away.


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 9th, 2023, 14:00 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 15463
Location: Australia
This also works and is far better:

Code:
7z t F:\Documents\*.xlsx > xlsx_test_log.txt

_________________
A backup a day keeps DR away.


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 10th, 2023, 2:57 
Offline

Joined: October 22nd, 2013, 20:00
Posts: 84
Location: Paris, France
fzabkar wrote:
This also works and is far better:

Code:
7z t F:\Documents\*.xlsx > xlsx_test_log.txt


Hi

I've had success with xls files, I've tried PDFs which it can't open.

7z t C:\check\*.pdf >> C:\check\test_log.txt

7-Zip 19.00 (x64): Copyright (c) 1999-2018 Igor Pavlov: 2019-02-21

Scanning the drive for archives:
2 files, 50394 bytes (50 KiB)

Testing archive: C:\check\Pdf1.pdf

Testing archive: C:\check\Pdf2.pdf

Archives: 2
OK archive: 0
Can't open as archive: 2
Files: 0
Size: 0
Compressed: 0

Thank

_________________
Sorry from my English


Top
 Profile  
 
 Post subject: Re: Software that can verify the integrity of files
PostPosted: June 10th, 2023, 14:49 
Offline
User avatar

Joined: September 8th, 2009, 18:21
Posts: 15463
Location: Australia
PDF is not an archive format.

_________________
A backup a day keeps DR away.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 16 posts ] 

All times are UTC - 5 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 21 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group