Speeding up "verifying integrity of existing..."

Re: Speeding up "verifying integrity of existing..."

Postby boco » 14.01.2020, 13:25

I would rather take a look at the Power On Hours. 41000 hours is already very high. Future degradation of that HDD is very likely.


@Denniss: If the HDD has NCQ (Native Command Queuing), it should not be much of a problem. But yes, spinning rust usually performs bad doing multiple things at one. Best example: Startup.
Microsoft update catalog: http://catalog.update.microsoft.com/v7/site/
Windows Install media download: https://support.microsoft.com/en-us/help/15088/windows-create-installation-media
boco
 
Posts: 2332
Joined: 24.11.2009, 17:00
Location: Germany

Re: Speeding up "verifying integrity of existing..."

Postby eLPuSHeR » 14.01.2020, 14:04

Denniss wrote:Please monitor the C7 errors on your HDD, may be a cable/connection problem.
Plus the more threads your CPU has the more files are checked simultaneously which is major stress for a HDD and actually forced me to move files to my SSD (HDD head sounds were not sounding healthy to me)


Hmmm. Could be that. My i7-5960x has got 8 cores / 16 threads.
eLPuSHeR
 
Posts: 62
Joined: 06.08.2014, 09:32

Re: Speeding up "verifying integrity of existing..."

Postby eLPuSHeR » 14.01.2020, 14:06

boco wrote:There is an OS "foreground boost" for the currently active window, yes. The only thing you could do is trying if it makes any difference without that option.

Do you have any software that manages process priorities (like Process Lasso, for example)?


Nope. But I have heard MS improved "core handling" on Intel systems on a recent W10 Update.
eLPuSHeR
 
Posts: 62
Joined: 06.08.2014, 09:32

Re: Speeding up "verifying integrity of existing..."

Postby eLPuSHeR » 14.01.2020, 14:07

I am now testing the newly created from scratch WSUS...
eLPuSHeR
 
Posts: 62
Joined: 06.08.2014, 09:32

Re: Speeding up "verifying integrity of existing..."

Postby eLPuSHeR » 14.01.2020, 15:37

This isn't going any faster. Total time: 1h 15m
I will do another test tomorrow disabling Hyperthreading for cpu.

I wonder if there is some way to force the hashing/verifying process sequentially/single-threaded. Despite Intel's claims, NCQ for hard disks seems just like placebo.
eLPuSHeR
 
Posts: 62
Joined: 06.08.2014, 09:32

Re: Speeding up "verifying integrity of existing..."

Postby hbuhrmester » 14.01.2020, 20:17

Multi-threading in hashdeep can be disabled with the option -j0

http://md5deep.sourceforge.net/hashdeep.html
hbuhrmester
 
Posts: 462
Joined: 11.10.2013, 20:59

Re: Speeding up "verifying integrity of existing..."

Postby eLPuSHeR » 14.01.2020, 21:19

Interesting. Let's see if I can find out what files I have to edit.

Thanks.
eLPuSHeR
 
Posts: 62
Joined: 06.08.2014, 09:32

Re: Speeding up "verifying integrity of existing..."

Postby eLPuSHeR » 15.01.2020, 01:18

Hello.

Making some good progress with the -j0 parameter. Now verifying digital file signtatures is taking its time too.
Time to go to sleep. 16GB+ has been downloaded because of 18383.592 w10 update.
But it has taken less time than before and now there is not that awful hard disk grinding noise.
eLPuSHeR
 
Posts: 62
Joined: 06.08.2014, 09:32

Re: Speeding up "verifying integrity of existing..."

Postby eLPuSHeR » 15.01.2020, 01:29

I wonder if it could be possible to use the SET variable NUMBER_OF_PROCESSORS to automatically set a good value for the -j<number> parameter.

For instance. My i7-5960x has got eight cores / 16 threads.

Something like %HASHDEEP-EXE% -j%NUMBER_OF_PROCESSORS% would use all threads. Maybe it should be divided by 2 and rounded.

Or just use a fixed number.
eLPuSHeR
 
Posts: 62
Joined: 06.08.2014, 09:32

Re: Speeding up "verifying integrity of existing..."

Postby eLPuSHeR » 15.01.2020, 08:46

Total time is now 40m. I will do one more test with -j2 this afternoon.

Thank you very much everyone for helping and putting me on the right track.
eLPuSHeR
 
Posts: 62
Joined: 06.08.2014, 09:32

PreviousNext

Return to Anregungen / Suggestions

Who is online

Users browsing this forum: No registered users and 5 guests