Windows 10 64 bit download folder

Re: Windows 10 64 bit download folder

Postby zirli » 15.01.2020, 14:07

This Issue is getting serious.
After installing wsus offline from scratch for the January 2020 patch tuesday (W10 x64), it is downloading nearly 21(!) GB. This is getting out of hand.
There must be a solution to download only the necessary files for the target build of Win10. Needless to say that 21GB traffic for just a few updates is insane. It's also impractical to get the large wsus folder to other computers. This issue needs more priority.
zirli
 
Posts: 5
Joined: 15.01.2020, 13:59

Re: Windows 10 64 bit download folder

Postby negg » 15.01.2020, 15:19

zirli wrote:This Issue is getting serious.
After installing wsus offline from scratch for the January 2020 patch Tuesday (W10 x64), it is downloading nearly 21(!) GB. This is getting out of hand.
There must be a solution to download only the necessary files for the target build of Win10. Needless to say that 21GB traffic for just a few updates is insane. It's also impractical to get the large wsus folder to other computers. This issue needs more priority.



Totally agree, I think it needs a separate section to download all the versions of Windows 10. Resulting in a little extra code but will save time and download space.
negg
 
Posts: 222
Joined: 26.03.2014, 11:46

Re: Windows 10 64 bit download folder

Postby boco » 18.01.2020, 01:30

I did a quick check and it seems that, beginning December 2019, old, superseded CU packages are not removed, anymore. In other words, the November 2019 and December 2019 CUs are still in there, in addition to the January 2020 ones. (Checked with 1803).

MS website for checking your w10 or w10-x64 client directory: https://support.microsoft.com/en-us/hel ... te-history


Looks like it is the same issue like with the Office updates, MS have badly fucked up their catalog file, and WOU now fails to determine and remove old CUs.
Microsoft update catalog: http://catalog.update.microsoft.com/v7/site/
Windows Install media download: https://support.microsoft.com/en-us/help/15088/windows-create-installation-media
boco
 
Posts: 2391
Joined: 24.11.2009, 17:00
Location: Germany

Re: Windows 10 64 bit download folder

Postby negg » 21.01.2020, 13:25

Can or is this issue being looked at if not using this for windows 10 seems to be a little pointless at the moment.....
negg
 
Posts: 222
Joined: 26.03.2014, 11:46

Re: Windows 10 64 bit download folder

Postby hbuhrmester » 21.01.2020, 19:41

The problem are changed paths on the server and how they affect the determination of superseded updates. For example, the URLs for the November 2019 cumulative updates are:


The last step in the determination of superseded updates is the connection of File Ids and URLs. This is done with the file UpdateCabExeIdsAndLocations.txt. It is created with the XSLT transformation file extract-update-cab-exe-ids-and-locations.xsl, which is based on the similar ExtractUpdateCabExeIdsAndLocations.xsl.

Both files use a series of tests, including:

Code: Select all
contains(@Url, '/update/software/secu/')


This is the usual path for security updates on Microsoft servers, but it is not used for Windows 10 updates anymore. This means, that the URLs are missing in the file UpdateCabExeIdsAndLocations.txt and, as a consequence, in the ExcludeList-superseded.txt.

But the tests in the file extract-update-cab-exe-ids-and-locations.xsl are not really needed, and we can use a much simplified version instead:

Code: Select all
<?xml version="1.0"?>
<!--
  Author: H. Buhrmester, 2020
  Filename: extract-file-ids-and-locations.xsl
  This file extracts the following fields:
  Field 1: File Id
  Field 2: File Url (Location)
-->
<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" xmlns:__="http://schemas.microsoft.com/msus/2004/02/OfflineSync" version="1.0">
  <xsl:output omit-xml-declaration="yes" indent="no" method="text" />
  <xsl:template match="/">
    <xsl:for-each select="__:OfflineSyncPackage/__:FileLocations/__:FileLocation">
      <xsl:value-of select="@Id" />
      <xsl:text>,</xsl:text>
      <xsl:value-of select="@Url" />
      <xsl:text>&#10;</xsl:text>
    </xsl:for-each>
  </xsl:template>
</xsl:stylesheet>


Save this file as extract-file-ids-and-locations.xsl in the directory wsusoffline/xslt. It replaces the file extract-update-cab-exe-ids-and-locations.xsl for the calculation of superseded updates.

For the unmodified DownloadUpdates.cmd 11.8.3, replace:

Code: Select all
rem *** Third step ***
echo Extracting file 6...
%CSCRIPT_PATH% //Nologo //B //E:vbs ..\cmd\XSLT.vbs "%TEMP%\package.xml" ..\xslt\extract-update-cab-exe-ids-and-locations.xsl "%TEMP%\UpdateCabExeIdsAndLocations.txt"


with:

Code: Select all
rem *** Third step ***
echo Extracting file 6...
%CSCRIPT_PATH% //Nologo //B //E:vbs ..\cmd\XSLT.vbs "%TEMP%\package.xml" ..\xslt\extract-file-ids-and-locations.xsl "%TEMP%\UpdateCabExeIdsAndLocations.txt"


Caveats: This will randomly delete files from all download directories, and about half of all Windows 10 downloads.

For the patched DownloadUpdates.cmd from https://forums.wsusoffline.net/viewtopic.php?f=3&t=9954&start=10#p30560 the approach is the same, but the file UpdateCabExeIdsAndLocations.txt should not be reused for the determination of Office updates, e.g. it should be deleted after calculating the superseded updates (as in the original script).
hbuhrmester
 
Posts: 525
Joined: 11.10.2013, 20:59

Re: Windows 10 64 bit download folder

Postby negg » 21.01.2020, 22:14

After making the file and the alterations nothing happened to reduce the size of my w100-x64 folder it contains about 85 files and is about 20gig in size
negg
 
Posts: 222
Joined: 26.03.2014, 11:46

Re: Windows 10 64 bit download folder

Postby hbuhrmester » 22.01.2020, 00:39

Then delete the files:

Code: Select all
wsusoffline/exclude/ExcludeList-superseded.txt
wsusoffline/exclude/ExcludeList-superseded-seconly.txt

and they will be rebuilt on the next run.
hbuhrmester
 
Posts: 525
Joined: 11.10.2013, 20:59

Re: Windows 10 64 bit download folder

Postby hbuhrmester » 22.01.2020, 08:11

Creating a more restrictive, twice as large ExcludeList-superseded.txt may have side effects, and now some updates may be missing during installation.

Updates, which are marked as "superseded", but which are still needed for some reason, can be brought back by adding their kb numbers to the files:

Code: Select all
wsusoffline/exclude/ExcludeList-superseded-exclude.txt (as maintainer)
wsusoffline/exclude/custom/ExcludeList-superseded-exclude.txt (as user)


The file ExcludeList-superseded-exclude-seconly.txt is used similarly for updates, which are only missing, if the option security-only is enabled.
hbuhrmester
 
Posts: 525
Joined: 11.10.2013, 20:59

Re: Windows 10 64 bit download folder

Postby negg » 22.01.2020, 09:03

Will try again asap.....
negg
 
Posts: 222
Joined: 26.03.2014, 11:46

Re: Windows 10 64 bit download folder

Postby negg » 22.01.2020, 14:02

hbuhrmester wrote:Then delete the files:

Code: Select all
wsusoffline/exclude/ExcludeList-superseded.txt
wsusoffline/exclude/ExcludeList-superseded-seconly.txt

and they will be rebuilt on the next run.



This didn't work either get the following error, and it wants to download about 500 files just for .net didn't think there was that many!!!!! Think my wsus is now completely broke think ill just delete the whole thing and not use it tell this issue is resolved.

Code: Select all
12:56:09.01 - Determining superseded updates (please be patient, this will take a while)...
Extracting file 1...
Extracting file 2...
Joining files 1 and 2 to file 3...
Extracting file 4...
Joining files 3 and 4 to file 5...
Extracting file 6...
..\bin\gsort.exe: C:\Users\negge\AppData\Local\Temp\UpdateCabExeIdsAndLocations.txt: No such file or directory
Could Not Find C:\Users\negge\AppData\Local\Temp\UpdateCabExeIdsAndLocations.txt
Joining files 5 and 6 to file 7...
12:56:38.85 - Done.
Verifying integrity of existing updates for dotnet x64-glb...
hashdeep64.exe: Audit passed
negg
 
Posts: 222
Joined: 26.03.2014, 11:46

PreviousNext

Return to Download

Who is online

Users browsing this forum: Google [Bot] and 41 guests