A complete rewrite of the Linux scripts

Re: A complete rewrite of the Linux scripts

Postby Dalai » 19.07.2017, 19:55

lindesbs wrote:So, this directory will grow larger than 30GB.

I need bigger USB sticks

You can use whatever type of storage you want. Within the same network - including VMs - a network share is the most simple and comfortable one IMO. You can also skip directories you don't need on the target system when copying the wsusoffline\client directory, if so required. If you don't have any MS Office installed on the target machine, then skip wsusoffline\client\ofc directory; if you don't have Win8.x/Server 2012 on the target machine, then skip wsusoffline\client\w62 and w63 directories, and so on.

I only use network shares myself, so I don't have to mess around with storage media or worry about how to get the update files to the target machine(s).

Regards
Dalai
Dalai
 
Posts: 609
Joined: 12.07.2016, 22:00

Re: A complete rewrite of the Linux scripts

Postby udo2toni » 20.07.2017, 22:16

How do I have to configure Samba to do this?

I'm using User/Password authentification for Samba shares.

If starting the UpdateInstaller.exe as a normal User it will ask for Superuser Permission, but then there is no Access to the Samba Share anymore. If trying to start the Software as a Superuser, this will fail for the same reason, so the only way is to copy the whole set of files to the client...

Obviously, I made some mistakes in Samba Configuration?
udo2toni
 
Posts: 1
Joined: 20.07.2017, 22:06

Re: A complete rewrite of the Linux scripts

Postby aker » 20.07.2017, 23:51

No, that's caused by the Network drive management of Windows.
I'd suggest you to run UpdateInstaller.exeusing the UNC-path. When using an auth-free path, wsusou (just UpdateInstaller.exe, none of the CMD-files) is able to auto-mount it.
Wer Rechtschreibfehler findet, darf sie behalten oder an den Meistbietenden versteigern. / Everybody finding a misspelling is allowed to sell it.
aker
aker
 
Posts: 3029
Joined: 02.03.2011, 16:32
Location: /dev/kmem

Re: A complete rewrite of the Linux scripts

Postby boco » 22.07.2017, 02:13

Running normally vs. running with elevated rights, that's technically like two different users for network shares. If you use a mapped resource, you need to assign it two times: Once as normal user and once as Superuser. Otherwise, the share is simply gone after the user context switch.
Microsoft update catalog: http://catalog.update.microsoft.com/v7/site/
Windows Install media download: https://support.microsoft.com/en-us/help/15088/windows-create-installation-media
boco
 
Posts: 1984
Joined: 24.11.2009, 18:00
Location: Germany

Release Notes for Version 1.0-beta-5

Postby hbuhrmester » 26.08.2017, 09:52

Release Notes for Version 1.0-beta-5

Release date: 2017-08-25
Intended compatibility: WSUS Offline Update Version 11.0.1 and newer

This version offers the following changes:

  • The documentation files Quick_installation_guide.txt and Kurzinstallationsanleitung.txt were renamed in version 1.0-beta-4. If the old files are still present, they are removed now.

  • The environment variables $LINES and $COLUMNS are set to 24x80, if the script runs as a cron job.

    If the script runs within a terminal emulator window, it should get the real window dimensions with tput.

    This was reported by "mani" in viewtopic.php?f=9&t=6180&start=20#p23381

  • The calculation of the file ExcludeList-superseded-seconly.txt was simplified.

    This calculation now respects the additional configuration files for security only updates of the .NET Frameworks.

  • A new function seconly_safety_guard tries to make sure, that the configuration files for security only updates are updated after the official patch day.

    The download and installation of security only updates depends on the configuration files:

    Code: Select all
    wsusoffline/client/exclude/HideList-seconly.txt
    wsusoffline/client/static/StaticUpdateIds-w61-seconly.txt
    wsusoffline/client/static/StaticUpdateIds-w62-seconly.txt
    wsusoffline/client/static/StaticUpdateIds-w63-seconly.txt


    These files must be updated after each official patch day, which is the second Tuesday each month. They are needed to prevent WSUS Offline Update from downloading and installing full quality update rollups as well.

    The function seconly_safety_guard compares the modification dates of the configuration files to the date of the official patch day, to make sure, that the files have been updated. Otherwise, the download will be postponed.

    This problem is discussed in the forum at viewtopic.php?f=4&t=6897


Note: The first post with the introduction and the download links ( viewtopic.php?f=9&t=6180#p21327 ), and the installation guides in English ( viewtopic.php?f=9&t=6180#p21449 ) and German ( viewtopic.php?f=9&t=6180#p21450 ) have been updated to point to the new release.
hbuhrmester
 
Posts: 309
Joined: 11.10.2013, 21:59

Release Notes for Version 1.0

Postby hbuhrmester » 19.01.2018, 19:11

Release Notes for Version 1.0

Release date: 2018-01-19
Intended compatibility: WSUS Offline Update Version 11.1 and later

Changes in this version:

  • After about one year in beta status, this version is now designated version 1.0.

  • Bugfix: The function download_single_file_failsafe was revised to delete partial files between tries.

    The function download_single_file_failsafe is used to download the four virus definition files mpam-fe.exe, mpam-fex64.exe, mpas-fe.exe, and mpas-feX64.exe and the WSUS catalog file wsusscn2.cab in one pass. If the download fails, it is started new from scratch. This is necessary, because there are often different versions of the same file in the Microsoft content delivery network. Partial files must be removed between tries, but a bug caused them to persist.

    This was reported by 8marti in viewtopic.php?f=9&t=7069 .

  • Bugfix: The declaration of indexed arrays with "declare -ag" was removed.

    The declaration of arrays with "declare -ag" can lead to "unbound variable" errors in old versions of the bash, e.g. GNU bash, version 4.2.25, from Ubuntu 12.04 LTS. This error does not happen in more recent versions of the bash.

    But, since this declaration with "declare -ag" is not really necessary, it was removed now.

    This was reported by ede70 in viewtopic.php?f=9&t=7402 .

  • The Wget option --unlink was removed.

    The option --unlink is useful, if hard links are used to create local snapshots or backups, but this option is not available in old versions of GNU Wget.

  • A new standalone script rebuild-integrity-database.bash was added.

    The integrity database consists of hashdeep checksum files in the directory wsusoffline/client/md. They are accessed twice during each run:

    1. Before each download, the existing files are verified by recalculating their hashes and comparing them to the values in the integrity database.
    2. After each download, the hashes files are deleted and rebuilt with the new folder contents. This allows a simple integrity test: Most security downloads include the SHA-1 hash in the filename, as a hexadecimal number of 40 digits length. After calculating the hashes with hashdeep, the SHA-1 hashes can be compared to the expected values.

    Recalculating all hashes twice during each run causes a lot of processing. For convenience, the usage of the integrity database can be disabled in the preferences files. The new script rebuild-integrity-database.bash allows to recreate all checksum files at a later time.

    However, this script is optional – you can just keep the regular schedule, as it was established by the Windows script DownloadUpdates.cmd.

    This was requested by AlBundy in viewtopic.php?f=9&t=7338 ; see also the discussion in viewtopic.php?f=9&t=7331 .

  • Support for .NET Framework 4.7.1 was added.

  • Support for Office 2007 was removed.

  • Internal Changes

    The functions remove_german_language_support and remove_english_language_support now keep the file modification date.

    The new filter function todos_line_endings changes the output of hashdeep to DOS line endings on the fly.

    The functions trash_file and unpack_wsus_catalog_file were revised to produce more output.

  • The copyright was updated to 2018.

    Source files are still licensed on a per-file basis, since this is often recommended, e.g. by the GPL itself (see the section "How to Apply These Terms to Your New Programs" at the end of the GPL).

    The version information, release date and intended compatibility are removed from most files. They are now only in the scripts update-generator.bash and download-updates.bash, in the files version-history.txt and installed-version.txt, and in this file.

    This should allow smaller, incremental updates in the future.

Note: The first post with the introduction and the download links ( viewtopic.php?f=9&t=6180#p21327 ), and the installation guides in English ( viewtopic.php?f=9&t=6180#p21449 ) and German ( viewtopic.php?f=9&t=6180#p21450 ) have been updated to point to the new release.
hbuhrmester
 
Posts: 309
Joined: 11.10.2013, 21:59

Re: A complete rewrite of the Linux scripts

Postby mani » 21.01.2018, 12:50

Dear Hartmut
I had yesterday a broken (automatic) update and today morning again.....I thought it was a download problem and didn't had a closer look. Today I found the temp file intact from the download yesterday and assumed according the log file, that the program is using the defect download.
BUT: after deleting the the temp directory and a fresh download the log shows the same Validation error

2018-01-21 11:44:10 - Info: Searching downloaded files...
2018-01-21 11:44:10 - Info: Found archive: /tmp/wsusoffline_temp/sh-new-1.0.tar.gz
2018-01-21 11:44:10 - Info: Found hashes file: /tmp/wsusoffline_temp/hashes-sh-new-1.0.txt
2018-01-21 11:44:10 - Info: Verifying the integrity of the archive sh-new-1.0.tar.gz ...
2018-01-21 11:44:10 - Error: Validation failed

Best regards
Mani

strange: Debian file size is 584k (but wget is retrieving 242k and saving 584k), but with windows 242k
Server2:/tmp/wsusoffline_temp# ls -l
insgesamt 824
-rw-r--r-- 1 root root 266 Jan 19 17:43 hashes-sh-new-1.0.txt
-rw-r--r-- 1 root root 583680 Jan 19 17:43 sh-new-1.0.tar.gz
-rwxrwxr-x+ 1 root root 242429 Jan 20 12:06 sh-new-1.0.tar.gz____windowsDownload

--2018-01-21 11:44:10-- http://downloads.hartmut-buhrmester.de/ ... 1.0.tar.gz
Resolving downloads.hartmut-buhrmester.de (downloads.hartmut-buhrmester.de)... 80.237.132.245, 2a01:488:42:1000:50ed:84f5:3f:9682
Connecting to downloads.hartmut-buhrmester.de (downloads.hartmut-buhrmester.de)|80.237.132.245|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 242429 (237K) [application/x-tar]
Saving to: '/tmp/wsusoffline_temp/sh-new-1.0.tar.gz'

0K100% 780K=0.3s

2018-01-21 11:44:10 (780 KB/s) - '/tmp/wsusoffline_temp/sh-new-1.0.tar.gz' saved [583680]
mani
 
Posts: 11
Joined: 04.04.2017, 16:50

Re: A complete rewrite of the Linux scripts

Postby hbuhrmester » 21.01.2018, 15:32

You seem to have something, which is automatically unpacking the *.tar.gz archive to an uncompressed *.tar archive. I get the same file size as your "Debian" archive with gunzip:

Code: Select all
hb1@debian:/tmp/wsusoffline_temp$ gunzip sh-new-1.0.tar.gz
hb1@debian:/tmp/wsusoffline_temp$ ll
insgesamt 580
-rw-r--r--  1 hb1 hb1    266 Jan 19 17:43 hashes-sh-new-1.0.txt
drwxr-xr-x 11 hb1 hb1   4096 Jan 19 10:11 sh-new-1.0
-rw-r--r--  1 hb1 hb1 583680 Jan 19 17:43 sh-new-1.0.tar



The correct file sizes for the uploaded files are:

Code: Select all
hb1@debian:~/Projekte/Releases/2018-01-19_1.0/Uploads$ ll
insgesamt 540
-rw-r--r--  1 hb1 hb1    133 Jan 19 16:05 available-version.txt
-rw-r--r--  1 hb1 hb1    266 Jan 19 16:21 hashes-sh-new-1.0.txt
-rw-r--r--  1 hb1 hb1 242429 Jan 19 16:20 sh-new-1.0.tar.gz
-rw-r--r--  1 hb1 hb1 197692 Jan 19 17:02 virusreport-sh-new-1.0-fullpage.png
-rw-r--r--  1 hb1 hb1  86505 Jan 19 17:05 virusreport-sh-new-1.0.pdf



MD5 hashes are:

Code: Select all
hb1@debian:~/Projekte/Releases/2018-01-19_1.0/Uploads$ md5sum available-version.txt hashes-sh-new-1.0.txt sh-new-1.0.tar.gz virusreport-sh-new-1.0-fullpage.png virusreport-sh-new-1.0.pdf
46d2c5b0209fd0c573827e35d42bd041  available-version.txt
dadddf90707215ea4b2bb6bca9ccc69a  hashes-sh-new-1.0.txt
71990f37508c854cc0218568780e2b24  sh-new-1.0.tar.gz
6c93030d64370d74df57090f325f6d37  virusreport-sh-new-1.0-fullpage.png
aa908fa9cd6fa70409221b09ef9a3525  virusreport-sh-new-1.0.pdf



SHA-1 hashes are:

Code: Select all
hb1@debian:~/Projekte/Releases/2018-01-19_1.0/Uploads$ sha1sum available-version.txt hashes-sh-new-1.0.txt sh-new-1.0.tar.gz virusreport-sh-new-1.0-fullpage.png virusreport-sh-new-1.0.pdf
89752b8427b5785e5b64dd4ad9e93b48d9ec3a3e  available-version.txt
686424676ff81e5ebbade123a106ce6ccb666193  hashes-sh-new-1.0.txt
b96cf7a70d545bb149c080426a5ea860ef1d6ad0  sh-new-1.0.tar.gz
a83c0a3dfda367f90387cabafc7b7f22af13f710  virusreport-sh-new-1.0-fullpage.png
08d3637035d0d6b31f898ae19b0d5ef5954d379c  virusreport-sh-new-1.0.pdf



After an automatic update of the Linux scripts, the file sizes are the same:

Code: Select all
hb1@debian:/tmp/wsusoffline_temp$ ll
insgesamt 248
-rw-r--r--  1 hb1 hb1    266 Jan 19 17:43 hashes-sh-new-1.0.txt
drwxr-xr-x 11 hb1 hb1   4096 Jan 19 10:11 sh-new-1.0
-rw-r--r--  1 hb1 hb1 242429 Jan 19 17:43 sh-new-1.0.tar.gz



So, your "Windows" download is correct.


To test the automatic update of the Linux scripts, I created a symbolic link to the optional script 60-check-script-version.bash:

Code: Select all
hb1@debian:~/Projekte/wsusoffline_current/sh/common-tasks$ ln -s ../available-tasks/60-check-script-version.bash
hb1@debian:~/Projekte/wsusoffline_current/sh/common-tasks$ ll
insgesamt 72
-rw-r--r-- 1 hb1 hb1  2952 Aug 25 13:39 10-remove-obsolete-scripts.bash
-rw-r--r-- 1 hb1 hb1  4275 Aug 25 13:33 20-start-logging.bash
-rw-r--r-- 1 hb1 hb1  7108 Aug 25 13:33 30-check-needed-applications.bash
-rw-r--r-- 1 hb1 hb1 20821 Aug 25 13:33 40-configure-downloaders.bash
-rw-r--r-- 1 hb1 hb1 15986 Aug 25 13:33 50-check-wsusoffline-version.bash
lrwxrwxrwx 1 hb1 hb1    47 Jan 21 13:26 60-check-script-version.bash -> ../available-tasks/60-check-script-version.bash
-rw-r--r-- 1 hb1 hb1  9525 Aug 25 13:33 70-update-configuration-files.bash



It just works as expected:

Code: Select all
hb1@debian:~/Projekte/wsusoffline_current/sh$ ./update-generator.bash
Info: Starting update-generator.bash 1.0-beta-5 (2017-08-25)
Info: Command line: ./update-generator.bash
Info: Running on WSUS Offline Update version 11.1.1
Info: Repository last updated on 2018-01-18

Info: Checking needed applications...
Info: Checking recommended applications...
Info: Found Linux trash handler: gvfs-trash

Info: Setting download options for GNU Wget...
Info: Wake up sleeping DSL modems and routers...
PING fg.download.windowsupdate.com.c.footprint.net (8.253.190.248) 56(84) bytes of data.

--- fg.download.windowsupdate.com.c.footprint.net ping statistics ---
4 packets transmitted, 0 received, 100% packet loss, time 3064ms


Info: Testing the Internet connection...
Info: Connection test succeeded

Info: Searching for the most recent version of WSUS Offline Update...
Info: No newer version of WSUS Offline Update found

Info: Searching for new versions of the Linux scripts...
Info: A new version of the Linux scripts is available:
Info: - Installed version: 1.0-beta-5
Info: - Available version: 1.0
Info: Do you want to install the new version now?
---------------------------------------------------------------------------
Note: This question automatically selects "No" after 30 seconds, to skip
the pending update and let the script continue. This is also the default
answer, if you simply hit return.
---------------------------------------------------------------------------
[y|N]: y
Info: Starting update of the Linux scripts...
Info: Downloading archive and accompanying hashes file...
Info: Searching downloaded files...
Info: Found archive:     /tmp/wsusoffline_temp/sh-new-1.0.tar.gz
Info: Found hashes file: /tmp/wsusoffline_temp/hashes-sh-new-1.0.txt
Info: Verifying the integrity of the archive sh-new-1.0.tar.gz ...
hashdeep: Audit passed
   Input files examined: 0
  Known files expecting: 0
          Files matched: 1
Files partially matched: 0
            Files moved: 0
        New files found: 0
  Known files not found: 0
Info: Validated archive sh-new-1.0.tar.gz
Info: Unpacking tar.gz archive...
sh-new-1.0/
sh-new-1.0/libraries/
sh-new-1.0/libraries/digital-file-signatures.bash
sh-new-1.0/libraries/desktop-integration.bash
sh-new-1.0/libraries/timestamps.bash
sh-new-1.0/libraries/cleanup-client-directories.bash
sh-new-1.0/libraries/messages.bash
sh-new-1.0/libraries/updates-and-languages.bash
sh-new-1.0/libraries/files-and-folders.bash
sh-new-1.0/libraries/dos-files.bash
sh-new-1.0/libraries/usage.bash
sh-new-1.0/libraries/integrity-database.bash
sh-new-1.0/comparison-linux-windows/
sh-new-1.0/comparison-linux-windows/compare-integrity-database.bash
sh-new-1.0/comparison-linux-windows/example-results-ofc.txt
sh-new-1.0/comparison-linux-windows/example-results-md.txt
sh-new-1.0/comparison-linux-windows/compare-update-tables.bash
sh-new-1.0/preferences-template.bash
sh-new-1.0/get-all-updates.bash
sh-new-1.0/download-updates.bash
sh-new-1.0/update-generator-tasks/
sh-new-1.0/update-generator-tasks/10-show-selection-dialogs.bash
sh-new-1.0/update-generator.bash
sh-new-1.0/licence/
sh-new-1.0/licence/gpl.txt
sh-new-1.0/common-tasks/
sh-new-1.0/common-tasks/10-remove-obsolete-scripts.bash
sh-new-1.0/common-tasks/50-check-wsusoffline-version.bash
sh-new-1.0/common-tasks/20-start-logging.bash
sh-new-1.0/common-tasks/40-configure-downloaders.bash
sh-new-1.0/common-tasks/70-update-configuration-files.bash
sh-new-1.0/common-tasks/30-check-needed-applications.bash
sh-new-1.0/available-tasks/
sh-new-1.0/available-tasks/70-synchronize-with-target.bash
sh-new-1.0/available-tasks/60-check-script-version.bash
sh-new-1.0/available-tasks/71-make-shapshot.bash
sh-new-1.0/fix-file-permissions.bash
sh-new-1.0/versions/
sh-new-1.0/versions/installed-version.txt
sh-new-1.0/rebuild-integrity-database.bash
sh-new-1.0/download-updates-tasks/
sh-new-1.0/download-updates-tasks/60-main-updates.bash
sh-new-1.0/download-updates-tasks/50-superseded-updates.bash
sh-new-1.0/download-updates-tasks/10-parse-command-line.bash
sh-new-1.0/download-updates-tasks/20-get-sysinternals-helpers.bash
sh-new-1.0/download-updates-tasks/90-finalization.bash
sh-new-1.0/download-updates-tasks/30-remove-default-languages.bash
sh-new-1.0/download-updates-tasks/40-included-downloads.bash
sh-new-1.0/documentation/
sh-new-1.0/documentation/release_notes_1.0.txt
sh-new-1.0/documentation/Installationsanleitung.txt
sh-new-1.0/documentation/Installation_Guide.txt
sh-new-1.0/documentation/Manual.pdf
sh-new-1.0/documentation/Manual.odt
sh-new-1.0/documentation/Structure_of_the_WSUS_catalog_file.txt
sh-new-1.0/documentation/usage.txt
sh-new-1.0/documentation/version-history.txt
Info: Searching unpacked directory...
Info: Found directory: /tmp/wsusoffline_temp/sh-new-1.0
Info: Copying new files...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/available-tasks ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/common-tasks ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/comparison-linux-windows ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/documentation ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/download-updates-tasks ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/download-updates.bash ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/fix-file-permissions.bash ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/get-all-updates.bash ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/libraries ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/licence ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/preferences-template.bash ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/rebuild-integrity-database.bash ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/update-generator-tasks ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/update-generator.bash ...
Info: Copying /tmp/wsusoffline_temp/sh-new-1.0/versions ...
Info: Recomparing versions of the Linux scripts:
Info: - Installed version: 1.0
Info: - Available version: 1.0
Info: The update of the Linux scripts was successful
Info: Restarting script update-generator.bash ...

--------------------------------------------------------------------------------

Info: Starting update-generator.bash 1.0 (2018-01-19)
Info: Command line: /home/hb1/Projekte/wsusoffline_current/sh/update-generator.bash
Info: Running on WSUS Offline Update version 11.1.1
Info: Repository last updated on 2018-01-18

Info: Checking needed applications...
Info: Checking recommended applications...
Info: Found Linux trash handler: gvfs-trash

Info: Setting download options for GNU Wget...
Info: Wake up sleeping DSL modems and routers...
PING download.windowsupdate.com (8.253.190.248) 56(84) bytes of data.

--- download.windowsupdate.com ping statistics ---
4 packets transmitted, 0 received, 100% packet loss, time 3054ms


Info: Testing the Internet connection...
Info: Connection test succeeded

Info: Skipped searching for new versions of WSUS Offline Update, because it has already been done less
than one day ago

Info: Skipped searching for new versions of the Linux scripts, because it has already been done less
than one day ago

Info: Removing obsolete files from previous versions of WSUS Offline Update...
Info: Updating static and exclude definitions for download and update...
Info: Comparing file modification dates for ExcludeList-superseded-exclude.txt ...
Info: The file ExcludeList-superseded-exclude.txt did not change.
Info: Comparing file modification dates for HideList-seconly.txt ...
Info: The file HideList-seconly.txt did not change.
Info: Comparing file modification dates for StaticDownloadFiles-modified.txt ...
Info: The file StaticDownloadFiles-modified.txt did not change.
Info: Comparing file modification dates for ExcludeDownloadFiles-modified.txt ...
Info: The file ExcludeDownloadFiles-modified.txt did not change.
Info: Comparing file modification dates for StaticUpdateFiles-modified.txt ...
Info: The file StaticUpdateFiles-modified.txt did not change.
Info: Updated static and exclude definitions for download and update


Update selection
----------------
 1) w60         Windows Server 2008, 32-bit
 2) w60-x64     Windows Server 2008, 64-bit
 3) w61         Windows 7, 32-bit
 4) w61-x64     Windows 7 / Server 2008 R2, 64-bit
 5) w62-x64     Windows Server 2012, 64-bit
 6) w63         Windows 8.1, 32-bit
 7) w63-x64     Windows 8.1 / Server 2012 R2, 64-bit
 8) w100        Windows 10, 32-bit
 9) w100-x64    Windows 10 / Server 2016, 64-bit
10) o2k10       Office 2010, 32-bit
11) o2k10-x64   Office 2010, 32-bit and 64-bit
12) o2k13       Office 2013, 32-bit
13) o2k13-x64   Office 2013, 32-bit and 64-bit
14) o2k16       Office 2016, 32-bit
15) o2k16-x64   Office 2016, 32-bit and 64-bit
Please select your update:



It works with aria2c as well.

Also, you should not run the script as root. This is not necessary for the download.

Regards,
hbuhrmester
hbuhrmester
 
Posts: 309
Joined: 11.10.2013, 21:59

Re: A complete rewrite of the Linux scripts

Postby hbuhrmester » 21.01.2018, 15:42

Also note, that the content-type is "x-tar", but the encoding is "x-gzip".

My wget from Debian 9 Stretch handles this correctly:

Code: Select all
hb1@debian:~/tmp$ wget --debug http://downloads.hartmut-buhrmester.de/sh-new-1.0.tar.gz
DEBUG output created by Wget 1.18 on linux-gnu.

Reading HSTS entries from /home/hb1/.wget-hsts
URI encoding = »UTF-8«
Converted file name 'sh-new-1.0.tar.gz' (UTF-8) -> 'sh-new-1.0.tar.gz' (UTF-8)
--2018-01-21 14:41:18--  http://downloads.hartmut-buhrmester.de/sh-new-1.0.tar.gz
Auflösen des Hostnamens »downloads.hartmut-buhrmester.de (downloads.hartmut-buhrmester.de)« … 80.237.132.245, 2a01:488:42:1000:50ed:84f5:3f:9682
Caching downloads.hartmut-buhrmester.de => 80.237.132.245 2a01:488:42:1000:50ed:84f5:3f:9682
Verbindungsaufbau zu downloads.hartmut-buhrmester.de (downloads.hartmut-buhrmester.de)|80.237.132.245|:80 … verbunden.
Created socket 3.
Releasing 0x01c98220 (new refcount 1).

---request begin---
GET /sh-new-1.0.tar.gz HTTP/1.1
User-Agent: Wget/1.18 (linux-gnu)
Accept: */*
Accept-Encoding: identity
Host: downloads.hartmut-buhrmester.de
Connection: Keep-Alive

---request end---
HTTP-Anforderung gesendet, auf Antwort wird gewartet …
---response begin---
HTTP/1.1 200 OK
Date: Sun, 21 Jan 2018 13:41:18 GMT
Content-Type: application/x-tar
Content-Length: 242429
Connection: keep-alive
Server: Apache
Last-Modified: Fri, 19 Jan 2018 16:43:09 GMT
ETag: "3b2fd-56323c68d3ff6"
Accept-Ranges: bytes
Content-Encoding: x-gzip

---response end---
200 OK
Registered socket 3 for persistent reuse.
Länge: 242429 (237K) [application/x-tar]
Wird in »»sh-new-1.0.tar.gz«« gespeichert.

sh-new-1.0.tar.gz         100%[=====================================>] 236,75K   629KB/s    in 0,4s   

2018-01-21 14:41:18 (629 KB/s) - »»sh-new-1.0.tar.gz«« gespeichert [242429/242429]


Regards,
hbuhrmester
hbuhrmester
 
Posts: 309
Joined: 11.10.2013, 21:59

Re: A complete rewrite of the Linux scripts

Postby mani » 21.01.2018, 15:50

Thanks Hartmut
I downgraded wget from 1.19.2-2 to 1.18-5 and I get now the right file size.......
It looks like the newest debian version has some strange changes.....I will investigate

BR
Mani
mani
 
Posts: 11
Joined: 04.04.2017, 16:50

PreviousNext

Return to Linux

Who is online

Users browsing this forum: No registered users and 2 guests