guix http downloads don't resume

  • Open
  • quality assurance status badge
Details
3 participants
  • Danny Milosavljevic
  • Ludovic Courtès
  • swedebugia
Owner
unassigned
Submitted by
Danny Milosavljevic
Severity
wishlist

Debbugs page

D
D
Danny Milosavljevic wrote on 20 Feb 2016 00:34
(address . bug-guix@gnu.org)
20160220093445.45cd64d2@scratchpost.org
Package: guix

By now, guix reconfigure has tried to download the same texlive binary from hydra at least 5 times to the same machine, unsuccessfully breaking after about 1 GB each, for a total of 5 GB, always starting from the beginning.

Would it be possible to just resume?

Additionally, it doesn't seem like it checks the Content-Length in order to find out whether the connection broke before the file was done. Why doesn't it?

The http-client seems to handle chunked encoding - so not sure whether it's a problem with hydra or with guix.
D
D
Danny Milosavljevic wrote on 20 Feb 2016 00:44
error messages
(address . 22745@debbugs.gnu.org)
20160220094442.6033b960@scratchpost.org
----
Found valid signature for /gnu/store/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523-texmf.tar.xz
Downloading 36wqhb...-texlive-20150523-texmf.tar.xz (1.76GiB installed)...
bzip2: Data integrity error when decompressing.
http://Inputfile = (stdin), output file = (stdout)wfqg6n-texlive-20150523-texmf.tar.xz 1.1MiB/s 13:24 | 893.9MiB transferred

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

guix substitute: error: corrupt input while restoring '/gnu/store/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523-texmf.tar.xz' from #{read pipe}#
killing process 3867g/nar/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523-texmf.tar.xz 1.1MiB/s 13:24 | 893.9MiB transferred
guix system: error: build failed: some substitutes for the outputs of derivation `/gnu/store/83nkdyp9wl6zwflcm416xf1imppp7v9f-texlive-20150523-texmf.tar.xz.drv' failed (usually happens due to networking issues); try `--fallback' to build derivation from source
---

Also, downloading it by wget right afterwards, it works just fine, all 1.77 GB of it. Wtf?
L
L
Ludovic Courtès wrote on 25 Mar 2016 01:35
Re: bug#22745: guix http downloads don't resume
(name . Danny Milosavljevic)(address . dannym@scratchpost.org)(address . 22745@debbugs.gnu.org)
87poujt0ov.fsf@gnu.org
Danny Milosavljevic <dannym@scratchpost.org> skribis:

Toggle quote (4 lines)
> By now, guix reconfigure has tried to download the same texlive binary from hydra at least 5 times to the same machine, unsuccessfully breaking after about 1 GB each, for a total of 5 GB, always starting from the beginning.
>
> Would it be possible to just resume?

There does not seem to be an easy way to achieve this.

Toggle quote (2 lines)
> Additionally, it doesn't seem like it checks the Content-Length in order to find out whether the connection broke before the file was done. Why doesn't it?

For archives (the /nar/foo URLs), there is currently no ‘Content-Length’
header at all (this is because Hydra, the software, generates those
files on the fly; we should tweak nginx to add a ‘Content-Length’
header, but this seems to require an external nginx plugin.)

However, the {mirror.,}hydra.gnu.org use chunked encoding, indeed, which
allows the HTTP client to detect truncated transfers.

Ludo’.
L
L
Ludovic Courtès wrote on 26 Apr 2016 02:55
control message for bug #22745
(address . control@debbugs.gnu.org)
87inz4wv77.fsf@gnu.org
severity 22745 wishlist
S
S
swedebugia wrote on 17 Dec 2018 01:25
guix http downloads don't resume
(address . 22745@debbugs.gnu.org)
d92eb9eef33bfffee3a710404b6577f9@riseup.net
Hi

Is this still a problem after Pierres work on texlive and when using the
mirror?

--
Cheers
Swedebugia
?
Your comment

Commenting via the web interface is currently disabled.

To comment on this conversation send an email to 22745@patchwise.org

To respond to this issue using the mumi CLI, first switch to it
mumi current 22745
Then, you may apply the latest patchset in this issue (with sign off)
mumi am -- -s
Or, compose a reply to this issue
mumi compose
Or, send patches to this issue
mumi send-email *.patch