GNU bug report logs

#22304 Build for Julia is not reproducible

PackageSource(s)Maintainer(s)
guix PTS Buildd Popcon
Full log

Message #23 received at 22304@debbugs.gnu.org (full text, mbox, reply):

Received: (at 22304) by debbugs.gnu.org; 24 Jan 2020 18:30:39 +0000
From debbugs-submit-bounces@debbugs.gnu.org Fri Jan 24 13:30:39 2020
Received: from localhost ([127.0.0.1]:54746 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces@debbugs.gnu.org>)
	id 1iv3j4-00083t-Tn
	for submit@debbugs.gnu.org; Fri, 24 Jan 2020 13:30:39 -0500
Received: from mail-qt1-f196.google.com ([209.85.160.196]:36825)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@gmail.com>) id 1iv3j3-00083h-84
 for 22304@debbugs.gnu.org; Fri, 24 Jan 2020 13:30:37 -0500
Received: by mail-qt1-f196.google.com with SMTP id t13so1867223qto.3
 for <22304@debbugs.gnu.org>; Fri, 24 Jan 2020 10:30:37 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=mime-version:references:in-reply-to:from:date:message-id:subject:to
 :cc:content-transfer-encoding;
 bh=JmpBZsGn/5JzuCPFoadgGxKRx/IeNvX/DSQ4grvMMog=;
 b=jBhsGx9w05CMIgfsB9Lou8F+7C1IyPxIoncWlRuFouVm5UTNutKTa2nf4Ai4YbGGe/
 yLroBrwUT9e+C7tJt7AQB9V6ISJ7sXdbce+VsRK5ux2UpqHXxVKoTOyv4Mbw36nJXxos
 mOmut+jLXPxlyJU4NCy2mVCpsNkdyU4Vu6TucXPt3sQuivEvr37OLo06O7afuLh+rE/A
 qhGgS1AfkmdItK3+3xgeB42Dhe6mnH+usM6bhv3uPgmfELp9kUBiyJTuAj/NFT2j7rJX
 wtn+EmNX8ubByT8cTlzd91Od5wqmsuMzBxpHHq+7U8A7M2UHkRj9w0tm8voaaM14r8hf
 gnTA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:references:in-reply-to:from:date
 :message-id:subject:to:cc:content-transfer-encoding;
 bh=JmpBZsGn/5JzuCPFoadgGxKRx/IeNvX/DSQ4grvMMog=;
 b=tKly0+s8PcSOIorhsuoN/x4X02QNbiSx8pSAoY+lOeQ0YL12guixzdSUxPXQyQQaV3
 /57anDEgRFEa++clgv1lgcWZqtUApzjahlQp3tHT0zQXLLruM71rW26utGoJhuG1hCNr
 g+k9huavj+rfW1O1m+7Er46FcnudV+roXJDoUafTWyMvs1ebouNvtInuECiNxR1oOErt
 EYjwelMzHz4oe60+lwYBqBJG5Vrlex/nLsBABtX/BeedsmA00cQ0pJwd8p1K/t0+JC7u
 NDrMgODEGuylkiV/YzFBcM7R+IYqzp+rHLR0Qn1EwZOElAxwYSdWiVHDY1W6LLYRlBG/
 t0/Q==
X-Gm-Message-State: APjAAAUppaCPDJN/wzudU1uSsGlKBquBppaeUeCDYs/fZ3CDCHfkT0a8
 L5/9lc/Uz2aCx1eiRk95YYlNmIfKrav4QBit8mc=
X-Google-Smtp-Source: APXvYqxRaZcH3JArQp5ytOm94ArOXP0mlKNi2NDQ1+/X9/tGSM+979dDpsBMPjBadWq6N9HSjXQT0sqDLGX8Un/9XBE=
X-Received: by 2002:ac8:4890:: with SMTP id i16mr3486991qtq.211.1579890631705; 
 Fri, 24 Jan 2020 10:30:31 -0800 (PST)
MIME-Version: 1.0
References: <CAJ3okZ3i90aWjZgZmvZSNad6XbWoRqBsk6KQnxZXaWO8Tq53eQ@mail.gmail.com>
 <874kymsli5.fsf@gnu.org>
 <CAJ3okZ0ZZQVqLWWYg=M9sHCfyScy=S9hyraydUbrF2GQwN5hPg@mail.gmail.com>
In-Reply-To: <CAJ3okZ0ZZQVqLWWYg=M9sHCfyScy=S9hyraydUbrF2GQwN5hPg@mail.gmail.com>
From: zimoun <zimon.toutoune@gmail.com>
Date: Fri, 24 Jan 2020 19:30:20 +0100
Message-ID: <CAJ3okZ0Yx8+dveO5ooQUBkJe0jAwZHZuwk5rj_c1LKXYXberhg@mail.gmail.com>
Subject: Re: bug#22304: Julia not reproducible
To: Ludovic Courtès <ludo@gnu.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 22304
Cc: Ricardo Wurmus <rekado@elephly.net>, 22304@debbugs.gnu.org
X-BeenThere: debbugs-submit@debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request@debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit@debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request@debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request@debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces@debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces@debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
Hi,

On Mon, 2 Dec 2019 at 18:28, zimoun <zimon.toutoune@gmail.com> wrote:

> If I understand well [1], the file .ji are "precompiled" (analogy: .pyc). Hum?!

The non-determinism seems coming from these "precompiled" .ji files
and 2 bugs are opened upstream.

https://github.com/JuliaLang/julia/issues/25900
https://github.com/JuliaLang/julia/issues/34115

Thanks to Nicolò to pointing out these [1] when working on the version update.

[1] https://debbugs.gnu.org/cgi/bugreport.cgi?bug=38546#80

With lengthy and clear details. :-)


Let start the container with everything useful.

--8<---------------cut here---------------start------------->8---
mkdir -p /tmp/test-julia && cd /tmp/test-julia

guix time-machine --commit=b5d4d5b \
   environment -u nixbld --no-cwd --container --network \
   --expose=$(realpath determinism) --share=/tmp/test-julia \
   --ad-hoc julia coreutils nss-certs curl tar gzip
--8<---------------cut here---------------end--------------->8---

Then, the path to reproduce is odd because there is no Julia packages
in Guix. So we need to use 'Pkg' from Julia which downloads from
elsewhere and the reproducibility of such is not well controlled but
it gives an idea. :-)

--8<---------------cut here---------------start------------->8---
export SSL_CERT_DIR="$GUIX_ENVIRONMENT/etc/ssl/certs"
export SSL_CERT_FILE="$SSL_CERT_DIR/ca-certificates.crt"
export GIT_SSL_CAINFO="$SSL_CERT_FILE"

# populate the Julia package manager
julia --startup-file=no -q -e 'using Pkg; Pkg.instantiate()'

# install something
julia --startup-file=no -q -e 'using Pkg; Pkg.add("Compat")'

# use something / precompiled it
julia --startup-file=no -q -e 'using Compat'

# check the .ji file
md5sum ~/.julia/compiled/v1.1/Compat/*
--8<---------------cut here---------------end--------------->8---


Then each time one runs this block, one gets different hash.


All the best,
simon




Send a report that this bug log contains spam.


debbugs.gnu.org maintainers <help-debbugs@gnu.org>. Last modified: Sun Dec 22 17:39:25 2024; Machine Name: wallace-server

GNU bug tracking system

Debbugs is free software and licensed under the terms of the GNU Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

Copyright © 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson, 2005-2017 Don Armstrong, and many other contributors.