#59365 - make-dynamic-linker-cache OOMs for LLVM 15 on i686-linux

Package	Source(s)		Maintainer(s)
guix		PTS Buildd Popcon

Message #17 received at 59365@debbugs.gnu.org (full text, mbox, reply):

Received: (at 59365) by debbugs.gnu.org; 12 Apr 2024 09:36:11 +0000
From debbugs-submit-bounces@debbugs.gnu.org Fri Apr 12 05:36:11 2024
Received: from localhost ([127.0.0.1]:57890 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces@debbugs.gnu.org>)
	id 1rvDKM-00031R-1Y
	for submit@debbugs.gnu.org; Fri, 12 Apr 2024 05:36:11 -0400
Received: from mail3-relais-sop.national.inria.fr ([192.134.164.104]:58021)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludovic.courtes@inria.fr>) id 1rvDKF-0002zU-9m
 for 59365@debbugs.gnu.org; Fri, 12 Apr 2024 05:36:07 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inria.fr; s=dc;
 h=from:to:cc:subject:in-reply-to:references:date:
 message-id:mime-version:content-transfer-encoding;
 bh=mkSSTBDlziE099EF+00sj6ds+WxmMVU8AyZInxGilnc=;
 b=ruKAaKjt7yMNp9GOR30ggdc5zVbFW9drYw7wzDS0R2JpqJZKBm9PqE92
 h/tKEP/bVvI6uangtLLLUghdY9BqMIM1e6eeSKCDHC4pHwhQa1nMW62OX
 dPcX/O1Oby3KjXyoKu02ClI4dV5SbABHmN0bNTfXNYgJwdNt5PJIbfc9w 8=;
Authentication-Results: mail3-relais-sop.national.inria.fr;
 dkim=none (message not signed) header.i=none;
 spf=SoftFail smtp.mailfrom=ludovic.courtes@inria.fr;
 dmarc=fail (p=none dis=none) d=inria.fr
X-IronPort-AV: E=Sophos;i="6.07,195,1708383600"; d="scan'208";a="84585832"
Received: from unknown (HELO ribbon) ([193.50.110.177])
 by mail3-relais-sop.national.inria.fr with
 ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Apr 2024 11:35:47 +0200
From: Ludovic Courtès <ludovic.courtes@inria.fr>
To: 59365@debbugs.gnu.org
Subject: Re: bug#59365: make-dynamic-linker-cache OOMs for LLVM 15 on
 i686-linux
In-Reply-To: <877cznidn8.fsf@gnu.org> ("Ludovic Courtès"'s message of "Tue, 22 Nov 2022 09:42:19 +0100")
References: <87mt8o14xd.fsf@gnu.org> <877cznidn8.fsf@gnu.org>
Date: Fri, 12 Apr 2024 11:35:47 +0200
Message-ID: <87le5igbyk.fsf@gnu.org>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 59365
Cc: Romain Garbage <romain.garbage@inria.fr>, Greg Hogan <code@greghogan.com>,
 Maxim Cournoyer <maxim.cournoyer@gmail.com>, Marius Bakke <marius@gnu.org>
X-BeenThere: debbugs-submit@debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request@debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit@debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request@debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request@debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces@debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces@debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hello,

Ludovic Courtès <ludo@gnu.org> skribis:

>>   GC Warning: Failed to expand heap by 285216768 bytes
>>   GC Warning: Failed to expand heap by 268439552 bytes
>>   GC Warning: Out of Memory! Heap size: 3620 MiB. Returning NULL!
>>   Warning: Unwind-only out of memory exception; skipping pre-unwind handler.
>>   Warning: Unwind-only out of memory exception; skipping pre-unwind handler.
>>   Warning: Unwind-only out of memory exception; skipping pre-unwind handler.
>>
>> (excerpt from https://ci.guix.gnu.org/build/1702995/log/raw)
>>
>> Not sure why this phase uses so much memory.  Ideas?
>
> Yes: the gremlin.scm code uses ‘file-dynamic-info’, which loads the
> whole file in memory.  Ridiculous.
>
> We should instead mmap it (but there are no ‘mmap’ bindings in Guile,
> yet) or arrange to load just the relevant parts (we’ll have to check but
> maybe ‘file-dynamic-info’ can find everything it needs at the beginning
> of a file, the PT_DYNAMIC segment.)

Another instance of the problem that we just stumbled upon is ‘guix pack -RR’:
that too tries to load entire ELF files in memory, in
‘elf-loader-compile-flags’.

Mmap!

Ludo’.

Display info messages

Send a report that this bug log contains spam.

debbugs.gnu.org maintainers <help-debbugs@gnu.org>. Last modified: Mon Sep 8 11:46:37 2025; Machine Name: wallace-server

GNU bug tracking system

Debbugs is free software and licensed under the terms of the GNU Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

#59365 make-dynamic-linker-cache OOMs for LLVM 15 on i686-linux