Subject: Re: bug#27386: offloading documentation and env

From: Oleg Pykhalov <[email-masked]>
Date: Wed, 05 Jul 2017 20:06:07 +0300

[email-masked] (Ludovic Courtès) writes:

> Hi,
>
> Oleg Pykhalov <[email-masked]> skribis:
>
>> process 5294 acquired build slot '/var/guix/offload/magnolia.local/0'
>> waiting for locks or build slots...
>> process 5294 acquired build slot '/var/guix/offload/magnolia.local/0'
>> process 5294 acquired build slot '/var/guix/offload/magnolia.local/0'
>> process 5294 acquired build slot '/var/guix/offload/magnolia.local/0'
>> process 5294 acquired build slot '/var/guix/offload/magnolia.local/0'
>> process 5294 acquired build slot '/var/guix/offload/magnolia.local/0'
>>   C-c C-c
>
> When that happens, could you check how many ‘guix offload’ processes are
> running?
> 
> Also, are you sure that the build machine is eligible for offloading
> (matching system type, normalized load is below 2.0, etc.)?

Yes, machine is totally free for load.

I captured 1 process as I see:
root     23867  4.9  0.9 128648 35656 ?        SLsl 20:01   0:00 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real offload x86_64-linux 0 1 0

Before
======

natsu@clover ~$ ps auxwwww | grep guix
root       341  0.0  0.1  34588  4704 ?        Ss   Jul03   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon --build-users-group guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
guix-pu+   433  0.0  0.6 121548 25940 ?        Ssl  Jul03   0:00 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real publish -u guix-publish -p 80 -C 3 --nar-path=nar --listen=0.0.0.0
root       476  0.0  0.1  34900  4212 ?        Ss   Jul03   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 433                 guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
natsu    10446  2.0 17.0 3342808 671380 ?      Sl   Jul04  30:29 /home/natsu/.guix-profile/bin/icecat
natsu    21472  0.0  3.0 376328 119796 pts/8   Ssl+ 18:59   0:02 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile -L /gnu/store/3ahyhf5fp6jvvln0xw0v1bjka1z6i69m-emacs-guix-0.3.1/share/guile/site/2.2 -C /gnu/store/3ahyhf5fp6jvvln0xw0v1bjka1z6i69m-emacs-guix-0.3.1/lib/guile/2.2/site-ccache -L /home/natsu/.config/guix/latest -C /home/natsu/.config/guix/latest -L /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/share/guile/site/2.2 -C /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/share/guile/site/2.2 --listen=/tmp/emacs-guix-20138f3K/repl-socket -q -L /gnu/store/620x0ky0cyqihnqx3nrjnqj5xw4zvj67-geiser-0.9/share/geiser/guile/
natsu    21479  0.2  3.9 257152 156592 pts/4   Sl   18:59   0:08 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real environment guix
root     21483  0.1  0.2  45420  8744 ?        Ss   18:59   0:06 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 21479               guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
root     21484  0.0  1.0 126748 42332 ?        Sl   18:59   0:01 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real substitute --query
natsu    23822  0.0  0.0   8168  1464 pts/5    S+   19:59   0:00 grep guix

natsu@clover ~$ ssh magnolia.local 'ps auxwwww | grep guix'
root       426  0.0  0.0  34584  4820 ?        Ss   Jul04   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon --build-users-group guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
guix-pu+   603  0.0  0.1 219164 44260 ?        SLsl Jul04   0:02 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real publish -u guix-publish -p 80 -C 3 --nar-path=nar --listen=0.0.0.0
root       635  0.0  0.0  35904  5680 ?        Ss   Jul04   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 603                 guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
natsu     4056  0.0  0.0   8076  1416 pts/5    S+   Jul04   0:00 tail -f /var/log/guix-daemon.log
natsu    27391  0.0  0.0  17988  3436 ?        Ss   19:59   0:00 bash -c ps auxwwww | grep guix
natsu    27396  0.0  0.0   8164  1540 ?        S    19:59   0:00 grep guix

During
======

natsu@clover ~$ ps auxwwww | grep guix
root       341  0.0  0.1  34588  4704 ?        Ss   Jul03   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon --build-users-group guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
guix-pu+   433  0.0  0.6 121548 25940 ?        Ssl  Jul03   0:00 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real publish -u guix-publish -p 80 -C 3 --nar-path=nar --listen=0.0.0.0
root       476  0.0  0.1  34900  4212 ?        Ss   Jul03   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 433                 guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
natsu    10446  2.0 17.0 3342808 671200 ?      Sl   Jul04  30:30 /home/natsu/.guix-profile/bin/icecat
natsu    21472  0.0  3.0 376328 119796 pts/8   Ssl+ 18:59   0:02 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile -L /gnu/store/3ahyhf5fp6jvvln0xw0v1bjka1z6i69m-emacs-guix-0.3.1/share/guile/site/2.2 -C /gnu/store/3ahyhf5fp6jvvln0xw0v1bjka1z6i69m-emacs-guix-0.3.1/lib/guile/2.2/site-ccache -L /home/natsu/.config/guix/latest -C /home/natsu/.config/guix/latest -L /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/share/guile/site/2.2 -C /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/share/guile/site/2.2 --listen=/tmp/emacs-guix-20138f3K/repl-socket -q -L /gnu/store/620x0ky0cyqihnqx3nrjnqj5xw4zvj67-geiser-0.9/share/geiser/guile/
natsu    21479  0.2  3.9 257152 156592 pts/4   Sl   18:59   0:08 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real environment guix
root     21483  0.1  0.2  45420  8744 ?        Ss   18:59   0:06 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 21479               guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
root     21484  0.0  1.0 126748 42332 ?        Sl   18:59   0:01 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real substitute --query
natsu    23854 33.7  3.5 236004 138320 pts/4   Sl+  20:01   0:07 /home/natsu/.guix-profile/bin/guile --no-auto-compile /home/natsu/src/guix/scripts/guix build -K t-engine
root     23860  0.7  0.1  36404  6648 ?        Ss   20:01   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 23854               guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
root     23862  2.5  0.8 123752 35232 ?        Sl   20:01   0:00 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real substitute --query
root     23867  4.9  0.9 128648 35656 ?        SLsl 20:01   0:00 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real offload x86_64-linux 0 1 0
natsu    23876  0.0  0.0   8168  1556 pts/5    S+   20:01   0:00 grep guix

natsu@clover ~$ ssh magnolia.local 'ps auxwwww | grep guix'
root       426  0.0  0.0  34584  4820 ?        Ss   Jul04   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon --build-users-group guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
guix-pu+   603  0.0  0.1 219164 44260 ?        SLsl Jul04   0:02 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real publish -u guix-publish -p 80 -C 3 --nar-path=nar --listen=0.0.0.0
root       635  0.0  0.0  35904  5680 ?        Ss   Jul04   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 603                 guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
natsu     4056  0.0  0.0   8076  1416 pts/5    S+   Jul04   0:00 tail -f /var/log/guix-daemon.log
natsu    27432  0.0  0.0  17988  3408 ?        Ss   20:01   0:00 bash -c ps auxwwww | grep guix
natsu    27437  0.0  0.0   8164  1476 ?        S    20:01   0:00 grep guix

After
=====

natsu@clover ~$ ps auxwwww | grep guix
root       341  0.0  0.1  34588  4704 ?        Ss   Jul03   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon --build-users-group guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
guix-pu+   433  0.0  0.6 121548 25940 ?        Ssl  Jul03   0:00 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real publish -u guix-publish -p 80 -C 3 --nar-path=nar --listen=0.0.0.0
root       476  0.0  0.1  34900  4212 ?        Ss   Jul03   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 433                 guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
natsu    10446  2.0 16.8 3326416 664492 ?      Sl   Jul04  30:33 /home/natsu/.guix-profile/bin/icecat
natsu    21472  0.0  3.0 376328 119796 pts/8   Ssl+ 18:59   0:02 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile -L /gnu/store/3ahyhf5fp6jvvln0xw0v1bjka1z6i69m-emacs-guix-0.3.1/share/guile/site/2.2 -C /gnu/store/3ahyhf5fp6jvvln0xw0v1bjka1z6i69m-emacs-guix-0.3.1/lib/guile/2.2/site-ccache -L /home/natsu/.config/guix/latest -C /home/natsu/.config/guix/latest -L /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/share/guile/site/2.2 -C /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/share/guile/site/2.2 --listen=/tmp/emacs-guix-20138f3K/repl-socket -q -L /gnu/store/620x0ky0cyqihnqx3nrjnqj5xw4zvj67-geiser-0.9/share/geiser/guile/
natsu    21479  0.2  3.9 257152 156592 pts/4   Sl   18:59   0:08 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real environment guix
root     21483  0.1  0.2  45420  8744 ?        Ss   18:59   0:06 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 21479               guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
root     21484  0.0  1.0 126748 42332 ?        Sl   18:59   0:01 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real substitute --query
natsu    23922  0.0  0.0   8168  1536 pts/5    S+   20:04   0:00 grep guix

natsu@clover ~$ ssh magnolia.local 'ps auxwwww | grep guix'
root       426  0.0  0.0  34584  4820 ?        Ss   Jul04   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon --build-users-group guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
guix-pu+   603  0.0  0.1 219164 44260 ?        SLsl Jul04   0:02 /gnu/store/w0jb15z5sa08fzcapvgyii49cygygyx5-guile-2.2.2/bin/guile --no-auto-compile /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/.guix-real publish -u guix-publish -p 80 -C 3 --nar-path=nar --listen=0.0.0.0
root       635  0.0  0.0  35904  5680 ?        Ss   Jul04   0:00 /gnu/store/nrd0v38d61l8y16vqkb1gws0bw45q885-guix-0.13.0-2.de9d8f0/bin/guix-daemon 603                 guixbuild --max-silent-time 0 --timeout 0 --substitute-urls https://mirror.hydra.gnu.org
natsu     4056  0.0  0.0   8076  1416 pts/5    S+   Jul04   0:00 tail -f /var/log/guix-daemon.log
natsu    27474  0.0  0.0  17988  3540 ?        Ss   20:04   0:00 bash -c ps auxwwww | grep guix
natsu    27479  0.0  0.0   8164  1472 ?        S    20:04   0:00 grep guix