Report forwarded
to bug-guix@gnu.org: bug#77407; Package guix.
(Mon, 31 Mar 2025 16:04:04 GMT) (full text, mbox, link).
Acknowledgement sent
to Andreas Enge <andreas@enge.fr>:
New bug report received and forwarded. Copy sent to bug-guix@gnu.org.
(Mon, 31 Mar 2025 16:04:04 GMT) (full text, mbox, link).
Subject: Re: shepherd hangs at "herd restart nginx"
Date: Mon, 31 Mar 2025 18:09:51 +0200
Today I noticed that the QA webpage was 502 on bayfront.
I restarted qa-frontpage and bffe without problem.
When trying to do "herd restart nginx", the command did not show any
output and did not come back. Moreover, "herd status" also hang without
any output.
I could still ssh into the machine and then, thanks to Ludovic, reboot
with the magic command
guix shell guile shepherd -- guile -c '(use-modules (shepherd system)) (sync) (reboot-kexec)'
Andreas
Severity set to 'important' from 'normal'
Request was from Ludovic Courtès <ludo@gnu.org>
to control@debbugs.gnu.org.
(Mon, 31 Mar 2025 16:17:06 GMT) (full text, mbox, link).
Information forwarded
to bug-guix@gnu.org: bug#77407; Package guix.
(Tue, 01 Apr 2025 12:21:05 GMT) (full text, mbox, link).
Subject: Re: shepherd hangs at "herd restart nginx"
Date: Tue, 01 Apr 2025 14:19:32 +0200
Hello,
Andreas Enge <andreas@enge.fr> skribis:
> Today I noticed that the QA webpage was 502 on bayfront.
> I restarted qa-frontpage and bffe without problem.
> When trying to do "herd restart nginx", the command did not show any
> output and did not come back. Moreover, "herd status" also hang without
> any output.
FWIW, I tested ‘bare-bones.tmpl’ with just nginx added; running:
while herd restart nginx; do : ; done
in that VM didn’t trigger the hang.
So I’m a bit at loss as to why this fails on bayfront. If someone has
ideas (and time!) on how to get a config closer to that of bayfront that
we could test in a VM, that’d be great. Otherwise, we’ll have to debug
in production…
> I could still ssh into the machine and then, thanks to Ludovic, reboot
> with the magic command
> guix shell guile shepherd -- guile -c '(use-modules (shepherd system)) (sync) (reboot-kexec)'
To be clear: this should be a last resort. :-)
Thanks,
Ludo’.
Information forwarded
to bug-guix@gnu.org: bug#77407; Package guix.
(Wed, 09 Apr 2025 16:58:01 GMT) (full text, mbox, link).
Ludovic Courtès <ludo@gnu.org> writes:
> I just realized: this may well be fixed by Shepherd commit
> a5d9a41aa0bfadea9617df4411b86c6ea0c525bd (see
> <https://issues.guix.gnu.org/77373>.) Would be great to give it a try
> somehow.
I've reconfigured one of the machines I was struggling with this issue
on with shepherd commit 8d31cafbdcb818160852a5d1e6fc24c1a9c53e41 and I
can no longer reproduce the issue.
There was a failing shepherd test, but I just disabled tests.
Cc: Andreas Enge <andreas@enge.fr>, 77407@debbugs.gnu.org
Subject: Re: bug#77407: shepherd hangs at "herd restart nginx"
Date: Thu, 10 Apr 2025 14:38:27 +0200
Christopher Baines <mail@cbaines.net> skribis:
>> I just realized: this may well be fixed by Shepherd commit
>> a5d9a41aa0bfadea9617df4411b86c6ea0c525bd (see
>> <https://issues.guix.gnu.org/77373>.) Would be great to give it a try
>> somehow.
>
> I've reconfigured one of the machines I was struggling with this issue
> on with shepherd commit 8d31cafbdcb818160852a5d1e6fc24c1a9c53e41 and I
> can no longer reproduce the issue.
Did you try hard enough? :-) As in:
while herd restart nginx; do : ; done
> There was a failing shepherd test, but I just disabled tests.
If you still have the build log, I’d be happy to see it.
Thanks for testing!
Ludo’.
Information forwarded
to bug-guix@gnu.org: bug#77407; Package guix.
(Thu, 10 Apr 2025 12:54:03 GMT) (full text, mbox, link).
Ludovic Courtès <ludo@gnu.org> writes:
> Christopher Baines <mail@cbaines.net> skribis:
>
>>> I just realized: this may well be fixed by Shepherd commit
>>> a5d9a41aa0bfadea9617df4411b86c6ea0c525bd (see
>>> <https://issues.guix.gnu.org/77373>.) Would be great to give it a try
>>> somehow.
>>
>> I've reconfigured one of the machines I was struggling with this issue
>> on with shepherd commit 8d31cafbdcb818160852a5d1e6fc24c1a9c53e41 and I
>> can no longer reproduce the issue.
>
> Did you try hard enough? :-) As in:
>
> while herd restart nginx; do : ; done
I did, and previously it happened almost every time I restarted nginx.
>> There was a failing shepherd test, but I just disabled tests.
>
> If you still have the build log, I’d be happy to see it.
Unfortunately I don't seem to have it, I can't reproduce the failure so
it seems to be a flaky test.
Cc: Andreas Enge <andreas@enge.fr>, 77407@debbugs.gnu.org
Subject: Re: bug#77407: shepherd hangs at "herd restart nginx"
Date: Thu, 10 Apr 2025 15:10:40 +0200
Christopher Baines <mail@cbaines.net> skribis:
>>> I've reconfigured one of the machines I was struggling with this issue
>>> on with shepherd commit 8d31cafbdcb818160852a5d1e6fc24c1a9c53e41 and I
>>> can no longer reproduce the issue.
>>
>> Did you try hard enough? :-) As in:
>>
>> while herd restart nginx; do : ; done
>
> I did, and previously it happened almost every time I restarted nginx.
Phew, that’s a relief.
I’ll tag 1.0.4 hopefully next week.
Thanks,
Ludo’.
Debbugs is free software and licensed under the terms of the
GNU Public License version 2. The current version can be
obtained from https://bugs.debian.org/debbugs-source/.