Request for merging "python-team" branch

Done

Details

3 participants

Andreas Enge
John Kehayias
Sharlatan Hellseher

Owner: unassigned

Submitted by: Sharlatan Hellseher

Severity: normal

Debbugs page

Sharlatan Hellseher wrote on 22 Jul 01:25 -0700

Recipients:(address . guix-patches@gnu.org)

Message-ID:874iv44oog.fsf@gmail.com

Hi Guix,

Placing to the queue the Python team branch. It will include the work of

"On the way to pyproject-build-system everywhere"

https://codeberg.org/guix/guix/milestone/20775

Oleg

John Kehayias wrote on 16 Sep 11:32 -0700

Recipients:(name . Sharlatan Hellseher)(address . sharlatanus@gmail.com)(address . 79073@debbugs.gnu.org)

Message-ID:87wm5yxn85.fsf@protonmail.com

Hi Oleg!

On Tue, Jul 22, 2025 at 09:25 AM, Sharlatan Hellseher wrote:

Toggle quote (9 lines)

> Hi Guix,

> Placing to the queue the Python team branch. It will include the work of

> "On the way to pyproject-build-system everywhere"

> <https://codeberg.org/guix/guix/milestone/20775>

> --

> Oleg

What is the current status of this branch? I have a big world rebuild
going on in mesa-updates (next in the queue) and was wondering if I
should rebase on this branch?

In particular, I see python-coverage is failing tests on mesa-updates. I
tried to just cherry pick the update to that package from python-team
but it seems it is failing for other reasons (it does build on
python-team).

Thanks!
John

John Kehayias wrote on 16 Sep 12:02 -0700

Recipients:(name . Sharlatan Hellseher)(address . sharlatanus@gmail.com)(address . 79073@debbugs.gnu.org)

Message-ID:87qzw6xlui.fsf@protonmail.com

On Tue, Sep 16, 2025 at 06:32 PM, John Kehayias wrote:

Toggle quote (23 lines)> Hi Oleg!
>
> On Tue, Jul 22, 2025 at 09:25 AM, Sharlatan Hellseher wrote:
>
>> Hi Guix,
>>
>> Placing to the queue the Python team branch. It will include the work of
>> "On the way to pyproject-build-system everywhere"
>> <https://codeberg.org/guix/guix/milestone/20775>
>>
>> --
>> Oleg
>
> What is the current status of this branch? I have a big world rebuild
> going on in mesa-updates (next in the queue) and was wondering if I
> should rebase on this branch?
>
> In particular, I see python-coverage is failing tests on mesa-updates. I
> tried to just cherry pick the update to that package from python-team
> but it seems it is failing for other reasons (it does build on
> python-team).
>

Just tried a local rebase and python-coverage does build successfully.
So if I should rebase on the python-team branch, I can do that in the
next day or so with a version bump to mesa as well. Let me know what you
are thinking with the branch or if there are a few commits I can just
cherry pick.

Toggle quote (2 lines)

> Thanks!

> John

Andreas Enge wrote on 17 Sep 02:43 -0700

Recipients:(name . John Kehayias)(address . john.kehayias@protonmail.com)

Message-ID:aMqCwRpWgZ_yVZDj@jurong

Hello,

is the branch ready from the Python team perspective?

It currently fails to evaluate on data.qa (just as mesa-updates, but for

a different reason):

https://data.qa.guix.gnu.org/revision/848519ed83a65d8405c78bc99157bcd02207b7a6

I do not know whether this is due to a problem with the branch (I could

build it locally) or a (transient?) failure of the data service (which

has some recent evaluations of the master branch).

Maybe you could try to rebase once again?

If the problem comes from the data service, we could also go by CI:

https://ci.guix.gnu.org/jobset/python-team

I do not quite know how to judge a branch by CI; the best way I see

(literally) is looking at the dashboard for x86_64, which currently

still has a lot of holes.

Andreas

Sharlatan Hellseher wrote on 17 Sep 04:47 -0700

(no subject)

Recipients:(address . 79073@debbugs.gnu.org)

Message-ID:87zfatfgh8.fsf@gmail.com

Hi,

I've migrated the last python package which affect ration is >0.7%, see:

https://codeberg.org/guix/guix/issues/928, and was about to fix any

build/test issue on a wider scale.

https://codeberg.org/Hellseher/guix-files/src/branch/main/python-team-stats.json

My strategy is:

- build all packages which affect ration is >0.7%

- build all packages where input count >= 10

- if I have resources build all >0.7% with -P1

I need help to verify the builds or fix failing packages.

Toggle snippet (25 lines)

---[ Commits stats ]---

* from-to: 3d3ae727d6106ffeae9cf80e3369842610670efb..36ecf6b0f2e4fbc57bdbc222a1c002f16b7bf7b6

* count: 479

---[ Packages stats ]---

* added: 17

* fixed: 25

* adjusted: 19

* realocated: 8

* removed: 29

* updated: 262

---[ Contributors ]---

* Felix Gruber <felgru@posteo.net>

* Jake Forster <jakecameron.forster@gmail.com>

* Maxim Cournoyer <maxim.cournoyer@gmail.com>

* Nguyễn Gia Phong <mcsinyx@disroot.org>

* Nicolas Graves <ngraves@ngraves.fr>

* Sharlatan Hellseher <sharlatanus@gmail.com>

* wrobell <wrobell@riseup.net>

---[ Refresh inpact ]---

Building the following 5179 packages would ensure 18509 dependent packages are rebuilt

Oleg

Andreas Enge wrote on 17 Sep 05:01 -0700

Re:

Recipients:(name . Sharlatan Hellseher)(address . sharlatanus@gmail.com)

Message-ID:aMqjGJB3qr1JP9NH@jurong

After Oleg rebased the branch, I have tried to restart guix-data-service
on data.qa to force an evaluation, but it fails to start with messages
like this:
# herd start guix-data-service
Service user-homes has been started.
PID file '/var/run/guix-data-service/pid' did not show up; terminating process 66636.
Service guix-data-service could not be started.
herd: error: failed to start service guix-data-service

and no message in the log file. I have seen this PID file not showing
quite frequently with bffe, but there it can usually be "solved" by just
restarting the service. Could you maybe have a look, Chris?

Andreas

Sharlatan Hellseher wrote on 17 Sep 12:33 -0700

Request for merging "python-team" branch

Recipients:(address . 79073@debbugs.gnu.org)

Message-ID:CAO+9K5psnVYfkx5QY3WSftMFtvOWLmQ6Pke_Y4ofQyAqbAmfYg@mail.gmail.com

Hi John,


I tried my best to remove development dependencies from inputs: coverage,
pylint, flake and friends (see details on the milestone).

Encourage everyone not to include them in new packages, and
exclude while refreshing existing ones.

VCS: https://github.incerto.xyz/;https://git.sr.ht/~hellseher/
GPG: 9847 81DE 689C 21C2 6418 0867 76D7 27BF F62C D2B5

… наш разум - превосходная объяснительная машина которая способна найти
смысл почти в чем угодно, истолковать любой феномен, но совершенно не в
состоянии принять мысль о непредсказуемости.

Attachment: file

Andreas Enge wrote on 18 Sep 00:46 -0700

Recipients:(name . John Kehayias)(address . john.kehayias@protonmail.com)

Message-ID:aMu41cjIeC7dUQls@jurong

Am Wed, Sep 17, 2025 at 11:43:29AM +0200 schrieb Andreas Enge:

Toggle quote (3 lines)

> If the problem comes from the data service, we could also go by CI:

> https://ci.guix.gnu.org/jobset/python-team

The branch still fails to be evaluated by the data service, but has been

finished (on x86_64 and i686) on CI.

The dashboard

https://ci.guix.gnu.org/eval/2086165/dashboard

looks mostly green, but there is a certain cumulation of dark red

(failed builds) and rose (failed dependencies) dots for python-...

packages.

Maybe the python team (in cc) could have a look?

Andreas

Sharlatan Hellseher wrote on 18 Sep 15:04 -0700

Request for merging "python-team" branch

Recipients:(address . 79073@debbugs.gnu.org)

Message-ID:87wm5vfmd4.fsf@gmail.com

1. Success to build all packages with large impact!

Toggle snippet (2 lines)

./pre-inst-env guix build -v1 $(jq -r '.[]|select(.affect_ratio > 0.7)| [.package_name + "@" + .package_guix_version]|@tsv' python-team-stats.json)

Sharlatan Hellseher wrote 5 days ago

Recipients:(address . 79073@debbugs.gnu.org)

Message-ID:CAO+9K5pJVdYwUuK+aiUjM3f7_aACNLTqpnqWOmYXupfveXZG+w@mail.gmail.com

Hi,

Writing on the way for
https://codeberg.org/guix/guix/issues/2816

One last check I liked to perform before merge

guix build -v1 -P1 python-cython

As cython is defaulted to V3 now with python-cython-0 for the older version

I will be available in about 3h


VCS: https://github.incerto.xyz/;https://git.sr.ht/~hellseher/
GPG: 9847 81DE 689C 21C2 6418 0867 76D7 27BF F62C D2B5

… наш разум - превосходная объяснительная машина которая способна найти
смысл почти в чем угодно, истолковать любой феномен, но совершенно не в
состоянии принять мысль о непредсказуемости.

Attachment: file

Andreas Enge wrote 3 days ago

Recipients:(name . Sharlatan Hellseher)(address . sharlatanus@gmail.com)

Message-ID:aNRK78gk4_678ld1@jurong

Hello,

do you think you will be able to sort out

https://codeberg.org/guix/guix/issues/2944

and to push to master tomorrow? I would like to go ahead with the

mesa-updates branch and the libxml2 fix, and python-team looks really

almost finished now :)

Andreas

Sharlatan Hellseher wrote 3 days ago

Request for merging "python-team" branch

Recipients:(address . 79073@debbugs.gnu.org)

Message-ID:87segb8qxw.fsf@gmail.com

Hi!

There is a strieng forward solution for

https://codeberg.org/guix/guix/issues/2944 preposed by Hugo in

<ttps://codeberg.org/guix/guix/pulls/2963> which we are testing right

now.

I'm quite confident that SciPy does not need all of that propoaged

inputs at all.

I can bulid some portion of -P1 for python-scipy tey are not too many,

rebased and merge tonight, WDYT?

---

Oleg

Andreas Enge wrote 2 days ago

Recipients:(name . Sharlatan Hellseher)(address . sharlatanus@gmail.com)

Message-ID:aNT2B3Yl8xhPfWUg@jurong

Am Wed, Sep 24, 2025 at 10:46:03PM +0100 schrieb Sharlatan Hellseher:

Toggle quote (5 lines)

> I'm quite confident that SciPy does not need all of that propoaged

> inputs at all.

> I can bulid some portion of -P1 for python-scipy tey are not too many,

> rebased and merge tonight, WDYT?

Sounds good to me, thanks!

Andreas

Sharlatan Hellseher wrote 2 days ago

Request for merging "python-team" branch

Recipients:(address . 79073-done@debbugs.gnu.org)

Message-ID:87plbe9ayr.fsf@gmail.com

Hi!

Toggle snippet (8 lines)

remote: Resolving deltas: 100% (3085/3085), completed with 81 local objects.

remote: * Checking 1 references

remote: Checked 1 references in total

To ssh://codeberg.org/guix/guix.git

e2a42ac5aca..ea44a564d14 master -> master

updating local tracking ref 'refs/remotes/origin/master'

--
Thanks,
Oleg

Closed

Andreas Enge wrote 2 days ago

Recipients:(name . Sharlatan Hellseher)(address . sharlatanus@gmail.com)

Message-ID:aNVsGiHWK3wfiJ-i@jurong

Thanks to all of you for the good work in getting the branch ready

for merge!

Andreas

Your comment

Commenting via the web interface is currently disabled.

To comment on this conversation send an email to 79073@patchwise.org

To respond to this issue using the mumi CLI, first switch to it

mumi current 79073

Then, you may apply the latest patchset in this issue (with sign off)

mumi am -- -s

Or, compose a reply to this issue

mumi compose

Or, send patches to this issue

mumi send-email *.patch

is:open	open issues
is:done	closed issues
submitter:<who>	search issue submitter
author:<who>	search by message author
date:yesterday..now	search by issue date
mdate:3m..2d	search by message date