GNU bug report logs - #40381
Guix shouldn't request substitutes for profile derivations

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 40381 in the body.
You can then email your comments to 40381 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: pkill9 <pkill9 <at> runbox.com>
To: bug-guix <at> gnu.org
Subject: Guix shouldn't request substitutes for profile derivations
Date: Wed, 1 Apr 2020 21:18:46 +0100

I see that Guix is requesting substitutes from the build servers before
it builds a profile derivation. 

Message #8 received at 40381 <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: pkill9 <pkill9 <at> runbox.com>
Cc: 40381 <at> debbugs.gnu.org
Subject: Re: bug#40381: Guix shouldn't request substitutes for profile
 derivations
Date: Thu, 02 Apr 2020 12:44:42 +0200

Hi,

pkill9 <pkill9 <at> runbox.com> skribis:

> I see that Guix is requesting substitutes from the build servers before
> it builds a profile derivation. 

Can you show more precisely what you mean by pasting a command and its
output?

With the recent changes in the implementation of grafts, what happens is
usually this:

  $ guix build foo
  updating the list of substitutes…
  The following things will be built/downloaded:
  …

  updating the list of substitutes…
  The following things will be built/downloaded:
  …

The second stage here typically includes profile.drv as well as grafts.
All this is expected behavior.

Detailed behavior depends on what’s in /gnu/store, the freshness of
substitute info in /var/guix/substitute/cache, and applicable grafts for
the package(s) at hand.

Thanks,
Ludo’.

Message #13 received at 40381 <at> debbugs.gnu.org (full text, mbox):

From: pkill9 <pkill9 <at> runbox.com>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: 40381 <at> debbugs.gnu.org
Subject: Re: bug#40381: Guix shouldn't request substitutes for profile
 derivations
Date: Sun, 26 Apr 2020 16:58:34 +0100

Hi Ludovic

> Can you show more precisely what you mean by pasting a command and its
> output?
> 
> With the recent changes in the implementation of grafts, what happens
> is usually this:
> 
>   $ guix build foo
>   updating the list of substitutes…
>   The following things will be built/downloaded:
>   …
> 
>   updating the list of substitutes…
>   The following things will be built/downloaded:
>   …
> 
> The second stage here typically includes profile.drv as well as
> grafts. All this is expected behavior.

I think that since profile.drv is always produced locally on the
machine, then it's unnecessary to update the list of substitutes
when it's on that second stage.

Message #16 received at 40381 <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: pkill9 <pkill9 <at> runbox.com>
Cc: 40381 <at> debbugs.gnu.org
Subject: Re: bug#40381: Guix shouldn't request substitutes for profile
 derivations
Date: Sun, 26 Apr 2020 22:20:38 +0200

Hi,

pkill9 <pkill9 <at> runbox.com> skribis:

>> Can you show more precisely what you mean by pasting a command and its
>> output?
>> 
>> With the recent changes in the implementation of grafts, what happens
>> is usually this:
>> 
>>   $ guix build foo
>>   updating the list of substitutes…
>>   The following things will be built/downloaded:
>>   …
>> 
>>   updating the list of substitutes…
>>   The following things will be built/downloaded:
>>   …
>> 
>> The second stage here typically includes profile.drv as well as
>> grafts. All this is expected behavior.
>
> I think that since profile.drv is always produced locally on the
> machine, then it's unnecessary to update the list of substitutes
> when it's on that second stage.

I don’t observe this, or rather I cannot blame profile.drv for this.

Can you show more precisely what you mean by pasting a command and its
output?

Thanks,
Ludo’.

Message #19 received at 40381 <at> debbugs.gnu.org (full text, mbox):

From: pkill9 <pkill9 <at> runbox.com>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: 40381 <at> debbugs.gnu.org
Subject: Re: bug#40381: Guix shouldn't request substitutes for profile
 derivations
Date: Mon, 27 Apr 2020 04:35:12 +0100

Hi,

> Can you show more precisely what you mean by pasting a command and its
> output?

So it seems it tries to look for substitutes when the profile hooks are built,
not when profile.drv is built.

Here is the output without build hooks:
```
itsme <at> antelope ~> guix environment --ad-hoc hello
The following derivation will be built:
   /gnu/store/gkz9hzjpc9pj1np7vi5pwb4xhmssk55d-profile.drv
building profile with 1 package...
Welcome to fish, the friendly interactive shell
itsme <at> antelope ~ [Guix env: /gnu/store/nsi48y..]>
```

And here is output with build hooks:
```
itsme <at> antelope ~> guix environment --ad-hoc man-db hello
substitute: updating substitutes from 'https://berlin.guixsd.org'... 100.0%
substitute: updating substitutes from 'https://mirror.hydra.gnu.org'... 100.0%
substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
The following derivation will be built:
   /gnu/store/w623j5spid7kyxjdp6xbgxs2r5scpjkn-profile.drv
The following profile hooks will be built:
   /gnu/store/14d1mgn1mwz66mj28rwjmnkddskf4zm0-info-dir.drv
   /gnu/store/7rrkqrdpxahk8g0927d56lpgz3n1kl6z-manual-database.drv
   /gnu/store/8h76m85hiyilv0mj053i9n7k2nxb0wf1-ca-certificate-bundle.drv
   /gnu/store/ia5d18hpmza375dizljqi2x12zlirwqi-fonts-dir.drv
building CA certificate bundle...
building fonts directory...
building directory of Info manuals...
building database for manual pages...
building profile with 2 packages...
Welcome to fish, the friendly interactive shell
itsme <at> antelope ~ [Guix env: /gnu/store/9qv380..]>
```

Message #24 received at 40381-done <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: pkill9 <pkill9 <at> runbox.com>
Cc: 40381-done <at> debbugs.gnu.org
Subject: Re: bug#40381: Guix shouldn't request substitutes for profile
 derivations
Date: Fri, 01 May 2020 01:22:51 +0200

Hi,

pkill9 <pkill9 <at> runbox.com> skribis:

> So it seems it tries to look for substitutes when the profile hooks are built,
> not when profile.drv is built.
>
> Here is the output without build hooks:
> ```
> itsme <at> antelope ~> guix environment --ad-hoc hello
> The following derivation will be built:
>    /gnu/store/gkz9hzjpc9pj1np7vi5pwb4xhmssk55d-profile.drv
> building profile with 1 package...
> Welcome to fish, the friendly interactive shell
> itsme <at> antelope ~ [Guix env: /gnu/store/nsi48y..]>
> ```
>
> And here is output with build hooks:
> ```
> itsme <at> antelope ~> guix environment --ad-hoc man-db hello
> substitute: updating substitutes from 'https://berlin.guixsd.org'... 100.0%
> substitute: updating substitutes from 'https://mirror.hydra.gnu.org'... 100.0%
> substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
> The following derivation will be built:
>    /gnu/store/w623j5spid7kyxjdp6xbgxs2r5scpjkn-profile.drv
> The following profile hooks will be built:
>    /gnu/store/14d1mgn1mwz66mj28rwjmnkddskf4zm0-info-dir.drv
>    /gnu/store/7rrkqrdpxahk8g0927d56lpgz3n1kl6z-manual-database.drv
>    /gnu/store/8h76m85hiyilv0mj053i9n7k2nxb0wf1-ca-certificate-bundle.drv
>    /gnu/store/ia5d18hpmza375dizljqi2x12zlirwqi-fonts-dir.drv

Looks like manual-database.drv was the only hook not mark as
non-substitutable.

Fixed in 69de98391d720b92206d5e45072ecd3944d95774.

Thanks,
Ludo’.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.