GNU bug report logs - #44574
guix weather not checking all substitute urls

Previous Next

Package: guix;

Reported by: Efraim Flashner <efraim <at> flashner.co.il>

Date: Wed, 11 Nov 2020 11:31:01 UTC

Severity: normal

Done: Ludovic Courtès <ludo <at> gnu.org>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 44574 in the body.
You can then email your comments to 44574 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-guix <at> gnu.org:
bug#44574; Package guix. (Wed, 11 Nov 2020 11:31:01 GMT) Full text and rfc822 format available.

Acknowledgement sent to Efraim Flashner <efraim <at> flashner.co.il>:
New bug report received and forwarded. Copy sent to bug-guix <at> gnu.org. (Wed, 11 Nov 2020 11:31:01 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Efraim Flashner <efraim <at> flashner.co.il>
To: bug-guix <at> gnu.org
Subject: guix weather not checking all substitute urls
Date: Wed, 11 Nov 2020 13:30:05 +0200
[Message part 1 (text/plain, inline)]
I would have assumed that it would check for all of the substitute urls
I listed and not just the first one. Most of the packages listed below
I've test built on my pine64 so they shouldn't appear in the list
anymore.

(ins)efraim <at> E5400 ~/workspace/guix-1.2.0$ time ./pre-inst-env guix weather -c 100 --system=aarch64-linux --substitute-urls="https://ci.guix.gnu.org http://pine64:3000"
computing 14,359 package derivations for aarch64-linux...
looking for 14,945 store items on https://ci.guix.gnu.org...
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
https://ci.guix.gnu.org
  52.4% substitutes available (7,838 out of 14,945)
  at least 25,425.6 MiB of nars (compressed)
  46,859.9 MiB on disk (uncompressed)
  0.002 seconds per request (30.7 seconds in total)
  487.1 requests per second

  0.0% (3 out of 7,107) of the missing items are queued
  at least 1,000 queued builds
      aarch64-linux: 123 (12.3%)
      i686-linux: 401 (40.1%)
      x86_64-linux: 404 (40.4%)
      armhf-linux: 72 (7.2%)
  build rate: 124.61 builds per hour
      x86_64-linux: 50.96 builds per hour
      i686-linux: 35.14 builds per hour
      armhf-linux: 17.95 builds per hour
      aarch64-linux: 20.57 builds per hour
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
1857 packages are missing from 'https://ci.guix.gnu.org' for 'aarch64-linux', among which:
  1625  rust <at> 1.24.1     /gnu/store/iaw29nqdhsvpg1zi4xh2i7q9v813kjyw-rust-1.24.1-cargo /gnu/store/kgn4q5nfdmh4hx32b1zd907ri0a26x26-rust-1.24.1-doc /gnu/store/fm
k8vnwc1x8a91w5ybdrfbfrfiq91d3y-rust-1.24.1
   766  ghc <at> 7.10.2      /gnu/store/zcvd3yqka7s1gn323y202rqxirmldawi-ghc-7.10.2-doc /gnu/store/vhhjk5z31rgxw82bv3dmrhz2fyhvh3yl-ghc-7.10.2
   749  r-yaml <at> 2.2.1    /gnu/store/d06vsnv4rbkz389g7wrh0xbr3mb37rbk-r-yaml-2.2.1
   747  r-highr <at> 0.8     /gnu/store/gjwsyw35p4c6cd7gqrnl4xjpgys6pic7-r-highr-0.8
   562  jamvm <at> 1.5.1     /gnu/store/mwgkpyjgrw4cnvkhglz2605i7c1rpfva-jamvm-1.5.1
   509  sbcl-lift <at> 1.7.1-1.7d49a66       /gnu/store/javclx2bycs1ig5rc0z5zw86ljwc5x5m-sbcl-lift-1.7.1-1.7d49a66
   488  r-rlang <at> 0.4.8   /gnu/store/l50wdpz16295diabmp2pkkvz2q0f52p3-r-rlang-0.4.8
   487  sbcl-net.didierverna.asdf-flv <at> 2.1       /gnu/store/mk4lpkafkbpsncf7qf7i310ix9h14xal-sbcl-net.didierverna.asdf-flv-2.1
   451  r-bh <at> 1.72.0-3   /gnu/store/0n560alajilbryj94z46wabfkq6hjjm9-r-bh-1.72.0-3
   436  sbcl-trivial-gray-streams <at> 0.0.0-1.ebd59b1       /gnu/store/s4cghmgb9pf79zw9z81lnp9ff5rx6p0g-sbcl-trivial-gray-streams-0.0.0-1.ebd59b1
   245  r-munsell <at> 0.5.0 /gnu/store/2gwfqxkpjvk4yjycs26n17dxkxd2w5m0-r-munsell-0.5.0
   236  r-r-cache <at> 0.14.0        /gnu/store/2g3c41lnvir5rr5ppn3svf2acqzs2290-r-r-cache-0.14.0
   236  sbcl-cffi-libffi <at> 0.21.0 /gnu/store/znfcdhp684zvjcipi5dvydn5886xzsa4-sbcl-cffi-libffi-0.21.0
   175  libpipeline <at> 1.5.3       /gnu/store/6qi0yj1i61py5mhg02vll8b6gbjilngl-libpipeline-1.5.3
   173  r-curl <at> 4.3      /gnu/store/gv0jw7rsmjq6a6xzzil1xlml2yd59mm8-r-curl-4.3
   169  python2-cffi <at> 1.14.0     /gnu/store/d24l9z1an90d9h2dk5zhliwp5rirh6ic-python2-cffi-1.14.0
   160  python2-iso8601 <at> 0.1.12  /gnu/store/ncbiv7lrikp7hqj6nykd4hsrjillg5rg-python2-iso8601-0.1.12
   156  python2-pytest-cov <at> 2.8.1        /gnu/store/xdxx4w89lqcdi9yzxrjzd2fwbq58a7dk-python2-pytest-cov-2.8.1
   156  sbcl-closer-mop <at> 1.0.0-2.19c9d33 /gnu/store/c4mch43a7w4ivhrcz0wkfb2936dyr8p3-sbcl-closer-mop-1.0.0-2.19c9d33
   154  kservice <at> 5.70.0 /gnu/store/2lhmsz7k8hgqhgahcj6bfcgmknnfbk5w-kservice-5.70.0
   151  r-survival <at> 3.2-7        /gnu/store/5yfkcacmm4lpygvfb8xk291p9f10c244-r-survival-3.2-7
   148  sbcl-trivial-garbage <at> 0.21       /gnu/store/zz75ir2q0k7gd6wprr42vxg7vsjcrb0i-sbcl-trivial-garbage-0.21
   138  cl-trivial-features <at> 0.8-1.870d03d       /gnu/store/6apvh159ld0b1rwsbzav1ls90bgiq5ad-cl-trivial-features-0.8-1.870d03d
   132  python2-markupsafe <at> 1.1.1        /gnu/store/hc6aami5qjwrmdfsj0m6rky5qsz0518n-python2-markupsafe-1.1.1
   128  zeromq <at> 4.3.3    /gnu/store/kpwiaj4ng31p71p15rdww6fnggc54l8w-zeromq-4.3.3
   113  webkitgtk <at> 2.30.2        /gnu/store/2hv5x29z673nzn4m11h21xxzgb0k47hv-webkitgtk-2.30.2-doc /gnu/store/whxb77cnsbhwd0dn0dcam8hjpz0z5ffy-webkitgtk-2.30.2
   110  numactl <at> 2.0.14  /gnu/store/dlc90qk7152iqf702hkp5y1axb8fr1dj-numactl-2.0.14
   106  emacs-shut-up <at> 0.3.2     /gnu/store/g6vjsdslm4m3bp6wbz0j9rwnmp3vr1x8-emacs-shut-up-0.3.2
   105  emacs-f <at> 0.20.0  /gnu/store/ars7lf4vswnw731pklng4dprwmw41km0-emacs-f-0.20.0

real    2m43.059s
user    2m10.339s
sys     0m3.571s

When I reversed the order of the substitute servers:
(ins)efraim <at> E5400 ~/workspace/guix-1.2.0$ time ./pre-inst-env guix weather -c 100 --system=aarch64-linux --substitute-urls="http://pine64:3000 https://ci.guix.gnu.org"
computing 14,359 package derivations for aarch64-linux...
looking for 14,945 store items on http://pine64:3000...
updating substitutes from 'http://pine64:3000'... 100.0%
http://pine64:3000
  7.7% substitutes available (1,148 out of 14,945)
  unknown substitute sizes
  5,199.5 MiB on disk (uncompressed)
  0.011 seconds per request (171.8 seconds in total)
  86.0 requests per second
  (continuous integration information unavailable)
updating substitutes from 'http://pine64:3000'... 100.0%
4885 packages are missing from 'http://pine64:3000' for 'aarch64-linux', among which:
  10801 python-minimal <at> 3.8.2    /gnu/store/r7ncfbpi0q153qybcbhpzqf5rf6wg4pg-python-minimal-3.8.2
  10651 xtrans <at> 1.4.0    /gnu/store/an00f8f7cq2hdh5pak9f50ngx4xy0bgq-xtrans-1.4.0
  8954  autoconf-wrapper <at> 2.69   /gnu/store/3m5kvv8a5196gk1x3n0qdn5f07g9v4gb-autoconf-wrapper-2.69
  8470  datefudge <at> 1.23  /gnu/store/rwk9qqb61iyn2bqy4w39j4v9llrqc6xk-datefudge-1.23
  <..snip..>

-- 
Efraim Flashner   <efraim <at> flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
[signature.asc (application/pgp-signature, inline)]

Information forwarded to bug-guix <at> gnu.org:
bug#44574; Package guix. (Mon, 16 Nov 2020 17:16:02 GMT) Full text and rfc822 format available.

Message #8 received at 44574 <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: Efraim Flashner <efraim <at> flashner.co.il>, 44574 <at> debbugs.gnu.org
Subject: Re: bug#44574: guix weather not checking all substitute urls
Date: Mon, 16 Nov 2020 18:12:54 +0100
Hi Efraim,

On Wed, 11 Nov 2020 at 13:30, Efraim Flashner <efraim <at> flashner.co.il> wrote:
> I would have assumed that it would check for all of the substitute urls
> I listed and not just the first one. Most of the packages listed below
> I've test built on my pine64 so they shouldn't appear in the list
> anymore.

I think #44688 [1] fixes it.  Please let me know.

1: <http://issues.guix.gnu.org/issue/44688>


Examples:

--8<---------------cut here---------------start------------->8---
$ ./pre-inst-env guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
computing 15,391 package derivations for x86_64-linux...
looking for 16,707 store items on https://bayfront.guix.gnu.org...
updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
https://bayfront.guix.gnu.org
  55.6% substitutes available (9,289 out of 16,707)
  at least 51,869.2 MiB of nars (compressed)
  82,986.2 MiB on disk (uncompressed)
  0.001 seconds per request (24.6 seconds in total)
  679.0 requests per second

  0.3% (20 out of 7,418) of the missing items are queued
  32 queued builds
      x86_64-linux: 32 (100.0%)
  build rate: 13.83 builds per hour
      x86_64-linux: 13.83 builds per hour
looking for 16,707 store items on https://ci.guix.gnu.org...
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
https://ci.guix.gnu.org
  88.9% substitutes available (14,860 out of 16,707)
  at least 78,929.4 MiB of nars (compressed)
  130,797.2 MiB on disk (uncompressed)
  0.002 seconds per request (26.9 seconds in total)
  620.2 requests per second

  0.5% (10 out of 1,847) of the missing items are queued
  at least 1,000 queued builds
      x86_64-linux: 493 (49.3%)
      aarch64-linux: 140 (14.0%)
      i686-linux: 346 (34.6%)
      armhf-linux: 21 (2.1%)
  build rate: 38.98 builds per hour
      x86_64-linux: 13.29 builds per hour
      i686-linux: 12.32 builds per hour
      aarch64-linux: 6.78 builds per hour
      armhf-linux: 6.59 builds per hour
--8<---------------cut here---------------end--------------->8---
      
or

--8<---------------cut here---------------start------------->8---
$ ./pre-inst-env guix weather --substitute-urls="https://guix.tobias.gr https://ci.guix.gnu.org" -c 100
computing 15,391 package derivations for x86_64-linux...
looking for 16,707 store items on https://guix.tobias.gr...
updating substitutes from 'https://guix.tobias.gr'... 100.0%
https://guix.tobias.gr
  35.0% substitutes available (5,855 out of 16,707)
  unknown substitute sizes
  52,230.7 MiB on disk (uncompressed)
  0.017 seconds per request (291.8 seconds in total)
  57.3 requests per second
  (continuous integration information unavailable)
updating substitutes from 'https://guix.tobias.gr'... 100.0%
6777 packages are missing from 'https://guix.tobias.gr' for 'x86_64-linux', among which:
  16564	bootar <at> 1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
  16561	bootstrap-mes-rewired <at> 0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
  16495	ld-wrapper-boot3 <at> 0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
  9743	bison <at> 3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
  1831	xkbcomp-intermediate <at> 1.4.3	/gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 
   788	bootar <at> 1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
   785	bootstrap-mes-rewired <at> 0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
   719	ld-wrapper-boot3 <at> 0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
   595	bootar <at> 1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
   592	bootstrap-mes-rewired <at> 0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
   526	ld-wrapper-boot3 <at> 0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
   339	bison <at> 3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
   305	go <at> 1.4-bootstrap-20171003	/gnu/store/asw6676iy7i0a8azpra2870w5hkq7bvv-go-1.4-bootstrap-20171003-doc /gnu/store/j20pik1y8psi78v7zb5ksqybn198inx7-go-1.4-bootstrap-20171003 /gnu/store/csfqsyyysbg9afnck405wmkhrlrblmza-go-1.4-bootstrap-20171003-tests 
   211	xkbcomp-intermediate <at> 1.4.3	/gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 
   121	bison <at> 3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
   113	r-codetools <at> 0.2-16	/gnu/store/k217j4c4ra2hfdldva075dmvq89ww1dn-r-codetools-0.2-16 
looking for 16,707 store items on https://ci.guix.gnu.org...
https://ci.guix.gnu.org
  88.9% substitutes available (14,860 out of 16,707)
  at least 78,929.4 MiB of nars (compressed)
  130,797.2 MiB on disk (uncompressed)
  0.001 seconds per request (10.1 seconds in total)
  1,650.0 requests per second

  0.5% (10 out of 1,847) of the missing items are queued
  at least 1,000 queued builds
      x86_64-linux: 493 (49.3%)
      aarch64-linux: 140 (14.0%)
      i686-linux: 346 (34.6%)
      armhf-linux: 21 (2.1%)
  build rate: 38.70 builds per hour
      x86_64-linux: 13.20 builds per hour
      i686-linux: 12.23 builds per hour
      aarch64-linux: 6.73 builds per hour
      armhf-linux: 6.54 builds per hour
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
1251 packages are missing from 'https://ci.guix.gnu.org' for 'x86_64-linux', among which:
   112	java-snappy <at> 1.1.7.5	/gnu/store/mq1xagq5sn9mfhpfg7j2cn1dn4vsds72-java-snappy-1.1.7.5 
--8<---------------cut here---------------end--------------->8---



compared to the current behaviour:

--8<---------------cut here---------------start------------->8---
$ guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
computing 15,287 package derivations for x86_64-linux...
looking for 16,584 store items on https://bayfront.guix.gnu.org...
updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
https://bayfront.guix.gnu.org
  54.4% substitutes available (9,026 out of 16,584)
  at least 49,365.8 MiB of nars (compressed)
  81,792.9 MiB on disk (uncompressed)
  0.003 seconds per request (41.6 seconds in total)
  398.0 requests per second

  0.1% (10 out of 7,558) of the missing items are queued
  32 queued builds
      x86_64-linux: 32 (100.0%)
  build rate: 13.84 builds per hour
      x86_64-linux: 13.84 builds per hour
--8<---------------cut here---------------end--------------->8---

(Note that Bayfront is working hard. ;-))

All the best,
simon




Information forwarded to bug-guix <at> gnu.org:
bug#44574; Package guix. (Mon, 16 Nov 2020 19:31:01 GMT) Full text and rfc822 format available.

Message #11 received at 44574 <at> debbugs.gnu.org (full text, mbox):

From: Efraim Flashner <efraim <at> flashner.co.il>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: 44574 <at> debbugs.gnu.org
Subject: Re: bug#44574: guix weather not checking all substitute urls
Date: Mon, 16 Nov 2020 21:30:11 +0200
[Message part 1 (text/plain, inline)]
On Mon, Nov 16, 2020 at 06:12:54PM +0100, zimoun wrote:
> Hi Efraim,
> 
> On Wed, 11 Nov 2020 at 13:30, Efraim Flashner <efraim <at> flashner.co.il> wrote:
> > I would have assumed that it would check for all of the substitute urls
> > I listed and not just the first one. Most of the packages listed below
> > I've test built on my pine64 so they shouldn't appear in the list
> > anymore.
> 
> I think #44688 [1] fixes it.  Please let me know.
> 
> 1: <http://issues.guix.gnu.org/issue/44688>

I had hoped for a unified list of the missing packages between the two
or more build machines but the separate output is also useful. With a
unified list it's possible to see which packages are missing overall and
need fixing/building.

> 
> Examples:
> 
> --8<---------------cut here---------------start------------->8---
> $ ./pre-inst-env guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
> computing 15,391 package derivations for x86_64-linux...
> looking for 16,707 store items on https://bayfront.guix.gnu.org...
> updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
> https://bayfront.guix.gnu.org
>   55.6% substitutes available (9,289 out of 16,707)
>   at least 51,869.2 MiB of nars (compressed)
>   82,986.2 MiB on disk (uncompressed)
>   0.001 seconds per request (24.6 seconds in total)
>   679.0 requests per second
> 
>   0.3% (20 out of 7,418) of the missing items are queued
>   32 queued builds
>       x86_64-linux: 32 (100.0%)
>   build rate: 13.83 builds per hour
>       x86_64-linux: 13.83 builds per hour
> looking for 16,707 store items on https://ci.guix.gnu.org...
> updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
> https://ci.guix.gnu.org
>   88.9% substitutes available (14,860 out of 16,707)
>   at least 78,929.4 MiB of nars (compressed)
>   130,797.2 MiB on disk (uncompressed)
>   0.002 seconds per request (26.9 seconds in total)
>   620.2 requests per second
> 
>   0.5% (10 out of 1,847) of the missing items are queued
>   at least 1,000 queued builds
>       x86_64-linux: 493 (49.3%)
>       aarch64-linux: 140 (14.0%)
>       i686-linux: 346 (34.6%)
>       armhf-linux: 21 (2.1%)
>   build rate: 38.98 builds per hour
>       x86_64-linux: 13.29 builds per hour
>       i686-linux: 12.32 builds per hour
>       aarch64-linux: 6.78 builds per hour
>       armhf-linux: 6.59 builds per hour
> --8<---------------cut here---------------end--------------->8---
>       
> or
> 
> --8<---------------cut here---------------start------------->8---
> $ ./pre-inst-env guix weather --substitute-urls="https://guix.tobias.gr https://ci.guix.gnu.org" -c 100
> computing 15,391 package derivations for x86_64-linux...
> looking for 16,707 store items on https://guix.tobias.gr...
> updating substitutes from 'https://guix.tobias.gr'... 100.0%
> https://guix.tobias.gr
>   35.0% substitutes available (5,855 out of 16,707)
>   unknown substitute sizes
>   52,230.7 MiB on disk (uncompressed)
>   0.017 seconds per request (291.8 seconds in total)
>   57.3 requests per second
>   (continuous integration information unavailable)
> updating substitutes from 'https://guix.tobias.gr'... 100.0%
> 6777 packages are missing from 'https://guix.tobias.gr' for 'x86_64-linux', among which:
>   16564	bootar <at> 1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
>   16561	bootstrap-mes-rewired <at> 0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
>   16495	ld-wrapper-boot3 <at> 0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
>   9743	bison <at> 3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
>   1831	xkbcomp-intermediate <at> 1.4.3	/gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 
>    788	bootar <at> 1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
>    785	bootstrap-mes-rewired <at> 0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
>    719	ld-wrapper-boot3 <at> 0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
>    595	bootar <at> 1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
>    592	bootstrap-mes-rewired <at> 0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
>    526	ld-wrapper-boot3 <at> 0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
>    339	bison <at> 3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
>    305	go <at> 1.4-bootstrap-20171003	/gnu/store/asw6676iy7i0a8azpra2870w5hkq7bvv-go-1.4-bootstrap-20171003-doc /gnu/store/j20pik1y8psi78v7zb5ksqybn198inx7-go-1.4-bootstrap-20171003 /gnu/store/csfqsyyysbg9afnck405wmkhrlrblmza-go-1.4-bootstrap-20171003-tests 
>    211	xkbcomp-intermediate <at> 1.4.3	/gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 
>    121	bison <at> 3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
>    113	r-codetools <at> 0.2-16	/gnu/store/k217j4c4ra2hfdldva075dmvq89ww1dn-r-codetools-0.2-16 
> looking for 16,707 store items on https://ci.guix.gnu.org...
> https://ci.guix.gnu.org
>   88.9% substitutes available (14,860 out of 16,707)
>   at least 78,929.4 MiB of nars (compressed)
>   130,797.2 MiB on disk (uncompressed)
>   0.001 seconds per request (10.1 seconds in total)
>   1,650.0 requests per second
> 
>   0.5% (10 out of 1,847) of the missing items are queued
>   at least 1,000 queued builds
>       x86_64-linux: 493 (49.3%)
>       aarch64-linux: 140 (14.0%)
>       i686-linux: 346 (34.6%)
>       armhf-linux: 21 (2.1%)
>   build rate: 38.70 builds per hour
>       x86_64-linux: 13.20 builds per hour
>       i686-linux: 12.23 builds per hour
>       aarch64-linux: 6.73 builds per hour
>       armhf-linux: 6.54 builds per hour
> updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
> 1251 packages are missing from 'https://ci.guix.gnu.org' for 'x86_64-linux', among which:
>    112	java-snappy <at> 1.1.7.5	/gnu/store/mq1xagq5sn9mfhpfg7j2cn1dn4vsds72-java-snappy-1.1.7.5 
> --8<---------------cut here---------------end--------------->8---
> 
> 
> 
> compared to the current behaviour:
> 
> --8<---------------cut here---------------start------------->8---
> $ guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
> computing 15,287 package derivations for x86_64-linux...
> looking for 16,584 store items on https://bayfront.guix.gnu.org...
> updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
> https://bayfront.guix.gnu.org
>   54.4% substitutes available (9,026 out of 16,584)
>   at least 49,365.8 MiB of nars (compressed)
>   81,792.9 MiB on disk (uncompressed)
>   0.003 seconds per request (41.6 seconds in total)
>   398.0 requests per second
> 
>   0.1% (10 out of 7,558) of the missing items are queued
>   32 queued builds
>       x86_64-linux: 32 (100.0%)
>   build rate: 13.84 builds per hour
>       x86_64-linux: 13.84 builds per hour
> --8<---------------cut here---------------end--------------->8---
> 
> (Note that Bayfront is working hard. ;-))
> 
> All the best,
> simon

-- 
Efraim Flashner   <efraim <at> flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
[signature.asc (application/pgp-signature, inline)]

Information forwarded to bug-guix <at> gnu.org:
bug#44574; Package guix. (Mon, 16 Nov 2020 20:45:01 GMT) Full text and rfc822 format available.

Message #14 received at 44574 <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: Efraim Flashner <efraim <at> flashner.co.il>
Cc: 44574 <at> debbugs.gnu.org
Subject: Re: bug#44574: guix weather not checking all substitute urls
Date: Mon, 16 Nov 2020 21:41:53 +0100
Hi Efraim,

On Mon, 16 Nov 2020 at 21:30, Efraim Flashner <efraim <at> flashner.co.il> wrote:

>> > I would have assumed that it would check for all of the substitute urls
>> > I listed and not just the first one. Most of the packages listed below
>> > I've test built on my pine64 so they shouldn't appear in the list
>> > anymore.
>> 
>> I think #44688 [1] fixes it.  Please let me know.
>> 
>> 1: <http://issues.guix.gnu.org/issue/44688>
>
> I had hoped for a unified list of the missing packages between the two
> or more build machines but the separate output is also useful. With a
> unified list it's possible to see which packages are missing overall and
> need fixing/building.

Ah, this a feature request. ;-)  I agree it could be really helpful.

Cheers,
simon




Information forwarded to bug-guix <at> gnu.org:
bug#44574; Package guix. (Mon, 16 Nov 2020 20:51:01 GMT) Full text and rfc822 format available.

Message #17 received at 44574 <at> debbugs.gnu.org (full text, mbox):

From: Efraim Flashner <efraim <at> flashner.co.il>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: 44574 <at> debbugs.gnu.org
Subject: Re: bug#44574: guix weather not checking all substitute urls
Date: Mon, 16 Nov 2020 22:49:54 +0200
[Message part 1 (text/plain, inline)]
On Mon, Nov 16, 2020 at 09:41:53PM +0100, zimoun wrote:
> Hi Efraim,
> 
> On Mon, 16 Nov 2020 at 21:30, Efraim Flashner <efraim <at> flashner.co.il> wrote:
> 
> >> > I would have assumed that it would check for all of the substitute urls
> >> > I listed and not just the first one. Most of the packages listed below
> >> > I've test built on my pine64 so they shouldn't appear in the list
> >> > anymore.
> >> 
> >> I think #44688 [1] fixes it.  Please let me know.
> >> 
> >> 1: <http://issues.guix.gnu.org/issue/44688>
> >
> > I had hoped for a unified list of the missing packages between the two
> > or more build machines but the separate output is also useful. With a
> > unified list it's possible to see which packages are missing overall and
> > need fixing/building.
> 
> Ah, this a feature request. ;-)  I agree it could be really helpful.
> 

Lets merge 44688 anyway, it does address something that's lacking.

-- 
Efraim Flashner   <efraim <at> flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
[signature.asc (application/pgp-signature, inline)]

Information forwarded to bug-guix <at> gnu.org:
bug#44574; Package guix. (Tue, 17 Nov 2020 16:11:02 GMT) Full text and rfc822 format available.

Message #20 received at 44574 <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: Efraim Flashner <efraim <at> flashner.co.il>, Ludovic Courtès <ludo <at> gnu.org>
Cc: 44574 <at> debbugs.gnu.org
Subject: Re: bug#44574: guix weather not checking all substitute urls
Date: Tue, 17 Nov 2020 17:01:13 +0100
Hi,

On Mon, 16 Nov 2020 at 22:49, Efraim Flashner <efraim <at> flashner.co.il> wrote:

>> >> > I would have assumed that it would check for all of the substitute urls
>> >> > I listed and not just the first one. Most of the packages listed below
>> >> > I've test built on my pine64 so they shouldn't appear in the list
>> >> > anymore.
>> >> 
>> >> I think #44688 [1] fixes it.  Please let me know.
>> >> 
>> >> 1: <http://issues.guix.gnu.org/issue/44688>

> Lets merge 44688 anyway, it does address something that's lacking.

Ludo, does #44688 go to version-1.2.0 or master?  It is simple patch
that fixes:

  guix weather \
       --substitute-urls=“https://bayfront.guix.gnu.org https://ci.guix.gnu.org”

where the current behaviour process only one server.


Cheers,
simon





Information forwarded to bug-guix <at> gnu.org:
bug#44574; Package guix. (Tue, 17 Nov 2020 20:47:02 GMT) Full text and rfc822 format available.

Message #23 received at 44574 <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: 44574 <at> debbugs.gnu.org, Efraim Flashner <efraim <at> flashner.co.il>
Subject: Re: bug#44574: guix weather not checking all substitute urls
Date: Tue, 17 Nov 2020 21:45:58 +0100
Hi,

zimoun <zimon.toutoune <at> gmail.com> skribis:

> On Mon, 16 Nov 2020 at 22:49, Efraim Flashner <efraim <at> flashner.co.il> wrote:
>
>>> >> > I would have assumed that it would check for all of the substitute urls
>>> >> > I listed and not just the first one. Most of the packages listed below
>>> >> > I've test built on my pine64 so they shouldn't appear in the list
>>> >> > anymore.
>>> >> 
>>> >> I think #44688 [1] fixes it.  Please let me know.
>>> >> 
>>> >> 1: <http://issues.guix.gnu.org/issue/44688>
>
>> Lets merge 44688 anyway, it does address something that's lacking.
>
> Ludo, does #44688 go to version-1.2.0 or master?  It is simple patch
> that fixes:
>
>   guix weather \
>        --substitute-urls=“https://bayfront.guix.gnu.org https://ci.guix.gnu.org”
>
> where the current behaviour process only one server.

It’s OK for ‘version-1.2.0’.  Thank you!

Ludo’.




Reply sent to Ludovic Courtès <ludo <at> gnu.org>:
You have taken responsibility. (Thu, 03 Dec 2020 17:08:02 GMT) Full text and rfc822 format available.

Notification sent to Efraim Flashner <efraim <at> flashner.co.il>:
bug acknowledged by developer. (Thu, 03 Dec 2020 17:08:02 GMT) Full text and rfc822 format available.

Message #28 received at 44574-done <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: 44574-done <at> debbugs.gnu.org, Efraim Flashner <efraim <at> flashner.co.il>
Subject: Re: bug#44574: guix weather not checking all substitute urls
Date: Thu, 03 Dec 2020 18:07:43 +0100
This was fixed by c2cc5f0a006fd7797039dae24274833118ea7b47, closing!




Information forwarded to bug-guix <at> gnu.org:
bug#44574; Package guix. (Fri, 04 Dec 2020 09:37:01 GMT) Full text and rfc822 format available.

Message #31 received at 44574-done <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: 44574-done <at> debbugs.gnu.org, Efraim Flashner <efraim <at> flashner.co.il>
Subject: Re: bug#44574: guix weather not checking all substitute urls
Date: Fri, 04 Dec 2020 10:35:58 +0100
Hi Ludo,

On Thu, 03 Dec 2020 at 18:07, Ludovic Courtès <ludo <at> gnu.org> wrote:
> This was fixed by c2cc5f0a006fd7797039dae24274833118ea7b47, closing!

Thanks to close this forgotten one.  But it does not count for the
“December old bug squashing“ effort. ;-)

Cheers,
simon




bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Fri, 01 Jan 2021 12:24:12 GMT) Full text and rfc822 format available.

This bug report was last modified 3 years and 116 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.