GNU bug report logs - #11671
Bootstrap randomly fails on Hydra

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 11671 in the body.
You can then email your comments to 11671 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: bug-coreutils <at> gnu.org
Subject: Bootstrap randomly fails on Hydra
Date: Mon, 11 Jun 2012 14:21:09 +0200

[Message part 1 (text/plain, inline)]

Hello,

For some time, the ‘tarball’ job of Coreutils on Hydra has been failing
apparently randomly, as in the example below.

It’s surprising since it is supposed to be deterministic: it starts from
a pristine tree, and is always performed on x86_64-linux-gnu.

Any idea what’s going on here?

Thanks,
Ludo’.

[Message part 2 (message/rfc822, inline)]

From: Hydra Build Daemon <e.dolstra <at> tudelft.nl>
To: Jim Meyering <jim <at> meyering.net>, PXXdraig Brady <P <at> draigBrady.com>,
 Ludovic CourtXXs <ludo <at> gnu.org>
Subject: Hydra job gnu:coreutils-master:tarball on x86_64-linux, build
 2691638: Failed
Date: Mon, 11 Jun 2012 11:50:54 +0200

Hi,

This is to let you know that Hydra build 2691638 of job gnu:coreutils-master:tarball has changed from 'Success' to 'Failed'.

Complete build information can be found on this page: http://hydra.nixos.org/build/2691638

The last 50 lines of the build log are shown at the bottom of this email.

A summary of the build information follows:

Build ID:              | 2691638
Nix name:              | coreutils-tarball-0pre07595ed8567368ca7857df974e1d8209716e7ec1
Short description:     | Build of a source distribution from a checkout
Maintainer(s):         | Jim Meyering <jim <at> meyering.net>, Pádraig Brady <P <at> draigBrady.com>, Ludovic Courtès <ludo <at> gnu.org>
System:                | x86_64-linux
Derivation store path: | /nix/store/3ya9v10145ky17mcc62aabivhnkpsqfh-coreutils-tarball-0pre07595ed8567368ca7857df974e1d8209716e7ec1.drv
Output store path:     | /nix/store/1hqvk6chfz4q3mvz1fviq4cg3d7gxcj4-coreutils-tarball-0pre07595ed8567368ca7857df974e1d8209716e7ec1
Time added:            | 2012-06-11 11:50:53
Build started:         | 2012-06-11 11:49:09
Build finished:        | 2012-06-11 11:50:53
Duration:              | 104s

The build inputs were:

Name         | Type  | Value
-------------+-------+--------------------------------------------------------------------------------------
hydraConfig  | git   | git://git.savannah.gnu.org/hydra-recipes.git:ba0050b99e7ae0f66e0cdc8287fb82accfcda76e
gnulibSrc    | git   | git://git.sv.gnu.org/gnulib.git:8cabb1a2d9e1894d373011fafd6c67924c166fa3
nixpkgs      | svn   | https://nixos.org/repos/nix/nixpkgs/trunk:34450
coreutilsSrc | git   | git://git.sv.gnu.org/coreutils.git:07595ed8567368ca7857df974e1d8209716e7ec1
tarball      | build | 2691173

Regards,

The Hydra build daemon.

---
  lib/glthread/thread.c -> tests/glthread/thread.c
  lib/glthread/thread.h -> tests/glthread/thread.h
  lib/glthread/yield.h -> tests/glthread/yield.h
  lib/inet_pton.c -> tests/inet_pton.c
  lib/ioctl.c -> tests/ioctl.c
  lib/listen.c -> tests/listen.c
  lib/localename.c -> tests/localename.c
  lib/localename.h -> tests/localename.h
  lib/perror.c -> tests/perror.c
  lib/pipe.c -> tests/pipe.c
  lib/setlocale.c -> tests/setlocale.c
  lib/setsockopt.c -> tests/setsockopt.c
  lib/sleep.c -> tests/sleep.c
  lib/socket.c -> tests/socket.c
  lib/strerror_r.c -> tests/strerror_r.c
  lib/symlinkat.c -> tests/symlinkat.c
  lib/unlinkdir.c -> tests/unlinkdir.c
  lib/unlinkdir.h -> tests/unlinkdir.h
  lib/usleep.c -> tests/usleep.c
  lib/w32sock.h -> tests/w32sock.h
  lib/wctob.c -> tests/wctob.c
  lib/wctomb-impl.h -> tests/wctomb-impl.h
  lib/wctomb.c -> tests/wctomb.c
  top/GNUmakefile
  top/maint.mk
Creating directory ./build-aux/snippet
Creating directory ./gnulib-tests/glthread
Creating directory ./gnulib-tests/unistr
Creating directory ./gnulib-tests/uniwidth
Creating directory ./lib/glthread
Creating directory ./lib/unistr
Creating directory ./lib/uniwidth
Copying file GNUmakefile
/nix/store/0h02f2l6qbah1wil9bpan9c2flv99xv9-git-export/gnulib-tool: line 4700: ./build-aux/announce-gen.tmp: Permission denied
/nix/store/0h02f2l6qbah1wil9bpan9c2flv99xv9-git-export/gnulib-tool: *** failed
/nix/store/0h02f2l6qbah1wil9bpan9c2flv99xv9-git-export/gnulib-tool: *** Stop.
running: AUTOPOINT=true LIBTOOLIZE=true  autoreconf --verbose --install --no-recursive -I m4
autoreconf: Entering directory `.'
autoreconf: running: true
autoreconf: running: aclocal -I m4 -I m4
sh: build-aux/git-version-gen: No such file or directory
configure.ac:35: error: AC_INIT should be called with package and version arguments
/nix/store/0a9vc8x31k1crzrlb18rh277v8mjrg1k-automake-1.11.2/share/aclocal-1.11/init.m4:26: AM_INIT_AUTOMAKE is expanded from...
configure.ac:35: the top level
autom4te: /nix/store/62pf2m8kv7zmghkpgnngd2hh7r163xs4-gnum4-1.4.16/bin/m4 failed with exit status: 1
.aclocal-wrapped: /nix/store/8msk42sv3zx1xbkrf3vck6g99mnbjzsv-autoconf-2.68/bin/autom4te failed with exit status: 1
autoreconf: aclocal failed with exit status: 1
build time elapsed:  0m0.034s 0m0.025s 0m27.090s 0m52.932s
Copying build directory to /nix/store/1hqvk6chfz4q3mvz1fviq4cg3d7gxcj4-coreutils-tarball-0pre07595ed8567368ca7857df974e1d8209716e7ec1/nix-build-3ya9v10145ky17mcc62aabivhnkpsqfh-coreutils-tarball-0pre07595ed8567368ca7857df974e1d8209716e7ec1.drv-0
build failed with exit code 1 (ignored)

Message #8 received at 11671 <at> debbugs.gnu.org (full text, mbox):

From: Paul Eggert <eggert <at> cs.ucla.edu>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: 11671 <at> debbugs.gnu.org
Subject: Re: bug#11671: Bootstrap randomly fails on Hydra
Date: Mon, 11 Jun 2012 10:12:25 -0700

On 06/11/2012 05:21 AM, Ludovic Courtès wrote:
> /nix/store/0h02f2l6qbah1wil9bpan9c2flv99xv9-git-export/gnulib-tool: line 4700: ./build-aux/announce-gen.tmp: Permission denied

That's the first diagnostic so that's what I'd worry about.
The pattern in gnulib-tool here is:

  cp "$lookedup_file" ./build-aux/announce-gen.tmp
  sed -e "..." < "$lookedup_file" > ./build-aux/announce-gen.tmp

and the latter command prompts the shell to say
"Permission denied".  One reason this might occur
is that the gnulib source code is read-only, i.e.,
the permissions on ...gnulib/build-aux/announce-gen
(the "$lookedup_file") are r-xr-xr-x.  Is this possible
in your environment?  That would explain the problem, and
if the diagnosis is correct gnulib-tool should be easy
to fix.

Message #11 received at 11671 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Paul Eggert <eggert <at> cs.ucla.edu>
Cc: 11671 <at> debbugs.gnu.org
Subject: Re: bug#11671: Bootstrap randomly fails on Hydra
Date: Tue, 12 Jun 2012 22:14:43 +0200

Hi Paul,

Paul Eggert <eggert <at> cs.ucla.edu> skribis:

> On 06/11/2012 05:21 AM, Ludovic Courtès wrote:
>> /nix/store/0h02f2l6qbah1wil9bpan9c2flv99xv9-git-export/gnulib-tool: line 4700: ./build-aux/announce-gen.tmp: Permission denied
>
> That's the first diagnostic so that's what I'd worry about.
> The pattern in gnulib-tool here is:
>
>   cp "$lookedup_file" ./build-aux/announce-gen.tmp
>   sed -e "..." < "$lookedup_file" > ./build-aux/announce-gen.tmp
>
> and the latter command prompts the shell to say
> "Permission denied".  One reason this might occur
> is that the gnulib source code is read-only, i.e.,
> the permissions on ...gnulib/build-aux/announce-gen
> (the "$lookedup_file") are r-xr-xr-x.  Is this possible
> in your environment?

Yes, according to <http://hydra.nixos.org/build/2693322/contents/1> (the
build tree of a failed build), ‘$top_srcdir/gnulib/build-aux’ was indeed
r-xr-xr-x.

I’m not sure why that would be the case, nor why it would not
/systematically/ be a problem.

(Details on the bootstrap phase available at
<http://git.savannah.gnu.org/cgit/hydra-recipes.git/tree/coreutils/release.nix#n65>.)

Thanks,
Ludo’.

Message #14 received at 11671 <at> debbugs.gnu.org (full text, mbox):

From: Paul Eggert <eggert <at> cs.ucla.edu>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: 11671 <at> debbugs.gnu.org
Subject: Re: bug#11671: Bootstrap randomly fails on Hydra
Date: Tue, 12 Jun 2012 21:36:05 -0700

On 06/12/2012 01:14 PM, Ludovic Courtès wrote:
> ‘$top_srcdir/gnulib/build-aux’ was indeed
> r-xr-xr-x.

Can you please try to reproduce that problem with build-aux,
if only artificially, along with the following patch?

gnulib-tool: work even if repository is read-only
Problem reported by Ludovic Courtès in <http://bugs.gnu.org/11671>.
* gnulib-tool (func_cp): New function.
(func_lookup_file, func_add_or_update, top level): Use it.
diff --git a/gnulib-tool b/gnulib-tool
index 16f9b2f..f3d1ee6 100755
--- a/gnulib-tool
+++ b/gnulib-tool
@@ -699,6 +699,14 @@ func_relconcat ()
   done
 }

+# func_cp SRC DEST
+# Like cp SRC DEST, except that the destination is made writeable
+# if it is not already writeable.
+func_cp ()
+{
+  cp "$1" "$2" && { test -w "$2" || chmod u+w "$2"; }
+}
+
 # func_ln SRC DEST
 # Like ln -s, except that SRC is given relative to the current directory (or
 # absolute), not given relative to the directory of DEST.
@@ -1464,7 +1472,7 @@ func_lookup_file ()
       if test -n "$local_gnulib_dir" && test -f "$local_gnulib_dir/$lkfile.diff"; then
         lkbase=`echo "$lkfile" | sed -e 's,^.*/,,'`
         rm -f "$tmp/$lkbase"
-        cp "$gnulib_dir/$lkfile" "$tmp/$lkbase"
+        func_cp "$gnulib_dir/$lkfile" "$tmp/$lkbase"
         patch -s "$tmp/$lkbase" < "$local_gnulib_dir/$lkfile.diff" \
           || func_fatal_error "patch file $local_gnulib_dir/$lkfile.diff didn't apply cleanly"
         lookedup_file="$tmp/$lkbase"
@@ -4685,7 +4693,7 @@ s,^\(.................................................[^ ]*\) *,
     esac
     func_dest_tmpfilename "$g"
     func_lookup_file "$f"
-    cp "$lookedup_file" "$tmpfile" || func_fatal_error "failed"
+    func_cp "$lookedup_file" "$tmpfile" || func_fatal_error "failed"
     if test -n "$sed_transform_main_lib_file"; then
       case "$of" in
         lib/*)
@@ -6665,7 +6673,7 @@ s/\([.*$]\)/[\1]/g'
     fi
     # Copy the file.
     func_dest_tmpfilename "$g"
-    cp "$lookedup_file" "$tmpfile" || func_fatal_error "failed"
+    func_cp "$lookedup_file" "$tmpfile" || func_fatal_error "failed"
     already_present=true
     if test -f "$destdir/$g"; then
       # The file already exists.

Message #17 received at 11671 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Paul Eggert <eggert <at> cs.ucla.edu>
Cc: 11671 <at> debbugs.gnu.org
Subject: Re: bug#11671: Bootstrap randomly fails on Hydra
Date: Thu, 14 Jun 2012 11:16:57 +0200

Hi Paul,

Paul Eggert <eggert <at> cs.ucla.edu> skribis:

> On 06/12/2012 01:14 PM, Ludovic Courtès wrote:
>> ‘$top_srcdir/gnulib/build-aux’ was indeed
>> r-xr-xr-x.
>
> Can you please try to reproduce that problem with build-aux,
> if only artificially, along with the following patch?

Sorry, I’m not sure how to reproduce it, but the patch would most likely
avoid the problem altogether.

Thanks,
Ludo’.

Message #20 received at 11671 <at> debbugs.gnu.org (full text, mbox):

From: Assaf Gordon <assafgordon <at> gmail.com>
Cc: 11671 <at> debbugs.gnu.org
Subject: Re: bug#11671: Bootstrap randomly fails on Hydra
Date: Mon, 15 Oct 2018 11:08:12 -0600

close 11671
stop

(triaging old bugs)

Hello,


On 14/06/12 03:16 AM, Ludovic Courtès wrote:
> Paul Eggert <eggert <at> cs.ucla.edu> skribis:
> 
>> On 06/12/2012 01:14 PM, Ludovic Courtès wrote:
>>> ‘$top_srcdir/gnulib/build-aux’ was indeed
>>> r-xr-xr-x.
>>
>> Can you please try to reproduce that problem with build-aux,
>> if only artificially, along with the following patch?
> 
> Sorry, I’m not sure how to reproduce it, but the patch would most likely
> avoid the problem altogether.

It's been 6 years since the report, and no major follow-ups.

I was also casually about to write "recent coreutils builds just fine on 
Hydra", but just checked and it seems several gnu packages are failing:
  https://hydra.nixos.org/project/gnu/
possible a hydra problem, not coreutils.

In any case, I'm closing this specific issue,
and if there are further hydra issues, please write to 
bug-coreutils <at> gnu.org .

regards,
 -assaf

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.