GNU bug report logs - #28966
git fails test suite

Previous Next

Package: guix;

Reported by: Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de>

Date: Tue, 24 Oct 2017 14:10:01 UTC

Severity: normal

Done: Marius Bakke <mbakke <at> fastmail.com>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 28966 in the body.
You can then email your comments to 28966 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-guix <at> gnu.org:
bug#28966; Package guix. (Tue, 24 Oct 2017 14:10:01 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de>:
New bug report received and forwarded. Copy sent to bug-guix <at> gnu.org. (Tue, 24 Oct 2017 14:10:01 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de>
To: <bug-guix <at> gnu.org>
Subject: git fails test suite
Date: Tue, 24 Oct 2017 16:09:19 +0200
As of 62d48234e20c732ebefc1b4deb425f590b4241ca git fails at least one of
its tests on my servers:

--8<---------------cut here---------------start------------->8---
not ok 185 - --contains and --no-contains work in a deep repo
#
#               >expect &&
#               i=1 &&
#               while test $i -lt 8000
#               do
#                       echo "commit refs/heads/master
#       committer A U Thor <author <at> example.com> $((1000000000 + $i * 100)) +0200
#       data <<EOF
#       commit #$i
#       EOF"
#                       test $i = 1 && echo "from refs/heads/master^0"
#                       i=$(($i + 1))
#               done | git fast-import &&
#               git checkout master &&
#               git tag far-far-away HEAD^ &&
#               run_with_limited_stack git tag --contains HEAD >actual &&
#               test_cmp expect actual &&
#               run_with_limited_stack git tag --no-contains HEAD >actual &&
#               test_line_count "-gt" 10 actual
#
--8<---------------cut here---------------end--------------->8---

The server has 1.5TB RAM and 192 cores.  I’ve tried to build git about 5
times; some of these times I used “--cores=1” to force a sequential
build, but the tests would still fail.

-- Ricardo




Information forwarded to bug-guix <at> gnu.org:
bug#28966; Package guix. (Tue, 24 Oct 2017 21:21:03 GMT) Full text and rfc822 format available.

Message #8 received at 28966 <at> debbugs.gnu.org (full text, mbox):

From: Marius Bakke <mbakke <at> fastmail.com>
To: Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de>, 28966 <at> debbugs.gnu.org
Subject: Re: bug#28966: git fails test suite
Date: Tue, 24 Oct 2017 23:20:54 +0200
[Message part 1 (text/plain, inline)]
Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de> writes:

> As of 62d48234e20c732ebefc1b4deb425f590b4241ca git fails at least one of
> its tests on my servers:
>
> --8<---------------cut here---------------start------------->8---
> not ok 185 - --contains and --no-contains work in a deep repo
> #
> #               >expect &&
> #               i=1 &&
> #               while test $i -lt 8000
> #               do
> #                       echo "commit refs/heads/master
> #       committer A U Thor <author <at> example.com> $((1000000000 + $i * 100)) +0200
> #       data <<EOF
> #       commit #$i
> #       EOF"
> #                       test $i = 1 && echo "from refs/heads/master^0"
> #                       i=$(($i + 1))
> #               done | git fast-import &&
> #               git checkout master &&
> #               git tag far-far-away HEAD^ &&
> #               run_with_limited_stack git tag --contains HEAD >actual &&
> #               test_cmp expect actual &&
> #               run_with_limited_stack git tag --no-contains HEAD >actual &&
> #               test_line_count "-gt" 10 actual
> #
> --8<---------------cut here---------------end--------------->8---

"185" is very early in the test run, there could be similar cases
hiding as well.  Are you able to try and disable these tests?  If not,
I'll patch out at least this one in the next few days.

> The server has 1.5TB RAM and 192 cores.  I’ve tried to build git about 5
> times; some of these times I used “--cores=1” to force a sequential
> build, but the tests would still fail.

Odd that it fails sequentially as well.  It would be good to report this
upstream.
[signature.asc (application/pgp-signature, inline)]

Information forwarded to bug-guix <at> gnu.org:
bug#28966; Package guix. (Wed, 01 Nov 2017 20:23:01 GMT) Full text and rfc822 format available.

Message #11 received at 28966 <at> debbugs.gnu.org (full text, mbox):

From: Marius Bakke <mbakke <at> fastmail.com>
To: Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de>, 28966 <at> debbugs.gnu.org
Subject: Re: bug#28966: git fails test suite
Date: Wed, 01 Nov 2017 21:22:44 +0100
[Message part 1 (text/plain, inline)]
Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de> writes:

> As of 62d48234e20c732ebefc1b4deb425f590b4241ca git fails at least one of
> its tests on my servers:
>
> --8<---------------cut here---------------start------------->8---
> not ok 185 - --contains and --no-contains work in a deep repo
> #
> #               >expect &&
> #               i=1 &&
> #               while test $i -lt 8000
> #               do
> #                       echo "commit refs/heads/master
> #       committer A U Thor <author <at> example.com> $((1000000000 + $i * 100)) +0200
> #       data <<EOF
> #       commit #$i
> #       EOF"
> #                       test $i = 1 && echo "from refs/heads/master^0"
> #                       i=$(($i + 1))
> #               done | git fast-import &&
> #               git checkout master &&
> #               git tag far-far-away HEAD^ &&
> #               run_with_limited_stack git tag --contains HEAD >actual &&
> #               test_cmp expect actual &&
> #               run_with_limited_stack git tag --no-contains HEAD >actual &&
> #               test_line_count "-gt" 10 actual
> #
> --8<---------------cut here---------------end--------------->8---
>
> The server has 1.5TB RAM and 192 cores.  I’ve tried to build git about 5
> times; some of these times I used “--cores=1” to force a sequential
> build, but the tests would still fail.

I wonder if this has anything to do with the fact that this test (and
one other) limits the stack size to 128 kB (ulimit -s).  FWIW here is
the commit that added this test:

https://github.com/git/git/commit/cbc60b67201e083a4970c8731c5382a575357e36

It has since been increased from 64kB to 128kB, so I wonder if the
attached patch will make any difference.  Can you try it?

[0001-gnu-git-Increase-stack-size-for-tests.patch (text/x-patch, inline)]
From f95ae3d32e5eab9797cb1591cca07c4d31f187ab Mon Sep 17 00:00:00 2001
From: Marius Bakke <mbakke <at> fastmail.com>
Date: Wed, 1 Nov 2017 21:11:29 +0100
Subject: [PATCH] gnu: git: Increase stack size for tests.

* gnu/packages/version-control.scm (git)[arguments]: Add substitution in
'patch-tests' phase.
---
 gnu/packages/version-control.scm | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/gnu/packages/version-control.scm b/gnu/packages/version-control.scm
index af880c29f..9059284ed 100644
--- a/gnu/packages/version-control.scm
+++ b/gnu/packages/version-control.scm
@@ -216,6 +216,12 @@ as well as the classic centralized workflow.")
             ;; Many tests contain inline shell scripts (hooks etc).
             (substitute* (find-files "t" "\\.sh$")
               (("#!/bin/sh") (string-append "#!" (which "sh"))))
+            ;; XXX: Some tests run with a limited stack size, but it may
+            ;; be too small for very large machines (1TB+).  See
+            ;; <https://bugs.gnu.org/28966>.
+            (substitute* "t/test-lib.sh"
+              (("\\(ulimit -s 128")
+               "(ulimit -s 256"))
             ;; Un-do shebang patching here to prevent checksum mismatch.
             (substitute* '("t/t4034/perl/pre" "t/t4034/perl/post")
               (("^#!.*/bin/perl") "#!/usr/bin/perl"))
-- 
2.14.3

[signature.asc (application/pgp-signature, inline)]

Information forwarded to bug-guix <at> gnu.org:
bug#28966; Package guix. (Tue, 11 Feb 2020 00:46:02 GMT) Full text and rfc822 format available.

Message #14 received at 28966 <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: 28966 <at> debbugs.gnu.org, Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de>, 
 Marius Bakke <mbakke <at> fastmail.com>
Subject: Bug#28966 Hunting: git fails test suite
Date: Tue, 11 Feb 2020 01:45:39 +0100
Dear,

This bug is about failing tests of Git. Possible because the stack size.
It was opened against the commit 62d48234e2 (Git version 2.14.3).

The message [1] contains a patch. Does it still make sense?
Does the test suite is still failing with the current version of Git?
From [2], it seems passing.

Could we close this bug?
Or can we confirm that the issue comes from the stack size and the
ulimit patch should be enough to pass the test suite, right? Merge it?


[1] https://debbugs.gnu.org/cgi/bugreport.cgi?bug=28966#11
[2] http://data.guix.gnu.org/revision/75385105348066201ef898b934917eeb6ceab87a/package/git/2.25.0


Thank you in advance for any comments.


All the best,
simon




Reply sent to Marius Bakke <mbakke <at> fastmail.com>:
You have taken responsibility. (Sat, 21 Mar 2020 20:35:02 GMT) Full text and rfc822 format available.

Notification sent to Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de>:
bug acknowledged by developer. (Sat, 21 Mar 2020 20:35:02 GMT) Full text and rfc822 format available.

Message #19 received at 28966-done <at> debbugs.gnu.org (full text, mbox):

From: Marius Bakke <mbakke <at> fastmail.com>
To: zimoun <zimon.toutoune <at> gmail.com>, 28966-done <at> debbugs.gnu.org,
 Ricardo Wurmus <ricardo.wurmus <at> mdc-berlin.de>
Subject: Re: Bug#28966 Hunting: git fails test suite
Date: Sat, 21 Mar 2020 21:34:29 +0100
[Message part 1 (text/plain, inline)]
zimoun <zimon.toutoune <at> gmail.com> writes:

> This bug is about failing tests of Git. Possible because the stack size.
> It was opened against the commit 62d48234e2 (Git version 2.14.3).

Since we haven't heard back from Ricardo regarding this I'll assume the
issue is fixed.  Closing!
[signature.asc (application/pgp-signature, inline)]

bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Sun, 19 Apr 2020 11:24:09 GMT) Full text and rfc822 format available.

This bug report was last modified 4 years and 1 day ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.