GNU bug report logs - #21949
git-2.6.3: 108M download, but 23M installed

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 21949 in the body.
You can then email your comments to 21949 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Florian Paul Schmidt <mista.tapas <at> gmx.net>
To: bug-guix <at> gnu.org
Subject: git-2.6.3: 108M download, but 23M installed
Date: Wed, 18 Nov 2015 08:03:13 +0100

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256


Hi,

I noticed this earlier and wonder if it's a bug or not:

When downloading the git-2.6.3 substitute from hydra it is a hefty
108M download, but installed in the store it's just 23M.

Compression failure? :)

Regards,
Flo

- -- 
https://fps.io
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQEbBAEBCAAGBQJWTCKwAAoJEA5f4Coltk8ZKRgH9iDfZsPd7x5k6XZ3MmCKtj/x
4FkuNHAnaZs2yZ1uQnGoK4cdPzSHkzPPl5A//ZvO7WXrgaw0fW1m2iFe4fcc7uHW
oU81s7GszXHMEha8WelhzUtr+NyLYWnICg5/9EIHc75eNQcA9hVa514wbkSKXokS
DYo3iH+h0CkxdV4QnwDKP2Rv+TS5ZR9UoLjRcawafM7ZeXbbPW2yyKJxUrsRc+ti
uG3MIgfeRyqOus1StlntYZRt+eMZzY9RmmRaocWxDsSBT4WL7Tx8CzqIO6YA66T7
Kb1eMib5gCYmk8HXpxXGPRaRdhGUzlzBpWCP4uvIGW7LrJWHZVAeJIAVF1HldQ==
=QV3F
-----END PGP SIGNATURE-----

Message #8 received at 21949 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Florian Paul Schmidt <mista.tapas <at> gmx.net>
Cc: 21949 <at> debbugs.gnu.org
Subject: Re: bug#21949: git-2.6.3: 108M download, but 23M installed
Date: Wed, 18 Nov 2015 19:12:43 +0100

Florian Paul Schmidt <mista.tapas <at> gmx.net> skribis:

> I noticed this earlier and wonder if it's a bug or not:
>
> When downloading the git-2.6.3 substitute from hydra it is a hefty
> 108M download, but installed in the store it's just 23M.

The fact that the result is small is due to hard links (under
libexec/git-core), resulting from deduplication performed by the daemon:

--8<---------------cut here---------------start------------->8---
$ du -msc /gnu/store/8xk88mnx31b6i9jz0n7x7zm4xrnknj3b-git-2.6.3
23	/gnu/store/8xk88mnx31b6i9jz0n7x7zm4xrnknj3b-git-2.6.3
23	totalo
$ du -mscl /gnu/store/8xk88mnx31b6i9jz0n7x7zm4xrnknj3b-git-2.6.3
249	/gnu/store/8xk88mnx31b6i9jz0n7x7zm4xrnknj3b-git-2.6.3
249	totalo
--8<---------------cut here---------------end--------------->8---

The problem is that the Nix archive format (Nar) is dumb and doesn’t do
anything sensible with hard links.  So the actual archive is indeed that
big:

--8<---------------cut here---------------start------------->8---
$ guix archive --export /gnu/store/8xk88mnx31b6i9jz0n7x7zm4xrnknj3b-git-2.6.3 | wc -c
259217552
--8<---------------cut here---------------end--------------->8---

Hydra compresses it with bzip2, hence the 108 MiB.

Git is obviously a pathological case.  However, the issue is a more
global one that I think we should address using content-addressable
storage:

  https://lists.gnu.org/archive/html/guix-devel/2015-03/msg00666.html

Ludo’.

Message #13 received at 21949-done <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Florian Paul Schmidt <mista.tapas <at> gmx.net>
Cc: 21949-done <at> debbugs.gnu.org
Subject: Re: bug#21949: git-2.6.3: 108M download, but 23M installed
Date: Sun, 28 Feb 2016 16:44:27 +0100

ludo <at> gnu.org (Ludovic Courtès) skribis:

> Florian Paul Schmidt <mista.tapas <at> gmx.net> skribis:
>
>> I noticed this earlier and wonder if it's a bug or not:
>>
>> When downloading the git-2.6.3 substitute from hydra it is a hefty
>> 108M download, but installed in the store it's just 23M.
>
> The fact that the result is small is due to hard links (under
> libexec/git-core), resulting from deduplication performed by the daemon:

I figured a simple fix is to have ‘make install’ use symlinks instead of
hard links.  Done in 1a59b6d.

Ludo’.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.