Re: Git and GCC

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Jon Smirl
Date: Thursday, December 6, 2007 - 2:39 pm

On 12/6/07, Nicolas Pitre <nico@cam.org> wrote:

I've deleted all my giant packs. Using the kernel pack:
4GB Q6600

Using the current thread pack code I get these results.

The interesting case is the last one. I set it to 15 threads and
monitored with 'top'.
For 0-60% compression I was at 300% CPU, 60-74% was 200% CPU and
74-100% was 100% CPU. It never used all for cores. The only other
things running were top and my desktop. This is the same load
balancing problem I observed earlier. Much more clock time was spent
in the 2/1 core phases than the 3 core one.

Threaded, threads = 5

jonsmirl@terra:/home/linux$ time git repack -a -d -f
Counting objects: 648366, done.
Compressing objects: 100% (647457/647457), done.
Writing objects: 100% (648366/648366), done.
Total 648366 (delta 528994), reused 0 (delta 0)

real    1m31.395s
user    2m59.239s
sys     0m3.048s
jonsmirl@terra:/home/linux$

12 seconds counting
53 seconds compressing
38 seconds writing

Without threads,

jonsmirl@terra:/home/linux$ time git repack -a -d -f
warning: no threads support, ignoring pack.threads
Counting objects: 648366, done.
Compressing objects: 100% (647457/647457), done.
Writing objects: 100% (648366/648366), done.
Total 648366 (delta 528999), reused 0 (delta 0)

real    2m54.849s
user    2m51.267s
sys     0m1.412s
jonsmirl@terra:/home/linux$

Threaded, threads = 5

jonsmirl@terra:/home/linux$ time git repack -a -d -f --depth=250 --window=250
Counting objects: 648366, done.
Compressing objects: 100% (647457/647457), done.
Writing objects: 100% (648366/648366), done.
Total 648366 (delta 539080), reused 0 (delta 0)

real    9m18.032s
user    19m7.484s
sys     0m3.880s
jonsmirl@terra:/home/linux$

jonsmirl@terra:/home/linux/.git/objects/pack$ ls -l
total 182156
-r--r--r-- 1 jonsmirl jonsmirl  15561848 2007-12-06 16:15
pack-f1f8637d2c68eb1c964ec7c1877196c0c7513412.idx
-r--r--r-- 1 jonsmirl jonsmirl 170768761 2007-12-06 16:15
pack-f1f8637d2c68eb1c964ec7c1877196c0c7513412.pack
jonsmirl@terra:/home/linux/.git/objects/pack$

Non-threaded:

jonsmirl@terra:/home/linux$ time git repack -a -d -f --depth=250 --window=250
warning: no threads support, ignoring pack.threads
Counting objects: 648366, done.
Compressing objects: 100% (647457/647457), done.
Writing objects: 100% (648366/648366), done.
Total 648366 (delta 539080), reused 0 (delta 0)

real    18m51.183s
user    18m46.538s
sys     0m1.604s
jonsmirl@terra:/home/linux$


jonsmirl@terra:/home/linux/.git/objects/pack$ ls -l
total 182156
-r--r--r-- 1 jonsmirl jonsmirl  15561848 2007-12-06 15:33
pack-f1f8637d2c68eb1c964ec7c1877196c0c7513412.idx
-r--r--r-- 1 jonsmirl jonsmirl 170768761 2007-12-06 15:33
pack-f1f8637d2c68eb1c964ec7c1877196c0c7513412.pack
jonsmirl@terra:/home/linux/.git/objects/pack$

Threaded, threads = 15

jonsmirl@terra:/home/linux$ time git repack -a -d -f --depth=250 --window=250
Counting objects: 648366, done.
Compressing objects: 100% (647457/647457), done.
Writing objects: 100% (648366/648366), done.
Total 648366 (delta 539080), reused 0 (delta 0)

real    9m18.325s
user    19m14.340s
sys     0m3.996s
jonsmirl@terra:/home/linux$

-- 
Jon Smirl
jonsmirl@gmail.com
-
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Re: Git and GCC, David Miller, (Wed Dec 5, 7:52 pm)
Re: Git and GCC, Daniel Berlin, (Wed Dec 5, 8:47 pm)
Re: Git and GCC, David Miller, (Wed Dec 5, 9:20 pm)
Re: Git and GCC, Harvey Harrison, (Wed Dec 5, 9:25 pm)
Re: Git and GCC, Harvey Harrison, (Wed Dec 5, 9:28 pm)
Re: Git and GCC, Daniel Berlin, (Wed Dec 5, 9:32 pm)
Re: Git and GCC, David Miller, (Wed Dec 5, 9:48 pm)
Re: Git and GCC, Linus Torvalds, (Wed Dec 5, 9:54 pm)
Re: Git and GCC, Harvey Harrison, (Wed Dec 5, 10:04 pm)
Re: Git and GCC, Daniel Berlin, (Wed Dec 5, 10:11 pm)
Re: Git and GCC, Harvey Harrison, (Wed Dec 5, 10:15 pm)
Re: Git and GCC, Daniel Berlin, (Wed Dec 5, 10:17 pm)
Re: Git and GCC, Linus Torvalds, (Wed Dec 5, 11:09 pm)
Re: Git and GCC, Jon Smirl, (Wed Dec 5, 11:47 pm)
Re: Git and GCC, Jeff King, (Thu Dec 6, 12:15 am)
Re: Git and GCC, Harvey Harrison, (Thu Dec 6, 12:49 am)
Re: Git and GCC, David Brown, (Thu Dec 6, 1:11 am)
Re: Git and GCC, Johannes Schindelin, (Thu Dec 6, 4:57 am)
[PATCH] gc --aggressive: make it really aggressive, Johannes Schindelin, (Thu Dec 6, 5:03 am)
Re: Git and GCC, Ismail , (Thu Dec 6, 5:04 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Theodore Tso, (Thu Dec 6, 6:42 am)
Re: Git and GCC, Nicolas Pitre, (Thu Dec 6, 7:01 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Nicolas Pitre, (Thu Dec 6, 7:15 am)
Re: Git and GCC, Nicolas Pitre, (Thu Dec 6, 7:18 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Pierre Habouzit, (Thu Dec 6, 7:22 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Harvey Harrison, (Thu Dec 6, 8:30 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Johannes Schindelin, (Thu Dec 6, 8:55 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Johannes Schindelin, (Thu Dec 6, 8:56 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Linus Torvalds, (Thu Dec 6, 9:19 am)
Re: [PATCH] gc --aggressive: make it really aggressive, David Kastrup, (Thu Dec 6, 10:05 am)
Re: Git and GCC, Jeff King, (Thu Dec 6, 10:39 am)
Re: Git and GCC, Nicolas Pitre, (Thu Dec 6, 11:02 am)
Re: Git and GCC, Daniel Berlin, (Thu Dec 6, 11:04 am)
Re: Git and GCC, NightStrike, (Thu Dec 6, 11:24 am)
Re: Git and GCC, Linus Torvalds, (Thu Dec 6, 11:29 am)
Re: Git and GCC, Linus Torvalds, (Thu Dec 6, 11:35 am)
Re: Git and GCC, Linus Torvalds, (Thu Dec 6, 11:45 am)
Re: Git and GCC, Jon Smirl, (Thu Dec 6, 11:55 am)
Re: Git and GCC, Nicolas Pitre, (Thu Dec 6, 12:08 pm)
Re: Git and GCC, Jon Loeliger, (Thu Dec 6, 12:12 pm)
Re: Git and GCC, Linus Torvalds, (Thu Dec 6, 12:39 pm)
Re: Git and GCC, Junio C Hamano, (Thu Dec 6, 1:04 pm)
Re: Git and GCC, Junio C Hamano, (Thu Dec 6, 2:02 pm)
Re: Git and GCC, Jon Smirl, (Thu Dec 6, 2:39 pm)
Re: Git and GCC, Nicolas Pitre, (Thu Dec 6, 3:08 pm)
Re: Git and GCC, Jon Smirl, (Thu Dec 6, 3:11 pm)
Re: Git and GCC, Jon Smirl, (Thu Dec 6, 3:22 pm)
Re: Git and GCC, David Kastrup, (Thu Dec 6, 3:26 pm)
Re: Git and GCC, Nicolas Pitre, (Thu Dec 6, 3:30 pm)
[OT] Re: Git and GCC, Randy Dunlap, (Thu Dec 6, 3:38 pm)
Re: Git and GCC, Jon Smirl, (Thu Dec 6, 3:44 pm)
Re: Git and GCC, Jakub Narebski, (Thu Dec 6, 5:29 pm)
Re: Git and GCC, Harvey Harrison, (Thu Dec 6, 7:42 pm)
Re: Git and GCC, Linus Torvalds, (Thu Dec 6, 8:01 pm)
Re: Git and GCC, David Miller, (Thu Dec 6, 8:31 pm)
Re: Git and GCC, Jon Smirl, (Thu Dec 6, 9:06 pm)
Re: Git and GCC, Nicolas Pitre, (Thu Dec 6, 9:21 pm)
Re: Git and GCC, Linus Torvalds, (Thu Dec 6, 10:21 pm)
Re: Git and GCC, NightStrike, (Thu Dec 6, 10:36 pm)
Re: Git and GCC, Jeff King, (Thu Dec 6, 11:38 pm)
Re: Git and GCC, Jeff King, (Thu Dec 6, 11:50 pm)
Re: Git and GCC, Jon Smirl, (Fri Dec 7, 12:08 am)
Re: Git and GCC, Jon Smirl, (Fri Dec 7, 12:10 am)
Re: Git and GCC, Jeff King, (Fri Dec 7, 12:27 am)
Re: Git and GCC, Jeff King, (Fri Dec 7, 12:31 am)
Re: Git and GCC, David Miller, (Fri Dec 7, 5:53 am)
Re: Git and GCC, Linus Torvalds, (Fri Dec 7, 10:23 am)
Re: Git and GCC, Nicolas Pitre, (Fri Dec 7, 12:36 pm)
Re: Git and GCC, Giovanni Bajo, (Fri Dec 7, 1:26 pm)
Re: Git and GCC, Jakub Narebski, (Fri Dec 7, 3:14 pm)
Re: Git and GCC, Luke Lu, (Fri Dec 7, 4:04 pm)
Re: Git and GCC, Giovanni Bajo, (Fri Dec 7, 4:14 pm)
Re: Git and GCC, Daniel Berlin, (Fri Dec 7, 4:33 pm)
Re: Git and GCC, Harvey Harrison, (Fri Dec 7, 5:47 pm)
Re: Git and GCC, David Miller, (Fri Dec 7, 6:55 pm)
Re: Git and GCC, Johannes Schindelin, (Sat Dec 8, 5:00 am)
Re: Git and GCC, Gabriel Paubert, (Mon Dec 10, 2:54 am)
Re: Git and GCC, David Miller, (Mon Dec 10, 2:57 am)
Re: Git and GCC, Nicolas Pitre, (Mon Dec 10, 8:35 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Johannes Schindelin, (Wed Mar 18, 9:01 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Teemu Likonen, (Wed Mar 18, 9:27 am)
Re: [PATCH] gc --aggressive: make it really aggressive, Nicolas Pitre, (Wed Mar 18, 11:02 am)