Re: pack operation is thrashing my server

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Linus Torvalds
Date: Friday, August 15, 2008 - 5:34 pm

On Thu, 14 Aug 2008, Linus Torvalds wrote:

Interestingly, it turns out that git also hits a sad performance downside 
of using zlib.

We always tend to set "stream.avail_out" to the exact size of the expected 
output. And it turns out that that means that the fast-path case of 
inffast.c doesn't trigger as often as it could. This (idiotic) patch 
actually seems to help performance on git rev-list by about 5%.

But maybe it's just me seeing things. But I did this because of the entry 
assumptions in inflate_fast(), that code only triggers for the case of 
strm->avail_out >= 258.

Sad, if true.

		Linus

---
 sha1_file.c |    4 ++--
 1 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/sha1_file.c b/sha1_file.c
index a57155d..5ca7ce2 100644
--- a/sha1_file.c
+++ b/sha1_file.c
@@ -1500,11 +1500,11 @@ static void *unpack_compressed_entry(struct packed_git *p,
 	z_stream stream;
 	unsigned char *buffer, *in;
 
-	buffer = xmalloc(size + 1);
+	buffer = xmalloc(size + 256 + 1);
 	buffer[size] = 0;
 	memset(&stream, 0, sizeof(stream));
 	stream.next_out = buffer;
-	stream.avail_out = size;
+	stream.avail_out = size + 256;
 
 	inflateInit(&stream);
 	do {
--
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
pack operation is thrashing my server, Ken Pratt, (Sun Aug 10, 12:47 pm)
Re: pack operation is thrashing my server, Martin Langhoff, (Sun Aug 10, 4:06 pm)
Re: pack operation is thrashing my server, Ken Pratt, (Sun Aug 10, 4:12 pm)
Re: pack operation is thrashing my server, Martin Langhoff, (Sun Aug 10, 4:30 pm)
Re: pack operation is thrashing my server, Ken Pratt, (Sun Aug 10, 4:34 pm)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Sun Aug 10, 8:04 pm)
Re: pack operation is thrashing my server, Ken Pratt, (Mon Aug 11, 12:43 am)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Mon Aug 11, 8:01 am)
Re: pack operation is thrashing my server, Avery Pennarun, (Mon Aug 11, 8:40 am)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Mon Aug 11, 8:59 am)
Re: pack operation is thrashing my server, Andi Kleen, (Mon Aug 11, 12:10 pm)
Re: pack operation is thrashing my server, Ken Pratt, (Mon Aug 11, 12:13 pm)
Re: pack operation is thrashing my server, Ken Pratt, (Mon Aug 11, 12:15 pm)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Mon Aug 11, 12:22 pm)
Re: pack operation is thrashing my server, Ken Pratt, (Mon Aug 11, 12:29 pm)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Mon Aug 11, 12:34 pm)
Re: pack operation is thrashing my server, Andi Kleen, (Mon Aug 11, 1:10 pm)
Re: pack operation is thrashing my server, Nicolas Pitre, (Tue Aug 12, 7:38 pm)
Re: pack operation is thrashing my server, Andi Kleen, (Tue Aug 12, 7:50 pm)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Tue Aug 12, 7:57 pm)
Re: pack operation is thrashing my server, Geert Bosch, (Tue Aug 12, 8:12 pm)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Tue Aug 12, 8:15 pm)
Re: pack operation is thrashing my server, Geert Bosch, (Tue Aug 12, 8:58 pm)
Re: pack operation is thrashing my server, Jakub Narebski, (Wed Aug 13, 5:43 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Wed Aug 13, 7:35 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Wed Aug 13, 7:37 am)
Re: pack operation is thrashing my server, Jakub Narebski, (Wed Aug 13, 7:56 am)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Wed Aug 13, 7:59 am)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Wed Aug 13, 8:04 am)
Re: pack operation is thrashing my server, David Tweed, (Wed Aug 13, 8:26 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Wed Aug 13, 8:43 am)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Wed Aug 13, 8:50 am)
Re: pack operation is thrashing my server, Geert Bosch, (Wed Aug 13, 9:01 am)
Re: pack operation is thrashing my server, Johan Herland, (Wed Aug 13, 9:10 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Wed Aug 13, 10:04 am)
Re: pack operation is thrashing my server, Dana How, (Wed Aug 13, 10:13 am)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Wed Aug 13, 10:19 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Wed Aug 13, 10:26 am)
Re: pack operation is thrashing my server, Ken Pratt, (Wed Aug 13, 10:38 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Wed Aug 13, 10:57 am)
Re: pack operation is thrashing my server, Martin Langhoff, (Wed Aug 13, 4:54 pm)
Re: pack operation is thrashing my server, Andreas Ericsson, (Wed Aug 13, 11:33 pm)
Re: pack operation is thrashing my server, David Tweed, (Thu Aug 14, 2:04 am)
Re: pack operation is thrashing my server, Thomas Rast, (Thu Aug 14, 3:04 am)
Re: pack operation is thrashing my server, Andreas Ericsson, (Thu Aug 14, 3:15 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Thu Aug 14, 7:01 am)
Re: pack operation is thrashing my server, Linus Torvalds, (Thu Aug 14, 10:21 am)
Re: pack operation is thrashing my server, Linus Torvalds, (Thu Aug 14, 10:58 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Thu Aug 14, 11:38 am)
Re: pack operation is thrashing my server, Linus Torvalds, (Thu Aug 14, 11:55 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Thu Aug 14, 12:04 pm)
Re: pack operation is thrashing my server, Linus Torvalds, (Thu Aug 14, 12:44 pm)
Re: pack operation is thrashing my server, Andi Kleen, (Thu Aug 14, 2:30 pm)
Re: pack operation is thrashing my server, Nicolas Pitre, (Thu Aug 14, 2:50 pm)
Re: pack operation is thrashing my server, Shawn O. Pearce, (Thu Aug 14, 3:33 pm)
Re: pack operation is thrashing my server, Linus Torvalds, (Thu Aug 14, 4:14 pm)
Re: pack operation is thrashing my server, Björn, (Thu Aug 14, 4:39 pm)
Re: pack operation is thrashing my server, Linus Torvalds, (Thu Aug 14, 5:06 pm)
Re: pack operation is thrashing my server, Linus Torvalds, (Thu Aug 14, 5:25 pm)
Re: pack operation is thrashing my server, Nicolas Pitre, (Thu Aug 14, 6:46 pm)
Re: pack operation is thrashing my server, Linus Torvalds, (Fri Aug 15, 9:15 am)
Re: pack operation is thrashing my server, Linus Torvalds, (Fri Aug 15, 5:34 pm)
Re: pack operation is thrashing my server, Björn, (Sat Aug 16, 5:47 am)
Re: pack operation is thrashing my server, Junio C Hamano, (Sat Sep 6, 6:03 pm)
Re: pack operation is thrashing my server, Linus Torvalds, (Sat Sep 6, 6:46 pm)
Re: pack operation is thrashing my server, Junio C Hamano, (Sat Sep 6, 7:33 pm)
Re: pack operation is thrashing my server, Jon Smirl, (Sat Sep 6, 7:50 pm)
Re: pack operation is thrashing my server, Linus Torvalds, (Sat Sep 6, 8:07 pm)
Re: pack operation is thrashing my server, Jon Smirl, (Sat Sep 6, 8:43 pm)
Re: pack operation is thrashing my server, Linus Torvalds, (Sat Sep 6, 9:50 pm)
Re: pack operation is thrashing my server, Mike Hommey, (Sun Sep 7, 12:45 am)
Re: pack operation is thrashing my server, Andreas Ericsson, (Sun Sep 7, 1:18 am)
Re: pack operation is thrashing my server, Jon Smirl, (Sun Sep 7, 6:58 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Sun Sep 7, 10:08 am)
Re: pack operation is thrashing my server, Nicolas Pitre, (Sun Sep 7, 10:11 am)
Re: pack operation is thrashing my server, Junio C Hamano, (Sun Sep 7, 10:41 am)
Re: pack operation is thrashing my server, Jon Smirl, (Sun Sep 7, 1:33 pm)
Re: pack operation is thrashing my server, Nicolas Pitre, (Mon Sep 8, 7:17 am)
Re: pack operation is thrashing my server, Jon Smirl, (Mon Sep 8, 8:12 am)
Re: pack operation is thrashing my server, Jon Smirl, (Mon Sep 8, 9:01 am)