RE: [RFC] respect the referenced bit of KVM guest pages?

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Dike, Jeffrey G
Date: Wednesday, September 2, 2009 - 12:30 pm

I'm trying to better understand the motivation for your make-mapped-exec-pages-first-class-citizens patch.  As I read your (very detailed!) description, you are diagnosing a threshold effect from Rik's evict-use-once-pages-first patch where if the inactive list is slightly smaller than the active list, the active list will start being scanned, pushing text (and other) pages onto the inactive list where they will be quickly kicked out to swap.

As I read Rik's patch, if the active list is one page larger than the inactive list, then a batch of pages will get moved from one to the other.  For this to have a noticeable effect on the system once the streaming is done, there must be something continuing to keep the active list larger than the inactive list.  Maybe there is a consistent percentage of the streamed pages which are use-twice. 

So, we a threshold effect where a small change in input (the size of the streaming file vs the number of active pages) causes a large change in output (lots of text pages suddenly start getting thrown out).   My immediate reaction to that is that there shouldn't be this sudden change in behavior, and that maybe there should only be enough scanning in shink_active_list to bring the two lists back to parity.  However, if there's something keeping the active list bigger than the inactive list, this will just put off the inevitable required scanning.

As for your patch, it seems like we have a problem with scanning I/O, and instead of looking at those pages, you are looking to protect some other set of pages (mapped text).  That, in turn, increases pressure on anonymous pages (which is where I came in).  Wouldn't it be a better idea to keep looking at those streaming pages and figure out how to get them out of memory quickly?

						Jeff


--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[RFC] respect the referenced bit of KVM guest pages?, Wu Fengguang, (Tue Aug 4, 7:40 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Tue Aug 4, 9:15 pm)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Wed Aug 5, 8:45 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Andrea Arcangeli, (Wed Aug 5, 8:58 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Andrea Arcangeli, (Wed Aug 5, 9:05 am)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Wed Aug 5, 9:12 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Andrea Arcangeli, (Wed Aug 5, 9:19 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Andrea Arcangeli, (Wed Aug 5, 9:31 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Andrea Arcangeli, (Wed Aug 5, 9:35 am)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Wed Aug 5, 12:00 pm)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Wed Aug 5, 12:18 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Andrea Arcangeli, (Thu Aug 6, 3:08 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Andrea Arcangeli, (Thu Aug 6, 3:15 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Andrea Arcangeli, (Thu Aug 6, 3:20 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, KAMEZAWA Hiroyuki, (Thu Aug 6, 6:25 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Thu Aug 6, 8:11 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Thu Aug 6, 8:17 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, KAMEZAWA Hiroyuki, (Fri Aug 7, 1:24 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Wu Fengguang, (Wed Aug 12, 12:48 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Johannes Weiner, (Thu Aug 13, 2:16 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Johannes Weiner, (Fri Aug 14, 2:10 am)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Fri Aug 14, 2:42 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Wu Fengguang, (Fri Aug 14, 10:32 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Wu Fengguang, (Fri Aug 14, 10:45 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Balbir Singh, (Sat Aug 15, 10:09 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Wu Fengguang, (Sat Aug 15, 10:15 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Wu Fengguang, (Sat Aug 15, 10:41 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Wu Fengguang, (Sat Aug 15, 10:50 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Balbir Singh, (Sat Aug 15, 10:59 pm)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Mon Aug 17, 11:04 am)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Mon Aug 17, 12:47 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Tue Aug 18, 8:57 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Tue Aug 18, 8:57 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Tue Aug 18, 8:57 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Tue Aug 18, 9:27 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Wed Aug 19, 5:05 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Wed Aug 19, 6:19 am)
Re: [RFC] memcg: move definitions to .h and inline some fu ..., KAMEZAWA Hiroyuki, (Wed Aug 19, 7:18 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Fri Aug 21, 4:17 am)
Re: [RFC] respect the referenced bit of KVM guest pages?, Balbir Singh, (Fri Aug 21, 11:24 am)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Mon Aug 31, 12:43 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, Rik van Riel, (Mon Aug 31, 12:52 pm)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Mon Aug 31, 1:06 pm)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Mon Aug 31, 1:11 pm)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Wed Sep 2, 12:30 pm)
RE: [RFC] respect the referenced bit of KVM guest pages?, Dike, Jeffrey G, (Fri Sep 4, 1:06 pm)
Re: [RFC] respect the referenced bit of KVM guest pages?, KOSAKI Motohiro, (Sun Sep 13, 9:23 am)