RE: Too many I/O controller patches

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Satoshi UCHIDA
Date: Monday, August 4, 2008 - 7:50 pm

Hi, Andrea.

I participated in Containers Mini-summit.
And, I talked with Mr. Andrew Morton in The Linux Foundation Japan
Symposium BoF, Japan, July 10th.

Currently, in ML, some I/O controller patches is sent and the respective
patch keeps sending the improvement version.
We and maintainers wouldn't like this situation.
We wanted to solve this situation by the Mini-summit, but unfortunately, 
no other developers participated.
(I couldn't give an opinion, because  my English skill is low)
Mr. Naveen present his way in Linux Symposium, and we discussed about
I/O control at a few time after this presentation.


Mr. Andrew gave a advice "Should discuss about design more and more"
to me.
And, in Containers Mini-summit (and Linux Symposium 2008 in Ottawa),
Paul said that a necessary to us is to decide a requirement first.
So, we must discuss requirement and design.

My requirement is
 * to be able to distribute performance moderately.
 (* to be able to isolate each group(environment)). 

I guess (it may be wrong)
 Naveen's requirement is
   * to be able to handle latency.
      (high priority is always precede in handling I/O)
   (Only share isn't just given priority to, like CFQ.)
   * to be able to distribute performance moderately.
 Andrea's requirement is
   * to be able to set and control by absolute(direct) performance.
 Ryo's requirement is
   * to be able to distribute performance moderately.
   * to be able to set and control I/Os at flexible range
         (multi device such as LVM).

I think that most solutions controls I/O performance moderately
(by using weight/priority/percentage/etc. and by not using absolute) 
because disk I/O performance is inconstant and is affected by
situation (such as application, file(data) balance, and so on).
So, it is difficult to guarantee performance which is set by
absolute bandwidth.
If devices have constant performance, it will good to control by
absolute bandwidth.
And, when guaranteeing it by the low ability, it'll be possible.
However, no one likes to make the resources wasteful.


And, he gave a advice "Can't a framework which organized each way,
such as I/O elevator, be made?".
I try to consider such framework (in elevator layer or block layer).
Now, I look at the other methods, again.


I think that OOM problems caused by memory/cache systems.
So, it will be better that I/O controller created out of these problems
first, although a lateness of the I/O device would be related.
If these problem can be resolved, its technique should be applied into 
normal I/O control as well as cgroups.

Buffered write I/O is also related with cache system.
We must consider this problem as I/O control.
I don't have a good way which can resolve this problems.



I'm very interested in this results.


Thanks,
 Satoshi Uchida.


--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[PATCH 1/7] dm-ioband: Patch of device-mapper driver, Ryo Tsuruta, (Mon Aug 4, 1:52 am)
[PATCH 3/7] bio-cgroup: Introduction, Ryo Tsuruta, (Mon Aug 4, 1:57 am)
[PATCH 5/7] bio-cgroup: Remove a lot of ifdefs, Ryo Tsuruta, (Mon Aug 4, 1:59 am)
[PATCH 6/7] bio-cgroup: Implement the bio-cgroup, Ryo Tsuruta, (Mon Aug 4, 2:00 am)
Too many I/O controller patches, Dave Hansen, (Mon Aug 4, 10:20 am)
Re: Too many I/O controller patches, Andrea Righi, (Mon Aug 4, 11:22 am)
Re: Too many I/O controller patches, Balbir Singh, (Mon Aug 4, 11:34 am)
Re: Too many I/O controller patches, Dave Hansen, (Mon Aug 4, 12:02 pm)
Re: Too many I/O controller patches, Andrea Righi, (Mon Aug 4, 1:42 pm)
Re: Too many I/O controller patches, Andrea Righi, (Mon Aug 4, 1:44 pm)
Re: Too many I/O controller patches, Dave Hansen, (Mon Aug 4, 1:50 pm)
RE: Too many I/O controller patches, Satoshi UCHIDA, (Mon Aug 4, 7:50 pm)
Re: Too many I/O controller patches, Paul Menage, (Mon Aug 4, 10:55 pm)
Re: Too many I/O controller patches, Balbir Singh, (Mon Aug 4, 11:03 pm)
Re: Too many I/O controller patches, Hirokazu Takahashi, (Mon Aug 4, 11:16 pm)
Re: Too many I/O controller patches, Hirokazu Takahashi, (Mon Aug 4, 11:28 pm)
Re: Too many I/O controller patches, Andrea Righi, (Tue Aug 5, 2:27 am)
Re: Too many I/O controller patches, Andrea Righi, (Tue Aug 5, 2:28 am)
Re: Too many I/O controller patches, Andrea Righi, (Tue Aug 5, 2:31 am)
Re: Too many I/O controller patches, Hirokazu Takahashi, (Tue Aug 5, 3:01 am)
Re: [PATCH 4/7] bio-cgroup: Split the cgroup memory subsys ..., Hirokazu Takahashi, (Tue Aug 5, 3:35 am)
Re: Too many I/O controller patches, Hirokazu Takahashi, (Tue Aug 5, 5:01 am)
Re: Too many I/O controller patches, Ryo Tsuruta, (Tue Aug 5, 6:17 am)
Re: Too many I/O controller patches, Dave Hansen, (Tue Aug 5, 9:20 am)
Re: Too many I/O controller patches, Dave Hansen, (Tue Aug 5, 9:25 am)
Re: Too many I/O controller patches, KAMEZAWA Hiroyuki, (Tue Aug 5, 7:44 pm)
Re: Too many I/O controller patches, Balbir Singh, (Tue Aug 5, 8:30 pm)
Re: RFC: I/O bandwidth controller, Ryo Tsuruta, (Tue Aug 5, 11:18 pm)
Re: RFC: I/O bandwidth controller, Fernando Luis , (Tue Aug 5, 11:41 pm)
Re: Too many I/O controller patches, Hirokazu Takahashi, (Tue Aug 5, 11:48 pm)
Re: [PATCH 4/7] bio-cgroup: Split the cgroup memory subsys ..., KAMEZAWA Hiroyuki, (Wed Aug 6, 12:54 am)
Re: [PATCH 4/7] bio-cgroup: Split the cgroup memory subsys ..., Hirokazu Takahashi, (Wed Aug 6, 4:43 am)
Re: RFC: I/O bandwidth controller, Dave Hansen, (Wed Aug 6, 8:48 am)
Re: RFC: I/O bandwidth controller, Fernando Luis , (Wed Aug 6, 9:38 pm)
Re: [PATCH 4/7] bio-cgroup: Split the cgroup memory subsys ..., Hirokazu Takahashi, (Thu Aug 7, 12:25 am)
Re: RFC: I/O bandwidth controller, Hirokazu Takahashi, (Thu Aug 7, 1:30 am)
Re: [PATCH 4/7] bio-cgroup: Split the cgroup memory subsys ..., Hirokazu Takahashi, (Thu Aug 7, 1:45 am)
Re: RFC: I/O bandwidth controller, Hirokazu Takahashi, (Thu Aug 7, 11:21 pm)
Re: [PATCH 6/7] bio-cgroup: Implement the bio-cgroup, Takuya Yoshikawa, (Fri Aug 8, 12:10 am)
Re: RFC: I/O bandwidth controller, Ryo Tsuruta, (Fri Aug 8, 12:20 am)
Re: RFC: I/O bandwidth controller, Fernando Luis , (Fri Aug 8, 1:10 am)
Re: [PATCH 6/7] bio-cgroup: Implement the bio-cgroup, Ryo Tsuruta, (Fri Aug 8, 1:30 am)
Re: [PATCH 6/7] bio-cgroup: Implement the bio-cgroup, Takuya Yoshikawa, (Fri Aug 8, 2:42 am)
Re: RFC: I/O bandwidth controller, Ryo Tsuruta, (Fri Aug 8, 3:05 am)
Re: RFC: I/O bandwidth controller, Hirokazu Takahashi, (Fri Aug 8, 4:39 am)
Re: [PATCH 6/7] bio-cgroup: Implement the bio-cgroup, Ryo Tsuruta, (Fri Aug 8, 4:41 am)
Re: RFC: I/O bandwidth controller, Hirokazu Takahashi, (Fri Aug 8, 7:31 am)
Re: RFC: I/O bandwidth controller (was Re: Too many I/O co ..., David Collier-Brown, (Mon Aug 11, 9:35 am)
Re: RFC: I/O bandwidth controller, Fernando Luis , (Mon Aug 11, 10:35 pm)