[PATCH 0/2] Updating ctime and mtime for memory-mapped files [try #4]

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: <linux-mm@...>, <jakob@...>, <linux-kernel@...>, <valdis.kletnieks@...>, <riel@...>, <ksm@...>, <staubach@...>, <jesper.juhl@...>, <torvalds@...>, <a.p.zijlstra@...>, <akpm@...>, <protasnb@...>, <miklos@...>
Date: Tuesday, January 15, 2008 - 12:02 pm

1. Introduction

This is the fourth version of my solution for the bug #2645:

http://bugzilla.kernel.org/show_bug.cgi?id=2645

Changes since the previous version:

1) the case of retouching an already-dirty page pointed out
  by Miklos Szeredi has been addressed;

2) the file metadata are updated using the page modification time
  instead of the time of syncing data;

3) a few small corrections according to the latest feedback.

Brief explanation of these changes as well as some design considerations
are given below.

2. The case of retouching an already-dirtied page

Miklos Szeredi gave the following feedback on the previous version:


This version adds handling of the case of multiple msync() calls. Before
going on with the explanaion, I'll quote a remark by Peter Zijlstra:


Indeed, the following logic of the __set_pages_dirty_nobuffers() function:

if (!TestSetPageDirty(page)) {
       mapping = page_mapping(page);

       if (!mapping)
               return 1;

       /* critical section */

       if (mapping->host) {
               __mark_inode_dirty(mapping->host, I_DIRTY_PAGES);
               set_bit(AS_MCTIME, &mapping->flags);
       }
       return 1;
}
return 0;

made it difficult to account for the case of the already-dirty page
retouch after the call to msync(MS_ASYNC).

In this version of my solution, I redesigned the logic of the same
function as follows:

mapping = page_mapping(page);

if (!mapping)
       return 1;

set_bit(AS_MCTIME, &mapping->flags);

if (TestSetPageDirty(page))
       return 0;

/* critical section */

if (mapping->host) {
       __mark_inode_dirty(mapping->host, I_DIRTY_PAGES);

return 1;

This allows us to set the AS_MCTIME bit independently of whether the page
had already been dirtied or not. Besides, such change makes the logic of
the topmost "if" in this function straight thus improving readability.
Finally, we already have the __set_page_dirty() routine with almost
identical functionality. My redesign of __set_pages_dirty_nobuffers()
is based on how the __set_page_dirty() routine is implemented.

Miklos gave an example of a scenario, where the previous version of
my solution would fail:

http://lkml.org/lkml/2008/1/14/100

Here is how it looks in the version I am sending now:

 1 page is dirtied through mapping
       => the AS_MCTIME bit turned on
 2 app calls msync(MS_ASYNC)
       => inode's times updated, the AS_MCTIME bit turned off
 3 page is written again through mapping
       => the AS_MCTIME bit turned on again
 4 app calls msync(MS_ASYNC)
       => inode's times updated, the AS_MCTIME bit turned off
 5 ...
 6 page is written back
       => ... by this moment, the either the msync(MS_ASYNC) has
          taken care of updating the file times, or the AS_MCTIME
          bit is on.

I think that the feedback about writes after the first msync(MS_ASYNC)
has thereby been addressed.

3. Updating the time stamps of the block device special files

As for the block device case, let's start from the following assumption:

if the block device data changes, we should do our best to tell the world
that this has happened.

This is how I approach this requirement:

1) if the block device is active, this is done at next *sync() through
  calling the bd_inode_update_time() helper function.

2) if the block device is not active, this is done during the block
  device file deactivation in the unlink_file_vma() routine.

Removing either of these actions would leave a possibility of losing
information about the block device data update. That is why I am keeping
both.

4. Recording the time was the file data changed

Finally, I noticed yet another issue with the previous version of my patch.
Specifically, the time stamps were set to the current time of the moment
when syncing but not the write reference was being done. This led to the
following adverse effect on my development system:

1) a text file A was updated by process B;
2) process B exits without calling any of the *sync() functions;
3) vi editor opens the file A;
4) file data synced, file times updated;
5) vi is confused by "thinking" that the file was changed after 3).

This version overcomes this problem by introducing another field into the
address_space structure. This field is used to "remember" the time of
dirtying, and then this time value is propagated to the file metadata.

This approach is based upon the following suggestion given by Peter
Staubach during one of our previous discussions:

http://lkml.org/lkml/2008/1/9/267


The solution I propose now proves the viability of the latter
approach.
--
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[PATCH 0/2] Updating ctime and mtime for memory-mapped files..., Anton Salikhmetov, (Tue Jan 15, 12:02 pm)
Re: [PATCH 0/2] Updating ctime and mtime for memory-mapped f..., Anton Salikhmetov, (Tue Jan 15, 6:15 pm)
[PATCH 1/2] Massive code cleanup of sys_msync(), Anton Salikhmetov, (Tue Jan 15, 12:02 pm)
Re: [PATCH 1/2] Massive code cleanup of sys_msync(), Christoph Hellwig, (Tue Jan 15, 1:57 pm)
Re: [PATCH 1/2] Massive code cleanup of sys_msync(), Anton Salikhmetov, (Tue Jan 15, 3:02 pm)
Re: [PATCH 1/2] Massive code cleanup of sys_msync(), Randy Dunlap, (Tue Jan 15, 3:10 pm)
Re: [PATCH 1/2] Massive code cleanup of sys_msync(), Matt Mackall, (Tue Jan 15, 4:46 pm)
Re: [PATCH 1/2] Massive code cleanup of sys_msync(), Randy Dunlap, (Tue Jan 15, 5:06 pm)
Re: [PATCH 1/2] Massive code cleanup of sys_msync(), Anton Salikhmetov, (Tue Jan 15, 3:26 pm)
Re: [PATCH 1/2] Massive code cleanup of sys_msync(), Peter Zijlstra, (Tue Jan 15, 3:28 pm)
Re: [PATCH 1/2] Massive code cleanup of sys_msync(), Christoph Hellwig, (Tue Jan 15, 3:32 pm)
Re: [PATCH 1/2] Massive code cleanup of sys_msync(), Anton Salikhmetov, (Tue Jan 15, 4:12 pm)
[PATCH 2/2] Updating ctime and mtime at syncing, Anton Salikhmetov, (Tue Jan 15, 12:02 pm)
Re: [PATCH 2/2] Updating ctime and mtime at syncing, Christoph Hellwig, (Tue Jan 15, 2:04 pm)
Re: [PATCH 2/2] Updating ctime and mtime at syncing, Anton Salikhmetov, (Tue Jan 15, 3:04 pm)
Re: [PATCH 2/2] Updating ctime and mtime at syncing, Peter Zijlstra, (Tue Jan 15, 12:35 pm)
Re: [PATCH 2/2] Updating ctime and mtime at syncing, Anton Salikhmetov, (Tue Jan 15, 1:18 pm)
Re: [PATCH 2/2] Updating ctime and mtime at syncing, Peter Zijlstra, (Tue Jan 15, 3:30 pm)