Home » Mailing list archives » git » 2008 » January » 23

Re: git on MacOSX and files with decomposed utf-8 file names

!MAILaRCHIVE_VOTE_RePLACE
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
[view in full thread]
From: Linus Torvalds <torvalds@...>
To: Theodore Tso <tytso@...>
Cc: Mike Hommey <mh@...>, Kevin Ballard <kevin@...>, <git@...>
Subject: Re: git on MacOSX and files with decomposed utf-8 file names
Date: Wednesday, January 23, 2008 - 12:16 pm

On Wed, 23 Jan 2008, Theodore Tso wrote:

Well, it demonstrates that (a) the OS and (b) _perl_ don't mangle 
filenames on non-HFS+ filesystems.

The problem is that since most native applications *expect* that name 
mangling, they'll probably do name mangling of their own (internally) just 
to compare the names!

So I would not be surprised if the globbing libraries, for example, will 
do NFD-mangling in order to glob "correctly", so even programs ported from 
real Unix might end up getting pathnames subtly changed into NFD as part 
of some hot library-on-library action with UTF hackery inside.

Things like the finder etc, which must be very aware of the fact that 
filenames get corrupted, would presumably internally always convert 
everything they get into NFD in order to compare names from different 
sources. And as part of that, programs may well corrupt the name before 
they then use it to create a pathname.

The fact that your perl program works under NFS, but creates NFD on a VFAT 
volume, does imply that they probably used at least some of the same 
routines they use in HFS+ for VFAT. Not entirely surprising: doing case 
insensitive stuff with Unicode is nasty code, so why not share it (even if 
it's then incorrect for FAT)..

Piece of crap it is, though. Apple has painted themselves into a nasty 
corner there.

			Linus
-
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
Messages in current thread:
Re: git on MacOSX and files with decomposed utf-8 file names, Theodore Tso, (Tue Jan 22, 8:08 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Linus Torvalds, (Tue Jan 22, 8:38 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Theodore Tso, (Tue Jan 22, 9:33 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Mike Hommey, (Wed Jan 23, 2:41 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Kevin Ballard, (Wed Jan 23, 4:15 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Mike Hommey, (Wed Jan 23, 5:40 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Kevin Ballard, (Wed Jan 23, 12:58 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Dmitry Potapov, (Wed Jan 23, 1:39 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Kevin Ballard, (Wed Jan 23, 1:47 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Theodore Tso, (Wed Jan 23, 9:38 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Linus Torvalds, (Wed Jan 23, 12:16 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Kevin Ballard, (Wed Jan 23, 1:19 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Martin Langhoff, (Wed Jan 23, 7:37 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Jay Soffian, (Wed Jan 23, 4:18 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Linus Torvalds, (Wed Jan 23, 1:32 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Theodore Tso, (Wed Jan 23, 1:12 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Dmitry Potapov, (Wed Jan 23, 4:43 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Jonathan del Strother, (Wed Jan 23, 5:02 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Dmitry Potapov, (Wed Jan 23, 5:12 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Mike Hommey, (Wed Jan 23, 5:19 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Dmitry Potapov, (Wed Jan 23, 5:32 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Linus Torvalds, (Tue Jan 22, 9:56 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Kevin Ballard, (Tue Jan 22, 10:02 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Kevin Ballard, (Tue Jan 22, 9:16 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Martin Langhoff, (Tue Jan 22, 9:27 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Martin Langhoff, (Tue Jan 22, 9:14 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Kevin Ballard, (Tue Jan 22, 8:38 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, David Kastrup, (Wed Jan 23, 4:45 am)
Re: git on MacOSX and files with decomposed utf-8 file names, Theodore Tso, (Tue Jan 22, 10:06 pm)
Re: git on MacOSX and files with decomposed utf-8 file names, Martin Langhoff, (Tue Jan 22, 9:47 pm)