[cfe-dev] [REVIEW] UTF-8 in identifiers proof of concept

[Sean Hunt]

Hey folks,

Attached is a proof of concept for the handling of UTF-8 in
identifiers. Aside from the terrible isIdentifierBody function, which
should be optimized where possible (possibly into a lookup table for
the BMP, since that would be 8kb, and using the simple bitwise
operation in there for other planes), I think the approach is the
correct one. Given that this is sensitive code, however, I would like
to ensure no one has any issues with this approach before I convert
more of the lexer code over.

Sean
-------------- next part --------------
A non-text attachment was scrubbed...
Name: utf8-proof-of-concept.patch
Type: text/x-patch
Size: 3570 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/cfe-dev/attachments/20111231/13c0e49f/attachment.bin>