[PATCH] Pull Lexer's CharInfo table out for general use throughout Clang

[Jordan Rose]

  Wondering if we're going to want to add other traits. Right now we don't have a locale-independent version of `islower`, `ispunct`, or `isprint`, all of which we're using in Clang. (Also, I realized this patch is missing `isLetter` and `isAlphanumeric`.)

http://llvm-reviews.chandlerc.com/D363