[PATCH] UTF-8 support for clang-format.

[Alexander Kornienko]

  TokenLength -> ByteCount, also fixed a few incorrect TokenLength usages.
  Utils.h -> Encoding.h

Hi klimek, djasper,

http://llvm-reviews.chandlerc.com/D918

CHANGE SINCE LAST DIFF
  http://llvm-reviews.chandlerc.com/D918?vs=2268&id=2273#toc

Files:
  lib/Format/BreakableToken.cpp
  lib/Format/BreakableToken.h
  lib/Format/Encoding.h
  lib/Format/Format.cpp
  lib/Format/FormatToken.h
  lib/Format/TokenAnnotator.cpp
  lib/Format/TokenAnnotator.h
  unittests/Format/FormatTest.cpp
-------------- next part --------------
A non-text attachment was scrubbed...
Name: D918.3.patch
Type: text/x-patch
Size: 39408 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/cfe-commits/attachments/20130605/23c3e1c1/attachment.bin>