<html>
<head>
<base href="http://llvm.org/bugs/" />
</head>
<body><table border="1" cellspacing="0" cellpadding="8">
<tr>
<th>Bug ID</th>
<td><a class="bz_bug_link
bz_status_NEW "
title="NEW --- - Wrong SourceLocation start/end if non-english letters in the text"
href="http://llvm.org/bugs/show_bug.cgi?id=18405">18405</a>
</td>
</tr>
<tr>
<th>Summary</th>
<td>Wrong SourceLocation start/end if non-english letters in the text
</td>
</tr>
<tr>
<th>Product</th>
<td>clang
</td>
</tr>
<tr>
<th>Version</th>
<td>3.3
</td>
</tr>
<tr>
<th>Hardware</th>
<td>PC
</td>
</tr>
<tr>
<th>OS</th>
<td>All
</td>
</tr>
<tr>
<th>Status</th>
<td>NEW
</td>
</tr>
<tr>
<th>Severity</th>
<td>normal
</td>
</tr>
<tr>
<th>Priority</th>
<td>P
</td>
</tr>
<tr>
<th>Component</th>
<td>libclang
</td>
</tr>
<tr>
<th>Assignee</th>
<td>unassignedclangbugs@nondot.org
</td>
</tr>
<tr>
<th>Reporter</th>
<td>dev@antonsmirnov.name
</td>
</tr>
<tr>
<th>CC</th>
<td>llvmbugs@cs.uiuc.edu
</td>
</tr>
<tr>
<th>Classification</th>
<td>Unclassified
</td>
</tr></table>
<p>
<div>
<pre>clang_tokenize() (via libclang C-API) returns wrong SourceLocation start/end if
there are non-English characters in the UnsavedFile content. It seems that each
character is counter with length 2.
For example:
unsaved file content:
"//йц
1"
tokens:
#1: start=0, end=6, kind=<a href="show_bug.cgi?id=18405#c2">comment
#2</a>: start=7, end=8, kind=literal
The error is that #1 end must be 4 and #2 must be shifted to beginning
(start=5, end=6)</pre>
</div>
</p>
<hr>
<span>You are receiving this mail because:</span>
<ul>
<li>You are on the CC list for the bug.</li>
</ul>
</body>
</html>