<table border="1" cellspacing="0" cellpadding="8">
    <tr>
        <th>Issue</th>
        <td>
            <a href=https://github.com/llvm/llvm-project/issues/156790>156790</a>
        </td>
    </tr>

    <tr>
        <th>Summary</th>
        <td>
            LLVM Discourse forums are not indexed by Google, is our robots.txt configured correctly?
        </td>
    </tr>

    <tr>
      <th>Labels</th>
      <td>
            infrastructure,
            discourse
      </td>
    </tr>

    <tr>
      <th>Assignees</th>
      <td>
      </td>
    </tr>

    <tr>
      <th>Reporter</th>
      <td>
          rnk
      </td>
    </tr>
</table>

<pre>
    Hey folks, when I search for highly unique LLVM Discourse posts by name, such as [this one](https://discourse.llvm.org/t/rfc-clang-arm32-compiler-support-for-skip-fault-mitigation/87759), using the text "ARM32 Compiler Support for Skip Fault Mitigation", I get no results from discourse.llvm.org when I use [Google](https://www.google.com/search?q=ARM32+Compiler+Support+for+Skip+Fault+Mitigation), but I get the result I'm looking for from [DuckDuckGo](https://duckduckgo.com/?t=h_&q=ARM32%5D+Compiler+Support+for+Skip+Fault+Mitigation&ia=web) and [Bing](https://www.bing.com/search?q=ARM32%5D+Compiler+Support+for+Skip+Fault+Mitigation).

I think our users and developers in affiliated projects (Rust, Swift, whoever) would greatly benefit from being able to search up information from LLVM RFC threads to better understand *why* certain design choices were made, so it would be good if we could fix this.

I looked at our [robots.txt](https://discourse.llvm.org/robots.txt), and I see a bunch of special Googlebot rules. They look correct to me, but I'm not an expert.

Since Google happens to be my employer, I may circulate this issue internally and get better results that way, but I wanted to start by publicly documenting the issue.
</pre>
<img width="1" height="1" alt="" src="http://email.email.llvm.org/o/eJykldGPozYQxv8a52WUiDUhWR54SDbiutLdy23V18qYAdwYm7PHy_LfV3bI7ba9VlX7gCIIDL_5vvkG4b3qDWLFijMrLhsRaLCucua6aWy7VD_hAp3VV8_4E8wDGngGj8LJATrrYFD9oBcIRn0LCJ8___IFLspLG5xHmKwnD80CRowYn_dBDiA8sOJMg_JgDbLiwvjjQDR5lp8Yrxmv23uFndav4866nvGaGK9dJ7dSC9NvhRtzvpV2nJRGt_VhmqyjbWfd1l_VtO1E0LQdFalekLKG8frxeCxKxssIErwyPdCAQPhGwDg_ff2Sc3haC8LLrWDq8eWqJqhjQfjyoSCPhZ6hRwJjwaEPmjx0zo7w1wbu0gWPsftP1vb6h73P87zr0787aUfG65vYLK-_sfySKBk_3zkZP6-kjJ87m86vamL8nHgZP38kTq03gVbq2P4NG54ZP46grb1GXWLTqQ9WnC9BXuPxyf7QqSCv8ejtSsvymlh-GX5l_PABuIjP_kfqgxIsv8zYMF6CMG2kOivT_516jTL9P2j3f1DKHctOLDs9Aw3KXMEGFx11PnG1-IraTvFUGRBdp7QShC1Mzv6Gkjww_vg1eIo2vMyqo1umLL5GkBJmG3QLvUNBeoEGDXaKbk40GI0RjUYgew9gmECZzrox4d1uTBH8Wj8BDQ5F6-PtDRKhg2BadJ6ShPw0DwvjJ5DoSCgDLcY9AHKwSqKHGR3CKNpbbC0oWukahN7aFlQHM4JM1zr1FgXx39WJg4QtCEoKseLsbGPJ7-iN_nXePzxyG9zIHXcPgoAmGDmA7cBPKJXQcAtUYwlc0Oh38POAS-IAaZ1DSVGI2xZKCUgDbyyBMIBvEzpa6V-UkbjWg0FME5pVRBgXwHHSdol2xeyPYgGpnAxaECYJQHkfEJQhdEZovSTsmLbVhPueoEEQzGJ5j-QsTByWaC8JR3FvTqHRSuoFWivDiIbuWyu9Zbdpq7wt81JssHo4Foey2O8fDpuh6rLjI7ayFDyT2UMn8kY-dg-Hct8d2iPP8o2qeMaLrMz2GS_y_LDjhzzLu5YXh7IpZSnZPsNRKP3dkU16ZfVQHI5lttGiQe3TN4NzZTonPLkgKTi8LUbG-XdX45XisnFVrLVtQu_ZPtPKk3-vToo0Vn_6fnTWhdGDcJicUqbFN2yjMOv-5E8QvyLBwfu0gLSmU31w2N6t1wvL601wuvrj3PWKhtCsuyKirD_bNbCM16lrz3i9Nv5a8d8DAAD__ysxaa4">