<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi Nirav<div class=""><br class=""></div><div class="">This patch is affecting our internal backends (large instruction count regressions). I haven’t completely gone through your patch but form what I see, the problem seems to be that we don’t handle</div><div class="">descending into TokenFactors (in getStoreMergeCandidates).</div><div class="">I also see a relevant FIXME which matches what I observe as missing. I have the relevant DAG dump from before and after this change below.</div><div class="">Before:</div><div class=""><div class=""><br class=""></div><div class=""> t17: i64 = add t6, Constant:i64<4></div><div class=""> t18: ch = store<ST1[%dst.gep2.i105.4](align=2)> t15, Constant:i8<0>, t17, undef:i64</div><div class=""> t20: i64 = add t6, Constant:i64<5></div><div class=""> t21: ch = store<ST1[%dst.gep2.i105.5]> t18, Constant:i8<0>, t20, undef:i64</div></div><div class=""><br class=""></div><div class="">After:</div><div class=""> t17: i64 = add t6, Constant:i64<4><br class=""> t18: ch = store<ST1[%dst.gep2.i105.4](align=2)> t15, Constant:i8<0>, t17, undef:i64<br class=""> t20: i64 = add t6, Constant:i64<5><br class=""> t50: ch = store<ST1[%dst.gep2.i105.5]> t0, Constant:i8<0>, t20, undef:i64<br class=""> t51: ch = TokenFactor t18, t50</div><div class=""><br class=""></div><div class="">Clearly we need to handle TokenFactors for getStoreMergeCandidates.</div><div class=""><br class=""></div><div class="">Would it be possible to revert this patch and commit it again once you handle TokenFactors? Do you have an ETA for the TokenFactors handling ?</div><div class=""><br class=""></div><div class="">Thanks</div><div class="">Aditya</div><div class=""><div><blockquote type="cite" class=""><div class="">On Mar 13, 2017, at 6:50 PM, Nirav Davé via llvm-commits <<a href="mailto:llvm-commits@lists.llvm.org" class="">llvm-commits@lists.llvm.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div class="">Yes. It'll be in presently.<br class=""></div><div class=""><br class=""></div><div class="">Thanks, </div><div class=""><br class=""></div><div class="">-Nirav</div><div class=""><br class=""></div><div class="gmail_extra"><div class="gmail_quote">On Mon, Mar 13, 2017 at 9:23 PM, Craig Topper <span dir="ltr" class=""><<a href="mailto:craig.topper@gmail.com" target="_blank" class="">craig.topper@gmail.com</a>></span> wrote:</div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="">Will you also be restoring my fix for i256-add.ll?</div><div class="gmail_extra"><br clear="all" class=""><div class=""><div class="m_4108594283957026219gmail_signature" data-smartmail="gmail_signature">~Craig</div></div>
<br class=""><div class="gmail_quote">On Mon, Mar 13, 2017 at 5:34 PM, Nirav Dave via llvm-commits <span dir="ltr" class=""><<a href="mailto:llvm-commits@lists.llvm.org" target="_blank" class="">llvm-commits@lists.llvm.org</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Author: niravd<br class="">
Date: Mon Mar 13 19:34:14 2017<br class="">
New Revision: 297695<br class="">
<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project?rev=297695&view=rev" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject?rev=297695&view=rev</a><br class="">
Log:<br class="">
In visitSTORE, always use FindBetterChain, rather than only when UseAA is enabled.<br class="">
<br class="">
Recommiting with compiler time improvements<br class="">
<br class="">
Recommitting after fixup of 32-bit aliasing sign offset bug in DAGCombiner.<br class="">
<br class="">
* Simplify Consecutive Merge Store Candidate Search<br class="">
<br class="">
Now that address aliasing is much less conservative, push through<br class="">
simplified store merging search and chain alias analysis which only<br class="">
checks for parallel stores through the chain subgraph. This is cleaner<br class="">
as the separation of non-interfering loads/stores from the<br class="">
store-merging logic.<br class="">
<br class="">
When merging stores search up the chain through a single load, and<br class="">
finds all possible stores by looking down from through a load and a<br class="">
TokenFactor to all stores visited.<br class="">
<br class="">
This improves the quality of the output SelectionDAG and the output<br class="">
Codegen (save perhaps for some ARM cases where we correctly constructs<br class="">
wider loads, but then promotes them to float operations which appear<br class="">
but requires more expensive constant generation).<br class="">
<br class="">
Some minor peephole optimizations to deal with improved SubDAG shapes (listed below)<br class="">
<br class="">
Additional Minor Changes:<br class="">
<br class="">
1. Finishes removing unused AliasLoad code<br class="">
<br class="">
2. Unifies the chain aggregation in the merged stores across code<br class="">
paths<br class="">
<br class="">
3. Re-add the Store node to the worklist after calling<br class="">
SimplifyDemandedBits.<br class="">
<br class="">
4. Increase GatherAllAliasesMaxDepth from 6 to 18. That number is<br class="">
arbitrary, but seems sufficient to not cause regressions in<br class="">
tests.<br class="">
<br class="">
5. Remove Chain dependencies of Memory operations on CopyfromReg<br class="">
nodes as these are captured by data dependence<br class="">
<br class="">
6. Forward loads-store values through tokenfactors containing<br class="">
{CopyToReg,CopyFromReg} Values.<br class="">
<br class="">
7. Peephole to convert buildvector of extract_vector_elt to<br class="">
extract_subvector if possible (see<br class="">
CodeGen/AArch64/store-merge.l<wbr class="">l)<br class="">
<br class="">
8. Store merging for the ARM target is restricted to 32-bit as<br class="">
some in some contexts invalid 64-bit operations are being<br class="">
generated. This can be removed once appropriate checks are<br class="">
added.<br class="">
<br class="">
This finishes the change Matt Arsenault started in r246307 and<br class="">
jyknight's original patch.<br class="">
<br class="">
Many tests required some changes as memory operations are now<br class="">
reorderable, improving load-store forwarding. One test in<br class="">
particular is worth noting:<br class="">
<br class="">
CodeGen/PowerPC/ppc64-align-lo<wbr class="">ng-double.ll - Improved load-store<br class="">
forwarding converts a load-store pair into a parallel store and<br class="">
a memory-realized bitcast of the same value. However, because we<br class="">
lose the sharing of the explicit and implicit store values we<br class="">
must create another local store. A similar transformation<br class="">
happens before SelectionDAG as well.<br class="">
<br class="">
Reviewers: arsenm, hfinkel, tstellarAMD, jyknight, nhaehnle<br class="">
<br class="">
Added:<br class="">
llvm/trunk/test/CodeGen/X86/pr<wbr class="">32108.ll<br class="">
Removed:<br class="">
llvm/trunk/test/CodeGen/X86/co<wbr class="">mbiner-aa-0.ll<br class="">
llvm/trunk/test/CodeGen/X86/co<wbr class="">mbiner-aa-1.ll<br class="">
llvm/trunk/test/CodeGen/X86/pr<wbr class="">18023.ll<br class="">
Modified:<br class="">
llvm/trunk/include/llvm/Target<wbr class="">/TargetLowering.h<br class="">
llvm/trunk/lib/CodeGen/Selecti<wbr class="">onDAG/DAGCombiner.cpp<br class="">
llvm/trunk/lib/CodeGen/TargetL<wbr class="">oweringBase.cpp<br class="">
llvm/trunk/lib/Target/AArch64/<wbr class="">AArch64ISelLowering.cpp<br class="">
llvm/trunk/lib/Target/ARM/ARMI<wbr class="">SelLowering.h<br class="">
llvm/trunk/test/CodeGen/AArch6<wbr class="">4/argument-blocks.ll<br class="">
llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-abi.ll<br class="">
llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-memset-inline.ll<br class="">
llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-variadic-aapcs.ll<br class="">
llvm/trunk/test/CodeGen/AArch6<wbr class="">4/merge-store.ll<br class="">
llvm/trunk/test/CodeGen/AArch6<wbr class="">4/vector_merge_dep_check.ll<br class="">
llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/debugger-insert-nops.ll<br class="">
llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/insert_vector_elt.ll<br class="">
llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/merge-stores.ll<br class="">
llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/private-element-size.ll<br class="">
llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/si-triv-disjoint-mem-access.<wbr class="">ll<br class="">
llvm/trunk/test/CodeGen/ARM/20<wbr class="">12-10-04-AAPCS-byval-align8.ll<br class="">
llvm/trunk/test/CodeGen/ARM/al<wbr class="">loc-no-stack-realign.ll<br class="">
llvm/trunk/test/CodeGen/ARM/gp<wbr class="">r-paired-spill.ll<br class="">
llvm/trunk/test/CodeGen/ARM/if<wbr class="">cvt10.ll<br class="">
llvm/trunk/test/CodeGen/ARM/il<wbr class="">legal-bitfield-loadstore.ll<br class="">
llvm/trunk/test/CodeGen/ARM/st<wbr class="">atic-addr-hoisting.ll<br class="">
llvm/trunk/test/CodeGen/BPF/un<wbr class="">def.ll<br class="">
llvm/trunk/test/CodeGen/MSP430<wbr class="">/Inst16mm.ll<br class="">
llvm/trunk/test/CodeGen/Mips/c<wbr class="">conv/arguments-float.ll<br class="">
llvm/trunk/test/CodeGen/Mips/c<wbr class="">conv/arguments-varargs.ll<br class="">
llvm/trunk/test/CodeGen/Mips/f<wbr class="">astcc.ll<br class="">
llvm/trunk/test/CodeGen/Mips/l<wbr class="">oad-store-left-right.ll<br class="">
llvm/trunk/test/CodeGen/Mips/m<wbr class="">icromips-li.ll<br class="">
llvm/trunk/test/CodeGen/Mips/m<wbr class="">ips64-f128-call.ll<br class="">
llvm/trunk/test/CodeGen/Mips/m<wbr class="">ips64-f128.ll<br class="">
llvm/trunk/test/CodeGen/Mips/m<wbr class="">no-ldc1-sdc1.ll<br class="">
llvm/trunk/test/CodeGen/Mips/m<wbr class="">sa/f16-llvm-ir.ll<br class="">
llvm/trunk/test/CodeGen/Mips/m<wbr class="">sa/i5_ld_st.ll<br class="">
llvm/trunk/test/CodeGen/Mips/o<wbr class="">32_cc_byval.ll<br class="">
llvm/trunk/test/CodeGen/Mips/o<wbr class="">32_cc_vararg.ll<br class="">
llvm/trunk/test/CodeGen/PowerP<wbr class="">C/anon_aggr.ll<br class="">
llvm/trunk/test/CodeGen/PowerP<wbr class="">C/complex-return.ll<br class="">
llvm/trunk/test/CodeGen/PowerP<wbr class="">C/jaggedstructs.ll<br class="">
llvm/trunk/test/CodeGen/PowerP<wbr class="">C/ppc64-align-long-double.ll<br class="">
llvm/trunk/test/CodeGen/PowerP<wbr class="">C/structsinmem.ll<br class="">
llvm/trunk/test/CodeGen/PowerP<wbr class="">C/structsinregs.ll<br class="">
llvm/trunk/test/CodeGen/System<wbr class="">Z/unaligned-01.ll<br class="">
llvm/trunk/test/CodeGen/Thumb/<wbr class="">2010-07-15-debugOrdering.ll<br class="">
llvm/trunk/test/CodeGen/Thumb/<wbr class="">stack-access.ll<br class="">
llvm/trunk/test/CodeGen/X86/20<wbr class="">10-09-17-SideEffectsInChain.ll<br class="">
llvm/trunk/test/CodeGen/X86/20<wbr class="">12-11-28-merge-store-alias.ll<br class="">
llvm/trunk/test/CodeGen/X86/Me<wbr class="">rgeConsecutiveStores.ll<br class="">
llvm/trunk/test/CodeGen/X86/av<wbr class="">x-vbroadcast.ll<br class="">
llvm/trunk/test/CodeGen/X86/av<wbr class="">x512-mask-op.ll<br class="">
llvm/trunk/test/CodeGen/X86/ch<wbr class="">ain_order.ll<br class="">
llvm/trunk/test/CodeGen/X86/cl<wbr class="">ear_upper_vector_element_bits.<wbr class="">ll<br class="">
llvm/trunk/test/CodeGen/X86/co<wbr class="">py-eflags.ll<br class="">
llvm/trunk/test/CodeGen/X86/da<wbr class="">g-merge-fast-accesses.ll<br class="">
llvm/trunk/test/CodeGen/X86/do<wbr class="">nt-trunc-store-double-to-float<wbr class="">.ll<br class="">
llvm/trunk/test/CodeGen/X86/ex<wbr class="">tractelement-legalization-stor<wbr class="">e-ordering.ll<br class="">
llvm/trunk/test/CodeGen/X86/i2<wbr class="">56-add.ll<br class="">
llvm/trunk/test/CodeGen/X86/i3<wbr class="">86-shrink-wrapping.ll<br class="">
llvm/trunk/test/CodeGen/X86/li<wbr class="">ve-range-nosubreg.ll<br class="">
llvm/trunk/test/CodeGen/X86/lo<wbr class="">nglong-deadload.ll<br class="">
llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-consecutive-loads-128.ll<br class="">
llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-consecutive-loads-256.ll<br class="">
llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-store-partially-alias-load<wbr class="">s.ll<br class="">
llvm/trunk/test/CodeGen/X86/sp<wbr class="">lit-store.ll<br class="">
llvm/trunk/test/CodeGen/X86/st<wbr class="">ores-merging.ll<br class="">
llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-compare-results.ll<br class="">
llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-shuffle-variable-128.ll<br class="">
llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-shuffle-variable-256.ll<br class="">
llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctorcall.ll<br class="">
llvm/trunk/test/CodeGen/X86/wi<wbr class="">n32-eh.ll<br class="">
llvm/trunk/test/CodeGen/XCore/<wbr class="">varargs.ll<br class="">
<br class="">
Modified: llvm/trunk/include/llvm/Target<wbr class="">/TargetLowering.h<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/include/llvm/Target/TargetLowering.h?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/include/llvm/<wbr class="">Target/TargetLowering.h?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/include/llvm/Target<wbr class="">/TargetLowering.h (original)<br class="">
+++ llvm/trunk/include/llvm/Target<wbr class="">/TargetLowering.h Mon Mar 13 19:34:14 2017<br class="">
@@ -363,6 +363,9 @@ public:<br class="">
return false;<br class="">
}<br class="">
<br class="">
+ /// Returns if it's reasonable to merge stores to MemVT size.<br class="">
+ virtual bool canMergeStoresTo(EVT MemVT) const { return true; }<br class="">
+<br class="">
/// \brief Return true if it is cheap to speculate a call to intrinsic cttz.<br class="">
virtual bool isCheapToSpeculateCttz() const {<br class="">
return false;<br class="">
<br class="">
Modified: llvm/trunk/lib/CodeGen/Selecti<wbr class="">onDAG/DAGCombiner.cpp<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/lib/CodeGen/SelectionDAG/DAGCombiner.cpp?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/lib/CodeGen/<wbr class="">SelectionDAG/DAGCombiner.cpp?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/lib/CodeGen/Selecti<wbr class="">onDAG/DAGCombiner.cpp (original)<br class="">
+++ llvm/trunk/lib/CodeGen/Selecti<wbr class="">onDAG/DAGCombiner.cpp Mon Mar 13 19:34:14 2017<br class="">
@@ -53,10 +53,6 @@ STATISTIC(SlicedLoads, "Number of load s<br class="">
<br class="">
namespace {<br class="">
static cl::opt<bool><br class="">
- CombinerAA("combiner-alias-ana<wbr class="">lysis", cl::Hidden,<br class="">
- cl::desc("Enable DAG combiner alias-analysis heuristics"));<br class="">
-<br class="">
- static cl::opt<bool><br class="">
CombinerGlobalAA("combiner-gl<wbr class="">obal-alias-analysis", cl::Hidden,<br class="">
cl::desc("Enable DAG combiner's use of IR alias analysis"));<br class="">
<br class="">
@@ -133,6 +129,9 @@ namespace {<br class="">
/// Add to the worklist making sure its instance is at the back (next to be<br class="">
/// processed.)<br class="">
void AddToWorklist(SDNode *N) {<br class="">
+ assert(N->getOpcode() != ISD::DELETED_NODE &&<br class="">
+ "Deleted Node added to Worklist");<br class="">
+<br class="">
// Skip handle nodes as they can't usefully be combined and confuse the<br class="">
// zero-use deletion strategy.<br class="">
if (N->getOpcode() == ISD::HANDLENODE)<br class="">
@@ -177,6 +176,7 @@ namespace {<br class="">
void CommitTargetLoweringOpt(const TargetLowering::TargetLowering<wbr class="">Opt &TLO);<br class="">
<br class="">
private:<br class="">
+ unsigned MaximumLegalStoreInBits;<br class="">
<br class="">
/// Check the specified integer node value to see if it can be simplified or<br class="">
/// if things it uses can be simplified by bit propagation.<br class="">
@@ -422,15 +422,12 @@ namespace {<br class="">
/// Holds a pointer to an LSBaseSDNode as well as information on where it<br class="">
/// is located in a sequence of memory operations connected by a chain.<br class="">
struct MemOpLink {<br class="">
- MemOpLink (LSBaseSDNode *N, int64_t Offset, unsigned Seq):<br class="">
- MemNode(N), OffsetFromBase(Offset), SequenceNum(Seq) { }<br class="">
+ MemOpLink(LSBaseSDNode *N, int64_t Offset)<br class="">
+ : MemNode(N), OffsetFromBase(Offset) {}<br class="">
// Ptr to the mem node.<br class="">
LSBaseSDNode *MemNode;<br class="">
// Offset from the base ptr.<br class="">
int64_t OffsetFromBase;<br class="">
- // What is the sequence number of this mem node.<br class="">
- // Lowest mem operand in the DAG starts at zero.<br class="">
- unsigned SequenceNum;<br class="">
};<br class="">
<br class="">
/// This is a helper function for visitMUL to check the profitability<br class="">
@@ -441,12 +438,6 @@ namespace {<br class="">
SDValue &AddNode,<br class="">
SDValue &ConstNode);<br class="">
<br class="">
- /// This is a helper function for MergeStoresOfConstantsOrVecElt<wbr class="">s. Returns a<br class="">
- /// constant build_vector of the stored constant values in Stores.<br class="">
- SDValue getMergedConstantVectorStore(S<wbr class="">electionDAG &DAG, const SDLoc &SL,<br class="">
- ArrayRef<MemOpLink> Stores,<br class="">
- SmallVectorImpl<SDValue> &Chains,<br class="">
- EVT Ty) const;<br class="">
<br class="">
/// This is a helper function for visitAND and visitZERO_EXTEND. Returns<br class="">
/// true if the (and (load x) c) pattern matches an extload. ExtVT returns<br class="">
@@ -460,18 +451,15 @@ namespace {<br class="">
/// This is a helper function for MergeConsecutiveStores. When the source<br class="">
/// elements of the consecutive stores are all constants or all extracted<br class="">
/// vector elements, try to merge them into one larger store.<br class="">
- /// \return number of stores that were merged into a merged store (always<br class="">
- /// a prefix of \p StoreNode).<br class="">
- bool MergeStoresOfConstantsOrVecElt<wbr class="">s(<br class="">
- SmallVectorImpl<MemOpLink> &StoreNodes, EVT MemVT, unsigned NumStores,<br class="">
- bool IsConstantSrc, bool UseVector);<br class="">
+ /// \return True if a merged store was created.<br class="">
+ bool MergeStoresOfConstantsOrVecElt<wbr class="">s(SmallVectorImpl<MemOpLink> &StoreNodes,<br class="">
+ EVT MemVT, unsigned NumStores,<br class="">
+ bool IsConstantSrc, bool UseVector);<br class="">
<br class="">
/// This is a helper function for MergeConsecutiveStores.<br class="">
/// Stores that may be merged are placed in StoreNodes.<br class="">
- /// Loads that may alias with those stores are placed in AliasLoadNodes.<br class="">
- void getStoreMergeAndAliasCandidate<wbr class="">s(<br class="">
- StoreSDNode* St, SmallVectorImpl<MemOpLink> &StoreNodes,<br class="">
- SmallVectorImpl<LSBaseSDNode*> &AliasLoadNodes);<br class="">
+ void getStoreMergeCandidates(StoreS<wbr class="">DNode *St,<br class="">
+ SmallVectorImpl<MemOpLink> &StoreNodes);<br class="">
<br class="">
/// Helper function for MergeConsecutiveStores. Checks if<br class="">
/// Candidate stores have indirect dependency through their<br class="">
@@ -483,8 +471,7 @@ namespace {<br class="">
/// This optimization uses wide integers or vectors when possible.<br class="">
/// \return number of stores that were merged into a merged store (the<br class="">
/// affected nodes are stored as a prefix in \p StoreNodes).<br class="">
- bool MergeConsecutiveStores(StoreSD<wbr class="">Node *N,<br class="">
- SmallVectorImpl<MemOpLink> &StoreNodes);<br class="">
+ bool MergeConsecutiveStores(StoreSD<wbr class="">Node *N);<br class="">
<br class="">
/// \brief Try to transform a truncation where C is a constant:<br class="">
/// (trunc (and X, C)) -> (and (trunc X), (trunc C))<br class="">
@@ -499,6 +486,13 @@ namespace {<br class="">
: DAG(D), TLI(D.getTargetLoweringInfo())<wbr class="">, Level(BeforeLegalizeTypes),<br class="">
OptLevel(OL), LegalOperations(false), LegalTypes(false), AA(A) {<br class="">
ForCodeSize = DAG.getMachineFunction().getFu<wbr class="">nction()->optForSize();<br class="">
+<br class="">
+ MaximumLegalStoreInBits = 0;<br class="">
+ for (MVT VT : MVT::all_valuetypes())<br class="">
+ if (EVT(VT).isSimple() && VT != MVT::Other &&<br class="">
+ TLI.isTypeLegal(EVT(VT)) &&<br class="">
+ VT.getSizeInBits() >= MaximumLegalStoreInBits)<br class="">
+ MaximumLegalStoreInBits = VT.getSizeInBits();<br class="">
}<br class="">
<br class="">
/// Runs the dag combiner on all nodes in the work list<br class="">
@@ -1589,7 +1583,7 @@ SDValue DAGCombiner::visitTokenFactor(<wbr class="">SD<br class="">
}<br class="">
<br class="">
SmallVector<SDNode *, 8> TFs; // List of token factors to visit.<br class="">
- SmallVector<SDValue, 8> Ops; // Ops for replacing token factor.<br class="">
+ SmallVector<SDValue, 8> Ops; // Ops for replacing token factor.<br class="">
SmallPtrSet<SDNode*, 16> SeenOps;<br class="">
bool Changed = false; // If we should replace this token factor.<br class="">
<br class="">
@@ -1633,6 +1627,86 @@ SDValue DAGCombiner::visitTokenFactor(<wbr class="">SD<br class="">
}<br class="">
}<br class="">
<br class="">
+ // Remove Nodes that are chained to another node in the list. Do so<br class="">
+ // by walking up chains breath-first stopping when we've seen<br class="">
+ // another operand. In general we must climb to the EntryNode, but we can exit<br class="">
+ // early if we find all remaining work is associated with just one operand as<br class="">
+ // no further pruning is possible.<br class="">
+<br class="">
+ // List of nodes to search through and original Ops from which they originate.<br class="">
+ SmallVector<std::pair<SDNode *, unsigned>, 8> Worklist;<br class="">
+ SmallVector<unsigned, 8> OpWorkCount; // Count of work for each Op.<br class="">
+ SmallPtrSet<SDNode *, 16> SeenChains;<br class="">
+ bool DidPruneOps = false;<br class="">
+<br class="">
+ unsigned NumLeftToConsider = 0;<br class="">
+ for (const SDValue &Op : Ops) {<br class="">
+ Worklist.push_back(std::make_p<wbr class="">air(Op.getNode(), NumLeftToConsider++));<br class="">
+ OpWorkCount.push_back(1);<br class="">
+ }<br class="">
+<br class="">
+ auto AddToWorklist = [&](unsigned CurIdx, SDNode *Op, unsigned OpNumber) {<br class="">
+ // If this is an Op, we can remove the op from the list. Remark any<br class="">
+ // search associated with it as from the current OpNumber.<br class="">
+ if (SeenOps.count(Op) != 0) {<br class="">
+ Changed = true;<br class="">
+ DidPruneOps = true;<br class="">
+ unsigned OrigOpNumber = 0;<br class="">
+ while (Ops[OrigOpNumber].getNode() != Op && OrigOpNumber < Ops.size())<br class="">
+ OrigOpNumber++;<br class="">
+ assert((OrigOpNumber != Ops.size()) &&<br class="">
+ "expected to find TokenFactor Operand");<br class="">
+ // Re-mark worklist from OrigOpNumber to OpNumber<br class="">
+ for (unsigned i = CurIdx + 1; i < Worklist.size(); ++i) {<br class="">
+ if (Worklist[i].second == OrigOpNumber) {<br class="">
+ Worklist[i].second = OpNumber;<br class="">
+ }<br class="">
+ }<br class="">
+ OpWorkCount[OpNumber] += OpWorkCount[OrigOpNumber];<br class="">
+ OpWorkCount[OrigOpNumber] = 0;<br class="">
+ NumLeftToConsider--;<br class="">
+ }<br class="">
+ // Add if it's a new chain<br class="">
+ if (SeenChains.insert(Op).second) {<br class="">
+ OpWorkCount[OpNumber]++;<br class="">
+ Worklist.push_back(std::make_p<wbr class="">air(Op, OpNumber));<br class="">
+ }<br class="">
+ };<br class="">
+<br class="">
+ for (unsigned i = 0; i < Worklist.size() && i < 1024; ++i) {<br class="">
+ // We need at least be consider at least 2 Ops to prune.<br class="">
+ if (NumLeftToConsider <= 1)<br class="">
+ break;<br class="">
+ auto CurNode = Worklist[i].first;<br class="">
+ auto CurOpNumber = Worklist[i].second;<br class="">
+ assert((OpWorkCount[CurOpNumbe<wbr class="">r] > 0) &&<br class="">
+ "Node should not appear in worklist");<br class="">
+ switch (CurNode->getOpcode()) {<br class="">
+ case ISD::EntryToken:<br class="">
+ // Hitting EntryToken is the only way for the search to terminate without<br class="">
+ // hitting<br class="">
+ // another operand's search. Prevent us from marking this operand<br class="">
+ // considered.<br class="">
+ NumLeftToConsider++;<br class="">
+ break;<br class="">
+ case ISD::TokenFactor:<br class="">
+ for (const SDValue &Op : CurNode->op_values())<br class="">
+ AddToWorklist(i, Op.getNode(), CurOpNumber);<br class="">
+ break;<br class="">
+ case ISD::CopyFromReg:<br class="">
+ case ISD::CopyToReg:<br class="">
+ AddToWorklist(i, CurNode->getOperand(0).getNode<wbr class="">(), CurOpNumber);<br class="">
+ break;<br class="">
+ default:<br class="">
+ if (auto *MemNode = dyn_cast<MemSDNode>(CurNode))<br class="">
+ AddToWorklist(i, MemNode->getChain().getNode(), CurOpNumber);<br class="">
+ break;<br class="">
+ }<br class="">
+ OpWorkCount[CurOpNumber]--;<br class="">
+ if (OpWorkCount[CurOpNumber] == 0)<br class="">
+ NumLeftToConsider--;<br class="">
+ }<br class="">
+<br class="">
SDValue Result;<br class="">
<br class="">
// If we've changed things around then replace token factor.<br class="">
@@ -1641,15 +1715,22 @@ SDValue DAGCombiner::visitTokenFactor(<wbr class="">SD<br class="">
// The entry token is the only possible outcome.<br class="">
Result = DAG.getEntryNode();<br class="">
} else {<br class="">
- // New and improved token factor.<br class="">
- Result = DAG.getNode(ISD::TokenFactor, SDLoc(N), MVT::Other, Ops);<br class="">
+ if (DidPruneOps) {<br class="">
+ SmallVector<SDValue, 8> PrunedOps;<br class="">
+ //<br class="">
+ for (const SDValue &Op : Ops) {<br class="">
+ if (SeenChains.count(Op.getNode()<wbr class="">) == 0)<br class="">
+ PrunedOps.push_back(Op);<br class="">
+ }<br class="">
+ Result = DAG.getNode(ISD::TokenFactor, SDLoc(N), MVT::Other, PrunedOps);<br class="">
+ } else {<br class="">
+ Result = DAG.getNode(ISD::TokenFactor, SDLoc(N), MVT::Other, Ops);<br class="">
+ }<br class="">
}<br class="">
<br class="">
- // Add users to worklist if AA is enabled, since it may introduce<br class="">
- // a lot of new chained token factors while removing memory deps.<br class="">
- bool UseAA = CombinerAA.getNumOccurrences() > 0 ? CombinerAA<br class="">
- : DAG.getSubtarget().useAA();<br class="">
- return CombineTo(N, Result, UseAA /*add to worklist*/);<br class="">
+ // Add users to worklist, since we may introduce a lot of new<br class="">
+ // chained token factors while removing memory deps.<br class="">
+ return CombineTo(N, Result, true /*add to worklist*/);<br class="">
}<br class="">
<br class="">
return Result;<br class="">
@@ -6792,6 +6873,9 @@ SDValue DAGCombiner::CombineExtLoad(SD<wbr class="">No<br class="">
SDValue NewChain = DAG.getNode(ISD::TokenFactor, DL, MVT::Other, Chains);<br class="">
SDValue NewValue = DAG.getNode(ISD::CONCAT_VECTOR<wbr class="">S, DL, DstVT, Loads);<br class="">
<br class="">
+ // Simplify TF.<br class="">
+ AddToWorklist(NewChain.getNode<wbr class="">());<br class="">
+<br class="">
CombineTo(N, NewValue);<br class="">
<br class="">
// Replace uses of the original load (before extension)<br class="">
@@ -10947,7 +11031,7 @@ SDValue DAGCombiner::visitLOAD(SDNode *N<br class="">
dbgs() << "\n");<br class="">
WorklistRemover DeadNodes(*this);<br class="">
DAG.<wbr class="">ReplaceAllUsesOfValueWith(SDVa<wbr class="">lue(N, 1), Chain);<br class="">
-<br class="">
+ AddUsersToWorklist(Chain.getNo<wbr class="">de());<br class="">
if (N->use_empty())<br class="">
deleteAndRecombine(N);<br class="">
<br class="">
@@ -11000,7 +11084,7 @@ SDValue DAGCombiner::visitLOAD(SDNode *N<br class="">
StoreSDNode *PrevST = cast<StoreSDNode>(Chain);<br class="">
if (PrevST->getBasePtr() == Ptr &&<br class="">
PrevST->getValue().getValueTy<wbr class="">pe() == N->getValueType(0))<br class="">
- return CombineTo(N, Chain.getOperand(1), Chain);<br class="">
+ return CombineTo(N, PrevST->getOperand(1), Chain);<br class="">
}<br class="">
}<br class="">
<br class="">
@@ -11018,14 +11102,7 @@ SDValue DAGCombiner::visitLOAD(SDNode *N<br class="">
}<br class="">
}<br class="">
<br class="">
- bool UseAA = CombinerAA.getNumOccurrences() > 0 ? CombinerAA<br class="">
- : DAG.getSubtarget().useAA();<br class="">
-#ifndef NDEBUG<br class="">
- if (CombinerAAOnlyFunc.getNumOccu<wbr class="">rrences() &&<br class="">
- CombinerAAOnlyFunc != DAG.getMachineFunction().getNa<wbr class="">me())<br class="">
- UseAA = false;<br class="">
-#endif<br class="">
- if (UseAA && LD->isUnindexed()) {<br class="">
+ if (LD->isUnindexed()) {<br class="">
// Walk up chain skipping non-aliasing memory nodes.<br class="">
SDValue BetterChain = FindBetterChain(N, Chain);<br class="">
<br class="">
@@ -11607,6 +11684,7 @@ bool DAGCombiner::SliceUpLoad(SDNod<wbr class="">e *N)<br class="">
SDValue Chain = DAG.getNode(ISD::TokenFactor, SDLoc(LD), MVT::Other,<br class="">
ArgChains);<br class="">
DAG.<wbr class="">ReplaceAllUsesOfValueWith(SDVa<wbr class="">lue(N, 1), Chain);<br class="">
+ AddToWorklist(Chain.getNode())<wbr class="">;<br class="">
return true;<br class="">
}<br class="">
<br class="">
@@ -12000,20 +12078,6 @@ bool DAGCombiner::isMulAddWithConst<wbr class="">Profi<br class="">
return false;<br class="">
}<br class="">
<br class="">
-SDValue DAGCombiner::getMergedConstant<wbr class="">VectorStore(<br class="">
- SelectionDAG &DAG, const SDLoc &SL, ArrayRef<MemOpLink> Stores,<br class="">
- SmallVectorImpl<SDValue> &Chains, EVT Ty) const {<br class="">
- SmallVector<SDValue, 8> BuildVector;<br class="">
-<br class="">
- for (unsigned I = 0, E = Ty.getVectorNumElements(); I != E; ++I) {<br class="">
- StoreSDNode *St = cast<StoreSDNode>(Stores[I].Me<wbr class="">mNode);<br class="">
- Chains.push_back(St->getChain(<wbr class="">));<br class="">
- BuildVector.push_back(St->getV<wbr class="">alue());<br class="">
- }<br class="">
-<br class="">
- return DAG.getBuildVector(Ty, SL, BuildVector);<br class="">
-}<br class="">
-<br class="">
bool DAGCombiner::MergeStoresOfCons<wbr class="">tantsOrVecElts(<br class="">
SmallVectorImpl<MemOpLink> &StoreNodes, EVT MemVT,<br class="">
unsigned NumStores, bool IsConstantSrc, bool UseVector) {<br class="">
@@ -12022,22 +12086,8 @@ bool DAGCombiner::MergeStoresOfCons<wbr class="">tants<br class="">
return false;<br class="">
<br class="">
int64_t ElementSizeBytes = MemVT.getSizeInBits() / 8;<br class="">
- LSBaseSDNode *FirstInChain = StoreNodes[0].MemNode;<br class="">
- unsigned LatestNodeUsed = 0;<br class="">
-<br class="">
- for (unsigned i=0; i < NumStores; ++i) {<br class="">
- // Find a chain for the new wide-store operand. Notice that some<br class="">
- // of the store nodes that we found may not be selected for inclusion<br class="">
- // in the wide store. The chain we use needs to be the chain of the<br class="">
- // latest store node which is *used* and replaced by the wide store.<br class="">
- if (StoreNodes[i].SequenceNum < StoreNodes[LatestNodeUsed].Seq<wbr class="">uenceNum)<br class="">
- LatestNodeUsed = i;<br class="">
- }<br class="">
-<br class="">
- SmallVector<SDValue, 8> Chains;<br class="">
<br class="">
// The latest Node in the DAG.<br class="">
- LSBaseSDNode *LatestOp = StoreNodes[LatestNodeUsed].Mem<wbr class="">Node;<br class="">
SDLoc DL(StoreNodes[0].MemNode);<br class="">
<br class="">
SDValue StoredVal;<br class="">
@@ -12053,7 +12103,18 @@ bool DAGCombiner::MergeStoresOfCons<wbr class="">tants<br class="">
assert(TLI.isTypeLegal(Ty) && "Illegal vector store");<br class="">
<br class="">
if (IsConstantSrc) {<br class="">
- StoredVal = getMergedConstantVectorStore(D<wbr class="">AG, DL, StoreNodes, Chains, Ty);<br class="">
+ SmallVector<SDValue, 8> BuildVector;<br class="">
+ for (unsigned I = 0, E = Ty.getVectorNumElements(); I != E; ++I) {<br class="">
+ StoreSDNode *St = cast<StoreSDNode>(StoreNodes[I<wbr class="">].MemNode);<br class="">
+ SDValue Val = St->getValue();<br class="">
+ if (MemVT.getScalarType().isInteg<wbr class="">er())<br class="">
+ if (auto *CFP = dyn_cast<ConstantFPSDNode>(St-<wbr class="">>getValue()))<br class="">
+ Val = DAG.getConstant(<br class="">
+ (uint32_t)CFP->getValueAPF().b<wbr class="">itcastToAPInt().getZExtValue()<wbr class="">,<br class="">
+ SDLoc(CFP), MemVT);<br class="">
+ BuildVector.push_back(Val);<br class="">
+ }<br class="">
+ StoredVal = DAG.getBuildVector(Ty, DL, BuildVector);<br class="">
} else {<br class="">
SmallVector<SDValue, 8> Ops;<br class="">
for (unsigned i = 0; i < NumStores; ++i) {<br class="">
@@ -12063,7 +12124,6 @@ bool DAGCombiner::MergeStoresOfCons<wbr class="">tants<br class="">
if (Val.getValueType() != MemVT)<br class="">
return false;<br class="">
Ops.push_back(Val);<br class="">
- Chains.push_back(St->getChain(<wbr class="">));<br class="">
}<br class="">
<br class="">
// Build the extracted vector elements back into a vector.<br class="">
@@ -12083,7 +12143,6 @@ bool DAGCombiner::MergeStoresOfCons<wbr class="">tants<br class="">
for (unsigned i = 0; i < NumStores; ++i) {<br class="">
unsigned Idx = IsLE ? (NumStores - 1 - i) : i;<br class="">
StoreSDNode *St = cast<StoreSDNode>(StoreNodes[I<wbr class="">dx].MemNode);<br class="">
- Chains.push_back(St->getChain(<wbr class="">));<br class="">
<br class="">
SDValue Val = St->getValue();<br class="">
StoreInt <<= ElementSizeBytes * 8;<br class="">
@@ -12101,54 +12160,36 @@ bool DAGCombiner::MergeStoresOfCons<wbr class="">tants<br class="">
StoredVal = DAG.getConstant(StoreInt, DL, StoreTy);<br class="">
}<br class="">
<br class="">
- assert(!Chains.empty());<br class="">
+ SmallVector<SDValue, 8> Chains;<br class="">
+<br class="">
+ // Gather all Chains we're inheriting. As generally all chains are<br class="">
+ // equal, do minor check to remove obvious redundancies.<br class="">
+ Chains.push_back(StoreNodes[0]<wbr class="">.MemNode->getChain());<br class="">
+ for (unsigned i = 1; i < NumStores; ++i)<br class="">
+ if (StoreNodes[0].MemNode->getCha<wbr class="">in() != StoreNodes[i].MemNode->getChai<wbr class="">n())<br class="">
+ Chains.push_back(StoreNodes[i]<wbr class="">.MemNode->getChain());<br class="">
<br class="">
+ LSBaseSDNode *FirstInChain = StoreNodes[0].MemNode;<br class="">
SDValue NewChain = DAG.getNode(ISD::TokenFactor, DL, MVT::Other, Chains);<br class="">
SDValue NewStore = DAG.getStore(NewChain, DL, StoredVal,<br class="">
FirstInChain->getBasePtr(),<br class="">
FirstInChain->getPointerInfo(<wbr class="">),<br class="">
FirstInChain->getAlignment())<wbr class="">;<br class="">
<br class="">
- bool UseAA = CombinerAA.getNumOccurrences() > 0 ? CombinerAA<br class="">
- : DAG.getSubtarget().useAA();<br class="">
- if (UseAA) {<br class="">
- // Replace all merged stores with the new store.<br class="">
- for (unsigned i = 0; i < NumStores; ++i)<br class="">
- CombineTo(StoreNodes[i].MemNod<wbr class="">e, NewStore);<br class="">
- } else {<br class="">
- // Replace the last store with the new store.<br class="">
- CombineTo(LatestOp, NewStore);<br class="">
- // Erase all other stores.<br class="">
- for (unsigned i = 0; i < NumStores; ++i) {<br class="">
- if (StoreNodes[i].MemNode == LatestOp)<br class="">
- continue;<br class="">
- StoreSDNode *St = cast<StoreSDNode>(StoreNodes[i<wbr class="">].MemNode);<br class="">
- // ReplaceAllUsesWith will replace all uses that existed when it was<br class="">
- // called, but graph optimizations may cause new ones to appear. For<br class="">
- // example, the case in pr14333 looks like<br class="">
- //<br class="">
- // St's chain -> St -> another store -> X<br class="">
- //<br class="">
- // And the only difference from St to the other store is the chain.<br class="">
- // When we change it's chain to be St's chain they become identical,<br class="">
- // get CSEed and the net result is that X is now a use of St.<br class="">
- // Since we know that St is redundant, just iterate.<br class="">
- while (!St->use_empty())<br class="">
- DAG.ReplaceAllUsesWith(SDValue<wbr class="">(St, 0), St->getChain());<br class="">
- deleteAndRecombine(St);<br class="">
- }<br class="">
- }<br class="">
+ // Replace all merged stores with the new store.<br class="">
+ for (unsigned i = 0; i < NumStores; ++i)<br class="">
+ CombineTo(StoreNodes[i].MemNod<wbr class="">e, NewStore);<br class="">
<br class="">
- StoreNodes.erase(<a href="http://StoreNodes.be" class="">StoreNodes.be</a><wbr class="">gin() + NumStores, StoreNodes.end());<br class="">
+ AddToWorklist(NewChain.getNode<wbr class="">());<br class="">
return true;<br class="">
}<br class="">
<br class="">
-void DAGCombiner::getStoreMergeAndA<wbr class="">liasCandidates(<br class="">
- StoreSDNode* St, SmallVectorImpl<MemOpLink> &StoreNodes,<br class="">
- SmallVectorImpl<LSBaseSDNode*> &AliasLoadNodes) {<br class="">
+void DAGCombiner::getStoreMergeCand<wbr class="">idates(<br class="">
+ StoreSDNode *St, SmallVectorImpl<MemOpLink> &StoreNodes) {<br class="">
// This holds the base pointer, index, and the offset in bytes from the base<br class="">
// pointer.<br class="">
BaseIndexOffset BasePtr = BaseIndexOffset::match(St->get<wbr class="">BasePtr(), DAG);<br class="">
+ EVT MemVT = St->getMemoryVT();<br class="">
<br class="">
// We must have a base and an offset.<br class="">
if (!BasePtr.Base.getNode())<br class="">
@@ -12158,104 +12199,70 @@ void DAGCombiner::getStoreMergeAndA<wbr class="">liasC<br class="">
if (BasePtr.Base.isUndef())<br class="">
return;<br class="">
<br class="">
- // Walk up the chain and look for nodes with offsets from the same<br class="">
- // base pointer. Stop when reaching an instruction with a different kind<br class="">
- // or instruction which has a different base pointer.<br class="">
- EVT MemVT = St->getMemoryVT();<br class="">
- unsigned Seq = 0;<br class="">
- StoreSDNode *Index = St;<br class="">
-<br class="">
-<br class="">
- bool UseAA = CombinerAA.getNumOccurrences() > 0 ? CombinerAA<br class="">
- : DAG.getSubtarget().useAA();<br class="">
-<br class="">
- if (UseAA) {<br class="">
- // Look at other users of the same chain. Stores on the same chain do not<br class="">
- // alias. If combiner-aa is enabled, non-aliasing stores are canonicalized<br class="">
- // to be on the same chain, so don't bother looking at adjacent chains.<br class="">
-<br class="">
- SDValue Chain = St->getChain();<br class="">
- for (auto I = Chain->use_begin(), E = Chain->use_end(); I != E; ++I) {<br class="">
- if (StoreSDNode *OtherST = dyn_cast<StoreSDNode>(*I)) {<br class="">
- if (I.getOperandNo() != 0)<br class="">
- continue;<br class="">
-<br class="">
- if (OtherST->isVolatile() || OtherST->isIndexed())<br class="">
- continue;<br class="">
-<br class="">
- if (OtherST->getMemoryVT() != MemVT)<br class="">
- continue;<br class="">
-<br class="">
- BaseIndexOffset Ptr = BaseIndexOffset::match(OtherST<wbr class="">->getBasePtr(), DAG);<br class="">
-<br class="">
- if (Ptr.equalBaseIndex(BasePtr))<br class="">
- StoreNodes.push_back(MemOpLink<wbr class="">(OtherST, Ptr.Offset, Seq++));<br class="">
- }<br class="">
- }<br class="">
-<br class="">
- return;<br class="">
- }<br class="">
-<br class="">
- while (Index) {<br class="">
- // If the chain has more than one use, then we can't reorder the mem ops.<br class="">
- if (Index != St && !SDValue(Index, 0)->hasOneUse())<br class="">
- break;<br class="">
-<br class="">
- // Find the base pointer and offset for this memory node.<br class="">
- BaseIndexOffset Ptr = BaseIndexOffset::match(Index-><wbr class="">getBasePtr(), DAG);<br class="">
-<br class="">
- // Check that the base pointer is the same as the original one.<br class="">
- if (!Ptr.equalBaseIndex(BasePtr))<br class="">
- break;<br class="">
+ // We looking for a root node which is an ancestor to all mergable<br class="">
+ // stores. We search up through a load, to our root and then down<br class="">
+ // through all children. For instance we will find Store{1,2,3} if<br class="">
+ // St is Store1, Store2. or Store3 where the root is not a load<br class="">
+ // which always true for nonvolatile ops. TODO: Expand<br class="">
+ // the search to find all valid candidates through multiple layers of loads.<br class="">
+ //<br class="">
+ // Root<br class="">
+ // |-------|-------|<br class="">
+ // Load Load Store3<br class="">
+ // | |<br class="">
+ // Store1 Store2<br class="">
+ //<br class="">
+ // FIXME: We should be able to climb and<br class="">
+ // descend TokenFactors to find candidates as well.<br class="">
<br class="">
- // The memory operands must not be volatile.<br class="">
- if (Index->isVolatile() || Index->isIndexed())<br class="">
- break;<br class="">
+ SDNode *RootNode = (St->getChain()).getNode();<br class="">
<br class="">
- // No truncation.<br class="">
- if (Index->isTruncatingStore())<br class="">
- break;<br class="">
+ // Set of Parents of Candidates<br class="">
+ std::set<SDNode *> CandidateParents;<br class="">
<br class="">
- // The stored memory type must be the same.<br class="">
- if (Index->getMemoryVT() != MemVT)<br class="">
- break;<br class="">
-<br class="">
- // We do not allow under-aligned stores in order to prevent<br class="">
- // overriding stores. NOTE: this is a bad hack. Alignment SHOULD<br class="">
- // be irrelevant here; what MATTERS is that we not move memory<br class="">
- // operations that potentially overlap past each-other.<br class="">
- if (Index->getAlignment() < MemVT.getStoreSize())<br class="">
- break;<br class="">
+ if (LoadSDNode *Ldn = dyn_cast<LoadSDNode>(RootNode)<wbr class="">) {<br class="">
+ RootNode = Ldn->getChain().getNode();<br class="">
+ for (auto I = RootNode->use_begin(), E = RootNode->use_end(); I != E; ++I)<br class="">
+ if (I.getOperandNo() == 0 && isa<LoadSDNode>(*I)) // walk down chain<br class="">
+ CandidateParents.insert(*I);<br class="">
+ } else<br class="">
+ CandidateParents.insert(RootNo<wbr class="">de);<br class="">
<br class="">
- // We found a potential memory operand to merge.<br class="">
- StoreNodes.push_back(MemOpLink<wbr class="">(Index, Ptr.Offset, Seq++));<br class="">
+ bool IsLoadSrc = isa<LoadSDNode>(St->getValue()<wbr class="">);<br class="">
+ bool IsConstantSrc = isa<ConstantSDNode>(St->getVal<wbr class="">ue()) ||<br class="">
+ isa<ConstantFPSDNode>(St->get<wbr class="">Value());<br class="">
+ bool IsExtractVecSrc =<br class="">
+ (St->getValue().getOpcode() == ISD::EXTRACT_VECTOR_ELT ||<br class="">
+ St->getValue().getOpcode() == ISD::EXTRACT_SUBVECTOR);<br class="">
+ auto CorrectValueKind = [&](StoreSDNode *Other) -> bool {<br class="">
+ if (IsLoadSrc)<br class="">
+ return isa<LoadSDNode>(Other->getValu<wbr class="">e());<br class="">
+ if (IsConstantSrc)<br class="">
+ return (isa<ConstantSDNode>(Other->ge<wbr class="">tValue()) ||<br class="">
+ isa<ConstantFPSDNode>(Other->g<wbr class="">etValue()));<br class="">
+ if (IsExtractVecSrc)<br class="">
+ return (Other->getValue().getOpcode() == ISD::EXTRACT_VECTOR_ELT ||<br class="">
+ Other->getValue().getOpcode() == ISD::EXTRACT_SUBVECTOR);<br class="">
+ return false;<br class="">
+ };<br class="">
<br class="">
- // Find the next memory operand in the chain. If the next operand in the<br class="">
- // chain is a store then move up and continue the scan with the next<br class="">
- // memory operand. If the next operand is a load save it and use alias<br class="">
- // information to check if it interferes with anything.<br class="">
- SDNode *NextInChain = Index->getChain().getNode();<br class="">
- while (1) {<br class="">
- if (StoreSDNode *STn = dyn_cast<StoreSDNode>(NextInCh<wbr class="">ain)) {<br class="">
- // We found a store node. Use it for the next iteration.<br class="">
- Index = STn;<br class="">
- break;<br class="">
- } else if (LoadSDNode *Ldn = dyn_cast<LoadSDNode>(NextInCha<wbr class="">in)) {<br class="">
- if (Ldn->isVolatile()) {<br class="">
- Index = nullptr;<br class="">
- break;<br class="">
+ // check all parents of mergable children<br class="">
+ for (auto P = CandidateParents.begin(); P != CandidateParents.end(); ++P)<br class="">
+ for (auto I = (*P)->use_begin(), E = (*P)->use_end(); I != E; ++I)<br class="">
+ if (I.getOperandNo() == 0)<br class="">
+ if (StoreSDNode *OtherST = dyn_cast<StoreSDNode>(*I)) {<br class="">
+ if (OtherST->isVolatile() || OtherST->isIndexed())<br class="">
+ continue;<br class="">
+ // We can merge constant floats to equivalent integers<br class="">
+ if (OtherST->getMemoryVT() != MemVT)<br class="">
+ if (!(MemVT.isInteger() && MemVT.bitsEq(OtherST->getMemor<wbr class="">yVT()) &&<br class="">
+ isa<ConstantFPSDNode>(OtherST-<wbr class="">>getValue())))<br class="">
+ continue;<br class="">
+ BaseIndexOffset Ptr =<br class="">
+ BaseIndexOffset::match(OtherST<wbr class="">->getBasePtr(), DAG);<br class="">
+ if (Ptr.equalBaseIndex(BasePtr) && CorrectValueKind(OtherST))<br class="">
+ StoreNodes.push_back(MemOpLink<wbr class="">(OtherST, Ptr.Offset));<br class="">
}<br class="">
-<br class="">
- // Save the load node for later. Continue the scan.<br class="">
- AliasLoadNodes.push_back(Ldn);<br class="">
- NextInChain = Ldn->getChain().getNode();<br class="">
- continue;<br class="">
- } else {<br class="">
- Index = nullptr;<br class="">
- break;<br class="">
- }<br class="">
- }<br class="">
- }<br class="">
}<br class="">
<br class="">
// We need to check that merging these stores does not cause a loop<br class="">
@@ -12282,13 +12289,16 @@ bool DAGCombiner::checkMergeStoreCa<wbr class="">ndida<br class="">
return true;<br class="">
}<br class="">
<br class="">
-bool DAGCombiner::MergeConsecutiveS<wbr class="">tores(<br class="">
- StoreSDNode* St, SmallVectorImpl<MemOpLink> &StoreNodes) {<br class="">
+bool DAGCombiner::MergeConsecutiveS<wbr class="">tores(StoreSDNode *St) {<br class="">
if (OptLevel == CodeGenOpt::None)<br class="">
return false;<br class="">
<br class="">
EVT MemVT = St->getMemoryVT();<br class="">
int64_t ElementSizeBytes = MemVT.getSizeInBits() / 8;<br class="">
+<br class="">
+ if (MemVT.getSizeInBits() * 2 > MaximumLegalStoreInBits)<br class="">
+ return false;<br class="">
+<br class="">
bool NoVectors = DAG.getMachineFunction().getFu<wbr class="">nction()->hasFnAttribute(<br class="">
Attribute::NoImplicitFloat);<br class="">
<br class="">
@@ -12317,145 +12327,136 @@ bool DAGCombiner::MergeConsecutiveS<wbr class="">tores<br class="">
if (MemVT.isVector() && IsLoadSrc)<br class="">
return false;<br class="">
<br class="">
- // Only look at ends of store sequences.<br class="">
- SDValue Chain = SDValue(St, 0);<br class="">
- if (Chain->hasOneUse() && Chain->use_begin()->getOpcode(<wbr class="">) == ISD::STORE)<br class="">
- return false;<br class="">
-<br class="">
- // Save the LoadSDNodes that we find in the chain.<br class="">
- // We need to make sure that these nodes do not interfere with<br class="">
- // any of the store nodes.<br class="">
- SmallVector<LSBaseSDNode*, 8> AliasLoadNodes;<br class="">
-<br class="">
- getStoreMergeAndAliasCandidate<wbr class="">s(St, StoreNodes, AliasLoadNodes);<br class="">
+ SmallVector<MemOpLink, 8> StoreNodes;<br class="">
+ // Find potential store merge candidates by searching through chain sub-DAG<br class="">
+ getStoreMergeCandidates(St, StoreNodes);<br class="">
<br class="">
// Check if there is anything to merge.<br class="">
if (StoreNodes.size() < 2)<br class="">
return false;<br class="">
<br class="">
- // only do dependence check in AA case<br class="">
- bool UseAA = CombinerAA.getNumOccurrences() > 0 ? CombinerAA<br class="">
- : DAG.getSubtarget().useAA();<br class="">
- if (UseAA && !checkMergeStoreCandidatesForD<wbr class="">ependencies(StoreNodes))<br class="">
+ // Check that we can merge these candidates without causing a cycle<br class="">
+ if (!checkMergeStoreCandidatesFor<wbr class="">Dependencies(StoreNodes))<br class="">
return false;<br class="">
<br class="">
// Sort the memory operands according to their distance from the<br class="">
- // base pointer. As a secondary criteria: make sure stores coming<br class="">
- // later in the code come first in the list. This is important for<br class="">
- // the non-UseAA case, because we're merging stores into the FINAL<br class="">
- // store along a chain which potentially contains aliasing stores.<br class="">
- // Thus, if there are multiple stores to the same address, the last<br class="">
- // one can be considered for merging but not the others.<br class="">
+ // base pointer.<br class="">
std::sort(StoreNodes.begin(), StoreNodes.end(),<br class="">
[](MemOpLink LHS, MemOpLink RHS) {<br class="">
- return LHS.OffsetFromBase < RHS.OffsetFromBase ||<br class="">
- (LHS.OffsetFromBase == RHS.OffsetFromBase &&<br class="">
- LHS.SequenceNum < RHS.SequenceNum);<br class="">
- });<br class="">
+ return LHS.OffsetFromBase < RHS.OffsetFromBase;<br class="">
+ });<br class="">
<br class="">
// Scan the memory operations on the chain and find the first non-consecutive<br class="">
// store memory address.<br class="">
- unsigned LastConsecutiveStore = 0;<br class="">
+ unsigned NumConsecutiveStores = 0;<br class="">
int64_t StartAddress = StoreNodes[0].OffsetFromBase;<br class="">
- for (unsigned i = 0, e = StoreNodes.size(); i < e; ++i) {<br class="">
-<br class="">
- // Check that the addresses are consecutive starting from the second<br class="">
- // element in the list of stores.<br class="">
- if (i > 0) {<br class="">
- int64_t CurrAddress = StoreNodes[i].OffsetFromBase;<br class="">
- if (CurrAddress - StartAddress != (ElementSizeBytes * i))<br class="">
- break;<br class="">
- }<br class="">
<br class="">
- // Check if this store interferes with any of the loads that we found.<br class="">
- // If we find a load that alias with this store. Stop the sequence.<br class="">
- if (any_of(AliasLoadNodes, [&](LSBaseSDNode *Ldn) {<br class="">
- return isAlias(Ldn, StoreNodes[i].MemNode);<br class="">
- }))<br class="">
+ // Check that the addresses are consecutive starting from the second<br class="">
+ // element in the list of stores.<br class="">
+ for (unsigned i = 1, e = StoreNodes.size(); i < e; ++i) {<br class="">
+ int64_t CurrAddress = StoreNodes[i].OffsetFromBase;<br class="">
+ if (CurrAddress - StartAddress != (ElementSizeBytes * i))<br class="">
break;<br class="">
-<br class="">
- // Mark this node as useful.<br class="">
- LastConsecutiveStore = i;<br class="">
+ NumConsecutiveStores = i + 1;<br class="">
}<br class="">
<br class="">
+ if (NumConsecutiveStores < 2)<br class="">
+ return false;<br class="">
+<br class="">
// The node with the lowest store address.<br class="">
- LSBaseSDNode *FirstInChain = StoreNodes[0].MemNode;<br class="">
- unsigned FirstStoreAS = FirstInChain->getAddressSpace(<wbr class="">);<br class="">
- unsigned FirstStoreAlign = FirstInChain->getAlignment();<br class="">
LLVMContext &Context = *DAG.getContext();<br class="">
const DataLayout &DL = DAG.getDataLayout();<br class="">
<br class="">
// Store the constants into memory as one consecutive store.<br class="">
if (IsConstantSrc) {<br class="">
- unsigned LastLegalType = 0;<br class="">
- unsigned LastLegalVectorType = 0;<br class="">
- bool NonZero = false;<br class="">
- for (unsigned i=0; i<LastConsecutiveStore+1; ++i) {<br class="">
- StoreSDNode *St = cast<StoreSDNode>(StoreNodes[i<wbr class="">].MemNode);<br class="">
- SDValue StoredVal = St->getValue();<br class="">
-<br class="">
- if (ConstantSDNode *C = dyn_cast<ConstantSDNode>(Store<wbr class="">dVal)) {<br class="">
- NonZero |= !C->isNullValue();<br class="">
- } else if (ConstantFPSDNode *C = dyn_cast<ConstantFPSDNode>(Sto<wbr class="">redVal)) {<br class="">
- NonZero |= !C->getConstantFPValue()->isNu<wbr class="">llValue();<br class="">
- } else {<br class="">
- // Non-constant.<br class="">
- break;<br class="">
- }<br class="">
+ bool RV = false;<br class="">
+ while (NumConsecutiveStores > 1) {<br class="">
+ LSBaseSDNode *FirstInChain = StoreNodes[0].MemNode;<br class="">
+ unsigned FirstStoreAS = FirstInChain->getAddressSpace(<wbr class="">);<br class="">
+ unsigned FirstStoreAlign = FirstInChain->getAlignment();<br class="">
+ unsigned LastLegalType = 0;<br class="">
+ unsigned LastLegalVectorType = 0;<br class="">
+ bool NonZero = false;<br class="">
+ for (unsigned i = 0; i < NumConsecutiveStores; ++i) {<br class="">
+ StoreSDNode *ST = cast<StoreSDNode>(StoreNodes[i<wbr class="">].MemNode);<br class="">
+ SDValue StoredVal = ST->getValue();<br class="">
+<br class="">
+ if (ConstantSDNode *C = dyn_cast<ConstantSDNode>(Store<wbr class="">dVal)) {<br class="">
+ NonZero |= !C->isNullValue();<br class="">
+ } else if (ConstantFPSDNode *C =<br class="">
+ dyn_cast<ConstantFPSDNode>(St<wbr class="">oredVal)) {<br class="">
+ NonZero |= !C->getConstantFPValue()->isNu<wbr class="">llValue();<br class="">
+ } else {<br class="">
+ // Non-constant.<br class="">
+ break;<br class="">
+ }<br class="">
<br class="">
- // Find a legal type for the constant store.<br class="">
- unsigned SizeInBits = (i+1) * ElementSizeBytes * 8;<br class="">
- EVT StoreTy = EVT::getIntegerVT(Context, SizeInBits);<br class="">
- bool IsFast;<br class="">
- if (TLI.isTypeLegal(StoreTy) &&<br class="">
- TLI.allowsMemoryAccess(Context<wbr class="">, DL, StoreTy, FirstStoreAS,<br class="">
- FirstStoreAlign, &IsFast) && IsFast) {<br class="">
- LastLegalType = i+1;<br class="">
- // Or check whether a truncstore is legal.<br class="">
- } else if (TLI.getTypeAction(Context, StoreTy) ==<br class="">
- TargetLowering::TypePromoteIn<wbr class="">teger) {<br class="">
- EVT LegalizedStoredValueTy =<br class="">
- TLI.getTypeToTransformTo(Conte<wbr class="">xt, StoredVal.getValueType());<br class="">
- if (TLI.isTruncStoreLegal(Legaliz<wbr class="">edStoredValueTy, StoreTy) &&<br class="">
- TLI.allowsMemoryAccess(Context<wbr class="">, DL, LegalizedStoredValueTy,<br class="">
- FirstStoreAS, FirstStoreAlign, &IsFast) &&<br class="">
+ // Find a legal type for the constant store.<br class="">
+ unsigned SizeInBits = (i + 1) * ElementSizeBytes * 8;<br class="">
+ EVT StoreTy = EVT::getIntegerVT(Context, SizeInBits);<br class="">
+ bool IsFast = false;<br class="">
+ if (TLI.isTypeLegal(StoreTy) &&<br class="">
+ TLI.allowsMemoryAccess(Context<wbr class="">, DL, StoreTy, FirstStoreAS,<br class="">
+ FirstStoreAlign, &IsFast) &&<br class="">
IsFast) {<br class="">
LastLegalType = i + 1;<br class="">
+ // Or check whether a truncstore is legal.<br class="">
+ } else if (TLI.getTypeAction(Context, StoreTy) ==<br class="">
+ TargetLowering::TypePromoteIn<wbr class="">teger) {<br class="">
+ EVT LegalizedStoredValueTy =<br class="">
+ TLI.getTypeToTransformTo(Conte<wbr class="">xt, StoredVal.getValueType());<br class="">
+ if (TLI.isTruncStoreLegal(Legaliz<wbr class="">edStoredValueTy, StoreTy) &&<br class="">
+ TLI.allowsMemoryAccess(Context<wbr class="">, DL, LegalizedStoredValueTy,<br class="">
+ FirstStoreAS, FirstStoreAlign, &IsFast) &&<br class="">
+ IsFast) {<br class="">
+ LastLegalType = i + 1;<br class="">
+ }<br class="">
}<br class="">
- }<br class="">
<br class="">
- // We only use vectors if the constant is known to be zero or the target<br class="">
- // allows it and the function is not marked with the noimplicitfloat<br class="">
- // attribute.<br class="">
- if ((!NonZero || TLI.storeOfVectorConstantIsChe<wbr class="">ap(MemVT, i+1,<br class="">
- FirstStoreAS)) &&<br class="">
- !NoVectors) {<br class="">
- // Find a legal type for the vector store.<br class="">
- EVT Ty = EVT::getVectorVT(Context, MemVT, i+1);<br class="">
- if (TLI.isTypeLegal(Ty) &&<br class="">
- TLI.allowsMemoryAccess(Context<wbr class="">, DL, Ty, FirstStoreAS,<br class="">
- FirstStoreAlign, &IsFast) && IsFast)<br class="">
- LastLegalVectorType = i + 1;<br class="">
+ // We only use vectors if the constant is known to be zero or the target<br class="">
+ // allows it and the function is not marked with the noimplicitfloat<br class="">
+ // attribute.<br class="">
+ if ((!NonZero ||<br class="">
+ TLI.storeOfVectorConstantIsCh<wbr class="">eap(MemVT, i + 1, FirstStoreAS)) &&<br class="">
+ !NoVectors) {<br class="">
+ // Find a legal type for the vector store.<br class="">
+ EVT Ty = EVT::getVectorVT(Context, MemVT, i + 1);<br class="">
+ if (TLI.isTypeLegal(Ty) && TLI.canMergeStoresTo(Ty) &&<br class="">
+ TLI.allowsMemoryAccess(Context<wbr class="">, DL, Ty, FirstStoreAS,<br class="">
+ FirstStoreAlign, &IsFast) &&<br class="">
+ IsFast)<br class="">
+ LastLegalVectorType = i + 1;<br class="">
+ }<br class="">
}<br class="">
- }<br class="">
<br class="">
- // Check if we found a legal integer type to store.<br class="">
- if (LastLegalType == 0 && LastLegalVectorType == 0)<br class="">
- return false;<br class="">
+ // Check if we found a legal integer type that creates a meaningful merge.<br class="">
+ if (LastLegalType < 2 && LastLegalVectorType < 2)<br class="">
+ break;<br class="">
<br class="">
- bool UseVector = (LastLegalVectorType > LastLegalType) && !NoVectors;<br class="">
- unsigned NumElem = UseVector ? LastLegalVectorType : LastLegalType;<br class="">
+ bool UseVector = (LastLegalVectorType > LastLegalType) && !NoVectors;<br class="">
+ unsigned NumElem = (UseVector) ? LastLegalVectorType : LastLegalType;<br class="">
<br class="">
- return MergeStoresOfConstantsOrVecElt<wbr class="">s(StoreNodes, MemVT, NumElem,<br class="">
- true, UseVector);<br class="">
+ bool Merged = MergeStoresOfConstantsOrVecElt<wbr class="">s(StoreNodes, MemVT, NumElem,<br class="">
+ true, UseVector);<br class="">
+ if (!Merged)<br class="">
+ break;<br class="">
+ // Remove merged stores for next iteration.<br class="">
+ StoreNodes.erase(<a href="http://StoreNodes.be" class="">StoreNodes.be</a><wbr class="">gin(), StoreNodes.begin() + NumElem);<br class="">
+ RV = true;<br class="">
+ NumConsecutiveStores -= NumElem;<br class="">
+ }<br class="">
+ return RV;<br class="">
}<br class="">
<br class="">
// When extracting multiple vector elements, try to store them<br class="">
// in one vector store rather than a sequence of scalar stores.<br class="">
if (IsExtractVecSrc) {<br class="">
+ LSBaseSDNode *FirstInChain = StoreNodes[0].MemNode;<br class="">
+ unsigned FirstStoreAS = FirstInChain->getAddressSpace(<wbr class="">);<br class="">
+ unsigned FirstStoreAlign = FirstInChain->getAlignment();<br class="">
unsigned NumStoresToMerge = 0;<br class="">
bool IsVec = MemVT.isVector();<br class="">
- for (unsigned i = 0; i < LastConsecutiveStore + 1; ++i) {<br class="">
+ for (unsigned i = 0; i < NumConsecutiveStores; ++i) {<br class="">
StoreSDNode *St = cast<StoreSDNode>(StoreNodes[i<wbr class="">].MemNode);<br class="">
unsigned StoreValOpcode = St->getValue().getOpcode();<br class="">
// This restriction could be loosened.<br class="">
@@ -12495,7 +12496,7 @@ bool DAGCombiner::MergeConsecutiveS<wbr class="">tores<br class="">
// Find acceptable loads. Loads need to have the same chain (token factor),<br class="">
// must not be zext, volatile, indexed, and they must be consecutive.<br class="">
BaseIndexOffset LdBasePtr;<br class="">
- for (unsigned i=0; i<LastConsecutiveStore+1; ++i) {<br class="">
+ for (unsigned i = 0; i < NumConsecutiveStores; ++i) {<br class="">
StoreSDNode *St = cast<StoreSDNode>(StoreNodes[i<wbr class="">].MemNode);<br class="">
LoadSDNode *Ld = dyn_cast<LoadSDNode>(St->getVa<wbr class="">lue());<br class="">
if (!Ld) break;<br class="">
@@ -12528,7 +12529,7 @@ bool DAGCombiner::MergeConsecutiveS<wbr class="">tores<br class="">
}<br class="">
<br class="">
// We found a potential memory operand to merge.<br class="">
- LoadNodes.push_back(MemOpLink(<wbr class="">Ld, LdPtr.Offset, 0));<br class="">
+ LoadNodes.push_back(MemOpLink(<wbr class="">Ld, LdPtr.Offset));<br class="">
}<br class="">
<br class="">
if (LoadNodes.size() < 2)<br class="">
@@ -12540,7 +12541,9 @@ bool DAGCombiner::MergeConsecutiveS<wbr class="">tores<br class="">
if (LoadNodes.size() == 2 && TLI.hasPairedLoad(MemVT, RequiredAlignment) &&<br class="">
St->getAlignment() >= RequiredAlignment)<br class="">
return false;<br class="">
-<br class="">
+ LSBaseSDNode *FirstInChain = StoreNodes[0].MemNode;<br class="">
+ unsigned FirstStoreAS = FirstInChain->getAddressSpace(<wbr class="">);<br class="">
+ unsigned FirstStoreAlign = FirstInChain->getAlignment();<br class="">
LoadSDNode *FirstLoad = cast<LoadSDNode>(LoadNodes[0].<wbr class="">MemNode);<br class="">
unsigned FirstLoadAS = FirstLoad->getAddressSpace();<br class="">
unsigned FirstLoadAlign = FirstLoad->getAlignment();<br class="">
@@ -12609,30 +12612,19 @@ bool DAGCombiner::MergeConsecutiveS<wbr class="">tores<br class="">
<br class="">
// We add +1 here because the LastXXX variables refer to location while<br class="">
// the NumElem refers to array/index size.<br class="">
- unsigned NumElem = std::min(LastConsecutiveStore, LastConsecutiveLoad) + 1;<br class="">
+ unsigned NumElem = std::min(NumConsecutiveStores, LastConsecutiveLoad + 1);<br class="">
NumElem = std::min(LastLegalType, NumElem);<br class="">
<br class="">
if (NumElem < 2)<br class="">
return false;<br class="">
<br class="">
- // Collect the chains from all merged stores.<br class="">
+ // Collect the chains from all merged stores. Because the common case<br class="">
+ // all chains are the same, check if we match the first Chain.<br class="">
SmallVector<SDValue, 8> MergeStoreChains;<br class="">
MergeStoreChains.push_back(St<wbr class="">oreNodes[0].MemNode->getChain(<wbr class="">));<br class="">
-<br class="">
- // The latest Node in the DAG.<br class="">
- unsigned LatestNodeUsed = 0;<br class="">
- for (unsigned i=1; i<NumElem; ++i) {<br class="">
- // Find a chain for the new wide-store operand. Notice that some<br class="">
- // of the store nodes that we found may not be selected for inclusion<br class="">
- // in the wide store. The chain we use needs to be the chain of the<br class="">
- // latest store node which is *used* and replaced by the wide store.<br class="">
- if (StoreNodes[i].SequenceNum < StoreNodes[LatestNodeUsed].Seq<wbr class="">uenceNum)<br class="">
- LatestNodeUsed = i;<br class="">
-<br class="">
- MergeStoreChains.push_back(Sto<wbr class="">reNodes[i].MemNode->getChain()<wbr class="">);<br class="">
- }<br class="">
-<br class="">
- LSBaseSDNode *LatestOp = StoreNodes[LatestNodeUsed].Mem<wbr class="">Node;<br class="">
+ for (unsigned i = 1; i < NumElem; ++i)<br class="">
+ if (StoreNodes[0].MemNode->getCha<wbr class="">in() != StoreNodes[i].MemNode->getChai<wbr class="">n())<br class="">
+ MergeStoreChains.push_back(Sto<wbr class="">reNodes[i].MemNode->getChain()<wbr class="">);<br class="">
<br class="">
// Find if it is better to use vectors or integers to load and store<br class="">
// to memory.<br class="">
@@ -12656,6 +12648,8 @@ bool DAGCombiner::MergeConsecutiveS<wbr class="">tores<br class="">
SDValue NewStoreChain =<br class="">
DAG.getNode(ISD::TokenFactor, StoreDL, MVT::Other, MergeStoreChains);<br class="">
<br class="">
+ AddToWorklist(NewStoreChain.ge<wbr class="">tNode());<br class="">
+<br class="">
SDValue NewStore =<br class="">
DAG.getStore(NewStoreChain, StoreDL, NewLoad, FirstInChain->getBasePtr(),<br class="">
FirstInChain->getPointerInfo()<wbr class="">, FirstStoreAlign);<br class="">
@@ -12667,25 +12661,9 @@ bool DAGCombiner::MergeConsecutiveS<wbr class="">tores<br class="">
SDValue(NewLoad.getNode(), 1));<br class="">
}<br class="">
<br class="">
- if (UseAA) {<br class="">
- // Replace the all stores with the new store.<br class="">
- for (unsigned i = 0; i < NumElem; ++i)<br class="">
- CombineTo(StoreNodes[i].MemNod<wbr class="">e, NewStore);<br class="">
- } else {<br class="">
- // Replace the last store with the new store.<br class="">
- CombineTo(LatestOp, NewStore);<br class="">
- // Erase all other stores.<br class="">
- for (unsigned i = 0; i < NumElem; ++i) {<br class="">
- // Remove all Store nodes.<br class="">
- if (StoreNodes[i].MemNode == LatestOp)<br class="">
- continue;<br class="">
- StoreSDNode *St = cast<StoreSDNode>(StoreNodes[i<wbr class="">].MemNode);<br class="">
- DAG.ReplaceAllUsesOfValueWith(<wbr class="">SDValue(St, 0), St->getChain());<br class="">
- deleteAndRecombine(St);<br class="">
- }<br class="">
- }<br class="">
-<br class="">
- StoreNodes.erase(<a href="http://StoreNodes.be" class="">StoreNodes.be</a><wbr class="">gin() + NumElem, StoreNodes.end());<br class="">
+ // Replace the all stores with the new store.<br class="">
+ for (unsigned i = 0; i < NumElem; ++i)<br class="">
+ CombineTo(StoreNodes[i].MemNod<wbr class="">e, NewStore);<br class="">
return true;<br class="">
}<br class="">
<br class="">
@@ -12842,19 +12820,7 @@ SDValue DAGCombiner::visitSTORE(SDNode *<br class="">
if (SDValue NewST = TransformFPLoadStorePair(N))<br class="">
return NewST;<br class="">
<br class="">
- bool UseAA = CombinerAA.getNumOccurrences() > 0 ? CombinerAA<br class="">
- : DAG.getSubtarget().useAA();<br class="">
-#ifndef NDEBUG<br class="">
- if (CombinerAAOnlyFunc.getNumOccu<wbr class="">rrences() &&<br class="">
- CombinerAAOnlyFunc != DAG.getMachineFunction().getNa<wbr class="">me())<br class="">
- UseAA = false;<br class="">
-#endif<br class="">
- if (UseAA && ST->isUnindexed()) {<br class="">
- // FIXME: We should do this even without AA enabled. AA will just allow<br class="">
- // FindBetterChain to work in more situations. The problem with this is that<br class="">
- // any combine that expects memory operations to be on consecutive chains<br class="">
- // first needs to be updated to look for users of the same chain.<br class="">
-<br class="">
+ if (ST->isUnindexed()) {<br class="">
// Walk up chain skipping non-aliasing memory nodes, on this store and any<br class="">
// adjacent stores.<br class="">
if (findBetterNeighborChains(ST)) {<br class="">
@@ -12888,8 +12854,15 @@ SDValue DAGCombiner::visitSTORE(SDNode *<br class="">
if (SimplifyDemandedBits(<br class="">
Value,<br class="">
APInt::getLowBitsSet(Value.ge<wbr class="">tScalarValueSizeInBits(),<br class="">
- ST->getMemoryVT().getScalarSi<wbr class="">zeInBits())))<br class="">
+ ST->getMemoryVT().getScalarSi<wbr class="">zeInBits()))) {<br class="">
+ // Re-visit the store if anything changed and the store hasn't been merged<br class="">
+ // with another node (N is deleted) SimplifyDemandedBits will add Value's<br class="">
+ // node back to the worklist if necessary, but we also need to re-visit<br class="">
+ // the Store node itself.<br class="">
+ if (N->getOpcode() != ISD::DELETED_NODE)<br class="">
+ AddToWorklist(N);<br class="">
return SDValue(N, 0);<br class="">
+ }<br class="">
}<br class="">
<br class="">
// If this is a load followed by a store to the same location, then the store<br class="">
@@ -12933,15 +12906,12 @@ SDValue DAGCombiner::visitSTORE(SDNode *<br class="">
// There can be multiple store sequences on the same chain.<br class="">
// Keep trying to merge store sequences until we are unable to do so<br class="">
// or until we merge the last store on the chain.<br class="">
- SmallVector<MemOpLink, 8> StoreNodes;<br class="">
- bool Changed = MergeConsecutiveStores(ST, StoreNodes);<br class="">
+ bool Changed = MergeConsecutiveStores(ST);<br class="">
if (!Changed) break;<br class="">
-<br class="">
- if (any_of(StoreNodes,<br class="">
- [ST](const MemOpLink &Link) { return Link.MemNode == ST; })) {<br class="">
- // ST has been merged and no longer exists.<br class="">
+ // Return N as merge only uses CombineTo and no worklist clean<br class="">
+ // up is necessary.<br class="">
+ if (N->getOpcode() == ISD::DELETED_NODE || !isa<StoreSDNode>(N))<br class="">
return SDValue(N, 0);<br class="">
- }<br class="">
}<br class="">
}<br class="">
<br class="">
@@ -12950,7 +12920,7 @@ SDValue DAGCombiner::visitSTORE(SDNode *<br class="">
// Make sure to do this only after attempting to merge stores in order to<br class="">
// avoid changing the types of some subset of stores due to visit order,<br class="">
// preventing their merging.<br class="">
- if (isa<ConstantFPSDNode>(Value)) {<br class="">
+ if (isa<ConstantFPSDNode>(ST->get<wbr class="">Value())) {<br class="">
if (SDValue NewSt = replaceStoreOfFPConstant(ST))<br class="">
return NewSt;<br class="">
}<br class="">
@@ -13887,6 +13857,35 @@ SDValue DAGCombiner::visitBUILD_VECTOR<wbr class="">(S<br class="">
if (ISD::allOperandsUndef(N))<br class="">
return DAG.getUNDEF(VT);<br class="">
<br class="">
+ // Check if we can express BUILD VECTOR via subvector extract.<br class="">
+ if (!LegalTypes && (N->getNumOperands() > 1)) {<br class="">
+ SDValue Op0 = N->getOperand(0);<br class="">
+ auto checkElem = [&](SDValue Op) -> uint64_t {<br class="">
+ if ((Op.getOpcode() == ISD::EXTRACT_VECTOR_ELT) &&<br class="">
+ (Op0.getOperand(0) == Op.getOperand(0)))<br class="">
+ if (auto CNode = dyn_cast<ConstantSDNode>(Op.ge<wbr class="">tOperand(1)))<br class="">
+ return CNode->getZExtValue();<br class="">
+ return -1;<br class="">
+ };<br class="">
+<br class="">
+ int Offset = checkElem(Op0);<br class="">
+ for (unsigned i = 0; i < N->getNumOperands(); ++i) {<br class="">
+ if (Offset + i != checkElem(N->getOperand(i))) {<br class="">
+ Offset = -1;<br class="">
+ break;<br class="">
+ }<br class="">
+ }<br class="">
+<br class="">
+ if ((Offset == 0) &&<br class="">
+ (Op0.getOperand(0).getValueTyp<wbr class="">e() == N->getValueType(0)))<br class="">
+ return Op0.getOperand(0);<br class="">
+ if ((Offset != -1) &&<br class="">
+ ((Offset % N->getValueType(0).getVectorNu<wbr class="">mElements()) ==<br class="">
+ 0)) // IDX must be multiple of output size.<br class="">
+ return DAG.getNode(ISD::EXTRACT_SUBVE<wbr class="">CTOR, SDLoc(N), N->getValueType(0),<br class="">
+ Op0.getOperand(0), Op0.getOperand(1));<br class="">
+ }<br class="">
+<br class="">
if (SDValue V = reduceBuildVecExtToExtBuildVec<wbr class="">(N))<br class="">
return V;<br class="">
<br class="">
@@ -15983,7 +15982,7 @@ static bool FindBaseOffset(SDValue Ptr,<br class="">
if (Base.getOpcode() == ISD::ADD) {<br class="">
if (ConstantSDNode *C = dyn_cast<ConstantSDNode>(Base.<wbr class="">getOperand(1))) {<br class="">
Base = Base.getOperand(0);<br class="">
- Offset += C->getZExtValue();<br class="">
+ Offset += C->getSExtValue();<br class="">
}<br class="">
}<br class="">
<br class="">
@@ -16180,6 +16179,12 @@ void DAGCombiner::GatherAllAliases(<wbr class="">SDNod<br class="">
++Depth;<br class="">
break;<br class="">
<br class="">
+ case ISD::CopyFromReg:<br class="">
+ // Forward past CopyFromReg.<br class="">
+ Chains.push_back(Chain.getOper<wbr class="">and(0));<br class="">
+ ++Depth;<br class="">
+ break;<br class="">
+<br class="">
default:<br class="">
// For all other instructions we will just have to take what we can get.<br class="">
Aliases.push_back(Chain);<br class="">
@@ -16208,6 +16213,18 @@ SDValue DAGCombiner::FindBetterChain(S<wbr class="">DN<br class="">
return DAG.getNode(ISD::TokenFactor, SDLoc(N), MVT::Other, Aliases);<br class="">
}<br class="">
<br class="">
+// This function tries to collect a bunch of potentially interesting<br class="">
+// nodes to improve the chains of, all at once. This might seem<br class="">
+// redundant, as this function gets called when visiting every store<br class="">
+// node, so why not let the work be done on each store as it's visited?<br class="">
+//<br class="">
+// I believe this is mainly important because MergeConsecutiveStores<br class="">
+// is unable to deal with merging stores of different sizes, so unless<br class="">
+// we improve the chains of all the potential candidates up-front<br class="">
+// before running MergeConsecutiveStores, it might only see some of<br class="">
+// the nodes that will eventually be candidates, and then not be able<br class="">
+// to go from a partially-merged state to the desired final<br class="">
+// fully-merged state.<br class="">
bool DAGCombiner::findBetterNeighbo<wbr class="">rChains(StoreSDNode *St) {<br class="">
// This holds the base pointer, index, and the offset in bytes from the base<br class="">
// pointer.<br class="">
@@ -16243,10 +16260,8 @@ bool DAGCombiner::findBetterNeighbo<wbr class="">rChai<br class="">
if (!Ptr.equalBaseIndex(BasePtr))<br class="">
break;<br class="">
<br class="">
- // Find the next memory operand in the chain. If the next operand in the<br class="">
- // chain is a store then move up and continue the scan with the next<br class="">
- // memory operand. If the next operand is a load save it and use alias<br class="">
- // information to check if it interferes with anything.<br class="">
+ // Walk up the chain to find the next store node, ignoring any<br class="">
+ // intermediate loads. Any other kind of node will halt the loop.<br class="">
SDNode *NextInChain = Index->getChain().getNode();<br class="">
while (true) {<br class="">
if (StoreSDNode *STn = dyn_cast<StoreSDNode>(NextInCh<wbr class="">ain)) {<br class="">
@@ -16265,9 +16280,14 @@ bool DAGCombiner::findBetterNeighbo<wbr class="">rChai<br class="">
Index = nullptr;<br class="">
break;<br class="">
}<br class="">
- }<br class="">
+ } // end while<br class="">
}<br class="">
<br class="">
+ // At this point, ChainedStores lists all of the Store nodes<br class="">
+ // reachable by iterating up through chain nodes matching the above<br class="">
+ // conditions. For each such store identified, try to find an<br class="">
+ // earlier chain to attach the store to which won't violate the<br class="">
+ // required ordering.<br class="">
bool MadeChangeToSt = false;<br class="">
SmallVector<std::pair<StoreSD<wbr class="">Node *, SDValue>, 8> BetterChains;<br class="">
<br class="">
<br class="">
Modified: llvm/trunk/lib/CodeGen/TargetL<wbr class="">oweringBase.cpp<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/lib/CodeGen/TargetLoweringBase.cpp?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/lib/CodeGen/<wbr class="">TargetLoweringBase.cpp?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/lib/CodeGen/TargetL<wbr class="">oweringBase.cpp (original)<br class="">
+++ llvm/trunk/lib/CodeGen/TargetL<wbr class="">oweringBase.cpp Mon Mar 13 19:34:14 2017<br class="">
@@ -850,7 +850,7 @@ TargetLoweringBase::TargetLowe<wbr class="">ringBase(c<br class="">
MinFunctionAlignment = 0;<br class="">
PrefFunctionAlignment = 0;<br class="">
PrefLoopAlignment = 0;<br class="">
- GatherAllAliasesMaxDepth = 6;<br class="">
+ GatherAllAliasesMaxDepth = 18;<br class="">
MinStackArgumentAlignment = 1;<br class="">
// TODO: the default will be switched to 0 in the next commit, along<br class="">
// with the Target-specific changes necessary.<br class="">
<br class="">
Modified: llvm/trunk/lib/Target/AArch64/<wbr class="">AArch64ISelLowering.cpp<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/lib/Target/AArch64/AArch64ISelLowering.cpp?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/lib/Target/AA<wbr class="">rch64/AArch64ISelLowering.cpp?<wbr class="">rev=297695&r1=297694&r2=297695<wbr class="">&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/lib/Target/AArch64/<wbr class="">AArch64ISelLowering.cpp (original)<br class="">
+++ llvm/trunk/lib/Target/AArch64/<wbr class="">AArch64ISelLowering.cpp Mon Mar 13 19:34:14 2017<br class="">
@@ -9338,7 +9338,7 @@ static SDValue performSTORECombine(SDNod<br class="">
return SDValue();<br class="">
}<br class="">
<br class="">
- /// This function handles the log2-shuffle pattern produced by the<br class="">
+/// This function handles the log2-shuffle pattern produced by the<br class="">
/// LoopVectorizer for the across vector reduction. It consists of<br class="">
/// log2(NumVectorElements) steps and, in each step, 2^(s) elements<br class="">
/// are reduced, where s is an induction variable from 0 to<br class="">
<br class="">
Modified: llvm/trunk/lib/Target/ARM/ARMI<wbr class="">SelLowering.h<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/lib/Target/ARM/ARMISelLowering.h?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/lib/Target/AR<wbr class="">M/ARMISelLowering.h?rev=297695<wbr class="">&r1=297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/lib/Target/ARM/ARMI<wbr class="">SelLowering.h (original)<br class="">
+++ llvm/trunk/lib/Target/ARM/ARMI<wbr class="">SelLowering.h Mon Mar 13 19:34:14 2017<br class="">
@@ -500,6 +500,11 @@ class InstrItineraryData;<br class="">
bool canCombineStoreAndExtract(Type *VectorTy, Value *Idx,<br class="">
unsigned &Cost) const override;<br class="">
<br class="">
+ bool canMergeStoresTo(EVT MemVT) const override {<br class="">
+ // Do not merge to larger than i32.<br class="">
+ return (MemVT.getSizeInBits() <= 32);<br class="">
+ }<br class="">
+<br class="">
bool isCheapToSpeculateCttz() const override;<br class="">
bool isCheapToSpeculateCtlz() const override;<br class="">
<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AArch6<wbr class="">4/argument-blocks.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AArch64/argument-blocks.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AArch64/argument-blocks.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AArch6<wbr class="">4/argument-blocks.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AArch6<wbr class="">4/argument-blocks.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -59,10 +59,10 @@ define i64 @test_hfa_ignores_gprs([7 x f<br class="">
}<br class="">
<br class="">
; [2 x float] should not be promoted to double by the Darwin varargs handling,<br class="">
-; but should go in an 8-byte aligned slot.<br class="">
+; but should go in an 8-byte aligned slot and can be merged as integer stores.<br class="">
define void @test_varargs_stackalign() {<br class="">
; CHECK-LABEL: test_varargs_stackalign:<br class="">
-; CHECK-DARWINPCS: stp {{w[0-9]+}}, {{w[0-9]+}}, [sp, #16]<br class="">
+; CHECK-DARWINPCS: str {{x[0-9]+}}, [sp, #16]<br class="">
<br class="">
call void(...) @callee([3 x float] undef, [2 x float] [float 1.0, float 2.0])<br class="">
ret void<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-abi.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AArch64/arm64-abi.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AArch64/arm64-abi.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-abi.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-abi.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -205,10 +205,7 @@ declare i32 @args_i32(i32, i32, i32, i32<br class="">
define i32 @test8(i32 %argc, i8** nocapture %argv) nounwind {<br class="">
entry:<br class="">
; CHECK-LABEL: test8<br class="">
-; CHECK: strb {{w[0-9]+}}, [sp, #3]<br class="">
-; CHECK: strb wzr, [sp, #2]<br class="">
-; CHECK: strb {{w[0-9]+}}, [sp, #1]<br class="">
-; CHECK: strb wzr, [sp]<br class="">
+; CHECK: str w8, [sp]<br class="">
; CHECK: bl<br class="">
; FAST-LABEL: test8<br class="">
; FAST: strb {{w[0-9]+}}, [sp]<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-memset-inline.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AArch64/arm64-memset-inline.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AArch64/arm64-memset-inline.<wbr class="">ll?rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-memset-inline.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-memset-inline.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -13,8 +13,8 @@ define void @t2() nounwind ssp {<br class="">
entry:<br class="">
; CHECK-LABEL: t2:<br class="">
; CHECK: strh wzr, [sp, #32]<br class="">
-; CHECK: stp xzr, xzr, [sp, #16]<br class="">
-; CHECK: str xzr, [sp, #8]<br class="">
+; CHECK: stp xzr, xzr, [sp, #8]<br class="">
+; CHECK: str xzr, [sp, #24]<br class="">
%buf = alloca [26 x i8], align 1<br class="">
%0 = getelementptr inbounds [26 x i8], [26 x i8]* %buf, i32 0, i32 0<br class="">
call void @llvm.memset.p0i8.i32(i8* %0, i8 0, i32 26, i32 1, i1 false)<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-variadic-aapcs.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AArch64/arm64-variadic-aapcs.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AArch64/arm64-variadic-aapcs.<wbr class="">ll?rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-variadic-aapcs.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AArch6<wbr class="">4/arm64-variadic-aapcs.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -99,7 +99,7 @@ define void @test_nospare([8 x i64], [8<br class="">
; __stack field should point just past them.<br class="">
define void @test_offsetstack([8 x i64], [2 x i64], [3 x float], ...) {<br class="">
; CHECK-LABEL: test_offsetstack:<br class="">
-; CHECK: sub sp, sp, #80<br class="">
+; CHECK: stp {{q[0-9]+}}, {{q[0-9]+}}, [sp, #-80]!<br class="">
; CHECK: add [[STACK_TOP:x[0-9]+]], sp, #96<br class="">
; CHECK: add x[[VAR:[0-9]+]], {{x[0-9]+}}, :lo12:var<br class="">
; CHECK: str [[STACK_TOP]], [x[[VAR]]]<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AArch6<wbr class="">4/merge-store.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AArch64/merge-store.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AArch64/merge-store.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AArch6<wbr class="">4/merge-store.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AArch6<wbr class="">4/merge-store.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -4,8 +4,7 @@<br class="">
@g0 = external global <3 x float>, align 16<br class="">
@g1 = external global <3 x float>, align 4<br class="">
<br class="">
-; CHECK: ldr s[[R0:[0-9]+]], {{\[}}[[R1:x[0-9]+]]{{\]}}, #4<br class="">
-; CHECK: ld1{{\.?s?}} { v[[R0]]{{\.?s?}} }[1], {{\[}}[[R1]]{{\]}}<br class="">
+; CHECK: ldr q[[R0:[0-9]+]], {{\[}}[[R1:x[0-9]+]], :lo12:g0<br class="">
; CHECK: str d[[R0]]<br class="">
<br class="">
define void @blam() {<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AArch6<wbr class="">4/vector_merge_dep_check.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AArch64/vector_merge_dep_check.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AArch64/vector_merge_dep_<wbr class="">check.ll?rev=297695&r1=297694&<wbr class="">r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AArch6<wbr class="">4/vector_merge_dep_check.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AArch6<wbr class="">4/vector_merge_dep_check.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,5 +1,4 @@<br class="">
-; RUN: llc --combiner-alias-analysis=fals<wbr class="">e < %s | FileCheck %s<br class="">
-; RUN: llc --combiner-alias-analysis=<wbr class="">true < %s | FileCheck %s<br class="">
+; RUN: llc < %s | FileCheck %s<br class="">
<br class="">
; This test checks that we do not merge stores together which have<br class="">
; dependencies through their non-chain operands (e.g. one store is the<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/debugger-insert-nops.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AMDGPU/debugger-insert-nops.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AMDGPU/debugger-insert-nops.<wbr class="">ll?rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/debugger-insert-nops.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/debugger-insert-nops.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,13 +1,21 @@<br class="">
-; RUN: llc -O0 -mtriple=amdgcn--amdhsa -mcpu=fiji -mattr=+amdgpu-debugger-insert<wbr class="">-nops -verify-machineinstrs < %s | FileCheck %s<br class="">
+; RUN: llc -O0 -mtriple=amdgcn--amdhsa -mcpu=fiji -mattr=+amdgpu-debugger-insert<wbr class="">-nops -verify-machineinstrs < %s | FileCheck %s --check-prefix=CHECK<br class="">
+; RUN: llc -O0 -mtriple=amdgcn--amdhsa -mcpu=fiji -mattr=+amdgpu-debugger-insert<wbr class="">-nops -verify-machineinstrs < %s | FileCheck %s --check-prefix=CHECKNOP<br class="">
<br class="">
-; CHECK: test01.cl:2:{{[0-9]+}}<br class="">
-; CHECK-NEXT: s_nop 0<br class="">
+; This test expects that we have one instance for each line in some order with "s_nop 0" instances after each.<br class="">
<br class="">
-; CHECK: test01.cl:3:{{[0-9]+}}<br class="">
-; CHECK-NEXT: s_nop 0<br class="">
+; Check that each line appears at least once<br class="">
+; CHECK-DAG: test01.cl:2:3<br class="">
+; CHECK-DAG: test01.cl:3:3<br class="">
+; CHECK-DAG: test01.cl:4:3<br class="">
<br class="">
-; CHECK: test01.cl:4:{{[0-9]+}}<br class="">
-; CHECK-NEXT: s_nop 0<br class="">
+<br class="">
+; Check that each of each of the lines consists of the line output, followed by "s_nop 0"<br class="">
+; CHECKNOP: test01.cl:{{[234]}}:3<br class="">
+; CHECKNOP-NEXT: s_nop 0<br class="">
+; CHECKNOP: test01.cl:{{[234]}}:3<br class="">
+; CHECKNOP-NEXT: s_nop 0<br class="">
+; CHECKNOP: test01.cl:{{[234]}}:3<br class="">
+; CHECKNOP-NEXT: s_nop 0<br class="">
<br class="">
; CHECK: test01.cl:5:{{[0-9]+}}<br class="">
; CHECK-NEXT: s_nop 0<br class="">
@@ -21,7 +29,7 @@ entry:<br class="">
call void @llvm.dbg.declare(metadata i32 addrspace(1)** %A.addr, metadata !17, metadata !18), !dbg !19<br class="">
%0 = load i32 addrspace(1)*, i32 addrspace(1)** %A.addr, align 4, !dbg !20<br class="">
%arrayidx = getelementptr inbounds i32, i32 addrspace(1)* %0, i32 0, !dbg !20<br class="">
- store i32 1, i32 addrspace(1)* %arrayidx, align 4, !dbg !21<br class="">
+ store i32 1, i32 addrspace(1)* %arrayidx, align 4, !dbg !20<br class="">
%1 = load i32 addrspace(1)*, i32 addrspace(1)** %A.addr, align 4, !dbg !22<br class="">
%arrayidx1 = getelementptr inbounds i32, i32 addrspace(1)* %1, i32 1, !dbg !22<br class="">
store i32 2, i32 addrspace(1)* %arrayidx1, align 4, !dbg !23<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/insert_vector_elt.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AMDGPU/insert_vector_elt.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AMDGPU/insert_vector_elt.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/insert_vector_elt.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/insert_vector_elt.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -253,11 +253,9 @@ define void @dynamic_insertelement_v2i8(<br class="">
; GCN: buffer_load_ubyte v{{[0-9]+}}, off<br class="">
; GCN: buffer_load_ubyte v{{[0-9]+}}, off<br class="">
<br class="">
-; GCN-DAG: buffer_store_byte v{{[0-9]+}}, off, s{{\[[0-9]+:[0-9]+\]}}, s{{[0-9]+}} offset:6<br class="">
-; GCN-DAG: buffer_store_byte v{{[0-9]+}}, off, s{{\[[0-9]+:[0-9]+\]}}, s{{[0-9]+}} offset:5<br class="">
; GCN-DAG: buffer_store_byte v{{[0-9]+}}, off, s{{\[[0-9]+:[0-9]+\]}}, s{{[0-9]+}} offset:4<br class="">
-<br class="">
-; GCN: buffer_store_byte v{{[0-9]+}}, v{{[0-9]+}}, s{{\[[0-9]+:[0-9]+\]}}, s{{[0-9]+}} offen{{$}}<br class="">
+; GCN-DAG: buffer_store_byte v{{[0-9]+}}, off, s{{\[[0-9]+:[0-9]+\]}}, s{{[0-9]+}} offset:5<br class="">
+; GCN-DAG: buffer_store_byte v{{[0-9]+}}, off, s{{\[[0-9]+:[0-9]+\]}}, s{{[0-9]+}} offset:6<br class="">
<br class="">
; GCN-NO-TONGA: buffer_load_ubyte<br class="">
; GCN-NO-TONGA: buffer_load_ubyte<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/merge-stores.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AMDGPU/merge-stores.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AMDGPU/merge-stores.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/merge-stores.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/merge-stores.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,8 +1,5 @@<br class="">
-; RUN: llc -march=amdgcn -verify-machineinstrs -amdgpu-load-store-vectorizer=<wbr class="">0 < %s | FileCheck -check-prefix=SI -check-prefix=GCN -check-prefix=GCN-NOAA %s<br class="">
-; RUN: llc -march=amdgcn -mcpu=bonaire -verify-machineinstrs -amdgpu-load-store-vectorizer=<wbr class="">0 < %s | FileCheck -check-prefix=SI -check-prefix=GCN -check-prefix=GCN-NOAA %s<br class="">
-<br class="">
-; RUN: llc -march=amdgcn -verify-machineinstrs -combiner-alias-analysis -amdgpu-load-store-vectorizer=<wbr class="">0 < %s | FileCheck -check-prefix=SI -check-prefix=GCN -check-prefix=GCN-AA %s<br class="">
-; RUN: llc -march=amdgcn -mcpu=bonaire -verify-machineinstrs -combiner-alias-analysis -amdgpu-load-store-vectorizer=<wbr class="">0 < %s | FileCheck -check-prefix=SI -check-prefix=GCN -check-prefix=GCN-AA %s<br class="">
+; RUN: llc -march=amdgcn -verify-machineinstrs -amdgpu-load-store-vectorizer=<wbr class="">0 < %s | FileCheck -check-prefix=SI -check-prefix=GCN -check-prefix=GCN-AA %s<br class="">
+; RUN: llc -march=amdgcn -mcpu=bonaire -verify-machineinstrs -amdgpu-load-store-vectorizer=<wbr class="">0 < %s | FileCheck -check-prefix=SI -check-prefix=GCN -check-prefix=GCN-AA %s<br class="">
<br class="">
; This test is mostly to test DAG store merging, so disable the vectorizer.<br class="">
; Run with devices with different unaligned load restrictions.<br class="">
@@ -150,12 +147,7 @@ define void @merge_global_store_4_consta<br class="">
}<br class="">
<br class="">
; GCN-LABEL: {{^}}merge_global_store_4_cons<wbr class="">tants_mixed_i32_f32:<br class="">
-; GCN-NOAA: buffer_store_dwordx4 v<br class="">
-<br class="">
-; GCN-AA: buffer_store_dwordx2<br class="">
-; GCN-AA: buffer_store_dword v<br class="">
-; GCN-AA: buffer_store_dword v<br class="">
-<br class="">
+; GCN-AA: buffer_store_dwordx4 v<br class="">
; GCN: s_endpgm<br class="">
define void @merge_global_store_4_constant<wbr class="">s_mixed_i32_f32(float addrspace(1)* %out) #0 {<br class="">
%out.gep.1 = getelementptr float, float addrspace(1)* %out, i32 1<br class="">
@@ -474,17 +466,9 @@ define void @merge_global_store_4_adjace<br class="">
ret void<br class="">
}<br class="">
<br class="">
-; This works once AA is enabled on the subtarget<br class="">
; GCN-LABEL: {{^}}merge_global_store_4_vect<wbr class="">or_elts_loads_v4i32:<br class="">
; GCN: buffer_load_dwordx4 [[LOAD:v\[[0-9]+:[0-9]+\]]]<br class="">
-<br class="">
-; GCN-NOAA: buffer_store_dword v<br class="">
-; GCN-NOAA: buffer_store_dword v<br class="">
-; GCN-NOAA: buffer_store_dword v<br class="">
-; GCN-NOAA: buffer_store_dword v<br class="">
-<br class="">
-; GCN-AA: buffer_store_dwordx4 [[LOAD]]<br class="">
-<br class="">
+; GCN: buffer_store_dwordx4 [[LOAD]]<br class="">
; GCN: s_endpgm<br class="">
define void @merge_global_store_4_vector_e<wbr class="">lts_loads_v4i32(i32 addrspace(1)* %out, <4 x i32> addrspace(1)* %in) #0 {<br class="">
%out.gep.1 = getelementptr i32, i32 addrspace(1)* %out, i32 1<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/private-element-size.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AMDGPU/private-element-size.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AMDGPU/private-element-size.<wbr class="">ll?rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/private-element-size.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/private-element-size.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -32,10 +32,10 @@<br class="">
; HSA-ELT4-DAG: buffer_store_dword {{v[0-9]+}}, off, s[0:3], s9 offset:40{{$}}<br class="">
; HSA-ELT4-DAG: buffer_store_dword {{v[0-9]+}}, off, s[0:3], s9 offset:44{{$}}<br class="">
<br class="">
-; HSA-ELT4: buffer_load_dword {{v[0-9]+}}, v{{[0-9]+}}, s[0:3], s9 offen{{$}}<br class="">
-; HSA-ELT4: buffer_load_dword {{v[0-9]+}}, v{{[0-9]+}}, s[0:3], s9 offen offset:4{{$}}<br class="">
-; HSA-ELT4: buffer_load_dword {{v[0-9]+}}, v{{[0-9]+}}, s[0:3], s9 offen offset:8{{$}}<br class="">
-; HSA-ELT4: buffer_load_dword {{v[0-9]+}}, v{{[0-9]+}}, s[0:3], s9 offen offset:12{{$}}<br class="">
+; HSA-ELT4-DAG: buffer_load_dword {{v[0-9]+}}, v{{[0-9]+}}, s[0:3], s9 offen{{$}}<br class="">
+; HSA-ELT4-DAG: buffer_load_dword {{v[0-9]+}}, v{{[0-9]+}}, s[0:3], s9 offen offset:4{{$}}<br class="">
+; HSA-ELT4-DAG: buffer_load_dword {{v[0-9]+}}, v{{[0-9]+}}, s[0:3], s9 offen offset:8{{$}}<br class="">
+; HSA-ELT4-DAG: buffer_load_dword {{v[0-9]+}}, v{{[0-9]+}}, s[0:3], s9 offen offset:12{{$}}<br class="">
define void @private_elt_size_v4i32(<4 x i32> addrspace(1)* %out, i32 addrspace(1)* %index.array) #0 {<br class="">
entry:<br class="">
%tid = call i32 @llvm.amdgcn.workitem.id.x()<br class="">
@@ -130,8 +130,8 @@ entry:<br class="">
; HSA-ELT8: private_element_size = 2<br class="">
; HSA-ELT4: private_element_size = 1<br class="">
<br class="">
-; HSA-ELTGE8-DAG: buffer_store_dwordx2 {{v\[[0-9]+:[0-9]+\]}}, off, s[0:3], s9 offset:16<br class="">
-; HSA-ELTGE8-DAG: buffer_store_dwordx2 {{v\[[0-9]+:[0-9]+\]}}, off, s[0:3], s9 offset:24<br class="">
+; HSA-ELTGE8-DAG: buffer_store_dwordx2 {{v\[[0-9]+:[0-9]+\]}}, {{off|v[0-9]}}, s[0:3], s9 offset:1<br class="">
+; HSA-ELTGE8-DAG: buffer_store_dwordx2 {{v\[[0-9]+:[0-9]+\]}}, {{off|v[0-9]}}, s[0:3], s9 offset:2<br class="">
<br class="">
; HSA-ELTGE8: buffer_load_dwordx2 {{v\[[0-9]+:[0-9]+\]}}, v{{[0-9]+}}, s[0:3], s9 offen<br class="">
<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/si-triv-disjoint-mem-access.<wbr class="">ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/AMDGPU/si-triv-disjoint-mem-access.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">AMDGPU/si-triv-disjoint-mem-<wbr class="">access.ll?rev=297695&r1=<wbr class="">297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/si-triv-disjoint-mem-access.<wbr class="">ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/AMDGPU<wbr class="">/si-triv-disjoint-mem-access.<wbr class="">ll Mon Mar 13 19:34:14 2017<br class="">
@@ -157,9 +157,8 @@ define void @reorder_global_load_local_s<br class="">
<br class="">
; FUNC-LABEL: @reorder_local_offsets<br class="">
; CI: ds_read2_b32 {{v\[[0-9]+:[0-9]+\]}}, {{v[0-9]+}} offset0:100 offset1:102<br class="">
-; CI: ds_write2_b32 {{v[0-9]+}}, {{v[0-9]+}}, {{v[0-9]+}} offset0:3 offset1:100<br class="">
-; CI: ds_read_b32 {{v[0-9]+}}, {{v[0-9]+}} offset:12<br class="">
-; CI: ds_write_b32 {{v[0-9]+}}, {{v[0-9]+}} offset:408<br class="">
+; CI-DAG: ds_write2_b32 {{v[0-9]+}}, v{{[0-9]+}}, v{{[0-9]+}} offset0:3 offset1:100<br class="">
+; CI-DAG: ds_write_b32 {{v[0-9]+}}, {{v[0-9]+}} offset:408<br class="">
; CI: buffer_store_dword<br class="">
; CI: s_endpgm<br class="">
define void @reorder_local_offsets(i32 addrspace(1)* nocapture %out, i32 addrspace(1)* noalias nocapture readnone %gptr, i32 addrspace(3)* noalias nocapture %ptr0) #0 {<br class="">
@@ -181,12 +180,12 @@ define void @reorder_local_offsets(i32 a<br class="">
}<br class="">
<br class="">
; FUNC-LABEL: @reorder_global_offsets<br class="">
-; CI: buffer_load_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:400<br class="">
-; CI: buffer_load_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:408<br class="">
-; CI: buffer_store_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:12<br class="">
-; CI: buffer_store_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:400<br class="">
-; CI: buffer_store_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:408<br class="">
-; CI: buffer_load_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:12<br class="">
+; CI-DAG: buffer_load_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:400<br class="">
+; CI-DAG: buffer_load_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:408<br class="">
+; CI-DAG: buffer_store_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:12<br class="">
+; CI-DAG: buffer_store_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:400<br class="">
+; CI-DAG: buffer_store_dword {{v[0-9]+}}, off, {{s\[[0-9]+:[0-9]+\]}}, 0 offset:408<br class="">
+; CI: buffer_store_dword<br class="">
; CI: s_endpgm<br class="">
define void @reorder_global_offsets(i32 addrspace(1)* nocapture %out, i32 addrspace(1)* noalias nocapture readnone %gptr, i32 addrspace(1)* noalias nocapture %ptr0) #0 {<br class="">
%ptr1 = getelementptr inbounds i32, i32 addrspace(1)* %ptr0, i32 3<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/ARM/20<wbr class="">12-10-04-AAPCS-byval-align8.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/ARM/2012-10-04-AAPCS-byval-align8.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">ARM/2012-10-04-AAPCS-byval-<wbr class="">align8.ll?rev=297695&r1=297694<wbr class="">&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/ARM/20<wbr class="">12-10-04-AAPCS-byval-align8.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/ARM/20<wbr class="">12-10-04-AAPCS-byval-align8.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -12,7 +12,8 @@ define void @test_byval_8_bytes_alignmen<br class="">
entry:<br class="">
; CHECK: sub sp, sp, #12<br class="">
; CHECK: sub sp, sp, #4<br class="">
-; CHECK: stmib sp, {r1, r2, r3}<br class="">
+; CHECK: add r0, sp, #4<br class="">
+; CHECK: stm sp, {r0, r1, r2, r3}<br class="">
%g = alloca i8*<br class="">
%g1 = bitcast i8** %g to i8*<br class="">
call void @llvm.va_start(i8* %g1)<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/ARM/al<wbr class="">loc-no-stack-realign.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/ARM/alloc-no-stack-realign.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">ARM/alloc-no-stack-realign.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/ARM/al<wbr class="">loc-no-stack-realign.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/ARM/al<wbr class="">loc-no-stack-realign.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,5 +1,4 @@<br class="">
-; RUN: llc < %s -mtriple=armv7-apple-ios -O0 | FileCheck %s -check-prefix=NO-REALIGN<br class="">
-; RUN: llc < %s -mtriple=armv7-apple-ios -O0 | FileCheck %s -check-prefix=REALIGN<br class="">
+; RUN: llc < %s -mtriple=armv7-apple-ios -O0 | FileCheck %s<br class="">
<br class="">
; <a href="rdar://12713765" class="">rdar://12713765</a><br class="">
; When realign-stack is set to false, make sure we are not creating stack<br class="">
@@ -8,29 +7,31 @@<br class="">
<br class="">
define void @test1(<16 x float>* noalias sret %agg.result) nounwind ssp "no-realign-stack" {<br class="">
entry:<br class="">
-; NO-REALIGN-LABEL: test1<br class="">
-; NO-REALIGN: mov r[[R2:[0-9]+]], r[[R1:[0-9]+]]<br class="">
-; NO-REALIGN: vld1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]!<br class="">
-; NO-REALIGN: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; NO-REALIGN: add r[[R2:[0-9]+]], r[[R1]], #32<br class="">
-; NO-REALIGN: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; NO-REALIGN: add r[[R2:[0-9]+]], r[[R1]], #48<br class="">
-; NO-REALIGN: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-<br class="">
-; NO-REALIGN: add r[[R2:[0-9]+]], r[[R1:[0-9]+]], #48<br class="">
-; NO-REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; NO-REALIGN: add r[[R2:[0-9]+]], r[[R1]], #32<br class="">
-; NO-REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; NO-REALIGN: mov r[[R3:[0-9]+]], r[[R1]]<br class="">
-; NO-REALIGN: vst1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R3]]:128]!<br class="">
-; NO-REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R3]]:128]<br class="">
-<br class="">
-; NO-REALIGN: add r[[R2:[0-9]+]], r[[R0:0]], #48<br class="">
-; NO-REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; NO-REALIGN: add r[[R2:[0-9]+]], r[[R0]], #32<br class="">
-; NO-REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; NO-REALIGN: vst1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R0]]:128]!<br class="">
-; NO-REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R0]]:128]<br class="">
+; CHECK-LABEL: test1<br class="">
+; CHECK: ldr r[[R1:[0-9]+]], [pc, r1]<br class="">
+; CHECK: add r[[R2:[0-9]+]], r1, #48<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: mov r[[R2:[0-9]+]], r[[R1]]<br class="">
+; CHECK: vld1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]!<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: add r[[R1:[0-9]+]], r[[R1]], #32<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: mov r[[R1:[0-9]+]], sp<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: add r[[R2:[0-9]+]], r[[R1]], #32<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: vld1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]!<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: vld1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]!<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: add r[[R1:[0-9]+]], r0, #48<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: add r[[R1:[0-9]+]], r0, #32<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: vst1.32 {{{d[0-9]+, d[0-9]+}}}, [r0:128]!<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r0:128]<br class="">
%retval = alloca <16 x float>, align 16<br class="">
%0 = load <16 x float>, <16 x float>* @T3_retval, align 16<br class="">
store <16 x float> %0, <16 x float>* %retval<br class="">
@@ -41,32 +42,33 @@ entry:<br class="">
<br class="">
define void @test2(<16 x float>* noalias sret %agg.result) nounwind ssp {<br class="">
entry:<br class="">
-; REALIGN-LABEL: test2<br class="">
-; REALIGN: bfc sp, #0, #6<br class="">
-; REALIGN: mov r[[R2:[0-9]+]], r[[R1:[0-9]+]]<br class="">
-; REALIGN: vld1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]!<br class="">
-; REALIGN: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; REALIGN: add r[[R2:[0-9]+]], r[[R1]], #32<br class="">
-; REALIGN: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; REALIGN: add r[[R2:[0-9]+]], r[[R1]], #48<br class="">
-; REALIGN: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: ldr r[[R1:[0-9]+]], [pc, r1]<br class="">
+; CHECK: add r[[R2:[0-9]+]], r[[R1]], #48<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: mov r[[R2:[0-9]+]], r[[R1]]<br class="">
+; CHECK: vld1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]!<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: add r[[R1:[0-9]+]], r[[R1]], #32<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: mov r[[R1:[0-9]+]], sp<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: orr r[[R2:[0-9]+]], r[[R1]], #32<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: vld1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]!<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: vld1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]!<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: vld1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
+; CHECK: add r[[R1:[0-9]+]], r0, #48<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: add r[[R1:[0-9]+]], r0, #32<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
+; CHECK: vst1.32 {{{d[0-9]+, d[0-9]+}}}, [r0:128]!<br class="">
+; CHECK: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r0:128]<br class="">
<br class="">
<br class="">
-; REALIGN: orr r[[R2:[0-9]+]], r[[R1:[0-9]+]], #48<br class="">
-; REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; REALIGN: orr r[[R2:[0-9]+]], r[[R1]], #32<br class="">
-; REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; REALIGN: orr r[[R2:[0-9]+]], r[[R1]], #16<br class="">
-; REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R2]]:128]<br class="">
-; REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
-<br class="">
-; REALIGN: add r[[R1:[0-9]+]], r[[R0:0]], #48<br class="">
-; REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
-; REALIGN: add r[[R1:[0-9]+]], r[[R0]], #32<br class="">
-; REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R1]]:128]<br class="">
-; REALIGN: vst1.32 {{{d[0-9]+, d[0-9]+}}}, [r[[R0]]:128]!<br class="">
-; REALIGN: vst1.64 {{{d[0-9]+, d[0-9]+}}}, [r[[R0]]:128]<br class="">
- %retval = alloca <16 x float>, align 16<br class="">
+%retval = alloca <16 x float>, align 16<br class="">
%0 = load <16 x float>, <16 x float>* @T3_retval, align 16<br class="">
store <16 x float> %0, <16 x float>* %retval<br class="">
%1 = load <16 x float>, <16 x float>* %retval<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/ARM/gp<wbr class="">r-paired-spill.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/ARM/gpr-paired-spill.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">ARM/gpr-paired-spill.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/ARM/gp<wbr class="">r-paired-spill.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/ARM/gp<wbr class="">r-paired-spill.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -16,22 +16,22 @@ define void @foo(i64* %addr) {<br class="">
; an LDMIA was created with both a FrameIndex and an offset, which<br class="">
; is not allowed.<br class="">
<br class="">
-; CHECK-WITH-LDRD: strd {{r[0-9]+}}, {{r[0-9]+}}, [sp, #8]<br class="">
-; CHECK-WITH-LDRD: strd {{r[0-9]+}}, {{r[0-9]+}}, [sp]<br class="">
+; CHECK-WITH-LDRD-DAG: strd {{r[0-9]+}}, {{r[0-9]+}}, [sp, #8]<br class="">
+; CHECK-WITH-LDRD-DAG: strd {{r[0-9]+}}, {{r[0-9]+}}, [sp]<br class="">
<br class="">
-; CHECK-WITH-LDRD: ldrd {{r[0-9]+}}, {{r[0-9]+}}, [sp, #8]<br class="">
-; CHECK-WITH-LDRD: ldrd {{r[0-9]+}}, {{r[0-9]+}}, [sp]<br class="">
+; CHECK-WITH-LDRD-DAG: ldrd {{r[0-9]+}}, {{r[0-9]+}}, [sp, #8]<br class="">
+; CHECK-WITH-LDRD-DAG: ldrd {{r[0-9]+}}, {{r[0-9]+}}, [sp]<br class="">
<br class="">
; We also want to ensure the register scavenger is working (i.e. an<br class="">
; offset from sp can be generated), so we need two spills.<br class="">
-; CHECK-WITHOUT-LDRD: add [[ADDRREG:[a-z0-9]+]], sp, #{{[0-9]+}}<br class="">
-; CHECK-WITHOUT-LDRD: stm [[ADDRREG]], {r{{[0-9]+}}, r{{[0-9]+}}}<br class="">
-; CHECK-WITHOUT-LDRD: stm sp, {r{{[0-9]+}}, r{{[0-9]+}}}<br class="">
+; CHECK-WITHOUT-LDRD-DAG: add [[ADDRREG:[a-z0-9]+]], sp, #{{[0-9]+}}<br class="">
+; CHECK-WITHOUT-LDRD-DAG: stm [[ADDRREG]], {r{{[0-9]+}}, r{{[0-9]+}}}<br class="">
+; CHECK-WITHOUT-LDRD-DAG: stm sp, {r{{[0-9]+}}, r{{[0-9]+}}}<br class="">
<br class="">
; In principle LLVM may have to recalculate the offset. At the moment<br class="">
; it reuses the original though.<br class="">
-; CHECK-WITHOUT-LDRD: ldm [[ADDRREG]], {r{{[0-9]+}}, r{{[0-9]+}}}<br class="">
-; CHECK-WITHOUT-LDRD: ldm sp, {r{{[0-9]+}}, r{{[0-9]+}}}<br class="">
+; CHECK-WITHOUT-LDRD-DAG: ldm [[ADDRREG]], {r{{[0-9]+}}, r{{[0-9]+}}}<br class="">
+; CHECK-WITHOUT-LDRD-DAG: ldm sp, {r{{[0-9]+}}, r{{[0-9]+}}}<br class="">
<br class="">
store volatile i64 %val1, i64* %addr<br class="">
store volatile i64 %val2, i64* %addr<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/ARM/if<wbr class="">cvt10.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/ARM/ifcvt10.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">ARM/ifcvt10.ll?rev=297695&r1=<wbr class="">297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/ARM/if<wbr class="">cvt10.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/ARM/if<wbr class="">cvt10.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -10,8 +10,6 @@ entry:<br class="">
; CHECK: vpop {d8}<br class="">
; CHECK-NOT: vpopne<br class="">
; CHECK: pop {r7, pc}<br class="">
-; CHECK: vpop {d8}<br class="">
-; CHECK: pop {r7, pc}<br class="">
br i1 undef, label %if.else, label %if.then<br class="">
<br class="">
if.then: ; preds = %entry<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/ARM/il<wbr class="">legal-bitfield-loadstore.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/ARM/illegal-bitfield-loadstore.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">ARM/illegal-bitfield-loadstore<wbr class="">.ll?rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/ARM/il<wbr class="">legal-bitfield-loadstore.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/ARM/il<wbr class="">legal-bitfield-loadstore.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -6,9 +6,7 @@ define void @i24_or(i24* %a) {<br class="">
; LE-LABEL: i24_or:<br class="">
; LE: @ BB#0:<br class="">
; LE-NEXT: ldrh r1, [r0]<br class="">
-; LE-NEXT: ldrb r2, [r0, #2]<br class="">
; LE-NEXT: orr r1, r1, #384<br class="">
-; LE-NEXT: strb r2, [r0, #2]<br class="">
; LE-NEXT: strh r1, [r0]<br class="">
; LE-NEXT: mov pc, lr<br class="">
;<br class="">
@@ -31,21 +29,19 @@ define void @i24_or(i24* %a) {<br class="">
define void @i24_and_or(i24* %a) {<br class="">
; LE-LABEL: i24_and_or:<br class="">
; LE: @ BB#0:<br class="">
-; LE-NEXT: ldrb r2, [r0, #2]<br class="">
; LE-NEXT: ldrh r1, [r0]<br class="">
-; LE-NEXT: strb r2, [r0, #2]<br class="">
; LE-NEXT: mov r2, #16256<br class="">
-; LE-NEXT: orr r1, r1, #384<br class="">
; LE-NEXT: orr r2, r2, #49152<br class="">
+; LE-NEXT: orr r1, r1, #384<br class="">
; LE-NEXT: and r1, r1, r2<br class="">
; LE-NEXT: strh r1, [r0]<br class="">
; LE-NEXT: mov pc, lr<br class="">
;<br class="">
; BE-LABEL: i24_and_or:<br class="">
; BE: @ BB#0:<br class="">
+; BE-NEXT: mov r1, #128<br class="">
+; BE-NEXT: strb r1, [r0, #2]<br class="">
; BE-NEXT: ldrh r1, [r0]<br class="">
-; BE-NEXT: mov r2, #128<br class="">
-; BE-NEXT: strb r2, [r0, #2]<br class="">
; BE-NEXT: orr r1, r1, #1<br class="">
; BE-NEXT: strh r1, [r0]<br class="">
; BE-NEXT: mov pc, lr<br class="">
@@ -59,9 +55,7 @@ define void @i24_and_or(i24* %a) {<br class="">
define void @i24_insert_bit(i24* %a, i1 zeroext %bit) {<br class="">
; LE-LABEL: i24_insert_bit:<br class="">
; LE: @ BB#0:<br class="">
-; LE-NEXT: ldrb r3, [r0, #2]<br class="">
; LE-NEXT: ldrh r2, [r0]<br class="">
-; LE-NEXT: strb r3, [r0, #2]<br class="">
; LE-NEXT: mov r3, #255<br class="">
; LE-NEXT: orr r3, r3, #57088<br class="">
; LE-NEXT: and r2, r2, r3<br class="">
@@ -71,9 +65,7 @@ define void @i24_insert_bit(i24* %a, i1<br class="">
;<br class="">
; BE-LABEL: i24_insert_bit:<br class="">
; BE: @ BB#0:<br class="">
-; BE-NEXT: ldrb r3, [r0, #2]<br class="">
; BE-NEXT: ldrh r2, [r0]<br class="">
-; BE-NEXT: strb r3, [r0, #2]<br class="">
; BE-NEXT: mov r3, #57088<br class="">
; BE-NEXT: orr r3, r3, #16711680<br class="">
; BE-NEXT: and r2, r3, r2, lsl #8<br class="">
@@ -93,14 +85,9 @@ define void @i24_insert_bit(i24* %a, i1<br class="">
define void @i56_or(i56* %a) {<br class="">
; LE-LABEL: i56_or:<br class="">
; LE: @ BB#0:<br class="">
-; LE-NEXT: mov r2, r0<br class="">
-; LE-NEXT: ldr r12, [r0]<br class="">
-; LE-NEXT: ldrh r3, [r2, #4]!<br class="">
-; LE-NEXT: ldrb r1, [r2, #2]<br class="">
-; LE-NEXT: strb r1, [r2, #2]<br class="">
-; LE-NEXT: orr r1, r12, #384<br class="">
+; LE-NEXT: ldr r1, [r0]<br class="">
+; LE-NEXT: orr r1, r1, #384<br class="">
; LE-NEXT: str r1, [r0]<br class="">
-; LE-NEXT: strh r3, [r2]<br class="">
; LE-NEXT: mov pc, lr<br class="">
;<br class="">
; BE-LABEL: i56_or:<br class="">
@@ -128,36 +115,29 @@ define void @i56_or(i56* %a) {<br class="">
define void @i56_and_or(i56* %a) {<br class="">
; LE-LABEL: i56_and_or:<br class="">
; LE: @ BB#0:<br class="">
-; LE-NEXT: mov r2, r0<br class="">
; LE-NEXT: ldr r1, [r0]<br class="">
-; LE-NEXT: ldrh r12, [r2, #4]!<br class="">
; LE-NEXT: orr r1, r1, #384<br class="">
-; LE-NEXT: ldrb r3, [r2, #2]<br class="">
; LE-NEXT: bic r1, r1, #127<br class="">
-; LE-NEXT: strb r3, [r2, #2]<br class="">
; LE-NEXT: str r1, [r0]<br class="">
-; LE-NEXT: strh r12, [r2]<br class="">
; LE-NEXT: mov pc, lr<br class="">
;<br class="">
; BE-LABEL: i56_and_or:<br class="">
; BE: @ BB#0:<br class="">
-; BE-NEXT: .save {r11, lr}<br class="">
-; BE-NEXT: push {r11, lr}<br class="">
-; BE-NEXT: mov r2, r0<br class="">
-; BE-NEXT: ldr lr, [r0]<br class="">
+; BE-NEXT: mov r1, r0<br class="">
; BE-NEXT: mov r3, #128<br class="">
-; BE-NEXT: ldrh r12, [r2, #4]!<br class="">
-; BE-NEXT: strb r3, [r2, #2]<br class="">
-; BE-NEXT: lsl r3, r12, #8<br class="">
-; BE-NEXT: orr r3, r3, lr, lsl #24<br class="">
-; BE-NEXT: orr r3, r3, #384<br class="">
-; BE-NEXT: lsr r1, r3, #8<br class="">
-; BE-NEXT: strh r1, [r2]<br class="">
-; BE-NEXT: bic r1, lr, #255<br class="">
-; BE-NEXT: orr r1, r1, r3, lsr #24<br class="">
+; BE-NEXT: ldrh r2, [r1, #4]!<br class="">
+; BE-NEXT: strb r3, [r1, #2]<br class="">
+; BE-NEXT: lsl r2, r2, #8<br class="">
+; BE-NEXT: ldr r12, [r0]<br class="">
+; BE-NEXT: orr r2, r2, r12, lsl #24<br class="">
+; BE-NEXT: orr r2, r2, #384<br class="">
+; BE-NEXT: lsr r3, r2, #8<br class="">
+; BE-NEXT: strh r3, [r1]<br class="">
+; BE-NEXT: bic r1, r12, #255<br class="">
+; BE-NEXT: orr r1, r1, r2, lsr #24<br class="">
; BE-NEXT: str r1, [r0]<br class="">
-; BE-NEXT: pop {r11, lr}<br class="">
; BE-NEXT: mov pc, lr<br class="">
+<br class="">
%b = load i56, i56* %a, align 1<br class="">
%c = and i56 %b, -128<br class="">
%d = or i56 %c, 384<br class="">
@@ -168,35 +148,27 @@ define void @i56_and_or(i56* %a) {<br class="">
define void @i56_insert_bit(i56* %a, i1 zeroext %bit) {<br class="">
; LE-LABEL: i56_insert_bit:<br class="">
; LE: @ BB#0:<br class="">
-; LE-NEXT: .save {r11, lr}<br class="">
-; LE-NEXT: push {r11, lr}<br class="">
-; LE-NEXT: mov r3, r0<br class="">
-; LE-NEXT: ldr lr, [r0]<br class="">
-; LE-NEXT: ldrh r12, [r3, #4]!<br class="">
-; LE-NEXT: ldrb r2, [r3, #2]<br class="">
-; LE-NEXT: strb r2, [r3, #2]<br class="">
-; LE-NEXT: bic r2, lr, #8192<br class="">
+; LE-NEXT: ldr r2, [r0]<br class="">
+; LE-NEXT: bic r2, r2, #8192<br class="">
; LE-NEXT: orr r1, r2, r1, lsl #13<br class="">
; LE-NEXT: str r1, [r0]<br class="">
-; LE-NEXT: strh r12, [r3]<br class="">
-; LE-NEXT: pop {r11, lr}<br class="">
; LE-NEXT: mov pc, lr<br class="">
;<br class="">
; BE-LABEL: i56_insert_bit:<br class="">
; BE: @ BB#0:<br class="">
; BE-NEXT: .save {r11, lr}<br class="">
; BE-NEXT: push {r11, lr}<br class="">
-; BE-NEXT: mov r3, r0<br class="">
+; BE-NEXT: mov r2, r0<br class="">
+; BE-NEXT: ldrh r12, [r2, #4]!<br class="">
+; BE-NEXT: ldrb r3, [r2, #2]<br class="">
+; BE-NEXT: strb r3, [r2, #2]<br class="">
+; BE-NEXT: orr r12, r3, r12, lsl #8<br class="">
; BE-NEXT: ldr lr, [r0]<br class="">
-; BE-NEXT: ldrh r12, [r3, #4]!<br class="">
-; BE-NEXT: ldrb r2, [r3, #2]<br class="">
-; BE-NEXT: strb r2, [r3, #2]<br class="">
-; BE-NEXT: orr r2, r2, r12, lsl #8<br class="">
-; BE-NEXT: orr r2, r2, lr, lsl #24<br class="">
-; BE-NEXT: bic r2, r2, #8192<br class="">
-; BE-NEXT: orr r1, r2, r1, lsl #13<br class="">
-; BE-NEXT: lsr r2, r1, #8<br class="">
-; BE-NEXT: strh r2, [r3]<br class="">
+; BE-NEXT: orr r3, r12, lr, lsl #24<br class="">
+; BE-NEXT: bic r3, r3, #8192<br class="">
+; BE-NEXT: orr r1, r3, r1, lsl #13<br class="">
+; BE-NEXT: lsr r3, r1, #8<br class="">
+; BE-NEXT: strh r3, [r2]<br class="">
; BE-NEXT: bic r2, lr, #255<br class="">
; BE-NEXT: orr r1, r2, r1, lsr #24<br class="">
; BE-NEXT: str r1, [r0]<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/ARM/st<wbr class="">atic-addr-hoisting.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/ARM/static-addr-hoisting.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">ARM/static-addr-hoisting.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/ARM/st<wbr class="">atic-addr-hoisting.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/ARM/st<wbr class="">atic-addr-hoisting.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -6,9 +6,9 @@ define void @multiple_store() {<br class="">
; CHECK: movs [[VAL:r[0-9]+]], #42<br class="">
; CHECK: movt r[[BASE1]], #15<br class="">
<br class="">
-; CHECK: str [[VAL]], [r[[BASE1]]]<br class="">
-; CHECK: str [[VAL]], [r[[BASE1]], #24]<br class="">
-; CHECK: str.w [[VAL]], [r[[BASE1]], #42]<br class="">
+; CHECK-DAG: str [[VAL]], [r[[BASE1]]]<br class="">
+; CHECK-DAG: str [[VAL]], [r[[BASE1]], #24]<br class="">
+; CHECK-DAG: str.w [[VAL]], [r[[BASE1]], #42]<br class="">
<br class="">
; CHECK: movw r[[BASE2:[0-9]+]], #20394<br class="">
; CHECK: movt r[[BASE2]], #18<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/BPF/un<wbr class="">def.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/BPF/undef.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">BPF/undef.ll?rev=297695&r1=<wbr class="">297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/BPF/un<wbr class="">def.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/BPF/un<wbr class="">def.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -13,50 +13,55 @@<br class="">
<br class="">
; Function Attrs: nounwind uwtable<br class="">
define i32 @ebpf_filter(%struct.__sk_buff<wbr class="">* nocapture readnone %ebpf_packet) #0 section "socket1" {<br class="">
+; CHECK: r2 = r10<br class="">
+; CHECK: r2 += -2<br class="">
+; CHECK: r1 = 0<br class="">
+; CHECK: *(u16 *)(r2 + 6) = r1<br class="">
+; CHECK: *(u16 *)(r2 + 4) = r1<br class="">
+; CHECK: *(u16 *)(r2 + 2) = r1<br class="">
+; CHECK: r2 = 6<br class="">
+; CHECK: *(u8 *)(r10 - 7) = r2<br class="">
+; CHECK: r2 = 5<br class="">
+; CHECK: *(u8 *)(r10 - 8) = r2<br class="">
+; CHECK: r2 = 7<br class="">
+; CHECK: *(u8 *)(r10 - 6) = r2<br class="">
+; CHECK: r2 = 8<br class="">
+; CHECK: *(u8 *)(r10 - 5) = r2<br class="">
+; CHECK: r2 = 9<br class="">
+; CHECK: *(u8 *)(r10 - 4) = r2<br class="">
+; CHECK: r2 = 10<br class="">
+; CHECK: *(u8 *)(r10 - 3) = r2<br class="">
+; CHECK: *(u16 *)(r10 + 24) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 22) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 20) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 18) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 16) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 14) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 12) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 10) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 8) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 6) = r1<br class="">
+; CHECK: *(u16 *)(r10 - 2) = r1<br class="">
+; CHECK: *(u16 *)(r10 + 26) = r1<br class="">
+; CHECK: r2 = r10<br class="">
+; CHECK: r2 += -8<br class="">
+; CHECK: r1 = <MCOperand Expr:(routing)>ll<br class="">
+; CHECK: call bpf_map_lookup_elem<br class="">
+; CHECK: exit<br class="">
%key = alloca %struct.routing_key_2, align 1<br class="">
%1 = getelementptr inbounds %struct.routing_key_2, %struct.routing_key_2* %key, i64 0, i32 0, i64 0<br class="">
-; CHECK: r1 = 5<br class="">
-; CHECK: *(u8 *)(r10 - 8) = r1<br class="">
store i8 5, i8* %1, align 1<br class="">
%2 = getelementptr inbounds %struct.routing_key_2, %struct.routing_key_2* %key, i64 0, i32 0, i64 1<br class="">
-; CHECK: r1 = 6<br class="">
-; CHECK: *(u8 *)(r10 - 7) = r1<br class="">
store i8 6, i8* %2, align 1<br class="">
%3 = getelementptr inbounds %struct.routing_key_2, %struct.routing_key_2* %key, i64 0, i32 0, i64 2<br class="">
-; CHECK: r1 = 7<br class="">
-; CHECK: *(u8 *)(r10 - 6) = r1<br class="">
store i8 7, i8* %3, align 1<br class="">
%4 = getelementptr inbounds %struct.routing_key_2, %struct.routing_key_2* %key, i64 0, i32 0, i64 3<br class="">
-; CHECK: r1 = 8<br class="">
-; CHECK: *(u8 *)(r10 - 5) = r1<br class="">
store i8 8, i8* %4, align 1<br class="">
%5 = getelementptr inbounds %struct.routing_key_2, %struct.routing_key_2* %key, i64 0, i32 0, i64 4<br class="">
-; CHECK: r1 = 9<br class="">
-; CHECK: *(u8 *)(r10 - 4) = r1<br class="">
store i8 9, i8* %5, align 1<br class="">
%6 = getelementptr inbounds %struct.routing_key_2, %struct.routing_key_2* %key, i64 0, i32 0, i64 5<br class="">
-; CHECK: r1 = 10<br class="">
-; CHECK: *(u8 *)(r10 - 3) = r1<br class="">
store i8 10, i8* %6, align 1<br class="">
%7 = getelementptr inbounds %struct.routing_key_2, %struct.routing_key_2* %key, i64 1, i32 0, i64 0<br class="">
-; CHECK: r1 = r10<br class="">
-; CHECK: r1 += -2<br class="">
-; CHECK: r2 = 0<br class="">
-; CHECK: *(u16 *)(r1 + 6) = r2<br class="">
-; CHECK: *(u16 *)(r1 + 4) = r2<br class="">
-; CHECK: *(u16 *)(r1 + 2) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 24) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 22) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 20) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 18) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 16) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 14) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 12) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 10) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 8) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 6) = r2<br class="">
-; CHECK: *(u16 *)(r10 - 2) = r2<br class="">
-; CHECK: *(u16 *)(r10 + 26) = r2<br class="">
call void @llvm.memset.p0i8.i64(i8* %7, i8 0, i64 30, i32 1, i1 false)<br class="">
%8 = call i32 (%struct.bpf_map_def*, %struct.routing_key_2*, ...) bitcast (i32 (...)* @bpf_map_lookup_elem to i32 (%struct.bpf_map_def*, %struct.routing_key_2*, ...)*)(%struct.bpf_map_def* nonnull @routing, %struct.routing_key_2* nonnull %key) #3<br class="">
ret i32 undef<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/MSP430<wbr class="">/Inst16mm.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/MSP430/Inst16mm.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">MSP430/Inst16mm.ll?rev=297695&<wbr class="">r1=297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/MSP430<wbr class="">/Inst16mm.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/MSP430<wbr class="">/Inst16mm.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,4 +1,4 @@<br class="">
-; RUN: llc -march=msp430 -combiner-alias-analysis < %s | FileCheck %s<br class="">
+; RUN: llc -march=msp430 < %s | FileCheck %s<br class="">
target datalayout = "e-p:16:8:8-i8:8:8-i16:8:8-i32<wbr class="">:8:8"<br class="">
target triple = "msp430-generic-generic"<br class="">
@foo = common global i16 0, align 2<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/c<wbr class="">conv/arguments-float.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/cconv/arguments-float.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/cconv/arguments-float.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/c<wbr class="">conv/arguments-float.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/c<wbr class="">conv/arguments-float.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -63,39 +63,39 @@ entry:<br class="">
; NEW-DAG: sd $5, 16([[R2]])<br class="">
<br class="">
; O32 has run out of argument registers and starts using the stack<br class="">
-; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 24($sp)<br class="">
-; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 28($sp)<br class="">
+; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 16($sp)<br class="">
+; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 20($sp)<br class="">
; O32-DAG: sw [[R3]], 24([[R2]])<br class="">
; O32-DAG: sw [[R4]], 28([[R2]])<br class="">
; NEW-DAG: sd $6, 24([[R2]])<br class="">
<br class="">
-; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 32($sp)<br class="">
-; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 36($sp)<br class="">
+; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 24($sp)<br class="">
+; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 28($sp)<br class="">
; O32-DAG: sw [[R3]], 32([[R2]])<br class="">
; O32-DAG: sw [[R4]], 36([[R2]])<br class="">
; NEW-DAG: sd $7, 32([[R2]])<br class="">
<br class="">
-; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 40($sp)<br class="">
-; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 44($sp)<br class="">
+; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 32($sp)<br class="">
+; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 36($sp)<br class="">
; O32-DAG: sw [[R3]], 40([[R2]])<br class="">
; O32-DAG: sw [[R4]], 44([[R2]])<br class="">
; NEW-DAG: sd $8, 40([[R2]])<br class="">
<br class="">
-; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 48($sp)<br class="">
-; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 52($sp)<br class="">
+; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 40($sp)<br class="">
+; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 44($sp)<br class="">
; O32-DAG: sw [[R3]], 48([[R2]])<br class="">
; O32-DAG: sw [[R4]], 52([[R2]])<br class="">
; NEW-DAG: sd $9, 48([[R2]])<br class="">
<br class="">
-; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 56($sp)<br class="">
-; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 60($sp)<br class="">
+; O32-DAG: lw [[R3:\$([0-9]+|gp)]], 48($sp)<br class="">
+; O32-DAG: lw [[R4:\$([0-9]+|gp)]], 52($sp)<br class="">
; O32-DAG: sw [[R3]], 56([[R2]])<br class="">
; O32-DAG: sw [[R4]], 60([[R2]])<br class="">
; NEW-DAG: sd $10, 56([[R2]])<br class="">
<br class="">
; N32/N64 have run out of registers and starts using the stack too<br class="">
-; O32-DAG: lw [[R3:\$[0-9]+]], 64($sp)<br class="">
-; O32-DAG: lw [[R4:\$[0-9]+]], 68($sp)<br class="">
+; O32-DAG: lw [[R3:\$[0-9]+]], 56($sp)<br class="">
+; O32-DAG: lw [[R4:\$[0-9]+]], 60($sp)<br class="">
; O32-DAG: sw [[R3]], 64([[R2]])<br class="">
; O32-DAG: sw [[R4]], 68([[R2]])<br class="">
; NEW-DAG: ld [[R3:\$[0-9]+]], 0($sp)<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/c<wbr class="">conv/arguments-varargs.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/cconv/arguments-varargs.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/cconv/arguments-varargs.<wbr class="">ll?rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/c<wbr class="">conv/arguments-varargs.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/c<wbr class="">conv/arguments-varargs.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -315,12 +315,11 @@ entry:<br class="">
; Big-endian mode for N32/N64 must add an additional 4 to the offset due to byte<br class="">
; order.<br class="">
; O32-DAG: addiu [[GV:\$[0-9]+]], ${{[0-9]+}}, %lo(dwords)<br class="">
-; O32-DAG: lw [[ARG1:\$[0-9]+]], 0([[VA]])<br class="">
+; O32-DAG: lw [[ARG1:\$[0-9]+]], 0([[VA_TMP2]])<br class="">
; O32-DAG: sw [[ARG1]], 8([[GV]])<br class="">
-; O32-DAG: lw [[VA:\$[0-9]+]], 0([[SP]])<br class="">
-; O32-DAG: addiu [[VA2:\$[0-9]+]], [[VA]], 4<br class="">
-; O32-DAG: sw [[VA2]], 0([[SP]])<br class="">
-; O32-DAG: lw [[ARG1:\$[0-9]+]], 0([[VA]])<br class="">
+; O32-DAG: addiu [[VA3:\$[0-9]+]], [[VA2]], 4<br class="">
+; O32-DAG: sw [[VA3]], 0([[SP]])<br class="">
+; O32-DAG: lw [[ARG1:\$[0-9]+]], 4([[VA_TMP2]])<br class="">
; O32-DAG: sw [[ARG1]], 12([[GV]])<br class="">
<br class="">
; N32-DAG: addiu [[GV:\$[0-9]+]], ${{[0-9]+}}, %lo(dwords)<br class="">
@@ -349,10 +348,9 @@ entry:<br class="">
; Load the second argument from the variable portion and copy it to the global.<br class="">
; O32-DAG: lw [[ARG2:\$[0-9]+]], 0([[VA]])<br class="">
; O32-DAG: sw [[ARG2]], 16([[GV]])<br class="">
-; O32-DAG: lw [[VA:\$[0-9]+]], 0([[SP]])<br class="">
-; O32-DAG: addiu [[VA2:\$[0-9]+]], [[VA]], 4<br class="">
-; O32-DAG: sw [[VA2]], 0([[SP]])<br class="">
-; O32-DAG: lw [[ARG2:\$[0-9]+]], 0([[VA]])<br class="">
+; O32-DAG: addiu [[VA3:\$[0-9]+]], [[VA2]], 4<br class="">
+; O32-DAG: sw [[VA3]], 0([[SP]])<br class="">
+; O32-DAG: lw [[ARG2:\$[0-9]+]], 4([[VA_TMP2]])<br class="">
; O32-DAG: sw [[ARG2]], 20([[GV]])<br class="">
<br class="">
; NEW-DAG: ld [[ARG2:\$[0-9]+]], 0([[VA2]])<br class="">
@@ -678,12 +676,11 @@ entry:<br class="">
; Big-endian mode for N32/N64 must add an additional 4 to the offset due to byte<br class="">
; order.<br class="">
; O32-DAG: addiu [[GV:\$[0-9]+]], ${{[0-9]+}}, %lo(dwords)<br class="">
-; O32-DAG: lw [[ARG1:\$[0-9]+]], 0([[VA]])<br class="">
+; O32-DAG: lw [[ARG1:\$[0-9]+]], 0([[VA_TMP2]])<br class="">
; O32-DAG: sw [[ARG1]], 8([[GV]])<br class="">
-; O32-DAG: lw [[VA:\$[0-9]+]], 0([[SP]])<br class="">
-; O32-DAG: addiu [[VA2:\$[0-9]+]], [[VA]], 4<br class="">
-; O32-DAG: sw [[VA2]], 0([[SP]])<br class="">
-; O32-DAG: lw [[ARG1:\$[0-9]+]], 0([[VA]])<br class="">
+; O32-DAG: addiu [[VA3:\$[0-9]+]], [[VA2]], 4<br class="">
+; O32-DAG: sw [[VA3]], 0([[SP]])<br class="">
+; O32-DAG: lw [[ARG1:\$[0-9]+]], 4([[VA_TMP2]])<br class="">
; O32-DAG: sw [[ARG1]], 12([[GV]])<br class="">
<br class="">
; N32-DAG: addiu [[GV:\$[0-9]+]], ${{[0-9]+}}, %lo(dwords)<br class="">
@@ -712,10 +709,9 @@ entry:<br class="">
; Load the second argument from the variable portion and copy it to the global.<br class="">
; O32-DAG: lw [[ARG2:\$[0-9]+]], 0([[VA]])<br class="">
; O32-DAG: sw [[ARG2]], 16([[GV]])<br class="">
-; O32-DAG: lw [[VA:\$[0-9]+]], 0([[SP]])<br class="">
-; O32-DAG: addiu [[VA2:\$[0-9]+]], [[VA]], 4<br class="">
+; O32-DAG: addiu [[VA3:\$[0-9]+]], [[VA2]], 4<br class="">
; O32-DAG: sw [[VA2]], 0([[SP]])<br class="">
-; O32-DAG: lw [[ARG2:\$[0-9]+]], 0([[VA]])<br class="">
+; O32-DAG: lw [[ARG2:\$[0-9]+]], 4([[VA_TMP2]])<br class="">
; O32-DAG: sw [[ARG2]], 20([[GV]])<br class="">
<br class="">
; NEW-DAG: ld [[ARG2:\$[0-9]+]], 0([[VA2]])<br class="">
@@ -1040,10 +1036,9 @@ entry:<br class="">
; O32-DAG: addiu [[GV:\$[0-9]+]], ${{[0-9]+}}, %lo(dwords)<br class="">
; O32-DAG: lw [[ARG1:\$[0-9]+]], 0([[VA]])<br class="">
; O32-DAG: sw [[ARG1]], 8([[GV]])<br class="">
-; O32-DAG: lw [[VA:\$[0-9]+]], 0([[SP]])<br class="">
-; O32-DAG: addiu [[VA2:\$[0-9]+]], [[VA]], 4<br class="">
-; O32-DAG: sw [[VA2]], 0([[SP]])<br class="">
-; O32-DAG: lw [[ARG1:\$[0-9]+]], 0([[VA]])<br class="">
+; O32-DAG: addiu [[VA3:\$[0-9]+]], [[VA2]], 4<br class="">
+; O32-DAG: sw [[VA3]], 0([[SP]])<br class="">
+; O32-DAG: lw [[ARG1:\$[0-9]+]], 4([[VA_TMP2]])<br class="">
; O32-DAG: sw [[ARG1]], 12([[GV]])<br class="">
<br class="">
; N32-DAG: addiu [[GV:\$[0-9]+]], ${{[0-9]+}}, %lo(dwords)<br class="">
@@ -1072,10 +1067,9 @@ entry:<br class="">
; Load the second argument from the variable portion and copy it to the global.<br class="">
; O32-DAG: lw [[ARG2:\$[0-9]+]], 0([[VA]])<br class="">
; O32-DAG: sw [[ARG2]], 16([[GV]])<br class="">
-; O32-DAG: lw [[VA:\$[0-9]+]], 0([[SP]])<br class="">
-; O32-DAG: addiu [[VA2:\$[0-9]+]], [[VA]], 4<br class="">
-; O32-DAG: sw [[VA2]], 0([[SP]])<br class="">
-; O32-DAG: lw [[ARG2:\$[0-9]+]], 0([[VA]])<br class="">
+; O32-DAG: addiu [[VA3:\$[0-9]+]], [[VA2]], 4<br class="">
+; O32-DAG: sw [[VA3]], 0([[SP]])<br class="">
+; O32-DAG: lw [[ARG2:\$[0-9]+]], 4([[VA_TMP2]])<br class="">
; O32-DAG: sw [[ARG2]], 20([[GV]])<br class="">
<br class="">
; NEW-DAG: ld [[ARG2:\$[0-9]+]], 0([[VA2]])<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/f<wbr class="">astcc.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/fastcc.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/fastcc.ll?rev=297695&r1=<wbr class="">297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/f<wbr class="">astcc.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/f<wbr class="">astcc.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -132,20 +132,19 @@ entry:<br class="">
define internal fastcc void @callee0(i32 %a0, i32 %a1, i32 %a2, i32 %a3, i32 %a4, i32 %a5, i32 %a6, i32 %a7, i32 %a8, i32 %a9, i32 %a10, i32 %a11, i32 %a12, i32 %a13, i32 %a14, i32 %a15, i32 %a16) nounwind noinline {<br class="">
entry:<br class="">
; CHECK: callee0<br class="">
-; CHECK: sw $4<br class="">
-; CHECK: sw $5<br class="">
-; CHECK: sw $6<br class="">
-; CHECK: sw $7<br class="">
-; CHECK: sw $8<br class="">
-; CHECK: sw $9<br class="">
-; CHECK: sw $10<br class="">
-; CHECK: sw $11<br class="">
-; CHECK: sw $12<br class="">
-; CHECK: sw $13<br class="">
-; CHECK: sw $14<br class="">
-; CHECK: sw $15<br class="">
-; CHECK: sw $24<br class="">
-; CHECK: sw $3<br class="">
+; CHECK-DAG: sw $4<br class="">
+; CHECK-DAG: sw $5<br class="">
+; CHECK-DAG: sw $7<br class="">
+; CHECK-DAG: sw $8<br class="">
+; CHECK-DAG: sw $9<br class="">
+; CHECK-DAG: sw $10<br class="">
+; CHECK-DAG: sw $11<br class="">
+; CHECK-DAG: sw $12<br class="">
+; CHECK-DAG: sw $13<br class="">
+; CHECK-DAG: sw $14<br class="">
+; CHECK-DAG: sw $15<br class="">
+; CHECK-DAG: sw $24<br class="">
+; CHECK-DAG: sw $3<br class="">
<br class="">
; t6, t7 and t8 are reserved in NaCl and cannot be used for fastcc.<br class="">
; CHECK-NACL-NOT: sw $14<br class="">
@@ -223,27 +222,27 @@ entry:<br class="">
<br class="">
define internal fastcc void @callee1(float %a0, float %a1, float %a2, float %a3, float %a4, float %a5, float %a6, float %a7, float %a8, float %a9, float %a10, float %a11, float %a12, float %a13, float %a14, float %a15, float %a16, float %a17, float %a18, float %a19, float %a20) nounwind noinline {<br class="">
entry:<br class="">
-; CHECK: callee1<br class="">
-; CHECK: swc1 $f0<br class="">
-; CHECK: swc1 $f1<br class="">
-; CHECK: swc1 $f2<br class="">
-; CHECK: swc1 $f3<br class="">
-; CHECK: swc1 $f4<br class="">
-; CHECK: swc1 $f5<br class="">
-; CHECK: swc1 $f6<br class="">
-; CHECK: swc1 $f7<br class="">
-; CHECK: swc1 $f8<br class="">
-; CHECK: swc1 $f9<br class="">
-; CHECK: swc1 $f10<br class="">
-; CHECK: swc1 $f11<br class="">
-; CHECK: swc1 $f12<br class="">
-; CHECK: swc1 $f13<br class="">
-; CHECK: swc1 $f14<br class="">
-; CHECK: swc1 $f15<br class="">
-; CHECK: swc1 $f16<br class="">
-; CHECK: swc1 $f17<br class="">
-; CHECK: swc1 $f18<br class="">
-; CHECK: swc1 $f19<br class="">
+; CHECK-LABEL: callee1:<br class="">
+; CHECK-DAG: swc1 $f0<br class="">
+; CHECK-DAG: swc1 $f1<br class="">
+; CHECK-DAG: swc1 $f2<br class="">
+; CHECK-DAG: swc1 $f3<br class="">
+; CHECK-DAG: swc1 $f4<br class="">
+; CHECK-DAG: swc1 $f5<br class="">
+; CHECK-DAG: swc1 $f6<br class="">
+; CHECK-DAG: swc1 $f7<br class="">
+; CHECK-DAG: swc1 $f8<br class="">
+; CHECK-DAG: swc1 $f9<br class="">
+; CHECK-DAG: swc1 $f10<br class="">
+; CHECK-DAG: swc1 $f11<br class="">
+; CHECK-DAG: swc1 $f12<br class="">
+; CHECK-DAG: swc1 $f13<br class="">
+; CHECK-DAG: swc1 $f14<br class="">
+; CHECK-DAG: swc1 $f15<br class="">
+; CHECK-DAG: swc1 $f16<br class="">
+; CHECK-DAG: swc1 $f17<br class="">
+; CHECK-DAG: swc1 $f18<br class="">
+; CHECK-DAG: swc1 $f19<br class="">
<br class="">
store float %a0, float* @gf0, align 4<br class="">
store float %a1, float* @gf1, align 4<br class="">
@@ -316,8 +315,6 @@ entry:<br class="">
<br class="">
; NOODDSPREG-LABEL: callee2:<br class="">
<br class="">
-; NOODDSPREG: addiu $sp, $sp, -[[OFFSET:[0-9]+]]<br class="">
-<br class="">
; Check that first 10 arguments are received in even float registers<br class="">
; f0, f2, ... , f18. Check that 11th argument is received on stack.<br class="">
<br class="">
@@ -333,7 +330,7 @@ entry:<br class="">
; NOODDSPREG-DAG: swc1 $f16, 32($[[R0]])<br class="">
; NOODDSPREG-DAG: swc1 $f18, 36($[[R0]])<br class="">
<br class="">
-; NOODDSPREG-DAG: lwc1 $[[F0:f[0-9]*[02468]]], [[OFFSET]]($sp)<br class="">
+; NOODDSPREG-DAG: lwc1 $[[F0:f[0-9]*[02468]]], 0($sp)<br class="">
; NOODDSPREG-DAG: swc1 $[[F0]], 40($[[R0]])<br class="">
<br class="">
store float %a0, float* getelementptr ([11 x float], [11 x float]* @fa, i32 0, i32 0), align 4<br class="">
@@ -397,7 +394,6 @@ entry:<br class="">
<br class="">
; FP64-NOODDSPREG-LABEL: callee3:<br class="">
<br class="">
-; FP64-NOODDSPREG: addiu $sp, $sp, -[[OFFSET:[0-9]+]]<br class="">
<br class="">
; Check that first 10 arguments are received in even float registers<br class="">
; f0, f2, ... , f18. Check that 11th argument is received on stack.<br class="">
@@ -414,7 +410,7 @@ entry:<br class="">
; FP64-NOODDSPREG-DAG: sdc1 $f16, 64($[[R0]])<br class="">
; FP64-NOODDSPREG-DAG: sdc1 $f18, 72($[[R0]])<br class="">
<br class="">
-; FP64-NOODDSPREG-DAG: ldc1 $[[F0:f[0-9]*[02468]]], [[OFFSET]]($sp)<br class="">
+; FP64-NOODDSPREG-DAG: ldc1 $[[F0:f[0-9]*[02468]]], 0($sp)<br class="">
; FP64-NOODDSPREG-DAG: sdc1 $[[F0]], 80($[[R0]])<br class="">
<br class="">
store double %a0, double* getelementptr ([11 x double], [11 x double]* @da, i32 0, i32 0), align 8<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/l<wbr class="">oad-store-left-right.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/load-store-left-right.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/load-store-left-right.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/l<wbr class="">oad-store-left-right.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/l<wbr class="">oad-store-left-right.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -250,12 +250,18 @@ entry:<br class="">
; MIPS64-EB: ld $[[PTR:[0-9]+]], %got_disp(struct_s0)(<br class="">
; MIPS64R6: ld $[[PTR:[0-9]+]], %got_disp(struct_s0)(<br class="">
<br class="">
-; FIXME: We should be able to do better than this on MIPS32r6/MIPS64r6 since<br class="">
-; we have unaligned halfword load/store available<br class="">
-; ALL-DAG: lbu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
-; ALL-DAG: sb $[[R1]], 2($[[PTR]])<br class="">
-; ALL-DAG: lbu $[[R1:[0-9]+]], 1($[[PTR]])<br class="">
-; ALL-DAG: sb $[[R1]], 3($[[PTR]])<br class="">
+; MIPS32-DAG: lbu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS32-DAG: sb $[[R1]], 2($[[PTR]])<br class="">
+; MIPS32-DAG: lbu $[[R2:[0-9]+]], 1($[[PTR]])<br class="">
+; MIPS32-DAG: sb $[[R2]], 3($[[PTR]])<br class="">
+<br class="">
+; MIPS32R6: lhu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS32R6: sh $[[R1]], 2($[[PTR]])<br class="">
+<br class="">
+; MIPS64-DAG: lbu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS64-DAG: sb $[[R1]], 2($[[PTR]])<br class="">
+; MIPS64-DAG: lbu $[[R2:[0-9]+]], 1($[[PTR]])<br class="">
+; MIPS64-DAG: sb $[[R2]], 3($[[PTR]])<br class="">
<br class="">
%0 = load %struct.S0, %struct.S0* getelementptr inbounds (%struct.S0, %struct.S0* @struct_s0, i32 0), align 1<br class="">
store %struct.S0 %0, %struct.S0* getelementptr inbounds (%struct.S0, %struct.S0* @struct_s0, i32 1), align 1<br class="">
@@ -268,37 +274,54 @@ entry:<br class="">
<br class="">
; MIPS32-EL: lw $[[PTR:[0-9]+]], %got(struct_s1)(<br class="">
; MIPS32-EB: lw $[[PTR:[0-9]+]], %got(struct_s1)(<br class="">
-; MIPS32-DAG: lbu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
-; MIPS32-DAG: sb $[[R1]], 4($[[PTR]])<br class="">
-; MIPS32-DAG: lbu $[[R1:[0-9]+]], 1($[[PTR]])<br class="">
-; MIPS32-DAG: sb $[[R1]], 5($[[PTR]])<br class="">
-; MIPS32-DAG: lbu $[[R1:[0-9]+]], 2($[[PTR]])<br class="">
-; MIPS32-DAG: sb $[[R1]], 6($[[PTR]])<br class="">
-; MIPS32-DAG: lbu $[[R1:[0-9]+]], 3($[[PTR]])<br class="">
-; MIPS32-DAG: sb $[[R1]], 7($[[PTR]])<br class="">
+; MIPS32-EL-DAG: lwl $[[R1:[0-9]+]], 3($[[PTR]])<br class="">
+; MIPS32-EL-DAG: lwr $[[R1]], 0($[[PTR]])<br class="">
+; MIPS32-EL-DAG: swl $[[R1]], 7($[[PTR]])<br class="">
+; MIPS32-EL-DAG: swr $[[R1]], 4($[[PTR]])<br class="">
+; MIPS32-EB-DAG: lwl $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS32-EB-DAG: lwr $[[R1]], 3($[[PTR]])<br class="">
+; MIPS32-EB-DAG: swl $[[R1]], 4($[[PTR]])<br class="">
+; MIPS32-EB-DAG: swr $[[R1]], 7($[[PTR]])<br class="">
+<br class="">
+; MIPS32-NOLEFTRIGHT-DAG: lbu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS32-NOLEFTRIGHT-DAG: sb $[[R1]], 4($[[PTR]])<br class="">
+; MIPS32-NOLEFTRIGHT-DAG: lbu $[[R1:[0-9]+]], 1($[[PTR]])<br class="">
+; MIPS32-NOLEFTRIGHT-DAG: sb $[[R1]], 5($[[PTR]])<br class="">
+; MIPS32-NOLEFTRIGHT-DAG: lbu $[[R1:[0-9]+]], 2($[[PTR]])<br class="">
+; MIPS32-NOLEFTRIGHT-DAG: sb $[[R1]], 6($[[PTR]])<br class="">
+; MIPS32-NOLEFTRIGHT-DAG: lbu $[[R1:[0-9]+]], 3($[[PTR]])<br class="">
+; MIPS32-NOLEFTRIGHT-DAG: sb $[[R1]], 7($[[PTR]])<br class="">
<br class="">
; MIPS32R6: lw $[[PTR:[0-9]+]], %got(struct_s1)(<br class="">
-; MIPS32R6-DAG: lhu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
-; MIPS32R6-DAG: sh $[[R1]], 4($[[PTR]])<br class="">
-; MIPS32R6-DAG: lhu $[[R1:[0-9]+]], 2($[[PTR]])<br class="">
-; MIPS32R6-DAG: sh $[[R1]], 6($[[PTR]])<br class="">
+; MIPS32R6-DAG: lw $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS32R6-DAG: sw $[[R1]], 4($[[PTR]])<br class="">
<br class="">
; MIPS64-EL: ld $[[PTR:[0-9]+]], %got_disp(struct_s1)(<br class="">
; MIPS64-EB: ld $[[PTR:[0-9]+]], %got_disp(struct_s1)(<br class="">
-; MIPS64-DAG: lbu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
-; MIPS64-DAG: sb $[[R1]], 4($[[PTR]])<br class="">
-; MIPS64-DAG: lbu $[[R1:[0-9]+]], 1($[[PTR]])<br class="">
-; MIPS64-DAG: sb $[[R1]], 5($[[PTR]])<br class="">
-; MIPS64-DAG: lbu $[[R1:[0-9]+]], 2($[[PTR]])<br class="">
-; MIPS64-DAG: sb $[[R1]], 6($[[PTR]])<br class="">
-; MIPS64-DAG: lbu $[[R1:[0-9]+]], 3($[[PTR]])<br class="">
-; MIPS64-DAG: sb $[[R1]], 7($[[PTR]])<br class="">
+<br class="">
+; MIPS64-EL-DAG: lwl $[[R1:[0-9]+]], 3($[[PTR]])<br class="">
+; MIPS64-EL-DAG: lwr $[[R1]], 0($[[PTR]])<br class="">
+; MIPS64-EL-DAG: swl $[[R1]], 7($[[PTR]])<br class="">
+; MIPS64-EL-DAG: swr $[[R1]], 4($[[PTR]])<br class="">
+<br class="">
+; MIPS64-EB-DAG: lwl $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS64-EB-DAG: lwr $[[R1]], 3($[[PTR]])<br class="">
+; MIPS64-EB-DAG: swl $[[R1]], 4($[[PTR]])<br class="">
+; MIPS64-EB-DAG: swr $[[R1]], 7($[[PTR]])<br class="">
+<br class="">
+<br class="">
+; MIPS64-NOLEFTRIGHT-DAG: lbu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS64-NOLEFTRIGHT-DAG: sb $[[R1]], 4($[[PTR]])<br class="">
+; MIPS64-NOLEFTRIGHT-DAG: lbu $[[R1:[0-9]+]], 1($[[PTR]])<br class="">
+; MIPS64-NOLEFTRIGHT-DAG: sb $[[R1]], 5($[[PTR]])<br class="">
+; MIPS64-NOLEFTRIGHT-DAG: lbu $[[R1:[0-9]+]], 2($[[PTR]])<br class="">
+; MIPS64-NOLEFTRIGHT-DAG: sb $[[R1]], 6($[[PTR]])<br class="">
+; MIPS64-NOLEFTRIGHT-DAG: lbu $[[R1:[0-9]+]], 3($[[PTR]])<br class="">
+; MIPS64-NOLEFTRIGHT-DAG: sb $[[R1]], 7($[[PTR]])<br class="">
<br class="">
; MIPS64R6: ld $[[PTR:[0-9]+]], %got_disp(struct_s1)(<br class="">
-; MIPS64R6-DAG: lhu $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
-; MIPS64R6-DAG: sh $[[R1]], 4($[[PTR]])<br class="">
-; MIPS64R6-DAG: lhu $[[R1:[0-9]+]], 2($[[PTR]])<br class="">
-; MIPS64R6-DAG: sh $[[R1]], 6($[[PTR]])<br class="">
+; MIPS64R6-DAG: lw $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS64R6-DAG: sw $[[R1]], 4($[[PTR]])<br class="">
<br class="">
%0 = load %struct.S1, %struct.S1* getelementptr inbounds (%struct.S1, %struct.S1* @struct_s1, i32 0), align 1<br class="">
store %struct.S1 %0, %struct.S1* getelementptr inbounds (%struct.S1, %struct.S1* @struct_s1, i32 1), align 1<br class="">
@@ -336,30 +359,21 @@ entry:<br class="">
; MIPS32R6-DAG: sw $[[R1]], 12($[[PTR]])<br class="">
<br class="">
; MIPS64-EL: ld $[[PTR:[0-9]+]], %got_disp(struct_s2)(<br class="">
-; MIPS64-EL-DAG: lwl $[[R1:[0-9]+]], 3($[[PTR]])<br class="">
-; MIPS64-EL-DAG: lwr $[[R1]], 0($[[PTR]])<br class="">
-; MIPS64-EL-DAG: swl $[[R1]], 11($[[PTR]])<br class="">
-; MIPS64-EL-DAG: swr $[[R1]], 8($[[PTR]])<br class="">
-; MIPS64-EL-DAG: lwl $[[R1:[0-9]+]], 7($[[PTR]])<br class="">
-; MIPS64-EL-DAG: lwr $[[R1]], 4($[[PTR]])<br class="">
-; MIPS64-EL-DAG: swl $[[R1]], 15($[[PTR]])<br class="">
-; MIPS64-EL-DAG: swr $[[R1]], 12($[[PTR]])<br class="">
+<br class="">
+; MIPS64-EL-DAG: ldl $[[R1:[0-9]+]], 7($[[PTR]])<br class="">
+; MIPS64-EL-DAG: ldr $[[R1]], 0($[[PTR]])<br class="">
+; MIPS64-EL-DAG: sdl $[[R1]], 15($[[PTR]])<br class="">
+; MIPS64-EL-DAG: sdr $[[R1]], 8($[[PTR]])<br class="">
<br class="">
; MIPS64-EB: ld $[[PTR:[0-9]+]], %got_disp(struct_s2)(<br class="">
-; MIPS64-EB-DAG: lwl $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
-; MIPS64-EB-DAG: lwr $[[R1]], 3($[[PTR]])<br class="">
-; MIPS64-EB-DAG: swl $[[R1]], 8($[[PTR]])<br class="">
-; MIPS64-EB-DAG: swr $[[R1]], 11($[[PTR]])<br class="">
-; MIPS64-EB-DAG: lwl $[[R1:[0-9]+]], 4($[[PTR]])<br class="">
-; MIPS64-EB-DAG: lwr $[[R1]], 7($[[PTR]])<br class="">
-; MIPS64-EB-DAG: swl $[[R1]], 12($[[PTR]])<br class="">
-; MIPS64-EB-DAG: swr $[[R1]], 15($[[PTR]])<br class="">
+; MIPS64-EB-DAG: ldl $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS64-EB-DAG: ldr $[[R1]], 7($[[PTR]])<br class="">
+; MIPS64-EB-DAG: sdl $[[R1]], 8($[[PTR]])<br class="">
+; MIPS64-EB-DAG: sdr $[[R1]], 15($[[PTR]])<br class="">
<br class="">
; MIPS64R6: ld $[[PTR:[0-9]+]], %got_disp(struct_s2)(<br class="">
-; MIPS64R6-DAG: lw $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
-; MIPS64R6-DAG: sw $[[R1]], 8($[[PTR]])<br class="">
-; MIPS64R6-DAG: lw $[[R1:[0-9]+]], 4($[[PTR]])<br class="">
-; MIPS64R6-DAG: sw $[[R1]], 12($[[PTR]])<br class="">
+; MIPS64R6-DAG: ld $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS64R6-DAG: sd $[[R1]], 8($[[PTR]])<br class="">
<br class="">
%0 = load %struct.S2, %struct.S2* getelementptr inbounds (%struct.S2, %struct.S2* @struct_s2, i32 0), align 1<br class="">
store %struct.S2 %0, %struct.S2* getelementptr inbounds (%struct.S2, %struct.S2* @struct_s2, i32 1), align 1<br class="">
@@ -416,17 +430,17 @@ entry:<br class="">
; MIPS64-EL-DAG: lwl $[[R1:[0-9]+]], 3($[[PTR]])<br class="">
; MIPS64-EL-DAG: lwr $[[R1]], 0($[[PTR]])<br class="">
<br class="">
-; MIPS64-EB: ld $[[SPTR:[0-9]+]], %got_disp(arr)(<br class="">
-; MIPS64-EB-DAG: lwl $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
-; MIPS64-EB-DAG: lwr $[[R1]], 3($[[PTR]])<br class="">
-; MIPS64-EB-DAG: dsll $[[R1]], $[[R1]], 32<br class="">
+; MIPS64-EB: ld $[[SPTR:[0-9]+]], %got_disp(arr)(<br class="">
; MIPS64-EB-DAG: lbu $[[R2:[0-9]+]], 5($[[PTR]])<br class="">
; MIPS64-EB-DAG: lbu $[[R3:[0-9]+]], 4($[[PTR]])<br class="">
; MIPS64-EB-DAG: dsll $[[T0:[0-9]+]], $[[R3]], 8<br class="">
; MIPS64-EB-DAG: or $[[T1:[0-9]+]], $[[T0]], $[[R2]]<br class="">
-; MIPS64-EB-DAG: dsll $[[T1]], $[[T1]], 16<br class="">
-; MIPS64-EB-DAG: or $[[T3:[0-9]+]], $[[R1]], $[[T1]]<br class="">
; MIPS64-EB-DAG: lbu $[[R4:[0-9]+]], 6($[[PTR]])<br class="">
+; MIPS64-EB-DAG: dsll $[[T1]], $[[T1]], 16<br class="">
+; MIPS64-EB-DAG: lwl $[[R1:[0-9]+]], 0($[[PTR]])<br class="">
+; MIPS64-EB-DAG: lwr $[[R1]], 3($[[PTR]])<br class="">
+; MIPS64-EB-DAG: dsll $[[R5:[0-9]+]], $[[R1]], 32<br class="">
+; MIPS64-EB-DAG: or $[[T3:[0-9]+]], $[[R5]], $[[T1]]<br class="">
; MIPS64-EB-DAG: dsll $[[T4:[0-9]+]], $[[R4]], 8<br class="">
; MIPS64-EB-DAG: or $4, $[[T3]], $[[T4]]<br class="">
<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/m<wbr class="">icromips-li.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/micromips-li.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/micromips-li.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/m<wbr class="">icromips-li.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/m<wbr class="">icromips-li.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -13,6 +13,6 @@ entry:<br class="">
ret i32 0<br class="">
}<br class="">
<br class="">
-; CHECK: li16 ${{[2-7]|16|17}}, 1<br class="">
; CHECK: addiu ${{[0-9]+}}, $zero, 2148<br class="">
+; CHECK: li16 ${{[2-7]|16|17}}, 1<br class="">
; CHECK: ori ${{[0-9]+}}, $zero, 33332<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/m<wbr class="">ips64-f128-call.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/mips64-f128-call.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/mips64-f128-call.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/m<wbr class="">ips64-f128-call.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/m<wbr class="">ips64-f128-call.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -4,8 +4,8 @@<br class="">
@gld1 = external global fp128<br class="">
<br class="">
; CHECK: foo0<br class="">
-; CHECK: sdc1 $f12, %lo(gld0)(${{[0-9]+}})<br class="">
-; CHECK: sdc1 $f13, 8(${{[0-9]+}})<br class="">
+; CHECK-DAG: sdc1 $f12, %lo(gld0)(${{[0-9]+}})<br class="">
+; CHECK-DAG: sdc1 $f13, 8(${{[0-9]+}})<br class="">
<br class="">
define void @foo0(fp128 %a0) {<br class="">
entry:<br class="">
@@ -14,8 +14,8 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK: foo1<br class="">
-; CHECK: ldc1 $f12, %lo(gld0)(${{[0-9]+}})<br class="">
-; CHECK: ldc1 $f13, 8(${{[0-9]+}})<br class="">
+; CHECK-DAG: ldc1 $f12, %lo(gld0)(${{[0-9]+}})<br class="">
+; CHECK-DAG: ldc1 $f13, 8(${{[0-9]+}})<br class="">
<br class="">
define void @foo1() {<br class="">
entry:<br class="">
@@ -26,11 +26,11 @@ entry:<br class="">
<br class="">
declare void @foo2(fp128)<br class="">
<br class="">
+<br class="">
; CHECK: foo3:<br class="">
-; CHECK: daddiu $[[R0:[0-9]+]], ${{[0-9]+}}, %hi(gld0)<br class="">
-; CHECK: dsll $[[R1:[0-9]+]], $[[R0]], 16<br class="">
+<br class="">
+; CHECK: daddiu $[[R2:[0-9]+]], $[[R1:[0-9]+]], %lo(gld0)<br class="">
; CHECK: sdc1 $f0, %lo(gld0)($[[R1]])<br class="">
-; CHECK: daddiu $[[R2:[0-9]]], $[[R1]], %lo(gld0)<br class="">
; CHECK: sdc1 $f2, 8($[[R2]])<br class="">
; CHECK: daddiu $[[R3:[0-9]+]], ${{[0-9]+}}, %hi(gld1)<br class="">
; CHECK: dsll $[[R4:[0-9]+]], $[[R3]], 16<br class="">
@@ -39,7 +39,6 @@ declare void @foo2(fp128)<br class="">
; CHECK: ldc1 $f2, 8($[[R5]])<br class="">
<br class="">
<br class="">
-<br class="">
define fp128 @foo3() {<br class="">
entry:<br class="">
%call = tail call fp128 @foo4()<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/m<wbr class="">ips64-f128.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/mips64-f128.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/mips64-f128.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/m<wbr class="">ips64-f128.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/m<wbr class="">ips64-f128.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -577,10 +577,10 @@ entry:<br class="">
<br class="">
; ALL-LABEL: store_LD_LD:<br class="">
; ALL: ld $[[R0:[0-9]+]], %got_disp(gld1)<br class="">
-; ALL: ld $[[R1:[0-9]+]], 0($[[R0]])<br class="">
; ALL: ld $[[R2:[0-9]+]], 8($[[R0]])<br class="">
; ALL: ld $[[R3:[0-9]+]], %got_disp(gld0)<br class="">
; ALL: sd $[[R2]], 8($[[R3]])<br class="">
+; ALL: ld $[[R1:[0-9]+]], 0($[[R0]])<br class="">
; ALL: sd $[[R1]], 0($[[R3]])<br class="">
<br class="">
define void @store_LD_LD() {<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/m<wbr class="">no-ldc1-sdc1.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/mno-ldc1-sdc1.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/mno-ldc1-sdc1.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/m<wbr class="">no-ldc1-sdc1.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/m<wbr class="">no-ldc1-sdc1.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -130,12 +130,12 @@<br class="">
; MM-MNO-PIC: addiu $[[R1:[0-9]+]], $[[R0]], %lo(_gp_disp)<br class="">
; MM-MNO-PIC: addu $[[R2:[0-9]+]], $[[R1]], $25<br class="">
; MM-MNO-PIC: lw $[[R3:[0-9]+]], %got(g0)($[[R2]])<br class="">
-; MM-MNO-PIC: lw16 $[[R4:[0-9]+]], 0($[[R3]])<br class="">
-; MM-MNO-PIC: lw16 $[[R5:[0-9]+]], 4($[[R3]])<br class="">
-; MM-MNO-LE-PIC: mtc1 $[[R4]], $f0<br class="">
-; MM-MNO-LE-PIC: mthc1 $[[R5]], $f0<br class="">
-; MM-MNO-BE-PIC: mtc1 $[[R5]], $f0<br class="">
-; MM-MNO-BE-PIC: mthc1 $[[R4]], $f0<br class="">
+; MM-MNO-PIC-DAG: lw16 $[[R4:[0-9]+]], 0($[[R3]])<br class="">
+; MM-MNO-PIC-DAG: lw16 $[[R5:[0-9]+]], 4($[[R3]])<br class="">
+; MM-MNO-LE-PIC-DAG: mtc1 $[[R4]], $f0<br class="">
+; MM-MNO-LE-PIC-DAG: mthc1 $[[R5]], $f0<br class="">
+; MM-MNO-BE-PIC-DAG: mtc1 $[[R5]], $f0<br class="">
+; MM-MNO-BE-PIC-DAG: mthc1 $[[R4]], $f0<br class="">
<br class="">
; MM-STATIC-PIC: lui $[[R0:[0-9]+]], %hi(g0)<br class="">
; MM-STATIC-PIC: ldc1 $f0, %lo(g0)($[[R0]])<br class="">
@@ -214,13 +214,13 @@ entry:<br class="">
; MM-MNO-PIC: lui $[[R0:[0-9]+]], %hi(_gp_disp)<br class="">
; MM-MNO-PIC: addiu $[[R1:[0-9]+]], $[[R0]], %lo(_gp_disp)<br class="">
; MM-MNO-PIC: addu $[[R2:[0-9]+]], $[[R1]], $25<br class="">
-; MM-MNO-LE-PIC: mfc1 $[[R3:[0-9]+]], $f12<br class="">
-; MM-MNO-BE-PIC: mfhc1 $[[R3:[0-9]+]], $f12<br class="">
-; MM-MNO-PIC: lw $[[R4:[0-9]+]], %got(g0)($[[R2]])<br class="">
-; MM-MNO-PIC: sw16 $[[R3]], 0($[[R4]])<br class="">
-; MM-MNO-LE-PIC: mfhc1 $[[R5:[0-9]+]], $f12<br class="">
-; MM-MNO-BE-PIC: mfc1 $[[R5:[0-9]+]], $f12<br class="">
-; MM-MNO-PIC: sw16 $[[R5]], 4($[[R4]])<br class="">
+; MM-MNO-LE-PIC-DAG: mfc1 $[[R3:[0-9]+]], $f12<br class="">
+; MM-MNO-BE-PIC-DAG: mfhc1 $[[R3:[0-9]+]], $f12<br class="">
+; MM-MNO-PIC-DAG: lw $[[R4:[0-9]+]], %got(g0)($[[R2]])<br class="">
+; MM-MNO-PIC-DAG: sw16 $[[R3]], 0($[[R4]])<br class="">
+; MM-MNO-LE-PIC-DAG: mfhc1 $[[R5:[0-9]+]], $f12<br class="">
+; MM-MNO-BE-PIC-DAG: mfc1 $[[R5:[0-9]+]], $f12<br class="">
+; MM-MNO-PIC-DAG: sw16 $[[R5]], 4($[[R4]])<br class="">
<br class="">
; MM-STATIC-PIC: lui $[[R0:[0-9]+]], %hi(g0)<br class="">
; MM-STATIC-PIC: sdc1 $f12, %lo(g0)($[[R0]])<br class="">
@@ -267,8 +267,8 @@ entry:<br class="">
<br class="">
; MM-MNO-PIC: sll16 $[[R0:[0-9]+]], $5, 3<br class="">
; MM-MNO-PIC: addu16 $[[R1:[0-9]+]], $4, $[[R0]]<br class="">
-; MM-MNO-PIC: lw16 $[[R2:[0-9]+]], 0($[[R1]])<br class="">
-; MM-MNO-PIC: lw16 $[[R3:[0-9]+]], 4($[[R1]])<br class="">
+; MM-MNO-PIC-DAG: lw16 $[[R2:[0-9]+]], 0($[[R1]])<br class="">
+; MM-MNO-PIC-DAG: lw16 $[[R3:[0-9]+]], 4($[[R1]])<br class="">
; MM-MNO-LE-PIC: mtc1 $[[R2]], $f0<br class="">
; MM-MNO-LE-PIC: mthc1 $[[R3]], $f0<br class="">
; MM-MNO-BE-PIC: mtc1 $[[R3]], $f0<br class="">
@@ -313,14 +313,14 @@ entry:<br class="">
; MM: addu16 $[[R1:[0-9]+]], $6, $[[R0]]<br class="">
; MM: sdc1 $f12, 0($[[R1]])<br class="">
<br class="">
-; MM-MNO-PIC: sll16 $[[R0:[0-9]+]], $7, 3<br class="">
-; MM-MNO-PIC: addu16 $[[R1:[0-9]+]], $6, $[[R0]]<br class="">
-; MM-MNO-LE-PIC: mfc1 $[[R2:[0-9]+]], $f12<br class="">
-; MM-MNO-BE-PIC: mfhc1 $[[R2:[0-9]+]], $f12<br class="">
-; MM-MNO-PIC: sw16 $[[R2]], 0($[[R1]])<br class="">
-; MM-MNO-LE-PIC: mfhc1 $[[R3:[0-9]+]], $f12<br class="">
-; MM-MNO-BE-PIC: mfc1 $[[R3:[0-9]+]], $f12<br class="">
-; MM-MNO-PIC: sw16 $[[R3]], 4($[[R1]])<br class="">
+; MM-MNO-PIC: sll16 $[[R0:[0-9]+]], $7, 3<br class="">
+; MM-MNO-PIC: addu16 $[[R1:[0-9]+]], $6, $[[R0]]<br class="">
+; MM-MNO-LE-PIC-DAG: mfc1 $[[R2:[0-9]+]], $f12<br class="">
+; MM-MNO-BE-PIC-DAG: mfhc1 $[[R2:[0-9]+]], $f12<br class="">
+; MM-MNO-PIC-DAG: sw16 $[[R2]], 0($[[R1]])<br class="">
+; MM-MNO-LE-PIC-DAG: mfhc1 $[[R3:[0-9]+]], $f12<br class="">
+; MM-MNO-BE-PIC-DAG: mfc1 $[[R3:[0-9]+]], $f12<br class="">
+; MM-MNO-PIC-DAG: sw16 $[[R3]], 4($[[R1]])<br class="">
<br class="">
; MM-STATIC-PIC: sll16 $[[R0:[0-9]+]], $7, 3<br class="">
; MM-STATIC-PIC: addu16 $[[R1:[0-9]+]], $6, $[[R0]]<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/m<wbr class="">sa/f16-llvm-ir.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/msa/f16-llvm-ir.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/msa/f16-llvm-ir.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/m<wbr class="">sa/f16-llvm-ir.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/m<wbr class="">sa/f16-llvm-ir.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -234,15 +234,15 @@ entry:<br class="">
; MIPS32: insert.w $w[[W0]][1], $[[R1]]<br class="">
; MIPS32: insert.w $w[[W0]][3], $[[R1]]<br class="">
<br class="">
-; MIPS64-N64: ld $[[R3:[0-9]+]], %got_disp(h)<br class="">
-; MIPS64-N32: lw $[[R3:[0-9]+]], %got_disp(h)<br class="">
-; MIPS64: dmfc1 $[[R1:[0-9]+]], $f[[F2]]<br class="">
-; MIPS64: fill.d $w[[W0:[0-9]+]], $[[R1]]<br class="">
+; MIPS64-N64-DAG: ld $[[R3:[0-9]+]], %got_disp(h)<br class="">
+; MIPS64-N32-DAG: lw $[[R3:[0-9]+]], %got_disp(h)<br class="">
+; MIPS64-DAG: dmfc1 $[[R1:[0-9]+]], $f[[F2]]<br class="">
+; MIPS64-DAG: fill.d $w[[W0:[0-9]+]], $[[R1]]<br class="">
<br class="">
-; ALL: fexdo.w $w[[W1:[0-9]+]], $w[[W0]], $w[[W0]]<br class="">
-; ALL: fexdo.h $w[[W2:[0-9]+]], $w[[W1]], $w[[W1]]<br class="">
+; ALL-DAG: fexdo.w $w[[W1:[0-9]+]], $w[[W0]], $w[[W0]]<br class="">
+; ALL-DAG: fexdo.h $w[[W2:[0-9]+]], $w[[W1]], $w[[W1]]<br class="">
<br class="">
-; MIPS32: lw $[[R3:[0-9]+]], %got(h)<br class="">
+; MIPS32-DAG: lw $[[R3:[0-9]+]], %got(h)<br class="">
<br class="">
; ALL: copy_u.h $[[R2:[0-9]+]], $w[[W2]]<br class="">
; ALL: sh $[[R2]], 0($[[R3]])<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/m<wbr class="">sa/i5_ld_st.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/msa/i5_ld_st.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/msa/i5_ld_st.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/m<wbr class="">sa/i5_ld_st.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/m<wbr class="">sa/i5_ld_st.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -336,8 +336,8 @@ entry:<br class="">
<br class="">
; CHECK: llvm_mips_st_b_valid_range_tes<wbr class="">ts:<br class="">
; CHECK: ld.b<br class="">
-; CHECK: st.b [[R1:\$w[0-9]+]], -512(<br class="">
-; CHECK: st.b [[R1:\$w[0-9]+]], 511(<br class="">
+; CHECK-DAG: st.b [[R1:\$w[0-9]+]], -512(<br class="">
+; CHECK-DAG: st.b [[R1:\$w[0-9]+]], 511(<br class="">
; CHECK: .size llvm_mips_st_b_valid_range_tes<wbr class="">ts<br class="">
;<br class="">
<br class="">
@@ -351,10 +351,10 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK: llvm_mips_st_b_invalid_range_t<wbr class="">ests:<br class="">
-; CHECK: addiu $2, $1, -513<br class="">
+; CHECK: addiu $2, $1, 512<br class="">
; CHECK: ld.b<br class="">
; CHECK: st.b [[R1:\$w[0-9]+]], 0(<br class="">
-; CHECK: addiu $1, $1, 512<br class="">
+; CHECK: addiu $1, $1, -513<br class="">
; CHECK: st.b [[R1:\$w[0-9]+]], 0(<br class="">
; CHECK: .size llvm_mips_st_b_invalid_range_t<wbr class="">ests<br class="">
;<br class="">
@@ -404,8 +404,8 @@ entry:<br class="">
<br class="">
; CHECK: llvm_mips_st_h_valid_range_tes<wbr class="">ts:<br class="">
; CHECK: ld.h<br class="">
-; CHECK: st.h [[R1:\$w[0-9]+]], -1024(<br class="">
-; CHECK: st.h [[R1:\$w[0-9]+]], 1022(<br class="">
+; CHECK-DAG: st.h [[R1:\$w[0-9]+]], -1024(<br class="">
+; CHECK-DAG: st.h [[R1:\$w[0-9]+]], 1022(<br class="">
; CHECK: .size llvm_mips_st_h_valid_range_tes<wbr class="">ts<br class="">
;<br class="">
<br class="">
@@ -419,10 +419,10 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK: llvm_mips_st_h_invalid_range_t<wbr class="">ests:<br class="">
-; CHECK: addiu $2, $1, -1026<br class="">
+; CHECK: addiu $2, $1, 1024<br class="">
; CHECK: ld.h<br class="">
; CHECK: st.h [[R1:\$w[0-9]+]], 0(<br class="">
-; CHECK: addiu $1, $1, 1024<br class="">
+; CHECK: addiu $1, $1, -1026<br class="">
; CHECK: st.h [[R1:\$w[0-9]+]], 0(<br class="">
; CHECK: .size llvm_mips_st_h_invalid_range_t<wbr class="">ests<br class="">
;<br class="">
@@ -472,8 +472,8 @@ entry:<br class="">
<br class="">
; CHECK: llvm_mips_st_w_valid_range_tes<wbr class="">ts:<br class="">
; CHECK: ld.w<br class="">
-; CHECK: st.w [[R1:\$w[0-9]+]], -2048(<br class="">
-; CHECK: st.w [[R1:\$w[0-9]+]], 2044(<br class="">
+; CHECK-DAG: st.w [[R1:\$w[0-9]+]], -2048(<br class="">
+; CHECK-DAG: st.w [[R1:\$w[0-9]+]], 2044(<br class="">
; CHECK: .size llvm_mips_st_w_valid_range_tes<wbr class="">ts<br class="">
;<br class="">
<br class="">
@@ -487,10 +487,10 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK: llvm_mips_st_w_invalid_range_t<wbr class="">ests:<br class="">
-; CHECK: addiu $2, $1, -2052<br class="">
+; CHECK: addiu $2, $1, 2048<br class="">
; CHECK: ld.w<br class="">
; CHECK: st.w [[R1:\$w[0-9]+]], 0(<br class="">
-; CHECK: addiu $1, $1, 2048<br class="">
+; CHECK: addiu $1, $1, -2052<br class="">
; CHECK: st.w [[R1:\$w[0-9]+]], 0(<br class="">
; CHECK: .size llvm_mips_st_w_invalid_range_t<wbr class="">ests<br class="">
;<br class="">
@@ -540,8 +540,8 @@ entry:<br class="">
<br class="">
; CHECK: llvm_mips_st_d_valid_range_tes<wbr class="">ts:<br class="">
; CHECK: ld.d<br class="">
-; CHECK: st.d [[R1:\$w[0-9]+]], -4096(<br class="">
-; CHECK: st.d [[R1:\$w[0-9]+]], 4088(<br class="">
+; CHECK-DAG: st.d [[R1:\$w[0-9]+]], -4096(<br class="">
+; CHECK-DAG: st.d [[R1:\$w[0-9]+]], 4088(<br class="">
; CHECK: .size llvm_mips_st_d_valid_range_tes<wbr class="">ts<br class="">
;<br class="">
<br class="">
@@ -555,10 +555,10 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK: llvm_mips_st_d_invalid_range_t<wbr class="">ests:<br class="">
-; CHECK: addiu $2, $1, -4104<br class="">
+; CHECK: addiu $2, $1, 4096<br class="">
; CHECK: ld.d<br class="">
; CHECK: st.d [[R1:\$w[0-9]+]], 0(<br class="">
-; CHECK: addiu $1, $1, 4096<br class="">
+; CHECK: addiu $1, $1, -4104<br class="">
; CHECK: st.d [[R1:\$w[0-9]+]], 0(<br class="">
; CHECK: .size llvm_mips_st_d_invalid_range_t<wbr class="">ests<br class="">
;<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/o<wbr class="">32_cc_byval.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/o32_cc_byval.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/o32_cc_byval.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/o<wbr class="">32_cc_byval.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/o<wbr class="">32_cc_byval.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -45,20 +45,18 @@ declare void @callee3(float, %struct.S3*<br class="">
define void @f2(float %f, %struct.S1* nocapture byval %s1) nounwind {<br class="">
entry:<br class="">
; CHECK: addiu $sp, $sp, -48<br class="">
-; CHECK: sw $7, 60($sp)<br class="">
-; CHECK: sw $6, 56($sp)<br class="">
-; CHECK: lw $4, 80($sp)<br class="">
-; CHECK: ldc1 $f[[F0:[0-9]+]], 72($sp)<br class="">
-; CHECK: lw $[[R3:[0-9]+]], 64($sp)<br class="">
-; CHECK: lw $[[R4:[0-9]+]], 68($sp)<br class="">
-; CHECK: lw $[[R2:[0-9]+]], 60($sp)<br class="">
-; CHECK: lh $[[R1:[0-9]+]], 58($sp)<br class="">
-; CHECK: lb $[[R0:[0-9]+]], 56($sp)<br class="">
-; CHECK: sw $[[R0]], 32($sp)<br class="">
-; CHECK: sw $[[R1]], 28($sp)<br class="">
-; CHECK: sw $[[R2]], 24($sp)<br class="">
-; CHECK: sw $[[R4]], 20($sp)<br class="">
-; CHECK: sw $[[R3]], 16($sp)<br class="">
+; CHECK-DAG: sw $7, 60($sp)<br class="">
+; CHECK-DAG: sw $6, 56($sp)<br class="">
+; CHECK-DAG: ldc1 $f[[F0:[0-9]+]], 72($sp)<br class="">
+; CHECK-DAG: lw $[[R3:[0-9]+]], 64($sp)<br class="">
+; CHECK-DAG: lw $[[R4:[0-9]+]], 68($sp)<br class="">
+; CHECK-DAG: lh $[[R1:[0-9]+]], 58($sp)<br class="">
+; CHECK-DAG: lb $[[R0:[0-9]+]], 56($sp)<br class="">
+; CHECK-DAG: sw $[[R0]], 32($sp)<br class="">
+; CHECK-DAG: sw $[[R1]], 28($sp)<br class="">
+; CHECK-DAG: sw $[[R4]], 20($sp)<br class="">
+; CHECK-DAG: sw $[[R3]], 16($sp)<br class="">
+; CHECK-DAG: sw $7, 24($sp)<br class="">
; CHECK: mfc1 $6, $f[[F0]]<br class="">
<br class="">
%i2 = getelementptr inbounds %struct.S1, %struct.S1* %s1, i32 0, i32 5<br class="">
@@ -82,13 +80,11 @@ declare void @callee4(i32, double, i64,<br class="">
define void @f3(%struct.S2* nocapture byval %s2) nounwind {<br class="">
entry:<br class="">
; CHECK: addiu $sp, $sp, -48<br class="">
-; CHECK: sw $7, 60($sp)<br class="">
-; CHECK: sw $6, 56($sp)<br class="">
-; CHECK: sw $5, 52($sp)<br class="">
-; CHECK: sw $4, 48($sp)<br class="">
-; CHECK: lw $4, 48($sp)<br class="">
-; CHECK: lw $[[R0:[0-9]+]], 60($sp)<br class="">
-; CHECK: sw $[[R0]], 24($sp)<br class="">
+; CHECK-DAG: sw $7, 60($sp)<br class="">
+; CHECK-DAG: sw $6, 56($sp)<br class="">
+; CHECK-DAG: sw $5, 52($sp)<br class="">
+; CHECK-DAG: sw $4, 48($sp)<br class="">
+; CHECK-DAG: sw $7, 24($sp)<br class="">
<br class="">
%arrayidx = getelementptr inbounds %struct.S2, %struct.S2* %s2, i32 0, i32 0, i32 0<br class="">
%tmp = load i32, i32* %arrayidx, align 4<br class="">
@@ -101,14 +97,14 @@ entry:<br class="">
define void @f4(float %f, %struct.S3* nocapture byval %s3, %struct.S1* nocapture byval %s1) nounwind {<br class="">
entry:<br class="">
; CHECK: addiu $sp, $sp, -48<br class="">
-; CHECK: sw $7, 60($sp)<br class="">
-; CHECK: sw $6, 56($sp)<br class="">
-; CHECK: sw $5, 52($sp)<br class="">
-; CHECK: lw $4, 60($sp)<br class="">
-; CHECK: lw $[[R1:[0-9]+]], 80($sp)<br class="">
-; CHECK: lb $[[R0:[0-9]+]], 52($sp)<br class="">
-; CHECK: sw $[[R0]], 32($sp)<br class="">
-; CHECK: sw $[[R1]], 24($sp)<br class="">
+; CHECK-DAG: sw $7, 60($sp)<br class="">
+; CHECK-DAG: sw $6, 56($sp)<br class="">
+; CHECK-DAG: sw $5, 52($sp)<br class="">
+; CHECK-DAG: lw $[[R1:[0-9]+]], 80($sp)<br class="">
+; CHECK-DAG: lb $[[R0:[0-9]+]], 52($sp)<br class="">
+; CHECK-DAG: sw $[[R0]], 32($sp)<br class="">
+; CHECK-DAG: sw $[[R1]], 24($sp)<br class="">
+; CHECK: move $4, $7<br class="">
<br class="">
%i = getelementptr inbounds %struct.S1, %struct.S1* %s1, i32 0, i32 2<br class="">
%tmp = load i32, i32* %i, align 4<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Mips/o<wbr class="">32_cc_vararg.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Mips/o32_cc_vararg.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Mips/o32_cc_vararg.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Mips/o<wbr class="">32_cc_vararg.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Mips/o<wbr class="">32_cc_vararg.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -29,9 +29,9 @@ entry:<br class="">
<br class="">
; CHECK-LABEL: va1:<br class="">
; CHECK: addiu $sp, $sp, -16<br class="">
+; CHECK: sw $5, 20($sp)<br class="">
; CHECK: sw $7, 28($sp)<br class="">
; CHECK: sw $6, 24($sp)<br class="">
-; CHECK: sw $5, 20($sp)<br class="">
; CHECK: lw $2, 20($sp)<br class="">
}<br class="">
<br class="">
@@ -83,8 +83,8 @@ entry:<br class="">
<br class="">
; CHECK-LABEL: va3:<br class="">
; CHECK: addiu $sp, $sp, -16<br class="">
-; CHECK: sw $7, 28($sp)<br class="">
; CHECK: sw $6, 24($sp)<br class="">
+; CHECK: sw $7, 28($sp)<br class="">
; CHECK: lw $2, 24($sp)<br class="">
}<br class="">
<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/PowerP<wbr class="">C/anon_aggr.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/PowerPC/anon_aggr.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">PowerPC/anon_aggr.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/PowerP<wbr class="">C/anon_aggr.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/PowerP<wbr class="">C/anon_aggr.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -60,33 +60,34 @@ equal:<br class="">
unequal:<br class="">
ret i8* %array2_ptr<br class="">
}<br class="">
-<br class="">
; CHECK-LABEL: func2:<br class="">
-; CHECK: ld [[REG2:[0-9]+]], 72(1)<br class="">
-; CHECK: cmpld {{([0-9]+,)?}}4, [[REG2]]<br class="">
-; CHECK-DAG: std [[REG2]], -[[OFFSET1:[0-9]+]]<br class="">
+; CHECK: cmpld {{([0-9]+,)?}}4, 6<br class="">
+; CHECK-DAG: std 6, 72(1)<br class="">
+; CHECK-DAG: std 5, 64(1)<br class="">
+; CHECK-DAG: std 6, -[[OFFSET1:[0-9]+]]<br class="">
; CHECK-DAG: std 4, -[[OFFSET2:[0-9]+]]<br class="">
; CHECK: ld 3, -[[OFFSET2]](1)<br class="">
; CHECK: ld 3, -[[OFFSET1]](1)<br class="">
<br class="">
-; DARWIN32: _func2:<br class="">
-; DARWIN32: addi r[[REG1:[0-9]+]], r[[REGSP:[0-9]+]], 36<br class="">
-; DARWIN32: lwz r[[REG2:[0-9]+]], 44(r[[REGSP]])<br class="">
+; DARWIN32-LABEL: _func2<br class="">
+; DARWIN32-DAG: addi r[[REG8:[0-9]+]], r[[REGSP:[0-9]+]], 36<br class="">
+; DARWIN32-DAG: lwz r[[REG2:[0-9]+]], 44(r[[REGSP]])<br class="">
; DARWIN32: mr<br class="">
-; DARWIN32: mr r[[REG3:[0-9]+]], r[[REGA:[0-9]+]]<br class="">
-; DARWIN32: cmplw {{(cr[0-9]+,)?}}r[[REGA]], r[[REG2]]<br class="">
-; DARWIN32: stw r[[REG3]], -[[OFFSET1:[0-9]+]]<br class="">
-; DARWIN32: stw r[[REG2]], -[[OFFSET2:[0-9]+]]<br class="">
-; DARWIN32: lwz r3, -[[OFFSET1]]<br class="">
-; DARWIN32: lwz r3, -[[OFFSET2]]<br class="">
+; DARWIN32: mr r[[REG7:[0-9]+]], r5<br class="">
+; DARWIN32-DAG: cmplw {{(cr[0-9]+,)?}}r5, r[[REG2]]<br class="">
+; DARWIN32-DAG: stw r[[REG7]], -[[OFFSET1:[0-9]+]]<br class="">
+; DARWIN32-DAG: stw r[[REG2]], -[[OFFSET2:[0-9]+]]<br class="">
+; DARWIN32-DAG: lwz r3, -[[OFFSET1]]<br class="">
+; DARWIN32-DAG: lwz r3, -[[OFFSET2]]<br class="">
+<br class="">
<br class="">
; DARWIN64: _func2:<br class="">
; DARWIN64: ld r[[REG2:[0-9]+]], 72(r1)<br class="">
; DARWIN64: mr<br class="">
; DARWIN64: mr r[[REG3:[0-9]+]], r[[REGA:[0-9]+]]<br class="">
; DARWIN64: cmpld {{(cr[0-9]+,)?}}r[[REGA]], r[[REG2]]<br class="">
-; DARWIN64: std r[[REG3]], -[[OFFSET1:[0-9]+]]<br class="">
; DARWIN64: std r[[REG2]], -[[OFFSET2:[0-9]+]]<br class="">
+; DARWIN64: std r[[REG3]], -[[OFFSET1:[0-9]+]]<br class="">
; DARWIN64: ld r3, -[[OFFSET1]]<br class="">
; DARWIN64: ld r3, -[[OFFSET2]]<br class="">
<br class="">
@@ -106,24 +107,24 @@ unequal:<br class="">
}<br class="">
<br class="">
; CHECK-LABEL: func3:<br class="">
-; CHECK: ld [[REG3:[0-9]+]], 72(1)<br class="">
-; CHECK: ld [[REG4:[0-9]+]], 56(1)<br class="">
-; CHECK: cmpld {{([0-9]+,)?}}[[REG4]], [[REG3]]<br class="">
-; CHECK: std [[REG3]], -[[OFFSET1:[0-9]+]](1)<br class="">
-; CHECK: std [[REG4]], -[[OFFSET2:[0-9]+]](1)<br class="">
+; CHECK: cmpld {{([0-9]+,)?}}4, 6<br class="">
+; CHECK-DAG: std 4, -[[OFFSET2:[0-9]+]](1)<br class="">
+; CHECK-DAG: std 6, -[[OFFSET1:[0-9]+]](1)<br class="">
; CHECK: ld 3, -[[OFFSET2]](1)<br class="">
; CHECK: ld 3, -[[OFFSET1]](1)<br class="">
<br class="">
-; DARWIN32: _func3:<br class="">
-; DARWIN32: addi r[[REG1:[0-9]+]], r[[REGSP:[0-9]+]], 36<br class="">
-; DARWIN32: addi r[[REG2:[0-9]+]], r[[REGSP]], 24<br class="">
-; DARWIN32: lwz r[[REG3:[0-9]+]], 44(r[[REGSP]])<br class="">
-; DARWIN32: lwz r[[REG4:[0-9]+]], 32(r[[REGSP]])<br class="">
-; DARWIN32: cmplw {{(cr[0-9]+,)?}}r[[REG4]], r[[REG3]]<br class="">
-; DARWIN32: stw r[[REG3]], -[[OFFSET1:[0-9]+]]<br class="">
-; DARWIN32: stw r[[REG4]], -[[OFFSET2:[0-9]+]]<br class="">
-; DARWIN32: lwz r3, -[[OFFSET2]]<br class="">
-; DARWIN32: lwz r3, -[[OFFSET1]]<br class="">
+; DARWIN32-LABEL: _func3:<br class="">
+; DARWIN32-DAG: stw r[[REG8:[0-9]+]], 44(r[[REGSP:[0-9]+]])<br class="">
+; DARWIN32-DAG: stw r[[REG5:[0-9]+]], 32(r[[REGSP]])<br class="">
+; DARWIN32-DAG: addi r[[REG5a:[0-9]+]], r[[REGSP:[0-9]+]], 36<br class="">
+; DARWIN32-DAG: addi r[[REG8a:[0-9]+]], r[[REGSP]], 24<br class="">
+; DARWIN32-DAG: lwz r[[REG5a:[0-9]+]], 44(r[[REGSP]])<br class="">
+; DARWIN32-DAG: lwz r[[REG8a:[0-9]+]], 32(r[[REGSP]])<br class="">
+; DARWIN32-DAG: cmplw {{(cr[0-9]+,)?}}r[[REG8a]], r[[REG5a]]<br class="">
+; DARWIN32-DAG: stw r[[REG5a]], -[[OFFSET1:[0-9]+]]<br class="">
+; DARWIN32-DAG: stw r[[REG8a]], -[[OFFSET2:[0-9]+]]<br class="">
+; DARWIN32-DAG: lwz r3, -[[OFFSET1:[0-9]+]]<br class="">
+; DARWIN32-DAG: lwz r3, -[[OFFSET2:[0-9]+]]<br class="">
<br class="">
; DARWIN64: _func3:<br class="">
; DARWIN64: ld r[[REG3:[0-9]+]], 72(r1)<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/PowerP<wbr class="">C/complex-return.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/PowerPC/complex-return.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">PowerPC/complex-return.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/PowerP<wbr class="">C/complex-return.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/PowerP<wbr class="">C/complex-return.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -24,10 +24,10 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK-LABEL: foo:<br class="">
-; CHECK: lfd 1<br class="">
-; CHECK: lfd 2<br class="">
-; CHECK: lfd 3<br class="">
-; CHECK: lfd 4<br class="">
+; CHECK-DAG: lfd 1<br class="">
+; CHECK-DAG: lfd 2<br class="">
+; CHECK-DAG: lfd 3<br class="">
+; CHECK_DAG: lfd 4<br class="">
<br class="">
define { float, float } @oof() nounwind {<br class="">
entry:<br class="">
@@ -50,6 +50,6 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK-LABEL: oof:<br class="">
-; CHECK: lfs 2<br class="">
-; CHECK: lfs 1<br class="">
+; CHECK-DAG: lfs 2<br class="">
+; CHECK-DAG: lfs 1<br class="">
<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/PowerP<wbr class="">C/jaggedstructs.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/PowerPC/jaggedstructs.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">PowerPC/jaggedstructs.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/PowerP<wbr class="">C/jaggedstructs.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/PowerP<wbr class="">C/jaggedstructs.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -18,31 +18,31 @@ entry:<br class="">
ret void<br class="">
}<br class="">
<br class="">
-; CHECK: std 6, 184(1)<br class="">
-; CHECK: std 5, 176(1)<br class="">
-; CHECK: std 4, 168(1)<br class="">
-; CHECK: std 3, 160(1)<br class="">
-; CHECK: lbz {{[0-9]+}}, 167(1)<br class="">
-; CHECK: lhz {{[0-9]+}}, 165(1)<br class="">
-; CHECK: stb {{[0-9]+}}, 55(1)<br class="">
-; CHECK: sth {{[0-9]+}}, 53(1)<br class="">
-; CHECK: lbz {{[0-9]+}}, 175(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 171(1)<br class="">
-; CHECK: stb {{[0-9]+}}, 63(1)<br class="">
-; CHECK: stw {{[0-9]+}}, 59(1)<br class="">
-; CHECK: lhz {{[0-9]+}}, 182(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 178(1)<br class="">
-; CHECK: sth {{[0-9]+}}, 70(1)<br class="">
-; CHECK: stw {{[0-9]+}}, 66(1)<br class="">
-; CHECK: lbz {{[0-9]+}}, 191(1)<br class="">
-; CHECK: lhz {{[0-9]+}}, 189(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 185(1)<br class="">
-; CHECK: stb {{[0-9]+}}, 79(1)<br class="">
-; CHECK: sth {{[0-9]+}}, 77(1)<br class="">
-; CHECK: stw {{[0-9]+}}, 73(1)<br class="">
-; CHECK: ld 6, 72(1)<br class="">
-; CHECK: ld 5, 64(1)<br class="">
-; CHECK: ld 4, 56(1)<br class="">
-; CHECK: ld 3, 48(1)<br class="">
+; CHECK-DAG: std 3, 160(1)<br class="">
+; CHECK-DAG: std 6, 184(1)<br class="">
+; CHECK-DAG: std 5, 176(1)<br class="">
+; CHECK-DAG: std 4, 168(1)<br class="">
+; CHECK-DAG: lbz {{[0-9]+}}, 167(1)<br class="">
+; CHECK-DAG: lhz {{[0-9]+}}, 165(1)<br class="">
+; CHECK-DAG: stb {{[0-9]+}}, 55(1)<br class="">
+; CHECK-DAG-DAG: sth {{[0-9]+}}, 53(1)<br class="">
+; CHECK-DAG: lbz {{[0-9]+}}, 175(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 171(1)<br class="">
+; CHECK-DAG: stb {{[0-9]+}}, 63(1)<br class="">
+; CHECK-DAG: stw {{[0-9]+}}, 59(1)<br class="">
+; CHECK-DAG: lhz {{[0-9]+}}, 182(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 178(1)<br class="">
+; CHECK-DAG: sth {{[0-9]+}}, 70(1)<br class="">
+; CHECK-DAG: stw {{[0-9]+}}, 66(1)<br class="">
+; CHECK-DAG: lbz {{[0-9]+}}, 191(1)<br class="">
+; CHECK-DAG: lhz {{[0-9]+}}, 189(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 185(1)<br class="">
+; CHECK-DAG: stb {{[0-9]+}}, 79(1)<br class="">
+; CHECK-DAG: sth {{[0-9]+}}, 77(1)<br class="">
+; CHECK-DAG: stw {{[0-9]+}}, 73(1)<br class="">
+; CHECK-DAG: ld 6, 72(1)<br class="">
+; CHECK-DAG: ld 5, 64(1)<br class="">
+; CHECK-DAG: ld 4, 56(1)<br class="">
+; CHECK-DAG: ld 3, 48(1)<br class="">
<br class="">
declare void @check(%struct.S3* byval, %struct.S5* byval, %struct.S6* byval, %struct.S7* byval)<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/PowerP<wbr class="">C/ppc64-align-long-double.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/PowerPC/ppc64-align-long-double.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">PowerPC/ppc64-align-long-<wbr class="">double.ll?rev=297695&r1=297694<wbr class="">&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/PowerP<wbr class="">C/ppc64-align-long-double.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/PowerP<wbr class="">C/ppc64-align-long-double.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,6 +1,6 @@<br class="">
; RUN: llc -verify-machineinstrs -mcpu=pwr7 -O0 -fast-isel=false -mattr=-vsx < %s | FileCheck %s<br class="">
; RUN: llc -verify-machineinstrs -mcpu=pwr7 -O0 -fast-isel=false -mattr=+vsx < %s | FileCheck -check-prefix=CHECK-VSX %s<br class="">
-; RUN: llc -verify-machineinstrs -mcpu=pwr9 -O0 -fast-isel=false -mattr=+vsx < %s | FileCheck %s<br class="">
+; RUN: llc -verify-machineinstrs -mcpu=pwr9 -O0 -fast-isel=false -mattr=+vsx < %s | FileCheck -check-prefix=CHECK-P9 %s<br class="">
<br class="">
; Verify internal alignment of long double in a struct. The double<br class="">
; argument comes in in GPR3; GPR4 is skipped; GPRs 5 and 6 contain<br class="">
@@ -19,19 +19,44 @@ entry:<br class="">
ret ppc_fp128 %0<br class="">
}<br class="">
<br class="">
+; The additional stores are caused because we forward the value in the<br class="">
+; store->load->bitcast path to make a store and bitcast of the same<br class="">
+; value. Since the target does bitcast through memory and we no longer<br class="">
+; remember the address we need to do the store in a fresh local<br class="">
+; address.<br class="">
+<br class="">
; CHECK-DAG: std 6, 72(1)<br class="">
; CHECK-DAG: std 5, 64(1)<br class="">
; CHECK-DAG: std 4, 56(1)<br class="">
; CHECK-DAG: std 3, 48(1)<br class="">
-; CHECK: lfd 1, 64(1)<br class="">
-; CHECK: lfd 2, 72(1)<br class="">
+<br class="">
+; CHECK-DAG: std 5, -16(1)<br class="">
+; CHECK-DAG: std 6, -8(1)<br class="">
+; CHECK-DAG: lfd 1, -16(1)<br class="">
+; CHECK-DAG: lfd 2, -8(1)<br class="">
+<br class="">
+; FIXMECHECK: lfd 1, 64(1)<br class="">
+; FIXMECHECK: lfd 2, 72(1)<br class="">
<br class="">
; CHECK-VSX-DAG: std 6, 72(1)<br class="">
; CHECK-VSX-DAG: std 5, 64(1)<br class="">
; CHECK-VSX-DAG: std 4, 56(1)<br class="">
; CHECK-VSX-DAG: std 3, 48(1)<br class="">
-; CHECK-VSX: li 3, 16<br class="">
-; CHECK-VSX: addi 4, 1, 48<br class="">
-; CHECK-VSX: lxsdx 1, 4, 3<br class="">
-; CHECK-VSX: li 3, 24<br class="">
-; CHECK-VSX: lxsdx 2, 4, 3<br class="">
+; CHECK-VSX-DAG: std 5, -16(1)<br class="">
+; CHECK-VSX-DAG: std 6, -8(1)<br class="">
+; CHECK-VSX: addi 3, 1, -16<br class="">
+; CHECK-VSX: lxsdx 1, 0, 3<br class="">
+; CHECK-VSX: addi 3, 1, -8<br class="">
+; CHECK-VSX: lxsdx 2, 0, 3<br class="">
+<br class="">
+; FIXME-VSX: addi 4, 1, 48<br class="">
+; FIXME-VSX: lxsdx 1, 4, 3<br class="">
+; FIXME-VSX: li 3, 24<br class="">
+; FIXME-VSX: lxsdx 2, 4, 3<br class="">
+<br class="">
+; CHECK-P9: std 6, 72(1)<br class="">
+; CHECK-P9: std 5, 64(1)<br class="">
+; CHECK-P9: std 4, 56(1)<br class="">
+; CHECK-P9: std 3, 48(1)<br class="">
+; CHECK-P9: mtvsrd 1, 5<br class="">
+; CHECK-P9: mtvsrd 2, 6<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/PowerP<wbr class="">C/structsinmem.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/PowerPC/structsinmem.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">PowerPC/structsinmem.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/PowerP<wbr class="">C/structsinmem.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/PowerP<wbr class="">C/structsinmem.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -113,13 +113,13 @@ entry:<br class="">
%add13 = add nsw i32 %add11, %6<br class="">
ret i32 %add13<br class="">
<br class="">
-; CHECK: lha {{[0-9]+}}, 126(1)<br class="">
-; CHECK: lha {{[0-9]+}}, 132(1)<br class="">
-; CHECK: lbz {{[0-9]+}}, 119(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 140(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 144(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 152(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 160(1)<br class="">
+; CHECK-DAG: lha {{[0-9]+}}, 126(1)<br class="">
+; CHECK-DAG: lha {{[0-9]+}}, 132(1)<br class="">
+; CHECK-DAG: lbz {{[0-9]+}}, 119(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 140(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 144(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 152(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 160(1)<br class="">
}<br class="">
<br class="">
define i32 @caller2() nounwind {<br class="">
@@ -205,11 +205,11 @@ entry:<br class="">
%add13 = add nsw i32 %add11, %6<br class="">
ret i32 %add13<br class="">
<br class="">
-; CHECK: lha {{[0-9]+}}, 126(1)<br class="">
-; CHECK: lha {{[0-9]+}}, 133(1)<br class="">
-; CHECK: lbz {{[0-9]+}}, 119(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 140(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 147(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 154(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 161(1)<br class="">
+; CHECK-DAG: lha {{[0-9]+}}, 126(1)<br class="">
+; CHECK-DAG: lha {{[0-9]+}}, 133(1)<br class="">
+; CHECK-DAG: lbz {{[0-9]+}}, 119(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 140(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 147(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 154(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 161(1)<br class="">
}<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/PowerP<wbr class="">C/structsinregs.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/PowerPC/structsinregs.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">PowerPC/structsinregs.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/PowerP<wbr class="">C/structsinregs.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/PowerP<wbr class="">C/structsinregs.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -59,6 +59,7 @@ entry:<br class="">
%call = call i32 @callee1(%struct.s1* byval %p1, %struct.s2* byval %p2, %struct.s3* byval %p3, %struct.s4* byval %p4, %struct.s5* byval %p5, %struct.s6* byval %p6, %struct.s7* byval %p7)<br class="">
ret i32 %call<br class="">
<br class="">
+; CHECK-LABEL: caller1<br class="">
; CHECK: ld 9, 112(31)<br class="">
; CHECK: ld 8, 120(31)<br class="">
; CHECK: ld 7, 128(31)<br class="">
@@ -97,20 +98,21 @@ entry:<br class="">
%add13 = add nsw i32 %add11, %6<br class="">
ret i32 %add13<br class="">
<br class="">
-; CHECK: std 9, 96(1)<br class="">
-; CHECK: std 8, 88(1)<br class="">
-; CHECK: std 7, 80(1)<br class="">
-; CHECK: stw 6, 76(1)<br class="">
-; CHECK: stw 5, 68(1)<br class="">
-; CHECK: sth 4, 62(1)<br class="">
-; CHECK: stb 3, 55(1)<br class="">
-; CHECK: lha {{[0-9]+}}, 62(1)<br class="">
-; CHECK: lha {{[0-9]+}}, 68(1)<br class="">
-; CHECK: lbz {{[0-9]+}}, 55(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 76(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 80(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 88(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 96(1)<br class="">
+; CHECK-LABEL: callee1<br class="">
+; CHECK-DAG: std 9, 96(1)<br class="">
+; CHECK-DAG: std 8, 88(1)<br class="">
+; CHECK-DAG: std 7, 80(1)<br class="">
+; CHECK-DAG: stw 6, 76(1)<br class="">
+; CHECK-DAG: stw 5, 68(1)<br class="">
+; CHECK-DAG: sth 4, 62(1)<br class="">
+; CHECK-DAG: stb 3, 55(1)<br class="">
+; CHECK-DAG: lha {{[0-9]+}}, 62(1)<br class="">
+; CHECK-DAG: lha {{[0-9]+}}, 68(1)<br class="">
+; CHECK-DAG: lbz {{[0-9]+}}, 55(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 76(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 80(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 88(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 96(1)<br class="">
}<br class="">
<br class="">
define i32 @caller2() nounwind {<br class="">
@@ -139,6 +141,7 @@ entry:<br class="">
%call = call i32 @callee2(%struct.t1* byval %p1, %struct.t2* byval %p2, %struct.t3* byval %p3, %struct.t4* byval %p4, %struct.t5* byval %p5, %struct.t6* byval %p6, %struct.t7* byval %p7)<br class="">
ret i32 %call<br class="">
<br class="">
+; CHECK-LABEL: caller2<br class="">
; CHECK: stb {{[0-9]+}}, 71(1)<br class="">
; CHECK: sth {{[0-9]+}}, 69(1)<br class="">
; CHECK: stb {{[0-9]+}}, 87(1)<br class="">
@@ -184,18 +187,19 @@ entry:<br class="">
%add13 = add nsw i32 %add11, %6<br class="">
ret i32 %add13<br class="">
<br class="">
-; CHECK: std 9, 96(1)<br class="">
-; CHECK: std 8, 88(1)<br class="">
-; CHECK: std 7, 80(1)<br class="">
-; CHECK: stw 6, 76(1)<br class="">
-; CHECK: std 5, 64(1)<br class="">
-; CHECK: sth 4, 62(1)<br class="">
-; CHECK: stb 3, 55(1)<br class="">
-; CHECK: lha {{[0-9]+}}, 62(1)<br class="">
-; CHECK: lha {{[0-9]+}}, 69(1)<br class="">
-; CHECK: lbz {{[0-9]+}}, 55(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 76(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 83(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 90(1)<br class="">
-; CHECK: lwz {{[0-9]+}}, 97(1)<br class="">
+; CHECK-LABEL: callee2<br class="">
+; CHECK-DAG: std 9, 96(1)<br class="">
+; CHECK-DAG: std 8, 88(1)<br class="">
+; CHECK-DAG: std 7, 80(1)<br class="">
+; CHECK-DAG: stw 6, 76(1)<br class="">
+; CHECK-DAG: std 5, 64(1)<br class="">
+; CHECK-DAG: sth 4, 62(1)<br class="">
+; CHECK-DAG: stb 3, 55(1)<br class="">
+; CHECK-DAG: lha {{[0-9]+}}, 62(1)<br class="">
+; CHECK-DAG: lha {{[0-9]+}}, 69(1)<br class="">
+; CHECK-DAG: lbz {{[0-9]+}}, 55(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 76(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 83(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 90(1)<br class="">
+; CHECK-DAG: lwz {{[0-9]+}}, 97(1)<br class="">
}<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/System<wbr class="">Z/unaligned-01.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/SystemZ/unaligned-01.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">SystemZ/unaligned-01.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/System<wbr class="">Z/unaligned-01.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/System<wbr class="">Z/unaligned-01.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,10 +1,7 @@<br class="">
; Check that unaligned accesses are allowed in general. We check the<br class="">
; few exceptions (like CRL) in their respective test files.<br class="">
;<br class="">
-; FIXME: -combiner-alias-analysis (the default for SystemZ) stops<br class="">
-; f1 from being optimized.<br class="">
-; RUN: llc < %s -mtriple=s390x-linux-gnu -combiner-alias-analysis=false \<br class="">
-; RUN: | FileCheck %s<br class="">
+; RUN: llc < %s -mtriple=s390x-linux-gnu | FileCheck %s<br class="">
<br class="">
; Check that these four byte stores become a single word store.<br class="">
define void @f1(i8 *%ptr) {<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Thumb/<wbr class="">2010-07-15-debugOrdering.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Thumb/2010-07-15-debugOrdering.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Thumb/2010-07-15-debugOrdering<wbr class="">.ll?rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Thumb/<wbr class="">2010-07-15-debugOrdering.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Thumb/<wbr class="">2010-07-15-debugOrdering.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -9,9 +9,9 @@<br class="">
<br class="">
define void @_Z19getClosestDiagonal3ii(%0* noalias sret, i32, i32) nounwind {<br class="">
; CHECK: bl ___muldf3<br class="">
-; CHECK: bl ___muldf3<br class="">
; CHECK: beq LBB0<br class="">
; CHECK: bl ___muldf3<br class="">
+; CHECK: bl ___muldf3<br class="">
; <label>:3<br class="">
switch i32 %1, label %4 [<br class="">
i32 0, label %5<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/Thumb/<wbr class="">stack-access.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/Thumb/stack-access.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">Thumb/stack-access.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/Thumb/<wbr class="">stack-access.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/Thumb/<wbr class="">stack-access.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -74,15 +74,17 @@ define zeroext i16 @test6() {<br class="">
}<br class="">
<br class="">
; Accessing the bottom of a large array shouldn't require materializing a base<br class="">
+;<br class="">
+; CHECK: movs [[REG:r[0-9]+]], #1<br class="">
+; CHECK: str [[REG]], [sp, #16]<br class="">
+; CHECK: str [[REG]], [sp, #4]<br class="">
+<br class="">
define void @test7() {<br class="">
%arr = alloca [200 x i32], align 4<br class="">
<br class="">
- ; CHECK: movs [[REG:r[0-9]+]], #1<br class="">
- ; CHECK: str [[REG]], [sp, #4]<br class="">
%arrayidx = getelementptr inbounds [200 x i32], [200 x i32]* %arr, i32 0, i32 1<br class="">
store i32 1, i32* %arrayidx, align 4<br class="">
<br class="">
- ; CHECK: str [[REG]], [sp, #16]<br class="">
%arrayidx1 = getelementptr inbounds [200 x i32], [200 x i32]* %arr, i32 0, i32 4<br class="">
store i32 1, i32* %arrayidx1, align 4<br class="">
<br class="">
@@ -96,30 +98,36 @@ define void @test8() {<br class="">
%arr1 = alloca [224 x i32], align 4<br class="">
<br class="">
; CHECK: movs [[REG:r[0-9]+]], #1<br class="">
-; CHECK: str [[REG]], [sp]<br class="">
+; CHECK-DAG: str [[REG]], [sp]<br class="">
%arr1idx1 = getelementptr inbounds [224 x i32], [224 x i32]* %arr1, i32 0, i32 0<br class="">
store i32 1, i32* %arr1idx1, align 4<br class="">
<br class="">
; Offset in range for sp-based store, but not for non-sp-based store<br class="">
-; CHECK: str [[REG]], [sp, #128]<br class="">
+; CHECK-DAG: str [[REG]], [sp, #128]<br class="">
%arr1idx2 = getelementptr inbounds [224 x i32], [224 x i32]* %arr1, i32 0, i32 32<br class="">
store i32 1, i32* %arr1idx2, align 4<br class="">
<br class="">
-; CHECK: str [[REG]], [sp, #896]<br class="">
+; CHECK-DAG: str [[REG]], [sp, #896]<br class="">
%arr2idx1 = getelementptr inbounds [224 x i32], [224 x i32]* %arr2, i32 0, i32 0<br class="">
store i32 1, i32* %arr2idx1, align 4<br class="">
<br class="">
; %arr2 is in range, but this element of it is not<br class="">
-; CHECK: str [[REG]], [{{r[0-9]+}}]<br class="">
+; CHECK-DAG: ldr [[RA:r[0-9]+]], .LCPI7_2<br class="">
+; CHECK-DAG: add [[RA]], sp<br class="">
+; CHECK-DAG: str [[REG]], [{{r[0-9]+}}]<br class="">
%arr2idx2 = getelementptr inbounds [224 x i32], [224 x i32]* %arr2, i32 0, i32 32<br class="">
store i32 1, i32* %arr2idx2, align 4<br class="">
<br class="">
; %arr3 is not in range<br class="">
-; CHECK: str [[REG]], [{{r[0-9]+}}]<br class="">
+; CHECK-DAG: ldr [[RB:r[0-9]+]], .LCPI7_3<br class="">
+; CHECK-DAG: add [[RB]], sp<br class="">
+; CHECK-DAG: str [[REG]], [{{r[0-9]+}}]<br class="">
%arr3idx1 = getelementptr inbounds [224 x i32], [224 x i32]* %arr3, i32 0, i32 0<br class="">
store i32 1, i32* %arr3idx1, align 4<br class="">
<br class="">
-; CHECK: str [[REG]], [{{r[0-9]+}}]<br class="">
+; CHECK-DAG: ldr [[RC:r[0-9]+]], .LCPI7_4<br class="">
+; CHECK-DAG: add [[RC]], sp<br class="">
+; CHECK-DAG: str [[REG]], [{{r[0-9]+}}]<br class="">
%arr3idx2 = getelementptr inbounds [224 x i32], [224 x i32]* %arr3, i32 0, i32 32<br class="">
store i32 1, i32* %arr3idx2, align 4<br class="">
<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/20<wbr class="">10-09-17-SideEffectsInChain.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/2010-09-17-SideEffectsInChain.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/2010-09-17-SideEffectsInCh<wbr class="">ain.ll?rev=297695&r1=297694&<wbr class="">r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/20<wbr class="">10-09-17-SideEffectsInChain.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/20<wbr class="">10-09-17-SideEffectsInChain.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,4 +1,4 @@<br class="">
-; RUN: llc < %s -combiner-alias-analysis -march=x86-64 -mcpu=core2 | FileCheck %s<br class="">
+; RUN: llc < %s -march=x86-64 -mcpu=core2 | FileCheck %s<br class="">
<br class="">
target datalayout = "e-p:64:64:64-i1:8:8-i8:8:8-i1<wbr class="">6:16:16-i32:32:32-i64:64:64-f3<wbr class="">2:32:32-f64:64:64-v64:64:64-v1<wbr class="">28:128:128-a0:0:64-s0:64:64-f8<wbr class="">0:128:128-n8:16:32:64"<br class="">
target triple = "x86_64-apple-darwin10.4"<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/20<wbr class="">12-11-28-merge-store-alias.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/2012-11-28-merge-store-alias.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/2012-11-28-merge-store-<wbr class="">alias.ll?rev=297695&r1=297694&<wbr class="">r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/20<wbr class="">12-11-28-merge-store-alias.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/20<wbr class="">12-11-28-merge-store-alias.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -3,8 +3,8 @@<br class="">
; CHECK: merge_stores_can<br class="">
; CHECK: callq foo<br class="">
; CHECK: xorps %xmm0, %xmm0<br class="">
-; CHECK-NEXT: movl 36(%rsp), %ebp<br class="">
; CHECK-NEXT: movups %xmm0<br class="">
+; CHECK-NEXT: movl 36(%rsp), %ebp<br class="">
; CHECK: callq foo<br class="">
; CHECK: ret<br class="">
declare i32 @foo([10 x i32]* )<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/Me<wbr class="">rgeConsecutiveStores.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/MergeConsecutiveStores.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/MergeConsecutiveStores.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/Me<wbr class="">rgeConsecutiveStores.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/Me<wbr class="">rgeConsecutiveStores.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -111,8 +111,7 @@ define void @merge_const_store_vec(i32 %<br class="">
; CHECK-LABEL: merge_nonconst_store:<br class="">
; CHECK: movl $67305985<br class="">
; CHECK: movb<br class="">
-; CHECK: movb<br class="">
-; CHECK: movb<br class="">
+; CHECK: movw<br class="">
; CHECK: movb<br class="">
; CHECK: ret<br class="">
define void @merge_nonconst_store(i32 %count, i8 %zz, %struct.A* nocapture %p) nounwind uwtable noinline ssp {<br class="">
@@ -292,16 +291,12 @@ block4:<br class="">
ret void<br class="">
}<br class="">
<br class="">
-;; On x86, even unaligned copies should be merged to vector ops.<br class="">
-;; TODO: however, this cannot happen at the moment, due to brokenness<br class="">
-;; in MergeConsecutiveStores. See UseAA FIXME in DAGCombiner.cpp<br class="">
-;; visitSTORE.<br class="">
-<br class="">
+;; On x86, even unaligned copies can be merged to vector ops.<br class="">
; CHECK-LABEL: merge_loads_no_align:<br class="">
; load:<br class="">
-; CHECK-NOT: vmovups ;; TODO<br class="">
+; CHECK: vmovups<br class="">
; store:<br class="">
-; CHECK-NOT: vmovups ;; TODO<br class="">
+; CHECK: vmovups<br class="">
; CHECK: ret<br class="">
define void @merge_loads_no_align(i32 %count, %struct.B* noalias nocapture %q, %struct.B* noalias nocapture %p) nounwind uwtable noinline ssp {<br class="">
%a1 = icmp sgt i32 %count, 0<br class="">
@@ -583,8 +578,8 @@ define void @merge_vec_element_and_scala<br class="">
<br class="">
; CHECK-LABEL: merge_vec_element_and_scalar_l<wbr class="">oad<br class="">
; CHECK: movq (%rdi), %rax<br class="">
+; CHECK-NEXT: movq 8(%rdi), %rcx<br class="">
; CHECK-NEXT: movq %rax, 32(%rdi)<br class="">
-; CHECK-NEXT: movq 8(%rdi), %rax<br class="">
-; CHECK-NEXT: movq %rax, 40(%rdi)<br class="">
+; CHECK-NEXT: movq %rcx, 40(%rdi)<br class="">
; CHECK-NEXT: retq<br class="">
}<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/av<wbr class="">x-vbroadcast.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/avx-vbroadcast.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/avx-vbroadcast.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/av<wbr class="">x-vbroadcast.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/av<wbr class="">x-vbroadcast.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -842,12 +842,15 @@ define float @broadcast_lifetime() nounw<br class="">
; X32-NEXT: leal {{[0-9]+}}(%esp), %esi<br class="">
; X32-NEXT: movl %esi, (%esp)<br class="">
; X32-NEXT: calll _gfunc<br class="">
-; X32-NEXT: vbroadcastss {{[0-9]+}}(%esp), %xmm0<br class="">
+; X32-NEXT: vmovss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; X32-NEXT: vmovaps %xmm0, {{[0-9]+}}(%esp) ## 16-byte Spill<br class="">
; X32-NEXT: movl %esi, (%esp)<br class="">
; X32-NEXT: calll _gfunc<br class="">
-; X32-NEXT: vbroadcastss {{[0-9]+}}(%esp), %xmm0<br class="">
-; X32-NEXT: vsubss {{[0-9]+}}(%esp), %xmm0, %xmm0 ## 16-byte Folded Reload<br class="">
+; X32-NEXT: vmovss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
+; X32-NEXT: vpermilps $0, {{[0-9]+}}(%esp), %xmm1 ## 16-byte Folded Reload<br class="">
+; X32-NEXT: ## xmm1 = mem[0,0,0,0]<br class="">
+; X32-NEXT: vpermilps {{.*#+}} xmm0 = xmm0[0,0,0,0]<br class="">
+; X32-NEXT: vsubss %xmm1, %xmm0, %xmm0<br class="">
; X32-NEXT: vmovss %xmm0, {{[0-9]+}}(%esp)<br class="">
; X32-NEXT: flds {{[0-9]+}}(%esp)<br class="">
; X32-NEXT: addl $56, %esp<br class="">
@@ -859,12 +862,15 @@ define float @broadcast_lifetime() nounw<br class="">
; X64-NEXT: subq $40, %rsp<br class="">
; X64-NEXT: movq %rsp, %rdi<br class="">
; X64-NEXT: callq _gfunc<br class="">
-; X64-NEXT: vbroadcastss {{[0-9]+}}(%rsp), %xmm0<br class="">
+; X64-NEXT: vmovss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; X64-NEXT: vmovaps %xmm0, {{[0-9]+}}(%rsp) ## 16-byte Spill<br class="">
; X64-NEXT: movq %rsp, %rdi<br class="">
; X64-NEXT: callq _gfunc<br class="">
-; X64-NEXT: vbroadcastss {{[0-9]+}}(%rsp), %xmm0<br class="">
-; X64-NEXT: vsubss {{[0-9]+}}(%rsp), %xmm0, %xmm0 ## 16-byte Folded Reload<br class="">
+; X64-NEXT: vmovss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
+; X64-NEXT: vpermilps $0, {{[0-9]+}}(%rsp), %xmm1 ## 16-byte Folded Reload<br class="">
+; X64-NEXT: ## xmm1 = mem[0,0,0,0]<br class="">
+; X64-NEXT: vpermilps {{.*#+}} xmm0 = xmm0[0,0,0,0]<br class="">
+; X64-NEXT: vsubss %xmm1, %xmm0, %xmm0<br class="">
; X64-NEXT: addq $40, %rsp<br class="">
; X64-NEXT: retq<br class="">
%1 = alloca <4 x float>, align 16<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/av<wbr class="">x512-mask-op.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/avx512-mask-op.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/avx512-mask-op.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/av<wbr class="">x512-mask-op.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/av<wbr class="">x512-mask-op.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1197,10 +1197,6 @@ define void @ktest_2(<32 x float> %in, f<br class="">
; KNL-NEXT: kmovw %k0, %eax<br class="">
; KNL-NEXT: vpinsrb $15, %eax, %xmm2, %xmm2<br class="">
; KNL-NEXT: vinserti128 $1, %xmm3, %ymm2, %ymm2<br class="">
-; KNL-NEXT: vpsllw $7, %ymm2, %ymm2<br class="">
-; KNL-NEXT: vpand {{.*}}(%rip), %ymm2, %ymm2<br class="">
-; KNL-NEXT: vpxor %ymm3, %ymm3, %ymm3<br class="">
-; KNL-NEXT: vpcmpgtb %ymm2, %ymm3, %ymm2<br class="">
; KNL-NEXT: vmovups 4(%rdi), %zmm3 {%k2} {z}<br class="">
; KNL-NEXT: vmovups 68(%rdi), %zmm4 {%k1} {z}<br class="">
; KNL-NEXT: vcmpltps %zmm4, %zmm1, %k0<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/ch<wbr class="">ain_order.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/chain_order.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/chain_order.ll?rev=297695&<wbr class="">r1=297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/ch<wbr class="">ain_order.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/ch<wbr class="">ain_order.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -11,9 +11,9 @@ define void @cftx020(double* nocapture %<br class="">
; CHECK-NEXT: vmovhpd {{.*#+}} xmm1 = xmm1[0],mem[0]<br class="">
; CHECK-NEXT: vaddpd %xmm1, %xmm0, %xmm0<br class="">
; CHECK-NEXT: vmovupd (%rdi), %xmm1<br class="">
-; CHECK-NEXT: vsubpd 16(%rdi), %xmm1, %xmm1<br class="">
; CHECK-NEXT: vmovupd %xmm0, (%rdi)<br class="">
-; CHECK-NEXT: vmovupd %xmm1, 16(%rdi)<br class="">
+; CHECK-NEXT: vsubpd 16(%rdi), %xmm1, %xmm0<br class="">
+; CHECK-NEXT: vmovupd %xmm0, 16(%rdi)<br class="">
; CHECK-NEXT: retq<br class="">
entry:<br class="">
%0 = load double, double* %a, align 8<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/cl<wbr class="">ear_upper_vector_element_bits.<wbr class="">ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/clear_upper_vector_element_bits.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/clear_upper_vector_<wbr class="">element_bits.ll?rev=297695&r1=<wbr class="">297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/cl<wbr class="">ear_upper_vector_element_bits.<wbr class="">ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/cl<wbr class="">ear_upper_vector_element_bits.<wbr class="">ll Mon Mar 13 19:34:14 2017<br class="">
@@ -360,47 +360,47 @@ define <16 x i8> @_clearupper16xi8a(<16<br class="">
; SSE-NEXT: movaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
; SSE-NEXT: movd %eax, %xmm0<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %r9d<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %edx<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %esi<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %r8d<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %edi<br class="">
; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
; SSE-NEXT: movd %eax, %xmm1<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3],xmm1[4],xmm0[4],xmm1[5],<wbr class="">xmm0[5],xmm1[6],xmm0[6],xmm1[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: movd %esi, %xmm0<br class="">
; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %esi<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %ecx<br class="">
-; SSE-NEXT: movd %ecx, %xmm2<br class="">
+; SSE-NEXT: movd %eax, %xmm0<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm2<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3],xmm2[4],xmm0[4],xmm2[5],<wbr class="">xmm0[5],xmm2[6],xmm0[6],xmm2[<wbr class="">7],xmm0[7]<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3],xmm2[4],xmm1[4],xmm2[5],<wbr class="">xmm1[5],xmm2[6],xmm1[6],xmm2[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: movd %edx, %xmm0<br class="">
-; SSE-NEXT: movd %esi, %xmm1<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3],xmm1[4],xmm0[4],xmm1[5],<wbr class="">xmm0[5],xmm1[6],xmm0[6],xmm1[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: movd %edi, %xmm0<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %ecx<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %edx<br class="">
-; SSE-NEXT: movd %edx, %xmm3<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm0<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm3<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm0[0],xmm3[1],xmm0[1<wbr class="">],xmm3[2],xmm0[2],xmm3[3],xmm0<wbr class="">[3],xmm3[4],xmm0[4],xmm3[5],<wbr class="">xmm0[5],xmm3[6],xmm0[6],xmm3[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm1[0],xmm3[1],xmm1[1<wbr class="">],xmm3[2],xmm1[2],xmm3[3],xmm1<wbr class="">[3],xmm3[4],xmm1[4],xmm3[5],<wbr class="">xmm1[5],xmm3[6],xmm1[6],xmm3[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm2[0],xmm3[1],xmm2[1<wbr class="">],xmm3[2],xmm2[2],xmm3[3],xmm2<wbr class="">[3],xmm3[4],xmm2[4],xmm3[5],<wbr class="">xmm2[5],xmm3[6],xmm2[6],xmm3[<wbr class="">7],xmm2[7]<br class="">
-; SSE-NEXT: movd %r9d, %xmm0<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm0<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
; SSE-NEXT: movd %eax, %xmm1<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3],xmm1[4],xmm0[4],xmm1[5],<wbr class="">xmm0[5],xmm1[6],xmm0[6],xmm1[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: movd %r8d, %xmm0<br class="">
-; SSE-NEXT: movd %ecx, %xmm2<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3],xmm2[4],xmm0[4],xmm2[5],<wbr class="">xmm0[5],xmm2[6],xmm0[6],xmm2[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3],xmm2[4],xmm1[4],xmm2[5],<wbr class="">xmm1[5],xmm2[6],xmm1[6],xmm2[<wbr class="">7],xmm1[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm3[0],xmm1[1],xmm3[1<wbr class="">],xmm1[2],xmm3[2],xmm1[3],xmm3<wbr class="">[3],xmm1[4],xmm3[4],xmm1[5],<wbr class="">xmm3[5],xmm1[6],xmm3[6],xmm1[<wbr class="">7],xmm3[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm2[0],xmm1[1],xmm2[1<wbr class="">],xmm1[2],xmm2[2],xmm1[3],xmm2<wbr class="">[3],xmm1[4],xmm2[4],xmm1[5],<wbr class="">xmm2[5],xmm1[6],xmm2[6],xmm1[<wbr class="">7],xmm2[7]<br class="">
; SSE-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
-; SSE-NEXT: movd {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3],xmm1[4],xmm0[4],xmm1[5],<wbr class="">xmm0[5],xmm1[6],xmm0[6],xmm1[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: movd {{.*#+}} xmm4 = mem[0],zero,zero,zero<br class="">
+; SSE-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3],xmm2[4],xmm0[4],xmm2[5],<wbr class="">xmm0[5],xmm2[6],xmm0[6],xmm2[<wbr class="">7],xmm0[7]<br class="">
+; SSE-NEXT: movd {{.*#+}} xmm3 = mem[0],zero,zero,zero<br class="">
; SSE-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3],xmm0[4],xmm3[4],xmm0[5],<wbr class="">xmm3[5],xmm0[6],xmm3[6],xmm0[<wbr class="">7],xmm3[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3],xmm0[4],xmm2[4],xmm0[5],<wbr class="">xmm2[5],xmm0[6],xmm2[6],xmm0[<wbr class="">7],xmm2[7]<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm2<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm3<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm2[0],xmm3[1],xmm2[1<wbr class="">],xmm3[2],xmm2[2],xmm3[3],xmm2<wbr class="">[3],xmm3[4],xmm2[4],xmm3[5],<wbr class="">xmm2[5],xmm3[6],xmm2[6],xmm3[<wbr class="">7],xmm2[7]<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm2<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm4<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm2[0],xmm4[1],xmm2[1<wbr class="">],xmm4[2],xmm2[2],xmm4[3],xmm2<wbr class="">[3],xmm4[4],xmm2[4],xmm4[5],<wbr class="">xmm2[5],xmm4[6],xmm2[6],xmm4[<wbr class="">7],xmm2[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm3[0],xmm4[1],xmm3[1<wbr class="">],xmm4[2],xmm3[2],xmm4[3],xmm3<wbr class="">[3],xmm4[4],xmm3[4],xmm4[5],<wbr class="">xmm3[5],xmm4[6],xmm3[6],xmm4[<wbr class="">7],xmm3[7]<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm4[0],xmm0[1],xmm4[1<wbr class="">],xmm0[2],xmm4[2],xmm0[3],xmm4<wbr class="">[3],xmm0[4],xmm4[4],xmm0[5],<wbr class="">xmm4[5],xmm0[6],xmm4[6],xmm0[<wbr class="">7],xmm4[7]<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3],xmm0[4],xmm1[4],xmm0[5],<wbr class="">xmm1[5],xmm0[6],xmm1[6],xmm0[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3],xmm0[4],xmm2[4],xmm0[5],<wbr class="">xmm2[5],xmm0[6],xmm2[6],xmm0[<wbr class="">7],xmm2[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3],xmm0[4],xmm3[4],xmm0[5],<wbr class="">xmm3[5],xmm0[6],xmm3[6],xmm0[<wbr class="">7],xmm3[7]<br class="">
; SSE-NEXT: pand {{.*}}(%rip), %xmm0<br class="">
; SSE-NEXT: retq<br class="">
;<br class="">
@@ -487,92 +487,92 @@ define <32 x i8> @_clearupper32xi8a(<32<br class="">
; SSE-NEXT: movaps %xmm1, -{{[0-9]+}}(%rsp)<br class="">
; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
; SSE-NEXT: movd %eax, %xmm0<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %r9d<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %edx<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %esi<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %r8d<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %edi<br class="">
; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
; SSE-NEXT: movd %eax, %xmm1<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3],xmm1[4],xmm0[4],xmm1[5],<wbr class="">xmm0[5],xmm1[6],xmm0[6],xmm1[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: movd %esi, %xmm0<br class="">
; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %esi<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %ecx<br class="">
-; SSE-NEXT: movd %ecx, %xmm2<br class="">
+; SSE-NEXT: movd %eax, %xmm0<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm2<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3],xmm2[4],xmm0[4],xmm2[5],<wbr class="">xmm0[5],xmm2[6],xmm0[6],xmm2[<wbr class="">7],xmm0[7]<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3],xmm2[4],xmm1[4],xmm2[5],<wbr class="">xmm1[5],xmm2[6],xmm1[6],xmm2[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: movd %edx, %xmm0<br class="">
-; SSE-NEXT: movd %esi, %xmm1<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3],xmm1[4],xmm0[4],xmm1[5],<wbr class="">xmm0[5],xmm1[6],xmm0[6],xmm1[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: movd %edi, %xmm0<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %ecx<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %edx<br class="">
-; SSE-NEXT: movd %edx, %xmm3<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm0<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm3<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm0[0],xmm3[1],xmm0[1<wbr class="">],xmm3[2],xmm0[2],xmm3[3],xmm0<wbr class="">[3],xmm3[4],xmm0[4],xmm3[5],<wbr class="">xmm0[5],xmm3[6],xmm0[6],xmm3[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm1[0],xmm3[1],xmm1[1<wbr class="">],xmm3[2],xmm1[2],xmm3[3],xmm1<wbr class="">[3],xmm3[4],xmm1[4],xmm3[5],<wbr class="">xmm1[5],xmm3[6],xmm1[6],xmm3[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm2[0],xmm3[1],xmm2[1<wbr class="">],xmm3[2],xmm2[2],xmm3[3],xmm2<wbr class="">[3],xmm3[4],xmm2[4],xmm3[5],<wbr class="">xmm2[5],xmm3[6],xmm2[6],xmm3[<wbr class="">7],xmm2[7]<br class="">
-; SSE-NEXT: movd %r9d, %xmm0<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm0<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
; SSE-NEXT: movd %eax, %xmm1<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3],xmm1[4],xmm0[4],xmm1[5],<wbr class="">xmm0[5],xmm1[6],xmm0[6],xmm1[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: movd %r8d, %xmm0<br class="">
-; SSE-NEXT: movd %ecx, %xmm2<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3],xmm2[4],xmm0[4],xmm2[5],<wbr class="">xmm0[5],xmm2[6],xmm0[6],xmm2[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3],xmm2[4],xmm1[4],xmm2[5],<wbr class="">xmm1[5],xmm2[6],xmm1[6],xmm2[<wbr class="">7],xmm1[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm3[0],xmm1[1],xmm3[1<wbr class="">],xmm1[2],xmm3[2],xmm1[3],xmm3<wbr class="">[3],xmm1[4],xmm3[4],xmm1[5],<wbr class="">xmm3[5],xmm1[6],xmm3[6],xmm1[<wbr class="">7],xmm3[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm2[0],xmm1[1],xmm2[1<wbr class="">],xmm1[2],xmm2[2],xmm1[3],xmm2<wbr class="">[3],xmm1[4],xmm2[4],xmm1[5],<wbr class="">xmm2[5],xmm1[6],xmm2[6],xmm1[<wbr class="">7],xmm2[7]<br class="">
; SSE-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
-; SSE-NEXT: movd {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3],xmm1[4],xmm0[4],xmm1[5],<wbr class="">xmm0[5],xmm1[6],xmm0[6],xmm1[<wbr class="">7],xmm0[7]<br class="">
-; SSE-NEXT: movd {{.*#+}} xmm4 = mem[0],zero,zero,zero<br class="">
+; SSE-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3],xmm2[4],xmm0[4],xmm2[5],<wbr class="">xmm0[5],xmm2[6],xmm0[6],xmm2[<wbr class="">7],xmm0[7]<br class="">
+; SSE-NEXT: movd {{.*#+}} xmm3 = mem[0],zero,zero,zero<br class="">
; SSE-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3],xmm0[4],xmm3[4],xmm0[5],<wbr class="">xmm3[5],xmm0[6],xmm3[6],xmm0[<wbr class="">7],xmm3[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3],xmm0[4],xmm2[4],xmm0[5],<wbr class="">xmm2[5],xmm0[6],xmm2[6],xmm0[<wbr class="">7],xmm2[7]<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm2<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm3<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm2[0],xmm3[1],xmm2[1<wbr class="">],xmm3[2],xmm2[2],xmm3[3],xmm2<wbr class="">[3],xmm3[4],xmm2[4],xmm3[5],<wbr class="">xmm2[5],xmm3[6],xmm2[6],xmm3[<wbr class="">7],xmm2[7]<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm2<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm4<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm2[0],xmm4[1],xmm2[1<wbr class="">],xmm4[2],xmm2[2],xmm4[3],xmm2<wbr class="">[3],xmm4[4],xmm2[4],xmm4[5],<wbr class="">xmm2[5],xmm4[6],xmm2[6],xmm4[<wbr class="">7],xmm2[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm3[0],xmm4[1],xmm3[1<wbr class="">],xmm4[2],xmm3[2],xmm4[3],xmm3<wbr class="">[3],xmm4[4],xmm3[4],xmm4[5],<wbr class="">xmm3[5],xmm4[6],xmm3[6],xmm4[<wbr class="">7],xmm3[7]<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm4[0],xmm0[1],xmm4[1<wbr class="">],xmm0[2],xmm4[2],xmm0[3],xmm4<wbr class="">[3],xmm0[4],xmm4[4],xmm0[5],<wbr class="">xmm4[5],xmm0[6],xmm4[6],xmm0[<wbr class="">7],xmm4[7]<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3],xmm0[4],xmm1[4],xmm0[5],<wbr class="">xmm1[5],xmm0[6],xmm1[6],xmm0[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3],xmm0[4],xmm2[4],xmm0[5],<wbr class="">xmm2[5],xmm0[6],xmm2[6],xmm0[<wbr class="">7],xmm2[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3],xmm0[4],xmm3[4],xmm0[5],<wbr class="">xmm3[5],xmm0[6],xmm3[6],xmm0[<wbr class="">7],xmm3[7]<br class="">
; SSE-NEXT: movdqa {{.*#+}} xmm2 = [15,15,15,15,15,15,15,15,15,15<wbr class="">,15,15,15,15,15,15]<br class="">
; SSE-NEXT: pand %xmm2, %xmm0<br class="">
; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
; SSE-NEXT: movd %eax, %xmm1<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %r9d<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %edx<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %esi<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %r8d<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %edi<br class="">
; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
; SSE-NEXT: movd %eax, %xmm3<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm1[0],xmm3[1],xmm1[1<wbr class="">],xmm3[2],xmm1[2],xmm3[3],xmm1<wbr class="">[3],xmm3[4],xmm1[4],xmm3[5],<wbr class="">xmm1[5],xmm3[6],xmm1[6],xmm3[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: movd %esi, %xmm1<br class="">
; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %esi<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %ecx<br class="">
-; SSE-NEXT: movd %ecx, %xmm4<br class="">
+; SSE-NEXT: movd %eax, %xmm1<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm4<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm1[0],xmm4[1],xmm1[1<wbr class="">],xmm4[2],xmm1[2],xmm4[3],xmm1<wbr class="">[3],xmm4[4],xmm1[4],xmm4[5],<wbr class="">xmm1[5],xmm4[6],xmm1[6],xmm4[<wbr class="">7],xmm1[7]<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm3[0],xmm4[1],xmm3[1<wbr class="">],xmm4[2],xmm3[2],xmm4[3],xmm3<wbr class="">[3],xmm4[4],xmm3[4],xmm4[5],<wbr class="">xmm3[5],xmm4[6],xmm3[6],xmm4[<wbr class="">7],xmm3[7]<br class="">
-; SSE-NEXT: movd %edx, %xmm1<br class="">
-; SSE-NEXT: movd %esi, %xmm3<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm1[0],xmm3[1],xmm1[1<wbr class="">],xmm3[2],xmm1[2],xmm3[3],xmm1<wbr class="">[3],xmm3[4],xmm1[4],xmm3[5],<wbr class="">xmm1[5],xmm3[6],xmm1[6],xmm3[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: movd %edi, %xmm1<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %ecx<br class="">
-; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %edx<br class="">
-; SSE-NEXT: movd %edx, %xmm5<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm1<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm5<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm1[0],xmm5[1],xmm1[1<wbr class="">],xmm5[2],xmm1[2],xmm5[3],xmm1<wbr class="">[3],xmm5[4],xmm1[4],xmm5[5],<wbr class="">xmm1[5],xmm5[6],xmm1[6],xmm5[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm3[0],xmm5[1],xmm3[1<wbr class="">],xmm5[2],xmm3[2],xmm5[3],xmm3<wbr class="">[3],xmm5[4],xmm3[4],xmm5[5],<wbr class="">xmm3[5],xmm5[6],xmm3[6],xmm5[<wbr class="">7],xmm3[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm4[0],xmm5[1],xmm4[1<wbr class="">],xmm5[2],xmm4[2],xmm5[3],xmm4<wbr class="">[3],xmm5[4],xmm4[4],xmm5[5],<wbr class="">xmm4[5],xmm5[6],xmm4[6],xmm5[<wbr class="">7],xmm4[7]<br class="">
-; SSE-NEXT: movd %r9d, %xmm1<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm1<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
; SSE-NEXT: movd %eax, %xmm3<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm1[0],xmm3[1],xmm1[1<wbr class="">],xmm3[2],xmm1[2],xmm3[3],xmm1<wbr class="">[3],xmm3[4],xmm1[4],xmm3[5],<wbr class="">xmm1[5],xmm3[6],xmm1[6],xmm3[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: movd %r8d, %xmm1<br class="">
-; SSE-NEXT: movd %ecx, %xmm4<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm1[0],xmm4[1],xmm1[1<wbr class="">],xmm4[2],xmm1[2],xmm4[3],xmm1<wbr class="">[3],xmm4[4],xmm1[4],xmm4[5],<wbr class="">xmm1[5],xmm4[6],xmm1[6],xmm4[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm3[0],xmm4[1],xmm3[1<wbr class="">],xmm4[2],xmm3[2],xmm4[3],xmm3<wbr class="">[3],xmm4[4],xmm3[4],xmm4[5],<wbr class="">xmm3[5],xmm4[6],xmm3[6],xmm4[<wbr class="">7],xmm3[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm5[0],xmm3[1],xmm5[1<wbr class="">],xmm3[2],xmm5[2],xmm3[3],xmm5<wbr class="">[3],xmm3[4],xmm5[4],xmm3[5],<wbr class="">xmm5[5],xmm3[6],xmm5[6],xmm3[<wbr class="">7],xmm5[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm4[0],xmm3[1],xmm4[1<wbr class="">],xmm3[2],xmm4[2],xmm3[3],xmm4<wbr class="">[3],xmm3[4],xmm4[4],xmm3[5],<wbr class="">xmm4[5],xmm3[6],xmm4[6],xmm3[<wbr class="">7],xmm4[7]<br class="">
; SSE-NEXT: movd {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
-; SSE-NEXT: movd {{.*#+}} xmm3 = mem[0],zero,zero,zero<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm1[0],xmm3[1],xmm1[1<wbr class="">],xmm3[2],xmm1[2],xmm3[3],xmm1<wbr class="">[3],xmm3[4],xmm1[4],xmm3[5],<wbr class="">xmm1[5],xmm3[6],xmm1[6],xmm3[<wbr class="">7],xmm1[7]<br class="">
-; SSE-NEXT: movd {{.*#+}} xmm6 = mem[0],zero,zero,zero<br class="">
+; SSE-NEXT: movd {{.*#+}} xmm4 = mem[0],zero,zero,zero<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm1[0],xmm4[1],xmm1[1<wbr class="">],xmm4[2],xmm1[2],xmm4[3],xmm1<wbr class="">[3],xmm4[4],xmm1[4],xmm4[5],<wbr class="">xmm1[5],xmm4[6],xmm1[6],xmm4[<wbr class="">7],xmm1[7]<br class="">
+; SSE-NEXT: movd {{.*#+}} xmm5 = mem[0],zero,zero,zero<br class="">
; SSE-NEXT: movd {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm5[0],xmm1[1],xmm5[1<wbr class="">],xmm1[2],xmm5[2],xmm1[3],xmm5<wbr class="">[3],xmm1[4],xmm5[4],xmm1[5],<wbr class="">xmm5[5],xmm1[6],xmm5[6],xmm1[<wbr class="">7],xmm5[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm4[0],xmm1[1],xmm4[1<wbr class="">],xmm1[2],xmm4[2],xmm1[3],xmm4<wbr class="">[3],xmm1[4],xmm4[4],xmm1[5],<wbr class="">xmm4[5],xmm1[6],xmm4[6],xmm1[<wbr class="">7],xmm4[7]<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm4<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm5<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm4[0],xmm5[1],xmm4[1<wbr class="">],xmm5[2],xmm4[2],xmm5[3],xmm4<wbr class="">[3],xmm5[4],xmm4[4],xmm5[5],<wbr class="">xmm4[5],xmm5[6],xmm4[6],xmm5[<wbr class="">7],xmm4[7]<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm4<br class="">
+; SSE-NEXT: movzbl -{{[0-9]+}}(%rsp), %eax<br class="">
+; SSE-NEXT: movd %eax, %xmm6<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm4[0],xmm6[1],xmm4[1<wbr class="">],xmm6[2],xmm4[2],xmm6[3],xmm4<wbr class="">[3],xmm6[4],xmm4[4],xmm6[5],<wbr class="">xmm4[5],xmm6[6],xmm4[6],xmm6[<wbr class="">7],xmm4[7]<br class="">
+; SSE-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm5[0],xmm6[1],xmm5[1<wbr class="">],xmm6[2],xmm5[2],xmm6[3],xmm5<wbr class="">[3],xmm6[4],xmm5[4],xmm6[5],<wbr class="">xmm5[5],xmm6[6],xmm5[6],xmm6[<wbr class="">7],xmm5[7]<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm6[0],xmm1[1],xmm6[1<wbr class="">],xmm1[2],xmm6[2],xmm1[3],xmm6<wbr class="">[3],xmm1[4],xmm6[4],xmm1[5],<wbr class="">xmm6[5],xmm1[6],xmm6[6],xmm1[<wbr class="">7],xmm6[7]<br class="">
; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm3[0],xmm1[1],xmm3[1<wbr class="">],xmm1[2],xmm3[2],xmm1[3],xmm3<wbr class="">[3],xmm1[4],xmm3[4],xmm1[5],<wbr class="">xmm3[5],xmm1[6],xmm3[6],xmm1[<wbr class="">7],xmm3[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm4[0],xmm1[1],xmm4[1<wbr class="">],xmm1[2],xmm4[2],xmm1[3],xmm4<wbr class="">[3],xmm1[4],xmm4[4],xmm1[5],<wbr class="">xmm4[5],xmm1[6],xmm4[6],xmm1[<wbr class="">7],xmm4[7]<br class="">
-; SSE-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm5[0],xmm1[1],xmm5[1<wbr class="">],xmm1[2],xmm5[2],xmm1[3],xmm5<wbr class="">[3],xmm1[4],xmm5[4],xmm1[5],<wbr class="">xmm5[5],xmm1[6],xmm5[6],xmm1[<wbr class="">7],xmm5[7]<br class="">
; SSE-NEXT: pand %xmm2, %xmm1<br class="">
; SSE-NEXT: retq<br class="">
;<br class="">
@@ -1180,91 +1180,87 @@ define <32 x i8> @_clearupper32xi8b(<32<br class="">
;<br class="">
; AVX1-LABEL: _clearupper32xi8b:<br class="">
; AVX1: # BB#0:<br class="">
-; AVX1-NEXT: pushq %rbp<br class="">
-; AVX1-NEXT: pushq %r15<br class="">
; AVX1-NEXT: pushq %r14<br class="">
-; AVX1-NEXT: pushq %r13<br class="">
-; AVX1-NEXT: pushq %r12<br class="">
; AVX1-NEXT: pushq %rbx<br class="">
; AVX1-NEXT: vpextrq $1, %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; AVX1-NEXT: vmovq %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: movq -{{[0-9]+}}(%rsp), %rcx<br class="">
-; AVX1-NEXT: movq -{{[0-9]+}}(%rsp), %rdx<br class="">
-; AVX1-NEXT: movq %rcx, %r8<br class="">
-; AVX1-NEXT: movq %rcx, %r9<br class="">
-; AVX1-NEXT: movq %rcx, %r10<br class="">
-; AVX1-NEXT: movq %rcx, %r11<br class="">
-; AVX1-NEXT: movq %rcx, %r14<br class="">
-; AVX1-NEXT: movq %rcx, %r15<br class="">
-; AVX1-NEXT: movq %rdx, %r12<br class="">
-; AVX1-NEXT: movq %rdx, %r13<br class="">
+; AVX1-NEXT: movq -{{[0-9]+}}(%rsp), %r14<br class="">
+; AVX1-NEXT: vpextrq $1, %xmm0, %rdx<br class="">
+; AVX1-NEXT: movq %rdx, %r8<br class="">
+; AVX1-NEXT: movq %rdx, %r9<br class="">
+; AVX1-NEXT: movq %rdx, %r11<br class="">
+; AVX1-NEXT: movq %rdx, %rsi<br class="">
; AVX1-NEXT: movq %rdx, %rdi<br class="">
+; AVX1-NEXT: movq %rdx, %rcx<br class="">
; AVX1-NEXT: movq %rdx, %rax<br class="">
-; AVX1-NEXT: movq %rdx, %rsi<br class="">
-; AVX1-NEXT: movq %rdx, %rbx<br class="">
-; AVX1-NEXT: movq %rdx, %rbp<br class="">
; AVX1-NEXT: andb $15, %dl<br class="">
; AVX1-NEXT: movb %dl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: movq %rcx, %rdx<br class="">
+; AVX1-NEXT: shrq $56, %rax<br class="">
+; AVX1-NEXT: andb $15, %al<br class="">
+; AVX1-NEXT: movb %al, -{{[0-9]+}}(%rsp)<br class="">
+; AVX1-NEXT: movq %r14, %r10<br class="">
+; AVX1-NEXT: shrq $48, %rcx<br class="">
; AVX1-NEXT: andb $15, %cl<br class="">
; AVX1-NEXT: movb %cl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: shrq $56, %rbp<br class="">
-; AVX1-NEXT: andb $15, %bpl<br class="">
-; AVX1-NEXT: movb %bpl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: shrq $48, %rbx<br class="">
+; AVX1-NEXT: movq %r14, %rdx<br class="">
+; AVX1-NEXT: shrq $40, %rdi<br class="">
+; AVX1-NEXT: andb $15, %dil<br class="">
+; AVX1-NEXT: movb %dil, -{{[0-9]+}}(%rsp)<br class="">
+; AVX1-NEXT: movq %r14, %rax<br class="">
+; AVX1-NEXT: shrq $32, %rsi<br class="">
+; AVX1-NEXT: andb $15, %sil<br class="">
+; AVX1-NEXT: movb %sil, -{{[0-9]+}}(%rsp)<br class="">
+; AVX1-NEXT: movq %r14, %rcx<br class="">
+; AVX1-NEXT: shrq $24, %r11<br class="">
+; AVX1-NEXT: andb $15, %r11b<br class="">
+; AVX1-NEXT: movb %r11b, -{{[0-9]+}}(%rsp)<br class="">
+; AVX1-NEXT: movq %r14, %rsi<br class="">
+; AVX1-NEXT: shrq $16, %r9<br class="">
+; AVX1-NEXT: andb $15, %r9b<br class="">
+; AVX1-NEXT: movb %r9b, -{{[0-9]+}}(%rsp)<br class="">
+; AVX1-NEXT: movq %r14, %rdi<br class="">
+; AVX1-NEXT: shrq $8, %r8<br class="">
+; AVX1-NEXT: andb $15, %r8b<br class="">
+; AVX1-NEXT: movb %r8b, -{{[0-9]+}}(%rsp)<br class="">
+; AVX1-NEXT: movq %r14, %rbx<br class="">
+; AVX1-NEXT: andb $15, %r14b<br class="">
+; AVX1-NEXT: movb %r14b, -{{[0-9]+}}(%rsp)<br class="">
+; AVX1-NEXT: shrq $8, %r10<br class="">
+; AVX1-NEXT: shrq $16, %rdx<br class="">
+; AVX1-NEXT: shrq $24, %rax<br class="">
+; AVX1-NEXT: shrq $32, %rcx<br class="">
+; AVX1-NEXT: shrq $40, %rsi<br class="">
+; AVX1-NEXT: shrq $48, %rdi<br class="">
+; AVX1-NEXT: shrq $56, %rbx<br class="">
; AVX1-NEXT: andb $15, %bl<br class="">
; AVX1-NEXT: movb %bl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: shrq $40, %rsi<br class="">
+; AVX1-NEXT: andb $15, %dil<br class="">
+; AVX1-NEXT: movb %dil, -{{[0-9]+}}(%rsp)<br class="">
; AVX1-NEXT: andb $15, %sil<br class="">
; AVX1-NEXT: movb %sil, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: shrq $32, %rax<br class="">
+; AVX1-NEXT: andb $15, %cl<br class="">
+; AVX1-NEXT: movb %cl, -{{[0-9]+}}(%rsp)<br class="">
; AVX1-NEXT: andb $15, %al<br class="">
; AVX1-NEXT: movb %al, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: shrq $24, %rdi<br class="">
-; AVX1-NEXT: andb $15, %dil<br class="">
-; AVX1-NEXT: movb %dil, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: shrq $16, %r13<br class="">
-; AVX1-NEXT: andb $15, %r13b<br class="">
-; AVX1-NEXT: movb %r13b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: shrq $8, %r12<br class="">
-; AVX1-NEXT: andb $15, %r12b<br class="">
-; AVX1-NEXT: movb %r12b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: shrq $8, %r8<br class="">
-; AVX1-NEXT: shrq $16, %r9<br class="">
-; AVX1-NEXT: shrq $24, %r10<br class="">
-; AVX1-NEXT: shrq $32, %r11<br class="">
-; AVX1-NEXT: shrq $40, %r14<br class="">
-; AVX1-NEXT: shrq $48, %r15<br class="">
-; AVX1-NEXT: shrq $56, %rdx<br class="">
; AVX1-NEXT: andb $15, %dl<br class="">
; AVX1-NEXT: movb %dl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: andb $15, %r15b<br class="">
-; AVX1-NEXT: movb %r15b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: andb $15, %r14b<br class="">
-; AVX1-NEXT: movb %r14b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: andb $15, %r11b<br class="">
-; AVX1-NEXT: movb %r11b, -{{[0-9]+}}(%rsp)<br class="">
; AVX1-NEXT: andb $15, %r10b<br class="">
; AVX1-NEXT: movb %r10b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: andb $15, %r9b<br class="">
-; AVX1-NEXT: movb %r9b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX1-NEXT: andb $15, %r8b<br class="">
-; AVX1-NEXT: movb %r8b, -{{[0-9]+}}(%rsp)<br class="">
; AVX1-NEXT: vextractf128 $1, %ymm0, %xmm0<br class="">
; AVX1-NEXT: vmovq %xmm0, %rax<br class="">
-; AVX1-NEXT: movq %rax, %rcx<br class="">
+; AVX1-NEXT: movq %rax, %r8<br class="">
; AVX1-NEXT: movq %rax, %rdx<br class="">
; AVX1-NEXT: movq %rax, %rsi<br class="">
; AVX1-NEXT: movq %rax, %rdi<br class="">
-; AVX1-NEXT: movl %eax, %ebp<br class="">
; AVX1-NEXT: movl %eax, %ebx<br class="">
+; AVX1-NEXT: movl %eax, %ecx<br class="">
; AVX1-NEXT: vmovd %eax, %xmm1<br class="">
; AVX1-NEXT: shrl $8, %eax<br class="">
; AVX1-NEXT: vpinsrb $1, %eax, %xmm1, %xmm1<br class="">
-; AVX1-NEXT: shrl $16, %ebx<br class="">
-; AVX1-NEXT: vpinsrb $2, %ebx, %xmm1, %xmm1<br class="">
-; AVX1-NEXT: shrl $24, %ebp<br class="">
-; AVX1-NEXT: vpinsrb $3, %ebp, %xmm1, %xmm1<br class="">
+; AVX1-NEXT: shrl $16, %ecx<br class="">
+; AVX1-NEXT: vpinsrb $2, %ecx, %xmm1, %xmm1<br class="">
+; AVX1-NEXT: shrl $24, %ebx<br class="">
+; AVX1-NEXT: vpinsrb $3, %ebx, %xmm1, %xmm1<br class="">
; AVX1-NEXT: shrq $32, %rdi<br class="">
; AVX1-NEXT: vpinsrb $4, %edi, %xmm1, %xmm1<br class="">
; AVX1-NEXT: shrq $40, %rsi<br class="">
@@ -1274,8 +1270,8 @@ define <32 x i8> @_clearupper32xi8b(<32<br class="">
; AVX1-NEXT: shrq $48, %rdx<br class="">
; AVX1-NEXT: vpinsrb $6, %edx, %xmm1, %xmm1<br class="">
; AVX1-NEXT: vpextrq $1, %xmm0, %rax<br class="">
-; AVX1-NEXT: shrq $56, %rcx<br class="">
-; AVX1-NEXT: vpinsrb $7, %ecx, %xmm1, %xmm0<br class="">
+; AVX1-NEXT: shrq $56, %r8<br class="">
+; AVX1-NEXT: vpinsrb $7, %r8d, %xmm1, %xmm0<br class="">
; AVX1-NEXT: movl %eax, %ecx<br class="">
; AVX1-NEXT: shrl $8, %ecx<br class="">
; AVX1-NEXT: vpinsrb $8, %eax, %xmm0, %xmm0<br class="">
@@ -1343,100 +1339,92 @@ define <32 x i8> @_clearupper32xi8b(<32<br class="">
; AVX1-NEXT: vpinsrb $15, %eax, %xmm1, %xmm1<br class="">
; AVX1-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX1-NEXT: popq %rbx<br class="">
-; AVX1-NEXT: popq %r12<br class="">
-; AVX1-NEXT: popq %r13<br class="">
; AVX1-NEXT: popq %r14<br class="">
-; AVX1-NEXT: popq %r15<br class="">
-; AVX1-NEXT: popq %rbp<br class="">
; AVX1-NEXT: retq<br class="">
;<br class="">
; AVX2-LABEL: _clearupper32xi8b:<br class="">
; AVX2: # BB#0:<br class="">
-; AVX2-NEXT: pushq %rbp<br class="">
-; AVX2-NEXT: pushq %r15<br class="">
; AVX2-NEXT: pushq %r14<br class="">
-; AVX2-NEXT: pushq %r13<br class="">
-; AVX2-NEXT: pushq %r12<br class="">
; AVX2-NEXT: pushq %rbx<br class="">
; AVX2-NEXT: vpextrq $1, %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; AVX2-NEXT: vmovq %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: movq -{{[0-9]+}}(%rsp), %rcx<br class="">
-; AVX2-NEXT: movq -{{[0-9]+}}(%rsp), %rdx<br class="">
-; AVX2-NEXT: movq %rcx, %r8<br class="">
-; AVX2-NEXT: movq %rcx, %r9<br class="">
-; AVX2-NEXT: movq %rcx, %r10<br class="">
-; AVX2-NEXT: movq %rcx, %r11<br class="">
-; AVX2-NEXT: movq %rcx, %r14<br class="">
-; AVX2-NEXT: movq %rcx, %r15<br class="">
-; AVX2-NEXT: movq %rdx, %r12<br class="">
-; AVX2-NEXT: movq %rdx, %r13<br class="">
+; AVX2-NEXT: movq -{{[0-9]+}}(%rsp), %r14<br class="">
+; AVX2-NEXT: vpextrq $1, %xmm0, %rdx<br class="">
+; AVX2-NEXT: movq %rdx, %r8<br class="">
+; AVX2-NEXT: movq %rdx, %r9<br class="">
+; AVX2-NEXT: movq %rdx, %r11<br class="">
+; AVX2-NEXT: movq %rdx, %rsi<br class="">
; AVX2-NEXT: movq %rdx, %rdi<br class="">
+; AVX2-NEXT: movq %rdx, %rcx<br class="">
; AVX2-NEXT: movq %rdx, %rax<br class="">
-; AVX2-NEXT: movq %rdx, %rsi<br class="">
-; AVX2-NEXT: movq %rdx, %rbx<br class="">
-; AVX2-NEXT: movq %rdx, %rbp<br class="">
; AVX2-NEXT: andb $15, %dl<br class="">
; AVX2-NEXT: movb %dl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: movq %rcx, %rdx<br class="">
+; AVX2-NEXT: shrq $56, %rax<br class="">
+; AVX2-NEXT: andb $15, %al<br class="">
+; AVX2-NEXT: movb %al, -{{[0-9]+}}(%rsp)<br class="">
+; AVX2-NEXT: movq %r14, %r10<br class="">
+; AVX2-NEXT: shrq $48, %rcx<br class="">
; AVX2-NEXT: andb $15, %cl<br class="">
; AVX2-NEXT: movb %cl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: shrq $56, %rbp<br class="">
-; AVX2-NEXT: andb $15, %bpl<br class="">
-; AVX2-NEXT: movb %bpl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: shrq $48, %rbx<br class="">
+; AVX2-NEXT: movq %r14, %rdx<br class="">
+; AVX2-NEXT: shrq $40, %rdi<br class="">
+; AVX2-NEXT: andb $15, %dil<br class="">
+; AVX2-NEXT: movb %dil, -{{[0-9]+}}(%rsp)<br class="">
+; AVX2-NEXT: movq %r14, %rax<br class="">
+; AVX2-NEXT: shrq $32, %rsi<br class="">
+; AVX2-NEXT: andb $15, %sil<br class="">
+; AVX2-NEXT: movb %sil, -{{[0-9]+}}(%rsp)<br class="">
+; AVX2-NEXT: movq %r14, %rcx<br class="">
+; AVX2-NEXT: shrq $24, %r11<br class="">
+; AVX2-NEXT: andb $15, %r11b<br class="">
+; AVX2-NEXT: movb %r11b, -{{[0-9]+}}(%rsp)<br class="">
+; AVX2-NEXT: movq %r14, %rsi<br class="">
+; AVX2-NEXT: shrq $16, %r9<br class="">
+; AVX2-NEXT: andb $15, %r9b<br class="">
+; AVX2-NEXT: movb %r9b, -{{[0-9]+}}(%rsp)<br class="">
+; AVX2-NEXT: movq %r14, %rdi<br class="">
+; AVX2-NEXT: shrq $8, %r8<br class="">
+; AVX2-NEXT: andb $15, %r8b<br class="">
+; AVX2-NEXT: movb %r8b, -{{[0-9]+}}(%rsp)<br class="">
+; AVX2-NEXT: movq %r14, %rbx<br class="">
+; AVX2-NEXT: andb $15, %r14b<br class="">
+; AVX2-NEXT: movb %r14b, -{{[0-9]+}}(%rsp)<br class="">
+; AVX2-NEXT: shrq $8, %r10<br class="">
+; AVX2-NEXT: shrq $16, %rdx<br class="">
+; AVX2-NEXT: shrq $24, %rax<br class="">
+; AVX2-NEXT: shrq $32, %rcx<br class="">
+; AVX2-NEXT: shrq $40, %rsi<br class="">
+; AVX2-NEXT: shrq $48, %rdi<br class="">
+; AVX2-NEXT: shrq $56, %rbx<br class="">
; AVX2-NEXT: andb $15, %bl<br class="">
; AVX2-NEXT: movb %bl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: shrq $40, %rsi<br class="">
+; AVX2-NEXT: andb $15, %dil<br class="">
+; AVX2-NEXT: movb %dil, -{{[0-9]+}}(%rsp)<br class="">
; AVX2-NEXT: andb $15, %sil<br class="">
; AVX2-NEXT: movb %sil, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: shrq $32, %rax<br class="">
+; AVX2-NEXT: andb $15, %cl<br class="">
+; AVX2-NEXT: movb %cl, -{{[0-9]+}}(%rsp)<br class="">
; AVX2-NEXT: andb $15, %al<br class="">
; AVX2-NEXT: movb %al, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: shrq $24, %rdi<br class="">
-; AVX2-NEXT: andb $15, %dil<br class="">
-; AVX2-NEXT: movb %dil, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: shrq $16, %r13<br class="">
-; AVX2-NEXT: andb $15, %r13b<br class="">
-; AVX2-NEXT: movb %r13b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: shrq $8, %r12<br class="">
-; AVX2-NEXT: andb $15, %r12b<br class="">
-; AVX2-NEXT: movb %r12b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: shrq $8, %r8<br class="">
-; AVX2-NEXT: shrq $16, %r9<br class="">
-; AVX2-NEXT: shrq $24, %r10<br class="">
-; AVX2-NEXT: shrq $32, %r11<br class="">
-; AVX2-NEXT: shrq $40, %r14<br class="">
-; AVX2-NEXT: shrq $48, %r15<br class="">
-; AVX2-NEXT: shrq $56, %rdx<br class="">
; AVX2-NEXT: andb $15, %dl<br class="">
; AVX2-NEXT: movb %dl, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: andb $15, %r15b<br class="">
-; AVX2-NEXT: movb %r15b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: andb $15, %r14b<br class="">
-; AVX2-NEXT: movb %r14b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: andb $15, %r11b<br class="">
-; AVX2-NEXT: movb %r11b, -{{[0-9]+}}(%rsp)<br class="">
; AVX2-NEXT: andb $15, %r10b<br class="">
; AVX2-NEXT: movb %r10b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: andb $15, %r9b<br class="">
-; AVX2-NEXT: movb %r9b, -{{[0-9]+}}(%rsp)<br class="">
-; AVX2-NEXT: andb $15, %r8b<br class="">
-; AVX2-NEXT: movb %r8b, -{{[0-9]+}}(%rsp)<br class="">
; AVX2-NEXT: vextracti128 $1, %ymm0, %xmm0<br class="">
; AVX2-NEXT: vmovq %xmm0, %rax<br class="">
-; AVX2-NEXT: movq %rax, %rcx<br class="">
+; AVX2-NEXT: movq %rax, %r8<br class="">
; AVX2-NEXT: movq %rax, %rdx<br class="">
; AVX2-NEXT: movq %rax, %rsi<br class="">
; AVX2-NEXT: movq %rax, %rdi<br class="">
-; AVX2-NEXT: movl %eax, %ebp<br class="">
; AVX2-NEXT: movl %eax, %ebx<br class="">
+; AVX2-NEXT: movl %eax, %ecx<br class="">
; AVX2-NEXT: vmovd %eax, %xmm1<br class="">
; AVX2-NEXT: shrl $8, %eax<br class="">
; AVX2-NEXT: vpinsrb $1, %eax, %xmm1, %xmm1<br class="">
-; AVX2-NEXT: shrl $16, %ebx<br class="">
-; AVX2-NEXT: vpinsrb $2, %ebx, %xmm1, %xmm1<br class="">
-; AVX2-NEXT: shrl $24, %ebp<br class="">
-; AVX2-NEXT: vpinsrb $3, %ebp, %xmm1, %xmm1<br class="">
+; AVX2-NEXT: shrl $16, %ecx<br class="">
+; AVX2-NEXT: vpinsrb $2, %ecx, %xmm1, %xmm1<br class="">
+; AVX2-NEXT: shrl $24, %ebx<br class="">
+; AVX2-NEXT: vpinsrb $3, %ebx, %xmm1, %xmm1<br class="">
; AVX2-NEXT: shrq $32, %rdi<br class="">
; AVX2-NEXT: vpinsrb $4, %edi, %xmm1, %xmm1<br class="">
; AVX2-NEXT: shrq $40, %rsi<br class="">
@@ -1446,8 +1434,8 @@ define <32 x i8> @_clearupper32xi8b(<32<br class="">
; AVX2-NEXT: shrq $48, %rdx<br class="">
; AVX2-NEXT: vpinsrb $6, %edx, %xmm1, %xmm1<br class="">
; AVX2-NEXT: vpextrq $1, %xmm0, %rax<br class="">
-; AVX2-NEXT: shrq $56, %rcx<br class="">
-; AVX2-NEXT: vpinsrb $7, %ecx, %xmm1, %xmm0<br class="">
+; AVX2-NEXT: shrq $56, %r8<br class="">
+; AVX2-NEXT: vpinsrb $7, %r8d, %xmm1, %xmm0<br class="">
; AVX2-NEXT: movl %eax, %ecx<br class="">
; AVX2-NEXT: shrl $8, %ecx<br class="">
; AVX2-NEXT: vpinsrb $8, %eax, %xmm0, %xmm0<br class="">
@@ -1515,11 +1503,7 @@ define <32 x i8> @_clearupper32xi8b(<32<br class="">
; AVX2-NEXT: vpinsrb $15, %eax, %xmm1, %xmm1<br class="">
; AVX2-NEXT: vinserti128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX2-NEXT: popq %rbx<br class="">
-; AVX2-NEXT: popq %r12<br class="">
-; AVX2-NEXT: popq %r13<br class="">
; AVX2-NEXT: popq %r14<br class="">
-; AVX2-NEXT: popq %r15<br class="">
-; AVX2-NEXT: popq %rbp<br class="">
; AVX2-NEXT: retq<br class="">
%x4 = bitcast <32 x i8> %0 to <64 x i4><br class="">
%r0 = insertelement <64 x i4> %x4, i4 zeroinitializer, i32 1<br class="">
<br class="">
Removed: llvm/trunk/test/CodeGen/X86/co<wbr class="">mbiner-aa-0.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/combiner-aa-0.ll?rev=297694&view=auto" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/combiner-aa-0.ll?rev=<wbr class="">297694&view=auto</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/co<wbr class="">mbiner-aa-0.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/co<wbr class="">mbiner-aa-0.ll (removed)<br class="">
@@ -1,20 +0,0 @@<br class="">
-; RUN: llc < %s -march=x86-64 -combiner-global-alias-analysi<wbr class="">s -combiner-alias-analysis<br class="">
-<br class="">
-target datalayout = "e-p:64:64:64-i1:8:8-i8:8:8-i1<wbr class="">6:16:16-i32:32:32-i64:64:64-f3<wbr class="">2:32:32-f64:64:64-v64:64:64-v1<wbr class="">28:128:128-a0:0:64-s0:64:64-f8<wbr class="">0:128:128"<br class="">
- %struct.Hash_Key = type { [4 x i32], i32 }<br class="">
-@g_flipV_hashkey = external global %struct.Hash_Key, align 16 ; <%struct.Hash_Key*> [#uses=1]<br class="">
-<br class="">
-define void @foo() nounwind {<br class="">
- %t0 = load i32, i32* undef, align 16 ; <i32> [#uses=1]<br class="">
- %t1 = load i32, i32* null, align 4 ; <i32> [#uses=1]<br class="">
- %t2 = srem i32 %t0, 32 ; <i32> [#uses=1]<br class="">
- %t3 = shl i32 1, %t2 ; <i32> [#uses=1]<br class="">
- %t4 = xor i32 %t3, %t1 ; <i32> [#uses=1]<br class="">
- store i32 %t4, i32* null, align 4<br class="">
- %t5 = getelementptr %struct.Hash_Key, %struct.Hash_Key* @g_flipV_hashkey, i64 0, i32 0, i64 0 ; <i32*> [#uses=2]<br class="">
- %t6 = load i32, i32* %t5, align 4 ; <i32> [#uses=1]<br class="">
- %t7 = shl i32 1, undef ; <i32> [#uses=1]<br class="">
- %t8 = xor i32 %t7, %t6 ; <i32> [#uses=1]<br class="">
- store i32 %t8, i32* %t5, align 4<br class="">
- unreachable<br class="">
-}<br class="">
<br class="">
Removed: llvm/trunk/test/CodeGen/X86/co<wbr class="">mbiner-aa-1.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/combiner-aa-1.ll?rev=297694&view=auto" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/combiner-aa-1.ll?rev=<wbr class="">297694&view=auto</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/co<wbr class="">mbiner-aa-1.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/co<wbr class="">mbiner-aa-1.ll (removed)<br class="">
@@ -1,23 +0,0 @@<br class="">
-; RUN: llc < %s --combiner-alias-analysis --combiner-global-alias-analys<wbr class="">is<br class="">
-; PR4880<br class="">
-<br class="">
-target datalayout = "e-p:32:32:32-i1:8:8-i8:8:8-i1<wbr class="">6:16:16-i32:32:32-i64:32:64-f3<wbr class="">2:32:32-f64:32:64-v64:64:64-v1<wbr class="">28:128:128-a0:0:64-f80:32:32"<br class="">
-target triple = "i386-pc-linux-gnu"<br class="">
-<br class="">
-%struct.alst_node = type { %struct.node }<br class="">
-%struct.arg_node = type { %struct.node, i8*, %struct.alst_node* }<br class="">
-%struct.arglst_node = type { %struct.alst_node, %struct.arg_node*, %struct.arglst_node* }<br class="">
-%struct.lam_node = type { %struct.alst_node, %struct.arg_node*, %struct.alst_node* }<br class="">
-%struct.node = type { i32 (...)**, %struct.node* }<br class="">
-<br class="">
-define i32 @._ZN8lam_node18resolve_name_c<wbr class="">lashEP8arg_nodeP9alst_node._ZN<wbr class="">K8lam_nodeeqERK8exp_node._ZN11<wbr class="">arglst_nodeD0Ev(%struct.lam_<wbr class="">node* %this.this, %struct.arg_node* %outer_arg, %struct.alst_node* %env.cmp, %struct.arglst_node* %this, i32 %functionID) {<br class="">
-comb_entry:<br class="">
- %.SV59 = alloca %struct.node* ; <%struct.node**> [#uses=1]<br class="">
- %0 = load i32 (...)**, i32 (...)*** null, align 4 ; <i32 (...)**> [#uses=1]<br class="">
- %1 = getelementptr inbounds i32 (...)*, i32 (...)** %0, i32 3 ; <i32 (...)**> [#uses=1]<br class="">
- %2 = load i32 (...)*, i32 (...)** %1, align 4 ; <i32 (...)*> [#uses=1]<br class="">
- store %struct.node* undef, %struct.node** %.SV59<br class="">
- %3 = bitcast i32 (...)* %2 to i32 (%struct.node*)* ; <i32 (%struct.node*)*> [#uses=1]<br class="">
- %4 = tail call i32 %3(%struct.node* undef) ; <i32> [#uses=0]<br class="">
- unreachable<br class="">
-}<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/co<wbr class="">py-eflags.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/copy-eflags.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/copy-eflags.ll?rev=297695&<wbr class="">r1=297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/co<wbr class="">py-eflags.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/co<wbr class="">py-eflags.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -9,19 +9,22 @@ target triple = "i686-unknown-linux-gnu"<br class="">
@.str = private unnamed_addr constant [4 x i8] c"%d\0A\00", align 1<br class="">
<br class="">
; CHECK-LABEL: func:<br class="">
-; This tests whether eax is properly saved/restored around the lahf/sahf<br class="">
-; instruction sequences.<br class="">
+; This tests whether eax is properly saved/restored around the<br class="">
+; lahf/sahf instruction sequences. We make mem op volatile to prevent<br class="">
+; their reordering to avoid spills.<br class="">
+<br class="">
+<br class="">
define i32 @func() {<br class="">
entry:<br class="">
%bval = load i8, i8* @b<br class="">
%inc = add i8 %bval, 1<br class="">
- store i8 %inc, i8* @b<br class="">
- %cval = load i32, i32* @c<br class="">
+ store volatile i8 %inc, i8* @b<br class="">
+ %cval = load volatile i32, i32* @c<br class="">
%inc1 = add nsw i32 %cval, 1<br class="">
- store i32 %inc1, i32* @c<br class="">
- %aval = load i8, i8* @a<br class="">
+ store volatile i32 %inc1, i32* @c<br class="">
+ %aval = load volatile i8, i8* @a<br class="">
%inc2 = add i8 %aval, 1<br class="">
- store i8 %inc2, i8* @a<br class="">
+ store volatile i8 %inc2, i8* @a<br class="">
; Copy flags produced by the incb of %inc1 to a register, need to save+restore<br class="">
; eax around it. The flags will be reused by %tobool.<br class="">
; CHECK: pushl %eax<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/da<wbr class="">g-merge-fast-accesses.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/dag-merge-fast-accesses.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/dag-merge-fast-accesses.<wbr class="">ll?rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/da<wbr class="">g-merge-fast-accesses.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/da<wbr class="">g-merge-fast-accesses.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -51,19 +51,11 @@ define void @merge_vec_element_store(<4<br class="">
}<br class="">
<br class="">
<br class="">
-;; TODO: FAST *should* be:<br class="">
-;; movups (%rdi), %xmm0<br class="">
-;; movups %xmm0, 40(%rdi)<br class="">
-;; ..but is not currently. See the UseAA FIXME in DAGCombiner.cpp<br class="">
-;; visitSTORE.<br class="">
-<br class="">
define void @merge_vec_load_and_stores(i64 *%ptr) {<br class="">
; FAST-LABEL: merge_vec_load_and_stores:<br class="">
; FAST: # BB#0:<br class="">
-; FAST-NEXT: movq (%rdi), %rax<br class="">
-; FAST-NEXT: movq 8(%rdi), %rcx<br class="">
-; FAST-NEXT: movq %rax, 40(%rdi)<br class="">
-; FAST-NEXT: movq %rcx, 48(%rdi)<br class="">
+; FAST-NEXT: movups (%rdi), %xmm0<br class="">
+; FAST-NEXT: movups %xmm0, 40(%rdi)<br class="">
; FAST-NEXT: retq<br class="">
;<br class="">
; SLOW-LABEL: merge_vec_load_and_stores:<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/do<wbr class="">nt-trunc-store-double-to-float<wbr class="">.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/dont-trunc-store-double-to-float.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/dont-trunc-store-double-<wbr class="">to-float.ll?rev=297695&r1=<wbr class="">297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/do<wbr class="">nt-trunc-store-double-to-float<wbr class="">.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/do<wbr class="">nt-trunc-store-double-to-float<wbr class="">.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,9 +1,9 @@<br class="">
; RUN: llc -march=x86 < %s | FileCheck %s<br class="">
<br class="">
; CHECK-LABEL: @bar<br class="">
-; CHECK: movl $1074339512,<br class="">
-; CHECK: movl $1374389535,<br class="">
-; CHECK: movl $1078523331,<br class="">
+; CHECK-DAG: movl $1074339512,<br class="">
+; CHECK-DAG: movl $1374389535,<br class="">
+; CHECK-DAG: movl $1078523331,<br class="">
define void @bar() unnamed_addr {<br class="">
entry-block:<br class="">
%a = alloca double<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/ex<wbr class="">tractelement-legalization-stor<wbr class="">e-ordering.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/extractelement-legalization-store-ordering.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/extractelement-legalizatio<wbr class="">n-store-ordering.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/ex<wbr class="">tractelement-legalization-stor<wbr class="">e-ordering.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/ex<wbr class="">tractelement-legalization-stor<wbr class="">e-ordering.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -16,19 +16,20 @@ target datalayout = "e-m:o-p:32:32-f64:3<br class="">
; CHECK-NEXT: movl 20(%esp), %edx<br class="">
; CHECK-NEXT: paddd (%edx), %xmm0<br class="">
; CHECK-NEXT: movdqa %xmm0, (%edx)<br class="">
-; CHECK-NEXT: movl (%edx), %esi<br class="">
-; CHECK-NEXT: movl 12(%edx), %edi<br class="">
-; CHECK-NEXT: movl 8(%edx), %ebx<br class="">
-; CHECK-NEXT: movl 4(%edx), %edx<br class="">
-; CHECK-NEXT: shll $4, %ecx<br class="">
+; CHECK-NEXT: movl (%edx), %esi<br class="">
+; CHECK-NEXT: movl 4(%edx), %edi<br class="">
+; CHECK-NEXT: shll $4, %ecx<br class="">
+; CHECK-NEXT: movl 8(%edx), %ebx<br class="">
+; CHECK-NEXT: movl 12(%edx), %edx<br class="">
; CHECK-NEXT: movl %esi, 12(%eax,%ecx)<br class="">
-; CHECK-NEXT: movl %edx, (%eax,%ecx)<br class="">
+; CHECK-NEXT: movl %edi, (%eax,%ecx)<br class="">
; CHECK-NEXT: movl %ebx, 8(%eax,%ecx)<br class="">
-; CHECK-NEXT: movl %edi, 4(%eax,%ecx)<br class="">
+; CHECK-NEXT: movl %edx, 4(%eax,%ecx)<br class="">
; CHECK-NEXT: popl %esi<br class="">
; CHECK-NEXT: popl %edi<br class="">
; CHECK-NEXT: popl %ebx<br class="">
; CHECK-NEXT: retl<br class="">
+<br class="">
define void @test_extractelement_legalizat<wbr class="">ion_storereuse(<4 x i32> %a, i32* nocapture %x, i32* nocapture readonly %y, i32 %i) #0 {<br class="">
entry:<br class="">
%0 = bitcast i32* %y to <4 x i32>*<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/i2<wbr class="">56-add.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/i256-add.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/i256-add.ll?rev=297695&r1=<wbr class="">297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/i2<wbr class="">56-add.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/i2<wbr class="">56-add.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -6,45 +6,122 @@ define void @add(i256* %p, i256* %q) nou<br class="">
; X32-LABEL: add:<br class="">
; X32: # BB#0:<br class="">
; X32-NEXT: pushl %ebp<br class="">
+; X32-NEXT: movl %esp, %ebp<br class="">
; X32-NEXT: pushl %ebx<br class="">
; X32-NEXT: pushl %edi<br class="">
; X32-NEXT: pushl %esi<br class="">
-; X32-NEXT: subl $16, %esp<br class="">
-; X32-NEXT: movl {{[0-9]+}}(%esp), %eax<br class="">
-; X32-NEXT: movl {{[0-9]+}}(%esp), %ecx<br class="">
-; X32-NEXT: movl 8(%ecx), %edi<br class="">
-; X32-NEXT: movl (%ecx), %esi<br class="">
-; X32-NEXT: movl 4(%ecx), %ebx<br class="">
-; X32-NEXT: movl 28(%eax), %edx<br class="">
-; X32-NEXT: movl %edx, {{[0-9]+}}(%esp) # 4-byte Spill<br class="">
-; X32-NEXT: movl 24(%eax), %edx<br class="">
-; X32-NEXT: addl (%eax), %esi<br class="">
-; X32-NEXT: movl %esi, {{[0-9]+}}(%esp) # 4-byte Spill<br class="">
-; X32-NEXT: adcl 4(%eax), %ebx<br class="">
-; X32-NEXT: movl %ebx, (%esp) # 4-byte Spill<br class="">
-; X32-NEXT: adcl 8(%eax), %edi<br class="">
-; X32-NEXT: movl %edi, {{[0-9]+}}(%esp) # 4-byte Spill<br class="">
-; X32-NEXT: movl 20(%eax), %ebx<br class="">
-; X32-NEXT: movl 12(%eax), %esi<br class="">
-; X32-NEXT: movl 16(%eax), %edi<br class="">
-; X32-NEXT: adcl 12(%ecx), %esi<br class="">
-; X32-NEXT: adcl 16(%ecx), %edi<br class="">
-; X32-NEXT: adcl 20(%ecx), %ebx<br class="">
-; X32-NEXT: adcl 24(%ecx), %edx<br class="">
-; X32-NEXT: movl {{[0-9]+}}(%esp), %eax # 4-byte Reload<br class="">
-; X32-NEXT: adcl 28(%ecx), %eax<br class="">
-; X32-NEXT: movl {{[0-9]+}}(%esp), %ebp # 4-byte Reload<br class="">
-; X32-NEXT: movl %ebp, 8(%ecx)<br class="">
-; X32-NEXT: movl (%esp), %ebp # 4-byte Reload<br class="">
-; X32-NEXT: movl %ebp, 4(%ecx)<br class="">
-; X32-NEXT: movl {{[0-9]+}}(%esp), %ebp # 4-byte Reload<br class="">
-; X32-NEXT: movl %ebp, (%ecx)<br class="">
-; X32-NEXT: movl %esi, 12(%ecx)<br class="">
-; X32-NEXT: movl %edi, 16(%ecx)<br class="">
-; X32-NEXT: movl %ebx, 20(%ecx)<br class="">
-; X32-NEXT: movl %edx, 24(%ecx)<br class="">
-; X32-NEXT: movl %eax, 28(%ecx)<br class="">
-; X32-NEXT: addl $16, %esp<br class="">
+; X32-NEXT: subl $28, %esp<br class="">
+; X32-NEXT: movl 12(%ebp), %edi<br class="">
+; X32-NEXT: movl 8(%ebp), %eax<br class="">
+; X32-NEXT: movl (%eax), %ecx<br class="">
+; X32-NEXT: movl (%edi), %edx<br class="">
+; X32-NEXT: movl %ecx, %esi<br class="">
+; X32-NEXT: addl %edx, %esi<br class="">
+; X32-NEXT: movl 4(%edi), %ebx<br class="">
+; X32-NEXT: movl 4(%eax), %esi<br class="">
+; X32-NEXT: adcl %ebx, %esi<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %esi<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: movl %esi, -32(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl %esi, -16(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: addl %edx, %ecx<br class="">
+; X32-NEXT: movl %ecx, -40(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl 8(%edi), %edx<br class="">
+; X32-NEXT: movl %edx, -28(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl 28(%edi), %ecx<br class="">
+; X32-NEXT: movl %ecx, -36(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl 24(%edi), %ecx<br class="">
+; X32-NEXT: movl %ecx, -20(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl 20(%edi), %ecx<br class="">
+; X32-NEXT: movl 16(%edi), %esi<br class="">
+; X32-NEXT: movl %esi, -24(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl 12(%edi), %edi<br class="">
+; X32-NEXT: adcl %ebx, 4(%eax)<br class="">
+; X32-NEXT: movl 8(%eax), %ebx<br class="">
+; X32-NEXT: movl -16(%ebp), %esi # 4-byte Reload<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %esi, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: adcl %edx, %ebx<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %ebx<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: adcl %edi, 12(%eax)<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %ebx, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: adcl 12(%eax), %edi<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %esi<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: movl 16(%eax), %ebx<br class="">
+; X32-NEXT: movl -24(%ebp), %edx # 4-byte Reload<br class="">
+; X32-NEXT: adcl %edx, %ebx<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %ebx<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %edi<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %esi, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: adcl %edx, 16(%eax)<br class="">
+; X32-NEXT: movl -32(%ebp), %edx # 4-byte Reload<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %edx, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: movl -28(%ebp), %edx # 4-byte Reload<br class="">
+; X32-NEXT: adcl %edx, 8(%eax)<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %edi, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: adcl %ecx, 20(%eax)<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %ebx, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: adcl 20(%eax), %ecx<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %ecx<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: movl -20(%ebp), %edx # 4-byte Reload<br class="">
+; X32-NEXT: adcl %edx, 24(%eax)<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %ecx, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: adcl 24(%eax), %edx<br class="">
+; X32-NEXT: movl -36(%ebp), %ecx # 4-byte Reload<br class="">
+; X32-NEXT: adcl %ecx, 28(%eax)<br class="">
+; X32-NEXT: movl -40(%ebp), %ecx # 4-byte Reload<br class="">
+; X32-NEXT: movl %ecx, (%eax)<br class="">
+; X32-NEXT: addl $28, %esp<br class="">
; X32-NEXT: popl %esi<br class="">
; X32-NEXT: popl %edi<br class="">
; X32-NEXT: popl %ebx<br class="">
@@ -53,18 +130,28 @@ define void @add(i256* %p, i256* %q) nou<br class="">
;<br class="">
; X64-LABEL: add:<br class="">
; X64: # BB#0:<br class="">
-; X64-NEXT: movq 16(%rdi), %rax<br class="">
-; X64-NEXT: movq (%rdi), %r8<br class="">
-; X64-NEXT: movq 8(%rdi), %rdx<br class="">
-; X64-NEXT: movq 24(%rsi), %rcx<br class="">
-; X64-NEXT: addq (%rsi), %r8<br class="">
-; X64-NEXT: adcq 8(%rsi), %rdx<br class="">
-; X64-NEXT: adcq 16(%rsi), %rax<br class="">
-; X64-NEXT: adcq 24(%rdi), %rcx<br class="">
-; X64-NEXT: movq %rax, 16(%rdi)<br class="">
-; X64-NEXT: movq %rdx, 8(%rdi)<br class="">
-; X64-NEXT: movq %r8, (%rdi)<br class="">
-; X64-NEXT: movq %rcx, 24(%rdi)<br class="">
+; X64-NEXT: pushq %rbp<br class="">
+; X64-NEXT: movq %rsp, %rbp<br class="">
+; X64-NEXT: movq (%rdi), %rdx<br class="">
+; X64-NEXT: movq 8(%rdi), %r9<br class="">
+; X64-NEXT: movq 24(%rsi), %r8<br class="">
+; X64-NEXT: movq 8(%rsi), %r10<br class="">
+; X64-NEXT: movq 16(%rsi), %rcx<br class="">
+; X64-NEXT: movq (%rsi), %rsi<br class="">
+; X64-NEXT: movq %rdx, %rax<br class="">
+; X64-NEXT: addq %rsi, %rax<br class="">
+; X64-NEXT: adcq %r10, 8(%rdi)<br class="">
+; X64-NEXT: addq %rsi, %rdx<br class="">
+; X64-NEXT: adcq %r10, %r9<br class="">
+; X64-NEXT: pushfq<br class="">
+; X64-NEXT: popq %rax<br class="">
+; X64-NEXT: adcq %rcx, 16(%rdi)<br class="">
+; X64-NEXT: pushq %rax<br class="">
+; X64-NEXT: popfq<br class="">
+; X64-NEXT: adcq 16(%rdi), %rcx<br class="">
+; X64-NEXT: adcq %r8, 24(%rdi)<br class="">
+; X64-NEXT: movq %rdx, (%rdi)<br class="">
+; X64-NEXT: popq %rbp<br class="">
; X64-NEXT: retq<br class="">
%a = load i256, i256* %p<br class="">
%b = load i256, i256* %q<br class="">
@@ -76,43 +163,110 @@ define void @sub(i256* %p, i256* %q) nou<br class="">
; X32-LABEL: sub:<br class="">
; X32: # BB#0:<br class="">
; X32-NEXT: pushl %ebp<br class="">
+; X32-NEXT: movl %esp, %ebp<br class="">
; X32-NEXT: pushl %ebx<br class="">
; X32-NEXT: pushl %edi<br class="">
; X32-NEXT: pushl %esi<br class="">
-; X32-NEXT: subl $12, %esp<br class="">
-; X32-NEXT: movl {{[0-9]+}}(%esp), %ebx<br class="">
-; X32-NEXT: movl {{[0-9]+}}(%esp), %ecx<br class="">
-; X32-NEXT: movl 16(%ecx), %eax<br class="">
-; X32-NEXT: movl 12(%ecx), %edx<br class="">
-; X32-NEXT: movl 8(%ecx), %edi<br class="">
-; X32-NEXT: movl (%ecx), %esi<br class="">
-; X32-NEXT: movl 4(%ecx), %ebp<br class="">
-; X32-NEXT: subl (%ebx), %esi<br class="">
-; X32-NEXT: movl %esi, {{[0-9]+}}(%esp) # 4-byte Spill<br class="">
-; X32-NEXT: sbbl 4(%ebx), %ebp<br class="">
-; X32-NEXT: sbbl 8(%ebx), %edi<br class="">
-; X32-NEXT: sbbl 12(%ebx), %edx<br class="">
-; X32-NEXT: movl %edx, {{[0-9]+}}(%esp) # 4-byte Spill<br class="">
-; X32-NEXT: sbbl 16(%ebx), %eax<br class="">
-; X32-NEXT: movl %eax, (%esp) # 4-byte Spill<br class="">
-; X32-NEXT: movl 20(%ecx), %esi<br class="">
-; X32-NEXT: sbbl 20(%ebx), %esi<br class="">
+; X32-NEXT: subl $24, %esp<br class="">
+; X32-NEXT: movl 12(%ebp), %edi<br class="">
+; X32-NEXT: movl 8(%ebp), %ecx<br class="">
+; X32-NEXT: movl (%ecx), %eax<br class="">
+; X32-NEXT: movl 4(%ecx), %edx<br class="">
+; X32-NEXT: movl (%edi), %esi<br class="">
+; X32-NEXT: cmpl %esi, %eax<br class="">
+; X32-NEXT: movl 4(%edi), %ebx<br class="">
+; X32-NEXT: sbbl %ebx, %edx<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %edx<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: movl %edx, -24(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl %edx, -16(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: subl %esi, %eax<br class="">
+; X32-NEXT: movl %eax, -36(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl 8(%edi), %esi<br class="">
+; X32-NEXT: movl 28(%edi), %eax<br class="">
+; X32-NEXT: movl %eax, -32(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl 24(%edi), %eax<br class="">
+; X32-NEXT: movl %eax, -28(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl 20(%edi), %eax<br class="">
+; X32-NEXT: movl %eax, -20(%ebp) # 4-byte Spill<br class="">
+; X32-NEXT: movl 16(%edi), %edx<br class="">
+; X32-NEXT: movl 12(%edi), %edi<br class="">
+; X32-NEXT: sbbl %ebx, 4(%ecx)<br class="">
+; X32-NEXT: movl 8(%ecx), %ebx<br class="">
+; X32-NEXT: movl -16(%ebp), %eax # 4-byte Reload<br class="">
+; X32-NEXT: movl %eax, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: sbbl %esi, %ebx<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %ebx<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: sbbl %edi, 12(%ecx)<br class="">
+; X32-NEXT: movl 12(%ecx), %eax<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %ebx, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: sbbl %edi, %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %eax<br class="">
+; X32-NEXT: movl 16(%ecx), %edi<br class="">
+; X32-NEXT: sbbl %edx, %edi<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %edi<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %ebx<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: movl %eax, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: sbbl %edx, 16(%ecx)<br class="">
+; X32-NEXT: movl -24(%ebp), %eax # 4-byte Reload<br class="">
+; X32-NEXT: movl %eax, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: sbbl %esi, 8(%ecx)<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %ebx, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: movl -20(%ebp), %edx # 4-byte Reload<br class="">
+; X32-NEXT: sbbl %edx, 20(%ecx)<br class="">
+; X32-NEXT: movl 20(%ecx), %eax<br class="">
+; X32-NEXT: pushl %eax<br class="">
+; X32-NEXT: movl %edi, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: popl %eax<br class="">
+; X32-NEXT: sbbl %edx, %eax<br class="">
+; X32-NEXT: seto %al<br class="">
+; X32-NEXT: lahf<br class="">
+; X32-NEXT: movl %eax, %eax<br class="">
+; X32-NEXT: movl -28(%ebp), %esi # 4-byte Reload<br class="">
+; X32-NEXT: sbbl %esi, 24(%ecx)<br class="">
; X32-NEXT: movl 24(%ecx), %edx<br class="">
-; X32-NEXT: sbbl 24(%ebx), %edx<br class="">
-; X32-NEXT: movl 28(%ecx), %eax<br class="">
-; X32-NEXT: sbbl 28(%ebx), %eax<br class="">
-; X32-NEXT: movl %edi, 8(%ecx)<br class="">
-; X32-NEXT: movl %ebp, 4(%ecx)<br class="">
-; X32-NEXT: movl {{[0-9]+}}(%esp), %edi # 4-byte Reload<br class="">
-; X32-NEXT: movl %edi, (%ecx)<br class="">
-; X32-NEXT: movl {{[0-9]+}}(%esp), %edi # 4-byte Reload<br class="">
-; X32-NEXT: movl %edi, 12(%ecx)<br class="">
-; X32-NEXT: movl (%esp), %edi # 4-byte Reload<br class="">
-; X32-NEXT: movl %edi, 16(%ecx)<br class="">
-; X32-NEXT: movl %esi, 20(%ecx)<br class="">
-; X32-NEXT: movl %edx, 24(%ecx)<br class="">
-; X32-NEXT: movl %eax, 28(%ecx)<br class="">
-; X32-NEXT: addl $12, %esp<br class="">
+; X32-NEXT: movl %eax, %eax<br class="">
+; X32-NEXT: addb $127, %al<br class="">
+; X32-NEXT: sahf<br class="">
+; X32-NEXT: sbbl %esi, %edx<br class="">
+; X32-NEXT: movl -32(%ebp), %eax # 4-byte Reload<br class="">
+; X32-NEXT: sbbl %eax, 28(%ecx)<br class="">
+; X32-NEXT: movl -36(%ebp), %eax # 4-byte Reload<br class="">
+; X32-NEXT: movl %eax, (%ecx)<br class="">
+; X32-NEXT: addl $24, %esp<br class="">
; X32-NEXT: popl %esi<br class="">
; X32-NEXT: popl %edi<br class="">
; X32-NEXT: popl %ebx<br class="">
@@ -121,18 +275,28 @@ define void @sub(i256* %p, i256* %q) nou<br class="">
;<br class="">
; X64-LABEL: sub:<br class="">
; X64: # BB#0:<br class="">
-; X64-NEXT: movq 24(%rdi), %r8<br class="">
-; X64-NEXT: movq 16(%rdi), %rcx<br class="">
-; X64-NEXT: movq (%rdi), %rdx<br class="">
-; X64-NEXT: movq 8(%rdi), %rax<br class="">
-; X64-NEXT: subq (%rsi), %rdx<br class="">
-; X64-NEXT: sbbq 8(%rsi), %rax<br class="">
-; X64-NEXT: sbbq 16(%rsi), %rcx<br class="">
-; X64-NEXT: sbbq 24(%rsi), %r8<br class="">
-; X64-NEXT: movq %rcx, 16(%rdi)<br class="">
-; X64-NEXT: movq %rax, 8(%rdi)<br class="">
-; X64-NEXT: movq %rdx, (%rdi)<br class="">
-; X64-NEXT: movq %r8, 24(%rdi)<br class="">
+; X64-NEXT: pushq %rbp<br class="">
+; X64-NEXT: movq %rsp, %rbp<br class="">
+; X64-NEXT: movq (%rdi), %rax<br class="">
+; X64-NEXT: movq 8(%rdi), %rcx<br class="">
+; X64-NEXT: movq 24(%rsi), %r8<br class="">
+; X64-NEXT: movq 8(%rsi), %rdx<br class="">
+; X64-NEXT: movq 16(%rsi), %r9<br class="">
+; X64-NEXT: movq (%rsi), %rsi<br class="">
+; X64-NEXT: cmpq %rsi, %rax<br class="">
+; X64-NEXT: sbbq %rdx, 8(%rdi)<br class="">
+; X64-NEXT: subq %rsi, %rax<br class="">
+; X64-NEXT: sbbq %rdx, %rcx<br class="">
+; X64-NEXT: pushfq<br class="">
+; X64-NEXT: popq %rcx<br class="">
+; X64-NEXT: sbbq %r9, 16(%rdi)<br class="">
+; X64-NEXT: movq 16(%rdi), %rdx<br class="">
+; X64-NEXT: pushq %rcx<br class="">
+; X64-NEXT: popfq<br class="">
+; X64-NEXT: sbbq %r9, %rdx<br class="">
+; X64-NEXT: sbbq %r8, 24(%rdi)<br class="">
+; X64-NEXT: movq %rax, (%rdi)<br class="">
+; X64-NEXT: popq %rbp<br class="">
; X64-NEXT: retq<br class="">
%a = load i256, i256* %p<br class="">
%b = load i256, i256* %q<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/i3<wbr class="">86-shrink-wrapping.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/i386-shrink-wrapping.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/i386-shrink-wrapping.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/i3<wbr class="">86-shrink-wrapping.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/i3<wbr class="">86-shrink-wrapping.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -55,8 +55,7 @@ target triple = "i386-apple-macosx10.5"<br class="">
;<br class="">
; CHECK-NEXT: L_e$non_lazy_ptr, [[E:%[a-z]+]]<br class="">
; CHECK-NEXT: movb [[D]], ([[E]])<br class="">
-; CHECK-NEXT: L_f$non_lazy_ptr, [[F:%[a-z]+]]<br class="">
-; CHECK-NEXT: movsbl ([[F]]), [[CONV:%[a-z]+]]<br class="">
+; CHECK-NEXT: movsbl ([[E]]), [[CONV:%[a-z]+]]<br class="">
; CHECK-NEXT: movl $6, [[CONV:%[a-z]+]]<br class="">
; The eflags is used in the next instruction.<br class="">
; If that instruction disappear, we are not exercising the bug<br class="">
@@ -96,7 +95,7 @@ for.end:<br class="">
%.b3 = load i1, i1* @d, align 1<br class="">
%tmp2 = select i1 %.b3, i8 0, i8 6<br class="">
store i8 %tmp2, i8* @e, align 1<br class="">
- %tmp3 = load i8, i8* @f, align 1<br class="">
+ %tmp3 = load i8, i8* @e, align 1<br class="">
%conv = sext i8 %tmp3 to i32<br class="">
%add = add nsw i32 %conv, 1<br class="">
%rem = srem i32 %tmp1, %add<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/li<wbr class="">ve-range-nosubreg.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/live-range-nosubreg.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/live-range-nosubreg.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/li<wbr class="">ve-range-nosubreg.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/li<wbr class="">ve-range-nosubreg.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,7 +1,6 @@<br class="">
-; RUN: llc -march=x86-64 < %s | FileCheck %s<br class="">
+; RUN: llc -march=x86-64 < %s<br class="">
<br class="">
-; Check for a sane output. This testcase used to crash. See PR29132.<br class="">
-; CHECK: leal -1<br class="">
+; This testcase used to crash. See PR29132.<br class="">
<br class="">
target triple = "x86_64-unknown-linux-gnu"<br class="">
<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/lo<wbr class="">nglong-deadload.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/longlong-deadload.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/longlong-deadload.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/lo<wbr class="">nglong-deadload.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/lo<wbr class="">nglong-deadload.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -7,10 +7,8 @@ define void @test(i64* %P) nounwind {<br class="">
; CHECK: # BB#0:<br class="">
; CHECK-NEXT: movl {{[0-9]+}}(%esp), %eax<br class="">
; CHECK-NEXT: movl (%eax), %ecx<br class="">
-; CHECK-NEXT: movl 4(%eax), %edx<br class="">
; CHECK-NEXT: xorl $1, %ecx<br class="">
; CHECK-NEXT: orl $2, %ecx<br class="">
-; CHECK-NEXT: movl %edx, 4(%eax)<br class="">
; CHECK-NEXT: movl %ecx, (%eax)<br class="">
; CHECK-NEXT: retl<br class="">
%tmp1 = load i64, i64* %P, align 8<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-consecutive-loads-128.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/merge-consecutive-loads-128.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/merge-consecutive-loads-<wbr class="">128.ll?rev=297695&r1=297694&<wbr class="">r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-consecutive-loads-128.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-consecutive-loads-128.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1037,12 +1037,12 @@ define <2 x i64> @merge_2i64_i64_12_vola<br class="">
define <4 x float> @merge_4f32_f32_2345_volatile(<wbr class="">float* %ptr) nounwind uwtable noinline ssp {<br class="">
; SSE2-LABEL: merge_4f32_f32_2345_volatile:<br class="">
; SSE2: # BB#0:<br class="">
-; SSE2-NEXT: movss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSE2-NEXT: movss {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
+; SSE2-NEXT: movss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSE2-NEXT: movss {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; SSE2-NEXT: movss {{.*#+}} xmm3 = mem[0],zero,zero,zero<br class="">
; SSE2-NEXT: unpcklps {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">]<br class="">
-; SSE2-NEXT: unpcklps {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">]<br class="">
+; SSE2-NEXT: movss {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
+; SSE2-NEXT: unpcklps {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">]<br class="">
; SSE2-NEXT: unpcklps {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
; SSE2-NEXT: retq<br class="">
;<br class="">
@@ -1065,13 +1065,13 @@ define <4 x float> @merge_4f32_f32_2345_<br class="">
; X32-SSE1-LABEL: merge_4f32_f32_2345_volatile:<br class="">
; X32-SSE1: # BB#0:<br class="">
; X32-SSE1-NEXT: movl {{[0-9]+}}(%esp), %eax<br class="">
-; X32-SSE1-NEXT: movss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
-; X32-SSE1-NEXT: movss {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
-; X32-SSE1-NEXT: movss {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; X32-SSE1-NEXT: movss {{.*#+}} xmm3 = mem[0],zero,zero,zero<br class="">
-; X32-SSE1-NEXT: unpcklps {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">]<br class="">
-; X32-SSE1-NEXT: unpcklps {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">]<br class="">
-; X32-SSE1-NEXT: unpcklps {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
+; X32-SSE1-DAG: movss 8(%eax), %[[R0:xmm[0-3]]] # [[R0]] = mem[0],zero,zero,zero<br class="">
+; X32-SSE1-DAG: movss 12(%eax), %[[R1:xmm[0-3]]] # [[R1]] = mem[0],zero,zero,zero<br class="">
+; X32-SSE1-DAG: movss 16(%eax), %[[R2:xmm[0-3]]] # [[R2]] = mem[0],zero,zero,zero<br class="">
+; X32-SSE1-DAG: movss 20(%eax), %[[R3:xmm[0-3]]] # [[R3]] = mem[0],zero,zero,zero<br class="">
+; X32-SSE1-DAG: unpcklps %[[R2]], %[[R0]] # [[R0]] = [[R0]][0],[[R2]][0],[[R0]][1],<wbr class="">[[R2]][1]<br class="">
+; X32-SSE1-DAG: unpcklps %[[R3]], %[[R1]] # [[R1]] = [[R1]][0],[[R3]][0],[[R1]][1],<wbr class="">[[R3]][1]<br class="">
+; X32-SSE1-DAG: unpcklps %[[R1]], %[[R0]] # [[R0]] = [[R0]][0],[[R1]][0],[[R0]][1],<wbr class="">[[R1]][1]<br class="">
; X32-SSE1-NEXT: retl<br class="">
;<br class="">
; X32-SSE41-LABEL: merge_4f32_f32_2345_volatile:<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-consecutive-loads-256.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/merge-consecutive-loads-256.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/merge-consecutive-loads-<wbr class="">256.ll?rev=297695&r1=297694&<wbr class="">r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-consecutive-loads-256.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-consecutive-loads-256.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -668,10 +668,10 @@ define <16 x i16> @merge_16i16_i16_0uu3z<br class="">
; AVX1: # BB#0:<br class="">
; AVX1-NEXT: vpxor %xmm0, %xmm0, %xmm0<br class="">
; AVX1-NEXT: vpinsrw $0, (%rdi), %xmm0, %xmm1<br class="">
-; AVX1-NEXT: vpinsrw $3, 6(%rdi), %xmm1, %xmm1<br class="">
; AVX1-NEXT: vpinsrw $4, 24(%rdi), %xmm0, %xmm0<br class="">
; AVX1-NEXT: vpinsrw $6, 28(%rdi), %xmm0, %xmm0<br class="">
; AVX1-NEXT: vpinsrw $7, 30(%rdi), %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $3, 6(%rdi), %xmm1, %xmm1<br class="">
; AVX1-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX1-NEXT: retq<br class="">
;<br class="">
@@ -679,10 +679,10 @@ define <16 x i16> @merge_16i16_i16_0uu3z<br class="">
; AVX2: # BB#0:<br class="">
; AVX2-NEXT: vpxor %xmm0, %xmm0, %xmm0<br class="">
; AVX2-NEXT: vpinsrw $0, (%rdi), %xmm0, %xmm1<br class="">
-; AVX2-NEXT: vpinsrw $3, 6(%rdi), %xmm1, %xmm1<br class="">
; AVX2-NEXT: vpinsrw $4, 24(%rdi), %xmm0, %xmm0<br class="">
; AVX2-NEXT: vpinsrw $6, 28(%rdi), %xmm0, %xmm0<br class="">
; AVX2-NEXT: vpinsrw $7, 30(%rdi), %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $3, 6(%rdi), %xmm1, %xmm1<br class="">
; AVX2-NEXT: vinserti128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX2-NEXT: retq<br class="">
;<br class="">
@@ -690,10 +690,10 @@ define <16 x i16> @merge_16i16_i16_0uu3z<br class="">
; AVX512F: # BB#0:<br class="">
; AVX512F-NEXT: vpxor %xmm0, %xmm0, %xmm0<br class="">
; AVX512F-NEXT: vpinsrw $0, (%rdi), %xmm0, %xmm1<br class="">
-; AVX512F-NEXT: vpinsrw $3, 6(%rdi), %xmm1, %xmm1<br class="">
; AVX512F-NEXT: vpinsrw $4, 24(%rdi), %xmm0, %xmm0<br class="">
; AVX512F-NEXT: vpinsrw $6, 28(%rdi), %xmm0, %xmm0<br class="">
; AVX512F-NEXT: vpinsrw $7, 30(%rdi), %xmm0, %xmm0<br class="">
+; AVX512F-NEXT: vpinsrw $3, 6(%rdi), %xmm1, %xmm1<br class="">
; AVX512F-NEXT: vinserti128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX512F-NEXT: retq<br class="">
;<br class="">
@@ -702,10 +702,10 @@ define <16 x i16> @merge_16i16_i16_0uu3z<br class="">
; X32-AVX-NEXT: movl {{[0-9]+}}(%esp), %eax<br class="">
; X32-AVX-NEXT: vpxor %xmm0, %xmm0, %xmm0<br class="">
; X32-AVX-NEXT: vpinsrw $0, (%eax), %xmm0, %xmm1<br class="">
-; X32-AVX-NEXT: vpinsrw $3, 6(%eax), %xmm1, %xmm1<br class="">
; X32-AVX-NEXT: vpinsrw $4, 24(%eax), %xmm0, %xmm0<br class="">
; X32-AVX-NEXT: vpinsrw $6, 28(%eax), %xmm0, %xmm0<br class="">
; X32-AVX-NEXT: vpinsrw $7, 30(%eax), %xmm0, %xmm0<br class="">
+; X32-AVX-NEXT: vpinsrw $3, 6(%eax), %xmm1, %xmm1<br class="">
; X32-AVX-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; X32-AVX-NEXT: retl<br class="">
%ptr0 = getelementptr inbounds i16, i16* %ptr, i64 0<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-store-partially-alias-load<wbr class="">s.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/merge-store-partially-alias-loads.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/merge-store-partially-<wbr class="">alias-loads.ll?rev=297695&r1=<wbr class="">297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-store-partially-alias-load<wbr class="">s.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/me<wbr class="">rge-store-partially-alias-load<wbr class="">s.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -21,11 +21,11 @@<br class="">
; DBGDAG-DAG: [[LD2:t[0-9]+]]: i16,ch = load<LD2[%tmp81](align=1)> [[ENTRYTOKEN]], [[BASEPTR]], undef:i64<br class="">
; DBGDAG-DAG: [[LD1:t[0-9]+]]: i8,ch = load<LD1[%tmp12]> [[ENTRYTOKEN]], [[ADDPTR]], undef:i64<br class="">
<br class="">
-; DBGDAG: [[LOADTOKEN:t[0-9]+]]: ch = TokenFactor [[LD2]]:1, [[LD1]]:1<br class="">
-<br class="">
+; DBGDAG-DAG: [[ST1:t[0-9]+]]: ch = store<ST1[%tmp14]> [[ENTRYTOKEN]], [[LD1]], t{{[0-9]+}}, undef:i64<br class="">
+; DBGDAG-DAG: [[LOADTOKEN:t[0-9]+]]: ch = TokenFactor [[LD2]]:1, [[LD1]]:1<br class="">
; DBGDAG-DAG: [[ST2:t[0-9]+]]: ch = store<ST2[%tmp10](align=1)> [[LOADTOKEN]], [[LD2]], t{{[0-9]+}}, undef:i64<br class="">
-; DBGDAG-DAG: [[ST1:t[0-9]+]]: ch = store<ST1[%tmp14]> [[ST2]], [[LD1]], t{{[0-9]+}}, undef:i64<br class="">
-; DBGDAG: X86ISD::RET_FLAG [[ST1]],<br class="">
+<br class="">
+; DBGDAG: X86ISD::RET_FLAG t{{[0-9]+}},<br class="">
<br class="">
; DBGDAG: Type-legalized selection DAG: BB#0 'merge_store_partial_overlap_l<wbr class="">oad:'<br class="">
define void @merge_store_partial_overlap_l<wbr class="">oad([4 x i8]* %tmp) {<br class="">
<br class="">
Removed: llvm/trunk/test/CodeGen/X86/pr<wbr class="">18023.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/pr18023.ll?rev=297694&view=auto" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/pr18023.ll?rev=297694&<wbr class="">view=auto</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/pr<wbr class="">18023.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/pr<wbr class="">18023.ll (removed)<br class="">
@@ -1,31 +0,0 @@<br class="">
-; RUN: llc < %s -mtriple x86_64-apple-macosx10.9.0 | FileCheck %s<br class="">
-; PR18023<br class="">
-<br class="">
-; CHECK: movabsq $4294967296, %rcx<br class="">
-; CHECK: movq %rcx, (%rax)<br class="">
-; CHECK: movl $1, 4(%rax)<br class="">
-; CHECK: movl $0, 4(%rax)<br class="">
-; CHECK: movq $1, 4(%rax)<br class="">
-<br class="">
-@c = common global i32 0, align 4<br class="">
-@a = common global [3 x i32] zeroinitializer, align 4<br class="">
-@b = common global i32 0, align 4<br class="">
-@.str = private unnamed_addr constant [4 x i8] c"%d\0A\00", align 1<br class="">
-<br class="">
-define void @func() {<br class="">
- store i32 1, i32* getelementptr inbounds ([3 x i32], [3 x i32]* @a, i64 0, i64 1), align 4<br class="">
- store i32 0, i32* getelementptr inbounds ([3 x i32], [3 x i32]* @a, i64 0, i64 0), align 4<br class="">
- %1 = load volatile i32, i32* @b, align 4<br class="">
- store i32 1, i32* getelementptr inbounds ([3 x i32], [3 x i32]* @a, i64 0, i64 1), align 4<br class="">
- store i32 0, i32* getelementptr inbounds ([3 x i32], [3 x i32]* @a, i64 0, i64 1), align 4<br class="">
- %2 = load volatile i32, i32* @b, align 4<br class="">
- store i32 1, i32* getelementptr inbounds ([3 x i32], [3 x i32]* @a, i64 0, i64 1), align 4<br class="">
- store i32 0, i32* getelementptr inbounds ([3 x i32], [3 x i32]* @a, i64 0, i64 2), align 4<br class="">
- %3 = load volatile i32, i32* @b, align 4<br class="">
- store i32 3, i32* @c, align 4<br class="">
- %4 = load i32, i32* getelementptr inbounds ([3 x i32], [3 x i32]* @a, i64 0, i64 1), align 4<br class="">
- %call = call i32 (i8*, ...) @printf(i8* getelementptr inbounds ([4 x i8], [4 x i8]* @.str, i64 0, i64 0), i32 %4)<br class="">
- ret void<br class="">
-}<br class="">
-<br class="">
-declare i32 @printf(i8*, ...)<br class="">
<br class="">
Added: llvm/trunk/test/CodeGen/X86/pr<wbr class="">32108.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/pr32108.ll?rev=297695&view=auto" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/pr32108.ll?rev=297695&<wbr class="">view=auto</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/pr<wbr class="">32108.ll (added)<br class="">
+++ llvm/trunk/test/CodeGen/X86/pr<wbr class="">32108.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -0,0 +1,20 @@<br class="">
+; RUN: llc -march=x86-64 %s -o -<br class="">
+<br class="">
+target triple = "x86_64-unknown-linux-gnu"<br class="">
+<br class="">
+define void @autogen_SD1794() {<br class="">
+BB:<br class="">
+ %Cmp45 = icmp slt <4 x i32> undef, undef<br class="">
+ br label %CF243<br class="">
+<br class="">
+CF243: ; preds = %CF243, %BB<br class="">
+ br i1 undef, label %CF243, label %CF257<br class="">
+<br class="">
+CF257: ; preds = %CF243<br class="">
+ %Shuff144 = shufflevector <4 x i1> undef, <4 x i1> %Cmp45, <4 x i32> <i32 undef, i32 undef, i32 5, i32 undef><br class="">
+ br label %CF244<br class="">
+<br class="">
+CF244: ; preds = %CF244, %CF257<br class="">
+ %Shuff182 = shufflevector <4 x i1> %Shuff144, <4 x i1> zeroinitializer, <4 x i32> <i32 3, i32 5, i32 7, i32 undef><br class="">
+ br label %CF244<br class="">
+}<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/sp<wbr class="">lit-store.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/split-store.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/split-store.ll?rev=297695&<wbr class="">r1=297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/sp<wbr class="">lit-store.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/sp<wbr class="">lit-store.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,8 +1,8 @@<br class="">
; RUN: llc -mtriple=x86_64-unknown-unknow<wbr class="">n -force-split-store < %s | FileCheck %s<br class="">
<br class="">
; CHECK-LABEL: int32_float_pair<br class="">
-; CHECK: movl %edi, (%rsi)<br class="">
-; CHECK: movss %xmm0, 4(%rsi)<br class="">
+; CHECK-DAG: movl %edi, (%rsi)<br class="">
+; CHECK-DAG: movss %xmm0, 4(%rsi)<br class="">
define void @int32_float_pair(i32 %tmp1, float %tmp2, i64* %ref.tmp) {<br class="">
entry:<br class="">
%t0 = bitcast float %tmp2 to i32<br class="">
@@ -15,8 +15,8 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK-LABEL: float_int32_pair<br class="">
-; CHECK: movss %xmm0, (%rsi)<br class="">
-; CHECK: movl %edi, 4(%rsi)<br class="">
+; CHECK-DAG: movss %xmm0, (%rsi)<br class="">
+; CHECK-DAG: movl %edi, 4(%rsi)<br class="">
define void @float_int32_pair(float %tmp1, i32 %tmp2, i64* %ref.tmp) {<br class="">
entry:<br class="">
%t0 = bitcast float %tmp1 to i32<br class="">
@@ -29,9 +29,9 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK-LABEL: int16_float_pair<br class="">
-; CHECK: movzwl %di, %eax<br class="">
-; CHECK: movl %eax, (%rsi)<br class="">
-; CHECK: movss %xmm0, 4(%rsi)<br class="">
+; CHECK-DAG: movzwl %di, %eax<br class="">
+; CHECK-DAG: movl %eax, (%rsi)<br class="">
+; CHECK-DAG: movss %xmm0, 4(%rsi)<br class="">
define void @int16_float_pair(i16 signext %tmp1, float %tmp2, i64* %ref.tmp) {<br class="">
entry:<br class="">
%t0 = bitcast float %tmp2 to i32<br class="">
@@ -44,9 +44,9 @@ entry:<br class="">
}<br class="">
<br class="">
; CHECK-LABEL: int8_float_pair<br class="">
-; CHECK: movzbl %dil, %eax<br class="">
-; CHECK: movl %eax, (%rsi)<br class="">
-; CHECK: movss %xmm0, 4(%rsi)<br class="">
+; CHECK-DAG: movzbl %dil, %eax<br class="">
+; CHECK-DAG: movl %eax, (%rsi)<br class="">
+; CHECK-DAG: movss %xmm0, 4(%rsi)<br class="">
define void @int8_float_pair(i8 signext %tmp1, float %tmp2, i64* %ref.tmp) {<br class="">
entry:<br class="">
%t0 = bitcast float %tmp2 to i32<br class="">
@@ -146,10 +146,9 @@ entry:<br class="">
; CHECK: movw %di, (%rdx)<br class="">
; CHECK: shrl $16, %edi<br class="">
; CHECK: movb %dil, 2(%rdx)<br class="">
-; CHECK: movl %esi, %eax<br class="">
-; CHECK: shrl $16, %eax<br class="">
-; CHECK: movb %al, 6(%rdx)<br class="">
-; CHECK: movw %si, 4(%rdx)<br class="">
+; CHECK: movw %si, 4(%rdx)<br class="">
+; CHECK: shrl $16, %esi<br class="">
+; CHECK: movb %sil, 6(%rdx)<br class="">
define void @int24_int24_pair(i24 signext %tmp1, i24 signext %tmp2, i48* %ref.tmp) {<br class="">
entry:<br class="">
%t1 = zext i24 %tmp2 to i48<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/st<wbr class="">ores-merging.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/stores-merging.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/stores-merging.ll?rev=<wbr class="">297695&r1=297694&r2=297695&<wbr class="">view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/st<wbr class="">ores-merging.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/st<wbr class="">ores-merging.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -13,9 +13,9 @@ target triple = "x86_64-unknown-linux-gn<br class="">
;; the same result in memory in the end.<br class="">
<br class="">
; CHECK-LABEL: redundant_stores_merging:<br class="">
-; CHECK: movl $123, e+8(%rip)<br class="">
-; CHECK: movabsq $1958505086977, %rax<br class="">
+; CHECK: movabsq $528280977409, %rax<br class="">
; CHECK: movq %rax, e+4(%rip)<br class="">
+; CHECK: movl $456, e+8(%rip)<br class="">
define void @redundant_stores_merging() {<br class="">
entry:<br class="">
store i32 1, i32* getelementptr inbounds (%structTy, %structTy* @e, i64 0, i32 1), align 4<br class="">
@@ -26,9 +26,9 @@ entry:<br class="">
<br class="">
;; This variant tests PR25154.<br class="">
; CHECK-LABEL: redundant_stores_merging_rever<wbr class="">se:<br class="">
-; CHECK: movl $123, e+8(%rip)<br class="">
-; CHECK: movabsq $1958505086977, %rax<br class="">
+; CHECK: movabsq $528280977409, %rax<br class="">
; CHECK: movq %rax, e+4(%rip)<br class="">
+; CHECK: movl $456, e+8(%rip)<br class="">
define void @redundant_stores_merging_reve<wbr class="">rse() {<br class="">
entry:<br class="">
store i32 123, i32* getelementptr inbounds (%structTy, %structTy* @e, i64 0, i32 2), align 4<br class="">
@@ -45,9 +45,8 @@ entry:<br class="">
;; a movl, after the store to 3).<br class="">
<br class="">
;; CHECK-LABEL: overlapping_stores_merging:<br class="">
-;; CHECK: movw $0, b+2(%rip)<br class="">
+;; CHECK: movl $1, b(%rip)<br class="">
;; CHECK: movw $2, b+3(%rip)<br class="">
-;; CHECK: movw $1, b(%rip)<br class="">
define void @overlapping_stores_merging() {<br class="">
entry:<br class="">
store i16 0, i16* bitcast (i8* getelementptr inbounds ([8 x i8], [8 x i8]* @b, i64 0, i64 2) to i16*), align 2<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-compare-results.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/vector-compare-results.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/vector-compare-results.ll?<wbr class="">rev=297695&r1=297694&r2=<wbr class="">297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-compare-results.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-compare-results.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -350,98 +350,98 @@ define <32 x i1> @test_cmp_v32i8(<32 x i<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 2(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, (%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movq %rdi, %rax<br class="">
@@ -900,98 +900,98 @@ define <32 x i1> @test_cmp_v32i16(<32 x<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 2(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, (%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movq %rdi, %rax<br class="">
@@ -1169,196 +1169,196 @@ define <64 x i1> @test_cmp_v64i8(<64 x i<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm2, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm1, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 6(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm2, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 4(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm1, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 2(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, (%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movq %rdi, %rax<br class="">
@@ -2491,98 +2491,98 @@ define <32 x i1> @test_cmp_v32f32(<32 x<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 2(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, (%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movq %rdi, %rax<br class="">
@@ -3990,98 +3990,98 @@ define <32 x i1> @test_cmp_v32i32(<32 x<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 2(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, (%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movq %rdi, %rax<br class="">
@@ -4944,196 +4944,196 @@ define <64 x i1> @test_cmp_v64i16(<64 x<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm4, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm2, -{{[0-9]+}}(%rsp)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 6(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm4, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 4(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm2, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 2(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, (%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movq %rdi, %rax<br class="">
@@ -6775,392 +6775,392 @@ define <128 x i1> @test_cmp_v128i8(<128<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm6, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm5, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm4, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm3, -{{[0-9]+}}(%rsp)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm2, -{{[0-9]+}}(%rsp)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm1, -{{[0-9]+}}(%rsp)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 14(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm6, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 12(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm5, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 10(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm4, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 8(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm3, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 6(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm2, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 4(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm1, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 2(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 14(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 12(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 10(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 8(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 6(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 4(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, (%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movq %rdi, %rax<br class="">
@@ -8581,98 +8581,98 @@ define <32 x i1> @test_cmp_v32f64(<32 x<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 2(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, (%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movq %rdi, %rax<br class="">
@@ -9897,98 +9897,98 @@ define <32 x i1> @test_cmp_v32i64(<32 x<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
-; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
-; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
-; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, (%rdi)<br class="">
+; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, 2(%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movdqa %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
-; SSE2-NEXT: movb %al, 2(%rdi)<br class="">
+; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %al<br class="">
+; SSE2-NEXT: movb -{{[0-9]+}}(%rsp), %cl<br class="">
+; SSE2-NEXT: andb $1, %cl<br class="">
+; SSE2-NEXT: movb %cl, (%rdi)<br class="">
; SSE2-NEXT: andb $1, %al<br class="">
; SSE2-NEXT: movb %al, (%rdi)<br class="">
; SSE2-NEXT: movq %rdi, %rax<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-shuffle-variable-128.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/vector-shuffle-variable-128.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/vector-shuffle-variable-<wbr class="">128.ll?rev=297695&r1=297694&<wbr class="">r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-shuffle-variable-128.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-shuffle-variable-128.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -42,8 +42,8 @@ define <2 x i64> @var_shuffle_v2i64_v2i6<br class="">
; SSE-NEXT: andl $1, %edi<br class="">
; SSE-NEXT: movaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; SSE-NEXT: andl $1, %esi<br class="">
-; SSE-NEXT: movq {{.*#+}} xmm0 = mem[0],zero<br class="">
; SSE-NEXT: movq {{.*#+}} xmm1 = mem[0],zero<br class="">
+; SSE-NEXT: movq {{.*#+}} xmm0 = mem[0],zero<br class="">
; SSE-NEXT: punpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm1[0]<br class="">
; SSE-NEXT: retq<br class="">
;<br class="">
@@ -56,7 +56,7 @@ define <2 x i64> @var_shuffle_v2i64_v2i6<br class="">
; AVX-NEXT: andl $1, %esi<br class="">
; AVX-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
-; AVX-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm1[0]<br class="">
+; AVX-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
; AVX-NEXT: retq<br class="">
%x0 = extractelement <2 x i64> %x, i32 %i0<br class="">
%x1 = extractelement <2 x i64> %x, i32 %i1<br class="">
@@ -79,10 +79,10 @@ define <4 x float> @var_shuffle_v4f32_v4<br class="">
; SSE2-NEXT: andl $3, %ecx<br class="">
; SSE2-NEXT: movss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSE2-NEXT: movss {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
+; SSE2-NEXT: unpcklps {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">]<br class="">
; SSE2-NEXT: movss {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
+; SSE2-NEXT: movss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSE2-NEXT: unpcklps {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
-; SSE2-NEXT: movss {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; SSE2-NEXT: unpcklps {{.*#+}} xmm1 = xmm1[0],xmm2[0],xmm1[1],xmm2[1<wbr class="">]<br class="">
; SSE2-NEXT: unpcklps {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">]<br class="">
; SSE2-NEXT: retq<br class="">
;<br class="">
@@ -99,10 +99,10 @@ define <4 x float> @var_shuffle_v4f32_v4<br class="">
; SSSE3-NEXT: andl $3, %ecx<br class="">
; SSSE3-NEXT: movss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSSE3-NEXT: movss {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
+; SSSE3-NEXT: unpcklps {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">]<br class="">
; SSSE3-NEXT: movss {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
+; SSSE3-NEXT: movss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSSE3-NEXT: unpcklps {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
-; SSSE3-NEXT: movss {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; SSSE3-NEXT: unpcklps {{.*#+}} xmm1 = xmm1[0],xmm2[0],xmm1[1],xmm2[1<wbr class="">]<br class="">
; SSSE3-NEXT: unpcklps {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">]<br class="">
; SSSE3-NEXT: retq<br class="">
;<br class="">
@@ -164,10 +164,10 @@ define <4 x i32> @var_shuffle_v4i32_v4i3<br class="">
; SSE2-NEXT: andl $3, %ecx<br class="">
; SSE2-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSE2-NEXT: movd {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
+; SSE2-NEXT: punpckldq {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">]<br class="">
; SSE2-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
+; SSE2-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSE2-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
-; SSE2-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; SSE2-NEXT: punpckldq {{.*#+}} xmm1 = xmm1[0],xmm2[0],xmm1[1],xmm2[1<wbr class="">]<br class="">
; SSE2-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">]<br class="">
; SSE2-NEXT: retq<br class="">
;<br class="">
@@ -184,10 +184,10 @@ define <4 x i32> @var_shuffle_v4i32_v4i3<br class="">
; SSSE3-NEXT: andl $3, %ecx<br class="">
; SSSE3-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSSE3-NEXT: movd {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
+; SSSE3-NEXT: punpckldq {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">]<br class="">
; SSSE3-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
+; SSSE3-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSSE3-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
-; SSSE3-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; SSSE3-NEXT: punpckldq {{.*#+}} xmm1 = xmm1[0],xmm2[0],xmm1[1],xmm2[1<wbr class="">]<br class="">
; SSSE3-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">]<br class="">
; SSSE3-NEXT: retq<br class="">
;<br class="">
@@ -255,29 +255,29 @@ define <8 x i16> @var_shuffle_v8i16_v8i1<br class="">
; SSE2-NEXT: andl $7, %r10d<br class="">
; SSE2-NEXT: movzwl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $7, %eax<br class="">
-; SSE2-NEXT: movzwl -24(%rsp,%r10,2), %r10d<br class="">
; SSE2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; SSE2-NEXT: movzwl -24(%rsp,%rdi,2), %edi<br class="">
-; SSE2-NEXT: movzwl -24(%rsp,%rsi,2), %esi<br class="">
-; SSE2-NEXT: movd %r10d, %xmm0<br class="">
-; SSE2-NEXT: movzwl -24(%rsp,%rdx,2), %edx<br class="">
-; SSE2-NEXT: movd %edx, %xmm1<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3]<br class="">
-; SSE2-NEXT: movzwl -24(%rsp,%rcx,2), %ecx<br class="">
-; SSE2-NEXT: movd %edi, %xmm0<br class="">
-; SSE2-NEXT: movzwl -24(%rsp,%r8,2), %edx<br class="">
-; SSE2-NEXT: movd %edx, %xmm2<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3]<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3]<br class="">
+; SSE2-NEXT: movd %eax, %xmm0<br class="">
+; SSE2-NEXT: movzwl -24(%rsp,%rcx,2), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm1<br class="">
-; SSE2-NEXT: movd %ecx, %xmm2<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3]<br class="">
-; SSE2-NEXT: movd %esi, %xmm1<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3]<br class="">
; SSE2-NEXT: movzwl -24(%rsp,%r9,2), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm0<br class="">
+; SSE2-NEXT: movzwl -24(%rsp,%rsi,2), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm2<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3]<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3]<br class="">
+; SSE2-NEXT: movzwl -24(%rsp,%r10,2), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm0<br class="">
+; SSE2-NEXT: movzwl -24(%rsp,%rdx,2), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm1<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3]<br class="">
+; SSE2-NEXT: movzwl -24(%rsp,%r8,2), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm3<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm3[0],xmm1[1],xmm3[1<wbr class="">],xmm1[2],xmm3[2],xmm1[3],xmm3<wbr class="">[3]<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm2[0],xmm1[1],xmm2[1<wbr class="">],xmm1[2],xmm2[2],xmm1[3],xmm2<wbr class="">[3]<br class="">
+; SSE2-NEXT: movzwl -24(%rsp,%rdi,2), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm0<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3]<br class="">
; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3]<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3]<br class="">
; SSE2-NEXT: retq<br class="">
;<br class="">
; SSSE3-LABEL: var_shuffle_v8i16_v8i16_xxxxxx<wbr class="">xx_i16:<br class="">
@@ -299,29 +299,29 @@ define <8 x i16> @var_shuffle_v8i16_v8i1<br class="">
; SSSE3-NEXT: andl $7, %r10d<br class="">
; SSSE3-NEXT: movzwl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $7, %eax<br class="">
-; SSSE3-NEXT: movzwl -24(%rsp,%r10,2), %r10d<br class="">
; SSSE3-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; SSSE3-NEXT: movzwl -24(%rsp,%rdi,2), %edi<br class="">
-; SSSE3-NEXT: movzwl -24(%rsp,%rsi,2), %esi<br class="">
-; SSSE3-NEXT: movd %r10d, %xmm0<br class="">
-; SSSE3-NEXT: movzwl -24(%rsp,%rdx,2), %edx<br class="">
-; SSSE3-NEXT: movd %edx, %xmm1<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3]<br class="">
-; SSSE3-NEXT: movzwl -24(%rsp,%rcx,2), %ecx<br class="">
-; SSSE3-NEXT: movd %edi, %xmm0<br class="">
-; SSSE3-NEXT: movzwl -24(%rsp,%r8,2), %edx<br class="">
-; SSSE3-NEXT: movd %edx, %xmm2<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3]<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3]<br class="">
+; SSSE3-NEXT: movd %eax, %xmm0<br class="">
+; SSSE3-NEXT: movzwl -24(%rsp,%rcx,2), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm1<br class="">
-; SSSE3-NEXT: movd %ecx, %xmm2<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3]<br class="">
-; SSSE3-NEXT: movd %esi, %xmm1<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3]<br class="">
; SSSE3-NEXT: movzwl -24(%rsp,%r9,2), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm0<br class="">
+; SSSE3-NEXT: movzwl -24(%rsp,%rsi,2), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm2<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3]<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3]<br class="">
+; SSSE3-NEXT: movzwl -24(%rsp,%r10,2), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm0<br class="">
+; SSSE3-NEXT: movzwl -24(%rsp,%rdx,2), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm1<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">],xmm1[2],xmm0[2],xmm1[3],xmm0<wbr class="">[3]<br class="">
+; SSSE3-NEXT: movzwl -24(%rsp,%r8,2), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm3<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm3[0],xmm1[1],xmm3[1<wbr class="">],xmm1[2],xmm3[2],xmm1[3],xmm3<wbr class="">[3]<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm1 = xmm1[0],xmm2[0],xmm1[1],xmm2[1<wbr class="">],xmm1[2],xmm2[2],xmm1[3],xmm2<wbr class="">[3]<br class="">
+; SSSE3-NEXT: movzwl -24(%rsp,%rdi,2), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm0<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3]<br class="">
; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3]<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3]<br class="">
; SSSE3-NEXT: retq<br class="">
;<br class="">
; SSE41-LABEL: var_shuffle_v8i16_v8i16_xxxxxx<wbr class="">xx_i16:<br class="">
@@ -343,8 +343,6 @@ define <8 x i16> @var_shuffle_v8i16_v8i1<br class="">
; SSE41-NEXT: andl $7, %r10d<br class="">
; SSE41-NEXT: movzwl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE41-NEXT: andl $7, %eax<br class="">
-; SSE41-NEXT: movzwl -24(%rsp,%r10,2), %r10d<br class="">
-; SSE41-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
; SSE41-NEXT: movzwl -24(%rsp,%rdi,2), %edi<br class="">
; SSE41-NEXT: movd %edi, %xmm0<br class="">
; SSE41-NEXT: pinsrw $1, -24(%rsp,%rsi,2), %xmm0<br class="">
@@ -352,8 +350,8 @@ define <8 x i16> @var_shuffle_v8i16_v8i1<br class="">
; SSE41-NEXT: pinsrw $3, -24(%rsp,%rcx,2), %xmm0<br class="">
; SSE41-NEXT: pinsrw $4, -24(%rsp,%r8,2), %xmm0<br class="">
; SSE41-NEXT: pinsrw $5, -24(%rsp,%r9,2), %xmm0<br class="">
-; SSE41-NEXT: pinsrw $6, %r10d, %xmm0<br class="">
-; SSE41-NEXT: pinsrw $7, %eax, %xmm0<br class="">
+; SSE41-NEXT: pinsrw $6, -24(%rsp,%r10,2), %xmm0<br class="">
+; SSE41-NEXT: pinsrw $7, -24(%rsp,%rax,2), %xmm0<br class="">
; SSE41-NEXT: retq<br class="">
;<br class="">
; AVX-LABEL: var_shuffle_v8i16_v8i16_xxxxxx<wbr class="">xx_i16:<br class="">
@@ -375,8 +373,6 @@ define <8 x i16> @var_shuffle_v8i16_v8i1<br class="">
; AVX-NEXT: andl $7, %r10d<br class="">
; AVX-NEXT: movzwl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX-NEXT: andl $7, %eax<br class="">
-; AVX-NEXT: movzwl -24(%rsp,%r10,2), %r10d<br class="">
-; AVX-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
; AVX-NEXT: movzwl -24(%rsp,%rdi,2), %edi<br class="">
; AVX-NEXT: vmovd %edi, %xmm0<br class="">
; AVX-NEXT: vpinsrw $1, -24(%rsp,%rsi,2), %xmm0, %xmm0<br class="">
@@ -384,8 +380,8 @@ define <8 x i16> @var_shuffle_v8i16_v8i1<br class="">
; AVX-NEXT: vpinsrw $3, -24(%rsp,%rcx,2), %xmm0, %xmm0<br class="">
; AVX-NEXT: vpinsrw $4, -24(%rsp,%r8,2), %xmm0, %xmm0<br class="">
; AVX-NEXT: vpinsrw $5, -24(%rsp,%r9,2), %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrw $6, %r10d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrw $7, %eax, %xmm0, %xmm0<br class="">
+; AVX-NEXT: vpinsrw $6, -24(%rsp,%r10,2), %xmm0, %xmm0<br class="">
+; AVX-NEXT: vpinsrw $7, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX-NEXT: retq<br class="">
%x0 = extractelement <8 x i16> %x, i16 %i0<br class="">
%x1 = extractelement <8 x i16> %x, i16 %i1<br class="">
@@ -416,80 +412,80 @@ define <16 x i8> @var_shuffle_v16i8_v16i<br class="">
; SSE2-NEXT: # kill: %ESI<def> %ESI<kill> %RSI<def><br class="">
; SSE2-NEXT: # kill: %EDI<def> %EDI<kill> %RDI<def><br class="">
; SSE2-NEXT: movaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %r10d<br class="">
-; SSE2-NEXT: andl $15, %r10d<br class="">
-; SSE2-NEXT: leaq -{{[0-9]+}}(%rsp), %r11<br class="">
-; SSE2-NEXT: movzbl (%r10,%r11), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm15<br class="">
; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSE2-NEXT: leaq -{{[0-9]+}}(%rsp), %r10<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm8<br class="">
; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm15<br class="">
+; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
+; SSE2-NEXT: andl $15, %eax<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm9<br class="">
-; SSE2-NEXT: andl $15, %edx<br class="">
-; SSE2-NEXT: movzbl (%rdx,%r11), %eax<br class="">
+; SSE2-NEXT: andl $15, %ecx<br class="">
+; SSE2-NEXT: movzbl (%rcx,%r10), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm3<br class="">
; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm10<br class="">
-; SSE2-NEXT: andl $15, %edi<br class="">
-; SSE2-NEXT: movzbl (%rdi,%r11), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm0<br class="">
+; SSE2-NEXT: andl $15, %r9d<br class="">
+; SSE2-NEXT: movzbl (%r9,%r10), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm7<br class="">
; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm11<br class="">
-; SSE2-NEXT: andl $15, %r8d<br class="">
-; SSE2-NEXT: movzbl (%r8,%r11), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm7<br class="">
+; SSE2-NEXT: andl $15, %esi<br class="">
+; SSE2-NEXT: movzbl (%rsi,%r10), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm6<br class="">
; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%r11), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm2<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm12<br class="">
; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%r11), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm12<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm5<br class="">
; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm13<br class="">
-; SSE2-NEXT: andl $15, %ecx<br class="">
-; SSE2-NEXT: movzbl (%rcx,%r11), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm6<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%r10), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm4<br class="">
; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm14<br class="">
-; SSE2-NEXT: andl $15, %esi<br class="">
-; SSE2-NEXT: movzbl (%rsi,%r11), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm5<br class="">
+; SSE2-NEXT: andl $15, %r8d<br class="">
+; SSE2-NEXT: movzbl (%r8,%r10), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm1<br class="">
; SSE2-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%r11), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm4<br class="">
-; SSE2-NEXT: andl $15, %r9d<br class="">
-; SSE2-NEXT: movzbl (%r9,%r11), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm1<br class="">
+; SSE2-NEXT: movzbl (%rax,%r10), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm2<br class="">
+; SSE2-NEXT: andl $15, %edi<br class="">
+; SSE2-NEXT: movzbl (%rdi,%r10), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm0<br class="">
; SSE2-NEXT: punpcklbw {{.*#+}} xmm15 = xmm15[0],xmm8[0],xmm15[1],xmm8<wbr class="">[1],xmm15[2],xmm8[2],xmm15[3],<wbr class="">xmm8[3],xmm15[4],xmm8[4],<wbr class="">xmm15[5],xmm8[5],xmm15[6],<wbr class="">xmm8[6],xmm15[7],xmm8[7]<br class="">
; SSE2-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm9[0],xmm3[1],xmm9[1<wbr class="">],xmm3[2],xmm9[2],xmm3[3],xmm9<wbr class="">[3],xmm3[4],xmm9[4],xmm3[5],<wbr class="">xmm9[5],xmm3[6],xmm9[6],xmm3[<wbr class="">7],xmm9[7]<br class="">
; SSE2-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm15[0],xmm3[1],xmm15<wbr class="">[1],xmm3[2],xmm15[2],xmm3[3],<wbr class="">xmm15[3],xmm3[4],xmm15[4],<wbr class="">xmm3[5],xmm15[5],xmm3[6],<wbr class="">xmm15[6],xmm3[7],xmm15[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm10[0],xmm0[1],xmm10<wbr class="">[1],xmm0[2],xmm10[2],xmm0[3],<wbr class="">xmm10[3],xmm0[4],xmm10[4],<wbr class="">xmm0[5],xmm10[5],xmm0[6],<wbr class="">xmm10[6],xmm0[7],xmm10[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm11[0],xmm7[1],xmm11<wbr class="">[1],xmm7[2],xmm11[2],xmm7[3],<wbr class="">xmm11[3],xmm7[4],xmm11[4],<wbr class="">xmm7[5],xmm11[5],xmm7[6],<wbr class="">xmm11[6],xmm7[7],xmm11[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm7[0],xmm0[1],xmm7[1<wbr class="">],xmm0[2],xmm7[2],xmm0[3],xmm7<wbr class="">[3],xmm0[4],xmm7[4],xmm0[5],<wbr class="">xmm7[5],xmm0[6],xmm7[6],xmm0[<wbr class="">7],xmm7[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3],xmm0[4],xmm3[4],xmm0[5],<wbr class="">xmm3[5],xmm0[6],xmm3[6],xmm0[<wbr class="">7],xmm3[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm12[0],xmm2[1],xmm12<wbr class="">[1],xmm2[2],xmm12[2],xmm2[3],<wbr class="">xmm12[3],xmm2[4],xmm12[4],<wbr class="">xmm2[5],xmm12[5],xmm2[6],<wbr class="">xmm12[6],xmm2[7],xmm12[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm13[0],xmm6[1],xmm13<wbr class="">[1],xmm6[2],xmm13[2],xmm6[3],<wbr class="">xmm13[3],xmm6[4],xmm13[4],<wbr class="">xmm6[5],xmm13[5],xmm6[6],<wbr class="">xmm13[6],xmm6[7],xmm13[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm2[0],xmm6[1],xmm2[1<wbr class="">],xmm6[2],xmm2[2],xmm6[3],xmm2<wbr class="">[3],xmm6[4],xmm2[4],xmm6[5],<wbr class="">xmm2[5],xmm6[6],xmm2[6],xmm6[<wbr class="">7],xmm2[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm14[0],xmm5[1],xmm14<wbr class="">[1],xmm5[2],xmm14[2],xmm5[3],<wbr class="">xmm14[3],xmm5[4],xmm14[4],<wbr class="">xmm5[5],xmm14[5],xmm5[6],<wbr class="">xmm14[6],xmm5[7],xmm14[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm4[0],xmm1[1],xmm4[1<wbr class="">],xmm1[2],xmm4[2],xmm1[3],xmm4<wbr class="">[3],xmm1[4],xmm4[4],xmm1[5],<wbr class="">xmm4[5],xmm1[6],xmm4[6],xmm1[<wbr class="">7],xmm4[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm1[0],xmm5[1],xmm1[1<wbr class="">],xmm5[2],xmm1[2],xmm5[3],xmm1<wbr class="">[3],xmm5[4],xmm1[4],xmm5[5],<wbr class="">xmm1[5],xmm5[6],xmm1[6],xmm5[<wbr class="">7],xmm1[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm6[0],xmm5[1],xmm6[1<wbr class="">],xmm5[2],xmm6[2],xmm5[3],xmm6<wbr class="">[3],xmm5[4],xmm6[4],xmm5[5],<wbr class="">xmm6[5],xmm5[6],xmm6[6],xmm5[<wbr class="">7],xmm6[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm5[0],xmm0[1],xmm5[1<wbr class="">],xmm0[2],xmm5[2],xmm0[3],xmm5<wbr class="">[3],xmm0[4],xmm5[4],xmm0[5],<wbr class="">xmm5[5],xmm0[6],xmm5[6],xmm0[<wbr class="">7],xmm5[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm10[0],xmm7[1],xmm10<wbr class="">[1],xmm7[2],xmm10[2],xmm7[3],<wbr class="">xmm10[3],xmm7[4],xmm10[4],<wbr class="">xmm7[5],xmm10[5],xmm7[6],<wbr class="">xmm10[6],xmm7[7],xmm10[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm11[0],xmm6[1],xmm11<wbr class="">[1],xmm6[2],xmm11[2],xmm6[3],<wbr class="">xmm11[3],xmm6[4],xmm11[4],<wbr class="">xmm6[5],xmm11[5],xmm6[6],<wbr class="">xmm11[6],xmm6[7],xmm11[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm7[0],xmm6[1],xmm7[1<wbr class="">],xmm6[2],xmm7[2],xmm6[3],xmm7<wbr class="">[3],xmm6[4],xmm7[4],xmm6[5],<wbr class="">xmm7[5],xmm6[6],xmm7[6],xmm6[<wbr class="">7],xmm7[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm3[0],xmm6[1],xmm3[1<wbr class="">],xmm6[2],xmm3[2],xmm6[3],xmm3<wbr class="">[3],xmm6[4],xmm3[4],xmm6[5],<wbr class="">xmm3[5],xmm6[6],xmm3[6],xmm6[<wbr class="">7],xmm3[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm12[0],xmm5[1],xmm12<wbr class="">[1],xmm5[2],xmm12[2],xmm5[3],<wbr class="">xmm12[3],xmm5[4],xmm12[4],<wbr class="">xmm5[5],xmm12[5],xmm5[6],<wbr class="">xmm12[6],xmm5[7],xmm12[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm13[0],xmm4[1],xmm13<wbr class="">[1],xmm4[2],xmm13[2],xmm4[3],<wbr class="">xmm13[3],xmm4[4],xmm13[4],<wbr class="">xmm4[5],xmm13[5],xmm4[6],<wbr class="">xmm13[6],xmm4[7],xmm13[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm5[0],xmm4[1],xmm5[1<wbr class="">],xmm4[2],xmm5[2],xmm4[3],xmm5<wbr class="">[3],xmm4[4],xmm5[4],xmm4[5],<wbr class="">xmm5[5],xmm4[6],xmm5[6],xmm4[<wbr class="">7],xmm5[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm14[0],xmm1[1],xmm14<wbr class="">[1],xmm1[2],xmm14[2],xmm1[3],<wbr class="">xmm14[3],xmm1[4],xmm14[4],<wbr class="">xmm1[5],xmm14[5],xmm1[6],<wbr class="">xmm14[6],xmm1[7],xmm14[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3],xmm0[4],xmm2[4],xmm0[5],<wbr class="">xmm2[5],xmm0[6],xmm2[6],xmm0[<wbr class="">7],xmm2[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3],xmm0[4],xmm1[4],xmm0[5],<wbr class="">xmm1[5],xmm0[6],xmm1[6],xmm0[<wbr class="">7],xmm1[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm4[0],xmm0[1],xmm4[1<wbr class="">],xmm0[2],xmm4[2],xmm0[3],xmm4<wbr class="">[3],xmm0[4],xmm4[4],xmm0[5],<wbr class="">xmm4[5],xmm0[6],xmm4[6],xmm0[<wbr class="">7],xmm4[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm6[0],xmm0[1],xmm6[1<wbr class="">],xmm0[2],xmm6[2],xmm0[3],xmm6<wbr class="">[3],xmm0[4],xmm6[4],xmm0[5],<wbr class="">xmm6[5],xmm0[6],xmm6[6],xmm0[<wbr class="">7],xmm6[7]<br class="">
; SSE2-NEXT: retq<br class="">
;<br class="">
; SSSE3-LABEL: var_shuffle_v16i8_v16i8_xxxxxx<wbr class="">xxxxxxxxxx_i8:<br class="">
@@ -501,89 +497,84 @@ define <16 x i8> @var_shuffle_v16i8_v16i<br class="">
; SSSE3-NEXT: # kill: %ESI<def> %ESI<kill> %RSI<def><br class="">
; SSSE3-NEXT: # kill: %EDI<def> %EDI<kill> %RDI<def><br class="">
; SSSE3-NEXT: movaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %r10d<br class="">
-; SSSE3-NEXT: andl $15, %r10d<br class="">
-; SSSE3-NEXT: leaq -{{[0-9]+}}(%rsp), %r11<br class="">
-; SSSE3-NEXT: movzbl (%r10,%r11), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm15<br class="">
; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSSE3-NEXT: leaq -{{[0-9]+}}(%rsp), %r10<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm8<br class="">
; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm15<br class="">
+; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
+; SSSE3-NEXT: andl $15, %eax<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm9<br class="">
-; SSSE3-NEXT: andl $15, %edx<br class="">
-; SSSE3-NEXT: movzbl (%rdx,%r11), %eax<br class="">
+; SSSE3-NEXT: andl $15, %ecx<br class="">
+; SSSE3-NEXT: movzbl (%rcx,%r10), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm3<br class="">
; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm10<br class="">
-; SSSE3-NEXT: andl $15, %edi<br class="">
-; SSSE3-NEXT: movzbl (%rdi,%r11), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm0<br class="">
+; SSSE3-NEXT: andl $15, %r9d<br class="">
+; SSSE3-NEXT: movzbl (%r9,%r10), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm7<br class="">
; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm11<br class="">
-; SSSE3-NEXT: andl $15, %r8d<br class="">
-; SSSE3-NEXT: movzbl (%r8,%r11), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm7<br class="">
+; SSSE3-NEXT: andl $15, %esi<br class="">
+; SSSE3-NEXT: movzbl (%rsi,%r10), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm6<br class="">
; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%r11), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm2<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm12<br class="">
; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%r11), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm12<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm5<br class="">
; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm13<br class="">
-; SSSE3-NEXT: andl $15, %ecx<br class="">
-; SSSE3-NEXT: movzbl (%rcx,%r11), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm6<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%r10), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm4<br class="">
; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%r11), %eax<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm14<br class="">
-; SSSE3-NEXT: andl $15, %esi<br class="">
-; SSSE3-NEXT: movzbl (%rsi,%r11), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm5<br class="">
+; SSSE3-NEXT: andl $15, %r8d<br class="">
+; SSSE3-NEXT: movzbl (%r8,%r10), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm1<br class="">
; SSSE3-NEXT: movzbl {{[0-9]+}}(%rsp), %eax<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%r11), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm4<br class="">
-; SSSE3-NEXT: andl $15, %r9d<br class="">
-; SSSE3-NEXT: movzbl (%r9,%r11), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm1<br class="">
+; SSSE3-NEXT: movzbl (%rax,%r10), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm2<br class="">
+; SSSE3-NEXT: andl $15, %edi<br class="">
+; SSSE3-NEXT: movzbl (%rdi,%r10), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm0<br class="">
; SSSE3-NEXT: punpcklbw {{.*#+}} xmm15 = xmm15[0],xmm8[0],xmm15[1],xmm8<wbr class="">[1],xmm15[2],xmm8[2],xmm15[3],<wbr class="">xmm8[3],xmm15[4],xmm8[4],<wbr class="">xmm15[5],xmm8[5],xmm15[6],<wbr class="">xmm8[6],xmm15[7],xmm8[7]<br class="">
; SSSE3-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm9[0],xmm3[1],xmm9[1<wbr class="">],xmm3[2],xmm9[2],xmm3[3],xmm9<wbr class="">[3],xmm3[4],xmm9[4],xmm3[5],<wbr class="">xmm9[5],xmm3[6],xmm9[6],xmm3[<wbr class="">7],xmm9[7]<br class="">
; SSSE3-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm15[0],xmm3[1],xmm15<wbr class="">[1],xmm3[2],xmm15[2],xmm3[3],<wbr class="">xmm15[3],xmm3[4],xmm15[4],<wbr class="">xmm3[5],xmm15[5],xmm3[6],<wbr class="">xmm15[6],xmm3[7],xmm15[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm10[0],xmm0[1],xmm10<wbr class="">[1],xmm0[2],xmm10[2],xmm0[3],<wbr class="">xmm10[3],xmm0[4],xmm10[4],<wbr class="">xmm0[5],xmm10[5],xmm0[6],<wbr class="">xmm10[6],xmm0[7],xmm10[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm11[0],xmm7[1],xmm11<wbr class="">[1],xmm7[2],xmm11[2],xmm7[3],<wbr class="">xmm11[3],xmm7[4],xmm11[4],<wbr class="">xmm7[5],xmm11[5],xmm7[6],<wbr class="">xmm11[6],xmm7[7],xmm11[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm7[0],xmm0[1],xmm7[1<wbr class="">],xmm0[2],xmm7[2],xmm0[3],xmm7<wbr class="">[3],xmm0[4],xmm7[4],xmm0[5],<wbr class="">xmm7[5],xmm0[6],xmm7[6],xmm0[<wbr class="">7],xmm7[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3],xmm0[4],xmm3[4],xmm0[5],<wbr class="">xmm3[5],xmm0[6],xmm3[6],xmm0[<wbr class="">7],xmm3[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm12[0],xmm2[1],xmm12<wbr class="">[1],xmm2[2],xmm12[2],xmm2[3],<wbr class="">xmm12[3],xmm2[4],xmm12[4],<wbr class="">xmm2[5],xmm12[5],xmm2[6],<wbr class="">xmm12[6],xmm2[7],xmm12[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm13[0],xmm6[1],xmm13<wbr class="">[1],xmm6[2],xmm13[2],xmm6[3],<wbr class="">xmm13[3],xmm6[4],xmm13[4],<wbr class="">xmm6[5],xmm13[5],xmm6[6],<wbr class="">xmm13[6],xmm6[7],xmm13[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm2[0],xmm6[1],xmm2[1<wbr class="">],xmm6[2],xmm2[2],xmm6[3],xmm2<wbr class="">[3],xmm6[4],xmm2[4],xmm6[5],<wbr class="">xmm2[5],xmm6[6],xmm2[6],xmm6[<wbr class="">7],xmm2[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm14[0],xmm5[1],xmm14<wbr class="">[1],xmm5[2],xmm14[2],xmm5[3],<wbr class="">xmm14[3],xmm5[4],xmm14[4],<wbr class="">xmm5[5],xmm14[5],xmm5[6],<wbr class="">xmm14[6],xmm5[7],xmm14[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm4[0],xmm1[1],xmm4[1<wbr class="">],xmm1[2],xmm4[2],xmm1[3],xmm4<wbr class="">[3],xmm1[4],xmm4[4],xmm1[5],<wbr class="">xmm4[5],xmm1[6],xmm4[6],xmm1[<wbr class="">7],xmm4[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm1[0],xmm5[1],xmm1[1<wbr class="">],xmm5[2],xmm1[2],xmm5[3],xmm1<wbr class="">[3],xmm5[4],xmm1[4],xmm5[5],<wbr class="">xmm1[5],xmm5[6],xmm1[6],xmm5[<wbr class="">7],xmm1[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm6[0],xmm5[1],xmm6[1<wbr class="">],xmm5[2],xmm6[2],xmm5[3],xmm6<wbr class="">[3],xmm5[4],xmm6[4],xmm5[5],<wbr class="">xmm6[5],xmm5[6],xmm6[6],xmm5[<wbr class="">7],xmm6[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm5[0],xmm0[1],xmm5[1<wbr class="">],xmm0[2],xmm5[2],xmm0[3],xmm5<wbr class="">[3],xmm0[4],xmm5[4],xmm0[5],<wbr class="">xmm5[5],xmm0[6],xmm5[6],xmm0[<wbr class="">7],xmm5[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm10[0],xmm7[1],xmm10<wbr class="">[1],xmm7[2],xmm10[2],xmm7[3],<wbr class="">xmm10[3],xmm7[4],xmm10[4],<wbr class="">xmm7[5],xmm10[5],xmm7[6],<wbr class="">xmm10[6],xmm7[7],xmm10[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm11[0],xmm6[1],xmm11<wbr class="">[1],xmm6[2],xmm11[2],xmm6[3],<wbr class="">xmm11[3],xmm6[4],xmm11[4],<wbr class="">xmm6[5],xmm11[5],xmm6[6],<wbr class="">xmm11[6],xmm6[7],xmm11[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm7[0],xmm6[1],xmm7[1<wbr class="">],xmm6[2],xmm7[2],xmm6[3],xmm7<wbr class="">[3],xmm6[4],xmm7[4],xmm6[5],<wbr class="">xmm7[5],xmm6[6],xmm7[6],xmm6[<wbr class="">7],xmm7[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm3[0],xmm6[1],xmm3[1<wbr class="">],xmm6[2],xmm3[2],xmm6[3],xmm3<wbr class="">[3],xmm6[4],xmm3[4],xmm6[5],<wbr class="">xmm3[5],xmm6[6],xmm3[6],xmm6[<wbr class="">7],xmm3[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm12[0],xmm5[1],xmm12<wbr class="">[1],xmm5[2],xmm12[2],xmm5[3],<wbr class="">xmm12[3],xmm5[4],xmm12[4],<wbr class="">xmm5[5],xmm12[5],xmm5[6],<wbr class="">xmm12[6],xmm5[7],xmm12[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm13[0],xmm4[1],xmm13<wbr class="">[1],xmm4[2],xmm13[2],xmm4[3],<wbr class="">xmm13[3],xmm4[4],xmm13[4],<wbr class="">xmm4[5],xmm13[5],xmm4[6],<wbr class="">xmm13[6],xmm4[7],xmm13[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm5[0],xmm4[1],xmm5[1<wbr class="">],xmm4[2],xmm5[2],xmm4[3],xmm5<wbr class="">[3],xmm4[4],xmm5[4],xmm4[5],<wbr class="">xmm5[5],xmm4[6],xmm5[6],xmm4[<wbr class="">7],xmm5[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm14[0],xmm1[1],xmm14<wbr class="">[1],xmm1[2],xmm14[2],xmm1[3],<wbr class="">xmm14[3],xmm1[4],xmm14[4],<wbr class="">xmm1[5],xmm14[5],xmm1[6],<wbr class="">xmm14[6],xmm1[7],xmm14[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3],xmm0[4],xmm2[4],xmm0[5],<wbr class="">xmm2[5],xmm0[6],xmm2[6],xmm0[<wbr class="">7],xmm2[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3],xmm0[4],xmm1[4],xmm0[5],<wbr class="">xmm1[5],xmm0[6],xmm1[6],xmm0[<wbr class="">7],xmm1[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm4[0],xmm0[1],xmm4[1<wbr class="">],xmm0[2],xmm4[2],xmm0[3],xmm4<wbr class="">[3],xmm0[4],xmm4[4],xmm0[5],<wbr class="">xmm4[5],xmm0[6],xmm4[6],xmm0[<wbr class="">7],xmm4[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm6[0],xmm0[1],xmm6[1<wbr class="">],xmm0[2],xmm6[2],xmm0[3],xmm6<wbr class="">[3],xmm0[4],xmm6[4],xmm0[5],<wbr class="">xmm6[5],xmm0[6],xmm6[6],xmm0[<wbr class="">7],xmm6[7]<br class="">
; SSSE3-NEXT: retq<br class="">
;<br class="">
; SSE41-LABEL: var_shuffle_v16i8_v16i8_xxxxxx<wbr class="">xxxxxxxxxx_i8:<br class="">
; SSE41: # BB#0:<br class="">
-; SSE41-NEXT: pushq %rbp<br class="">
-; SSE41-NEXT: pushq %r15<br class="">
-; SSE41-NEXT: pushq %r14<br class="">
-; SSE41-NEXT: pushq %r12<br class="">
-; SSE41-NEXT: pushq %rbx<br class="">
; SSE41-NEXT: # kill: %R9D<def> %R9D<kill> %R9<def><br class="">
; SSE41-NEXT: # kill: %R8D<def> %R8D<kill> %R8<def><br class="">
; SSE41-NEXT: # kill: %ECX<def> %ECX<kill> %RCX<def><br class="">
@@ -591,74 +582,54 @@ define <16 x i8> @var_shuffle_v16i8_v16i<br class="">
; SSE41-NEXT: # kill: %ESI<def> %ESI<kill> %RSI<def><br class="">
; SSE41-NEXT: # kill: %EDI<def> %EDI<kill> %RDI<def><br class="">
; SSE41-NEXT: andl $15, %edi<br class="">
-; SSE41-NEXT: andl $15, %esi<br class="">
-; SSE41-NEXT: andl $15, %edx<br class="">
-; SSE41-NEXT: andl $15, %ecx<br class="">
-; SSE41-NEXT: andl $15, %r8d<br class="">
; SSE41-NEXT: movaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSE41-NEXT: andl $15, %r9d<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %r10d<br class="">
-; SSE41-NEXT: andl $15, %r10d<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %r11d<br class="">
-; SSE41-NEXT: andl $15, %r11d<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %r14d<br class="">
-; SSE41-NEXT: andl $15, %r14d<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %r15d<br class="">
-; SSE41-NEXT: andl $15, %r15d<br class="">
; SSE41-NEXT: leaq -{{[0-9]+}}(%rsp), %rax<br class="">
; SSE41-NEXT: movzbl (%rdi,%rax), %edi<br class="">
; SSE41-NEXT: movd %edi, %xmm0<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %r12d<br class="">
-; SSE41-NEXT: andl $15, %r12d<br class="">
-; SSE41-NEXT: pinsrb $1, (%rsi,%rax), %xmm0<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %esi<br class="">
; SSE41-NEXT: andl $15, %esi<br class="">
-; SSE41-NEXT: pinsrb $2, (%rdx,%rax), %xmm0<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %edx<br class="">
+; SSE41-NEXT: pinsrb $1, (%rsi,%rax), %xmm0<br class="">
; SSE41-NEXT: andl $15, %edx<br class="">
-; SSE41-NEXT: pinsrb $3, (%rcx,%rax), %xmm0<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: pinsrb $2, (%rdx,%rax), %xmm0<br class="">
; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $3, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: andl $15, %r8d<br class="">
; SSE41-NEXT: pinsrb $4, (%r8,%rax), %xmm0<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ebx<br class="">
-; SSE41-NEXT: andl $15, %ebx<br class="">
+; SSE41-NEXT: andl $15, %r9d<br class="">
; SSE41-NEXT: pinsrb $5, (%r9,%rax), %xmm0<br class="">
-; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %edi<br class="">
-; SSE41-NEXT: andl $15, %edi<br class="">
-; SSE41-NEXT: movzbl (%r10,%rax), %r8d<br class="">
-; SSE41-NEXT: movzbl (%r11,%rax), %r9d<br class="">
-; SSE41-NEXT: movzbl (%r14,%rax), %r10d<br class="">
-; SSE41-NEXT: movzbl (%r15,%rax), %r11d<br class="">
-; SSE41-NEXT: movzbl (%r12,%rax), %ebp<br class="">
-; SSE41-NEXT: movzbl (%rsi,%rax), %esi<br class="">
-; SSE41-NEXT: movzbl (%rdx,%rax), %edx<br class="">
-; SSE41-NEXT: movzbl (%rcx,%rax), %ecx<br class="">
-; SSE41-NEXT: movzbl (%rbx,%rax), %ebx<br class="">
-; SSE41-NEXT: movzbl (%rdi,%rax), %eax<br class="">
-; SSE41-NEXT: pinsrb $6, %r8d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $7, %r9d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $8, %r10d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $9, %r11d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $10, %ebp, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $11, %esi, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $12, %edx, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $13, %ecx, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $14, %ebx, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $15, %eax, %xmm0<br class="">
-; SSE41-NEXT: popq %rbx<br class="">
-; SSE41-NEXT: popq %r12<br class="">
-; SSE41-NEXT: popq %r14<br class="">
-; SSE41-NEXT: popq %r15<br class="">
-; SSE41-NEXT: popq %rbp<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $6, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $7, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $8, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $9, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $10, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $11, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $12, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $13, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $14, (%rcx,%rax), %xmm0<br class="">
+; SSE41-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; SSE41-NEXT: andl $15, %ecx<br class="">
+; SSE41-NEXT: pinsrb $15, (%rcx,%rax), %xmm0<br class="">
; SSE41-NEXT: retq<br class="">
;<br class="">
; AVX-LABEL: var_shuffle_v16i8_v16i8_xxxxxx<wbr class="">xxxxxxxxxx_i8:<br class="">
; AVX: # BB#0:<br class="">
-; AVX-NEXT: pushq %rbp<br class="">
-; AVX-NEXT: pushq %r15<br class="">
-; AVX-NEXT: pushq %r14<br class="">
-; AVX-NEXT: pushq %r12<br class="">
-; AVX-NEXT: pushq %rbx<br class="">
; AVX-NEXT: # kill: %R9D<def> %R9D<kill> %R9<def><br class="">
; AVX-NEXT: # kill: %R8D<def> %R8D<kill> %R8<def><br class="">
; AVX-NEXT: # kill: %ECX<def> %ECX<kill> %RCX<def><br class="">
@@ -666,65 +637,50 @@ define <16 x i8> @var_shuffle_v16i8_v16i<br class="">
; AVX-NEXT: # kill: %ESI<def> %ESI<kill> %RSI<def><br class="">
; AVX-NEXT: # kill: %EDI<def> %EDI<kill> %RDI<def><br class="">
; AVX-NEXT: andl $15, %edi<br class="">
-; AVX-NEXT: andl $15, %esi<br class="">
-; AVX-NEXT: andl $15, %edx<br class="">
-; AVX-NEXT: andl $15, %ecx<br class="">
-; AVX-NEXT: andl $15, %r8d<br class="">
; AVX-NEXT: vmovaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; AVX-NEXT: andl $15, %r9d<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %r10d<br class="">
-; AVX-NEXT: andl $15, %r10d<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %r11d<br class="">
-; AVX-NEXT: andl $15, %r11d<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %r14d<br class="">
-; AVX-NEXT: andl $15, %r14d<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %r15d<br class="">
-; AVX-NEXT: andl $15, %r15d<br class="">
; AVX-NEXT: leaq -{{[0-9]+}}(%rsp), %rax<br class="">
; AVX-NEXT: movzbl (%rdi,%rax), %edi<br class="">
; AVX-NEXT: vmovd %edi, %xmm0<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %r12d<br class="">
-; AVX-NEXT: andl $15, %r12d<br class="">
-; AVX-NEXT: vpinsrb $1, (%rsi,%rax), %xmm0, %xmm0<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %esi<br class="">
; AVX-NEXT: andl $15, %esi<br class="">
-; AVX-NEXT: vpinsrb $2, (%rdx,%rax), %xmm0, %xmm0<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %edx<br class="">
+; AVX-NEXT: vpinsrb $1, (%rsi,%rax), %xmm0, %xmm0<br class="">
; AVX-NEXT: andl $15, %edx<br class="">
-; AVX-NEXT: vpinsrb $3, (%rcx,%rax), %xmm0, %xmm0<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: vpinsrb $2, (%rdx,%rax), %xmm0, %xmm0<br class="">
; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $3, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: andl $15, %r8d<br class="">
; AVX-NEXT: vpinsrb $4, (%r8,%rax), %xmm0, %xmm0<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ebx<br class="">
-; AVX-NEXT: andl $15, %ebx<br class="">
+; AVX-NEXT: andl $15, %r9d<br class="">
; AVX-NEXT: vpinsrb $5, (%r9,%rax), %xmm0, %xmm0<br class="">
-; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %edi<br class="">
-; AVX-NEXT: andl $15, %edi<br class="">
-; AVX-NEXT: movzbl (%r10,%rax), %r8d<br class="">
-; AVX-NEXT: movzbl (%r11,%rax), %r9d<br class="">
-; AVX-NEXT: movzbl (%r14,%rax), %r10d<br class="">
-; AVX-NEXT: movzbl (%r15,%rax), %r11d<br class="">
-; AVX-NEXT: movzbl (%r12,%rax), %ebp<br class="">
-; AVX-NEXT: movzbl (%rsi,%rax), %esi<br class="">
-; AVX-NEXT: movzbl (%rdx,%rax), %edx<br class="">
-; AVX-NEXT: movzbl (%rcx,%rax), %ecx<br class="">
-; AVX-NEXT: movzbl (%rbx,%rax), %ebx<br class="">
-; AVX-NEXT: movzbl (%rdi,%rax), %eax<br class="">
-; AVX-NEXT: vpinsrb $6, %r8d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $7, %r9d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $8, %r10d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $9, %r11d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $10, %ebp, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $11, %esi, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $12, %edx, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $13, %ecx, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $14, %ebx, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $15, %eax, %xmm0, %xmm0<br class="">
-; AVX-NEXT: popq %rbx<br class="">
-; AVX-NEXT: popq %r12<br class="">
-; AVX-NEXT: popq %r14<br class="">
-; AVX-NEXT: popq %r15<br class="">
-; AVX-NEXT: popq %rbp<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $6, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $7, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $8, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $9, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $10, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $11, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $12, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $13, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $14, (%rcx,%rax), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl {{[0-9]+}}(%rsp), %ecx<br class="">
+; AVX-NEXT: andl $15, %ecx<br class="">
+; AVX-NEXT: vpinsrb $15, (%rcx,%rax), %xmm0, %xmm0<br class="">
; AVX-NEXT: retq<br class="">
%x0 = extractelement <16 x i8> %x, i8 %i0<br class="">
%x1 = extractelement <16 x i8> %x, i8 %i1<br class="">
@@ -779,11 +735,11 @@ define <4 x i32> @mem_shuffle_v4i32_v4i3<br class="">
; SSE2-NEXT: andl $3, %esi<br class="">
; SSE2-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSE2-NEXT: movd {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
+; SSE2-NEXT: punpckldq {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">]<br class="">
; SSE2-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
+; SSE2-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSE2-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
-; SSE2-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; SSE2-NEXT: punpckldq {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">]<br class="">
-; SSE2-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
+; SSE2-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">]<br class="">
; SSE2-NEXT: retq<br class="">
;<br class="">
; SSSE3-LABEL: mem_shuffle_v4i32_v4i32_xxxx_i<wbr class="">32:<br class="">
@@ -799,11 +755,11 @@ define <4 x i32> @mem_shuffle_v4i32_v4i3<br class="">
; SSSE3-NEXT: andl $3, %esi<br class="">
; SSSE3-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSSE3-NEXT: movd {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
+; SSSE3-NEXT: punpckldq {{.*#+}} xmm1 = xmm1[0],xmm0[0],xmm1[1],xmm0[1<wbr class="">]<br class="">
; SSSE3-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
+; SSSE3-NEXT: movd {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
; SSSE3-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
-; SSSE3-NEXT: movd {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; SSSE3-NEXT: punpckldq {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">]<br class="">
-; SSSE3-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">]<br class="">
+; SSSE3-NEXT: punpckldq {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">]<br class="">
; SSSE3-NEXT: retq<br class="">
;<br class="">
; SSE41-LABEL: mem_shuffle_v4i32_v4i32_xxxx_i<wbr class="">32:<br class="">
@@ -862,341 +818,281 @@ define <16 x i8> @mem_shuffle_v16i8_v16i<br class="">
; SSE2-LABEL: mem_shuffle_v16i8_v16i8_xxxxxx<wbr class="">xxxxxxxxxx_i8:<br class="">
; SSE2: # BB#0:<br class="">
; SSE2-NEXT: movzbl (%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
; SSE2-NEXT: movaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
+; SSE2-NEXT: movzbl 15(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
; SSE2-NEXT: leaq -{{[0-9]+}}(%rsp), %rcx<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm0<br class="">
-; SSE2-NEXT: movzbl 8(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm8<br class="">
-; SSE2-NEXT: movzbl 12(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm9<br class="">
-; SSE2-NEXT: movzbl 4(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm3<br class="">
-; SSE2-NEXT: movzbl 14(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm10<br class="">
-; SSE2-NEXT: movzbl 6(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm5<br class="">
-; SSE2-NEXT: movzbl 10(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm11<br class="">
-; SSE2-NEXT: movzbl 2(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm7<br class="">
-; SSE2-NEXT: movzbl 15(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm12<br class="">
-; SSE2-NEXT: movzbl 7(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm2<br class="">
-; SSE2-NEXT: movzbl 11(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm13<br class="">
-; SSE2-NEXT: movzbl 3(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm6<br class="">
-; SSE2-NEXT: movzbl 13(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm14<br class="">
-; SSE2-NEXT: movzbl 5(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm4<br class="">
-; SSE2-NEXT: movzbl 9(%rdi), %eax<br class="">
-; SSE2-NEXT: andl $15, %eax<br class="">
-; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm15<br class="">
-; SSE2-NEXT: movzbl 1(%rdi), %eax<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm8<br class="">
+; SSE2-NEXT: movzbl 7(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm15<br class="">
+; SSE2-NEXT: movzbl 11(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm9<br class="">
+; SSE2-NEXT: movzbl 3(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm3<br class="">
+; SSE2-NEXT: movzbl 13(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm10<br class="">
+; SSE2-NEXT: movzbl 5(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm7<br class="">
+; SSE2-NEXT: movzbl 9(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm11<br class="">
+; SSE2-NEXT: movzbl 1(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm6<br class="">
+; SSE2-NEXT: movzbl 14(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm12<br class="">
+; SSE2-NEXT: movzbl 6(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm5<br class="">
+; SSE2-NEXT: movzbl 10(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm13<br class="">
+; SSE2-NEXT: movzbl 2(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm4<br class="">
+; SSE2-NEXT: movzbl 12(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm14<br class="">
+; SSE2-NEXT: movzbl 4(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm1<br class="">
+; SSE2-NEXT: movzbl 8(%rdi), %edx<br class="">
+; SSE2-NEXT: andl $15, %edx<br class="">
+; SSE2-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSE2-NEXT: movd %edx, %xmm2<br class="">
; SSE2-NEXT: andl $15, %eax<br class="">
; SSE2-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSE2-NEXT: movd %eax, %xmm1<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm8[0],xmm0[1],xmm8[1<wbr class="">],xmm0[2],xmm8[2],xmm0[3],xmm8<wbr class="">[3],xmm0[4],xmm8[4],xmm0[5],<wbr class="">xmm8[5],xmm0[6],xmm8[6],xmm0[<wbr class="">7],xmm8[7]<br class="">
+; SSE2-NEXT: movd %eax, %xmm0<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm15 = xmm15[0],xmm8[0],xmm15[1],xmm8<wbr class="">[1],xmm15[2],xmm8[2],xmm15[3],<wbr class="">xmm8[3],xmm15[4],xmm8[4],<wbr class="">xmm15[5],xmm8[5],xmm15[6],<wbr class="">xmm8[6],xmm15[7],xmm8[7]<br class="">
; SSE2-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm9[0],xmm3[1],xmm9[1<wbr class="">],xmm3[2],xmm9[2],xmm3[3],xmm9<wbr class="">[3],xmm3[4],xmm9[4],xmm3[5],<wbr class="">xmm9[5],xmm3[6],xmm9[6],xmm3[<wbr class="">7],xmm9[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3],xmm0[4],xmm3[4],xmm0[5],<wbr class="">xmm3[5],xmm0[6],xmm3[6],xmm0[<wbr class="">7],xmm3[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm10[0],xmm5[1],xmm10<wbr class="">[1],xmm5[2],xmm10[2],xmm5[3],<wbr class="">xmm10[3],xmm5[4],xmm10[4],<wbr class="">xmm5[5],xmm10[5],xmm5[6],<wbr class="">xmm10[6],xmm5[7],xmm10[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm11[0],xmm7[1],xmm11<wbr class="">[1],xmm7[2],xmm11[2],xmm7[3],<wbr class="">xmm11[3],xmm7[4],xmm11[4],<wbr class="">xmm7[5],xmm11[5],xmm7[6],<wbr class="">xmm11[6],xmm7[7],xmm11[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm5[0],xmm7[1],xmm5[1<wbr class="">],xmm7[2],xmm5[2],xmm7[3],xmm5<wbr class="">[3],xmm7[4],xmm5[4],xmm7[5],<wbr class="">xmm5[5],xmm7[6],xmm5[6],xmm7[<wbr class="">7],xmm5[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm7[0],xmm0[1],xmm7[1<wbr class="">],xmm0[2],xmm7[2],xmm0[3],xmm7<wbr class="">[3],xmm0[4],xmm7[4],xmm0[5],<wbr class="">xmm7[5],xmm0[6],xmm7[6],xmm0[<wbr class="">7],xmm7[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm12[0],xmm2[1],xmm12<wbr class="">[1],xmm2[2],xmm12[2],xmm2[3],<wbr class="">xmm12[3],xmm2[4],xmm12[4],<wbr class="">xmm2[5],xmm12[5],xmm2[6],<wbr class="">xmm12[6],xmm2[7],xmm12[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm13[0],xmm6[1],xmm13<wbr class="">[1],xmm6[2],xmm13[2],xmm6[3],<wbr class="">xmm13[3],xmm6[4],xmm13[4],<wbr class="">xmm6[5],xmm13[5],xmm6[6],<wbr class="">xmm13[6],xmm6[7],xmm13[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm2[0],xmm6[1],xmm2[1<wbr class="">],xmm6[2],xmm2[2],xmm6[3],xmm2<wbr class="">[3],xmm6[4],xmm2[4],xmm6[5],<wbr class="">xmm2[5],xmm6[6],xmm2[6],xmm6[<wbr class="">7],xmm2[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm14[0],xmm4[1],xmm14<wbr class="">[1],xmm4[2],xmm14[2],xmm4[3],<wbr class="">xmm14[3],xmm4[4],xmm14[4],<wbr class="">xmm4[5],xmm14[5],xmm4[6],<wbr class="">xmm14[6],xmm4[7],xmm14[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm15[0],xmm1[1],xmm15<wbr class="">[1],xmm1[2],xmm15[2],xmm1[3],<wbr class="">xmm15[3],xmm1[4],xmm15[4],<wbr class="">xmm1[5],xmm15[5],xmm1[6],<wbr class="">xmm15[6],xmm1[7],xmm15[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm4[0],xmm1[1],xmm4[1<wbr class="">],xmm1[2],xmm4[2],xmm1[3],xmm4<wbr class="">[3],xmm1[4],xmm4[4],xmm1[5],<wbr class="">xmm4[5],xmm1[6],xmm4[6],xmm1[<wbr class="">7],xmm4[7]<br class="">
-; SSE2-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm6[0],xmm1[1],xmm6[1<wbr class="">],xmm1[2],xmm6[2],xmm1[3],xmm6<wbr class="">[3],xmm1[4],xmm6[4],xmm1[5],<wbr class="">xmm6[5],xmm1[6],xmm6[6],xmm1[<wbr class="">7],xmm6[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm15[0],xmm3[1],xmm15<wbr class="">[1],xmm3[2],xmm15[2],xmm3[3],<wbr class="">xmm15[3],xmm3[4],xmm15[4],<wbr class="">xmm3[5],xmm15[5],xmm3[6],<wbr class="">xmm15[6],xmm3[7],xmm15[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm10[0],xmm7[1],xmm10<wbr class="">[1],xmm7[2],xmm10[2],xmm7[3],<wbr class="">xmm10[3],xmm7[4],xmm10[4],<wbr class="">xmm7[5],xmm10[5],xmm7[6],<wbr class="">xmm10[6],xmm7[7],xmm10[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm11[0],xmm6[1],xmm11<wbr class="">[1],xmm6[2],xmm11[2],xmm6[3],<wbr class="">xmm11[3],xmm6[4],xmm11[4],<wbr class="">xmm6[5],xmm11[5],xmm6[6],<wbr class="">xmm11[6],xmm6[7],xmm11[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm7[0],xmm6[1],xmm7[1<wbr class="">],xmm6[2],xmm7[2],xmm6[3],xmm7<wbr class="">[3],xmm6[4],xmm7[4],xmm6[5],<wbr class="">xmm7[5],xmm6[6],xmm7[6],xmm6[<wbr class="">7],xmm7[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm3[0],xmm6[1],xmm3[1<wbr class="">],xmm6[2],xmm3[2],xmm6[3],xmm3<wbr class="">[3],xmm6[4],xmm3[4],xmm6[5],<wbr class="">xmm3[5],xmm6[6],xmm3[6],xmm6[<wbr class="">7],xmm3[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm12[0],xmm5[1],xmm12<wbr class="">[1],xmm5[2],xmm12[2],xmm5[3],<wbr class="">xmm12[3],xmm5[4],xmm12[4],<wbr class="">xmm5[5],xmm12[5],xmm5[6],<wbr class="">xmm12[6],xmm5[7],xmm12[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm13[0],xmm4[1],xmm13<wbr class="">[1],xmm4[2],xmm13[2],xmm4[3],<wbr class="">xmm13[3],xmm4[4],xmm13[4],<wbr class="">xmm4[5],xmm13[5],xmm4[6],<wbr class="">xmm13[6],xmm4[7],xmm13[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm5[0],xmm4[1],xmm5[1<wbr class="">],xmm4[2],xmm5[2],xmm4[3],xmm5<wbr class="">[3],xmm4[4],xmm5[4],xmm4[5],<wbr class="">xmm5[5],xmm4[6],xmm5[6],xmm4[<wbr class="">7],xmm5[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm14[0],xmm1[1],xmm14<wbr class="">[1],xmm1[2],xmm14[2],xmm1[3],<wbr class="">xmm14[3],xmm1[4],xmm14[4],<wbr class="">xmm1[5],xmm14[5],xmm1[6],<wbr class="">xmm14[6],xmm1[7],xmm14[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3],xmm0[4],xmm2[4],xmm0[5],<wbr class="">xmm2[5],xmm0[6],xmm2[6],xmm0[<wbr class="">7],xmm2[7]<br class="">
; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3],xmm0[4],xmm1[4],xmm0[5],<wbr class="">xmm1[5],xmm0[6],xmm1[6],xmm0[<wbr class="">7],xmm1[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm4[0],xmm0[1],xmm4[1<wbr class="">],xmm0[2],xmm4[2],xmm0[3],xmm4<wbr class="">[3],xmm0[4],xmm4[4],xmm0[5],<wbr class="">xmm4[5],xmm0[6],xmm4[6],xmm0[<wbr class="">7],xmm4[7]<br class="">
+; SSE2-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm6[0],xmm0[1],xmm6[1<wbr class="">],xmm0[2],xmm6[2],xmm0[3],xmm6<wbr class="">[3],xmm0[4],xmm6[4],xmm0[5],<wbr class="">xmm6[5],xmm0[6],xmm6[6],xmm0[<wbr class="">7],xmm6[7]<br class="">
; SSE2-NEXT: retq<br class="">
;<br class="">
; SSSE3-LABEL: mem_shuffle_v16i8_v16i8_xxxxxx<wbr class="">xxxxxxxxxx_i8:<br class="">
; SSSE3: # BB#0:<br class="">
; SSSE3-NEXT: movzbl (%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
; SSSE3-NEXT: movaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
+; SSSE3-NEXT: movzbl 15(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
; SSSE3-NEXT: leaq -{{[0-9]+}}(%rsp), %rcx<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm0<br class="">
-; SSSE3-NEXT: movzbl 8(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm8<br class="">
-; SSSE3-NEXT: movzbl 12(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm9<br class="">
-; SSSE3-NEXT: movzbl 4(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm3<br class="">
-; SSSE3-NEXT: movzbl 14(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm10<br class="">
-; SSSE3-NEXT: movzbl 6(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm5<br class="">
-; SSSE3-NEXT: movzbl 10(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm11<br class="">
-; SSSE3-NEXT: movzbl 2(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm7<br class="">
-; SSSE3-NEXT: movzbl 15(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm12<br class="">
-; SSSE3-NEXT: movzbl 7(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm2<br class="">
-; SSSE3-NEXT: movzbl 11(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm13<br class="">
-; SSSE3-NEXT: movzbl 3(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm6<br class="">
-; SSSE3-NEXT: movzbl 13(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm14<br class="">
-; SSSE3-NEXT: movzbl 5(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm4<br class="">
-; SSSE3-NEXT: movzbl 9(%rdi), %eax<br class="">
-; SSSE3-NEXT: andl $15, %eax<br class="">
-; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm15<br class="">
-; SSSE3-NEXT: movzbl 1(%rdi), %eax<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm8<br class="">
+; SSSE3-NEXT: movzbl 7(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm15<br class="">
+; SSSE3-NEXT: movzbl 11(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm9<br class="">
+; SSSE3-NEXT: movzbl 3(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm3<br class="">
+; SSSE3-NEXT: movzbl 13(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm10<br class="">
+; SSSE3-NEXT: movzbl 5(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm7<br class="">
+; SSSE3-NEXT: movzbl 9(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm11<br class="">
+; SSSE3-NEXT: movzbl 1(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm6<br class="">
+; SSSE3-NEXT: movzbl 14(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm12<br class="">
+; SSSE3-NEXT: movzbl 6(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm5<br class="">
+; SSSE3-NEXT: movzbl 10(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm13<br class="">
+; SSSE3-NEXT: movzbl 2(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm4<br class="">
+; SSSE3-NEXT: movzbl 12(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm14<br class="">
+; SSSE3-NEXT: movzbl 4(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm1<br class="">
+; SSSE3-NEXT: movzbl 8(%rdi), %edx<br class="">
+; SSSE3-NEXT: andl $15, %edx<br class="">
+; SSSE3-NEXT: movzbl (%rdx,%rcx), %edx<br class="">
+; SSSE3-NEXT: movd %edx, %xmm2<br class="">
; SSSE3-NEXT: andl $15, %eax<br class="">
; SSSE3-NEXT: movzbl (%rax,%rcx), %eax<br class="">
-; SSSE3-NEXT: movd %eax, %xmm1<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm8[0],xmm0[1],xmm8[1<wbr class="">],xmm0[2],xmm8[2],xmm0[3],xmm8<wbr class="">[3],xmm0[4],xmm8[4],xmm0[5],<wbr class="">xmm8[5],xmm0[6],xmm8[6],xmm0[<wbr class="">7],xmm8[7]<br class="">
+; SSSE3-NEXT: movd %eax, %xmm0<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm15 = xmm15[0],xmm8[0],xmm15[1],xmm8<wbr class="">[1],xmm15[2],xmm8[2],xmm15[3],<wbr class="">xmm8[3],xmm15[4],xmm8[4],<wbr class="">xmm15[5],xmm8[5],xmm15[6],<wbr class="">xmm8[6],xmm15[7],xmm8[7]<br class="">
; SSSE3-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm9[0],xmm3[1],xmm9[1<wbr class="">],xmm3[2],xmm9[2],xmm3[3],xmm9<wbr class="">[3],xmm3[4],xmm9[4],xmm3[5],<wbr class="">xmm9[5],xmm3[6],xmm9[6],xmm3[<wbr class="">7],xmm9[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3],xmm0[4],xmm3[4],xmm0[5],<wbr class="">xmm3[5],xmm0[6],xmm3[6],xmm0[<wbr class="">7],xmm3[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm10[0],xmm5[1],xmm10<wbr class="">[1],xmm5[2],xmm10[2],xmm5[3],<wbr class="">xmm10[3],xmm5[4],xmm10[4],<wbr class="">xmm5[5],xmm10[5],xmm5[6],<wbr class="">xmm10[6],xmm5[7],xmm10[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm11[0],xmm7[1],xmm11<wbr class="">[1],xmm7[2],xmm11[2],xmm7[3],<wbr class="">xmm11[3],xmm7[4],xmm11[4],<wbr class="">xmm7[5],xmm11[5],xmm7[6],<wbr class="">xmm11[6],xmm7[7],xmm11[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm5[0],xmm7[1],xmm5[1<wbr class="">],xmm7[2],xmm5[2],xmm7[3],xmm5<wbr class="">[3],xmm7[4],xmm5[4],xmm7[5],<wbr class="">xmm5[5],xmm7[6],xmm5[6],xmm7[<wbr class="">7],xmm5[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm7[0],xmm0[1],xmm7[1<wbr class="">],xmm0[2],xmm7[2],xmm0[3],xmm7<wbr class="">[3],xmm0[4],xmm7[4],xmm0[5],<wbr class="">xmm7[5],xmm0[6],xmm7[6],xmm0[<wbr class="">7],xmm7[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm2 = xmm2[0],xmm12[0],xmm2[1],xmm12<wbr class="">[1],xmm2[2],xmm12[2],xmm2[3],<wbr class="">xmm12[3],xmm2[4],xmm12[4],<wbr class="">xmm2[5],xmm12[5],xmm2[6],<wbr class="">xmm12[6],xmm2[7],xmm12[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm13[0],xmm6[1],xmm13<wbr class="">[1],xmm6[2],xmm13[2],xmm6[3],<wbr class="">xmm13[3],xmm6[4],xmm13[4],<wbr class="">xmm6[5],xmm13[5],xmm6[6],<wbr class="">xmm13[6],xmm6[7],xmm13[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm2[0],xmm6[1],xmm2[1<wbr class="">],xmm6[2],xmm2[2],xmm6[3],xmm2<wbr class="">[3],xmm6[4],xmm2[4],xmm6[5],<wbr class="">xmm2[5],xmm6[6],xmm2[6],xmm6[<wbr class="">7],xmm2[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm14[0],xmm4[1],xmm14<wbr class="">[1],xmm4[2],xmm14[2],xmm4[3],<wbr class="">xmm14[3],xmm4[4],xmm14[4],<wbr class="">xmm4[5],xmm14[5],xmm4[6],<wbr class="">xmm14[6],xmm4[7],xmm14[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm15[0],xmm1[1],xmm15<wbr class="">[1],xmm1[2],xmm15[2],xmm1[3],<wbr class="">xmm15[3],xmm1[4],xmm15[4],<wbr class="">xmm1[5],xmm15[5],xmm1[6],<wbr class="">xmm15[6],xmm1[7],xmm15[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm4[0],xmm1[1],xmm4[1<wbr class="">],xmm1[2],xmm4[2],xmm1[3],xmm4<wbr class="">[3],xmm1[4],xmm4[4],xmm1[5],<wbr class="">xmm4[5],xmm1[6],xmm4[6],xmm1[<wbr class="">7],xmm4[7]<br class="">
-; SSSE3-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm6[0],xmm1[1],xmm6[1<wbr class="">],xmm1[2],xmm6[2],xmm1[3],xmm6<wbr class="">[3],xmm1[4],xmm6[4],xmm1[5],<wbr class="">xmm6[5],xmm1[6],xmm6[6],xmm1[<wbr class="">7],xmm6[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm3 = xmm3[0],xmm15[0],xmm3[1],xmm15<wbr class="">[1],xmm3[2],xmm15[2],xmm3[3],<wbr class="">xmm15[3],xmm3[4],xmm15[4],<wbr class="">xmm3[5],xmm15[5],xmm3[6],<wbr class="">xmm15[6],xmm3[7],xmm15[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm7 = xmm7[0],xmm10[0],xmm7[1],xmm10<wbr class="">[1],xmm7[2],xmm10[2],xmm7[3],<wbr class="">xmm10[3],xmm7[4],xmm10[4],<wbr class="">xmm7[5],xmm10[5],xmm7[6],<wbr class="">xmm10[6],xmm7[7],xmm10[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm11[0],xmm6[1],xmm11<wbr class="">[1],xmm6[2],xmm11[2],xmm6[3],<wbr class="">xmm11[3],xmm6[4],xmm11[4],<wbr class="">xmm6[5],xmm11[5],xmm6[6],<wbr class="">xmm11[6],xmm6[7],xmm11[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm7[0],xmm6[1],xmm7[1<wbr class="">],xmm6[2],xmm7[2],xmm6[3],xmm7<wbr class="">[3],xmm6[4],xmm7[4],xmm6[5],<wbr class="">xmm7[5],xmm6[6],xmm7[6],xmm6[<wbr class="">7],xmm7[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm6 = xmm6[0],xmm3[0],xmm6[1],xmm3[1<wbr class="">],xmm6[2],xmm3[2],xmm6[3],xmm3<wbr class="">[3],xmm6[4],xmm3[4],xmm6[5],<wbr class="">xmm3[5],xmm6[6],xmm3[6],xmm6[<wbr class="">7],xmm3[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm5 = xmm5[0],xmm12[0],xmm5[1],xmm12<wbr class="">[1],xmm5[2],xmm12[2],xmm5[3],<wbr class="">xmm12[3],xmm5[4],xmm12[4],<wbr class="">xmm5[5],xmm12[5],xmm5[6],<wbr class="">xmm12[6],xmm5[7],xmm12[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm13[0],xmm4[1],xmm13<wbr class="">[1],xmm4[2],xmm13[2],xmm4[3],<wbr class="">xmm13[3],xmm4[4],xmm13[4],<wbr class="">xmm4[5],xmm13[5],xmm4[6],<wbr class="">xmm13[6],xmm4[7],xmm13[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm4 = xmm4[0],xmm5[0],xmm4[1],xmm5[1<wbr class="">],xmm4[2],xmm5[2],xmm4[3],xmm5<wbr class="">[3],xmm4[4],xmm5[4],xmm4[5],<wbr class="">xmm5[5],xmm4[6],xmm5[6],xmm4[<wbr class="">7],xmm5[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm1 = xmm1[0],xmm14[0],xmm1[1],xmm14<wbr class="">[1],xmm1[2],xmm14[2],xmm1[3],<wbr class="">xmm14[3],xmm1[4],xmm14[4],<wbr class="">xmm1[5],xmm14[5],xmm1[6],<wbr class="">xmm14[6],xmm1[7],xmm14[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3],xmm0[4],xmm2[4],xmm0[5],<wbr class="">xmm2[5],xmm0[6],xmm2[6],xmm0[<wbr class="">7],xmm2[7]<br class="">
; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3],xmm0[4],xmm1[4],xmm0[5],<wbr class="">xmm1[5],xmm0[6],xmm1[6],xmm0[<wbr class="">7],xmm1[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm4[0],xmm0[1],xmm4[1<wbr class="">],xmm0[2],xmm4[2],xmm0[3],xmm4<wbr class="">[3],xmm0[4],xmm4[4],xmm0[5],<wbr class="">xmm4[5],xmm0[6],xmm4[6],xmm0[<wbr class="">7],xmm4[7]<br class="">
+; SSSE3-NEXT: punpcklbw {{.*#+}} xmm0 = xmm0[0],xmm6[0],xmm0[1],xmm6[1<wbr class="">],xmm0[2],xmm6[2],xmm0[3],xmm6<wbr class="">[3],xmm0[4],xmm6[4],xmm0[5],<wbr class="">xmm6[5],xmm0[6],xmm6[6],xmm0[<wbr class="">7],xmm6[7]<br class="">
; SSSE3-NEXT: retq<br class="">
;<br class="">
; SSE41-LABEL: mem_shuffle_v16i8_v16i8_xxxxxx<wbr class="">xxxxxxxxxx_i8:<br class="">
; SSE41: # BB#0:<br class="">
-; SSE41-NEXT: pushq %rbp<br class="">
-; SSE41-NEXT: pushq %r15<br class="">
-; SSE41-NEXT: pushq %r14<br class="">
-; SSE41-NEXT: pushq %r13<br class="">
-; SSE41-NEXT: pushq %r12<br class="">
-; SSE41-NEXT: pushq %rbx<br class="">
-; SSE41-NEXT: movzbl (%rdi), %r11d<br class="">
-; SSE41-NEXT: andl $15, %r11d<br class="">
+; SSE41-NEXT: movzbl (%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
; SSE41-NEXT: movaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; SSE41-NEXT: movzbl 1(%rdi), %r9d<br class="">
-; SSE41-NEXT: andl $15, %r9d<br class="">
+; SSE41-NEXT: leaq -{{[0-9]+}}(%rsp), %rcx<br class="">
+; SSE41-NEXT: movzbl (%rax,%rcx), %eax<br class="">
+; SSE41-NEXT: movd %eax, %xmm0<br class="">
+; SSE41-NEXT: movzbl 1(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $1, (%rax,%rcx), %xmm0<br class="">
; SSE41-NEXT: movzbl 2(%rdi), %eax<br class="">
; SSE41-NEXT: andl $15, %eax<br class="">
-; SSE41-NEXT: movq %rax, -{{[0-9]+}}(%rsp) # 8-byte Spill<br class="">
+; SSE41-NEXT: pinsrb $2, (%rax,%rcx), %xmm0<br class="">
; SSE41-NEXT: movzbl 3(%rdi), %eax<br class="">
; SSE41-NEXT: andl $15, %eax<br class="">
-; SSE41-NEXT: movq %rax, -{{[0-9]+}}(%rsp) # 8-byte Spill<br class="">
-; SSE41-NEXT: movzbl 4(%rdi), %r14d<br class="">
-; SSE41-NEXT: andl $15, %r14d<br class="">
-; SSE41-NEXT: movzbl 5(%rdi), %r15d<br class="">
-; SSE41-NEXT: andl $15, %r15d<br class="">
-; SSE41-NEXT: movzbl 6(%rdi), %r12d<br class="">
-; SSE41-NEXT: andl $15, %r12d<br class="">
-; SSE41-NEXT: movzbl 7(%rdi), %r13d<br class="">
-; SSE41-NEXT: andl $15, %r13d<br class="">
-; SSE41-NEXT: movzbl 8(%rdi), %r8d<br class="">
-; SSE41-NEXT: andl $15, %r8d<br class="">
+; SSE41-NEXT: pinsrb $3, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 4(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $4, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 5(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $5, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 6(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $6, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 7(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $7, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 8(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $8, (%rax,%rcx), %xmm0<br class="">
; SSE41-NEXT: movzbl 9(%rdi), %eax<br class="">
; SSE41-NEXT: andl $15, %eax<br class="">
-; SSE41-NEXT: movzbl 10(%rdi), %ecx<br class="">
-; SSE41-NEXT: andl $15, %ecx<br class="">
-; SSE41-NEXT: movzbl 11(%rdi), %edx<br class="">
-; SSE41-NEXT: andl $15, %edx<br class="">
-; SSE41-NEXT: movzbl 12(%rdi), %esi<br class="">
-; SSE41-NEXT: andl $15, %esi<br class="">
-; SSE41-NEXT: leaq -{{[0-9]+}}(%rsp), %rbp<br class="">
-; SSE41-NEXT: movzbl (%r11,%rbp), %ebx<br class="">
-; SSE41-NEXT: movd %ebx, %xmm0<br class="">
-; SSE41-NEXT: movzbl 13(%rdi), %r11d<br class="">
-; SSE41-NEXT: andl $15, %r11d<br class="">
-; SSE41-NEXT: pinsrb $1, (%r9,%rbp), %xmm0<br class="">
-; SSE41-NEXT: movzbl 14(%rdi), %ebx<br class="">
-; SSE41-NEXT: andl $15, %ebx<br class="">
-; SSE41-NEXT: movzbl 15(%rdi), %edi<br class="">
-; SSE41-NEXT: andl $15, %edi<br class="">
-; SSE41-NEXT: movzbl (%rdi,%rbp), %r10d<br class="">
-; SSE41-NEXT: movzbl (%rbx,%rbp), %r9d<br class="">
-; SSE41-NEXT: movzbl (%r11,%rbp), %r11d<br class="">
-; SSE41-NEXT: movzbl (%rsi,%rbp), %esi<br class="">
-; SSE41-NEXT: movzbl (%rdx,%rbp), %edx<br class="">
-; SSE41-NEXT: movzbl (%rcx,%rbp), %ecx<br class="">
-; SSE41-NEXT: movzbl (%rax,%rbp), %eax<br class="">
-; SSE41-NEXT: movzbl (%r8,%rbp), %r8d<br class="">
-; SSE41-NEXT: movzbl (%r13,%rbp), %r13d<br class="">
-; SSE41-NEXT: movzbl (%r12,%rbp), %r12d<br class="">
-; SSE41-NEXT: movzbl (%r15,%rbp), %r15d<br class="">
-; SSE41-NEXT: movzbl (%r14,%rbp), %r14d<br class="">
-; SSE41-NEXT: movq -{{[0-9]+}}(%rsp), %rdi # 8-byte Reload<br class="">
-; SSE41-NEXT: movzbl (%rdi,%rbp), %edi<br class="">
-; SSE41-NEXT: movq -{{[0-9]+}}(%rsp), %rbx # 8-byte Reload<br class="">
-; SSE41-NEXT: movzbl (%rbx,%rbp), %ebp<br class="">
-; SSE41-NEXT: pinsrb $2, %ebp, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $3, %edi, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $4, %r14d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $5, %r15d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $6, %r12d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $7, %r13d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $8, %r8d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $9, %eax, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $10, %ecx, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $11, %edx, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $12, %esi, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $13, %r11d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $14, %r9d, %xmm0<br class="">
-; SSE41-NEXT: pinsrb $15, %r10d, %xmm0<br class="">
-; SSE41-NEXT: popq %rbx<br class="">
-; SSE41-NEXT: popq %r12<br class="">
-; SSE41-NEXT: popq %r13<br class="">
-; SSE41-NEXT: popq %r14<br class="">
-; SSE41-NEXT: popq %r15<br class="">
-; SSE41-NEXT: popq %rbp<br class="">
+; SSE41-NEXT: pinsrb $9, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 10(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $10, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 11(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $11, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 12(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $12, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 13(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $13, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 14(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $14, (%rax,%rcx), %xmm0<br class="">
+; SSE41-NEXT: movzbl 15(%rdi), %eax<br class="">
+; SSE41-NEXT: andl $15, %eax<br class="">
+; SSE41-NEXT: pinsrb $15, (%rax,%rcx), %xmm0<br class="">
; SSE41-NEXT: retq<br class="">
;<br class="">
; AVX-LABEL: mem_shuffle_v16i8_v16i8_xxxxxx<wbr class="">xxxxxxxxxx_i8:<br class="">
; AVX: # BB#0:<br class="">
-; AVX-NEXT: pushq %rbp<br class="">
-; AVX-NEXT: pushq %r15<br class="">
-; AVX-NEXT: pushq %r14<br class="">
-; AVX-NEXT: pushq %r13<br class="">
-; AVX-NEXT: pushq %r12<br class="">
-; AVX-NEXT: pushq %rbx<br class="">
-; AVX-NEXT: movzbl (%rdi), %r11d<br class="">
-; AVX-NEXT: andl $15, %r11d<br class="">
+; AVX-NEXT: movzbl (%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
; AVX-NEXT: vmovaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
-; AVX-NEXT: movzbl 1(%rdi), %r9d<br class="">
-; AVX-NEXT: andl $15, %r9d<br class="">
+; AVX-NEXT: leaq -{{[0-9]+}}(%rsp), %rcx<br class="">
+; AVX-NEXT: movzbl (%rax,%rcx), %eax<br class="">
+; AVX-NEXT: vmovd %eax, %xmm0<br class="">
+; AVX-NEXT: movzbl 1(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $1, (%rax,%rcx), %xmm0, %xmm0<br class="">
; AVX-NEXT: movzbl 2(%rdi), %eax<br class="">
; AVX-NEXT: andl $15, %eax<br class="">
-; AVX-NEXT: movq %rax, -{{[0-9]+}}(%rsp) # 8-byte Spill<br class="">
+; AVX-NEXT: vpinsrb $2, (%rax,%rcx), %xmm0, %xmm0<br class="">
; AVX-NEXT: movzbl 3(%rdi), %eax<br class="">
; AVX-NEXT: andl $15, %eax<br class="">
-; AVX-NEXT: movq %rax, -{{[0-9]+}}(%rsp) # 8-byte Spill<br class="">
-; AVX-NEXT: movzbl 4(%rdi), %r14d<br class="">
-; AVX-NEXT: andl $15, %r14d<br class="">
-; AVX-NEXT: movzbl 5(%rdi), %r15d<br class="">
-; AVX-NEXT: andl $15, %r15d<br class="">
-; AVX-NEXT: movzbl 6(%rdi), %r12d<br class="">
-; AVX-NEXT: andl $15, %r12d<br class="">
-; AVX-NEXT: movzbl 7(%rdi), %r13d<br class="">
-; AVX-NEXT: andl $15, %r13d<br class="">
-; AVX-NEXT: movzbl 8(%rdi), %r8d<br class="">
-; AVX-NEXT: andl $15, %r8d<br class="">
+; AVX-NEXT: vpinsrb $3, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 4(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $4, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 5(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $5, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 6(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $6, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 7(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $7, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 8(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $8, (%rax,%rcx), %xmm0, %xmm0<br class="">
; AVX-NEXT: movzbl 9(%rdi), %eax<br class="">
; AVX-NEXT: andl $15, %eax<br class="">
-; AVX-NEXT: movzbl 10(%rdi), %ecx<br class="">
-; AVX-NEXT: andl $15, %ecx<br class="">
-; AVX-NEXT: movzbl 11(%rdi), %edx<br class="">
-; AVX-NEXT: andl $15, %edx<br class="">
-; AVX-NEXT: movzbl 12(%rdi), %esi<br class="">
-; AVX-NEXT: andl $15, %esi<br class="">
-; AVX-NEXT: leaq -{{[0-9]+}}(%rsp), %rbp<br class="">
-; AVX-NEXT: movzbl (%r11,%rbp), %ebx<br class="">
-; AVX-NEXT: vmovd %ebx, %xmm0<br class="">
-; AVX-NEXT: movzbl 13(%rdi), %r11d<br class="">
-; AVX-NEXT: andl $15, %r11d<br class="">
-; AVX-NEXT: vpinsrb $1, (%r9,%rbp), %xmm0, %xmm0<br class="">
-; AVX-NEXT: movzbl 14(%rdi), %ebx<br class="">
-; AVX-NEXT: andl $15, %ebx<br class="">
-; AVX-NEXT: movzbl 15(%rdi), %edi<br class="">
-; AVX-NEXT: andl $15, %edi<br class="">
-; AVX-NEXT: movzbl (%rdi,%rbp), %r10d<br class="">
-; AVX-NEXT: movzbl (%rbx,%rbp), %r9d<br class="">
-; AVX-NEXT: movzbl (%r11,%rbp), %r11d<br class="">
-; AVX-NEXT: movzbl (%rsi,%rbp), %esi<br class="">
-; AVX-NEXT: movzbl (%rdx,%rbp), %edx<br class="">
-; AVX-NEXT: movzbl (%rcx,%rbp), %ecx<br class="">
-; AVX-NEXT: movzbl (%rax,%rbp), %eax<br class="">
-; AVX-NEXT: movzbl (%r8,%rbp), %r8d<br class="">
-; AVX-NEXT: movzbl (%r13,%rbp), %r13d<br class="">
-; AVX-NEXT: movzbl (%r12,%rbp), %r12d<br class="">
-; AVX-NEXT: movzbl (%r15,%rbp), %r15d<br class="">
-; AVX-NEXT: movzbl (%r14,%rbp), %r14d<br class="">
-; AVX-NEXT: movq -{{[0-9]+}}(%rsp), %rdi # 8-byte Reload<br class="">
-; AVX-NEXT: movzbl (%rdi,%rbp), %edi<br class="">
-; AVX-NEXT: movq -{{[0-9]+}}(%rsp), %rbx # 8-byte Reload<br class="">
-; AVX-NEXT: movzbl (%rbx,%rbp), %ebp<br class="">
-; AVX-NEXT: vpinsrb $2, %ebp, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $3, %edi, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $4, %r14d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $5, %r15d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $6, %r12d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $7, %r13d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $8, %r8d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $9, %eax, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $10, %ecx, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $11, %edx, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $12, %esi, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $13, %r11d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $14, %r9d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: vpinsrb $15, %r10d, %xmm0, %xmm0<br class="">
-; AVX-NEXT: popq %rbx<br class="">
-; AVX-NEXT: popq %r12<br class="">
-; AVX-NEXT: popq %r13<br class="">
-; AVX-NEXT: popq %r14<br class="">
-; AVX-NEXT: popq %r15<br class="">
-; AVX-NEXT: popq %rbp<br class="">
+; AVX-NEXT: vpinsrb $9, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 10(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $10, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 11(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $11, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 12(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $12, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 13(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $13, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 14(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $14, (%rax,%rcx), %xmm0, %xmm0<br class="">
+; AVX-NEXT: movzbl 15(%rdi), %eax<br class="">
+; AVX-NEXT: andl $15, %eax<br class="">
+; AVX-NEXT: vpinsrb $15, (%rax,%rcx), %xmm0, %xmm0<br class="">
; AVX-NEXT: retq<br class="">
%p0 = getelementptr inbounds i8, i8* %i, i64 0<br class="">
%p1 = getelementptr inbounds i8, i8* %i, i64 1<br class="">
@@ -1331,26 +1227,26 @@ define <8 x i16> @var_shuffle_v8i16_v8i1<br class="">
; SSE2-NEXT: andl $7, %r8d<br class="">
; SSE2-NEXT: movdqa %xmm1, -{{[0-9]+}}(%rsp)<br class="">
; SSE2-NEXT: andl $7, %r9d<br class="">
-; SSE2-NEXT: movzwl -24(%rsp,%rsi,2), %eax<br class="">
-; SSE2-NEXT: movzwl -24(%rsp,%rcx,2), %ecx<br class="">
-; SSE2-NEXT: movd %ecx, %xmm0<br class="">
+; SSE2-NEXT: movzwl -24(%rsp,%rcx,2), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm0<br class="">
; SSE2-NEXT: pxor %xmm1, %xmm1<br class="">
; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3]<br class="">
-; SSE2-NEXT: movd %eax, %xmm2<br class="">
; SSE2-NEXT: movzwl -24(%rsp,%r9,2), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm2<br class="">
+; SSE2-NEXT: movzwl -24(%rsp,%rsi,2), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm3<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm3[0],xmm2[1],xmm3[1<wbr class="">],xmm2[2],xmm3[2],xmm2[3],xmm3<wbr class="">[3]<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3]<br class="">
-; SSE2-NEXT: movzwl -40(%rsp,%rdi,2), %eax<br class="">
-; SSE2-NEXT: movzwl -40(%rsp,%rdx,2), %ecx<br class="">
-; SSE2-NEXT: movd %ecx, %xmm3<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm3 = xmm3[0],xmm1[0],xmm3[1],xmm1[1<wbr class="">],xmm3[2],xmm1[2],xmm3[3],xmm1<wbr class="">[3]<br class="">
-; SSE2-NEXT: movd %eax, %xmm0<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm3 = xmm3[0],xmm2[0],xmm3[1],xmm2[1<wbr class="">],xmm3[2],xmm2[2],xmm3[3],xmm2<wbr class="">[3]<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm3 = xmm3[0],xmm0[0],xmm3[1],xmm0[1<wbr class="">],xmm3[2],xmm0[2],xmm3[3],xmm0<wbr class="">[3]<br class="">
+; SSE2-NEXT: movzwl -40(%rsp,%rdx,2), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm2<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3]<br class="">
; SSE2-NEXT: movzwl -40(%rsp,%r8,2), %eax<br class="">
; SSE2-NEXT: movd %eax, %xmm1<br class="">
+; SSE2-NEXT: movzwl -40(%rsp,%rdi,2), %eax<br class="">
+; SSE2-NEXT: movd %eax, %xmm0<br class="">
; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3]<br class="">
-; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3]<br class="">
; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3]<br class="">
+; SSE2-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3]<br class="">
; SSE2-NEXT: retq<br class="">
;<br class="">
; SSSE3-LABEL: var_shuffle_v8i16_v8i16_xyxyxy<wbr class="">00_i16:<br class="">
@@ -1369,26 +1265,26 @@ define <8 x i16> @var_shuffle_v8i16_v8i1<br class="">
; SSSE3-NEXT: andl $7, %r8d<br class="">
; SSSE3-NEXT: movdqa %xmm1, -{{[0-9]+}}(%rsp)<br class="">
; SSSE3-NEXT: andl $7, %r9d<br class="">
-; SSSE3-NEXT: movzwl -24(%rsp,%rsi,2), %eax<br class="">
-; SSSE3-NEXT: movzwl -24(%rsp,%rcx,2), %ecx<br class="">
-; SSSE3-NEXT: movd %ecx, %xmm0<br class="">
+; SSSE3-NEXT: movzwl -24(%rsp,%rcx,2), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm0<br class="">
; SSSE3-NEXT: pxor %xmm1, %xmm1<br class="">
; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3]<br class="">
-; SSSE3-NEXT: movd %eax, %xmm2<br class="">
; SSSE3-NEXT: movzwl -24(%rsp,%r9,2), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm2<br class="">
+; SSSE3-NEXT: movzwl -24(%rsp,%rsi,2), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm3<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm3[0],xmm2[1],xmm3[1<wbr class="">],xmm2[2],xmm3[2],xmm2[3],xmm3<wbr class="">[3]<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm0[0],xmm2[1],xmm0[1<wbr class="">],xmm2[2],xmm0[2],xmm2[3],xmm0<wbr class="">[3]<br class="">
-; SSSE3-NEXT: movzwl -40(%rsp,%rdi,2), %eax<br class="">
-; SSSE3-NEXT: movzwl -40(%rsp,%rdx,2), %ecx<br class="">
-; SSSE3-NEXT: movd %ecx, %xmm3<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm3 = xmm3[0],xmm1[0],xmm3[1],xmm1[1<wbr class="">],xmm3[2],xmm1[2],xmm3[3],xmm1<wbr class="">[3]<br class="">
-; SSSE3-NEXT: movd %eax, %xmm0<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm3 = xmm3[0],xmm2[0],xmm3[1],xmm2[1<wbr class="">],xmm3[2],xmm2[2],xmm3[3],xmm2<wbr class="">[3]<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm3 = xmm3[0],xmm0[0],xmm3[1],xmm0[1<wbr class="">],xmm3[2],xmm0[2],xmm3[3],xmm0<wbr class="">[3]<br class="">
+; SSSE3-NEXT: movzwl -40(%rsp,%rdx,2), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm2<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm2 = xmm2[0],xmm1[0],xmm2[1],xmm1[1<wbr class="">],xmm2[2],xmm1[2],xmm2[3],xmm1<wbr class="">[3]<br class="">
; SSSE3-NEXT: movzwl -40(%rsp,%r8,2), %eax<br class="">
; SSSE3-NEXT: movd %eax, %xmm1<br class="">
+; SSSE3-NEXT: movzwl -40(%rsp,%rdi,2), %eax<br class="">
+; SSSE3-NEXT: movd %eax, %xmm0<br class="">
; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm1[0],xmm0[1],xmm1[1<wbr class="">],xmm0[2],xmm1[2],xmm0[3],xmm1<wbr class="">[3]<br class="">
-; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3]<br class="">
; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm2[0],xmm0[1],xmm2[1<wbr class="">],xmm0[2],xmm2[2],xmm0[3],xmm2<wbr class="">[3]<br class="">
+; SSSE3-NEXT: punpcklwd {{.*#+}} xmm0 = xmm0[0],xmm3[0],xmm0[1],xmm3[1<wbr class="">],xmm0[2],xmm3[2],xmm0[3],xmm3<wbr class="">[3]<br class="">
; SSSE3-NEXT: retq<br class="">
;<br class="">
; SSE41-LABEL: var_shuffle_v8i16_v8i16_xyxyxy<wbr class="">00_i16:<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-shuffle-variable-256.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/vector-shuffle-variable-256.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/vector-shuffle-variable-<wbr class="">256.ll?rev=297695&r1=297694&<wbr class="">r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-shuffle-variable-256.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctor-shuffle-variable-256.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -1,4 +1,5 @@<br class="">
; NOTE: Assertions have been autogenerated by utils/update_llc_test_checks.p<wbr class="">y<br class="">
+; NOTE: Assertions have been autogenerated by update_llc_test_checks.py<br class="">
; RUN: llc < %s -mtriple=x86_64-unknown-unknow<wbr class="">n -mcpu=x86-64 -mattr=+avx | FileCheck %s --check-prefix=ALL --check-prefix=AVX --check-prefix=AVX1<br class="">
; RUN: llc < %s -mtriple=x86_64-unknown-unknow<wbr class="">n -mcpu=x86-64 -mattr=+avx2 | FileCheck %s --check-prefix=ALL --check-prefix=AVX --check-prefix=AVX2<br class="">
<br class="">
@@ -13,16 +14,16 @@ define <4 x double> @var_shuffle_v4f64_v<br class="">
; ALL-NEXT: movq %rsp, %rbp<br class="">
; ALL-NEXT: andq $-32, %rsp<br class="">
; ALL-NEXT: subq $64, %rsp<br class="">
-; ALL-NEXT: andl $3, %ecx<br class="">
-; ALL-NEXT: andl $3, %edx<br class="">
; ALL-NEXT: andl $3, %esi<br class="">
; ALL-NEXT: andl $3, %edi<br class="">
+; ALL-NEXT: andl $3, %ecx<br class="">
+; ALL-NEXT: andl $3, %edx<br class="">
; ALL-NEXT: vmovaps %ymm0, (%rsp)<br class="">
; ALL-NEXT: vmovsd {{.*#+}} xmm0 = mem[0],zero<br class="">
; ALL-NEXT: vmovhpd {{.*#+}} xmm0 = xmm0[0],mem[0]<br class="">
; ALL-NEXT: vmovsd {{.*#+}} xmm1 = mem[0],zero<br class="">
; ALL-NEXT: vmovhpd {{.*#+}} xmm1 = xmm1[0],mem[0]<br class="">
-; ALL-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; ALL-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; ALL-NEXT: movq %rbp, %rsp<br class="">
; ALL-NEXT: popq %rbp<br class="">
; ALL-NEXT: retq<br class="">
@@ -68,16 +69,16 @@ define <4 x double> @var_shuffle_v4f64_v<br class="">
define <4 x double> @var_shuffle_v4f64_v2f64_xxxx_<wbr class="">i64(<2 x double> %x, i64 %i0, i64 %i1, i64 %i2, i64 %i3) nounwind {<br class="">
; ALL-LABEL: var_shuffle_v4f64_v2f64_xxxx_i<wbr class="">64:<br class="">
; ALL: # BB#0:<br class="">
-; ALL-NEXT: andl $1, %ecx<br class="">
-; ALL-NEXT: andl $1, %edx<br class="">
; ALL-NEXT: andl $1, %esi<br class="">
; ALL-NEXT: andl $1, %edi<br class="">
+; ALL-NEXT: andl $1, %ecx<br class="">
+; ALL-NEXT: andl $1, %edx<br class="">
; ALL-NEXT: vmovaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; ALL-NEXT: vmovsd {{.*#+}} xmm0 = mem[0],zero<br class="">
; ALL-NEXT: vmovhpd {{.*#+}} xmm0 = xmm0[0],mem[0]<br class="">
; ALL-NEXT: vmovsd {{.*#+}} xmm1 = mem[0],zero<br class="">
; ALL-NEXT: vmovhpd {{.*#+}} xmm1 = xmm1[0],mem[0]<br class="">
-; ALL-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; ALL-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; ALL-NEXT: retq<br class="">
%x0 = extractelement <2 x double> %x, i64 %i0<br class="">
%x1 = extractelement <2 x double> %x, i64 %i1<br class="">
@@ -97,18 +98,18 @@ define <4 x i64> @var_shuffle_v4i64_v4i6<br class="">
; AVX1-NEXT: movq %rsp, %rbp<br class="">
; AVX1-NEXT: andq $-32, %rsp<br class="">
; AVX1-NEXT: subq $64, %rsp<br class="">
-; AVX1-NEXT: andl $3, %ecx<br class="">
-; AVX1-NEXT: andl $3, %edx<br class="">
-; AVX1-NEXT: andl $3, %esi<br class="">
; AVX1-NEXT: andl $3, %edi<br class="">
+; AVX1-NEXT: andl $3, %esi<br class="">
+; AVX1-NEXT: andl $3, %edx<br class="">
+; AVX1-NEXT: andl $3, %ecx<br class="">
; AVX1-NEXT: vmovaps %ymm0, (%rsp)<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
-; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm1[0]<br class="">
+; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
-; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm1[0],xmm2[0]<br class="">
-; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm2[0],xmm1[0]<br class="">
+; AVX1-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX1-NEXT: movq %rbp, %rsp<br class="">
; AVX1-NEXT: popq %rbp<br class="">
; AVX1-NEXT: retq<br class="">
@@ -119,18 +120,18 @@ define <4 x i64> @var_shuffle_v4i64_v4i6<br class="">
; AVX2-NEXT: movq %rsp, %rbp<br class="">
; AVX2-NEXT: andq $-32, %rsp<br class="">
; AVX2-NEXT: subq $64, %rsp<br class="">
-; AVX2-NEXT: andl $3, %ecx<br class="">
-; AVX2-NEXT: andl $3, %edx<br class="">
-; AVX2-NEXT: andl $3, %esi<br class="">
; AVX2-NEXT: andl $3, %edi<br class="">
+; AVX2-NEXT: andl $3, %esi<br class="">
+; AVX2-NEXT: andl $3, %edx<br class="">
+; AVX2-NEXT: andl $3, %ecx<br class="">
; AVX2-NEXT: vmovaps %ymm0, (%rsp)<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
-; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm1[0]<br class="">
+; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
-; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm1[0],xmm2[0]<br class="">
-; AVX2-NEXT: vinserti128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm2[0],xmm1[0]<br class="">
+; AVX2-NEXT: vinserti128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX2-NEXT: movq %rbp, %rsp<br class="">
; AVX2-NEXT: popq %rbp<br class="">
; AVX2-NEXT: retq<br class="">
@@ -152,12 +153,12 @@ define <4 x i64> @var_shuffle_v4i64_v4i6<br class="">
; AVX1-NEXT: movq %rsp, %rbp<br class="">
; AVX1-NEXT: andq $-32, %rsp<br class="">
; AVX1-NEXT: subq $64, %rsp<br class="">
-; AVX1-NEXT: andl $3, %esi<br class="">
; AVX1-NEXT: andl $3, %edi<br class="">
+; AVX1-NEXT: andl $3, %esi<br class="">
; AVX1-NEXT: vmovaps %ymm0, (%rsp)<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
-; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm1[0]<br class="">
+; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
; AVX1-NEXT: vpxor %xmm1, %xmm1, %xmm1<br class="">
; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0<br class="">
; AVX1-NEXT: movq %rbp, %rsp<br class="">
@@ -170,12 +171,12 @@ define <4 x i64> @var_shuffle_v4i64_v4i6<br class="">
; AVX2-NEXT: movq %rsp, %rbp<br class="">
; AVX2-NEXT: andq $-32, %rsp<br class="">
; AVX2-NEXT: subq $64, %rsp<br class="">
-; AVX2-NEXT: andl $3, %esi<br class="">
; AVX2-NEXT: andl $3, %edi<br class="">
+; AVX2-NEXT: andl $3, %esi<br class="">
; AVX2-NEXT: vmovaps %ymm0, (%rsp)<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
-; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm1[0]<br class="">
+; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
; AVX2-NEXT: vpxor %xmm1, %xmm1, %xmm1<br class="">
; AVX2-NEXT: vinserti128 $1, %xmm1, %ymm0, %ymm0<br class="">
; AVX2-NEXT: movq %rbp, %rsp<br class="">
@@ -195,34 +196,34 @@ define <4 x i64> @var_shuffle_v4i64_v4i6<br class="">
define <4 x i64> @var_shuffle_v4i64_v2i64_xxxx_<wbr class="">i64(<2 x i64> %x, i64 %i0, i64 %i1, i64 %i2, i64 %i3) nounwind {<br class="">
; AVX1-LABEL: var_shuffle_v4i64_v2i64_xxxx_i<wbr class="">64:<br class="">
; AVX1: # BB#0:<br class="">
-; AVX1-NEXT: andl $1, %ecx<br class="">
-; AVX1-NEXT: andl $1, %edx<br class="">
-; AVX1-NEXT: andl $1, %esi<br class="">
; AVX1-NEXT: andl $1, %edi<br class="">
+; AVX1-NEXT: andl $1, %esi<br class="">
+; AVX1-NEXT: andl $1, %edx<br class="">
+; AVX1-NEXT: andl $1, %ecx<br class="">
; AVX1-NEXT: vmovaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
-; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm1[0]<br class="">
+; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
-; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm1[0],xmm2[0]<br class="">
-; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm2[0],xmm1[0]<br class="">
+; AVX1-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX1-NEXT: retq<br class="">
;<br class="">
; AVX2-LABEL: var_shuffle_v4i64_v2i64_xxxx_i<wbr class="">64:<br class="">
; AVX2: # BB#0:<br class="">
-; AVX2-NEXT: andl $1, %ecx<br class="">
-; AVX2-NEXT: andl $1, %edx<br class="">
-; AVX2-NEXT: andl $1, %esi<br class="">
; AVX2-NEXT: andl $1, %edi<br class="">
+; AVX2-NEXT: andl $1, %esi<br class="">
+; AVX2-NEXT: andl $1, %edx<br class="">
+; AVX2-NEXT: andl $1, %ecx<br class="">
; AVX2-NEXT: vmovaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
-; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm1[0]<br class="">
+; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
-; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm1[0],xmm2[0]<br class="">
-; AVX2-NEXT: vinserti128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm2[0],xmm1[0]<br class="">
+; AVX2-NEXT: vinserti128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX2-NEXT: retq<br class="">
%x0 = extractelement <2 x i64> %x, i64 %i0<br class="">
%x1 = extractelement <2 x i64> %x, i64 %i1<br class="">
@@ -260,16 +261,14 @@ define <8 x float> @var_shuffle_v8f32_v8<br class="">
; ALL-NEXT: movl 24(%rbp), %eax<br class="">
; ALL-NEXT: andl $7, %eax<br class="">
; ALL-NEXT: vmovss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm0[0],mem[0],xmm0[2,3]<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm0[0,1],mem[0],xmm0[3]<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm0[0,1,2],mem[0]<br class="">
; ALL-NEXT: vmovss {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
-; ALL-NEXT: vmovss {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm2 = xmm2[0],mem[0],xmm2[2,3]<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm2 = xmm2[0,1],mem[0],xmm2[3]<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm2 = xmm2[0,1,2],mem[0]<br class="">
-; ALL-NEXT: vmovss {{.*#+}} xmm3 = mem[0],zero,zero,zero<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm3 = xmm3[0],mem[0],xmm3[2,3]<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm3[0,1],xmm0[0],xmm3[3]<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm0[0,1,2],xmm1[0]<br class="">
-; ALL-NEXT: vinsertf128 $1, %xmm0, %ymm2, %ymm0<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm1 = xmm1[0],mem[0],xmm1[2,3]<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm1 = xmm1[0,1],mem[0],xmm1[3]<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm1 = xmm1[0,1,2],mem[0]<br class="">
+; ALL-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; ALL-NEXT: movq %rbp, %rsp<br class="">
; ALL-NEXT: popq %rbp<br class="">
; ALL-NEXT: retq<br class="">
@@ -313,16 +312,14 @@ define <8 x float> @var_shuffle_v8f32_v4<br class="">
; ALL-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; ALL-NEXT: andl $3, %eax<br class="">
; ALL-NEXT: vmovss {{.*#+}} xmm0 = mem[0],zero,zero,zero<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm0[0],mem[0],xmm0[2,3]<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm0[0,1],mem[0],xmm0[3]<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm0[0,1,2],mem[0]<br class="">
; ALL-NEXT: vmovss {{.*#+}} xmm1 = mem[0],zero,zero,zero<br class="">
-; ALL-NEXT: vmovss {{.*#+}} xmm2 = mem[0],zero,zero,zero<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm2 = xmm2[0],mem[0],xmm2[2,3]<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm2 = xmm2[0,1],mem[0],xmm2[3]<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm2 = xmm2[0,1,2],mem[0]<br class="">
-; ALL-NEXT: vmovss {{.*#+}} xmm3 = mem[0],zero,zero,zero<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm3 = xmm3[0],mem[0],xmm3[2,3]<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm3[0,1],xmm0[0],xmm3[3]<br class="">
-; ALL-NEXT: vinsertps {{.*#+}} xmm0 = xmm0[0,1,2],xmm1[0]<br class="">
-; ALL-NEXT: vinsertf128 $1, %xmm0, %ymm2, %ymm0<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm1 = xmm1[0],mem[0],xmm1[2,3]<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm1 = xmm1[0,1],mem[0],xmm1[3]<br class="">
+; ALL-NEXT: vinsertps {{.*#+}} xmm1 = xmm1[0,1,2],mem[0]<br class="">
+; ALL-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; ALL-NEXT: retq<br class="">
%x0 = extractelement <4 x float> %x, i32 %i0<br class="">
%x1 = extractelement <4 x float> %x, i32 %i1<br class="">
@@ -363,32 +360,25 @@ define <16 x i16> @var_shuffle_v16i16_v1<br class="">
; AVX1-NEXT: vmovd %eax, %xmm0<br class="">
; AVX1-NEXT: movl 40(%rbp), %eax<br class="">
; AVX1-NEXT: andl $15, %eax<br class="">
-; AVX1-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $1, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $1, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl 48(%rbp), %eax<br class="">
; AVX1-NEXT: andl $15, %eax<br class="">
-; AVX1-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $2, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $2, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl 56(%rbp), %eax<br class="">
; AVX1-NEXT: andl $15, %eax<br class="">
-; AVX1-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $3, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $3, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl 64(%rbp), %eax<br class="">
; AVX1-NEXT: andl $15, %eax<br class="">
-; AVX1-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $4, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $4, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl 72(%rbp), %eax<br class="">
; AVX1-NEXT: andl $15, %eax<br class="">
-; AVX1-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $5, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $5, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl 80(%rbp), %eax<br class="">
; AVX1-NEXT: andl $15, %eax<br class="">
-; AVX1-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $6, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $6, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl 88(%rbp), %eax<br class="">
; AVX1-NEXT: andl $15, %eax<br class="">
-; AVX1-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $7, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $7, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: andl $15, %edi<br class="">
; AVX1-NEXT: movzwl (%rsp,%rdi,2), %eax<br class="">
; AVX1-NEXT: vmovd %eax, %xmm1<br class="">
@@ -404,12 +394,10 @@ define <16 x i16> @var_shuffle_v16i16_v1<br class="">
; AVX1-NEXT: vpinsrw $5, (%rsp,%r9,2), %xmm1, %xmm1<br class="">
; AVX1-NEXT: movl 16(%rbp), %eax<br class="">
; AVX1-NEXT: andl $15, %eax<br class="">
-; AVX1-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $6, %eax, %xmm1, %xmm1<br class="">
+; AVX1-NEXT: vpinsrw $6, (%rsp,%rax,2), %xmm1, %xmm1<br class="">
; AVX1-NEXT: movl 24(%rbp), %eax<br class="">
; AVX1-NEXT: andl $15, %eax<br class="">
-; AVX1-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $7, %eax, %xmm1, %xmm1<br class="">
+; AVX1-NEXT: vpinsrw $7, (%rsp,%rax,2), %xmm1, %xmm1<br class="">
; AVX1-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX1-NEXT: movq %rbp, %rsp<br class="">
; AVX1-NEXT: popq %rbp<br class="">
@@ -434,32 +422,25 @@ define <16 x i16> @var_shuffle_v16i16_v1<br class="">
; AVX2-NEXT: vmovd %eax, %xmm0<br class="">
; AVX2-NEXT: movl 40(%rbp), %eax<br class="">
; AVX2-NEXT: andl $15, %eax<br class="">
-; AVX2-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $1, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $1, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl 48(%rbp), %eax<br class="">
; AVX2-NEXT: andl $15, %eax<br class="">
-; AVX2-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $2, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $2, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl 56(%rbp), %eax<br class="">
; AVX2-NEXT: andl $15, %eax<br class="">
-; AVX2-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $3, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $3, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl 64(%rbp), %eax<br class="">
; AVX2-NEXT: andl $15, %eax<br class="">
-; AVX2-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $4, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $4, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl 72(%rbp), %eax<br class="">
; AVX2-NEXT: andl $15, %eax<br class="">
-; AVX2-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $5, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $5, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl 80(%rbp), %eax<br class="">
; AVX2-NEXT: andl $15, %eax<br class="">
-; AVX2-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $6, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $6, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl 88(%rbp), %eax<br class="">
; AVX2-NEXT: andl $15, %eax<br class="">
-; AVX2-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $7, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $7, (%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: andl $15, %edi<br class="">
; AVX2-NEXT: movzwl (%rsp,%rdi,2), %eax<br class="">
; AVX2-NEXT: vmovd %eax, %xmm1<br class="">
@@ -475,12 +456,10 @@ define <16 x i16> @var_shuffle_v16i16_v1<br class="">
; AVX2-NEXT: vpinsrw $5, (%rsp,%r9,2), %xmm1, %xmm1<br class="">
; AVX2-NEXT: movl 16(%rbp), %eax<br class="">
; AVX2-NEXT: andl $15, %eax<br class="">
-; AVX2-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $6, %eax, %xmm1, %xmm1<br class="">
+; AVX2-NEXT: vpinsrw $6, (%rsp,%rax,2), %xmm1, %xmm1<br class="">
; AVX2-NEXT: movl 24(%rbp), %eax<br class="">
; AVX2-NEXT: andl $15, %eax<br class="">
-; AVX2-NEXT: movzwl (%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $7, %eax, %xmm1, %xmm1<br class="">
+; AVX2-NEXT: vpinsrw $7, (%rsp,%rax,2), %xmm1, %xmm1<br class="">
; AVX2-NEXT: vinserti128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX2-NEXT: movq %rbp, %rsp<br class="">
; AVX2-NEXT: popq %rbp<br class="">
@@ -536,32 +515,25 @@ define <16 x i16> @var_shuffle_v16i16_v8<br class="">
; AVX1-NEXT: vmovd %eax, %xmm0<br class="">
; AVX1-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX1-NEXT: andl $7, %eax<br class="">
-; AVX1-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $1, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $1, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX1-NEXT: andl $7, %eax<br class="">
-; AVX1-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $2, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $2, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX1-NEXT: andl $7, %eax<br class="">
-; AVX1-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $3, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $3, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX1-NEXT: andl $7, %eax<br class="">
-; AVX1-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $4, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $4, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX1-NEXT: andl $7, %eax<br class="">
-; AVX1-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $5, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $5, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX1-NEXT: andl $7, %eax<br class="">
-; AVX1-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $6, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $6, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX1-NEXT: andl $7, %eax<br class="">
-; AVX1-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $7, %eax, %xmm0, %xmm0<br class="">
+; AVX1-NEXT: vpinsrw $7, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX1-NEXT: andl $7, %edi<br class="">
; AVX1-NEXT: movzwl -24(%rsp,%rdi,2), %eax<br class="">
; AVX1-NEXT: vmovd %eax, %xmm1<br class="">
@@ -577,12 +549,10 @@ define <16 x i16> @var_shuffle_v16i16_v8<br class="">
; AVX1-NEXT: vpinsrw $5, -24(%rsp,%r9,2), %xmm1, %xmm1<br class="">
; AVX1-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX1-NEXT: andl $7, %eax<br class="">
-; AVX1-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $6, %eax, %xmm1, %xmm1<br class="">
+; AVX1-NEXT: vpinsrw $6, -24(%rsp,%rax,2), %xmm1, %xmm1<br class="">
; AVX1-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX1-NEXT: andl $7, %eax<br class="">
-; AVX1-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX1-NEXT: vpinsrw $7, %eax, %xmm1, %xmm1<br class="">
+; AVX1-NEXT: vpinsrw $7, -24(%rsp,%rax,2), %xmm1, %xmm1<br class="">
; AVX1-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX1-NEXT: retq<br class="">
;<br class="">
@@ -601,32 +571,25 @@ define <16 x i16> @var_shuffle_v16i16_v8<br class="">
; AVX2-NEXT: vmovd %eax, %xmm0<br class="">
; AVX2-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX2-NEXT: andl $7, %eax<br class="">
-; AVX2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $1, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $1, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX2-NEXT: andl $7, %eax<br class="">
-; AVX2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $2, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $2, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX2-NEXT: andl $7, %eax<br class="">
-; AVX2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $3, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $3, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX2-NEXT: andl $7, %eax<br class="">
-; AVX2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $4, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $4, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX2-NEXT: andl $7, %eax<br class="">
-; AVX2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $5, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $5, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX2-NEXT: andl $7, %eax<br class="">
-; AVX2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $6, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $6, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX2-NEXT: andl $7, %eax<br class="">
-; AVX2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $7, %eax, %xmm0, %xmm0<br class="">
+; AVX2-NEXT: vpinsrw $7, -24(%rsp,%rax,2), %xmm0, %xmm0<br class="">
; AVX2-NEXT: andl $7, %edi<br class="">
; AVX2-NEXT: movzwl -24(%rsp,%rdi,2), %eax<br class="">
; AVX2-NEXT: vmovd %eax, %xmm1<br class="">
@@ -642,12 +605,10 @@ define <16 x i16> @var_shuffle_v16i16_v8<br class="">
; AVX2-NEXT: vpinsrw $5, -24(%rsp,%r9,2), %xmm1, %xmm1<br class="">
; AVX2-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX2-NEXT: andl $7, %eax<br class="">
-; AVX2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $6, %eax, %xmm1, %xmm1<br class="">
+; AVX2-NEXT: vpinsrw $6, -24(%rsp,%rax,2), %xmm1, %xmm1<br class="">
; AVX2-NEXT: movl {{[0-9]+}}(%rsp), %eax<br class="">
; AVX2-NEXT: andl $7, %eax<br class="">
-; AVX2-NEXT: movzwl -24(%rsp,%rax,2), %eax<br class="">
-; AVX2-NEXT: vpinsrw $7, %eax, %xmm1, %xmm1<br class="">
+; AVX2-NEXT: vpinsrw $7, -24(%rsp,%rax,2), %xmm1, %xmm1<br class="">
; AVX2-NEXT: vinserti128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX2-NEXT: retq<br class="">
%x0 = extractelement <8 x i16> %x, i32 %i0<br class="">
@@ -707,11 +668,11 @@ define <4 x i64> @mem_shuffle_v4i64_v4i6<br class="">
; AVX1-NEXT: vmovaps %ymm0, (%rsp)<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
+; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
+; AVX1-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm2[0],xmm1[0]<br class="">
-; AVX1-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
-; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm2[0]<br class="">
-; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; AVX1-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX1-NEXT: movq %rbp, %rsp<br class="">
; AVX1-NEXT: popq %rbp<br class="">
; AVX1-NEXT: retq<br class="">
@@ -733,11 +694,11 @@ define <4 x i64> @mem_shuffle_v4i64_v4i6<br class="">
; AVX2-NEXT: vmovaps %ymm0, (%rsp)<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
+; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
+; AVX2-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm2[0],xmm1[0]<br class="">
-; AVX2-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
-; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm2[0]<br class="">
-; AVX2-NEXT: vinserti128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; AVX2-NEXT: vinserti128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX2-NEXT: movq %rbp, %rsp<br class="">
; AVX2-NEXT: popq %rbp<br class="">
; AVX2-NEXT: retq<br class="">
@@ -774,11 +735,11 @@ define <4 x i64> @mem_shuffle_v4i64_v2i6<br class="">
; AVX1-NEXT: vmovaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
+; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
+; AVX1-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
; AVX1-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm2[0],xmm1[0]<br class="">
-; AVX1-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
-; AVX1-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm2[0]<br class="">
-; AVX1-NEXT: vinsertf128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; AVX1-NEXT: vinsertf128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX1-NEXT: retq<br class="">
;<br class="">
; AVX2-LABEL: mem_shuffle_v4i64_v2i64_xxxx_i<wbr class="">64:<br class="">
@@ -794,11 +755,11 @@ define <4 x i64> @mem_shuffle_v4i64_v2i6<br class="">
; AVX2-NEXT: vmovaps %xmm0, -{{[0-9]+}}(%rsp)<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm0 = mem[0],zero<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
+; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm1[0],xmm0[0]<br class="">
+; AVX2-NEXT: vmovq {{.*#+}} xmm1 = mem[0],zero<br class="">
; AVX2-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm1 = xmm2[0],xmm1[0]<br class="">
-; AVX2-NEXT: vmovq {{.*#+}} xmm2 = mem[0],zero<br class="">
-; AVX2-NEXT: vpunpcklqdq {{.*#+}} xmm0 = xmm0[0],xmm2[0]<br class="">
-; AVX2-NEXT: vinserti128 $1, %xmm1, %ymm0, %ymm0<br class="">
+; AVX2-NEXT: vinserti128 $1, %xmm0, %ymm1, %ymm0<br class="">
; AVX2-NEXT: retq<br class="">
%p0 = getelementptr inbounds i64, i64* %i, i32 0<br class="">
%p1 = getelementptr inbounds i64, i64* %i, i32 1<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctorcall.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/vectorcall.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/vectorcall.ll?rev=297695&<wbr class="">r1=297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctorcall.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/ve<wbr class="">ctorcall.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -103,7 +103,7 @@ entry:<br class="">
}<br class="">
; CHECK-LABEL: test_mixed_1<br class="">
; CHECK: movaps %xmm1, 16(%{{(e|r)}}sp)<br class="">
-; CHECK: movaps 16(%{{(e|r)}}sp), %xmm0<br class="">
+; CHECK: movaps %xmm1, %xmm0<br class="">
; CHECK: ret{{q|l}}<br class="">
<br class="">
define x86_vectorcallcc <4 x float> @test_mixed_2(%struct.HVA4 inreg %a, %struct.HVA4* %b, <4 x float> %c) {<br class="">
@@ -149,7 +149,7 @@ entry:<br class="">
}<br class="">
; CHECK-LABEL: test_mixed_5<br class="">
; CHECK: movaps %xmm5, 16(%{{(e|r)}}sp)<br class="">
-; CHECK: movaps 16(%{{(e|r)}}sp), %xmm0<br class="">
+; CHECK: movaps %xmm5, %xmm0<br class="">
; CHECK: ret{{[ql]}}<br class="">
<br class="">
define x86_vectorcallcc %struct.HVA4 @test_mixed_6(%struct.HVA4 inreg %a, %struct.HVA4* %b) {<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/X86/wi<wbr class="">n32-eh.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/X86/win32-eh.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">X86/win32-eh.ll?rev=297695&r1=<wbr class="">297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/X86/wi<wbr class="">n32-eh.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/X86/wi<wbr class="">n32-eh.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -27,23 +27,26 @@ catch:<br class="">
<br class="">
; CHECK-LABEL: _use_except_handler3:<br class="">
; CHECK: pushl %ebp<br class="">
-; CHECK: movl %esp, %ebp<br class="">
-; CHECK: pushl %ebx<br class="">
-; CHECK: pushl %edi<br class="">
-; CHECK: pushl %esi<br class="">
-; CHECK: subl ${{[0-9]+}}, %esp<br class="">
-; CHECK: movl $-1, -16(%ebp)<br class="">
-; CHECK: movl $L__ehtable$use_except_handler<wbr class="">3, -20(%ebp)<br class="">
-; CHECK: leal -28(%ebp), %[[node:[^ ,]*]]<br class="">
-; CHECK: movl $__except_handler3, -24(%ebp)<br class="">
-; CHECK: movl %fs:0, %[[next:[^ ,]*]]<br class="">
-; CHECK: movl %[[next]], -28(%ebp)<br class="">
-; CHECK: movl %[[node]], %fs:0<br class="">
-; CHECK: calll _may_throw_or_crash<br class="">
+; CHECK-NEXT: movl %esp, %ebp<br class="">
+; CHECK-NEXT: pushl %ebx<br class="">
+; CHECK-NEXT: pushl %edi<br class="">
+; CHECK-NEXT: pushl %esi<br class="">
+; CHECK-NEXT: subl ${{[0-9]+}}, %esp<br class="">
+; CHECK-NEXT: movl %esp, -36(%ebp)<br class="">
+; CHECK-NEXT: movl $-1, -16(%ebp)<br class="">
+; CHECK-NEXT: movl $L__ehtable$use_except_handler<wbr class="">3, -20(%ebp)<br class="">
+; CHECK-NEXT: leal -28(%ebp), %[[node:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl $__except_handler3, -24(%ebp)<br class="">
+; CHECK-NEXT: movl %fs:0, %[[next:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl %[[next]], -28(%ebp)<br class="">
+; CHECK-NEXT: movl %[[node]], %fs:0<br class="">
+; CHECK-NEXT: movl $0, -16(%ebp)<br class="">
+; CHECK-NEXT: calll _may_throw_or_crash<br class="">
+<br class="">
; CHECK: movl -28(%ebp), %[[next:[^ ,]*]]<br class="">
-; CHECK: movl %[[next]], %fs:0<br class="">
+; CHECK-NEXT: movl %[[next]], %fs:0<br class="">
; CHECK: retl<br class="">
-; CHECK: LBB1_2: # %catch{{$}}<br class="">
+; CHECK-NEXT: LBB1_2: # %catch{{$}}<br class="">
<br class="">
; CHECK: .section .xdata,"dr"<br class="">
; CHECK-LABEL: L__ehtable$use_except_handler3<wbr class="">:<br class="">
@@ -66,23 +69,37 @@ catch:<br class="">
<br class="">
; CHECK-LABEL: _use_except_handler4:<br class="">
; CHECK: pushl %ebp<br class="">
-; CHECK: movl %esp, %ebp<br class="">
-; CHECK: subl ${{[0-9]+}}, %esp<br class="">
-; CHECK: movl %esp, -36(%ebp)<br class="">
-; CHECK: movl $-2, -16(%ebp)<br class="">
-; CHECK: movl $L__ehtable$use_except_handler<wbr class="">4, %[[lsda:[^ ,]*]]<br class="">
-; CHECK: xorl ___security_cookie, %[[lsda]]<br class="">
-; CHECK: movl %[[lsda]], -20(%ebp)<br class="">
-; CHECK: leal -28(%ebp), %[[node:[^ ,]*]]<br class="">
-; CHECK: movl $__except_handler4, -24(%ebp)<br class="">
-; CHECK: movl %fs:0, %[[next:[^ ,]*]]<br class="">
-; CHECK: movl %[[next]], -28(%ebp)<br class="">
-; CHECK: movl %[[node]], %fs:0<br class="">
-; CHECK: calll _may_throw_or_crash<br class="">
+; CHECK-NEXT: movl %esp, %ebp<br class="">
+; CHECK-NEXT: pushl %ebx<br class="">
+; CHECK-NEXT: pushl %edi<br class="">
+; CHECK-NEXT: pushl %esi<br class="">
+; CHECK-NEXT: subl ${{[0-9]+}}, %esp<br class="">
+; CHECK-NEXT: movl %ebp, %eax<br class="">
+; CHECK-NEXT: movl %esp, -36(%ebp)<br class="">
+; CHECK-NEXT: movl $-2, -16(%ebp)<br class="">
+; CHECK-NEXT: movl $L__ehtable$use_except_handler<wbr class="">4, %[[lsda:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl ___security_cookie, %[[seccookie:[^ ,]*]]<br class="">
+; CHECK-NEXT: xorl %[[seccookie]], %[[lsda]]<br class="">
+; CHECK-NEXT: movl %[[lsda]], -20(%ebp)<br class="">
+; CHECK-NEXT: xorl %[[seccookie]], %[[tmp1:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl %[[tmp1]], -40(%ebp)<br class="">
+; CHECK-NEXT: leal -28(%ebp), %[[node:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl $__except_handler4, -24(%ebp)<br class="">
+; CHECK-NEXT: movl %fs:0, %[[next:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl %[[next]], -28(%ebp)<br class="">
+; CHECK-NEXT: movl %[[node]], %fs:0<br class="">
+; CHECK-NEXT: movl $0, -16(%ebp)<br class="">
+; CHECK-NEXT: calll _may_throw_or_crash<br class="">
+<br class="">
; CHECK: movl -28(%ebp), %[[next:[^ ,]*]]<br class="">
-; CHECK: movl %[[next]], %fs:0<br class="">
-; CHECK: retl<br class="">
-; CHECK: LBB2_2: # %catch{{$}}<br class="">
+; CHECK-NEXT: movl %[[next]], %fs:0<br class="">
+; CHECK-NEXT: addl $28, %esp<br class="">
+; CHECK-NEXT: popl %esi<br class="">
+; CHECK-NEXT: popl %edi<br class="">
+; CHECK-NEXT: popl %ebx<br class="">
+; CHECK-NEXT: popl %ebp<br class="">
+; CHECK-NEXT: retl<br class="">
+; CHECK-NEXT: LBB2_2: # %catch{{$}}<br class="">
<br class="">
; CHECK: .section .xdata,"dr"<br class="">
; CHECK-LABEL: L__ehtable$use_except_handler4<wbr class="">:<br class="">
@@ -109,26 +126,33 @@ catch:<br class="">
<br class="">
; CHECK-LABEL: _use_except_handler4_ssp:<br class="">
; CHECK: pushl %ebp<br class="">
-; CHECK: movl %esp, %ebp<br class="">
-; CHECK: subl ${{[0-9]+}}, %esp<br class="">
-; CHECK: movl %ebp, %[[ehguard:[^ ,]*]]<br class="">
-; CHECK: movl %esp, -36(%ebp)<br class="">
-; CHECK: movl $-2, -16(%ebp)<br class="">
-; CHECK: movl $L__ehtable$use_except_handler<wbr class="">4_ssp, %[[lsda:[^ ,]*]]<br class="">
-; CHECK: xorl ___security_cookie, %[[lsda]]<br class="">
-; CHECK: movl %[[lsda]], -20(%ebp)<br class="">
-; CHECK: xorl ___security_cookie, %[[ehguard]]<br class="">
-; CHECK: movl %[[ehguard]], -40(%ebp)<br class="">
-; CHECK: leal -28(%ebp), %[[node:[^ ,]*]]<br class="">
-; CHECK: movl $__except_handler4, -24(%ebp)<br class="">
-; CHECK: movl %fs:0, %[[next:[^ ,]*]]<br class="">
-; CHECK: movl %[[next]], -28(%ebp)<br class="">
-; CHECK: movl %[[node]], %fs:0<br class="">
-; CHECK: calll _may_throw_or_crash<br class="">
+; CHECK-NEXT: movl %esp, %ebp<br class="">
+; CHECK-NEXT: pushl %ebx<br class="">
+; CHECK-NEXT: pushl %edi<br class="">
+; CHECK-NEXT: pushl %esi<br class="">
+; CHECK-NEXT: subl ${{[0-9]+}}, %esp<br class="">
+; CHECK-NEXT: movl %ebp, %[[ehguard:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl %esp, -36(%ebp)<br class="">
+; CHECK-NEXT: movl $-2, -16(%ebp)<br class="">
+; CHECK-NEXT: movl $L__ehtable$use_except_handler<wbr class="">4_ssp, %[[lsda:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl ___security_cookie, %[[seccookie:[^ ,]*]]<br class="">
+; CHECK-NEXT: xorl %[[seccookie]], %[[lsda]]<br class="">
+; CHECK-NEXT: movl %[[lsda]], -20(%ebp)<br class="">
+; CHECK-NEXT: xorl %[[seccookie]], %[[ehguard]]<br class="">
+; CHECK-NEXT: movl %[[ehguard]], -40(%ebp)<br class="">
+; CHECK-NEXT: leal -28(%ebp), %[[node:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl $__except_handler4, -24(%ebp)<br class="">
+; CHECK-NEXT: movl %fs:0, %[[next:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl %[[next]], -28(%ebp)<br class="">
+; CHECK-NEXT: movl %[[node]], %fs:0<br class="">
+; CHECK-NEXT: movl $0, -16(%ebp)<br class="">
+; CHECK-NEXT: calll _may_throw_or_crash<br class="">
; CHECK: movl -28(%ebp), %[[next:[^ ,]*]]<br class="">
-; CHECK: movl %[[next]], %fs:0<br class="">
+; CHECK-NEXT: movl %[[next]], %fs:0<br class="">
; CHECK: retl<br class="">
-; CHECK: [[catch:[^ ,]*]]: # %catch{{$}}<br class="">
+; CHECK-NEXT: [[catch:[^ ,]*]]: # %catch{{$}}<br class="">
+<br class="">
+<br class="">
<br class="">
; CHECK: .section .xdata,"dr"<br class="">
; CHECK-LABEL: L__ehtable$use_except_handler4<wbr class="">_ssp:<br class="">
@@ -155,23 +179,26 @@ catch:<br class="">
<br class="">
; CHECK-LABEL: _use_CxxFrameHandler3:<br class="">
; CHECK: pushl %ebp<br class="">
-; CHECK: movl %esp, %ebp<br class="">
-; CHECK: subl ${{[0-9]+}}, %esp<br class="">
-; CHECK: movl %esp, -28(%ebp)<br class="">
-; CHECK: movl $-1, -16(%ebp)<br class="">
-; CHECK: leal -24(%ebp), %[[node:[^ ,]*]]<br class="">
-; CHECK: movl $___ehhandler$use_CxxFrameHand<wbr class="">ler3, -20(%ebp)<br class="">
-; CHECK: movl %fs:0, %[[next:[^ ,]*]]<br class="">
-; CHECK: movl %[[next]], -24(%ebp)<br class="">
-; CHECK: movl %[[node]], %fs:0<br class="">
-; CHECK: movl $0, -16(%ebp)<br class="">
-; CHECK: calll _may_throw_or_crash<br class="">
+; CHECK-NEXT: movl %esp, %ebp<br class="">
+; CHECK-NEXT: pushl %ebx<br class="">
+; CHECK-NEXT: pushl %edi<br class="">
+; CHECK-NEXT: pushl %esi<br class="">
+; CHECK-NEXT: subl ${{[0-9]+}}, %esp<br class="">
+; CHECK-NEXT: movl %esp, -28(%ebp)<br class="">
+; CHECK-NEXT: movl $-1, -16(%ebp)<br class="">
+; CHECK-NEXT: leal -24(%ebp), %[[node:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl $___ehhandler$use_CxxFrameHand<wbr class="">ler3, -20(%ebp)<br class="">
+; CHECK-NEXT: movl %fs:0, %[[next:[^ ,]*]]<br class="">
+; CHECK-NEXT: movl %[[next]], -24(%ebp)<br class="">
+; CHECK-NEXT: movl %[[node]], %fs:0<br class="">
+; CHECK-NEXT: movl $0, -16(%ebp)<br class="">
+; CHECK-NEXT: calll _may_throw_or_crash<br class="">
; CHECK: movl -24(%ebp), %[[next:[^ ,]*]]<br class="">
-; CHECK: movl %[[next]], %fs:0<br class="">
+; CHECK-NEXT: movl %[[next]], %fs:0<br class="">
; CHECK: retl<br class="">
<br class="">
; CHECK: .section .xdata,"dr"<br class="">
-; CHECK: .p2align 2<br class="">
+; CHECK-NEXT: .p2align 2<br class="">
; CHECK-LABEL: L__ehtable$use_CxxFrameHandler<wbr class="">3:<br class="">
; CHECK-NEXT: .long 429065506<br class="">
; CHECK-NEXT: .long 2<br class="">
@@ -185,8 +212,8 @@ catch:<br class="">
<br class="">
; CHECK-LABEL: ___ehhandler$use_CxxFrameHandl<wbr class="">er3:<br class="">
; CHECK: movl $L__ehtable$use_CxxFrameHandle<wbr class="">r3, %eax<br class="">
-; CHECK: jmp ___CxxFrameHandler3 # TAILCALL<br class="">
+; CHECK-NEXT: jmp ___CxxFrameHandler3 # TAILCALL<br class="">
<br class="">
; CHECK: .safeseh __except_handler3<br class="">
-; CHECK: .safeseh __except_handler4<br class="">
-; CHECK: .safeseh ___ehhandler$use_CxxFrameHandl<wbr class="">er3<br class="">
+; CHECK-NEXT: .safeseh __except_handler4<br class="">
+; CHECK-NEXT: .safeseh ___ehhandler$use_CxxFrameHandl<wbr class="">er3<br class="">
<br class="">
Modified: llvm/trunk/test/CodeGen/XCore/<wbr class="">varargs.ll<br class="">
URL: <a href="http://llvm.org/viewvc/llvm-project/llvm/trunk/test/CodeGen/XCore/varargs.ll?rev=297695&r1=297694&r2=297695&view=diff" rel="noreferrer" target="_blank" class="">http://llvm.org/viewvc/llvm-pr<wbr class="">oject/llvm/trunk/test/CodeGen/<wbr class="">XCore/varargs.ll?rev=297695&<wbr class="">r1=297694&r2=297695&view=diff</a><br class="">
==============================<wbr class="">==============================<wbr class="">==================<br class="">
--- llvm/trunk/test/CodeGen/XCore/<wbr class="">varargs.ll (original)<br class="">
+++ llvm/trunk/test/CodeGen/XCore/<wbr class="">varargs.ll Mon Mar 13 19:34:14 2017<br class="">
@@ -26,10 +26,10 @@ entry:<br class="">
; CHECK-LABEL: test_vararg<br class="">
; CHECK: extsp 6<br class="">
; CHECK: stw lr, sp[1]<br class="">
+; CHECK: stw r3, sp[6]<br class="">
; CHECK: stw r0, sp[3]<br class="">
; CHECK: stw r1, sp[4]<br class="">
; CHECK: stw r2, sp[5]<br class="">
-; CHECK: stw r3, sp[6]<br class="">
; CHECK: ldaw r0, sp[3]<br class="">
; CHECK: stw r0, sp[2]<br class="">
%list = alloca i8*, align 4<br class="">
<br class="">
<br class="">
______________________________<wbr class="">_________________<br class="">
llvm-commits mailing list<br class="">
<a href="mailto:llvm-commits@lists.llvm.org" target="_blank" class="">llvm-commits@lists.llvm.org</a><br class="">
<a href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-commits" rel="noreferrer" target="_blank" class="">http://lists.llvm.org/cgi-bin/<wbr class="">mailman/listinfo/llvm-commits</a><br class="">
</blockquote></div><br class=""></div>
</blockquote></div><br class=""></div></div>
_______________________________________________<br class="">llvm-commits mailing list<br class=""><a href="mailto:llvm-commits@lists.llvm.org" class="">llvm-commits@lists.llvm.org</a><br class="">http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-commits<br class=""></div></blockquote></div><br class=""></div></body></html>