llvm/lib/CodeGen
Sam Parker 6189e4972d [HardwareLoops] Loop counter guard intrinsic
Introduce llvm.test.set.loop.iterations which sets the loop counter
and also produces an i1 after testing that the count is not zero.

Differential Revision: https://reviews.llvm.org/D63809


git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@364628 91177308-0d34-0410-b5e6-96231b3b80d8
2019-06-28 07:38:16 +00:00
..
AsmPrinter [DWARF] Handle the DW_OP_entry_value operand 2019-06-27 13:52:34 +00:00
GlobalISel GlobalISel: Use Register 2019-06-28 01:47:44 +00:00
MIRParser [MachineFunction] Base support for call site info tracking 2019-06-27 07:48:06 +00:00
SelectionDAG [CodeGen] [SelectionDAG] More efficient code for X % C == 0 (UREM case) (try 3) 2019-06-27 21:52:10 +00:00
AggressiveAntiDepBreaker.cpp
AggressiveAntiDepBreaker.h
AllocationOrder.cpp
AllocationOrder.h
Analysis.cpp DAG: allow DAG pointer size different from memory representation. 2019-05-01 12:37:30 +00:00
AntiDepBreaker.h
AtomicExpandPass.cpp AtomicExpand: Don't crash on non-0 alloca 2019-06-11 01:35:07 +00:00
BasicTargetTransformInfo.cpp
BranchFolding.cpp [Codegen] Merge tail blocks with no successors after block placement 2019-06-13 18:11:32 +00:00
BranchFolding.h
BranchRelaxation.cpp Revert "Use const DebugLoc&" 2019-04-23 01:42:07 +00:00
BreakFalseDeps.cpp
BuiltinGCs.cpp
CalcSpillWeights.cpp
CallingConvLower.cpp
CFIInstrInserter.cpp
CMakeLists.txt Revert "r364412 [ExpandMemCmp][MergeICmps] Move passes out of CodeGen into opt pipeline." 2019-06-26 12:13:13 +00:00
CodeGen.cpp Revert "r364412 [ExpandMemCmp][MergeICmps] Move passes out of CodeGen into opt pipeline." 2019-06-26 12:13:13 +00:00
CodeGenPrepare.cpp [DAGCombiner] [CodeGenPrepare] More comprehensive GEP splitting 2019-06-17 10:54:12 +00:00
CriticalAntiDepBreaker.cpp
CriticalAntiDepBreaker.h
DeadMachineInstructionElim.cpp Revert LIS handling in MachineDCE 2019-04-09 16:13:53 +00:00
DetectDeadLanes.cpp
DFAPacketizer.cpp
DwarfEHPrepare.cpp Add an optional list of blocks to avoid when looking for a path in isPotentiallyReachable. 2019-04-02 01:05:48 +00:00
EarlyIfConversion.cpp
EdgeBundles.cpp
ExecutionDomainFix.cpp [ExecutionDomainFix] Optimize a binary search insertion 2019-04-20 13:00:50 +00:00
ExpandMemCmp.cpp Revert "r364412 [ExpandMemCmp][MergeICmps] Move passes out of CodeGen into opt pipeline." 2019-06-26 12:13:13 +00:00
ExpandPostRAPseudos.cpp
ExpandReductions.cpp Change semantics of fadd/fmul vector reductions. 2019-06-11 08:22:10 +00:00
FaultMaps.cpp
FEntryInserter.cpp
FinalizeISel.cpp Rename ExpandISelPseudo->FinalizeISel, delay register reservation 2019-06-19 00:25:39 +00:00
FuncletLayout.cpp
GCMetadata.cpp
GCMetadataPrinter.cpp
GCRootLowering.cpp
GCStrategy.cpp
GlobalMerge.cpp Use llvm::stable_sort 2019-04-23 14:51:27 +00:00
HardwareLoops.cpp [HardwareLoops] Loop counter guard intrinsic 2019-06-28 07:38:16 +00:00
IfConversion.cpp Use llvm::stable_sort 2019-04-23 14:51:27 +00:00
ImplicitNullChecks.cpp Allow target to handle STRICT floating-point nodes 2019-06-05 22:33:10 +00:00
IndirectBrExpandPass.cpp
InlineSpiller.cpp [Backend] Keep call site info valid through the backend 2019-06-27 13:10:29 +00:00
InterferenceCache.cpp
InterferenceCache.h
InterleavedAccessPass.cpp
InterleavedLoadCombinePass.cpp computePolynomialFromPointer - add missing early-out return for non-pointer types. 2019-04-29 19:25:16 +00:00
IntrinsicLowering.cpp
LatencyPriorityQueue.cpp
LazyMachineBlockFrequencyInfo.cpp
LexicalScopes.cpp
LiveDebugValues.cpp Revert "[LiveDebugValues] Emit the debug entry values" 2019-06-27 18:12:04 +00:00
LiveDebugVariables.cpp [DebugInfo] Incorrect debug info record generated for loop counter. 2019-06-06 21:19:39 +00:00
LiveDebugVariables.h
LiveInterval.cpp Use llvm::upper_bound. NFC 2019-04-12 11:31:16 +00:00
LiveIntervals.cpp Simplify std::lower_bound with llvm::{bsearch,lower_bound}. NFC 2019-06-21 05:40:31 +00:00
LiveIntervalUnion.cpp
LivePhysRegs.cpp
LiveRangeCalc.cpp
LiveRangeCalc.h
LiveRangeEdit.cpp [LiveRangeEdit] Fix build failure caused by the rL364536 2019-06-27 14:31:52 +00:00
LiveRangeShrink.cpp
LiveRangeUtils.h
LiveRegMatrix.cpp
LiveRegUnits.cpp
LiveStacks.cpp
LiveVariables.cpp
LLVMBuild.txt
LLVMTargetMachine.cpp [AIX] Implement function descriptor on SDAG 2019-06-06 19:13:36 +00:00
LocalStackSlotAllocation.cpp
LoopTraversal.cpp
LowerEmuTLS.cpp
LowLevelType.cpp
MachineBasicBlock.cpp
MachineBlockFrequencyInfo.cpp
MachineBlockPlacement.cpp [MBP] Move a latch block with conditional exit and multi predecessors to top of loop 2019-06-14 23:08:59 +00:00
MachineBranchProbabilityInfo.cpp
MachineCombiner.cpp [X86] Fix several places that weren't passing what they though they were to MachineInstr::print 2019-06-02 01:36:48 +00:00
MachineCopyPropagation.cpp
MachineCSE.cpp [MIR] Skip hoisting to basic block which may throw exception or return 2019-06-12 13:51:44 +00:00
MachineDominanceFrontier.cpp
MachineDominators.cpp
MachineFrameInfo.cpp Describe stack-id as an enum 2019-06-17 09:13:29 +00:00
MachineFunction.cpp [Backend] Keep call site info valid through the backend 2019-06-27 13:10:29 +00:00
MachineFunctionPass.cpp
MachineFunctionPrinterPass.cpp
MachineInstr.cpp Allow target to handle STRICT floating-point nodes 2019-06-05 22:33:10 +00:00
MachineInstrBundle.cpp
MachineLICM.cpp
MachineLoopInfo.cpp
MachineModuleInfo.cpp Qualify use of llvm::empty that's ambiguous with std::empty 2019-05-29 15:02:16 +00:00
MachineModuleInfoImpls.cpp
MachineOperand.cpp CodeGen: Introduce a class for registers 2019-06-24 15:50:29 +00:00
MachineOptimizationRemarkEmitter.cpp
MachineOutliner.cpp [Backend] Keep call site info valid through the backend 2019-06-27 13:10:29 +00:00
MachinePipeliner.cpp [MachinePipeliner] Fix risky iterator usage R++, --R 2019-06-25 21:50:56 +00:00
MachinePostDominators.cpp
MachineRegionInfo.cpp
MachineRegisterInfo.cpp [Peephole] Allow folding loads into instructions w/multiple uses (such as test64rr) 2019-06-25 17:29:18 +00:00
MachineScheduler.cpp [MachineScheduler] checkResourceLimit boundary condition update 2019-06-07 14:54:47 +00:00
MachineSink.cpp Use llvm::stable_sort 2019-04-23 14:51:27 +00:00
MachineSSAUpdater.cpp
MachineTraceMetrics.cpp
MachineVerifier.cpp [MachineFunction] Base support for call site info tracking 2019-06-27 07:48:06 +00:00
MacroFusion.cpp
MIRCanonicalizerPass.cpp [MIR-Canon] Fixing non-determinism that was breaking bots (NFC). 2019-06-11 00:00:25 +00:00
MIRPrinter.cpp [MachineFunction] Base support for call site info tracking 2019-06-27 07:48:06 +00:00
MIRPrintingPass.cpp
OptimizePHIs.cpp
ParallelCG.cpp
PatchableFunction.cpp
PeepholeOptimizer.cpp [Backend] Keep call site info valid through the backend 2019-06-27 13:10:29 +00:00
PHIElimination.cpp
PHIEliminationUtils.cpp
PHIEliminationUtils.h
PostRAHazardRecognizer.cpp
PostRASchedulerList.cpp
PreISelIntrinsicLowering.cpp
ProcessImplicitDefs.cpp
PrologEpilogInserter.cpp PEI: Add default handling of spills to registers 2019-06-26 20:56:15 +00:00
PseudoSourceValue.cpp
ReachingDefAnalysis.cpp
README.txt
RegAllocBase.cpp RegAlloc: try to fail more gracefully when out of registers 2019-05-15 17:29:58 +00:00
RegAllocBase.h
RegAllocBasic.cpp
RegAllocFast.cpp RegAllocFast: Set MayLiveAcrossBlocks when allocating uses 2019-05-27 20:37:31 +00:00
RegAllocGreedy.cpp CodeGen: Introduce a class for registers 2019-06-24 15:50:29 +00:00
RegAllocPBQP.cpp
RegisterClassInfo.cpp
RegisterCoalescer.cpp [DebugInfo] Avoid register coalesing unsoundly changing DBG_VALUE locations 2019-06-27 10:20:27 +00:00
RegisterCoalescer.h
RegisterPressure.cpp
RegisterScavenging.cpp
RegisterUsageInfo.cpp
RegUsageInfoCollector.cpp [RegUsageInfoCollector] Don't mark as saved registers that don't have subregister lanes 2019-05-28 23:43:12 +00:00
RegUsageInfoPropagate.cpp
RenameIndependentSubregs.cpp
ResetMachineFunctionPass.cpp
SafeStack.cpp PHINode: introduce setIncomingValueForBlock() function, and use it. 2019-06-17 14:38:56 +00:00
SafeStackColoring.cpp
SafeStackColoring.h
SafeStackLayout.cpp
SafeStackLayout.h
ScalarizeMaskedMemIntrin.cpp [X86] Add test cases for masked store and masked scatter with an all zeroes mask. Fix bug in ScalarizeMaskedMemIntrin 2019-06-02 22:52:34 +00:00
ScheduleDAG.cpp [ScheduleDAGRRList] Recompute topological ordering on demand. 2019-04-17 15:05:29 +00:00
ScheduleDAGInstrs.cpp Allow target to handle STRICT floating-point nodes 2019-06-05 22:33:10 +00:00
ScheduleDAGPrinter.cpp
ScoreboardHazardRecognizer.cpp
ShadowStackGCLowering.cpp
ShrinkWrap.cpp [FIX] Forces shrink wrapping to consider any memory access as aliasing with the stack 2019-06-13 13:56:19 +00:00
SjLjEHPrepare.cpp
SlotIndexes.cpp SlotIndexes: delete unused functions 2019-06-23 16:05:29 +00:00
Spiller.h
SpillPlacement.cpp
SpillPlacement.h
SplitKit.cpp
SplitKit.h
StackColoring.cpp Use llvm::stable_sort 2019-04-23 14:51:27 +00:00
StackMapLivenessAnalysis.cpp
StackMaps.cpp
StackProtector.cpp StackProtector: Use PointerMayBeCaptured 2019-06-12 14:23:33 +00:00
StackSlotColoring.cpp Use llvm::stable_sort 2019-04-23 14:51:27 +00:00
SwiftErrorValueTracking.cpp GlobalISel: Remove unsigned variant of SrcOp 2019-06-24 16:16:12 +00:00
SwitchLoweringUtils.cpp [GlobalISel][IRTranslator] Change switch table translation to generate jump tables and range checks. 2019-06-21 18:10:38 +00:00
TailDuplication.cpp
TailDuplicator.cpp TailDuplicator: Remove no-op analyzeBranch call 2019-06-07 13:33:34 +00:00
TargetFrameLoweringImpl.cpp
TargetInstrInfo.cpp [Backend] Keep call site info valid through the backend 2019-06-27 13:10:29 +00:00
TargetLoweringBase.cpp [TargetLowering] Add MachineMemOperand::Flags to allowsMemoryAccess tests (PR42123) 2019-06-12 17:14:03 +00:00
TargetLoweringObjectFileImpl.cpp [ELF] Implement Dependent Libraries Feature 2019-05-17 03:44:15 +00:00
TargetOptionsImpl.cpp
TargetPassConfig.cpp Revert "r364412 [ExpandMemCmp][MergeICmps] Move passes out of CodeGen into opt pipeline." 2019-06-26 12:13:13 +00:00
TargetRegisterInfo.cpp
TargetSchedule.cpp
TargetSubtargetInfo.cpp
TwoAddressInstructionPass.cpp
UnreachableBlockElim.cpp
ValueTypes.cpp
VirtRegMap.cpp RegAlloc: Fix verifier error with undef identity copies 2019-05-20 14:09:36 +00:00
WasmEHPrepare.cpp
WinEHPrepare.cpp
XRayInstrumentation.cpp [Backend] Keep call site info valid through the backend 2019-06-27 13:10:29 +00:00

//===---------------------------------------------------------------------===//

Common register allocation / spilling problem:

        mul lr, r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        ldr r4, [sp, #+52]
        mla r4, r3, lr, r4

can be:

        mul lr, r4, lr
        mov r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

and then "merge" mul and mov:

        mul r4, r4, lr
        str r4, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

It also increase the likelihood the store may become dead.

//===---------------------------------------------------------------------===//

bb27 ...
        ...
        %reg1037 = ADDri %reg1039, 1
        %reg1038 = ADDrs %reg1032, %reg1039, %noreg, 10
    Successors according to CFG: 0x8b03bf0 (#5)

bb76 (0x8b03bf0, LLVM BB @0x8b032d0, ID#5):
    Predecessors according to CFG: 0x8b0c5f0 (#3) 0x8b0a7c0 (#4)
        %reg1039 = PHI %reg1070, mbb<bb76.outer,0x8b0c5f0>, %reg1037, mbb<bb27,0x8b0a7c0>

Note ADDri is not a two-address instruction. However, its result %reg1037 is an
operand of the PHI node in bb76 and its operand %reg1039 is the result of the
PHI node. We should treat it as a two-address code and make sure the ADDri is
scheduled after any node that reads %reg1039.

//===---------------------------------------------------------------------===//

Use local info (i.e. register scavenger) to assign it a free register to allow
reuse:
        ldr r3, [sp, #+4]
        add r3, r3, #3
        ldr r2, [sp, #+8]
        add r2, r2, #2
        ldr r1, [sp, #+4]  <==
        add r1, r1, #1
        ldr r0, [sp, #+4]
        add r0, r0, #2

//===---------------------------------------------------------------------===//

LLVM aggressively lift CSE out of loop. Sometimes this can be negative side-
effects:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
load [i + R1]
...
load [i + R2]
...
load [i + R3]

Suppose there is high register pressure, R1, R2, R3, can be spilled. We need
to implement proper re-materialization to handle this:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
R1 = X + 4  @ re-materialized
load [i + R1]
...
R2 = X + 7 @ re-materialized
load [i + R2]
...
R3 = X + 15 @ re-materialized
load [i + R3]

Furthermore, with re-association, we can enable sharing:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
T = i + X
load [T + 4]
...
load [T + 7]
...
load [T + 15]
//===---------------------------------------------------------------------===//

It's not always a good idea to choose rematerialization over spilling. If all
the load / store instructions would be folded then spilling is cheaper because
it won't require new live intervals / registers. See 2003-05-31-LongShifts for
an example.

//===---------------------------------------------------------------------===//

With a copying garbage collector, derived pointers must not be retained across
collector safe points; the collector could move the objects and invalidate the
derived pointer. This is bad enough in the first place, but safe points can
crop up unpredictably. Consider:

        %array = load { i32, [0 x %obj] }** %array_addr
        %nth_el = getelementptr { i32, [0 x %obj] }* %array, i32 0, i32 %n
        %old = load %obj** %nth_el
        %z = div i64 %x, %y
        store %obj* %new, %obj** %nth_el

If the i64 division is lowered to a libcall, then a safe point will (must)
appear for the call site. If a collection occurs, %array and %nth_el no longer
point into the correct object.

The fix for this is to copy address calculations so that dependent pointers
are never live across safe point boundaries. But the loads cannot be copied
like this if there was an intervening store, so may be hard to get right.

Only a concurrent mutator can trigger a collection at the libcall safe point.
So single-threaded programs do not have this requirement, even with a copying
collector. Still, LLVM optimizations would probably undo a front-end's careful
work.

//===---------------------------------------------------------------------===//

The ocaml frametable structure supports liveness information. It would be good
to support it.

//===---------------------------------------------------------------------===//

The FIXME in ComputeCommonTailLength in BranchFolding.cpp needs to be
revisited. The check is there to work around a misuse of directives in inline
assembly.

//===---------------------------------------------------------------------===//

It would be good to detect collector/target compatibility instead of silently
doing the wrong thing.

//===---------------------------------------------------------------------===//

It would be really nice to be able to write patterns in .td files for copies,
which would eliminate a bunch of explicit predicates on them (e.g. no side
effects).  Once this is in place, it would be even better to have tblgen
synthesize the various copy insertion/inspection methods in TargetInstrInfo.

//===---------------------------------------------------------------------===//

Stack coloring improvements:

1. Do proper LiveStacks analysis on all stack objects including those which are
   not spill slots.
2. Reorder objects to fill in gaps between objects.
   e.g. 4, 1, <gap>, 4, 1, 1, 1, <gap>, 4 => 4, 1, 1, 1, 1, 4, 4

//===---------------------------------------------------------------------===//

The scheduler should be able to sort nearby instructions by their address. For
example, in an expanded memset sequence it's not uncommon to see code like this:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

Each of the stores is independent, and the scheduler is currently making an
arbitrary decision about the order.

//===---------------------------------------------------------------------===//

Another opportunitiy in this code is that the $0 could be moved to a register:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

This would save substantial code size, especially for longer sequences like
this. It would be easy to have a rule telling isel to avoid matching MOV32mi
if the immediate has more than some fixed number of uses. It's more involved
to teach the register allocator how to do late folding to recover from
excessive register pressure.