llvm/lib/CodeGen
Peter Collingbourne 74eabdd998 Introduce llvm.load.relative intrinsic.
This intrinsic takes two arguments, ``%ptr`` and ``%offset``. It loads
a 32-bit value from the address ``%ptr + %offset``, adds ``%ptr`` to that
value and returns it. The constant folder specifically recognizes the form of
this intrinsic and the constant initializers it may load from; if a loaded
constant initializer is known to have the form ``i32 trunc(x - %ptr)``,
the intrinsic call is folded to ``x``.

LLVM provides that the calculation of such a constant initializer will
not overflow at link time under the medium code model if ``x`` is an
``unnamed_addr`` function. However, it does not provide this guarantee for
a constant initializer folded into a function body. This intrinsic can be
used to avoid the possibility of overflows when loading from such a constant.

Differential Revision: http://reviews.llvm.org/D18367

git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@267223 91177308-0d34-0410-b5e6-96231b3b80d8
2016-04-22 21:18:02 +00:00
..
AsmPrinter CodeGen: Use PLT relocations for relative references to unnamed_addr functions. 2016-04-22 20:40:10 +00:00
GlobalISel Fix -Wunused-variable in non-asserts build. 2016-04-22 09:50:31 +00:00
MIRParser [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
SelectionDAG DAGCombiner: Relax alignment restriction when changing store type 2016-04-22 21:01:41 +00:00
AggressiveAntiDepBreaker.cpp Fix Sub-register Rewriting in Aggressive Anti-Dependence Breaker 2016-04-01 02:05:29 +00:00
AggressiveAntiDepBreaker.h CodeGen: Use MachineInstr& in AntiDepBreaker API, NFC 2016-02-27 19:33:37 +00:00
AllocationOrder.cpp
AllocationOrder.h
Analysis.cpp One more batch of self-containing headers. 2016-01-27 19:29:56 +00:00
AntiDepBreaker.h CodeGen: Use MachineInstr& in AntiDepBreaker API, NFC 2016-02-27 19:33:37 +00:00
AtomicExpandPass.cpp NFC: unify clang / LLVM atomic ordering 2016-04-18 18:01:43 +00:00
BasicTargetTransformInfo.cpp
BranchFolding.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
BranchFolding.h
BuiltinGCs.cpp [GC] Consolidate all built in GCs into a single file [NFC] 2016-01-19 03:57:18 +00:00
CalcSpillWeights.cpp CodeGen: Update LiveIntervalAnalysis API to use MachineInstr&, NFC 2016-02-27 20:14:29 +00:00
CallingConvLower.cpp CodeGen: Factor out code for tail call result compatibility check; NFC 2016-03-30 22:46:04 +00:00
CMakeLists.txt Introduce llvm.load.relative intrinsic. 2016-04-22 21:18:02 +00:00
CodeGen.cpp Introduce llvm.load.relative intrinsic. 2016-04-22 21:18:02 +00:00
CodeGenPrepare.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
CriticalAntiDepBreaker.cpp CodeGen: Use MachineInstr& in AntiDepBreaker API, NFC 2016-02-27 19:33:37 +00:00
CriticalAntiDepBreaker.h [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
DeadMachineInstructionElim.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
DFAPacketizer.cpp Add DAG mutation interface to the DFA packetizer 2016-03-08 15:33:51 +00:00
DwarfEHPrepare.cpp Move EH-specific helper functions to a more appropriate place 2015-12-02 23:06:39 +00:00
EarlyIfConversion.cpp Reapply "CodeGen: Use references in MachineTraceMetrics::Trace, NFC" 2016-02-22 03:33:28 +00:00
EdgeBundles.cpp
ExecutionDepsFix.cpp Add MachineFunctionProperty checks for AllVRegsAllocated for target passes 2016-04-04 17:09:25 +00:00
ExpandISelPseudos.cpp
ExpandPostRAPseudos.cpp
FaultMaps.cpp
FuncletLayout.cpp Introduce MachineFunctionProperties and the AllVRegsAllocated property 2016-03-28 17:05:30 +00:00
GCMetadata.cpp
GCMetadataPrinter.cpp Revert 258157 2016-01-19 18:41:10 +00:00
GCRootLowering.cpp [opaque pointer types] Alloca: use getAllocatedType() instead of getType()->getPointerElementType(). 2016-01-18 00:10:01 +00:00
GCStrategy.cpp Revert 258157 2016-01-19 18:41:10 +00:00
GlobalMerge.cpp Make some headers self-contained, remove unused includes that violate layering. 2016-01-27 16:05:37 +00:00
IfConversion.cpp [ifcnv] Don't duplicate blocks that contain convergent instructions. 2016-04-15 01:38:41 +00:00
ImplicitNullChecks.cpp Introduce MachineFunctionProperties and the AllVRegsAllocated property 2016-03-28 17:05:30 +00:00
InlineSpiller.cpp Don't skip splitSeparateComponents in eliminateDeadDefs for HoistSpillHelper::hoistAllSpills. 2016-04-15 23:16:44 +00:00
InterferenceCache.cpp
InterferenceCache.h
InterleavedAccessPass.cpp
IntrinsicLowering.cpp getParent() ^ 3 == getModule() ; NFCI 2015-12-14 17:24:23 +00:00
LatencyPriorityQueue.cpp
LexicalScopes.cpp Fixed Dwarf debug info emission to skip DILexicalBlockFile entries. 2016-04-21 16:58:49 +00:00
LiveDebugValues.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
LiveDebugVariables.cpp CodeGen: Take MachineInstr& in SlotIndexes and LiveIntervals, NFC 2016-02-27 06:40:41 +00:00
LiveDebugVariables.h [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
LiveInterval.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
LiveIntervalAnalysis.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
LiveIntervalUnion.cpp
LivePhysRegs.cpp LivePhysRegs: Remove redundant check 2016-04-06 02:46:04 +00:00
LiveRangeCalc.cpp CodeGen: Take MachineInstr& in SlotIndexes and LiveIntervals, NFC 2016-02-27 06:40:41 +00:00
LiveRangeCalc.h
LiveRangeEdit.cpp Don't skip splitSeparateComponents in eliminateDeadDefs for HoistSpillHelper::hoistAllSpills. 2016-04-15 23:16:44 +00:00
LiveRegMatrix.cpp
LiveStackAnalysis.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
LiveVariables.cpp LiveVariables: Fix typo and shorten comment 2016-03-29 19:07:40 +00:00
LLVMBuild.txt Include ProfileData as CodeGen's required library. 2016-02-22 22:54:14 +00:00
LLVMTargetMachine.cpp Introduce llvm.load.relative intrinsic. 2016-04-22 21:18:02 +00:00
LocalStackSlotAllocation.cpp
LowerEmuTLS.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
MachineBasicBlock.cpp [MachineBasicBlock] Make the pass argument truly mandatory when 2016-04-21 21:01:13 +00:00
MachineBlockFrequencyInfo.cpp
MachineBlockPlacement.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
MachineBranchProbabilityInfo.cpp Use getEdgeProbability() instead of getEdgeWeight() in BFI and remove getEdgeWeight() interfaces from MBPI. 2015-12-18 21:53:24 +00:00
MachineCombiner.cpp Revert r267098 - [MachineCombiner] Support for floating-point FMA on ARM64 2016-04-22 09:37:26 +00:00
MachineCopyPropagation.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
MachineCSE.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
MachineDominanceFrontier.cpp
MachineDominators.cpp
MachineFunction.cpp Improve error message reporting for MachineFunctionProperties 2016-04-21 22:19:24 +00:00
MachineFunctionAnalysis.cpp
MachineFunctionPass.cpp Improve error message reporting for MachineFunctionProperties 2016-04-21 22:19:24 +00:00
MachineFunctionPrinterPass.cpp Recommit r256952 "Filtering IR printing for print-after-all/print-before-all" 2016-01-06 22:55:03 +00:00
MachineInstr.cpp AMDGPU/SI: add llvm.amdgcn.ps.live intrinsic 2016-04-22 04:04:08 +00:00
MachineInstrBundle.cpp MachineInstrBundle: Fix reversed isSuperRegisterEq() call 2016-01-05 00:45:35 +00:00
MachineLICM.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
MachineLoopInfo.cpp ADT: Remove == and != comparisons between ilist iterators and pointers 2016-02-21 20:39:50 +00:00
MachineModuleInfo.cpp Remove uses of builtin comma operator. 2016-02-18 22:09:30 +00:00
MachineModuleInfoImpls.cpp
MachinePassRegistry.cpp
MachinePostDominators.cpp
MachineRegionInfo.cpp Introduce DominanceFrontierAnalysis to the new PassManager to compute DominanceFrontier. NFC 2016-02-25 17:54:15 +00:00
MachineRegisterInfo.cpp Replace MachineRegisterInfo::TracksLiveness with a MachineFunctionProperty 2016-04-11 23:32:13 +00:00
MachineScheduler.cpp MachineScheduler: Move code to initialize a Candidate out of tryCandidate(); NFC 2016-04-22 19:10:15 +00:00
MachineSink.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
MachineSSAUpdater.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
MachineTraceMetrics.cpp Reapply "CodeGen: Use references in MachineTraceMetrics::Trace, NFC" 2016-02-22 03:33:28 +00:00
MachineVerifier.cpp [MachineVerifier] Teach how to check some of the properties of generic 2016-04-08 16:35:22 +00:00
MIRPrinter.cpp Sink DI metadata usage out of MachineInstr.h and MachineInstrBuilder.h 2016-04-14 18:29:59 +00:00
MIRPrinter.h
MIRPrintingPass.cpp
OptimizePHIs.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
ParallelCG.cpp [ParallelCG] SmallVector<char> -> SmallString. 2016-04-17 19:38:57 +00:00
Passes.cpp Introduce a "patchable-function" function attribute 2016-04-19 05:24:47 +00:00
PatchableFunction.cpp Add a description for the PatchableFunction pass; NFC 2016-04-19 06:25:02 +00:00
PeepholeOptimizer.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
PHIElimination.cpp [MachineBasicBlock] Make the pass argument truly mandatory when 2016-04-21 21:01:13 +00:00
PHIEliminationUtils.cpp
PHIEliminationUtils.h
PostRAHazardRecognizer.cpp PostRAHazardRecocgnizer: Fix unused-private-field warning 2016-04-22 15:11:08 +00:00
PostRASchedulerList.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
PreISelIntrinsicLowering.cpp Introduce llvm.load.relative intrinsic. 2016-04-22 21:18:02 +00:00
ProcessImplicitDefs.cpp Revert "CodeGen: MachineInstr::getIterator() => getInstrIterator(), NFC" 2016-02-22 20:49:58 +00:00
PrologEpilogInserter.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
PseudoSourceValue.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
README.txt
RegAllocBase.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
RegAllocBase.h Recommit r265547, and r265610,r265639,r265657 on top of it, plus 2016-04-13 03:08:27 +00:00
RegAllocBasic.cpp Recommit r265547, and r265610,r265639,r265657 on top of it, plus 2016-04-13 03:08:27 +00:00
RegAllocFast.cpp Remove some unneeded headers and replace some headers with forward class declarations (NFC) 2016-04-16 07:51:28 +00:00
RegAllocGreedy.cpp Recommit r265547, and r265610,r265639,r265657 on top of it, plus 2016-04-13 03:08:27 +00:00
RegAllocPBQP.cpp Recommit r265547, and r265610,r265639,r265657 on top of it, plus 2016-04-13 03:08:27 +00:00
RegisterClassInfo.cpp
RegisterCoalescer.cpp CodeGen: Don't iterate over operands after we've erased an MI 2016-03-25 20:03:28 +00:00
RegisterCoalescer.h
RegisterPressure.cpp RegisterPressure: Simplify liveness tracking when lanemasks are not checked. 2016-03-29 03:54:22 +00:00
RegisterScavenging.cpp RegisterScavenger: Take a reference as enterBasicBlock() argument. 2016-04-06 02:47:09 +00:00
SafeStack.cpp [safestack] Add canary to unsafe stack frames 2016-04-11 22:27:48 +00:00
ScheduleDAG.cpp MachineScheduler: Add regpressure information to debug dump 2015-11-06 20:59:02 +00:00
ScheduleDAGInstrs.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
ScheduleDAGPrinter.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
ScoreboardHazardRecognizer.cpp ScoreboardHazardRecognizer: unbreak TSAN by moving a static mutated variable to a member 2016-04-20 00:21:24 +00:00
ShadowStackGCLowering.cpp [GC] Consolidate all built in GCs into a single file [NFC] 2016-01-19 03:57:18 +00:00
ShrinkWrap.cpp [ShrinkWrapping] Give up on irreducible CFGs. 2016-01-07 01:23:49 +00:00
SjLjEHPrepare.cpp ADT: Remove == and != comparisons between ilist iterators and pointers 2016-02-21 20:39:50 +00:00
SlotIndexes.cpp CodeGen: Take MachineInstr& in SlotIndexes and LiveIntervals, NFC 2016-02-27 06:40:41 +00:00
Spiller.h Recommit r265547, and r265610,r265639,r265657 on top of it, plus 2016-04-13 03:08:27 +00:00
SpillPlacement.cpp Revert r263460: [SpillPlacement] Fix a quadratic behavior in spill placement. 2016-04-04 18:57:50 +00:00
SpillPlacement.h Revert r263460: [SpillPlacement] Fix a quadratic behavior in spill placement. 2016-04-04 18:57:50 +00:00
SplitKit.cpp Recommit r265547, and r265610,r265639,r265657 on top of it, plus 2016-04-13 03:08:27 +00:00
SplitKit.h Recommit r265547, and r265610,r265639,r265657 on top of it, plus 2016-04-13 03:08:27 +00:00
StackColoring.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
StackMapLivenessAnalysis.cpp Introduce MachineFunctionProperties and the AllVRegsAllocated property 2016-03-28 17:05:30 +00:00
StackMaps.cpp Fix a couple of redundant conditional expressions (PR27283, PR28282) 2016-04-11 20:35:01 +00:00
StackProtector.cpp [SSP, 2/2] Create llvm.stackguard() intrinsic and lower it to LOAD_STACK_GUARD 2016-04-19 19:40:37 +00:00
StackSlotColoring.cpp CodeGen: Update LiveIntervalAnalysis API to use MachineInstr&, NFC 2016-02-27 20:14:29 +00:00
TailDuplication.cpp Revert "Initial implementation of optimization bisect support." 2016-04-22 06:51:37 +00:00
TailDuplicator.cpp CodeGen: Fix a use-after-free in TailDuplication 2016-04-11 22:37:13 +00:00
TargetFrameLoweringImpl.cpp CXX_FAST_TLS calling convention: performance improvement for PPC64 2016-04-08 12:04:32 +00:00
TargetInstrInfo.cpp Revert r267098 - [MachineCombiner] Support for floating-point FMA on ARM64 2016-04-22 09:37:26 +00:00
TargetLoweringBase.cpp TLI: Only iterate over integer vector types 2016-04-22 21:16:17 +00:00
TargetLoweringObjectFileImpl.cpp CodeGen: Use PLT relocations for relative references to unnamed_addr functions. 2016-04-22 20:40:10 +00:00
TargetOptionsImpl.cpp
TargetRegisterInfo.cpp [TargetRegisterInfo] Re-apply r265734. 2016-04-08 00:51:00 +00:00
TargetSchedule.cpp CodeGen: TII: Take MachineInstr& in predicate API, NFC 2016-02-23 02:46:52 +00:00
TwoAddressInstructionPass.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
UnreachableBlockElim.cpp
VirtRegMap.cpp [NFC] Header cleanup 2016-04-18 09:17:29 +00:00
WinEHPrepare.cpp IR: RF_IgnoreMissingValues => RF_IgnoreMissingLocals, NFC 2016-04-07 00:26:43 +00:00

//===---------------------------------------------------------------------===//

Common register allocation / spilling problem:

        mul lr, r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        ldr r4, [sp, #+52]
        mla r4, r3, lr, r4

can be:

        mul lr, r4, lr
        mov r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

and then "merge" mul and mov:

        mul r4, r4, lr
        str r4, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

It also increase the likelihood the store may become dead.

//===---------------------------------------------------------------------===//

bb27 ...
        ...
        %reg1037 = ADDri %reg1039, 1
        %reg1038 = ADDrs %reg1032, %reg1039, %NOREG, 10
    Successors according to CFG: 0x8b03bf0 (#5)

bb76 (0x8b03bf0, LLVM BB @0x8b032d0, ID#5):
    Predecessors according to CFG: 0x8b0c5f0 (#3) 0x8b0a7c0 (#4)
        %reg1039 = PHI %reg1070, mbb<bb76.outer,0x8b0c5f0>, %reg1037, mbb<bb27,0x8b0a7c0>

Note ADDri is not a two-address instruction. However, its result %reg1037 is an
operand of the PHI node in bb76 and its operand %reg1039 is the result of the
PHI node. We should treat it as a two-address code and make sure the ADDri is
scheduled after any node that reads %reg1039.

//===---------------------------------------------------------------------===//

Use local info (i.e. register scavenger) to assign it a free register to allow
reuse:
        ldr r3, [sp, #+4]
        add r3, r3, #3
        ldr r2, [sp, #+8]
        add r2, r2, #2
        ldr r1, [sp, #+4]  <==
        add r1, r1, #1
        ldr r0, [sp, #+4]
        add r0, r0, #2

//===---------------------------------------------------------------------===//

LLVM aggressively lift CSE out of loop. Sometimes this can be negative side-
effects:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
load [i + R1]
...
load [i + R2]
...
load [i + R3]

Suppose there is high register pressure, R1, R2, R3, can be spilled. We need
to implement proper re-materialization to handle this:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
R1 = X + 4  @ re-materialized
load [i + R1]
...
R2 = X + 7 @ re-materialized
load [i + R2]
...
R3 = X + 15 @ re-materialized
load [i + R3]

Furthermore, with re-association, we can enable sharing:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
T = i + X
load [T + 4]
...
load [T + 7]
...
load [T + 15]
//===---------------------------------------------------------------------===//

It's not always a good idea to choose rematerialization over spilling. If all
the load / store instructions would be folded then spilling is cheaper because
it won't require new live intervals / registers. See 2003-05-31-LongShifts for
an example.

//===---------------------------------------------------------------------===//

With a copying garbage collector, derived pointers must not be retained across
collector safe points; the collector could move the objects and invalidate the
derived pointer. This is bad enough in the first place, but safe points can
crop up unpredictably. Consider:

        %array = load { i32, [0 x %obj] }** %array_addr
        %nth_el = getelementptr { i32, [0 x %obj] }* %array, i32 0, i32 %n
        %old = load %obj** %nth_el
        %z = div i64 %x, %y
        store %obj* %new, %obj** %nth_el

If the i64 division is lowered to a libcall, then a safe point will (must)
appear for the call site. If a collection occurs, %array and %nth_el no longer
point into the correct object.

The fix for this is to copy address calculations so that dependent pointers
are never live across safe point boundaries. But the loads cannot be copied
like this if there was an intervening store, so may be hard to get right.

Only a concurrent mutator can trigger a collection at the libcall safe point.
So single-threaded programs do not have this requirement, even with a copying
collector. Still, LLVM optimizations would probably undo a front-end's careful
work.

//===---------------------------------------------------------------------===//

The ocaml frametable structure supports liveness information. It would be good
to support it.

//===---------------------------------------------------------------------===//

The FIXME in ComputeCommonTailLength in BranchFolding.cpp needs to be
revisited. The check is there to work around a misuse of directives in inline
assembly.

//===---------------------------------------------------------------------===//

It would be good to detect collector/target compatibility instead of silently
doing the wrong thing.

//===---------------------------------------------------------------------===//

It would be really nice to be able to write patterns in .td files for copies,
which would eliminate a bunch of explicit predicates on them (e.g. no side 
effects).  Once this is in place, it would be even better to have tblgen 
synthesize the various copy insertion/inspection methods in TargetInstrInfo.

//===---------------------------------------------------------------------===//

Stack coloring improvements:

1. Do proper LiveStackAnalysis on all stack objects including those which are
   not spill slots.
2. Reorder objects to fill in gaps between objects.
   e.g. 4, 1, <gap>, 4, 1, 1, 1, <gap>, 4 => 4, 1, 1, 1, 1, 4, 4

//===---------------------------------------------------------------------===//

The scheduler should be able to sort nearby instructions by their address. For
example, in an expanded memset sequence it's not uncommon to see code like this:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

Each of the stores is independent, and the scheduler is currently making an
arbitrary decision about the order.

//===---------------------------------------------------------------------===//

Another opportunitiy in this code is that the $0 could be moved to a register:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

This would save substantial code size, especially for longer sequences like
this. It would be easy to have a rule telling isel to avoid matching MOV32mi
if the immediate has more than some fixed number of uses. It's more involved
to teach the register allocator how to do late folding to recover from
excessive register pressure.