llvm/lib/CodeGen
Cong Hou 3808efa2e6 Remove the successor probabilities normalization in tail duplication pass.
The normalization may cause assertion failures on SystemZ and some out-of-tree
tests. The root cause is that unknown probabilities are materialized into known
ones by calling getSuccProbability(), which is then used to add another
successor to the same MBB which results in mixed known and unknown
probabilities. But currently those mixed probabilities cannot be normalized.

I will compose another patch to fix the root issue.




git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@255530 91177308-0d34-0410-b5e6-96231b3b80d8
2015-12-14 19:11:54 +00:00
..
AsmPrinter [IR] Reformulate LLVM's EH funclet IR 2015-12-12 05:38:55 +00:00
MIRParser Replace uint16_t with the MCPhysReg typedef in many places. A lot of physical register arrays already use this typedef. 2015-12-05 07:13:35 +00:00
SelectionDAG [IR] Remove terminatepad 2015-12-14 18:34:23 +00:00
AggressiveAntiDepBreaker.cpp [CodeGen]: Fix bad interaction with AntiDep breaking and inline asm. 2015-12-02 18:58:51 +00:00
AggressiveAntiDepBreaker.h
AllocationOrder.cpp
AllocationOrder.h
Analysis.cpp Remove assert(false) in favor of asserting the if conditional it is contained within. 2015-10-26 18:41:13 +00:00
AntiDepBreaker.h
AtomicExpandPass.cpp AArch64: use ldxp/stxp pair to implement 128-bit atomic loads. 2015-12-02 18:12:57 +00:00
BasicTargetTransformInfo.cpp constify the Function parameter to the TTI creation callback and 2015-09-16 23:38:13 +00:00
BranchFolding.cpp Revert "[BranchFolding] Merge MMOs during tail merge" 2015-12-04 04:15:05 +00:00
BranchFolding.h [WinEH] Permit branch folding in the face of funclets 2015-10-04 02:22:52 +00:00
CalcSpillWeights.cpp
CallingConvLower.cpp Arguments spilled on the stack before a function call may have 2015-09-29 10:12:57 +00:00
CMakeLists.txt Revert "Implement a new pass - LiveDebugValues - to compute the set of live DEBUG_VALUEs at each basic block and insert them. Reviewed and accepted at: http://reviews.llvm.org/D11933" 2015-12-09 08:17:42 +00:00
CodeGen.cpp Revert "Implement a new pass - LiveDebugValues - to compute the set of live DEBUG_VALUEs at each basic block and insert them. Reviewed and accepted at: http://reviews.llvm.org/D11933" 2015-12-09 08:17:42 +00:00
CodeGenPrepare.cpp getParent() ^ 3 == getModule() ; NFCI 2015-12-14 17:24:23 +00:00
CoreCLRGC.cpp
CriticalAntiDepBreaker.cpp MachineBasicBlock: Factor out common code into isReturnBlock() 2015-09-25 21:25:19 +00:00
CriticalAntiDepBreaker.h
DeadMachineInstructionElim.cpp
DFAPacketizer.cpp Avoid dependency between TableGen and CodeGen 2015-11-22 15:20:19 +00:00
DwarfEHPrepare.cpp Move EH-specific helper functions to a more appropriate place 2015-12-02 23:06:39 +00:00
EarlyIfConversion.cpp Normalize MBB's successors' probabilities in several locations. 2015-12-13 09:26:17 +00:00
EdgeBundles.cpp
ErlangGC.cpp
ExecutionDepsFix.cpp CodeGen: Start removing implicit conversions to/from list iterators, NFC 2015-10-09 16:54:49 +00:00
ExpandISelPseudos.cpp CodeGen: Remove a few more ilist iterator implicit conversions, NFC 2015-10-09 18:44:40 +00:00
ExpandPostRAPseudos.cpp
FaultMaps.cpp
FuncletLayout.cpp [WinEH] Update CATCHRET's operand to match its successor 2015-10-05 20:09:16 +00:00
GCMetadata.cpp
GCMetadataPrinter.cpp
GCRootLowering.cpp CodeGen: Remove a few more ilist iterator implicit conversions, NFC 2015-10-09 18:44:40 +00:00
GCStrategy.cpp
GlobalMerge.cpp CodeGen: Use range-based for in GlobalMerge, NFC 2015-10-09 18:57:47 +00:00
IfConversion.cpp Normalize MBB's successors' probabilities in several locations. 2015-12-13 09:26:17 +00:00
ImplicitNullChecks.cpp [ImplicitNulls] Add some clarifying comments; NFC 2015-11-13 08:14:00 +00:00
InlineSpiller.cpp CodeGen: Redo analyzePhysRegs() and computeRegisterLiveness() 2015-12-11 19:42:09 +00:00
InterferenceCache.cpp CodeGen: Remove more ilist iterator implicit conversions, NFC 2015-10-09 19:13:58 +00:00
InterferenceCache.h
InterleavedAccessPass.cpp
IntrinsicLowering.cpp getParent() ^ 3 == getModule() ; NFCI 2015-12-14 17:24:23 +00:00
LatencyPriorityQueue.cpp
LexicalScopes.cpp
LiveDebugVariables.cpp DI: Reverse direction of subprogram -> function edge. 2015-11-05 22:03:56 +00:00
LiveDebugVariables.h Erase unused FunctionDIs variables after r252219. 2015-11-07 10:21:25 +00:00
LiveInterval.cpp TargetRegisterInfo: Introduce PrintLaneMask. 2015-09-25 21:51:24 +00:00
LiveIntervalAnalysis.cpp MachineInstr: addRegisterDefReadUndef() => setRegisterDefReadUndef() 2015-11-11 00:41:58 +00:00
LiveIntervalUnion.cpp
LivePhysRegs.cpp LivePhysRegs: Fix live-outs of return blocks 2015-09-25 23:50:53 +00:00
LiveRangeCalc.cpp TargetRegisterInfo: Add typedef unsigned LaneBitmask and use it where apropriate; NFC 2015-09-25 21:51:14 +00:00
LiveRangeCalc.h TargetRegisterInfo: Add typedef unsigned LaneBitmask and use it where apropriate; NFC 2015-09-25 21:51:14 +00:00
LiveRangeEdit.cpp TargetRegisterInfo: Add typedef unsigned LaneBitmask and use it where apropriate; NFC 2015-09-25 21:51:14 +00:00
LiveRegMatrix.cpp TargetRegisterInfo: Introduce PrintLaneMask. 2015-09-25 21:51:24 +00:00
LiveStackAnalysis.cpp
LiveVariables.cpp LiveVariables should not clobber MachineOperand::IsDead, ::IsKill on reserved physical registers 2015-11-24 20:06:56 +00:00
LLVMBuild.txt
LLVMTargetMachine.cpp Have 'optnone' respect the -fast-isel=false option. 2015-11-30 21:56:16 +00:00
LocalStackSlotAllocation.cpp CodeGen: Remove more ilist iterator implicit conversions, NFC 2015-10-09 19:13:58 +00:00
MachineBasicBlock.cpp Fix a type issue in r255455. Should not use unsigned type as std::abs()'s template type. 2015-12-13 17:00:25 +00:00
MachineBlockFrequencyInfo.cpp CodeGen: Avoid ilist iterator implicit conversions in a few more places, NFC 2015-10-09 19:23:20 +00:00
MachineBlockPlacement.cpp Replace all weight-based interfaces in MBB with probability-based interfaces, and update all uses of old interfaces. 2015-12-01 05:29:22 +00:00
MachineBranchProbabilityInfo.cpp Replace all weight-based interfaces in MBB with probability-based interfaces, and update all uses of old interfaces. 2015-12-01 05:29:22 +00:00
MachineCombiner.cpp less indent; NFCI 2015-11-10 20:09:02 +00:00
MachineCopyPropagation.cpp
MachineCSE.cpp
MachineDominanceFrontier.cpp
MachineDominators.cpp
MachineFunction.cpp Move EH-specific helper functions to a more appropriate place 2015-12-02 23:06:39 +00:00
MachineFunctionAnalysis.cpp
MachineFunctionPass.cpp
MachineFunctionPrinterPass.cpp
MachineInstr.cpp Replace uint16_t with the MCPhysReg typedef in many places. A lot of physical register arrays already use this typedef. 2015-12-05 07:13:35 +00:00
MachineInstrBundle.cpp CodeGen: Redo analyzePhysRegs() and computeRegisterLiveness() 2015-12-11 19:42:09 +00:00
MachineLICM.cpp remove duplicated comments and don't repeat function names in comments; NFC 2015-12-10 16:34:21 +00:00
MachineLoopInfo.cpp CodeGen: Continue removing ilist iterator implicit conversions 2015-10-09 19:40:45 +00:00
MachineModuleInfo.cpp Move EH-specific helper functions to a more appropriate place 2015-12-02 23:06:39 +00:00
MachineModuleInfoImpls.cpp
MachinePassRegistry.cpp
MachinePostDominators.cpp
MachineRegionInfo.cpp
MachineRegisterInfo.cpp Scheduler / Regalloc: use unique_ptr[] instead of std::vector 2015-12-02 18:32:59 +00:00
MachineScheduler.cpp MachineScheduler: Print initial pressure in debug dump 2015-11-13 22:30:31 +00:00
MachineSink.cpp Refine the definition of convergent to only disallow the addition of new control dependencies. 2015-10-09 18:06:13 +00:00
MachineSSAUpdater.cpp
MachineTraceMetrics.cpp use range-based for loops; NFCI 2015-12-09 22:45:45 +00:00
MachineVerifier.cpp Move EH-specific helper functions to a more appropriate place 2015-12-02 23:06:39 +00:00
Makefile
MIRPrinter.cpp Replace all weight-based interfaces in MBB with probability-based interfaces, and update all uses of old interfaces. 2015-12-01 05:29:22 +00:00
MIRPrinter.h
MIRPrintingPass.cpp
module.modulemap
OcamlGC.cpp
OptimizePHIs.cpp
ParallelCG.cpp [LTO] Add option to emit assembly from LTOCodeGenerator 2015-11-19 23:59:24 +00:00
Passes.cpp [PostRA scheduling] Allow a target to do scheduling when it wants post RA. 2015-12-10 09:10:07 +00:00
PeepholeOptimizer.cpp PeepholeOptimizer: Ignore dead implicit defs 2015-12-10 00:37:51 +00:00
PHIElimination.cpp
PHIEliminationUtils.cpp
PHIEliminationUtils.h
PostRASchedulerList.cpp MachineScheduler: Add regpressure information to debug dump 2015-11-06 20:59:02 +00:00
ProcessImplicitDefs.cpp CodeGen: Avoid more ilist iterator implicit conversions, NFC 2015-10-09 21:08:19 +00:00
PrologEpilogInserter.cpp Support for emitting inline stack probes 2015-11-10 01:50:49 +00:00
PseudoSourceValue.cpp Refactor: Simplify boolean conditional return statements in lib/CodeGen. 2015-10-24 23:11:13 +00:00
README.txt
RegAllocBase.cpp
RegAllocBase.h
RegAllocBasic.cpp
RegAllocFast.cpp
RegAllocGreedy.cpp
RegAllocPBQP.cpp raw_ostream: << operator for callables with raw_ostream argument 2015-12-04 01:31:59 +00:00
RegisterClassInfo.cpp
RegisterCoalescer.cpp Assume lane masks are always precise 2015-11-17 00:50:55 +00:00
RegisterCoalescer.h
RegisterPressure.cpp RegisterPressure: Factor out liveness dead-def detection logic; NFCI 2015-12-10 01:04:15 +00:00
RegisterScavenging.cpp TargetRegisterInfo: Add typedef unsigned LaneBitmask and use it where apropriate; NFC 2015-09-25 21:51:14 +00:00
ScheduleDAG.cpp MachineScheduler: Add regpressure information to debug dump 2015-11-06 20:59:02 +00:00
ScheduleDAGInstrs.cpp ScheduleDAGInstrs: Move LiveIntervals field to ScheduleDAGMI 2015-12-04 19:54:24 +00:00
ScheduleDAGPrinter.cpp Make the SelectionDAG graph printer use SDNode::PersistentId labels. 2015-10-27 23:09:03 +00:00
ScoreboardHazardRecognizer.cpp
ShadowStackGC.cpp
ShadowStackGCLowering.cpp CodeGen: Avoid more ilist iterator implicit conversions, NFC 2015-10-09 21:08:19 +00:00
ShrinkWrap.cpp [ShrinkWrap] Teach ShrinkWrap to handle targets requiring a register scavenger. 2015-11-20 21:54:27 +00:00
SjLjEHPrepare.cpp CodeGen: Remove implicit ilist iterator conversions, NFC 2015-10-09 22:56:24 +00:00
SlotIndexes.cpp CodeGen: Continue removing ilist iterator implicit conversions 2015-10-09 19:40:45 +00:00
Spiller.h
SpillPlacement.cpp CodeGen: Remove implicit ilist iterator conversions, NFC 2015-10-09 22:56:24 +00:00
SpillPlacement.h
SplitKit.cpp CodeGen: Remove implicit ilist iterator conversions, NFC 2015-10-09 22:56:24 +00:00
SplitKit.h
StackColoring.cpp
StackMapLivenessAnalysis.cpp
StackMaps.cpp
StackProtector.cpp Refactor: Simplify boolean conditional return statements in lib/CodeGen. 2015-10-24 23:11:13 +00:00
StackSlotColoring.cpp
StatepointExampleGC.cpp
TailDuplication.cpp Remove the successor probabilities normalization in tail duplication pass. 2015-12-14 19:11:54 +00:00
TargetFrameLoweringImpl.cpp HHVM calling conventions. 2015-09-29 22:09:16 +00:00
TargetInstrInfo.cpp replace MachineCombinerPattern namespace and enum with enum class; NFCI 2015-11-05 19:34:57 +00:00
TargetLoweringBase.cpp [IR] Remove terminatepad 2015-12-14 18:34:23 +00:00
TargetLoweringObjectFileImpl.cpp Stop producing .data.rel sections. 2015-11-18 06:02:15 +00:00
TargetOptionsImpl.cpp
TargetRegisterInfo.cpp raw_ostream: << operator for callables with raw_ostream argument 2015-12-04 01:31:59 +00:00
TargetSchedule.cpp
TwoAddressInstructionPass.cpp use range-based for loops; NFCI 2015-12-01 19:57:43 +00:00
UnreachableBlockElim.cpp CodeGen: Remove implicit ilist iterator conversions, NFC 2015-10-09 22:56:24 +00:00
VirtRegMap.cpp Assume lane masks are always precise 2015-11-17 00:50:55 +00:00
WinEHPrepare.cpp [IR] Remove terminatepad 2015-12-14 18:34:23 +00:00

//===---------------------------------------------------------------------===//

Common register allocation / spilling problem:

        mul lr, r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        ldr r4, [sp, #+52]
        mla r4, r3, lr, r4

can be:

        mul lr, r4, lr
        mov r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

and then "merge" mul and mov:

        mul r4, r4, lr
        str r4, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

It also increase the likelihood the store may become dead.

//===---------------------------------------------------------------------===//

bb27 ...
        ...
        %reg1037 = ADDri %reg1039, 1
        %reg1038 = ADDrs %reg1032, %reg1039, %NOREG, 10
    Successors according to CFG: 0x8b03bf0 (#5)

bb76 (0x8b03bf0, LLVM BB @0x8b032d0, ID#5):
    Predecessors according to CFG: 0x8b0c5f0 (#3) 0x8b0a7c0 (#4)
        %reg1039 = PHI %reg1070, mbb<bb76.outer,0x8b0c5f0>, %reg1037, mbb<bb27,0x8b0a7c0>

Note ADDri is not a two-address instruction. However, its result %reg1037 is an
operand of the PHI node in bb76 and its operand %reg1039 is the result of the
PHI node. We should treat it as a two-address code and make sure the ADDri is
scheduled after any node that reads %reg1039.

//===---------------------------------------------------------------------===//

Use local info (i.e. register scavenger) to assign it a free register to allow
reuse:
        ldr r3, [sp, #+4]
        add r3, r3, #3
        ldr r2, [sp, #+8]
        add r2, r2, #2
        ldr r1, [sp, #+4]  <==
        add r1, r1, #1
        ldr r0, [sp, #+4]
        add r0, r0, #2

//===---------------------------------------------------------------------===//

LLVM aggressively lift CSE out of loop. Sometimes this can be negative side-
effects:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
load [i + R1]
...
load [i + R2]
...
load [i + R3]

Suppose there is high register pressure, R1, R2, R3, can be spilled. We need
to implement proper re-materialization to handle this:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
R1 = X + 4  @ re-materialized
load [i + R1]
...
R2 = X + 7 @ re-materialized
load [i + R2]
...
R3 = X + 15 @ re-materialized
load [i + R3]

Furthermore, with re-association, we can enable sharing:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
T = i + X
load [T + 4]
...
load [T + 7]
...
load [T + 15]
//===---------------------------------------------------------------------===//

It's not always a good idea to choose rematerialization over spilling. If all
the load / store instructions would be folded then spilling is cheaper because
it won't require new live intervals / registers. See 2003-05-31-LongShifts for
an example.

//===---------------------------------------------------------------------===//

With a copying garbage collector, derived pointers must not be retained across
collector safe points; the collector could move the objects and invalidate the
derived pointer. This is bad enough in the first place, but safe points can
crop up unpredictably. Consider:

        %array = load { i32, [0 x %obj] }** %array_addr
        %nth_el = getelementptr { i32, [0 x %obj] }* %array, i32 0, i32 %n
        %old = load %obj** %nth_el
        %z = div i64 %x, %y
        store %obj* %new, %obj** %nth_el

If the i64 division is lowered to a libcall, then a safe point will (must)
appear for the call site. If a collection occurs, %array and %nth_el no longer
point into the correct object.

The fix for this is to copy address calculations so that dependent pointers
are never live across safe point boundaries. But the loads cannot be copied
like this if there was an intervening store, so may be hard to get right.

Only a concurrent mutator can trigger a collection at the libcall safe point.
So single-threaded programs do not have this requirement, even with a copying
collector. Still, LLVM optimizations would probably undo a front-end's careful
work.

//===---------------------------------------------------------------------===//

The ocaml frametable structure supports liveness information. It would be good
to support it.

//===---------------------------------------------------------------------===//

The FIXME in ComputeCommonTailLength in BranchFolding.cpp needs to be
revisited. The check is there to work around a misuse of directives in inline
assembly.

//===---------------------------------------------------------------------===//

It would be good to detect collector/target compatibility instead of silently
doing the wrong thing.

//===---------------------------------------------------------------------===//

It would be really nice to be able to write patterns in .td files for copies,
which would eliminate a bunch of explicit predicates on them (e.g. no side 
effects).  Once this is in place, it would be even better to have tblgen 
synthesize the various copy insertion/inspection methods in TargetInstrInfo.

//===---------------------------------------------------------------------===//

Stack coloring improvements:

1. Do proper LiveStackAnalysis on all stack objects including those which are
   not spill slots.
2. Reorder objects to fill in gaps between objects.
   e.g. 4, 1, <gap>, 4, 1, 1, 1, <gap>, 4 => 4, 1, 1, 1, 1, 4, 4

//===---------------------------------------------------------------------===//

The scheduler should be able to sort nearby instructions by their address. For
example, in an expanded memset sequence it's not uncommon to see code like this:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

Each of the stores is independent, and the scheduler is currently making an
arbitrary decision about the order.

//===---------------------------------------------------------------------===//

Another opportunitiy in this code is that the $0 could be moved to a register:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

This would save substantial code size, especially for longer sequences like
this. It would be easy to have a rule telling isel to avoid matching MOV32mi
if the immediate has more than some fixed number of uses. It's more involved
to teach the register allocator how to do late folding to recover from
excessive register pressure.