Simon Pilgrim 2d4f754c33 [TTI] Reduction costs only need to include a single extract element cost (REAPPLIED) ...

We were adding the entire scalarization extraction cost for reductions, which returns the total cost of extracting every element of a vector type.

For reductions we don't need to do this - we just need to extract the 0'th element after the reduction pattern has completed.

Fixes PR37731

Rebased and reapplied after being reverted in rL347541 due to PR39774 - which was fixed by D54955/rL347759 and D55017/rL347997

Differential Revision: https://reviews.llvm.org/D54585

git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@348076 91177308-0d34-0410-b5e6-96231b3b80d8

2018-12-01 14:18:31 +00:00

..

GlobalISel

[GlobalISel] LegalizationArtifactCombiner: Combine aext([asz]ext x) -> [asz]ext x

2018-11-29 18:19:24 +00:00

MIRParser

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

PBQP

Remove @brief commands from doxygen comments, too.

2018-05-01 16:10:38 +00:00

AccelTable.h

DwarfDebug: Reduce duplication in addAccel*** methods

2018-07-20 15:24:13 +00:00

Analysis.h

[WebAssembly] Add functions for EHScopes

2018-05-23 00:32:46 +00:00

AsmPrinter.h

[DebugInfo] Rename EmitDebugThreadLocal back to EmitDebugValue. NFC

2018-11-28 11:48:07 +00:00

AtomicExpandUtils.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

BasicTTIImpl.h

[TTI] Reduction costs only need to include a single extract element cost (REAPPLIED)

2018-12-01 14:18:31 +00:00

BuiltinGCs.h

[GC] Rename a header for consistency

2018-11-10 16:08:10 +00:00

CalcSpillWeights.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

CallingConvLower.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

CommandFlags.inc

[AArch64] Add Tiny Code Model for AArch64

2018-08-22 11:31:39 +00:00

CostTable.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

DAGCombine.h

Refactor DAGCombinerInfo. Change the different booleans that indicate if we are before or after different runs of DAGCo, with the CombineLevel enum.

2012-12-27 06:47:41 +00:00

DFAPacketizer.h

[Packetizer] Add function to check for aliasing between instructions

2017-10-20 22:08:40 +00:00

DIE.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

DIEValue.def

Make a DWARF generator so we can unit test DWARF APIs with gtest.

2016-12-08 01:03:48 +00:00

DwarfStringPoolEntry.h

[DebugInfo] Reduce debug_str_offsets section size

2018-08-07 09:54:52 +00:00

EdgeBundles.h

[modules] "Specialize" a function by actually specializing a function template

2014-04-24 18:27:29 +00:00

ExecutionDomainFix.h

Separate LoopTraversal, ReachingDefAnalysis and BreakFalseDeps into their own files.

2018-01-22 10:06:50 +00:00

ExpandReductions.h

Add a late IR expansion pass for the experimental reduction intrinsics.

2017-05-10 09:42:49 +00:00

FastISel.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

FaultMaps.h

Fix FaultMaps crash when the out streamer is reused

2017-10-17 11:44:34 +00:00

FunctionLoweringInfo.h

AMDGPU: Fix various issues around the VirtReg2Value mapping

2018-11-30 22:55:29 +00:00

GCMetadata.h

[GC][NFC] Simplify code now that we only have one safepoint kind

2018-11-12 22:03:53 +00:00

GCMetadataPrinter.h

[CodeGen] Support custom format of stack maps

2018-11-26 18:43:48 +00:00

GCStrategy.h

[GC][NFC] Simplify code now that we only have one safepoint kind

2018-11-12 22:03:53 +00:00

IntrinsicLowering.h

[CodeGen] fix documentation comments; NFC

2017-12-15 18:09:33 +00:00

ISDOpcodes.h

[SelectionDAG][X86] Relax restriction on the width of an input to *_EXTEND_VECTOR_INREG. Use them and regular *_EXTEND to replace the X86 specific VSEXT/VZEXT opcodes

2018-11-13 19:45:21 +00:00

LatencyPriorityQueue.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

LazyMachineBlockFrequencyInfo.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

LexicalScopes.h

Mark dump() methods as const. NFC

2017-06-21 22:19:17 +00:00

LinkAllAsmWriterComponents.h

[GC] Rename a header for consistency

2018-11-10 16:08:10 +00:00

LinkAllCodegenComponents.h

[GC] Rename a header for consistency

2018-11-10 16:08:10 +00:00

LiveInterval.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

LiveIntervals.h

Fix typos in comment

2018-10-30 01:11:52 +00:00

LiveIntervalUnion.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

LivePhysRegs.h

LivePhysRegs/IfConversion: Change some types from unsigned to MCPhysReg; NFC

2018-11-06 19:00:11 +00:00

LiveRangeEdit.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

LiveRegMatrix.h

Take into account the cost of local intervals when selecting split candidate.

2018-01-31 13:31:08 +00:00

LiveRegUnits.h

LivePhysRegs/IfConversion: Change some types from unsigned to MCPhysReg; NFC

2018-11-06 19:00:11 +00:00

LiveStacks.h

LiveStacks: Rename LiveStack.{h|cpp} to LiveStacks.{h|cpp}; NFC

2017-12-18 23:19:44 +00:00

LiveVariables.h

Fix a bunch more layering of CodeGen headers that are in Target

2017-11-17 01:07:10 +00:00

LoopTraversal.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

LowLevelType.h

Recommit: [globalisel] Change LLT constructor string into an LLT-based object that knows how to generate it.

2017-03-07 23:20:35 +00:00

MachineBasicBlock.h

[WebAssembly] Add isEHScopeReturn instruction property

2018-08-21 19:44:11 +00:00

MachineBlockFrequencyInfo.h

Irreducible loop metadata for more accurate block frequency under PGO.

2017-11-02 22:26:51 +00:00

MachineBranchProbabilityInfo.h

Use getEdgeProbability() instead of getEdgeWeight() in BFI and remove getEdgeWeight() interfaces from MBPI.

2015-12-18 21:53:24 +00:00

MachineCombinerPattern.h

[AArch64] Add patterns to replace fsub fmul with fma fneg.

2017-12-06 22:48:36 +00:00

MachineConstantPool.h

Remove @brief commands from doxygen comments, too.

2018-05-01 16:10:38 +00:00

MachineDominanceFrontier.h

[WebAssembly] Add WebAssemblyException information analysis

2018-06-25 01:20:21 +00:00

MachineDominators.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

MachineFrameInfo.h

[Power9] Allow gpr callee saved spills in prologue to vectors registers

2018-11-09 16:36:24 +00:00

MachineFunction.h

MachineFunction: Store more specific reference to LLVMTargetMachine; NFC

2018-11-05 23:49:14 +00:00

MachineFunctionPass.h

Sort the remaining #include lines in include/... and lib/....

2017-06-06 11:49:48 +00:00

MachineInstr.h

Fix documentation of MachineInstr::getNumOperands

2018-10-12 12:26:37 +00:00

MachineInstrBuilder.h

[MI] Change the array of MachineMemOperand pointers to be

2018-08-16 21:30:05 +00:00

MachineInstrBundle.h

[CodeGen] Use MachineOperand::print in the MIRPrinter for MO_Register.

2017-12-07 10:40:31 +00:00

MachineInstrBundleIterator.h

[CodeGen] Fix some Clang-tidy modernize-use-using and Include What You Use warnings; other minor fixes (NFC).

2017-05-31 01:10:10 +00:00

MachineJumpTableInfo.h

[CodeGen] Print jump-table index operands as %jump-table.0 in both MIR and debug output

2017-12-13 10:30:59 +00:00

MachineLoopInfo.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

MachineMemOperand.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

MachineModuleInfo.h

MachineModuleInfo: Store more specific reference to LLVMTargetMachine; NFC

2018-11-05 23:49:13 +00:00

MachineModuleInfoImpls.h

[MinGW] [X86] Add stubs for references to data variables that might end up imported from a dll

2018-08-29 17:28:34 +00:00

MachineOperand.h

CodeGen: Cleanup regmask construction; NFC

2018-07-26 00:27:47 +00:00

MachineOptimizationRemarkEmitter.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

MachineOutliner.h

[MachineOutliner][NFC] Don't compute liveness if X16/X17/NZCV are unused

2018-11-14 22:23:38 +00:00

MachinePassRegistry.h

Type safe version of MachinePassRegistry

2018-11-09 17:19:45 +00:00

MachinePostDominators.h

[Dominators] Change Roots type to SmallVector

2017-07-26 18:27:39 +00:00

MachineRegionInfo.h

[CodeGen] Fix some Clang-tidy modernize-use-using and Include What You Use warnings; other minor fixes (NFC).

2017-06-01 23:25:02 +00:00

MachineRegisterInfo.h

[MachineCSE][GlobalISel] Making sure MachineCSE works mid-GlobalISel (again)

2018-10-20 00:06:15 +00:00

MachineScheduler.h

Bias physical register immediate assignments

2018-11-14 21:11:53 +00:00

MachineSSAUpdater.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

MachineTraceMetrics.h

Recommit [MachineCombiner] Update instruction depths incrementally for large BBs.

2017-09-20 11:54:37 +00:00

MachORelocation.h

Remove trailing space

2018-07-30 19:41:25 +00:00

MacroFusion.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

MIRPrinter.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

MIRYamlMapping.h

[MIR] Add hasWinCFI field

2018-10-24 21:07:38 +00:00

ParallelCG.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

Passes.h

Subject: [PATCH] [CodeGen] Add pass to combine interleaved loads.

2018-11-19 14:26:10 +00:00

PBQPRAConstraint.h

Remove @brief commands from doxygen comments, too.

2018-05-01 16:10:38 +00:00

PreISelIntrinsicLowering.h

[CodeGen] Fix some Clang-tidy modernize and Include What You Use warnings; other minor fixes (NFC).

2017-09-13 21:15:20 +00:00

PseudoSourceValue.h

[PSV] Update API to be able to use TargetCustom without UB.

2018-08-20 19:23:45 +00:00

ReachingDefAnalysis.h

[ReachingDefAnalysis] Fix what I assume to be a typo ReachingDedDefaultVal->ReachingDefDefaultVal.

2018-03-20 20:53:21 +00:00

RegAllocPBQP.h

Remove @brief commands from doxygen comments, too.

2018-05-01 16:10:38 +00:00

RegAllocRegistry.h

Type safe version of MachinePassRegistry

2018-11-09 17:19:45 +00:00

RegisterClassInfo.h

Fix a bunch more layering of CodeGen headers that are in Target

2017-11-17 01:07:10 +00:00

RegisterPressure.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

RegisterScavenging.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

RegisterUsageInfo.h

MachineFunction: Store more specific reference to LLVMTargetMachine; NFC

2018-11-05 23:49:14 +00:00

ResourcePriorityQueue.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

RuntimeLibcalls.h

Put "built-in" function definitions in global Used list, for LTO. (fix bug 34169)

2018-07-24 19:34:37 +00:00

ScheduleDAG.h

MachineFunction: Store more specific reference to LLVMTargetMachine; NFC

2018-11-05 23:49:14 +00:00

ScheduleDAGInstrs.h

ScheduleDAG: Cleanup dumping code; NFC

2018-09-19 00:23:35 +00:00

ScheduleDAGMutation.h

[CodeGen] Fix some Clang-tidy modernize and Include What You Use warnings; other minor fixes (NFC).

2017-02-22 22:32:51 +00:00

ScheduleDFS.h

Remove \brief commands from doxygen comments.

2018-05-01 15:54:18 +00:00

ScheduleHazardRecognizer.h

[CodeGen] Fix some Clang-tidy modernize and Include What You Use warnings; other minor fixes (NFC).

2017-02-22 22:32:51 +00:00

SchedulerRegistry.h

Type safe version of MachinePassRegistry

2018-11-09 17:19:45 +00:00

ScoreboardHazardRecognizer.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

SDNodeProperties.td

TableGen: Allow setting SDNodeProperties on intrinsics

2017-12-20 19:36:28 +00:00

SelectionDAG.h

[DAG] consolidate shift simplifications

2018-11-23 20:05:12 +00:00

SelectionDAGAddressAnalysis.h

[DAG] Add const variants for BaseIndexOffset functions.

2018-10-30 18:26:43 +00:00

SelectionDAGISel.h

TableGen/ISel: Allow PatFrag predicate code to access captured operands

2018-11-30 14:15:13 +00:00

SelectionDAGNodes.h

[SelectionDAG] move constant or splat functions to common location

2018-11-25 16:09:32 +00:00

SelectionDAGTargetInfo.h

[CodeGen] Fix some Clang-tidy modernize and Include What You Use warnings; other minor fixes (NFC).

2017-09-13 21:15:20 +00:00

SlotIndexes.h

Fix typos in assert message

2018-10-19 20:17:05 +00:00

StackMaps.h

[CodeGen] Expose some data types and accessors from StackMaps

2018-11-16 16:48:49 +00:00

StackProtector.h

CodeGen: Remove pipeline dependencies on StackProtector; NFC

2018-07-13 00:08:38 +00:00

TailDuplicator.h

Remove unnecessary includes; NFC

2017-12-13 02:51:01 +00:00

TargetCallingConv.h

[IR][CodeGen] Remove dependency on EVT from IR/Function.cpp. Move EVT to CodeGen layer.

2018-03-29 17:21:10 +00:00

TargetFrameLowering.h

Correct dwarf unwind information in function epilogue

2018-04-24 10:32:08 +00:00

TargetInstrInfo.h

[CodeGen][NFC] Make TII::getMemOpBaseImmOfs return a base operand

2018-11-28 12:00:20 +00:00

TargetLowering.h

[TargetLowering][RISCV] Introduce isSExtCheaperThanZExt hook and implement for RISC-V

2018-11-30 09:56:54 +00:00

TargetLoweringObjectFileImpl.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

TargetOpcodes.h

Fix layering of CodeGen/TargetOpcodes.def by moving it to Support

2018-03-23 23:58:27 +00:00

TargetPassConfig.h

LLVMTargetMachine/TargetPassConfig: Simplify handling of start/stop options; NFC

2018-11-02 01:31:50 +00:00

TargetRegisterInfo.h

[TargetRegisterInfo] Remove temporary hook enableMultipleCopyHints()

2018-10-05 14:23:11 +00:00

TargetSchedule.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

TargetSubtargetInfo.h

[tblgen][llvm-mca] Add the ability to describe move elimination candidates via tablegen.

2018-10-12 11:23:04 +00:00

UnreachableBlockElim.h

[PM] Port UnreachableBlockElim to the new Pass Manager

2016-07-08 03:32:49 +00:00

ValueTypes.h

[IR][CodeGen] Remove dependency on EVT from IR/Function.cpp. Move EVT to CodeGen layer.

2018-03-29 17:21:10 +00:00

ValueTypes.td

NFC Fix a comment in ValueTypes.td

2018-06-07 23:32:18 +00:00

VirtRegMap.h

[CodeGen] Fix inconsistent declaration parameter name

2018-07-16 18:51:40 +00:00

WasmEHFuncInfo.h

[WebAssembly] Add support for the event section

2018-11-14 02:46:21 +00:00

WinEHFuncInfo.h

[CodeGen] Fix some Clang-tidy modernize-use-using and Include What You Use warnings; other minor fixes (NFC).

2017-06-03 00:22:41 +00:00