Elad Cohen ea59a24717 Support arbitrary address space pointers in masked gather/scatter intrinsics. ...

Fixes PR31789 - When loop-vectorize tries to use these intrinsics for a
non-default address space pointer we fail with a "Calling a function with a
bad singature!" assertion. This patch solves this by adding the 'vector of
pointers' argument as an overloaded type which will determine the address
space.

Differential revision: https://reviews.llvm.org/D31490



git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@302018 91177308-0d34-0410-b5e6-96231b3b80d8

2017-05-03 12:28:54 +00:00

..

ADCE

Fix a test to check assembly output instead of bitcode.

2017-03-31 23:22:19 +00:00

AddDiscriminators

[AddDiscriminators] Assign discriminators to MemIntrinsic calls.

2017-04-11 19:07:30 +00:00

AlignmentFromAssumptions

[PM] Port AlignmentFromAssumptions to the new PM.

2016-06-15 06:18:01 +00:00

ArgumentPromotion

[ArgPromotion] Don't drop !prof metadata on promoted calls

2017-04-13 18:10:30 +00:00

AtomicExpand

Add address space mangling to lifetime intrinsics

2017-04-10 20:18:21 +00:00

BBVectorize

Replace hardcoded intrinsic list with speculatable attribute.

2017-05-03 02:26:10 +00:00

BDCE

[Analysis] Support bitreverse in -demanded-bits pass

2017-04-13 16:44:25 +00:00

BranchFolding

Move branch folding test to a better location.

2015-12-03 19:41:25 +00:00

CodeExtractor

[PartialInlining] Add more early filtering

2017-05-02 18:43:21 +00:00

CodeGenPrepare

[CodeGenPrepare] Fix crash due to an invalid CFG

2017-04-17 19:11:04 +00:00

ConstantHoisting

[ConstHoisting] Add BFI in constanthoisting pass and select the best insertion

2017-04-21 15:50:16 +00:00

ConstantMerge

Don't merge global constants with non-dbg metadata.

2017-03-09 00:03:37 +00:00

ConstProp

opt: Rename -default-data-layout flag to -data-layout and make it always override the layout.

2017-02-17 17:36:52 +00:00

Coroutines

Add address space mangling to lifetime intrinsics

2017-04-10 20:18:21 +00:00

CorrelatedValuePropagation

Add address space mangling to lifetime intrinsics

2017-04-10 20:18:21 +00:00

CountingFunctionInserter

Add a counter-function insertion pass

2016-09-01 09:42:39 +00:00

CrossDSOCFI

[PM] Port CrossDSOCFI to the new pass manager.

2016-07-09 03:25:35 +00:00

DCE

llvm/test/Transforms/DCE/calls-errno.ll: Suppress checking @pow(+0,-1).

2016-11-04 18:50:45 +00:00

DeadArgElim

Replace hardcoded intrinsic list with speculatable attribute.

2017-05-03 02:26:10 +00:00

DeadStoreElimination

Add address space mangling to lifetime intrinsics

2017-04-10 20:18:21 +00:00

EarlyCSE

[EarlyCSE] Mark the condition of assume intrinsic as true

2017-04-28 06:25:39 +00:00

EliminateAvailableExternally

[PM] Port EliminateAvailableExternally pass to the new pass manager.

2016-05-05 02:37:32 +00:00

Float2Int

[PM] Port float2int to the new pass manager

2016-06-24 23:32:02 +00:00

ForcedFunctionAttrs

[attrs] Split off the forced attributes utility into its own pass that

2015-12-27 08:13:45 +00:00

FunctionAttrs

Support arbitrary address space pointers in masked gather/scatter intrinsics.

2017-05-03 12:28:54 +00:00

FunctionImport

Revert r295861, "[ModuleSummaryAnalysis] Don't crash when referencing unnamed globals."

2017-05-03 00:18:48 +00:00

GCOVProfiling

[IR] Remove the DIExpression field from DIGlobalVariable.

2016-12-20 02:09:43 +00:00

GlobalDCE

[PH] Replace uses of AssertingVH from members of analysis results with

2017-01-24 12:55:57 +00:00

GlobalMerge

Renumber testcase metadata nodes after r290153.

2016-12-22 00:45:21 +00:00

GlobalOpt

[GlobalOpt] Correctly update metadata when localizing a global.

2017-04-27 18:39:08 +00:00

GlobalSplit

Fix one-after-the-end type metadata handling in globalsplit.

2017-03-07 22:18:48 +00:00

GuardWidening

[GuardWidening] Fix incorrect use of remove_if

2016-05-21 02:24:44 +00:00

GVN

Support arbitrary address space pointers in masked gather/scatter intrinsics.

2017-05-03 12:28:54 +00:00

GVNHoist

Disable GVN Hoist due to still more bugs being found in it. There is

2017-04-27 00:28:03 +00:00

IndVarSimplify

Add address space mangling to lifetime intrinsics

2017-04-10 20:18:21 +00:00

InferAddressSpaces

InferAddressSpaces: Search constant expressions for addrspacecasts

2017-04-28 22:52:41 +00:00

InferFunctionAttrs

[InferAttributes] Don't access parameters that don't exist.

2016-09-20 23:10:31 +00:00

Inline

[InlineCost] Improve the cost heuristic for Switch

2017-04-28 16:04:03 +00:00

InstCombine

Support arbitrary address space pointers in masked gather/scatter intrinsics.

2017-05-03 12:28:54 +00:00

InstMerge

Remove the load hoisting code of MLSM, it is completely subsumed by GVNHoist

2017-01-24 19:55:36 +00:00

InstSimplify

Revert r301880

2017-05-01 23:54:41 +00:00

InterleavedAccess

[ARM/AArch64] Ensure valid vector element types for interleaved accesses

2017-04-10 18:34:37 +00:00

Internalize

[Internalize] Test that __stack_chk_{guard, fail} are not internalized.

2016-06-05 19:08:54 +00:00

IPConstantProp

[IPCP] Don't propagate return value for naked functions.

2017-02-04 19:44:14 +00:00

IRCE

[IRCE] Add a missing invariant check

2017-02-07 23:59:07 +00:00

JumpThreading

Take indirect branch into account as well when folding.

2017-05-01 17:15:37 +00:00

LCSSA

Revert "Revert r275883 and r275891. They seem to cause PR28608."

2016-07-20 01:55:27 +00:00

LICM

Revert "Compute safety information in a much finer granularity."

2017-04-24 18:25:07 +00:00

LoadCombine

[LoadCombine] Avoid analysing dead basic blocks

2017-04-12 08:07:55 +00:00

LoadStoreVectorizer

Skip bitcasts while looking for GEP in LoadStoreVectorizer

2017-04-25 18:00:08 +00:00

LoopDataPrefetch

[PM] Port LoopDataPrefetch AArch64 tests to new pass manager

2016-08-22 12:59:58 +00:00

LoopDeletion

[Loop Deletion] Delete loops that are never executed

2017-05-03 11:47:11 +00:00

LoopDistribute

Move test of lazy BFI with ORE to a generic directory

2017-01-13 00:16:23 +00:00

LoopIdiom

[LIR] Obey non-integral pointer semantics

2017-04-24 20:12:10 +00:00

LoopInterchange

[LoopInterchange] Track all dependencies, not just anti dependencies.

2016-09-21 19:16:47 +00:00

LoopLoadElim

[PM] Port LoopLoadElimination to the new pass manager and wire it into

2017-01-27 01:32:26 +00:00

LoopPredication

Loop predication expand both sides of the widened condition

2017-02-27 15:44:49 +00:00

LoopReroll

[LoopReroll] Make root-finding more aggressive.

2016-11-21 22:35:34 +00:00

LoopRotate

[LoopRotate] Propagate dbg.value intrinsics

2017-03-08 09:56:22 +00:00

LoopSimplify

[BasicBlockUtils] Use getFirstNonPHIOrDbg to set debugloc for instructions created in SplitBlockPredecessors

2017-02-14 21:10:40 +00:00

LoopSimplifyCFG

LPM: Drop require<loops> from these tests, it's redundant. NFC

2016-05-10 18:28:10 +00:00

LoopStrengthReduce

ARM: handle post-indexed NEON ops where the offset isn't the access width.

2017-04-20 19:54:02 +00:00

LoopUnroll

[LoopUnroll] Don't try to unroll non canonical loops.

2017-04-24 20:14:11 +00:00

LoopUnswitch

[LoopUnswitch] Don't remove instructions with side effects.

2017-04-29 00:12:18 +00:00

LoopVectorize

Support arbitrary address space pointers in masked gather/scatter intrinsics.

2017-05-03 12:28:54 +00:00

LoopVersioning

[LAA] Correctly return a half-open range in expandBounds

2017-04-05 09:24:26 +00:00

LoopVersioningLICM

[LAA] Correctly return a half-open range in expandBounds

2017-04-05 09:24:26 +00:00

LowerAtomic

[PM] Port LowerAtomic to the new pass manager.

2016-05-13 22:52:35 +00:00

LowerExpectIntrinsic

[Profile] handle select instruction in 'expect' lowering

2016-09-02 22:03:40 +00:00

LowerGuardIntrinsic

[PM] Port LowerGuardIntrinsic to the new PM.

2016-07-28 22:08:41 +00:00

LowerInvoke

[PM] Port LowerInvoke to the new pass manager

2016-08-12 17:28:27 +00:00

LowerSwitch

LowerSwitch: Fix producing invalid IR on unreachable code

2017-04-21 23:54:12 +00:00

LowerTypeTests

Align all scalar numbers to LLVM_YAML_IS_FLOW_SEQUENCE_VECTOR

2017-04-04 06:02:32 +00:00

Mem2Reg

Add test coverage for mem2reg dbg.declare lowering.

2017-04-21 22:13:55 +00:00

MemCpyOpt

Add address space mangling to lifetime intrinsics

2017-04-10 20:18:21 +00:00

MergeFunc

MergeFunctions: Preserve debug info in thunks, under option -mergefunc-preserve-debug-info

2017-01-21 02:02:56 +00:00

MetaRenamer

[MetaRenamer] Don't rename library functions.

2017-03-23 23:21:07 +00:00

NameAnonGlobals

[ThinLTO] Ensure anonymous globals renamed even at -O0

2016-09-17 20:40:16 +00:00

NaryReassociate

Revert @llvm.assume with operator bundles (r289755-r289757)

2016-12-19 08:22:17 +00:00

NewGVN

Support arbitrary address space pointers in masked gather/scatter intrinsics.

2017-05-03 12:28:54 +00:00

ObjCARC

Replace hardcoded intrinsic list with speculatable attribute.

2017-05-03 02:26:10 +00:00

PartiallyInlineLibCalls

Add positive test for sqrt "partial inlining". NFC.

2017-01-04 21:24:56 +00:00

PGOProfile

Memory intrinsic value profile optimization: Avoid divide by 0

2017-04-28 14:30:54 +00:00

PhaseOrdering

Make globalaa-retained.ll test catching more cases.

2017-04-18 13:29:26 +00:00

PlaceSafepoints

[PlaceSafepoints] Don't call undef in test case; NFC

2016-06-25 01:40:54 +00:00

PreISelIntrinsicLowering

[PM] Port PreISelIntrinsicLowering to the new PM

2016-06-24 20:13:42 +00:00

PruneEH

[PruneEH] Be correct in the face IPO

2016-10-03 19:35:30 +00:00

Reassociate

[Reassociate] Add negated value of negative constant to the Duplicates list.

2017-02-23 18:49:03 +00:00

Reg2Mem

Move the personality function from LandingPadInst to Function

2015-06-17 20:52:32 +00:00

RewriteStatepointsForGC

[RSForGC] Handle vector GEPs

2017-03-17 00:55:53 +00:00

SafeStack

PR32382: Fix emitting complex DWARF expressions.

2017-04-18 01:21:53 +00:00

SampleProfile

Build SymbolMap in SampleProfileLoader to help matchin function names with suffix.

2017-04-17 22:23:05 +00:00

Scalarizer

[Scalarizer] Handle scalar arguments in vector GEP

2017-03-31 06:29:49 +00:00

SCCP

[SCCP] Resolve indirect branch target when possible.

2017-04-10 00:33:25 +00:00

SeparateConstOffsetFromGEP

AMDGPU: Mark all unspecified CC functions in tests as amdgpu_kernel

2017-03-21 21:39:51 +00:00

SimpleLoopUnswitch

[PM/LoopUnswitch] Introduce a new, simpler loop unswitch pass.

2017-04-27 18:45:20 +00:00

SimplifyCFG

[ValueTracking] Teach isSafeToSpeculativelyExecute() about the speculatable attribute

2017-04-28 21:13:09 +00:00

Sink

Add a testcase for r275581

2016-07-19 17:52:41 +00:00

SLPVectorizer

Replace hardcoded intrinsic list with speculatable attribute.

2017-05-03 02:26:10 +00:00

SpeculativeExecution

SpeculativeExecution: Stop using whitelist for costs

2017-05-02 18:02:18 +00:00

SROA

Allow DataLayout to specify addrspace for allocas.

2017-04-10 22:27:50 +00:00

StraightLineStrengthReduce

AMDGPU: Mark all unspecified CC functions in tests as amdgpu_kernel

2017-03-21 21:39:51 +00:00

StripDeadPrototypes

[PM] Port StripDeadPrototypes to the new pass manager

2015-10-30 23:28:12 +00:00

StripSymbols

[StripDeadDebug/DIFinder] Track inlined SPs

2017-04-11 13:32:11 +00:00

StructurizeCFG

Revert "StructurizeCFG: Directly invert cmp instructions"

2017-04-24 20:25:01 +00:00

TailCallElim

Avoid tail recursion elimination across calls with operand bundles

2016-11-07 21:01:49 +00:00

ThinLTOBitcodeWriter

ThinLTOBitcodeWriter: keep comdats together, rename if leader is renamed

2017-04-12 01:43:07 +00:00

Util

[SimplifyLibCalls] Fix infinite loop with fast-math optimization.

2017-04-25 12:36:14 +00:00

WholeProgramDevirt

Align all scalar numbers to LLVM_YAML_IS_FLOW_SEQUENCE_VECTOR

2017-04-04 06:02:32 +00:00