LLVM 19.0.0git
Public Member Functions | Static Public Attributes | List of all members
llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics Class Reference

A helper class used for scoring candidates for two consecutive lanes. More...

Public Member Functions

 LookAheadHeuristics (const TargetLibraryInfo &TLI, const DataLayout &DL, ScalarEvolution &SE, const BoUpSLP &R, int NumLanes, int MaxLevel)
 
int getShallowScore (Value *V1, Value *V2, Instruction *U1, Instruction *U2, ArrayRef< Value * > MainAltOps) const
 
int getScoreAtLevelRec (Value *LHS, Value *RHS, Instruction *U1, Instruction *U2, int CurrLevel, ArrayRef< Value * > MainAltOps) const
 Go through the operands of LHS and RHS recursively until MaxLevel, and return the cummulative score.
 

Static Public Attributes

static const int ScoreConsecutiveLoads = 4
 Loads from consecutive memory addresses, e.g. load(A[i]), load(A[i+1]).
 
static const int ScoreSplatLoads = 3
 The same load multiple times.
 
static const int ScoreReversedLoads = 3
 Loads from reversed memory addresses, e.g. load(A[i+1]), load(A[i]).
 
static const int ScoreMaskedGatherCandidate = 1
 A load candidate for masked gather.
 
static const int ScoreConsecutiveExtracts = 4
 ExtractElementInst from same vector and consecutive indexes.
 
static const int ScoreReversedExtracts = 3
 ExtractElementInst from same vector and reversed indices.
 
static const int ScoreConstants = 2
 Constants.
 
static const int ScoreSameOpcode = 2
 Instructions with the same opcode.
 
static const int ScoreAltOpcodes = 1
 Instructions with alt opcodes (e.g, add + sub).
 
static const int ScoreSplat = 1
 Identical instructions (a.k.a. splat or broadcast).
 
static const int ScoreUndef = 1
 Matching with an undef is preferable to failing.
 
static const int ScoreFail = 0
 Score for failing to find a decent match.
 
static const int ScoreAllUserVectorized = 1
 Score if all users are vectorized.
 

Detailed Description

A helper class used for scoring candidates for two consecutive lanes.

Definition at line 1246 of file SLPVectorizer.cpp.

Constructor & Destructor Documentation

◆ LookAheadHeuristics()

llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::LookAheadHeuristics ( const TargetLibraryInfo TLI,
const DataLayout DL,
ScalarEvolution SE,
const BoUpSLP R,
int  NumLanes,
int  MaxLevel 
)
inline

Definition at line 1255 of file SLPVectorizer.cpp.

References DL.

Member Function Documentation

◆ getScoreAtLevelRec()

int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::getScoreAtLevelRec ( Value LHS,
Value RHS,
Instruction U1,
Instruction U2,
int  CurrLevel,
ArrayRef< Value * >  MainAltOps 
) const
inline

Go through the operands of LHS and RHS recursively until MaxLevel, and return the cummulative score.

U1 and U2 are the users of LHS and RHS (that is LHS and RHS are operands of U1 and U2), except at the beginning of the recursion where these are set to nullptr.

For example:

///  A[0]  B[0]  A[1]  B[1]  C[0] D[0]  B[1] A[1]
///     \ /         \ /         \ /        \ /
///      +           +           +          +
///     G1          G2          G3         G4
/// 

The getScoreAtLevelRec(G1, G2) function will try to match the nodes at each level recursively, accumulating the score. It starts from matching the additions at level 0, then moves on to the loads (level 1). The score of G1 and G2 is higher than G1 and G3, because {A[0],A[1]} and {B[0],B[1]} match with LookAheadHeuristics::ScoreConsecutiveLoads, while {A[0],C[0]} has a score of LookAheadHeuristics::ScoreFail. Please note that the order of the operands does not matter, as we evaluate the score of all profitable combinations of operands. In other words the score of G1 and G4 is the same as G1 and G2. This heuristic is based on ideas described in: Look-ahead SLP: Auto-vectorization in the presence of commutative operations, CGO 2018 by Vasileios Porpodas, Rodrigo C. O. Rocha, Luís F. W. Góes

Definition at line 1468 of file SLPVectorizer.cpp.

References assert(), llvm::SmallSet< T, N, C >::count(), getScoreAtLevelRec(), getShallowScore(), llvm::SmallSet< T, N, C >::insert(), isCommutative(), LHS, RHS, and ScoreFail.

Referenced by llvm::slpvectorizer::BoUpSLP::findBestRootPair(), and getScoreAtLevelRec().

◆ getShallowScore()

int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::getShallowScore ( Value V1,
Value V2,
Instruction U1,
Instruction U2,
ArrayRef< Value * >  MainAltOps 
) const
inline

Member Data Documentation

◆ ScoreAllUserVectorized

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreAllUserVectorized = 1
static

Score if all users are vectorized.

Definition at line 1300 of file SLPVectorizer.cpp.

◆ ScoreAltOpcodes

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreAltOpcodes = 1
static

Instructions with alt opcodes (e.g, add + sub).

Definition at line 1292 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreConsecutiveExtracts

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreConsecutiveExtracts = 4
static

ExtractElementInst from same vector and consecutive indexes.

Definition at line 1284 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreConsecutiveLoads

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreConsecutiveLoads = 4
static

Loads from consecutive memory addresses, e.g. load(A[i]), load(A[i+1]).

Definition at line 1273 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreConstants

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreConstants = 2
static

Constants.

Definition at line 1288 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreFail

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreFail = 0
static

Score for failing to find a decent match.

Definition at line 1298 of file SLPVectorizer.cpp.

Referenced by getScoreAtLevelRec(), and getShallowScore().

◆ ScoreMaskedGatherCandidate

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreMaskedGatherCandidate = 1
static

A load candidate for masked gather.

Definition at line 1282 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreReversedExtracts

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreReversedExtracts = 3
static

ExtractElementInst from same vector and reversed indices.

Definition at line 1286 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreReversedLoads

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreReversedLoads = 3
static

Loads from reversed memory addresses, e.g. load(A[i+1]), load(A[i]).

Definition at line 1280 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreSameOpcode

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreSameOpcode = 2
static

Instructions with the same opcode.

Definition at line 1290 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreSplat

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreSplat = 1
static

Identical instructions (a.k.a. splat or broadcast).

Definition at line 1294 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreSplatLoads

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreSplatLoads = 3
static

The same load multiple times.

This should have a better score than ScoreSplat because it in x86 for a 2-lane vector we can represent it with movddup (reg), xmm0 which has a throughput of 0.5 versus 0.5 for a vector load and 1.0 for a broadcast.

Definition at line 1278 of file SLPVectorizer.cpp.

Referenced by getShallowScore().

◆ ScoreUndef

const int llvm::slpvectorizer::BoUpSLP::LookAheadHeuristics::ScoreUndef = 1
static

Matching with an undef is preferable to failing.

Definition at line 1296 of file SLPVectorizer.cpp.

Referenced by getShallowScore().


The documentation for this class was generated from the following file: