LLVM 24.0.0git
Public Member Functions | Protected Member Functions | Protected Attributes | Friends | List of all members
llvm::InnerLoopVectorizer Class Reference

InnerLoopVectorizer vectorizes loops which contain only one basic block to a specified vectorization factor (VF). More...

Inheritance diagram for llvm::InnerLoopVectorizer:
[legend]

Public Member Functions

 InnerLoopVectorizer (Loop *OrigLoop, PredicatedScalarEvolution &PSE, LoopInfo *LI, DominatorTree *DT, const TargetTransformInfo *TTI, AssumptionCache *AC, ElementCount VecWidth, unsigned UnrollFactor, GeneratedRTChecks &RTChecks, VPlan &Plan)
virtual ~InnerLoopVectorizer ()=default
virtual BasicBlock * createVectorizedLoopSkeleton ()
 Creates a basic block for the scalar preheader.
void fixVectorizedLoop (VPTransformState &State)
 Fix the vectorized code, taking care of header phi's, and more.

Protected Member Functions

BasicBlock * createScalarPreheader (StringRef Prefix)
 Create and return a new IR basic block for the scalar preheader whose name is prefixed with Prefix.

Protected Attributes

Loop * OrigLoop
 The original loop.
PredicatedScalarEvolution & PSE
 A wrapper around ScalarEvolution used to add runtime SCEV checks.
LoopInfo * LI
 Loop Info.
DominatorTree * DT
 Dominator Tree.
const TargetTransformInfo * TTI
 Target Transform Info.
AssumptionCache * AC
 Assumption Cache.
ElementCount VF
 The vectorization SIMD factor to use.
unsigned UF
 The vectorization unroll factor to use.
IRBuilder Builder
 The builder that we use.
GeneratedRTChecks & RTChecks
 Structure to hold information about generated runtime checks, responsible for cleaning the checks, if vectorization turns out unprofitable.
VPlan & Plan
VPBasicBlock * VectorPHVPBB
 The vector preheader block of Plan, used as target for check blocks introduced during skeleton creation.

Friends

class LoopVectorizationPlanner

Detailed Description

InnerLoopVectorizer vectorizes loops which contain only one basic block to a specified vectorization factor (VF).

This class performs the widening of scalars into vectors, or multiple scalars. This class also implements the following features:

  • It inserts an epilogue loop for handling loops that don't have iteration counts that are known to be a multiple of the vectorization factor.
  • It handles the code generation for reduction variables.
  • Scalarization (implementation using scalars) of un-vectorizable instructions. InnerLoopVectorizer does not perform any vectorization-legality checks, and relies on the caller to check for the different legality aspects. The InnerLoopVectorizer relies on the LoopVectorizationLegality class to provide information about the induction and reduction variables that were found to a given vectorization factor.

Definition at line 541 of file LoopVectorize.cpp.

Constructor & Destructor Documentation

◆ InnerLoopVectorizer()

llvm::InnerLoopVectorizer::InnerLoopVectorizer ( Loop * OrigLoop,
PredicatedScalarEvolution & PSE,
LoopInfo * LI,
DominatorTree * DT,
const TargetTransformInfo * TTI,
AssumptionCache * AC,
ElementCount VecWidth,
unsigned UnrollFactor,
GeneratedRTChecks & RTChecks,
VPlan & Plan )
inline

Definition at line 543 of file LoopVectorize.cpp.

References AC, Builder, llvm::cast(), DT, getContext(), LI, OrigLoop, Plan, PSE, RTChecks, TTI, UF, VectorPHVPBB, and VF.

Referenced by llvm::EpilogueVectorizerEpilogueLoop::EpilogueVectorizerEpilogueLoop().

◆ ~InnerLoopVectorizer()

virtual llvm::InnerLoopVectorizer::~InnerLoopVectorizer ( )
virtualdefault

Member Function Documentation

◆ createScalarPreheader()

BasicBlock * InnerLoopVectorizer::createScalarPreheader ( StringRef Prefix)
protected

Create and return a new IR basic block for the scalar preheader whose name is prefixed with Prefix.

Definition at line 1941 of file LoopVectorize.cpp.

References assert(), DT, llvm::BasicBlock::getTerminator(), LI, OrigLoop, and llvm::SplitBlock().

Referenced by llvm::EpilogueVectorizerEpilogueLoop::createVectorizedLoopSkeleton(), and createVectorizedLoopSkeleton().

◆ createVectorizedLoopSkeleton()

BasicBlock * InnerLoopVectorizer::createVectorizedLoopSkeleton ( )
virtual

Creates a basic block for the scalar preheader.

EpilogueVectorizerEpilogueLoop overrides the method to create additional blocks and checks needed for epilogue vectorization.

Reimplemented in llvm::EpilogueVectorizerEpilogueLoop.

Definition at line 1980 of file LoopVectorize.cpp.

References createScalarPreheader(), and llvm::BasicBlock::getSinglePredecessor().

Referenced by llvm::LoopVectorizationPlanner::executePlan().

◆ fixVectorizedLoop()

void InnerLoopVectorizer::fixVectorizedLoop ( VPTransformState & State)

Fix the vectorized code, taking care of header phi's, and more.

Definition at line 2127 of file LoopVectorize.cpp.

References llvm::vputils::getFirstLoopHeader(), and legacyCSE().

Referenced by llvm::LoopVectorizationPlanner::executePlan().

◆ LoopVectorizationPlanner

friend class LoopVectorizationPlanner
friend

Definition at line 565 of file LoopVectorize.cpp.

References LoopVectorizationPlanner.

Referenced by LoopVectorizationPlanner.

Member Data Documentation

◆ AC

AssumptionCache* llvm::InnerLoopVectorizer::AC
protected

Assumption Cache.

Definition at line 589 of file LoopVectorize.cpp.

Referenced by llvm::EpilogueVectorizerEpilogueLoop::EpilogueVectorizerEpilogueLoop(), llvm::LoopVectorizationPlanner::executePlan(), and InnerLoopVectorizer().

◆ Builder

IRBuilder llvm::InnerLoopVectorizer::Builder
protected

The builder that we use.

Definition at line 600 of file LoopVectorize.cpp.

Referenced by llvm::LoopVectorizationPlanner::executePlan(), and InnerLoopVectorizer().

◆ DT

DominatorTree* llvm::InnerLoopVectorizer::DT
protected

Dominator Tree.

Definition at line 583 of file LoopVectorize.cpp.

Referenced by createScalarPreheader(), llvm::EpilogueVectorizerEpilogueLoop::EpilogueVectorizerEpilogueLoop(), and InnerLoopVectorizer().

◆ LI

LoopInfo* llvm::InnerLoopVectorizer::LI
protected

Loop Info.

Definition at line 580 of file LoopVectorize.cpp.

Referenced by createScalarPreheader(), llvm::EpilogueVectorizerEpilogueLoop::EpilogueVectorizerEpilogueLoop(), and InnerLoopVectorizer().

◆ OrigLoop

Loop* llvm::InnerLoopVectorizer::OrigLoop
protected

The original loop.

Definition at line 572 of file LoopVectorize.cpp.

Referenced by createScalarPreheader(), llvm::EpilogueVectorizerEpilogueLoop::EpilogueVectorizerEpilogueLoop(), and InnerLoopVectorizer().

◆ Plan

VPlan& llvm::InnerLoopVectorizer::Plan
protected

Definition at line 608 of file LoopVectorize.cpp.

Referenced by llvm::EpilogueVectorizerEpilogueLoop::createVectorizedLoopSkeleton(), llvm::EpilogueVectorizerEpilogueLoop::EpilogueVectorizerEpilogueLoop(), and InnerLoopVectorizer().

◆ PSE

PredicatedScalarEvolution& llvm::InnerLoopVectorizer::PSE
protected

A wrapper around ScalarEvolution used to add runtime SCEV checks.

Applies dynamic knowledge to simplify SCEV expressions and converts them to a more usable form.

Definition at line 577 of file LoopVectorize.cpp.

Referenced by llvm::EpilogueVectorizerEpilogueLoop::EpilogueVectorizerEpilogueLoop(), and InnerLoopVectorizer().

◆ RTChecks

GeneratedRTChecks& llvm::InnerLoopVectorizer::RTChecks
protected

Structure to hold information about generated runtime checks, responsible for cleaning the checks, if vectorization turns out unprofitable.

Definition at line 606 of file LoopVectorize.cpp.

Referenced by llvm::LoopVectorizationPlanner::executePlan(), and InnerLoopVectorizer().

◆ TTI

const TargetTransformInfo* llvm::InnerLoopVectorizer::TTI
protected

Target Transform Info.

Definition at line 586 of file LoopVectorize.cpp.

Referenced by llvm::EpilogueVectorizerEpilogueLoop::EpilogueVectorizerEpilogueLoop(), and InnerLoopVectorizer().

◆ UF

unsigned llvm::InnerLoopVectorizer::UF
protected

The vectorization unroll factor to use.

Each scalar is vectorized to this many different vector instructions.

Definition at line 597 of file LoopVectorize.cpp.

Referenced by InnerLoopVectorizer().

◆ VectorPHVPBB

VPBasicBlock* llvm::InnerLoopVectorizer::VectorPHVPBB
protected

The vector preheader block of Plan, used as target for check blocks introduced during skeleton creation.

Definition at line 612 of file LoopVectorize.cpp.

Referenced by InnerLoopVectorizer().

◆ VF

ElementCount llvm::InnerLoopVectorizer::VF
protected

The vectorization SIMD factor to use.

Each vector will have this many vector elements.

Definition at line 593 of file LoopVectorize.cpp.

Referenced by InnerLoopVectorizer().

The documentation for this class was generated from the following file:
Generated on for LLVM by doxygen 1.14.0