SIInsertWaitcnts.cpp File Reference

Insert wait instructions for memory reads and writes. More...

#include "AMDGPU.h"
#include "AMDGPUHWEvents.h"
#include "AMDGPUWaitcntUtils.h"
#include "GCNSubtarget.h"
#include "SIMachineFunctionInfo.h"
#include "Utils/AMDGPUBaseInfo.h"
#include "llvm/Analysis/AliasAnalysis.h"
#include "llvm/CodeGen/MachineFrameInfo.h"
#include "llvm/CodeGen/MachineLoopInfo.h"
#include "llvm/CodeGen/MachinePassManager.h"
#include "llvm/CodeGen/MachinePostDominators.h"
#include "llvm/IR/Dominators.h"
#include "llvm/InitializePasses.h"
#include "llvm/Support/AMDGPUAsyncStages.h"
#include "llvm/TargetParser/AMDGPUTargetParser.h"

Go to the source code of this file.

Macros
#define	DEBUG_TYPE   "si-insert-waitcnts"

Typedefs
using	HWEvents = AMDGPU::HWEvents

Functions
	INITIALIZE_PASS_BEGIN (SIInsertWaitcntsLegacy, DEBUG_TYPE, "SI Insert Waitcnts", false, false) INITIALIZE_PASS_END(SIInsertWaitcntsLegacy
static bool	updateOperandIfDifferent (MachineInstr &MI, AMDGPU::OpName OpName, unsigned NewEnc)
static bool	isWaitInstr (MachineInstr &Inst)

Variables
	DEBUG_TYPE
SI Insert	Waitcnts
SI Insert	false

Detailed Description

Insert wait instructions for memory reads and writes.

Memory reads and writes are issued asynchronously, so we need to insert S_WAITCNT instructions when we want to access any of their results or overwrite any register that's used asynchronously.

TODO: This pass currently keeps one timeline per hardware counter. A more finely-grained approach that keeps one timeline per event type could sometimes get away with generating weaker s_waitcnt instructions. For example, when both SMEM and LDS are in flight and we need to wait for the i-th-last LDS instruction, then an lgkmcnt(i) is actually sufficient, but the pass will currently generate a conservative lgkmcnt(0) because multiple event types are in flight.

Definition in file SIInsertWaitcnts.cpp.

Macro Definition Documentation

DEBUG_TYPE

#define DEBUG_TYPE   "si-insert-waitcnts"

Definition at line 46 of file SIInsertWaitcnts.cpp.

Typedef Documentation

HWEvents

using HWEvents = AMDGPU::HWEvents

Definition at line 44 of file SIInsertWaitcnts.cpp.

Function Documentation

INITIALIZE_PASS_BEGIN()

INITIALIZE_PASS_BEGIN	(	SIInsertWaitcntsLegacy	,
		DEBUG_TYPE	,
		"SI Insert Waitcnts"	,
		false	,
		false	)

References DEBUG_TYPE, and INITIALIZE_PASS_DEPENDENCY.

isWaitInstr()

bool isWaitInstr ( MachineInstr & Inst )

static

Definition at line 3028 of file SIInsertWaitcnts.cpp.

References llvm::AMDGPU::counterTypeForInstr(), llvm::SIInstrInfo::getNonSoftWaitcntOpcode(), llvm::MachineInstr::getOpcode(), llvm::MachineInstr::getOperand(), llvm::MachineOperand::getReg(), and isReg().

updateOperandIfDifferent()

bool updateOperandIfDifferent ( MachineInstr & MI, AMDGPU::OpName OpName, unsigned NewEnc )

static

Definition at line 1676 of file SIInsertWaitcnts.cpp.

References assert(), llvm::MachineOperand::getImm(), MI, and llvm::MachineOperand::setImm().

Variable Documentation

DEBUG_TYPE

DEBUG_TYPE

Definition at line 1665 of file SIInsertWaitcnts.cpp.

false

SI Insert false

Definition at line 1666 of file SIInsertWaitcnts.cpp.

Waitcnts

SI Insert Waitcnts

Definition at line 1665 of file SIInsertWaitcnts.cpp.