llvm::MLModelRunner Class Reference

MLModelRunner interface: abstraction of a mechanism for evaluating a ML model. More...

#include "llvm/Analysis/MLModelRunner.h"

Inheritance diagram for llvm::MLModelRunner:

Public Types
enum class	Kind : int {   Unknown , Release , Development , NoOp ,   Interactive }

Public Member Functions
	MLModelRunner (const MLModelRunner &)=delete
MLModelRunner &	operator= (const MLModelRunner &)=delete
virtual	~MLModelRunner ()=default
template<typename T >
T	evaluate ()
template<typename T , typename I >
T *	getTensor (I FeatureID)
template<typename T , typename I >
const T *	getTensor (I FeatureID) const
void *	getTensorUntyped (size_t Index)
const void *	getTensorUntyped (size_t Index) const
Kind	getKind () const
virtual void	switchContext (StringRef Name)

Protected Member Functions
	MLModelRunner (LLVMContext &Ctx, Kind Type, size_t NrInputs)
virtual void *	evaluateUntyped ()=0
void	setUpBufferForTensor (size_t Index, const TensorSpec &Spec, void *Buffer)

Protected Attributes
LLVMContext &	Ctx
const Kind	Type

Detailed Description

MLModelRunner interface: abstraction of a mechanism for evaluating a ML model.

More abstractly, evaluating a function that has as tensors as arguments, described via TensorSpecs, and returns a tensor. Currently, the latter is assumed to be a scalar, in absence of more elaborate scenarios. NOTE: feature indices are expected to be consistent all accross MLModelRunners (pertaining to the same model), and also Loggers (see TFUtils.h)

Definition at line 26 of file MLModelRunner.h.

Member Enumeration Documentation

Kind

enum class llvm::MLModelRunner::Kind : int

strong

Enumerator
Unknown
Release
Development
NoOp
Interactive

Definition at line 52 of file MLModelRunner.h.

Constructor & Destructor Documentation

MLModelRunner() [1/2]

llvm::MLModelRunner::MLModelRunner ( const MLModelRunner &  )

delete

~MLModelRunner()

virtual llvm::MLModelRunner::~MLModelRunner ( )

virtualdefault

MLModelRunner() [2/2]

llvm::MLModelRunner::MLModelRunner ( LLVMContext &  Ctx, Kind  Type, size_t  NrInputs  )

inlineprotected

Definition at line 57 of file MLModelRunner.h.

References assert(), and Unknown.

Member Function Documentation

evaluate()

template<typename T >

T llvm::MLModelRunner::evaluate ( )

inline

Definition at line 33 of file MLModelRunner.h.

References evaluateUntyped().

Referenced by llvm::MLPriorityAdvisor::getPriorityImpl().

evaluateUntyped()

virtual void * llvm::MLModelRunner::evaluateUntyped ( )

protectedpure virtual

Referenced by evaluate().

getKind()

Kind llvm::MLModelRunner::getKind ( ) const

inline

Definition at line 53 of file MLModelRunner.h.

References Type.

getTensor() [1/2]

template<typename T , typename I >

T * llvm::MLModelRunner::getTensor ( I  FeatureID )

inline

Definition at line 37 of file MLModelRunner.h.

References getTensorUntyped().

Referenced by extractInstructionFeatures(), extractMBBFrequency(), and llvm::MLPriorityAdvisor::getPriorityImpl().

getTensor() [2/2]

template<typename T , typename I >

const T * llvm::MLModelRunner::getTensor ( I  FeatureID ) const

inline

Definition at line 42 of file MLModelRunner.h.

References getTensorUntyped().

getTensorUntyped() [1/2]

void * llvm::MLModelRunner::getTensorUntyped ( size_t  Index )

inline

Definition at line 47 of file MLModelRunner.h.

Referenced by getTensor().

getTensorUntyped() [2/2]

const void * llvm::MLModelRunner::getTensorUntyped ( size_t  Index ) const

inline

Definition at line 48 of file MLModelRunner.h.

operator=()

MLModelRunner & llvm::MLModelRunner::operator= ( const MLModelRunner &  )

delete

setUpBufferForTensor()

void llvm::MLModelRunner::setUpBufferForTensor ( size_t  Index, const TensorSpec &  Spec, void *  Buffer  )

inlineprotected

Definition at line 63 of file MLModelRunner.h.

Referenced by llvm::InteractiveModelRunner::InteractiveModelRunner(), llvm::NoInferenceModelRunner::NoInferenceModelRunner(), and llvm::ReleaseModeModelRunner< TGen >::ReleaseModeModelRunner().

switchContext()

virtual void llvm::MLModelRunner::switchContext ( StringRef  Name )

inlinevirtual

Reimplemented in llvm::InteractiveModelRunner.

Definition at line 54 of file MLModelRunner.h.

Referenced by llvm::MLPriorityAdvisor::MLPriorityAdvisor().

Member Data Documentation

Ctx

LLVMContext& llvm::MLModelRunner::Ctx

protected

Definition at line 72 of file MLModelRunner.h.

Referenced by llvm::InteractiveModelRunner::InteractiveModelRunner().

Type

const Kind llvm::MLModelRunner::Type

protected

Definition at line 73 of file MLModelRunner.h.

Referenced by getKind().

---

The documentation for this class was generated from the following file:

• include/llvm/Analysis/MLModelRunner.h