LLVM 18.0.0git
|
MLModelRunner interface: abstraction of a mechanism for evaluating a tensorflow "saved model". More...
#include "llvm/Analysis/MLModelRunner.h"
Public Types | |
enum class | Kind : int { Unknown , Release , Development , NoOp , Interactive } |
Public Member Functions | |
MLModelRunner (const MLModelRunner &)=delete | |
MLModelRunner & | operator= (const MLModelRunner &)=delete |
virtual | ~MLModelRunner ()=default |
template<typename T > | |
T | evaluate () |
template<typename T , typename I > | |
T * | getTensor (I FeatureID) |
template<typename T , typename I > | |
const T * | getTensor (I FeatureID) const |
void * | getTensorUntyped (size_t Index) |
const void * | getTensorUntyped (size_t Index) const |
Kind | getKind () const |
virtual void | switchContext (StringRef Name) |
Protected Member Functions | |
MLModelRunner (LLVMContext &Ctx, Kind Type, size_t NrInputs) | |
virtual void * | evaluateUntyped ()=0 |
void | setUpBufferForTensor (size_t Index, const TensorSpec &Spec, void *Buffer) |
Protected Attributes | |
LLVMContext & | Ctx |
const Kind | Type |
MLModelRunner interface: abstraction of a mechanism for evaluating a tensorflow "saved model".
NOTE: feature indices are expected to be consistent all accross MLModelRunners (pertaining to the same model), and also Loggers (see TFUtils.h)
Definition at line 24 of file MLModelRunner.h.
|
strong |
Enumerator | |
---|---|
Unknown | |
Release | |
Development | |
NoOp | |
Interactive |
Definition at line 50 of file MLModelRunner.h.
|
delete |
|
virtualdefault |
|
inlineprotected |
Definition at line 55 of file MLModelRunner.h.
Definition at line 31 of file MLModelRunner.h.
References evaluateUntyped().
Referenced by llvm::MLPriorityAdvisor::getPriorityImpl().
|
protectedpure virtual |
Referenced by evaluate().
|
inline |
Definition at line 51 of file MLModelRunner.h.
References Type.
Definition at line 35 of file MLModelRunner.h.
References getTensorUntyped().
Referenced by extractInstructionFeatures(), extractMBBFrequency(), and llvm::MLPriorityAdvisor::getPriorityImpl().
Definition at line 40 of file MLModelRunner.h.
References getTensorUntyped().
|
inline |
Definition at line 45 of file MLModelRunner.h.
Referenced by getTensor().
|
inline |
Definition at line 46 of file MLModelRunner.h.
|
delete |
|
inlineprotected |
Definition at line 61 of file MLModelRunner.h.
Referenced by llvm::InteractiveModelRunner::InteractiveModelRunner(), llvm::NoInferenceModelRunner::NoInferenceModelRunner(), and llvm::ReleaseModeModelRunner< TGen >::ReleaseModeModelRunner().
|
inlinevirtual |
Reimplemented in llvm::InteractiveModelRunner.
Definition at line 52 of file MLModelRunner.h.
Referenced by llvm::MLPriorityAdvisor::MLPriorityAdvisor().
|
protected |
Definition at line 70 of file MLModelRunner.h.
Referenced by llvm::InteractiveModelRunner::InteractiveModelRunner().
Definition at line 71 of file MLModelRunner.h.
Referenced by getKind().