LLVM 18.0.0git
|
ReleaseModeModelRunner - production mode implementation of the MLModelRunner. More...
#include "llvm/Analysis/ReleaseModeModelRunner.h"
Public Member Functions | |
template<class FType > | |
ReleaseModeModelRunner (LLVMContext &Ctx, const FType &InputSpec, StringRef DecisionName, StringRef FeedPrefix="feed_", StringRef FetchPrefix="fetch_") | |
FeatureNames' type should be an indexed collection of std::string, like std::array or std::vector, that has a size() method. | |
virtual | ~ReleaseModeModelRunner ()=default |
![]() | |
MLModelRunner (const MLModelRunner &)=delete | |
MLModelRunner & | operator= (const MLModelRunner &)=delete |
virtual | ~MLModelRunner ()=default |
template<typename T > | |
T | evaluate () |
template<typename T , typename I > | |
T * | getTensor (I FeatureID) |
template<typename T , typename I > | |
const T * | getTensor (I FeatureID) const |
void * | getTensorUntyped (size_t Index) |
const void * | getTensorUntyped (size_t Index) const |
Kind | getKind () const |
virtual void | switchContext (StringRef Name) |
Static Public Member Functions | |
static bool | classof (const MLModelRunner *R) |
Additional Inherited Members | |
![]() | |
enum class | Kind : int { Unknown , Release , Development , NoOp , Interactive } |
![]() | |
MLModelRunner (LLVMContext &Ctx, Kind Type, size_t NrInputs) | |
virtual void * | evaluateUntyped ()=0 |
void | setUpBufferForTensor (size_t Index, const TensorSpec &Spec, void *Buffer) |
![]() | |
LLVMContext & | Ctx |
const Kind | Type |
ReleaseModeModelRunner - production mode implementation of the MLModelRunner.
It uses an AOT-compiled SavedModel for efficient execution.
Definition at line 29 of file ReleaseModeModelRunner.h.
|
inline |
FeatureNames' type should be an indexed collection of std::string, like std::array or std::vector, that has a size() method.
Definition at line 34 of file ReleaseModeModelRunner.h.
References assert(), llvm::DecisionName, I, llvm::MLModelRunner::setUpBufferForTensor(), and llvm::size().
|
virtualdefault |
|
inlinestatic |
Definition at line 57 of file ReleaseModeModelRunner.h.
References llvm::MLModelRunner::Release.