LLVM 19.0.0git
Public Member Functions | Static Public Member Functions | List of all members
llvm::ReleaseModeModelRunner< TGen > Class Template Referencefinal

ReleaseModeModelRunner - production mode implementation of the MLModelRunner. More...

#include "llvm/Analysis/ReleaseModeModelRunner.h"

Inheritance diagram for llvm::ReleaseModeModelRunner< TGen >:
Inheritance graph
[legend]

Public Member Functions

template<class FType >
 ReleaseModeModelRunner (LLVMContext &Ctx, const FType &InputSpec, StringRef DecisionName, StringRef FeedPrefix="feed_", StringRef FetchPrefix="fetch_")
 FeatureNames' type should be an indexed collection of std::string, like std::array or std::vector, that has a size() method.
 
virtual ~ReleaseModeModelRunner ()=default
 
- Public Member Functions inherited from llvm::MLModelRunner
 MLModelRunner (const MLModelRunner &)=delete
 
MLModelRunneroperator= (const MLModelRunner &)=delete
 
virtual ~MLModelRunner ()=default
 
template<typename T >
T evaluate ()
 
template<typename T , typename I >
TgetTensor (I FeatureID)
 
template<typename T , typename I >
const TgetTensor (I FeatureID) const
 
void * getTensorUntyped (size_t Index)
 
const void * getTensorUntyped (size_t Index) const
 
Kind getKind () const
 
virtual void switchContext (StringRef Name)
 

Static Public Member Functions

static bool classof (const MLModelRunner *R)
 

Additional Inherited Members

- Public Types inherited from llvm::MLModelRunner
enum class  Kind : int {
  Unknown , Release , Development , NoOp ,
  Interactive
}
 
- Protected Member Functions inherited from llvm::MLModelRunner
 MLModelRunner (LLVMContext &Ctx, Kind Type, size_t NrInputs)
 
virtual void * evaluateUntyped ()=0
 
void setUpBufferForTensor (size_t Index, const TensorSpec &Spec, void *Buffer)
 
- Protected Attributes inherited from llvm::MLModelRunner
LLVMContextCtx
 
const Kind Type
 

Detailed Description

template<class TGen>
class llvm::ReleaseModeModelRunner< TGen >

ReleaseModeModelRunner - production mode implementation of the MLModelRunner.

It uses an AOT-compiled SavedModel for efficient execution.

Definition at line 29 of file ReleaseModeModelRunner.h.

Constructor & Destructor Documentation

◆ ReleaseModeModelRunner()

template<class TGen >
template<class FType >
llvm::ReleaseModeModelRunner< TGen >::ReleaseModeModelRunner ( LLVMContext Ctx,
const FType &  InputSpec,
StringRef  DecisionName,
StringRef  FeedPrefix = "feed_",
StringRef  FetchPrefix = "fetch_" 
)
inline

FeatureNames' type should be an indexed collection of std::string, like std::array or std::vector, that has a size() method.

Definition at line 34 of file ReleaseModeModelRunner.h.

References assert(), llvm::DecisionName, I, llvm::MLModelRunner::setUpBufferForTensor(), and llvm::size().

◆ ~ReleaseModeModelRunner()

template<class TGen >
virtual llvm::ReleaseModeModelRunner< TGen >::~ReleaseModeModelRunner ( )
virtualdefault

Member Function Documentation

◆ classof()

template<class TGen >
static bool llvm::ReleaseModeModelRunner< TGen >::classof ( const MLModelRunner R)
inlinestatic

Definition at line 57 of file ReleaseModeModelRunner.h.

References llvm::MLModelRunner::Release.


The documentation for this class was generated from the following file: