Package com.viam.sdk.core.service.mlmodel

Class MLModelRPCService

java.lang.Object

com.viam.service.mlmodel.v1.MLModelServiceGrpc.MLModelServiceImplBase

com.viam.sdk.core.service.mlmodel.MLModelRPCService

All Implemented Interfaces:

ResourceRPCService<MLModel>, MLModelServiceGrpc.AsyncService, io.grpc.BindableService

public class MLModelRPCService
extends MLModelServiceGrpc.MLModelServiceImplBase
implements ResourceRPCService<MLModel>

Constructor Summary

Constructors

Constructor	Description
MLModelRPCService(ResourceManager manager)

Method Summary

Modifier and Type	Method	Description
ResourceManager	getManager()
Class<MLModel>	getResourceClass()
void	infer(Mlmodel.InferRequest request, io.grpc.stub.StreamObserver<Mlmodel.InferResponse> responseObserver)	Infer takes an already ordered input tensor as a map, makes an inference on the model, and returns an output data map.
void	metadata(Mlmodel.MetadataRequest request, io.grpc.stub.StreamObserver<Mlmodel.MetadataResponse> responseObserver)	Metadata returns the metadata associated with the ML model.
static void	setNDManager(ai.djl.ndarray.NDManager ndManager)

Methods inherited from class com.viam.service.mlmodel.v1.MLModelServiceGrpc.MLModelServiceImplBase

bindService

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.grpc.BindableService

bindService

Methods inherited from interface com.viam.sdk.core.resource.ResourceRPCService

getResource

Constructor Details

MLModelRPCService

public MLModelRPCService(ResourceManager manager)

Method Details

setNDManager

public static void setNDManager(ai.djl.ndarray.NDManager ndManager)

infer

public void infer(Mlmodel.InferRequest request,
 io.grpc.stub.StreamObserver<Mlmodel.InferResponse> responseObserver)

Description copied from interface: MLModelServiceGrpc.AsyncService

 Infer takes an already ordered input tensor as a map, makes an inference on the model, and returns an output data map.
 

Specified by:

infer in interface MLModelServiceGrpc.AsyncService

metadata

public void metadata(Mlmodel.MetadataRequest request,
 io.grpc.stub.StreamObserver<Mlmodel.MetadataResponse> responseObserver)

Description copied from interface: MLModelServiceGrpc.AsyncService

 Metadata returns the metadata associated with the ML model.
 

Specified by:

metadata in interface MLModelServiceGrpc.AsyncService

getResourceClass

public Class<MLModel> getResourceClass()

Specified by:

getResourceClass in interface ResourceRPCService<MLModel>

getManager

public ResourceManager getManager()

Specified by:

getManager in interface ResourceRPCService<MLModel>