Interface MLModelServiceGrpc.AsyncService

All Known Implementing Classes:
MLModelRPCService, MLModelServiceGrpc.MLModelServiceImplBase
Enclosing class:
MLModelServiceGrpc

public static interface MLModelServiceGrpc.AsyncService
 MLModelService declares the gRPC contract for a service that takes in a map of input arrays/tensors,
 runs them through an ML inference engine, and outputs a map of array/tensors.
 
  • Method Summary

    Modifier and Type
    Method
    Description
    default void
    infer(Mlmodel.InferRequest request, io.grpc.stub.StreamObserver<Mlmodel.InferResponse> responseObserver)
    Infer takes an already ordered input tensor as a map, makes an inference on the model, and returns an output data map.
    default void
    metadata(Mlmodel.MetadataRequest request, io.grpc.stub.StreamObserver<Mlmodel.MetadataResponse> responseObserver)
    Metadata returns the metadata associated with the ML model.
  • Method Details

    • infer

      default void infer(Mlmodel.InferRequest request, io.grpc.stub.StreamObserver<Mlmodel.InferResponse> responseObserver)
       Infer takes an already ordered input tensor as a map, makes an inference on the model, and returns an output data map.
       
    • metadata

      default void metadata(Mlmodel.MetadataRequest request, io.grpc.stub.StreamObserver<Mlmodel.MetadataResponse> responseObserver)
       Metadata returns the metadata associated with the ML model.