Support gRPC and RESTful API.
Support simple Python API for Client and Server.
Support Model configuration,User can customize preprocessing & postprocessing for model.
Support multiple models,Multiple models can run simultaneously.
Support Model batching,Multiple instances will be split and combined to meet the batch size requirements of the model.