You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
1. MindSpore Serving 1.2.0 Release Notes
1.1. Major Features and Improvements
1.1.1. Serving Framework
- [STABLE] Support distributed inference, it needs to cooperate with distributed training to export distributed models for super-large-scale neural network parameters.
- [STABLE] Support GPU platform, Serving worker nodes can be deployer on GPU, Ascend 310 and Ascend 910.
2. MindSpore Serving 1.1.0 Release Notes
2.1. Major Features and Improvements
2.1.1. Ascend 310 & Ascend 910 Serving Framework
- [STABLE] Support gRPC and RESTful API.
- [STABLE] Support simple Python API for Client and Server.
- [STABLE] Support Model configuration,User can customize preprocessing & postprocessing for model.
- [STABLE] Support multiple models,Multiple models can run simultaneously.
- [STABLE] Support Model batching,Multiple instances will be split and combined to meet the batch size requirements of the model.