lixian
|
693b4cfdc8
|
refactor cpp context, add string tensor, add get tensor by name
|
5 years ago |
wilfChen
|
a46d0c55fb
|
register akg kernel
|
5 years ago |
zhupuxu
|
3cc573b5b8
|
zero copy
Signed-off-by: zhupuxu <zhupuxu@huawei.com>
|
5 years ago |
zhupuxu
|
d490b3ad0b
|
fix bug for dynamic_batch_size
Signed-off-by: zhupuxu <zhupuxu@huawei.com>
|
5 years ago |
zhupuxu
|
5ca25451ee
|
dynamic_batch
Signed-off-by: zhupuxu <zhupuxu@huawei.com>
|
5 years ago |
wilfChen
|
0ce25b4724
|
gpu inference config
|
5 years ago |
wilfChen
|
156e8e92e9
|
gpu inference config
|
5 years ago |
mindspore-ci-bot
|
7036d35e9d
|
!12871 add 310 options
From: @zhoufeng54
Reviewed-by: @kisnwang,@xu-yfei
Signed-off-by: @xu-yfei
|
5 years ago |
zhoufeng
|
96aea47492
|
310 add context options
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
wilfChen
|
d7f5e7a571
|
gpu support tensor-rt kernel
|
5 years ago |
zhoufeng
|
7d54d627f1
|
910 parallel inference
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
5f6e15058d
|
error when loadmodel a unexist file
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
931c4f90a2
|
fix 910 cpp inference multi device id
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
lixian
|
7d2fd6e76c
|
cxx api refactor: tensor/status/model
|
5 years ago |
wilfChen
|
a911b9ef9e
|
mindspore serving support gpu backend
|
5 years ago |
zhoufeng
|
fc89d7c51d
|
910 c++ library python env finalize
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
775795253e
|
c++ library adapt to latest ascend software
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
7534916059
|
call closeTsd when cxx lib exit
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
5f25956bf8
|
310 infer with dvpp
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
ee7e412def
|
add reset device, fix runtime delete ring buffer failed
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
ad1e49b7a3
|
modify timeout of version check subprocess to 3s
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
d6fad5a0b3
|
fix 910 memory size of GetInputInfo
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
cd1ce73a25
|
remove pybind calling in cxx library
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |
zhoufeng
|
3204ecb7d6
|
mindspore c++ interface
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
|
5 years ago |