mwang
6e70ed105b
adjust second allreduce split indices
5 years ago
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
5 years ago
mwang
0b312c2385
thor generalization code submit
5 years ago
mindspore-ci-bot
9fa0499fa0
Change GatherV2 to Gather r1.1 to master
5 years ago
lizhenyu
f17534af08
ps cache support sparse
5 years ago
wangshuide2020
4cca77cb88
add validation of ApplyMomentum and update annotation of Broadcast, DistributedGradReducer, GlobalBatchNorm, etc. operators.
5 years ago
mindspore-ci-bot
2ea8527de3
!11314 add cache embedding for wide&deep model
From: @fangzehua
Reviewed-by:
Signed-off-by:
5 years ago
fangzehua
f97e19f23f
add cache pass
5 years ago
wangshuide2020
2e078eefb4
update annotation of WarmUpLR, FTRL, LARS, etc. operators.
5 years ago
wangshuide2020
88b5e96d0c
update annotation of Norm, Range, Ftrl, etc. operators.
5 years ago
yanghaoran
58bae307d6
fix bugs
5 years ago
lihongkang
5bd1a198ad
fix bugs
5 years ago
zhangyi
5b5cfee0b1
fix some api comments.
5 years ago
shibeiji
b2d98d2751
add tbe fusion operators LambApplyOptimizerAssign and LambApplyWeightAssign for lamb optimizer
5 years ago
dayschan
a661c3dd40
fix warning for enable_graph_kernel context in CPU device
5 years ago
mindspore-ci-bot
aecd96cdb2
!10424 Compute weighted loss
From: @xuguoyang5566
Reviewed-by: @wuxuejian
Signed-off-by:
5 years ago
Ziyan
660f578988
fix standalone prediction
5 years ago
xuguoyang
7fe25d6444
Add weights loss compute
5 years ago
wangshuide2020
4b693377dc
update documentation of warmup_lr, F1, RMSProp, BatchNorm2d and add some pictures of links of activation function.
5 years ago
lihongkang
d499135f43
fix bugs
5 years ago
mindspore-ci-bot
00611b1c41
!10175 Add tensor.ndim and rename tensor.size() to tensor.size
From: @yanglf1121
Reviewed-by: @kingxian,@zhunaipan
Signed-off-by: @kingxian
5 years ago
Ziyan
c5c905fdf5
add restriction for opt shard
5 years ago
yanglf1121
918679daa3
add tensor.ndim and rename tensor.size() to tensor.size
5 years ago
lihongkang
c27d27c46e
fix bugs
5 years ago
mindspore-ci-bot
50ccfecb7b
!10057 update the description of some operations.
From: @wangshuide2020
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
5 years ago
wangshuide2020
fd74df15c8
update the description of some operations.
5 years ago
Jiaqi
1f6be29792
cpu check
5 years ago
mindspore-ci-bot
9eb6fb01bc
!9973 update the doc string of some operations.
From: @wangshuide2020
Reviewed-by: @liangchenghui,@wuxuejian
Signed-off-by: @liangchenghui
5 years ago
lizhenyu
a8e15e2dd1
[bugfix]Momentum does not suport ps cache leading to process aborted
5 years ago
wangshuide2020
abf0d30537
update the doc string of some operations.
5 years ago
mindspore-ci-bot
a9dab042a4
!9706 Remove unused interfaces in graph_kernels.py and change remaining to inner interfaces
From: @looop5
Reviewed-by: @ckey_dou
Signed-off-by:
5 years ago
looop5
4d8205cd93
Delete unused interface in graph_kernels.py
5 years ago
lizhenyu
e3f7ae61db
add ps cache manager
5 years ago
lihongkang
679651f344
fix bugs
5 years ago
mindspore-ci-bot
231fccf66c
!9600 Add Adagrad Optimizer
From: @zyx5256
Reviewed-by: @liangchenghui,@kingxian
Signed-off-by: @liangchenghui
5 years ago
zhuyuxiao
37bebc751b
add adagrad optim
5 years ago
caifubi
3033ae295c
Create Tensor for assignadd input in Optimizer
5 years ago
wangnan39@huawei.com
9b545e4982
fix bug in example of Lamb
5 years ago
mindspore-ci-bot
386f6e0d2b
!8963 Updating notes of remaining examples in nn and ops' folders
From: @zhangz0911gm
Reviewed-by: @liangchenghui,@zhunaipan
Signed-off-by: @zhunaipan
5 years ago
zhangz0911gm
7b1d1ca831
Updating remaining notes
5 years ago
caifubi
702ab2bac2
Change const tensor dtype to fp16
5 years ago
mindspore-ci-bot
3f75f13556
!8648 PyNative Performance Optimization
From: @jojobugfree
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
d79a454564
!8890 Add labels to python files
From: @JunYuLiu
Reviewed-by: @gemini524
Signed-off-by:
5 years ago
mindspore-ci-bot
71a3086fff
!8261 gpu support heterogeneous network
From: @wilfchen
Reviewed-by: @limingqi107,@cristoval
Signed-off-by: @cristoval
5 years ago
JunYuLiu
1eaa4a30dd
Add labels to python files
5 years ago
caifubi
c7d6997819
pynative host device parallel
5 years ago
mindspore-ci-bot
d8a7fd8801
!8734 Code_docs updating notes of examples in nn_folder
From: @zhangz0911gm
Reviewed-by: @zhunaipan,@liangchenghui
Signed-off-by: @liangchenghui
5 years ago
mindspore-ci-bot
a3ae3b9794
!8695 add AdamOffload optimizer
From: @wangnan39
Reviewed-by: @stsuteng,@stsuteng,@kingxian
Signed-off-by: @kingxian
5 years ago
mindspore-ci-bot
fb0e866ad1
!8269 forward unique dynamic shape
From: @yao_yf
Reviewed-by:
Signed-off-by:
5 years ago
wangnan39@huawei.com
ab811fca8f
add AdamOffload optimizer
5 years ago