mindspore-ci-bot
7fcce73c51
!12700 add grad accumulation combined with optimizer parallel
From: @yangzhenzhang
Reviewed-by:
Signed-off-by:
5 years ago
chendongsheng
db0a6f1e19
replace ps-lite
5 years ago
yangzhenzhang
a70d616841
mini step grad accumulation
5 years ago
mindspore-ci-bot
b13cabeb10
!12621 Eliminate all redundant nodes related to UpdateStates.
From: @zh_qh
Reviewed-by: @ginfung,@hwhewei
Signed-off-by: @ginfung
5 years ago
Zhang Qinghua
9b26c210f4
Eliminate all useless nodes related to UpdateStates.
5 years ago
huangbingjian
0bbd95d7a0
modify CheckpointStrategy to adapt load operator
5 years ago
mindspore-ci-bot
2c5d19260e
!12434 fix operator_info is null
From: @Margaret_wangrui
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
da6e6728b1
!12515 fix shape_ptr is nullptr:Umonad should not get shape
From: @Margaret_wangrui
Reviewed-by:
Signed-off-by:
5 years ago
fangzehua
3235ebbdab
fix cache acc
5 years ago
Margaret_wangrui
0aaa31764e
Do not get shape for monad type
5 years ago
Margaret_wangrui
a5fa4918f5
fix operator_info is null
5 years ago
yangzhenzhang
70aa0dc5e2
modify get output layout
5 years ago
huangbingjian
b56fc0c2af
[auto-monad] Do not insert VirtualDiv after UpdateState
5 years ago
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
5 years ago
jinyaohui
30a27b2adb
modify Gelu、FastGelu to GeLU and FastGeLU
5 years ago
mindspore-ci-bot
c9aaa70b39
!12092 Change L2Norm, merge from r1.1 to master
From: @liangzhibo
Reviewed-by: @ginfung
Signed-off-by:
5 years ago
mindspore-ci-bot
ad5b033cc5
Change L2Norm, r1.1 to master
5 years ago
mindspore-ci-bot
74652eb942
!12044 modify pack to stack
From: @jinyaohui
Reviewed-by:
Signed-off-by:
5 years ago
jinyaohui
8022f9a6ed
modify pack to stack
5 years ago
l00591931
c497bcf98a
Change GatherV2P to GatherP
5 years ago
lizhenyu
0d7fee0c53
hange tuple_getitem name to op instance name
5 years ago
mindspore-ci-bot
d02f6f4d10
!11976 fix bug for prelu mirror
From: @yangzhenzhang
Reviewed-by: @cristoval,@stsuteng
Signed-off-by: @stsuteng
5 years ago
mindspore-ci-bot
b189f177bb
Change tuple_getitem to TupleGetItem and some other ops, merge from r1.1 to master
5 years ago
yangzhenzhang
9e50b0be5c
fix bug for prelu mirror
5 years ago
l00591931
9ec100d069
Change TensorAdd to Add, from r1.1 to master
5 years ago
mindspore-ci-bot
9fa0499fa0
Change GatherV2 to Gather r1.1 to master
5 years ago
lizhenyu
f17534af08
ps cache support sparse
5 years ago
mindspore-ci-bot
e02b6852cb
!11462 add pipe for cache embedding
From: @fangzehua
Reviewed-by:
Signed-off-by:
5 years ago
fangzehua
9fddc2e1e4
add pipe
5 years ago
sheng
b97e99b9ce
change a log level to info
5 years ago
xsmq
73b7154e55
fix cmakelint error
5 years ago
yangzhenzhang
4d20e76530
update gatherv2 tensor map
5 years ago
yangzhenzhang
cbca482e59
delete useless parameter in pipeline parallel
5 years ago
yangzhenzhang
7303c3d3b8
add group ckpt
5 years ago
mindspore-ci-bot
2ea8527de3
!11314 add cache embedding for wide&deep model
From: @fangzehua
Reviewed-by:
Signed-off-by:
5 years ago
fangzehua
f97e19f23f
add cache pass
5 years ago
yangzhenzhang
38ea8784c6
update infer mirror ops
5 years ago
sheng
db23661c47
rec strategy for predict
5 years ago
yangzhenzhang
9da3f9bec9
mini step grad accumulation
5 years ago
Ziyan
98566ddc07
enable gradients mean in opt shard
5 years ago
mindspore-ci-bot
fae4246811
!10683 [Auto paralel] Change memory cost calculation in auto-parallel
From: @xiaoda_zh
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
5 years ago
lichenever
39306d64fb
opt_pipeline_split
5 years ago
Xiaoda Zhang
3c27c08b46
change memory cost calculation in auto-parallel
5 years ago
mindspore-ci-bot
b67aaf6773
!9832 expose_allgather_fusion_to_users
From: @gong_zi_yan
Reviewed-by:
Signed-off-by:
5 years ago
Ziyan
bbf8ec82b9
expose allgather fusion interface to users
5 years ago
lichenever
9595502278
optimizer_pipline_split
5 years ago
sheng
e2d713ddbf
update new strategy for UnsortedSegments to fit stra check
5 years ago
mindspore-ci-bot
84f9a2bdde
!10209 [AutoParallell] take manually configured strategies in consideration
From: @ch-l
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
5 years ago
mindspore-ci-bot
5ff6de83eb
!10173 Fix Strategy Check for UnsortedSegments
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
5 years ago
huangxinjing
a8446af1ab
Fix condition check
5 years ago