huangbingjian
b56fc0c2af
[auto-monad] Do not insert VirtualDiv after UpdateState
5 years ago
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
5 years ago
jinyaohui
30a27b2adb
modify Gelu、FastGelu to GeLU and FastGeLU
5 years ago
mindspore-ci-bot
c9aaa70b39
!12092 Change L2Norm, merge from r1.1 to master
From: @liangzhibo
Reviewed-by: @ginfung
Signed-off-by:
5 years ago
mindspore-ci-bot
ad5b033cc5
Change L2Norm, r1.1 to master
5 years ago
mindspore-ci-bot
74652eb942
!12044 modify pack to stack
From: @jinyaohui
Reviewed-by:
Signed-off-by:
5 years ago
jinyaohui
8022f9a6ed
modify pack to stack
5 years ago
l00591931
c497bcf98a
Change GatherV2P to GatherP
5 years ago
lizhenyu
0d7fee0c53
hange tuple_getitem name to op instance name
5 years ago
mindspore-ci-bot
d02f6f4d10
!11976 fix bug for prelu mirror
From: @yangzhenzhang
Reviewed-by: @cristoval,@stsuteng
Signed-off-by: @stsuteng
5 years ago
mindspore-ci-bot
b189f177bb
Change tuple_getitem to TupleGetItem and some other ops, merge from r1.1 to master
5 years ago
yangzhenzhang
9e50b0be5c
fix bug for prelu mirror
5 years ago
l00591931
9ec100d069
Change TensorAdd to Add, from r1.1 to master
5 years ago
mindspore-ci-bot
9fa0499fa0
Change GatherV2 to Gather r1.1 to master
5 years ago
lizhenyu
f17534af08
ps cache support sparse
5 years ago
mindspore-ci-bot
e02b6852cb
!11462 add pipe for cache embedding
From: @fangzehua
Reviewed-by:
Signed-off-by:
5 years ago
fangzehua
9fddc2e1e4
add pipe
5 years ago
sheng
b97e99b9ce
change a log level to info
5 years ago
xsmq
73b7154e55
fix cmakelint error
5 years ago
yangzhenzhang
4d20e76530
update gatherv2 tensor map
5 years ago
yangzhenzhang
cbca482e59
delete useless parameter in pipeline parallel
5 years ago
yangzhenzhang
7303c3d3b8
add group ckpt
5 years ago
mindspore-ci-bot
2ea8527de3
!11314 add cache embedding for wide&deep model
From: @fangzehua
Reviewed-by:
Signed-off-by:
5 years ago
fangzehua
f97e19f23f
add cache pass
5 years ago
yangzhenzhang
38ea8784c6
update infer mirror ops
5 years ago
sheng
db23661c47
rec strategy for predict
5 years ago
yangzhenzhang
9da3f9bec9
mini step grad accumulation
5 years ago
Ziyan
98566ddc07
enable gradients mean in opt shard
5 years ago
mindspore-ci-bot
fae4246811
!10683 [Auto paralel] Change memory cost calculation in auto-parallel
From: @xiaoda_zh
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
5 years ago
lichenever
39306d64fb
opt_pipeline_split
5 years ago
Xiaoda Zhang
3c27c08b46
change memory cost calculation in auto-parallel
5 years ago
mindspore-ci-bot
b67aaf6773
!9832 expose_allgather_fusion_to_users
From: @gong_zi_yan
Reviewed-by:
Signed-off-by:
5 years ago
Ziyan
bbf8ec82b9
expose allgather fusion interface to users
5 years ago
lichenever
9595502278
optimizer_pipline_split
5 years ago
sheng
e2d713ddbf
update new strategy for UnsortedSegments to fit stra check
5 years ago
mindspore-ci-bot
84f9a2bdde
!10209 [AutoParallell] take manually configured strategies in consideration
From: @ch-l
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
5 years ago
mindspore-ci-bot
5ff6de83eb
!10173 Fix Strategy Check for UnsortedSegments
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
5 years ago
huangxinjing
a8446af1ab
Fix condition check
5 years ago
sheng
dbab352861
support user defined strategy
5 years ago
lichenever
8a09ab2110
fix auto_parallel_log_bug
5 years ago
lichenever
1d19fe8b43
fix dropout log bug
5 years ago
huangxinjing
1ff78eb167
fix range start and deta error
5 years ago
yao_yf
73dbc8e7ae
fix_auto_parallel_dynamic_shape_map_set
5 years ago
Xiaoda Zhang
aff9aaee35
calculate used_devices in VirtualDataset
5 years ago
mindspore-ci-bot
5e35bec957
!9799 change_last_nodes_strategy_in_auto_parallel_when_eval_and_predict
From: @yao_yf
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
5 years ago
yao_yf
19fe28cb9b
hange strategys of last nodes in eval/predict at auto parallel mode
5 years ago
Xiaoda Zhang
176c028c65
add initcostgraph to rec_algo
5 years ago
Xiaoda Zhang
e78228603b
move parallel-related black-list to core/ir, and fix the cloneCNode bug
5 years ago
mindspore-ci-bot
0e6876205f
!9725 redistribution_support_all_repeat_cal_when_dev_matrix_diff
From: @yao_yf
Reviewed-by: @stsuteng,@liangchenghui
Signed-off-by: @stsuteng
5 years ago
mindspore-ci-bot
a4b010cea8
!9746 add ps cache
From: @zyli2020
Reviewed-by:
Signed-off-by:
5 years ago