He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
5 years ago
jinyaohui
30a27b2adb
modify Gelu、FastGelu to GeLU and FastGeLU
5 years ago
mindspore-ci-bot
c9aaa70b39
!12092 Change L2Norm, merge from r1.1 to master
From: @liangzhibo
Reviewed-by: @ginfung
Signed-off-by:
5 years ago
mindspore-ci-bot
ad5b033cc5
Change L2Norm, r1.1 to master
5 years ago
jinyaohui
8022f9a6ed
modify pack to stack
5 years ago
lizhenyu
0d7fee0c53
hange tuple_getitem name to op instance name
5 years ago
mindspore-ci-bot
d02f6f4d10
!11976 fix bug for prelu mirror
From: @yangzhenzhang
Reviewed-by: @cristoval,@stsuteng
Signed-off-by: @stsuteng
5 years ago
mindspore-ci-bot
b189f177bb
Change tuple_getitem to TupleGetItem and some other ops, merge from r1.1 to master
5 years ago
yangzhenzhang
9e50b0be5c
fix bug for prelu mirror
5 years ago
l00591931
9ec100d069
Change TensorAdd to Add, from r1.1 to master
5 years ago
mindspore-ci-bot
9fa0499fa0
Change GatherV2 to Gather r1.1 to master
5 years ago
lizhenyu
f17534af08
ps cache support sparse
5 years ago
yangzhenzhang
4d20e76530
update gatherv2 tensor map
5 years ago
yangzhenzhang
7303c3d3b8
add group ckpt
5 years ago
yangzhenzhang
38ea8784c6
update infer mirror ops
5 years ago
sheng
db23661c47
rec strategy for predict
5 years ago
yangzhenzhang
9da3f9bec9
mini step grad accumulation
5 years ago
Xiaoda Zhang
3c27c08b46
change memory cost calculation in auto-parallel
5 years ago
mindspore-ci-bot
5ff6de83eb
!10173 Fix Strategy Check for UnsortedSegments
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
5 years ago
huangxinjing
a8446af1ab
Fix condition check
5 years ago
lichenever
8a09ab2110
fix auto_parallel_log_bug
5 years ago
lichenever
1d19fe8b43
fix dropout log bug
5 years ago
huangxinjing
1ff78eb167
fix range start and deta error
5 years ago
Xiaoda Zhang
aff9aaee35
calculate used_devices in VirtualDataset
5 years ago
lizhenyu
e3f7ae61db
add ps cache manager
5 years ago
alex-yuyue
5250b327ae
Fix some non-minddata typos
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
lichenever
78e131cf15
pipeline_split adapt parallel
5 years ago
yangzhenzhang
2f45b7171f
gatherv2 1-dim repeated calculation
5 years ago
yangzhenzhang
7b33f3e2ac
gatherv2 axis split repeated calculation
5 years ago
yangzhenzhang
7278f5c109
update_gatherv2_op
5 years ago
huangxinjing
f2d5f14e37
Fix review bot
5 years ago
huangxinjing
89e7778497
Add UnsortedSegmentMax Operation
5 years ago
huangxinjing
8129806475
Add slice parallel op
5 years ago
mindspore-ci-bot
ee72de1db2
!8441 Add Parallel Implements of UniformCandidateSampler
From: @huangxinjing
Reviewed-by:
Signed-off-by:
5 years ago
huangxinjing
2730cef047
Uniform Sampler Base Update
5 years ago
yangzhenzhang
d4d6c4beae
update get device list in parallel ops
5 years ago
yangzhenzhang
0c2c76d037
update get rank in parallel ops
5 years ago
huangxinjing
3e9fac7f59
Fix repeat error
5 years ago
Ziyan
17f2e6e756
fix api error and get next info
5 years ago
mindspore-ci-bot
4e07f43dff
!8323 [Auto parallel] Supporting for-loop in strategy-searching
From: @xiaoda_zh
Reviewed-by:
Signed-off-by:
5 years ago
Xiaoda Zhang
aa13d6b1cd
support for-loop in auto-parallel
5 years ago
yangzhenzhang
9747bde861
add range op
5 years ago
yangzhenzhang
0a79ab82ae
add parallel ops
5 years ago
Yi Huaijie
d7faa77b5e
support int64 shape
5 years ago
Xiaoda Zhang
aa84484049
enabling approximation in DP algorithms
5 years ago
mindspore-ci-bot
e909b9077c
!7946 fix auto parallel optimizer weight shard
Merge pull request !7946 from gziyan/fix_auto_optim_shard
5 years ago
mindspore-ci-bot
33aa2ae16b
!8063 fix ReLUV2 mask error
Merge pull request !8063 from yihuaijie/dev
5 years ago
Ziyan
c33f2cd796
fix auto optimizer weight shard
5 years ago
yao_yf
e76c8b708d
auto_parallel_dynamic_shape_supplements
5 years ago
Yi Huaijie
94f9f0ef64
fix reluv2 mask error
5 years ago