huangbingjian
b56fc0c2af
[auto-monad] Do not insert VirtualDiv after UpdateState
5 years ago
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
5 years ago
jinyaohui
30a27b2adb
modify Gelu、FastGelu to GeLU and FastGeLU
5 years ago
mindspore-ci-bot
24e528112f
!12134 improve grad of first input
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
c9aaa70b39
!12092 Change L2Norm, merge from r1.1 to master
From: @liangzhibo
Reviewed-by: @ginfung
Signed-off-by:
5 years ago
buxue
899d6114a4
improve grad of first input
5 years ago
mindspore-ci-bot
ad5b033cc5
Change L2Norm, r1.1 to master
5 years ago
mindspore-ci-bot
623cca4214
!12071 Refactor grad operation implementation.
From: @zh_qh
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
74652eb942
!12044 modify pack to stack
From: @jinyaohui
Reviewed-by:
Signed-off-by:
5 years ago
jinyaohui
8022f9a6ed
modify pack to stack
5 years ago
Zhang Qinghua
c621a48533
Refactor grad operation implementation.
5 years ago
l00591931
c497bcf98a
Change GatherV2P to GatherP
5 years ago
lizhenyu
0d7fee0c53
hange tuple_getitem name to op instance name
5 years ago
mindspore-ci-bot
d02f6f4d10
!11976 fix bug for prelu mirror
From: @yangzhenzhang
Reviewed-by: @cristoval,@stsuteng
Signed-off-by: @stsuteng
5 years ago
mindspore-ci-bot
b189f177bb
Change tuple_getitem to TupleGetItem and some other ops, merge from r1.1 to master
5 years ago
yangzhenzhang
9e50b0be5c
fix bug for prelu mirror
5 years ago
mindspore-ci-bot
e897eb4c41
!11915 Change TensorAdd to Add, merge from r1.1 to master
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
5 years ago
l00591931
9ec100d069
Change TensorAdd to Add, from r1.1 to master
5 years ago
mindspore-ci-bot
066ebe516e
!11794 remove useless code of dot
From: @yuan_shen_zhou
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
5 years ago
zhouyuanshen
d1e6878011
remove dot
5 years ago
mindspore-ci-bot
9fa0499fa0
Change GatherV2 to Gather r1.1 to master
5 years ago
lizhenyu
f17534af08
ps cache support sparse
5 years ago
mindspore-ci-bot
b9e1c3f045
!11530 support call inner net attr
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
5 years ago
buxue
3d33c4fed3
support call inner net attr
5 years ago
mindspore-ci-bot
e02b6852cb
!11462 add pipe for cache embedding
From: @fangzehua
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
b67314827e
!11583 Not do cse for the nodes set recomputed before recompute pass
From: @ginfung
Reviewed-by:
Signed-off-by:
5 years ago
yujianfeng
266e960acb
Not do cse for the nodes set recomputed before recompute pass
5 years ago
fangzehua
9fddc2e1e4
add pipe
5 years ago
sheng
b97e99b9ce
change a log level to info
5 years ago
xsmq
73b7154e55
fix cmakelint error
5 years ago
yangzhenzhang
4d20e76530
update gatherv2 tensor map
5 years ago
yangzhenzhang
cbca482e59
delete useless parameter in pipeline parallel
5 years ago
yangzhenzhang
7303c3d3b8
add group ckpt
5 years ago
mindspore-ci-bot
55594db01c
!11348 add check for outermost net inputs type and support isinstance first arg is an empty list
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
2ea8527de3
!11314 add cache embedding for wide&deep model
From: @fangzehua
Reviewed-by:
Signed-off-by:
5 years ago
buxue
e8cd572bc2
add check for outermost net inputs type and support isinstance first arg an empty list
5 years ago
fangzehua
f97e19f23f
add cache pass
5 years ago
yujianfeng
08e00b20a9
Move the whole graph nodes firstly for the single used graph when inline
5 years ago
mindspore-ci-bot
74e619b9c4
!11277 [ME]Add dump ir level env and for to while env
From: @chenfei52
Reviewed-by:
Signed-off-by:
5 years ago
chenfei
874f350eb9
add dump level
5 years ago
yangzhenzhang
38ea8784c6
update infer mirror ops
5 years ago
buxue
acec35d4d4
support non tensor inputs
5 years ago
sheng
db23661c47
rec strategy for predict
5 years ago
mindspore-ci-bot
21addb331d
!11009 Fix continuous calls for recompute api
From: @ginfung
Reviewed-by: @zhunaipan,@zh_qh
Signed-off-by: @zh_qh
5 years ago
yujianfeng
7cac3d3a47
Fix continuous calls for recompute api
5 years ago
mindspore-ci-bot
1c942ce49f
!10221 support grad accumulation for auto parallel
From: @yangzhenzhang
Reviewed-by:
Signed-off-by:
5 years ago
yujianfeng
ba311cf57f
Add cnode attr for recomputation
5 years ago
yangzhenzhang
9da3f9bec9
mini step grad accumulation
5 years ago
mindspore-ci-bot
275da50b32
!10474 Add recomputed pass
From: @ginfung
Reviewed-by:
Signed-off-by:
5 years ago
yujianfeng
7b412d7cb2
add recompute nodes
5 years ago