He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
5 years ago
jinyaohui
30a27b2adb
modify Gelu、FastGelu to GeLU and FastGeLU
5 years ago
mindspore-ci-bot
ad5b033cc5
Change L2Norm, r1.1 to master
5 years ago
mindspore-ci-bot
e6221008a1
!12041 unify parameter output type
From: @zhangbuxue
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
5 years ago
mindspore-ci-bot
a6d47b9242
!12003 Rebase pynative r1.1 to master
From: @zjun3021
Reviewed-by: @chujinjin,@chujinjin
Signed-off-by:
5 years ago
buxue
81d26eaa34
unify parameter output type
5 years ago
mindspore-ci-bot
cbfba95ad0
!11921 do not broaden when arg is not tensor
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
5 years ago
zjun
b76290c155
Rebase r1.1
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
buxue
6ccc4379b4
do not broaden scalar
5 years ago
simson
e375c86d0c
allow list as parameter input & store op info using op_name instead of primitive id
5 years ago
mindspore-ci-bot
066ebe516e
!11794 remove useless code of dot
From: @yuan_shen_zhou
Reviewed-by: @liangchenghui
Signed-off-by: @liangchenghui
5 years ago
zhouyuanshen
d1e6878011
remove dot
5 years ago
lizhenyu
f17534af08
ps cache support sparse
5 years ago
mindspore-ci-bot
b9e1c3f045
!11530 support call inner net attr
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
5 years ago
buxue
3d33c4fed3
support call inner net attr
5 years ago
yujianfeng
266e960acb
Not do cse for the nodes set recomputed before recompute pass
5 years ago
xsmq
73b7154e55
fix cmakelint error
5 years ago
mindspore-ci-bot
29e5f0fcdb
!11493 modify export model error log
From: @changzherui
Reviewed-by: @zh_qh,@kingxian
Signed-off-by: @zh_qh
5 years ago
mindspore-ci-bot
5c560c7d9b
!11463 Redo delete grad flag for fixing memory not enough
From: @joylvliang
Reviewed-by: @chujinjin,@zhoufeng54
Signed-off-by: @chujinjin
5 years ago
yangzhenzhang
cbca482e59
delete useless parameter in pipeline parallel
5 years ago
changzherui
6596c0b8c1
modify export log
5 years ago
yangzhenzhang
7303c3d3b8
add group ckpt
5 years ago
lvliang
626cb9f0ab
recover-delete-grad-flag-for-fixing-memory-poor
5 years ago
mindspore-ci-bot
55594db01c
!11348 add check for outermost net inputs type and support isinstance first arg is an empty list
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
2ea8527de3
!11314 add cache embedding for wide&deep model
From: @fangzehua
Reviewed-by:
Signed-off-by:
5 years ago
buxue
e8cd572bc2
add check for outermost net inputs type and support isinstance first arg an empty list
5 years ago
fangzehua
f97e19f23f
add cache pass
5 years ago
buxue
3df40b73a5
clear parse or resolve debug info
5 years ago
buxue
69d9a33ddb
show line of code when parse or resolve phase exception
5 years ago
mindspore-ci-bot
7f7e790565
!11188 Fix address is nullptr in value node
From: @joylvliang
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
74e619b9c4
!11277 [ME]Add dump ir level env and for to while env
From: @chenfei52
Reviewed-by:
Signed-off-by:
5 years ago
chenfei
874f350eb9
add dump level
5 years ago
zjun
e0c3853af2
Fix pynative graph have already run compiled bug in second derivate order
5 years ago
mindspore-ci-bot
eacc8bac89
!10755 [Numpy-Native] Add new numpy-native interfaces to mindspore.numpy
From: @yanglf1121
Reviewed-by:
Signed-off-by:
5 years ago
yanglf1121
72903c11c8
add array_ops, math_ops and tensor ops
5 years ago
buxue
acec35d4d4
support non tensor inputs
5 years ago
mindspore-ci-bot
e805d06499
!11179 revert dynamic op re primitive when infer
From: @liubuyu
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
5 years ago
liubuyu
c84647cc51
revert re primitive
5 years ago
zjun
45c6f30065
Opitimize pynative grad graph already run
5 years ago
mindspore-ci-bot
68ce3077d4
!11106 fix device memory leak in pynative mode
From: @chujinjin
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
5 years ago
chujinjin
ade9a82c2b
fix device memory leak
5 years ago
mindspore-ci-bot
92a85d1061
!11075 dynamic op re primitive when infer
From: @liubuyu
Reviewed-by: @kisnwang,@zhoufeng54
Signed-off-by: @zhoufeng54
5 years ago
liubuyu
39cc9e70cd
dynamic op re primitive when infer
5 years ago
mindspore-ci-bot
437816551e
!11010 Fix bug of RunOp context checker in GRAPH_MODE
From: @jojobugfree
Reviewed-by: @kisnwang,@chujinjin
Signed-off-by: @chujinjin
5 years ago
mindspore-ci-bot
1c942ce49f
!10221 support grad accumulation for auto parallel
From: @yangzhenzhang
Reviewed-by:
Signed-off-by:
5 years ago
caifubi
efe4f8a8fb
Fix bug of RunOp context checker in GRAPH_MODE
5 years ago
yangzhenzhang
9da3f9bec9
mini step grad accumulation
5 years ago
buxue
6d395c1d3f
keep consistent in Graph mode and PyNative mode for 'isinstance'
5 years ago
mindspore-ci-bot
61869a6602
!10901 Add compile profiling for PyNative mode.
From: @zh_qh
Reviewed-by: @ginfung,@zhunaipan
Signed-off-by: @zhunaipan
5 years ago
buxue
985772c192
fix bug when MixedPrecisionCast op return a tuple with many elements
5 years ago