He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
5 years ago
jinyaohui
30a27b2adb
modify Gelu、FastGelu to GeLU and FastGeLU
5 years ago
mindspore-ci-bot
ad5b033cc5
Change L2Norm, r1.1 to master
5 years ago
zjun
b76290c155
Rebase r1.1
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
simson
e375c86d0c
allow list as parameter input & store op info using op_name instead of primitive id
5 years ago
lvliang
626cb9f0ab
recover-delete-grad-flag-for-fixing-memory-poor
5 years ago
zjun
e0c3853af2
Fix pynative graph have already run compiled bug in second derivate order
5 years ago
mindspore-ci-bot
e805d06499
!11179 revert dynamic op re primitive when infer
From: @liubuyu
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
5 years ago
liubuyu
c84647cc51
revert re primitive
5 years ago
zjun
45c6f30065
Opitimize pynative grad graph already run
5 years ago
mindspore-ci-bot
68ce3077d4
!11106 fix device memory leak in pynative mode
From: @chujinjin
Reviewed-by: @zhoufeng54,@kisnwang
Signed-off-by: @kisnwang
5 years ago
chujinjin
ade9a82c2b
fix device memory leak
5 years ago
mindspore-ci-bot
92a85d1061
!11075 dynamic op re primitive when infer
From: @liubuyu
Reviewed-by: @kisnwang,@zhoufeng54
Signed-off-by: @zhoufeng54
5 years ago
liubuyu
39cc9e70cd
dynamic op re primitive when infer
5 years ago
caifubi
efe4f8a8fb
Fix bug of RunOp context checker in GRAPH_MODE
5 years ago
buxue
985772c192
fix bug when MixedPrecisionCast op return a tuple with many elements
5 years ago
mindspore-ci-bot
b7b7c591ee
!10620 fix memory leak by clear cache when a new step starts
From: @simson_wu
Reviewed-by: @chujinjin
Signed-off-by: @chujinjin
5 years ago
simson
759e43957e
fix memory leak
5 years ago
caifubi
7366fcf761
Add PyNative parallel context checker
5 years ago
buxue
2739b6d5e5
fix the bug for op when return a single element tuple in PyNative mode
5 years ago
mindspore-ci-bot
44abd94b42
!9408 [ME][Pynative]Fix mem leak problem in pynative mode
From: @chenfei52
Reviewed-by:
Signed-off-by:
5 years ago
chenfei
1f20e552ed
handle mem leak in pynative mode
use enter and leave construct
5 years ago
zjun
5ce00d4de2
Fix bprop describe
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
mindspore-ci-bot
32dc10a735
!9864 Adjust the location of cleaning unuse memory in value node
From: @joylvliang
Reviewed-by:
Signed-off-by:
5 years ago
zjun
020bd96976
Fix pynative parameters seoncd derivative
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
lvliang
1490947ff0
adjust-the-location-of-cleaning-unuseless-memory-in-value-node
5 years ago
zjun
942b6928ab
Fix bprop dynamic
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
zjun
c0f02dfaf8
Opitimize pynative bprop
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
zjun
3e1358fe94
Fix bprop second derivative
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
chujinjin
98d6898438
fix embeddinglookup error on cpu pynative mode
5 years ago
zjun
96b0452c14
Fix pynative order derivetive memory
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
lvliang
6d477ef17c
fix-bug-of-mistakenly-deleting-address-of-scalar-value-node
5 years ago
zjun
67866474f9
Add pynative second derivative function
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
mindspore-ci-bot
afa931ae79
!9308 Clean useless tensor after run pynative bprop graph
From: @HulkTang
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
b5be4e0402
!9711 change cell id for pynative to fix clipnorm execute error
From: @chujinjin
Reviewed-by: @limingqi107,@zhoufeng54
Signed-off-by: @zhoufeng54
5 years ago
mindspore-ci-bot
d694c5ab18
!9708 ifdef __APPLE -> #if defined(__APPLE__)
From: @xiaoyisd
Reviewed-by: @sanjaychan,@zh_qh,@liangchenghui
Signed-off-by: @zh_qh
5 years ago
mindspore-ci-bot
7bc084487e
!9654 optimize scalar to tensor function
From: @zhangbuxue
Reviewed-by:
Signed-off-by:
5 years ago
chujinjin
90967215d3
change cell id for pynative
5 years ago
xiaoyisd
0cf09f4b8e
ifdef __APPLE -> #if defined(__APPLE__)
5 years ago
mindspore-ci-bot
c2ad16352f
!9532 build for mac
From: @xiaoyisd
Reviewed-by:
Signed-off-by:
5 years ago
buxue
0647b8b7db
optimize scalar to tensor function
5 years ago
tanghuikang
82450afa9e
Optimize memory using in pynative mode
5 years ago
xiaoyisd
424999267a
mac build
5 years ago
lvliang
a7df90a555
fix-bug-of-nullptr-in-valuenode-when-parametr-connect-with-backward-op
5 years ago
mindspore-ci-bot
d38f8205dc
!8987 support getnext in pynative mode
From: @chujinjin
Reviewed-by:
Signed-off-by:
5 years ago
lvliang
8984cc9c03
pynative-support-dynamic-op-run-in-gpu
5 years ago
chujinjin
af031410bb
support getnext in pynative
5 years ago
mindspore-ci-bot
89535c4612
!9488 Fix DropoutGenMask output shape err of Transformer in Pynative mode
From: @zuochuanyong
Reviewed-by: @chujinjin,@kisnwang
Signed-off-by: @chujinjin
5 years ago
zuochuanyong
739059d340
Add output information(shape, type id) of the operator to graph_info to solve the problem of cache missing
5 years ago
lvliang
28e3121fbc
fix-bug-of-null-output-addr-of-tensor-in-valuenode
5 years ago