He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
5 years ago
yujianfeng
266e960acb
Not do cse for the nodes set recomputed before recompute pass
5 years ago
fangzehua
f97e19f23f
add cache pass
5 years ago
buxue
acec35d4d4
support non tensor inputs
5 years ago
yangzhenzhang
9da3f9bec9
mini step grad accumulation
5 years ago
yujianfeng
7b412d7cb2
add recompute nodes
5 years ago
lvliang
7da4f49c41
fix-bug-of-gather-drop-negatives-without-default-parameter
5 years ago
Zhang Qinghua
64d9d76321
Add grad epilogue passes for PyNative mode.
5 years ago
buxue
2530943a7f
optimize list getitem in bprop
5 years ago
lichenever
ee34ae9259
add_receive_eliminate_pass
5 years ago
lichenever
2e1c43483e
add auto parallel pipeline
5 years ago
Yi Huaijie
d7faa77b5e
support int64 shape
5 years ago
Zhang Qinghua
216e8fa958
Add AccumulaterNV2 eliminator pass
5 years ago
kpy
4338dd266e
optimizer pynative graph memory
5 years ago
BowenK
1bdb26f9e8
Warming up python pass by adding inline passes before it
5 years ago
huangdongrun
0099da2c99
add support for tuple parameter transform
add support for pynative pass
add testcases
5 years ago
fary86
fcbb3e0edc
Refactor ms_context implementation
5 years ago
zhousiyi
c25e37e7bf
make backend/optimizer pybind free
5 years ago
BowenK
eacb306ae0
Revert "Revert "Eliminate AllReduce when the input is a constant""
This reverts commit 7a7e499475 .
5 years ago
BowenK
7a7e499475
Revert "Eliminate AllReduce when the input is a constant"
This reverts commit f3a9fbdd78 .
5 years ago
panyifeng
f9f3cd7ce0
fix switch_layer_issues
5 years ago
panyifeng
22a9d02e9f
switch_layer incorporate env_get and tuple_get
5 years ago
zhoufeng
663278112f
optimize code compile performance
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
5 years ago
mindspore-ci-bot
81833943ba
!2969 Eliminate AllReduce when the input is a constant in Graph mode
Merge pull request !2969 from BowenK/fix_reduce_all
5 years ago
BowenK
f3a9fbdd78
Eliminate AllReduce when the input is a constant
5 years ago
mindspore-ci-bot
f875bf21bc
!2948 fix control flow
Merge pull request !2948 from amongo/FixControlFlow
5 years ago
huangdongrun
2a6d346d2f
support if by if grad parameter
add join for ref
adjust env eliminate to eliminate all env ops
add partial app cache
resolve while endless
fix env eliminate
support for "for while" cases
fix join shape error
5 years ago
panyifeng
1c296b96c9
fix switch layer sigle prim cell
5 years ago
panyifeng
34e50e5d6e
fix cell bprop
5 years ago
liubuyu
a499d4e47c
decoupling core and debug
5 years ago
panyifeng
598bfa0205
add sparse operators
5 years ago
Hoai Linh Tran
2861e5462d
Add optimization pass to remove redundant Select, fix uninitiated parameter in test_bert_train.py script
Create a new pass named ValueBasedEliminate to reduce the load of Arithmetic Simplify
Code review
5 years ago
liubuyu
f4bc0bc9fe
move the dependency of utils to core
5 years ago
panyifeng
4d4e23fd9e
Add bprop for sparse_tensor
5 years ago
panyifeng
5a10383cc3
add coo_tensor
5 years ago
liubuyu
43c79eb853
mindspore path adjust
5 years ago