yangzhenzhang
a70d616841
mini step grad accumulation
5 years ago
wangshuide2020
72e938eb06
change dimension of input for FusedBatchNormEx from 2D to 4D in test_two_matmul_batchnorm_ex.
4 years ago
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
4 years ago
jinyaohui
30a27b2adb
modify Gelu、FastGelu to GeLU and FastGeLU
4 years ago
mindspore-ci-bot
74652eb942
!12044 modify pack to stack
From: @jinyaohui
Reviewed-by:
Signed-off-by:
4 years ago
jinyaohui
8022f9a6ed
modify pack to stack
4 years ago
yangzhenzhang
726ea32778
merge parameter slice compile graph only once
4 years ago
l00591931
9ec100d069
Change TensorAdd to Add, from r1.1 to master
4 years ago
mindspore-ci-bot
9fa0499fa0
Change GatherV2 to Gather r1.1 to master
4 years ago
yangzhenzhang
cbca482e59
delete useless parameter in pipeline parallel
4 years ago
yangzhenzhang
7303c3d3b8
add group ckpt
4 years ago
lilei
9a45c4419c
modify batch_normal
4 years ago
yangzhenzhang
9da3f9bec9
mini step grad accumulation
5 years ago
mindspore-ci-bot
2e684df5b1
!10686 fix infer rank list typo and add testcase
From: @gong_zi_yan
Reviewed-by: @stsuteng,@zhunaipan
Signed-off-by: @stsuteng
4 years ago
Ziyan
2c3b99ce91
fix infer rank list typo
5 years ago
mindspore-ci-bot
b67aaf6773
!9832 expose_allgather_fusion_to_users
From: @gong_zi_yan
Reviewed-by:
Signed-off-by:
5 years ago
Ziyan
bbf8ec82b9
expose allgather fusion interface to users
5 years ago
ms_yan
deb1e6e965
use from_numpy and add do_copy option
5 years ago
Ziyan
c5c905fdf5
add restriction for opt shard
5 years ago
huangxinjing
a8446af1ab
Fix condition check
5 years ago
jjfeing
1984cf8e20
unify mindir
5 years ago
mindspore-ci-bot
d5db8872fd
!9834 Fix wrong input argument of Reshape for multi field embedding
From: @huangxinjing
Reviewed-by: @zhunaipan,@stsuteng
Signed-off-by: @stsuteng
5 years ago
huangxinjing
996ee72c50
Fix embedding layer
Fix input check
5 years ago
yao_yf
19fe28cb9b
hange strategys of last nodes in eval/predict at auto parallel mode
5 years ago
Xiaoda Zhang
e78228603b
move parallel-related black-list to core/ir, and fix the cloneCNode bug
5 years ago
mindspore-ci-bot
ec3983b77d
!9577 support distributed predict
From: @gong_zi_yan
Reviewed-by: @caozhou_huawei,@yao_yf,@stsuteng,@zh_qh
Signed-off-by: @stsuteng
5 years ago
Ziyan
e7e9dae54d
support distributed predict
5 years ago
Xiaoda Zhang
9a9e3a751e
set cnode's fullname when cloning
5 years ago
lichenever
818e920f02
fix_pipeline_split_param_shared_bug
5 years ago
lichenever
78e131cf15
pipeline_split adapt parallel
5 years ago
yangzhenzhang
7b33f3e2ac
gatherv2 axis split repeated calculation
5 years ago
yangzhenzhang
7278f5c109
update_gatherv2_op
5 years ago
Xiaoda Zhang
c79e988b0d
set fullname for reshape after reshape-elimination
5 years ago
yao_yf
9cda064716
auto parallel predict
5 years ago
mindspore-ci-bot
3d6d820612
!8154 Add nn.MultiFieldEmbedding for the embedding lookup opearations
From: @huangxinjing
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
d915fd9b96
!8592 change repeat_elements to a composite op
From: @tom__chen
Reviewed-by:
Signed-off-by:
5 years ago
huangxinjing
b0deb7a289
Add dense embedding
5 years ago
tom__chen
a52cd685fc
change repeat_element op to a composite op
5 years ago
huangxinjing
89e7778497
Add UnsortedSegmentMax Operation
5 years ago
huangxinjing
8129806475
Add slice parallel op
5 years ago
mindspore-ci-bot
ee72de1db2
!8441 Add Parallel Implements of UniformCandidateSampler
From: @huangxinjing
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
cd6236c0a0
!8712 update pipeline parallel interface
From: @yangzhenzhang
Reviewed-by: @kisnwang
Signed-off-by:
5 years ago
mindspore-ci-bot
fb0e866ad1
!8269 forward unique dynamic shape
From: @yao_yf
Reviewed-by:
Signed-off-by:
5 years ago
yao_yf
31819bb4a7
support forward unique
5 years ago
yangzhenzhang
278e82a849
update pipeline parallel
5 years ago
huangxinjing
2730cef047
Uniform Sampler Base Update
5 years ago
Ziyan
0ddb754edb
run cast before parallel optimizer
5 years ago
huangxinjing
12e9107162
Fix VirtualDiv Int32 error
5 years ago
mindspore-ci-bot
4e07f43dff
!8323 [Auto parallel] Supporting for-loop in strategy-searching
From: @xiaoda_zh
Reviewed-by:
Signed-off-by:
5 years ago
Xiaoda Zhang
aa13d6b1cd
support for-loop in auto-parallel
5 years ago