mindspore-ci-bot
669a32355c
!13769 remove control_depend from py file
From: @huangbingjian
Reviewed-by: @hwhewei,@zh_qh
Signed-off-by: @zh_qh
4 years ago
huangbingjian
72ae1799f3
remove control_depend from py file
4 years ago
VectorSL
c1a619ccfe
add AdamWeightDecayOp
4 years ago
chenhaozhe
15d37e5db9
imporve convergence of loss in bert
4 years ago
wangnan39@huawei.com
7188a14215
modify api detect_overflow name in TrainOneStepWithLossScaleCell
4 years ago
wangnan39@huawei.com
4d69e21933
optimizer class TrainOneStepWithLossScaleCell
4 years ago
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
4 years ago
mindspore-ci-bot
3bf5681ebc
!12093 adapt api for optimizer import
From: @sl_wang
Reviewed-by: @wang_zi_dong
Signed-off-by:
4 years ago
mwang
8f8eee4b5e
bert thor supports lr configuration in config.py
4 years ago
mindspore-ci-bot
51e7b6481a
!12034 modify instructions of preprocessing msra dataset
From: @shibeiji
Reviewed-by: @c_34,@guoqi1024
Signed-off-by: @c_34
4 years ago
shibeiji
95ccebb811
fix bugs of MSRA dataset preprocessing
4 years ago
mwang
0b312c2385
thor generalization code submit
4 years ago
mindspore-ci-bot
e897eb4c41
!11915 Change TensorAdd to Add, merge from r1.1 to master
From: @liangzhibo
Reviewed-by: @ginfung,@zh_qh
Signed-off-by: @zh_qh
4 years ago
l00591931
9ec100d069
Change TensorAdd to Add, from r1.1 to master
4 years ago
shibeiji
cc18b206c9
bert ner for adaption of MSRA dataset
4 years ago
mindspore-ci-bot
9fa0499fa0
Change GatherV2 to Gather r1.1 to master
4 years ago
shibeiji
8b1a8a6bc1
bert ner for msra dataset
4 years ago
shibeiji
3ec3f038ad
extract bert embedding tables in construct
4 years ago
chenhaozhe
4899a0b4c1
fix code spell
4 years ago
chenhaozhe
8eae3262f3
fix some description about bert and yolov3
4 years ago
VectorSL
33277fe64b
fix bert init
4 years ago
shibeiji
f0b08e8bff
all reduce after each step in gradients accumulation mode for bert
5 years ago
mindspore-ci-bot
811a785555
!10886 GPU update bert scripts
From: @VectorSL
Reviewed-by: @gaoxiong1,@c_34,@gaoxiong1
Signed-off-by: @c_34
4 years ago
VectorSL
0c97835662
update control flow int adamweightdecay for bert
5 years ago
shibeiji
812b4b0eab
extract embedding table from unified interface
5 years ago
hanhuifeng2020
65bfefd92b
bert on gpu for pre training script supports loss scale
5 years ago
Xiao Tianci
31fed1a2f6
change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine
5 years ago
caozhou
b1189cd118
compatible name
5 years ago
yoonlee666
a744ef9113
add squad
5 years ago
shibeiji
bde36af04c
Modify the default activation function for bert
5 years ago
shibeiji
cd850bd210
register activation operator fast_gelu
5 years ago
jzg
4851a67bb5
add layer of clipbyglobalnorm.
5 years ago
root
4e85071055
redundant codes clean
5 years ago
yoonlee666
01c9e8b373
add tokenization and score file
5 years ago
yoonlee666
92d0a29911
bugfix bert config
5 years ago
mindspore-ci-bot
31ad1654a1
!6267 delete redundant codes in model zoo
Merge pull request !6267 from zhaoting/clean_warnings
5 years ago
dayschan
59d9f8bf6a
remove importing _selected_ops from model_zoo
5 years ago
mindspore-ci-bot
cc4859f0b2
!6358 fix loss print in bert, change epoch number to integer
Merge pull request !6358 from chenhaozhe/fix-loss-print
5 years ago
zhaoting
d421f49e60
delete redundant codes
5 years ago
chenhaozhe
1a8dffe4c6
change epoch to integer while print loss
5 years ago
yoonlee666
d90ac3c6d1
bugfix
5 years ago
mindspore-ci-bot
3671244ff8
!6233 move batch_size from bert_cfg_cfg to cfg
Merge pull request !6233 from yoonlee666/master
5 years ago
yoonlee666
528072f45f
move batch_size from bert_cfg_cfg to cfg
5 years ago
wangnan39@huawei.com
dc78af7365
fix bug in bert
5 years ago
mindspore-ci-bot
105422fbb9
!6188 fix loss print of bert, add attention about bind cores in README
Merge pull request !6188 from chenhaozhe/fix-bert-loss-print
5 years ago
wangnan39@huawei.com
7578f23632
optim TrainOneStepCell
5 years ago
chenhaozhe
e1f4c066b3
fix loss print in bert and corresponding downstream task
5 years ago
chenhaozhe
91c65a734a
fix some doc error
5 years ago
chenhaozhe
28cb0da168
remove os.system in launch scripts
5 years ago
nhussain
92e99ff224
change map calls
5 years ago