chenhaozhe
8eae3262f3
fix some description about bert and yolov3
4 years ago
VectorSL
33277fe64b
fix bert init
4 years ago
shibeiji
f0b08e8bff
all reduce after each step in gradients accumulation mode for bert
5 years ago
mindspore-ci-bot
811a785555
!10886 GPU update bert scripts
From: @VectorSL
Reviewed-by: @gaoxiong1,@c_34,@gaoxiong1
Signed-off-by: @c_34
4 years ago
VectorSL
0c97835662
update control flow int adamweightdecay for bert
5 years ago
shibeiji
812b4b0eab
extract embedding table from unified interface
5 years ago
hanhuifeng2020
65bfefd92b
bert on gpu for pre training script supports loss scale
5 years ago
Xiao Tianci
31fed1a2f6
change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine
5 years ago
caozhou
b1189cd118
compatible name
5 years ago
yoonlee666
a744ef9113
add squad
5 years ago
shibeiji
bde36af04c
Modify the default activation function for bert
5 years ago
shibeiji
cd850bd210
register activation operator fast_gelu
5 years ago
jzg
4851a67bb5
add layer of clipbyglobalnorm.
5 years ago
root
4e85071055
redundant codes clean
5 years ago
yoonlee666
01c9e8b373
add tokenization and score file
5 years ago
yoonlee666
92d0a29911
bugfix bert config
5 years ago
mindspore-ci-bot
31ad1654a1
!6267 delete redundant codes in model zoo
Merge pull request !6267 from zhaoting/clean_warnings
5 years ago
dayschan
59d9f8bf6a
remove importing _selected_ops from model_zoo
5 years ago
mindspore-ci-bot
cc4859f0b2
!6358 fix loss print in bert, change epoch number to integer
Merge pull request !6358 from chenhaozhe/fix-loss-print
5 years ago
zhaoting
d421f49e60
delete redundant codes
5 years ago
chenhaozhe
1a8dffe4c6
change epoch to integer while print loss
5 years ago
yoonlee666
d90ac3c6d1
bugfix
5 years ago
mindspore-ci-bot
3671244ff8
!6233 move batch_size from bert_cfg_cfg to cfg
Merge pull request !6233 from yoonlee666/master
5 years ago
yoonlee666
528072f45f
move batch_size from bert_cfg_cfg to cfg
5 years ago
wangnan39@huawei.com
dc78af7365
fix bug in bert
5 years ago
mindspore-ci-bot
105422fbb9
!6188 fix loss print of bert, add attention about bind cores in README
Merge pull request !6188 from chenhaozhe/fix-bert-loss-print
5 years ago
wangnan39@huawei.com
7578f23632
optim TrainOneStepCell
5 years ago
chenhaozhe
e1f4c066b3
fix loss print in bert and corresponding downstream task
5 years ago
chenhaozhe
91c65a734a
fix some doc error
5 years ago
chenhaozhe
28cb0da168
remove os.system in launch scripts
5 years ago
nhussain
92e99ff224
change map calls
5 years ago
mindspore-ci-bot
cd07acc8a4
!5903 add set_grad() for pynative mode in model_zoo networks
Merge pull request !5903 from lvchangquan/master
5 years ago
nhussain
3bac9d3713
switch input columns and operation
change ImagefolderDV2 name
change ds.transforms.vision to ds.vision
change batch api to match map api more closely
compose op changes
test_pylint
remove compose op from vision, move to transform module, refactor map and batch to use column_order
5 years ago
lvchangquan
7abe692fb5
add set_grad() for pynative mode in model_zoo network
5 years ago
yao_yf
d4cfe55c04
rename mirror_mean to gradients_mean
5 years ago
yoonlee666
dfd85caa1b
delete enable_fused_layernorm
5 years ago
mindspore-ci-bot
44a9c25251
!5632 Add clip_by_global_nrom in bert
Merge pull request !5632 from chenhaozhe/add-global-norm-to-bert
5 years ago
chenhaozhe
ac95836257
add global norm in bert
5 years ago
shibeiji
d57960ed4c
delete the redundant argument while initializing class of GradOperation
5 years ago
yoonlee666
954f53da9e
enhancement
5 years ago
mindspore-ci-bot
c247f5cdbf
!5325 add schema file introduce for BERT and TinyBERT
Merge pull request !5325 from wanghua/master
5 years ago
wanghua
f347d1c9e7
add schema for BERT and TinyBERT
5 years ago
yao_yf
07117e4dd4
mv ParallelMode to context
5 years ago
panyifeng
1a54785fe2
remove name arg from gradoperation
5 years ago
shibeiji
40fc11e9a4
Mimic higher batch size by accumulating gradients N times before weight update
5 years ago
chenhaozhe
fa10a4e483
optimize print of bert scripts'
5 years ago
panbingao
3f60bf6dfe
fix pylint warnings in model_zoo
5 years ago
yoonlee666
e18c7292d6
bug fix
5 years ago
mindspore-ci-bot
7113f1f22c
!3857 modify bert and tinybert scripts and README
Merge pull request !3857 from wanghua/master
5 years ago
wanghua
89fa2d3708
modify bert and tinybert readme
5 years ago