w00449189
6c412a94e3
fix pylint warning
4 years ago
zhaoting
c14c707475
Support CPU tinybert and ner task
4 years ago
mindspore-ci-bot
1aa16fb431
!13999 modify BERT、TinyBERT README and modify TinyBERT network script
From: @wang_hua_2019
Reviewed-by: @c_34
Signed-off-by:
4 years ago
wang_hua_2019
e0d85aecea
modify tinybert for MindSpore BERT
4 years ago
caojiewen
cad462902a
fixed the code spell errors.
4 years ago
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
4 years ago
l00591931
9ec100d069
Change TensorAdd to Add, from r1.1 to master
4 years ago
mindspore-ci-bot
9fa0499fa0
Change GatherV2 to Gather r1.1 to master
4 years ago
Xiao Tianci
31fed1a2f6
change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine
5 years ago
caozhou
b1189cd118
compatible name
5 years ago
wanghua
f09087a68a
update tinybert_model.py
5 years ago
mindspore-ci-bot
2a799fe90e
!6018 Set the number of epochs in mode.train() non-sink Mode
Merge pull request !6018 from h.farahat/ms_nonsink_epochs
5 years ago
yoonlee666
a2af684dd4
bugfix tinybert
5 years ago
hesham
9cee0d2143
Add num_epochs to non-sink training
5 years ago
yanghaitao1
a4de9ba0eb
fix tinybert failes if run 1p
5 years ago
mindspore-ci-bot
bd5a8b42ac
!6724 redundant codes clean
Merge pull request !6724 from TuDouNi/master
5 years ago
root
4e85071055
redundant codes clean
5 years ago
yoonlee666
25b2c1944f
tinybert hub
5 years ago
zhaoting
d421f49e60
delete redundant codes
5 years ago
xiefangqi
9b3c33e157
minddata iterator output ms_tensor
5 years ago
nhussain
92e99ff224
change map calls
5 years ago
lvchangquan
7abe692fb5
add set_grad() for pynative mode in model_zoo network
5 years ago
yao_yf
d4cfe55c04
rename mirror_mean to gradients_mean
5 years ago
yoonlee666
dfd85caa1b
delete enable_fused_layernorm
5 years ago
mindspore-ci-bot
4ec343961e
!5482 modify save_checkpoint
Merge pull request !5482 from liuyang/md_save_checkpoint
5 years ago
liuyang_655
4683de3443
modify save_checkpoint
5 years ago
mindspore-ci-bot
820f2cb4eb
!5351 move ParalleMode to Context
Merge pull request !5351 from yao_yf/parallel_context_collation
5 years ago
yao_yf
07117e4dd4
mv ParallelMode to context
5 years ago
mindspore-ci-bot
7127304c67
!4814 support minddateset for tinybert
Merge pull request !4814 from dengyutao/tinybert
5 years ago
dengyutao
4e0447b05e
support minddataset for tinybert
5 years ago
panyifeng
1a54785fe2
remove name arg from gradoperation
5 years ago
hanhuifeng2020
9e2b38c961
The teacher use fp16 calculations to optimize the performance of tinybert on the gpu
5 years ago
mindspore-ci-bot
881fc135bf
!4187 tinybert script suit for gpu
Merge pull request !4187 from hanhuifeng/tinybert_suit_gpu
5 years ago
hanhuifeng2020
1756d084ab
tinybert script suit for gpu
5 years ago
panbingao
3f60bf6dfe
fix pylint warnings in model_zoo
5 years ago
wanghua
89fa2d3708
modify bert and tinybert readme
5 years ago
wanghua
7dd5e78fde
add tinybert scripts
5 years ago