This website works better with JavaScript.
Home
Issues
Pull Requests
Milestones
AI流水线
Repositories
Datasets
Forum
实训
竞赛
大数据
AI开发
Register
Sign In
Huawei_Technology
/
mindspore
Not watched
Unwatch
Watch all
Watch but not notify
1
Star
0
Fork
0
Code
Releases
13
Wiki
evaluate
Activity
Issues
0
Pull Requests
0
Datasets
Model
Cloudbrain
HPC
Browse Source
!9192
reset the default activation function for bert
From:
@shibeiji
Reviewed-by: @c_34,@liangchenghui Signed-off-by:
@c_34
tags/v1.1.0
mindspore-ci-bot
Gitee
5 years ago
parent
0694c2d31c
bde36af04c
commit
bebc37b389
1 changed files
with
1 additions
and
1 deletions
Split View
Diff Options
Show Stats
Download Patch File
Download Diff File
+1
-1
model_zoo/official/nlp/bert/src/config.py
+ 1
- 1
model_zoo/official/nlp/bert/src/config.py
View File
@@ -103,7 +103,7 @@ if cfg.bert_network == 'large':
num_hidden_layers=24,
num_attention_heads=16,
intermediate_size=4096,
hidden_act="
fast_
gelu",
hidden_act="gelu",
hidden_dropout_prob=0.1,
attention_probs_dropout_prob=0.1,
max_position_embeddings=512,
Write
Preview
Loading…
Cancel
Save