Gosicfly
|
9a9732a86f
|
Update vocabulary.py (#325)
strip只需要将\n去掉,否则会将一些特殊字符去掉,造成split的时候长度出错
token_type_id_rev (#329)
当activation=lambda x: x出现错误 (#330)
Co-authored-by: 路人咦 <1417954729@qq.com>
1.修改部分文档中的typo; 2.支持对transformers embedding
update import
|
5 years ago |
yh_cc
|
0d0a6f746a
|
修复测试失败问题
|
5 years ago |
yh_cc
|
e361b32c3a
|
在@linzehui 的帮助下seq2seq终于有了第一个版本; 目前实现了Seq2Seq的Transformer和LSTM版本,但metric和loss还没update;
|
5 years ago |
yh_cc
|
ab047a2aa3
|
新增对RobertaEmbedding和GPT2Embedding的支持
|
6 years ago |
yh_cc
|
7398f2b0b2
|
1.增加RobertaEmbedding与GPT2Embedding
|
6 years ago |
yh_cc
|
45139ebbff
|
BertEmbedding支持选择是否缩小词表
|
6 years ago |
yh_cc
|
ace8aafdb2
|
修复BertEmbedding在include_cls_sep=True时,SEP位置的值不正确的问题
|
6 years ago |
yh_cc
|
367edb7ad1
|
修复move_to_device中device为None时可能出现错误的问题; BERTEmbedding中增加一个可选参数
|
6 years ago |
yh_cc
|
8acb0f4ad6
|
1.新增Vocabulary的save与load功能; 2.修复BERTEmbedding drop_word的bug; 3.新增各种Embedding的使用注释
|
6 years ago |
yh_cc
|
51e8c3c3b4
|
update static_embedding to make its property words_to_words is sequential
|
6 years ago |
yh_cc
|
38fea0fcfa
|
1.增强CMRC2018Metric的使用范围; 2. StaticEmbedding支持仅使用来自于pretrain embedding的token
|
6 years ago |
Yige Xu
|
fccb6d9b1b
|
add __init__.py in test dir to solve file conflicts.
|
6 years ago |
yh
|
5ebce3176f
|
增加部分测试
|
6 years ago |
Yige Xu
|
f22991698a
|
add assert in test_elmo_embedding
|
6 years ago |
Yige Xu
|
880e3ad969
|
1. add mini_elmo.pkl and test codes for testing ElmoEmbedding; 2. update bert testing codes
|
6 years ago |
yh_cc
|
e903db0e70
|
增加中文分类Pipe;使用矩阵加速BertEmbedding部分pool_method;调整部分测试用例名称;修复metric中对warning的误报
|
6 years ago |
Yige Xu
|
4440801dbf
|
1. update bert.py and fix a bug in bert_embedding to adapt torch 1.2.0; 2. update models/bert.py and add BertForSentenceMatching model, now a BertEmbedding param should be passed to these five models; 3. create a small bert version for testing and modify test/models/test_bert.py; 4. move small glove and word2vec files to data_for_tests/embedding/small_static_embedding dir and fix relevant test codes; 5. delete some __init__.py files in test dir.
|
6 years ago |
yh_cc
|
be77533c38
|
修复word drop bug, 增加相应测试
|
6 years ago |
yh_cc
|
85f01f01d1
|
1.修复部分测试; 2.修复StaticEmbedding中未找到词初始化bug
|
6 years ago |
yh
|
511f41dda1
|
1. 增加中文NER相关的loader和pipe; 2. 对应修改sequence_labeling的代码; 3.增加部分测试代码
|
6 years ago |
yh
|
fd37ed60a7
|
1. Trainer增加一个dev_batch_size参数;2.StaticEmbedding中增加min_freq;
|
6 years ago |
yh
|
c9fba2ae96
|
增加对static_embed的测试
|
6 years ago |
yh
|
3ae383efc3
|
修复BertEmbedding中长度会额外加长的bug
|
6 years ago |
yh
|
014e9786c7
|
1. 分类DataSetLoader中的Loader功能Pipe功能; 2. 增加数据集自动下载; 3.修复vocabulary中的bug
|
6 years ago |
yh
|
39f3accace
|
增加Embedding的文档
|
6 years ago |
xuyige
|
65f92855ba
|
add testing code in stack embedding
|
6 years ago |
xuyige
|
570b214dfb
|
增加fastNLP.embeddings模块并修改对应的现有代码以适配fastNLP.embeddings
|
6 years ago |