yh_cc
ab047a2aa3
新增对RobertaEmbedding和GPT2Embedding的支持
6 years ago
yh_cc
7398f2b0b2
1.增加RobertaEmbedding与GPT2Embedding
6 years ago
yh_cc
ba645f4483
1.将collect_fn修改为collate_fn使得与pytorch保持一致; 2.增加对BatchSampler的支持
6 years ago
yh_cc
a8aa1035d3
修复batch转tensor的bug; 新增对TorchLoaderIter的说明
6 years ago
yh_cc
885c74022c
增加对ConfusionMatrix的测试用例
6 years ago
yh_cc
7f01971321
调整涉及到多个field取batch的实现方式
6 years ago
yh_cc
dce1a73f53
Merge branch 'master' of github.com:fastnlp/fastNLP
6 years ago
yh_cc
8fe7a4f191
防止BERTEmbedding在中文场景下被错误使用
6 years ago
ChenXin
26ee41f923
DataSet 增加了 apply_more 和 apply_filed_more 两个新方法
6 years ago
yunfan
54dcc23ad7
[update] collect_fn keep tracks for field
6 years ago
yunfan
423e8e3746
[update] huge modify on collect_fn
6 years ago
yunfan
127d6d194b
[add] collect_fn for multi field combined inputs
6 years ago
yh_cc
8acb0f4ad6
1.新增Vocabulary的save与load功能; 2.修复BERTEmbedding drop_word的bug; 3.新增各种Embedding的使用注释
6 years ago
ROGERDJQ
f3ee16a5f6
[new] add ConfusionMatrix, ConfusionMatrixMetric ( #272 )
* add ConfusionMatrix, ConfusionMatrixMetric
* add confusionmatrix to utils
* add ConfusionMatrixmetric
* add ConfusionMatrixMetric
* init for test
* begin test
* test finish
* doc finish
6 years ago
yh_cc
4518a8fccb
[bug fix] test bug fix
6 years ago
yunfan
1139986b36
[bugfix] fix logger's logging level
6 years ago
yh_cc
9293a6c1ab
修复一个小bug
新增CheckPointCallback用于恢复Trainer的训练; CheckPointCallback会将optimizer,model以及Trainer的状态恢复到保存的epoch
6 years ago
yh_cc
faec3245d4
update CMRC2018Metric测试
6 years ago
Yige Xu
be432c3b39
fix a bug in ClassifyFPRMetric
6 years ago
Yige Xu
0547572d58
add ClassifyFPRMetric
6 years ago
yh
f887da12a1
解决CrossEntropyLoss测试因为数值问题无法通过测试的问题
6 years ago
yh
9c0190fbd8
新增对CrossEntropyLoss中class_in_dim的测试
6 years ago
yh
70d572cb3e
Merge branch 'dev0.5.0' of https://github.com/fastnlp/fastNLP into dev0.5.0
6 years ago
yh
7e41b9d355
1.新增CMRC2018的metric,loss,pipe,loader等; 2. 新增中文Bert的使用教程
6 years ago
Yige Xu
da2416a1b8
fix test bugs in: 1. use prettytable to print instance; 2. CNXNLI loader and pipe.
6 years ago
yunfan
c73f327a3e
[bugfix] fix test cases
6 years ago
ChenXin
4f0ec4a081
add the test for EarlyStopCallback, BUG found!
6 years ago
ChenXin
d8fa75b058
add the test for ControlC callback
6 years ago
ChenXin
e28ecb8b33
hide the EchoCallback
6 years ago
yunfan
05eb499eb8
[bugfix] dist_trainer's save & load
6 years ago
yunfan
29e4de36e3
[add] tutorial for callback
[add] test case for logger, batch
[bugfix] batch.py
6 years ago
Yige Xu
fccb6d9b1b
add __init__.py in test dir to solve file conflicts.
6 years ago
yh
5ebce3176f
增加部分测试
6 years ago
Yige Xu
5768cbbfef
add test code in AdamW
6 years ago
Yige Xu
9b2317e3e8
delete util functions and test cases in fastNLP/core/losses.py
6 years ago
Yige Xu
38d5b36be1
Update test_callbacks.py
6 years ago
Yige Xu
a3b4d5e76e
remove tensorboard logs after testing TensorboardCallback
6 years ago
yh_cc
8c8e22cc9b
DataSet中增加print_field_meta方法,使得其可以获取field的input和target信息
6 years ago
yh
1994029ab8
1.当前支持的encoding_type都支持从tag_vocab中自动判断;避免触发无意识导致的metric bug; 2. 修复部分inplace操作无法求导的问题; 3.Vocabulary将一些属性通过property暴露
6 years ago
Yige Xu
091f24e393
fix some bugs in test code.
6 years ago
xuyige
8142bad87a
Merge branch 'dev0.5.0' of https://github.com/fastnlp/fastNLP into dev0.5.0
6 years ago
xuyige
5d8a8c98c6
1. delete io/data_loader dir; 2. delete model/enas*; 3. delete legacy dir; 4. delete DateSetLoader and relevant codes; 5. fix a test code error in core/test_dataset.py; 6. delete io.BaseLoader and relevant code.
6 years ago
yh_cc
55e736bf4c
SpanFMetric增加对encoding_type和tag_vocab的检查
6 years ago
yunfan
cacf40366c
[fix] distributed trainer
6 years ago
yunfan
329a18976f
[update] distributed trainer, add evaluation part
6 years ago
yunfan
606d63a5a4
[update] distributed trainer
6 years ago
yunfan
861f5387a4
[add] very first version of distributed trainer
6 years ago
xuyige
c2d687528e
fix bugs and add test codes for: 1. models.snli; 2. core.metrics.extractive_qa; 3. io.data_loader.mnli
6 years ago
yh
22a8702d22
1. Trainer支持使用DistributedDataParallel训练; 但是还没有经过广泛测试,谨慎使用; 2. 修复import os bug; 3.FitlogCallback支持不传入任何DataSet; 4. NullOptimizer的construct_from_optimer返回self; 5. 修复Bert中pooled_cls的bug;“
6 years ago
yh_cc
1babf5384f
Vocabulary中no_create_entry的bug修复
6 years ago