yh_cc
edd3022bde
新增ConstantTokenNumSampler使得每个sample中token数量一致,可以最大化利用GPU的显存
5 years ago
ROGERDJQ
b6a07be364
[test] fix f1 test ( #314 )
* f1 fix
* fix f1 test
* f1 fix
5 years ago
yh_cc
40bec21684
修复save_path在dev为空的时候的bug
5 years ago
roger
b9b688d233
f1 fix
5 years ago
ROGERDJQ
4e95989e97
[new] add seperator for conll loader ( #293 )
* add ConfusionMatrix, ConfusionMatrixMetric
* add confusionmatrix to utils
* add ConfusionMatrixmetric
* add ConfusionMatrixMetric
* init for test
* begin test
* test finish
* doc finish
* revised confusion
* revised two
* revise two
* add sep for conll loader
* with remote
* withdraw some update
* finish merge
* update test
* update test
* to avoid none situation
5 years ago
yh_cc
ff8b9a37a7
修复Embedding注释错误与core.utils.py代码错误
5 years ago
ChenXin
4557202023
更新了 ControlC 的 API
5 years ago
yh_cc
18747e632e
修复Vocabulary在load的时候可能发生的bug
5 years ago
yh_cc
ab047a2aa3
新增对RobertaEmbedding和GPT2Embedding的支持
6 years ago
yh_cc
7398f2b0b2
1.增加RobertaEmbedding与GPT2Embedding
6 years ago
yh_cc
ba645f4483
1.将collect_fn修改为collate_fn使得与pytorch保持一致; 2.增加对BatchSampler的支持
6 years ago
yh_cc
a8aa1035d3
修复batch转tensor的bug; 新增对TorchLoaderIter的说明
6 years ago
yh_cc
885c74022c
增加对ConfusionMatrix的测试用例
6 years ago
yh_cc
7f01971321
调整涉及到多个field取batch的实现方式
6 years ago
yh_cc
dce1a73f53
Merge branch 'master' of github.com:fastnlp/fastNLP
6 years ago
yh_cc
8fe7a4f191
防止BERTEmbedding在中文场景下被错误使用
6 years ago
ChenXin
26ee41f923
DataSet 增加了 apply_more 和 apply_filed_more 两个新方法
6 years ago
yunfan
54dcc23ad7
[update] collect_fn keep tracks for field
6 years ago
yunfan
423e8e3746
[update] huge modify on collect_fn
6 years ago
yunfan
127d6d194b
[add] collect_fn for multi field combined inputs
6 years ago
yh_cc
8acb0f4ad6
1.新增Vocabulary的save与load功能; 2.修复BERTEmbedding drop_word的bug; 3.新增各种Embedding的使用注释
6 years ago
ROGERDJQ
f3ee16a5f6
[new] add ConfusionMatrix, ConfusionMatrixMetric ( #272 )
* add ConfusionMatrix, ConfusionMatrixMetric
* add confusionmatrix to utils
* add ConfusionMatrixmetric
* add ConfusionMatrixMetric
* init for test
* begin test
* test finish
* doc finish
6 years ago
yh_cc
4518a8fccb
[bug fix] test bug fix
6 years ago
yunfan
1139986b36
[bugfix] fix logger's logging level
6 years ago
yh_cc
9293a6c1ab
修复一个小bug
新增CheckPointCallback用于恢复Trainer的训练; CheckPointCallback会将optimizer,model以及Trainer的状态恢复到保存的epoch
6 years ago
yh_cc
faec3245d4
update CMRC2018Metric测试
6 years ago
Yige Xu
be432c3b39
fix a bug in ClassifyFPRMetric
6 years ago
Yige Xu
0547572d58
add ClassifyFPRMetric
6 years ago
yh
f887da12a1
解决CrossEntropyLoss测试因为数值问题无法通过测试的问题
6 years ago
yh
9c0190fbd8
新增对CrossEntropyLoss中class_in_dim的测试
6 years ago
yh
70d572cb3e
Merge branch 'dev0.5.0' of https://github.com/fastnlp/fastNLP into dev0.5.0
6 years ago
yh
7e41b9d355
1.新增CMRC2018的metric,loss,pipe,loader等; 2. 新增中文Bert的使用教程
6 years ago
Yige Xu
da2416a1b8
fix test bugs in: 1. use prettytable to print instance; 2. CNXNLI loader and pipe.
6 years ago
yunfan
c73f327a3e
[bugfix] fix test cases
6 years ago
ChenXin
4f0ec4a081
add the test for EarlyStopCallback, BUG found!
6 years ago
ChenXin
d8fa75b058
add the test for ControlC callback
6 years ago
ChenXin
e28ecb8b33
hide the EchoCallback
6 years ago
yunfan
05eb499eb8
[bugfix] dist_trainer's save & load
6 years ago
yunfan
29e4de36e3
[add] tutorial for callback
[add] test case for logger, batch
[bugfix] batch.py
6 years ago
Yige Xu
fccb6d9b1b
add __init__.py in test dir to solve file conflicts.
6 years ago
yh
5ebce3176f
增加部分测试
6 years ago
Yige Xu
5768cbbfef
add test code in AdamW
6 years ago
Yige Xu
9b2317e3e8
delete util functions and test cases in fastNLP/core/losses.py
6 years ago
Yige Xu
38d5b36be1
Update test_callbacks.py
6 years ago
Yige Xu
a3b4d5e76e
remove tensorboard logs after testing TensorboardCallback
6 years ago
yh_cc
8c8e22cc9b
DataSet中增加print_field_meta方法,使得其可以获取field的input和target信息
6 years ago
yh
1994029ab8
1.当前支持的encoding_type都支持从tag_vocab中自动判断;避免触发无意识导致的metric bug; 2. 修复部分inplace操作无法求导的问题; 3.Vocabulary将一些属性通过property暴露
6 years ago
Yige Xu
091f24e393
fix some bugs in test code.
6 years ago
xuyige
8142bad87a
Merge branch 'dev0.5.0' of https://github.com/fastnlp/fastNLP into dev0.5.0
6 years ago
xuyige
5d8a8c98c6
1. delete io/data_loader dir; 2. delete model/enas*; 3. delete legacy dir; 4. delete DateSetLoader and relevant codes; 5. fix a test code error in core/test_dataset.py; 6. delete io.BaseLoader and relevant code.
6 years ago