ChenXin
2a09dea235
1. SKIP test_process_from_file
2. doc_utils 增加了 __all__ 的检查
5 years ago
yh_cc
ee584e71dc
修复seq2seq_generator的bug
5 years ago
yh_cc
c957ed69c1
loader中load先将filename排序保证一致的load顺序, 避免测试不通过
5 years ago
yh_cc
e361b32c3a
在@linzehui 的帮助下seq2seq终于有了第一个版本; 目前实现了Seq2Seq的Transformer和LSTM版本,但metric和loss还没update;
5 years ago
ROGERDJQ
4e95989e97
[new] add seperator for conll loader ( #293 )
* add ConfusionMatrix, ConfusionMatrixMetric
* add confusionmatrix to utils
* add ConfusionMatrixmetric
* add ConfusionMatrixMetric
* init for test
* begin test
* test finish
* doc finish
* revised confusion
* revised two
* revise two
* add sep for conll loader
* with remote
* withdraw some update
* finish merge
* update test
* update test
* to avoid none situation
6 years ago
Yige Xu
56bf05adf1
Update test_classification.py
6 years ago
Yige Xu
58762810ec
[update] Re-organize classification loader and pipe
6 years ago
yh_cc
03e9ca2147
修复CWSPipe中无法读取包含<, >的数据的问题 https://github.com/fastnlp/fastNLP/issues/258#issue-533768454
6 years ago
yh
70d572cb3e
Merge branch 'dev0.5.0' of https://github.com/fastnlp/fastNLP into dev0.5.0
6 years ago
yh
7e41b9d355
1.新增CMRC2018的metric,loss,pipe,loader等; 2. 新增中文Bert的使用教程
6 years ago
Yige Xu
209a8fedba
Update test_matching.py
6 years ago
Yige Xu
da2416a1b8
fix test bugs in: 1. use prettytable to print instance; 2. CNXNLI loader and pipe.
6 years ago
Yige Xu
ad95707718
1. reorganize auto download datasets in io/file_utils.py; 2. add auto download for CNNDM and THUCNews; 3. rename XNLI loader and pipe to CNXNLI*; 4. update documents in some download method.
6 years ago
Yige Xu
a4babc04e2
1. add summary loader; 2. reorganize code in ExtCNNDMPipe; 3. reorganize test data and code for ExtCNNDMPipe;
6 years ago
ChenXin
0a4f17f4ce
add test for ModelSaver & ModelLoader
6 years ago
Yige Xu
d677ea879a
add data and test codes for testing OntoNotes and Conll2003 tasks
6 years ago
Yige Xu
452a62baed
Merge pull request #224 from brxx122/master
[new] Motified to Fastnlp/io/pipe/summarization.py for Summarization/Baseline
6 years ago
Danqing Wang
8affc4a3ff
add doc for summarization pipe
6 years ago
Danqing Wang
41995683ca
add test case for extcnndm
6 years ago
Yige Xu
d0a2b032bd
fix a bug while testing Quora Dataset
6 years ago
Yige Xu
927a3e746d
update test codes for testing classification and matching loader and pipe
6 years ago
Yige Xu
cccc1bfd57
add fitlog and spacy while testing
6 years ago
Yige Xu
fccb6d9b1b
add __init__.py in test dir to solve file conflicts.
6 years ago
Yige Xu
5d1c2a7ac3
add test code and data for testing CHN NER and classification loader and pipe
6 years ago
Yige Xu
5a2820cd18
add test code and data for testing cws loader and pipe
6 years ago
Yige Xu
1dfbc0aeff
update test code for testing matching loader and pipe
6 years ago
Yige Xu
64fc8bc1e5
1. update classification and matching loader and pipe; 2. add data and test codes for testing classification and matching loader and pipe.
6 years ago
Yige Xu
753327d214
fix code style in coreference task and related codes
6 years ago
liuxiaoxiong
07bbb79f77
Merge pull request #4 from fastnlp/dev0.5.0
Dev0.5.0
6 years ago
xxliu
5bbfb92a30
代码规范以及修改测试文件路径以匹配github文件路径
6 years ago
xxliu
ea5fbc8881
增加注释
增加测试文件及测试样例
修改部分变量命名
6 years ago
yh_cc
e903db0e70
增加中文分类Pipe;使用矩阵加速BertEmbedding部分pool_method;调整部分测试用例名称;修复metric中对warning的误报
6 years ago
Yige Xu
b9aa05f6cf
add testing codes and data for loader and pipe.
6 years ago
Yige Xu
4440801dbf
1. update bert.py and fix a bug in bert_embedding to adapt torch 1.2.0; 2. update models/bert.py and add BertForSentenceMatching model, now a BertEmbedding param should be passed to these five models; 3. create a small bert version for testing and modify test/models/test_bert.py; 4. move small glove and word2vec files to data_for_tests/embedding/small_static_embedding dir and fix relevant test codes; 5. delete some __init__.py files in test dir.
6 years ago
xuyige
5d8a8c98c6
1. delete io/data_loader dir; 2. delete model/enas*; 3. delete legacy dir; 4. delete DateSetLoader and relevant codes; 5. fix a test code error in core/test_dataset.py; 6. delete io.BaseLoader and relevant code.
6 years ago
yh
e2232ac39f
1.修复Embedding中潜在的寻找路径失败; 2.reproduction中增加分词模型; 3.修改ner模型为最新的pipe版本
6 years ago
yh
511f41dda1
1. 增加中文NER相关的loader和pipe; 2. 对应修改sequence_labeling的代码; 3.增加部分测试代码
6 years ago
ChenXin
1faf4ba2fa
delete a out-date test case
6 years ago
yh
014e9786c7
1. 分类DataSetLoader中的Loader功能Pipe功能; 2. 增加数据集自动下载; 3.修复vocabulary中的bug
6 years ago
xuyige
c2d687528e
fix bugs and add test codes for: 1. models.snli; 2. core.metrics.extractive_qa; 3. io.data_loader.mnli
6 years ago
xuyige
defcaae4bd
将test_embed_loader的almost equal范围稍稍调大一些,以防止偶然的测试不通过
6 years ago
xuyige
bedb792b3c
将test_embed_loader的almost equal范围稍稍调大一些,以防止偶然的测试不通过
6 years ago
xuyige
2eba991660
fix matching DataLoader test code
6 years ago
xuyige
7d07b38e0a
fix bug in matching DataLoader
6 years ago
xuyige
a83cee0fbb
fix bug in load dataset test code
6 years ago
xuyige
66a7cf084e
fix bug in test
6 years ago
xuyige
089009f9f2
大幅度更新:
1、更新requirements以及README.md
2、更新DataLoader
3、更新loss
4、更新model/bert.py内容及适配的测试代码
5、更新reproduction/README.md
6、修复其他测试代码的报错的地方
6 years ago
Violet Yao
74925f8237
wrong folder
6 years ago
Violet Yao
d17acd0cb1
remove ast
6 years ago
yunfan
eddb8af45c
add sst loader tests
6 years ago