yh_cc
c707cd4336
CRF维特比解码BUG修复
5 years ago
yh_cc
fe7ce8e448
Merge branch 'master' of github.com:fastnlp/fastNLP
5 years ago
yh_cc
ee584e71dc
修复seq2seq_generator的bug
5 years ago
yunfan
8d08626d67
[update] fix padding masking in viterbi_decode() of CRF
5 years ago
yh_cc
0d0a6f746a
修复测试失败问题
5 years ago
yh_cc
e361b32c3a
在@linzehui 的帮助下seq2seq终于有了第一个版本; 目前实现了Seq2Seq的Transformer和LSTM版本,但metric和loss还没update;
5 years ago
linzehui
b95aa56afb
基本完成seq2seq基础功能
5 years ago
linzehui
15360e9724
保存一版旧版
5 years ago
yh_cc
ab047a2aa3
新增对RobertaEmbedding和GPT2Embedding的支持
6 years ago
yh_cc
7398f2b0b2
1.增加RobertaEmbedding与GPT2Embedding
6 years ago
ChenXin
b874fba8f2
add the test for modules.utils.summary
6 years ago
Yige Xu
fccb6d9b1b
add __init__.py in test dir to solve file conflicts.
6 years ago
yh
8d3cab5f7d
Merge branch 'dev0.5.0' of https://github.com/fastnlp/fastNLP into dev0.5.0
6 years ago
yh
5ebce3176f
增加部分测试
6 years ago
Yige Xu
4e2ca6c95a
add test code for testing pooling
6 years ago
Yige Xu
d15ad75d96
fix a bug in test code
6 years ago
yh
1994029ab8
1.当前支持的encoding_type都支持从tag_vocab中自动判断;避免触发无意识导致的metric bug; 2. 修复部分inplace操作无法求导的问题; 3.Vocabulary将一些属性通过property暴露
6 years ago
Yige Xu
4440801dbf
1. update bert.py and fix a bug in bert_embedding to adapt torch 1.2.0; 2. update models/bert.py and add BertForSentenceMatching model, now a BertEmbedding param should be passed to these five models; 3. create a small bert version for testing and modify test/models/test_bert.py; 4. move small glove and word2vec files to data_for_tests/embedding/small_static_embedding dir and fix relevant test codes; 5. delete some __init__.py files in test dir.
6 years ago
yh
3ae383efc3
修复BertEmbedding中长度会额外加长的bug
6 years ago
yh
014e9786c7
1. 分类DataSetLoader中的Loader功能Pipe功能; 2. 增加数据集自动下载; 3.修复vocabulary中的bug
6 years ago
xuyige
570b214dfb
增加fastNLP.embeddings模块并修改对应的现有代码以适配fastNLP.embeddings
6 years ago
xuyige
089009f9f2
大幅度更新:
1、更新requirements以及README.md
2、更新DataLoader
3、更新loss
4、更新model/bert.py内容及适配的测试代码
5、更新reproduction/README.md
6、修复其他测试代码的报错的地方
6 years ago
yh_cc
2f5d8967a3
1. 适配将Batch修改为pytorch的DataLoader的修改
2. 修改embedding.py中的bug
3. ConllReader默认跳过所有的DOCSTART标签
4. 交换bert的heavy lifting到_bert, 将BertEncoder在bert.py中暴露
5. crf中allow_transition的include_end_start修改为false,以与CRF的默认值适配
6. allow_transition与SpanMetric支持BIOES类型的tag
7. datainfo中增加打印格式化输出
6 years ago
xuyige
016f02be3b
fix bugs in model/bert.py and add testing codes
6 years ago
ChenXin
ff1d695aa4
修改了 modules 模块的__all__ 和 import
6 years ago
ChenXin
51b493d716
修改 io 的测试文件; 删除了一些过时的测试
6 years ago
yh_cc
56ff4ac7a1
统一不同位置的seq_len_to_mask, 现统一到core.utils.seq_len_to_mask
6 years ago
yunfan
702fa1d95c
- update attention
- fix tests
6 years ago
yh_cc
f65c0935f6
Merge branch 'dev' of github.com:choosewhatulike/fastNLP-private into dev
6 years ago
yh_cc
06891cf90a
补充注释,并修改部分代码
6 years ago
xuyige
ee49f4177e
update char level encoder
6 years ago
yunfan
e025350ea8
Merge branch 'dev' of https://github.com/choosewhatulike/fastNLP-private into pr
6 years ago
yh_cc
29f81e79ad
准备发布0.4.0版本“
7 years ago
yunfan
e12041513f
Merge remote-tracking branch 'private/dev' into pr
# Conflicts:
# fastNLP/core/callback.py
# fastNLP/core/trainer.py
7 years ago
yh
e5f68bbd5b
修复CRF为负数的bug
7 years ago
yh
f2d7d01bb7
修复CRF中可能存在的bug
7 years ago
yunfan
7c7f28f2ac
- add star-transformer
7 years ago
yh
897c43fc3b
1. CRF增加constrain, 用于限制跃迁,比如BMES中B不能跃迁到S
2. metric增加SpanFMetric,可以用于计算sequence labelling的performance
3. 分词复现任务根据新版接口做了部分调整。
7 years ago
FengZiYjun
3d66975091
* refine code comments
* refine code style
* set up unit tests for Batch, DataSet, FieldArray
* remove a lot of out-of-date unit tests, to get testing passed
7 years ago
yunfan
8ea529404e
fix test
7 years ago
FengZiYjun
fb806163c3
remove unused codes; add more tests
7 years ago
FengZiYjun
5be4cb7bb5
Merge Preprocessor into DataSet.
- DataSet's __init__ takes a function as argument, rather than class object
- Preprocessor is about to remove. Don't use anymore.
- Remove cross_validate in trainer, because it is rarely used and wired
- Loader.load is expected to be a static method
- Delete sth. in other_modules.py
- Add more tests
- Delete extra sample data
7 years ago
FengZiYjun
28a0683853
1. add tests in test_fastNLP.py & test_sampler.py; increase test coverage to 81%
2. changes of names:
aggregation ----> aggregator
interaction ----> interactor
action.py ----> sampler.py
BasePreprocess ---> Preprocessor
BaseTester ----> Tester
BaseTrainer ----> Trainer
3. add more code comments
4. fix bugs in predictor's data_forward
5. in sampler.py, remove Bachifier, fix some codes. but not test
6. remove unused codes in other_modules.py & utils.py
7. update fastnlp.py with new config file names and code comments
8. add data examples in data_for_tests/
7 years ago
xuyige
beee885689
add test code for testing variational rnn
7 years ago
xuyige
2bc54c6d17
add test code for testing masked rnn
7 years ago
xuyige
7a54a20908
add codes testing utils
7 years ago
xuyige
246908bf45
find a bug that bilinear must have bias
7 years ago
xuyige
e58295d657
add test code for testing other modules
7 years ago