xuyige
570b214dfb
增加fastNLP.embeddings模块并修改对应的现有代码以适配fastNLP.embeddings
6 years ago
xuyige
089009f9f2
大幅度更新:
1、更新requirements以及README.md
2、更新DataLoader
3、更新loss
4、更新model/bert.py内容及适配的测试代码
5、更新reproduction/README.md
6、修复其他测试代码的报错的地方
6 years ago
yh_cc
2f5d8967a3
1. 适配将Batch修改为pytorch的DataLoader的修改
2. 修改embedding.py中的bug
3. ConllReader默认跳过所有的DOCSTART标签
4. 交换bert的heavy lifting到_bert, 将BertEncoder在bert.py中暴露
5. crf中allow_transition的include_end_start修改为false,以与CRF的默认值适配
6. allow_transition与SpanMetric支持BIOES类型的tag
7. datainfo中增加打印格式化输出
6 years ago
xuyige
016f02be3b
fix bugs in model/bert.py and add testing codes
6 years ago
ChenXin
ff1d695aa4
修改了 modules 模块的__all__ 和 import
6 years ago
ChenXin
51b493d716
修改 io 的测试文件; 删除了一些过时的测试
6 years ago
yh_cc
56ff4ac7a1
统一不同位置的seq_len_to_mask, 现统一到core.utils.seq_len_to_mask
6 years ago
yunfan
702fa1d95c
- update attention
- fix tests
6 years ago
yh_cc
f65c0935f6
Merge branch 'dev' of github.com:choosewhatulike/fastNLP-private into dev
6 years ago
yh_cc
06891cf90a
补充注释,并修改部分代码
6 years ago
xuyige
ee49f4177e
update char level encoder
6 years ago
yunfan
e025350ea8
Merge branch 'dev' of https://github.com/choosewhatulike/fastNLP-private into pr
6 years ago
yh_cc
29f81e79ad
准备发布0.4.0版本“
6 years ago
yunfan
e12041513f
Merge remote-tracking branch 'private/dev' into pr
# Conflicts:
# fastNLP/core/callback.py
# fastNLP/core/trainer.py
6 years ago
yh
e5f68bbd5b
修复CRF为负数的bug
6 years ago
yh
f2d7d01bb7
修复CRF中可能存在的bug
6 years ago
yunfan
7c7f28f2ac
- add star-transformer
6 years ago
yh
897c43fc3b
1. CRF增加constrain, 用于限制跃迁,比如BMES中B不能跃迁到S
2. metric增加SpanFMetric,可以用于计算sequence labelling的performance
3. 分词复现任务根据新版接口做了部分调整。
7 years ago
FengZiYjun
3d66975091
* refine code comments
* refine code style
* set up unit tests for Batch, DataSet, FieldArray
* remove a lot of out-of-date unit tests, to get testing passed
7 years ago
yunfan
8ea529404e
fix test
7 years ago
FengZiYjun
fb806163c3
remove unused codes; add more tests
7 years ago
FengZiYjun
5be4cb7bb5
Merge Preprocessor into DataSet.
- DataSet's __init__ takes a function as argument, rather than class object
- Preprocessor is about to remove. Don't use anymore.
- Remove cross_validate in trainer, because it is rarely used and wired
- Loader.load is expected to be a static method
- Delete sth. in other_modules.py
- Add more tests
- Delete extra sample data
7 years ago
FengZiYjun
28a0683853
1. add tests in test_fastNLP.py & test_sampler.py; increase test coverage to 81%
2. changes of names:
aggregation ----> aggregator
interaction ----> interactor
action.py ----> sampler.py
BasePreprocess ---> Preprocessor
BaseTester ----> Tester
BaseTrainer ----> Trainer
3. add more code comments
4. fix bugs in predictor's data_forward
5. in sampler.py, remove Bachifier, fix some codes. but not test
6. remove unused codes in other_modules.py & utils.py
7. update fastnlp.py with new config file names and code comments
8. add data examples in data_for_tests/
7 years ago
xuyige
beee885689
add test code for testing variational rnn
7 years ago
xuyige
2bc54c6d17
add test code for testing masked rnn
7 years ago
xuyige
7a54a20908
add codes testing utils
7 years ago
xuyige
246908bf45
find a bug that bilinear must have bias
7 years ago
xuyige
e58295d657
add test code for testing other modules
7 years ago