yh
e5f68bbd5b
修复CRF为负数的bug
7 years ago
FengZiYjun
99d6bb208b
change two default init arguments of Trainer into None
7 years ago
yh
f2d7d01bb7
修复CRF中可能存在的bug
7 years ago
yh
22661ea866
修复crf中typo; 以及可能导致数值不稳定的地方
7 years ago
yh
3d7cfb3598
修复fieldarray中padder潜在bug
7 years ago
FengZiYjun
95a72f06b9
* AutoPadder will not pad when dtype is None
* add ignore_type in DataSet.apply
7 years ago
FengZiYjun
3e01b14249
add ignore_type in DataSet.add_field
7 years ago
chenkaiyu1997
251088ac4b
Add ENAS (Efficient Neural Architecture Search)
7 years ago
Coet
feb8f63a06
Update README.md
fix tutorial link
7 years ago
yh
f14d317599
Merge branch 'dev' of github.com:choosewhatulike/fastNLP-private into dev
7 years ago
yh
8d4f26bbd9
增加metric注释;修改trainer save过程中的bug
7 years ago
xuyige
ee677d5d55
update MLP module
7 years ago
yh
3ea7de1673
1.修改ClipGradientCallback的bug;删除LRSchedulerCallback中的print,之后应该传入pbar进行打印;2.增加MLP注释
7 years ago
yh
5eb126dbcd
BucketSampler增加一条错误检测
7 years ago
yh
853bea5812
Merge branch 'dev' of github.com:choosewhatulike/fastNLP-private into dev
7 years ago
yh
29eab18b78
1. CRF增加支持bmeso类型的tag 2. vocabulary中增加注释
7 years ago
FengZiYjun
b66d7b8f51
update API introduction
7 years ago
FengZiYjun
d1b5adabc4
add codecov fix
7 years ago
FengZiYjun
0c5630bd16
Ready for V0.3.1
* 升级parser API和模型
* update docs: add new pages for tutorials
* upgrade CWS api download source
* add a new method for dataset field access
* add introduction for bert
* add more unit tests for api/processor
* remove unused test data. Add new test data.
7 years ago
FengZiYjun
986541139a
整理所有dataset loader,建立单元测试
7 years ago
FengZiYjun
bfaf09df8c
add BERT model
* load pre-trained BERT weights from local binary
* add tests
7 years ago
FengZiYjun
887fc9281f
update callbacks:
* rename callback methods. Use fastai's notation.
* add a new callback method - on_valid_begin
7 years ago
xuyige
e0d6a259ae
skip training while n_epoch in trainer is not greater than 0
7 years ago
xuyige
d4b4ffa28b
add testing tutorial
7 years ago
yunfan
9474ab4b34
remove device in batch
7 years ago
yunfan
c02980e006
Merge branch 'yyff' into dev
7 years ago
yunfan
a37de4344d
add batch device
7 years ago
yunfan
e93c6f0053
Merge branch 'dev' of https://github.com/choosewhatulike/fastNLP-private into dev
7 years ago
yh
47ec69ea96
trainer根据syf的多进程batch进行修改
7 years ago
FengZiYjun
f3cb812554
将tesorboardX处理为callback, 从trainer移除tensorboardX相关代码
7 years ago
yunfan
03f49c8264
- batch with multiprocessing
7 years ago
FengZiYjun
b14dd58828
Update POS API
7 years ago
FengZiYjun
62ea4f7fed
添加LR finder,用第一个epoch找最佳lr,从第二个epoch开始训练
7 years ago
yunfan
a7f3701bdf
- revert batch
7 years ago
yunfan
de856fb8eb
update reproduction
7 years ago
yunfan
eb55856c78
- fix parser train
7 years ago
FengZiYjun
ab953b43ab
* 重构POS API,改成接受word作为输入
* 添加两类Callback
* 完善Trainer对error的捕捉
7 years ago
yh_cc
d9ac334409
减少batch中不断创建多进程的开销
7 years ago
yh_cc
2e3ef52a7d
将batch增强为多进程batch
7 years ago
FengZiYjun
864c2238f8
添加FieldArray对list of np.array的支持
7 years ago
FengZiYjun
b93ca9bb30
* FieldArray添加对list of np.array的支持
* 添加测试:FieldArray的初始化
7 years ago
FengZiYjun
e4f997d52a
refactor type system in FieldArray:
* 重构dtype的检测代码,在FieldArray的初始化和append两处,达到更好的代码复用
* 类型检测的责任完全落在FieldArray,DataSet与之配合
测试:
* 整理dtype相关的测试代码
* 给所有tutorial添加测试
其他:
* 完善一个完整的Conll dataset loader
* 升级POS tag model训练脚本
7 years ago
yh
73dd35dabf
Merge branch 'dev' of github.com:choosewhatulike/fastNLP-private into dev
7 years ago
yh
3e33a23042
修改Padder的测试用例
7 years ago
yh
8091a734ee
1. 将pad的功能从FieldArray中剥离出来,使用Padder完成各种padding操作。
2. FieldArray默认使用AutoPadder, AutoPadder的行为与之前不使用padder是一致的的
3. 为了解决二维padding的问题,引入了EngChar2dPadder用于对character进行padding
4. 增加一份padding的tutorial。
7 years ago
FengZiYjun
d80d944e40
* 添加callbacks:EarlyStopCallback
* 将dataset.py中的assert改为raise error
* 给trainer添加try-except,捕捉EarlyStopError
* 优化trainer代码
* 给callbacks添加测试
7 years ago
yh
1f50b01ffa
conflict solved
7 years ago
yh
6a0a1ed4ad
train增加注释;attention增加注释;新增transformer分词
7 years ago
FengZiYjun
1fdaf236d2
Updates:
* 改名: chinese_word_segment ---> Chinese_word_segmentation
* 改名: pos_tag_model ---> POS_tagging
* 添加4个对Batch的测试
* 删除无用的chinese_word_segment/run.py
7 years ago
FengZiYjun
c4ba75d160
code optimization
* move used readers from reproduction to io/dataset_loader.py
(API shall not call anything from reproduction/)
7 years ago