yunfan
|
f4e64906d4
|
- fix callback & tests
|
7 years ago |
yunfan
|
e12041513f
|
Merge remote-tracking branch 'private/dev' into pr
# Conflicts:
# fastNLP/core/callback.py
# fastNLP/core/trainer.py
|
7 years ago |
yunfan
|
58f373d371
|
- fix test
|
7 years ago |
yh
|
ec90a1f0bb
|
Merge branch 'dev' of github.com:choosewhatulike/fastNLP-private into dev
|
7 years ago |
yh
|
e5f68bbd5b
|
修复CRF为负数的bug
|
7 years ago |
FengZiYjun
|
6a498bbdf2
|
* 给vocabulary添加遍历方法
|
7 years ago |
FengZiYjun
|
ef0c6e936d
|
Changes to Callbacks:
* 给callback添加给定几个只读属性
* 通过manager设置这些属性
* 代码优化,减轻@transfer的负担
|
7 years ago |
FengZiYjun
|
95a72f06b9
|
* AutoPadder will not pad when dtype is None
* add ignore_type in DataSet.apply
|
7 years ago |
FengZiYjun
|
3e01b14249
|
add ignore_type in DataSet.add_field
|
7 years ago |
FengZiYjun
|
986541139a
|
整理所有dataset loader,建立单元测试
|
7 years ago |
FengZiYjun
|
887fc9281f
|
update callbacks:
* rename callback methods. Use fastai's notation.
* add a new callback method - on_valid_begin
|
7 years ago |
FengZiYjun
|
f3cb812554
|
将tesorboardX处理为callback, 从trainer移除tensorboardX相关代码
|
7 years ago |
FengZiYjun
|
62ea4f7fed
|
添加LR finder,用第一个epoch找最佳lr,从第二个epoch开始训练
|
7 years ago |
FengZiYjun
|
ab953b43ab
|
* 重构POS API,改成接受word作为输入
* 添加两类Callback
* 完善Trainer对error的捕捉
|
7 years ago |
yh_cc
|
d9ac334409
|
减少batch中不断创建多进程的开销
|
7 years ago |
yh_cc
|
2e3ef52a7d
|
将batch增强为多进程batch
|
7 years ago |
FengZiYjun
|
864c2238f8
|
添加FieldArray对list of np.array的支持
|
7 years ago |
FengZiYjun
|
b93ca9bb30
|
* FieldArray添加对list of np.array的支持
* 添加测试:FieldArray的初始化
|
7 years ago |
FengZiYjun
|
e4f997d52a
|
refactor type system in FieldArray:
* 重构dtype的检测代码,在FieldArray的初始化和append两处,达到更好的代码复用
* 类型检测的责任完全落在FieldArray,DataSet与之配合
测试:
* 整理dtype相关的测试代码
* 给所有tutorial添加测试
其他:
* 完善一个完整的Conll dataset loader
* 升级POS tag model训练脚本
|
7 years ago |
yh
|
73dd35dabf
|
Merge branch 'dev' of github.com:choosewhatulike/fastNLP-private into dev
|
7 years ago |
yh
|
3e33a23042
|
修改Padder的测试用例
|
7 years ago |
yh
|
8091a734ee
|
1. 将pad的功能从FieldArray中剥离出来,使用Padder完成各种padding操作。
2. FieldArray默认使用AutoPadder, AutoPadder的行为与之前不使用padder是一致的的
3. 为了解决二维padding的问题,引入了EngChar2dPadder用于对character进行padding
4. 增加一份padding的tutorial。
|
7 years ago |
FengZiYjun
|
d80d944e40
|
* 添加callbacks:EarlyStopCallback
* 将dataset.py中的assert改为raise error
* 给trainer添加try-except,捕捉EarlyStopError
* 优化trainer代码
* 给callbacks添加测试
|
7 years ago |
FengZiYjun
|
1fdaf236d2
|
Updates:
* 改名: chinese_word_segment ---> Chinese_word_segmentation
* 改名: pos_tag_model ---> POS_tagging
* 添加4个对Batch的测试
* 删除无用的chinese_word_segment/run.py
|
7 years ago |
FengZiYjun
|
c0b67a2bc9
|
fix tests
|
7 years ago |
FengZiYjun
|
179d12327a
|
add callback in Trainer
|
7 years ago |
yh
|
897c43fc3b
|
1. CRF增加constrain, 用于限制跃迁,比如BMES中B不能跃迁到S
2. metric增加SpanFMetric,可以用于计算sequence labelling的performance
3. 分词复现任务根据新版接口做了部分调整。
|
7 years ago |
FengZiYjun
|
337e3035b3
|
* update most processors to use dataset.apply
* fix failed tests
|
7 years ago |
FengZiYjun
|
23305af733
|
Fix failed tests.
|
7 years ago |
FengZiYjun
|
db0a789d61
|
* final clean up
* remove conflicts
* all tests passed
|
7 years ago |
FengZiYjun
|
720a264eb3
|
* rename DataSet.get_fields() into get_all_fields()
* add DataSet.get_field(), to fetch a FieldArray based on its name
* remove old tutorials & add new tutorials
|
7 years ago |
FengZiYjun
|
447746d9f5
|
* remove unused codes in losses.py & metrics.py
* refine code style
* fix tests
* add a new tutorial
|
7 years ago |
FengZiYjun
|
27e9453d19
|
* fix processor.py
* add code comments
* merge *_saver.py & *_loader.py in io/
* (ancient codes) rename Loss into LossFromTorch
|
7 years ago |
yh
|
306eee9690
|
Merge branch 'trainer' of github.com:FengZiYjun/fastNLP into trainer
|
7 years ago |
yh
|
cd83866527
|
bug fix in LossInForward
|
7 years ago |
FengZiYjun
|
6129a31c1d
|
* fix tests
* clean up unused codes
|
7 years ago |
yh
|
aea931812b
|
1. trainer中losser修改为loss
|
7 years ago |
yh
|
1158556236
|
1. 优化trainer checkcode过程的报错信息
|
7 years ago |
yh
|
e779409cf8
|
conflict fix
|
7 years ago |
yh
|
4dff3ec81f
|
修改losses中直接使用F.cross_entropy的情况,因为这些函数的signature是(input, target)
|
7 years ago |
FengZiYjun
|
f26f11608b
|
* 更新教程,放在在./tutorial
* remove unused codes in metrics.py
* add tests for DataSet
* add tests for FieldArray
* add tests for metrics.py
* fix predictor, add tests for predictor
* fix bucket sampler, add tests for bucket sampler
|
7 years ago |
yh
|
7c261faf19
|
Merge branch 'trainer' of github.com:FengZiYjun/fastNLP into trainer
|
7 years ago |
yh
|
87e5d44b01
|
。
|
7 years ago |
yunfan
|
52b1b18a76
|
fix bugs in vocab
|
7 years ago |
yh
|
79ae38738f
|
conflict solved
|
7 years ago |
yh
|
62c63f159a
|
test loss
|
7 years ago |
FengZiYjun
|
27833d06ae
|
FieldArray only check type when is_input or is_target is set.
|
7 years ago |
FengZiYjun
|
9acdb54fc8
|
优化loss在missing和duplicate时报错的信息:返回loss初始化约定接受的key
|
7 years ago |
yh
|
abe5ec7261
|
Merge branch 'trainer' of github.com:FengZiYjun/fastNLP into trainer
# Conflicts:
# test/core/test_trainer.py
|
7 years ago |
yh
|
a1a41c2d8b
|
1. unused报错运行错误修复
2. loss中修复一个错误
3. metric中fast_param调整
|
7 years ago |