ChenXin
4926b33df0
core部分的测试和一些小修改
6 years ago
yunfan
799d4dbc68
- add test
- fix jsonloader
6 years ago
yh_cc
7997dce8a7
对DataSet的文档进行更新
6 years ago
FengZiYjun
986541139a
整理所有dataset loader,建立单元测试
6 years ago
FengZiYjun
f3cb812554
将tesorboardX处理为callback, 从trainer移除tensorboardX相关代码
6 years ago
yh_cc
2e3ef52a7d
将batch增强为多进程batch
6 years ago
FengZiYjun
e4f997d52a
refactor type system in FieldArray:
* 重构dtype的检测代码,在FieldArray的初始化和append两处,达到更好的代码复用
* 类型检测的责任完全落在FieldArray,DataSet与之配合
测试:
* 整理dtype相关的测试代码
* 给所有tutorial添加测试
其他:
* 完善一个完整的Conll dataset loader
* 升级POS tag model训练脚本
6 years ago
FengZiYjun
d80d944e40
* 添加callbacks:EarlyStopCallback
* 将dataset.py中的assert改为raise error
* 给trainer添加try-except,捕捉EarlyStopError
* 优化trainer代码
* 给callbacks添加测试
6 years ago
FengZiYjun
1fdaf236d2
Updates:
* 改名: chinese_word_segment ---> Chinese_word_segmentation
* 改名: pos_tag_model ---> POS_tagging
* 添加4个对Batch的测试
* 删除无用的chinese_word_segment/run.py
6 years ago
FengZiYjun
cc440b5ed6
All tests pass.
* 更新测试代码,跑通所有测试,覆盖率65%
* refine代码规范和某些注释
* fix tester self.use_cuda未赋值先使用的bug
* 添加tutorial样例数据——tutorial_sample_dataset.csv
* 【unsolved】embed_loader在计算np.cov时遇到segmentation fault
7 years ago
FengZiYjun
3d66975091
* refine code comments
* refine code style
* set up unit tests for Batch, DataSet, FieldArray
* remove a lot of out-of-date unit tests, to get testing passed
7 years ago
FengZiYjun
837bef47dc
* add unit tests for instance, vocabulary
* remove and fix other unit tests
* add more code comments
7 years ago
FengZiYjun
090f7aef5b
* fixing unit tests
7 years ago
yunfan
82f4351540
add index to word processor
7 years ago
yunfan
a4c9786ca4
update dataset & loader
7 years ago
xuyige
91f3d97ace
Update to new version of framework
7 years ago
FengZiYjun
f2fc98b5e6
add Field support in Predictor:
- apply DataSet in Predictor; remove sub-predictors; add "task" argument to specify which task to predict, as how Trainer/Tester did.
- remove Action class
- add helper function for DataSet, to create DataSet easily
- more code comments
- clean up unnecessary codes
- add unit tests for Batch, Predictor, Preprocessor, Trainer, Tester
7 years ago