yh
5c80c6f4f5
将DataInfo修改为DataBundle
6 years ago
xuyige
089009f9f2
大幅度更新:
1、更新requirements以及README.md
2、更新DataLoader
3、更新loss
4、更新model/bert.py内容及适配的测试代码
5、更新reproduction/README.md
6、修复其他测试代码的报错的地方
6 years ago
yh_cc
2f5d8967a3
1. 适配将Batch修改为pytorch的DataLoader的修改
2. 修改embedding.py中的bug
3. ConllReader默认跳过所有的DOCSTART标签
4. 交换bert的heavy lifting到_bert, 将BertEncoder在bert.py中暴露
5. crf中allow_transition的include_end_start修改为false,以与CRF的默认值适配
6. allow_transition与SpanMetric支持BIOES类型的tag
7. datainfo中增加打印格式化输出
6 years ago
yunfan
7fea175f0a
move sst loader to new folder
6 years ago
ChenXin
bdec6187a2
一些符合 PEP8 的微调
6 years ago
ChenXin
9c07850019
修改了 models 部分 import 的顺序,__all__ 暴露的内容
6 years ago
ChenXin
fec3216a0e
使用 .. todo:: 隐藏了可能被抽到文档中的 TODO 注释
6 years ago
ChenXin
a1f8cdec48
修改了 io 部分的注释
6 years ago
FengZiYjun
986541139a
整理所有dataset loader,建立单元测试
6 years ago
FengZiYjun
dedc160415
fix docs for io/
7 years ago
FengZiYjun
db0a789d61
* final clean up
* remove conflicts
* all tests passed
7 years ago
yunfan
267baec224
add dataloader register
7 years ago
FengZiYjun
27e9453d19
* fix processor.py
* add code comments
* merge *_saver.py & *_loader.py in io/
* (ancient codes) rename Loss into LossFromTorch
7 years ago
FengZiYjun
3d66975091
* refine code comments
* refine code style
* set up unit tests for Batch, DataSet, FieldArray
* remove a lot of out-of-date unit tests, to get testing passed
7 years ago
yunfan
3a42c84a47
use counter in vocab, add a load func in baseloader
7 years ago
FengZiYjun
e9d7074ba1
* delete readme_example.py because it is oooooooout of date.
* rename preprocess.py into utils.py, because nothing about preprocess in it
* anything in loader/ and saver/ is moved directly into io/
* corresponding unit tests are moved to /test/io
* delete fastnlp.py, because we have new and better APIs
* rename Biaffine_parser/run_test.py to Biaffine_parser/main.py; Otherwise, test will fail.
* A looooooooooot of ancient codes to be refined...........
7 years ago