行嗔
55fb3b05a9
format finetune code, and ut case
3 years ago
行嗔
44026e0bf8
Merge remote-tracking branch 'origin/master' into ofa/finetune
3 years ago
yuze.zyz
707cbef013
[to #42322933 ]Fix bug in daily UT
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491891
3 years ago
zhangyanzhao.zyz
824ee8232c
[to #42322933 ]更新语义相关性任务英文名称为text ranking,修改对应变量名和类名
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491951
3 years ago
Yingda Chen
dee93c40e2
[to #42322933 ] force download dataset for portraint enhancement
3 years ago
行嗔
330a8ac68f
Merge remote-tracking branch 'origin/master' into ofa/finetune
3 years ago
baiguan.yt
533ab3df63
[to #42322933 ]update msdatasets for image-portrait-enhancement training
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10453584
3 years ago
翎航
9b8cfc4ece
modify ofatrainer
3 years ago
Yingda Chen
b559ea50ca
Merge remote-tracking branch 'origin' into ofa/finetune
3 years ago
yuze.zyz
acba1786b0
[to #42322933 ] Fix bug in UT daily
1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764
3 years ago
shouzhou.bx
01d521dd78
[to #42322933 ]add face 2d keypoints finetune test case
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421808
* add face 2d keypoints & human wholebody keypoint finrtune test case
3 years ago
Yingda Chen
089cadab4b
[to #42322933 ] disable unstable trainer test
3 years ago
行嗔
e76f5a96a3
fix comments
3 years ago
行嗔
8257e28a4f
Merge remote-tracking branch 'origin/master' into ofa/finetune
# Conflicts:
# modelscope/metrics/__init__.py
3 years ago
huizheng.hz
c0b546a96e
[to #42322933 ]add subset_name when loading dataset (NAFNet image denoising)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10427797
3 years ago
hanyuan.chy
2d50c812df
[to #42322933 ] support finetune on cv/hand_2d_keypoints
添加2d手部关键点检测finetune功能
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10371710
3 years ago
bin.xue
3863efc14d
[to #42322933 ] add far field KWS trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10275823
3 years ago
yuxiang.tyx
2989492bc0
[to #42322933 ]更新face_detection_scrfd模型并支持finetune, 新增card_detection模型
1. 调整face_detection的文件层级(scrfd与其余新增face_detection方法平级);
2. 增加极大脸/旋转脸的检测方法,更新了新模型;
3. 支持读入数据集并finetune和eval;
4. 新增card_detection模型,支持读入datasethub数据集并finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10244540
3 years ago
huizheng.hz
922f4c589b
[to #42322933 ]图像去噪using msdataset to load dataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10338265
3 years ago
ashui.cbh
69da8f91ac
[to #42322933 ]suport image inpainting
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10111615
3 years ago
laiyin.lyc
09d2296f36
[to #44847108 ] add sparsity hook (pst algorithm)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10198228
* [to #44847108 ] add sparsity hook (pst algorithm)
3 years ago
行嗔
dbf022efe8
caption finetune done, add belu
3 years ago
行嗔
a0c57e1538
Merge remote-tracking branch 'origin/master' into ofa/finetune
3 years ago
行嗔
3b09d848ce
update
3 years ago
yuze.zyz
357a233ee3
[to #42322933 ] fix bug: checkpoint hook and bestckpthook exists at the same time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10227608
3 years ago
行嗔
537827e5a1
Merge remote-tracking branch 'origin/master' into ofa/finetune
# Conflicts:
# modelscope/models/multi_modal/ofa_for_all_tasks.py
# modelscope/msdatasets/ms_dataset.py
# modelscope/trainers/utils/inference.py
3 years ago
行嗔
d979b90439
Merge branch 'master' into ofa/finetune
# Conflicts:
# modelscope/preprocessors/multi_modal.py
# modelscope/trainers/trainer.py
# tests/pipelines/test_ofa_tasks.py
3 years ago
jiangnana.jnn
1794e08af7
fix dist training
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10185634
* fix dist training
3 years ago
行嗔
5d83f62312
mnli finetune done
3 years ago
wenmeng.zwm
6808e9a301
[to #44902099 ] add license for framework files
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10189613
3 years ago
yuze.zyz
4cdd0c23eb
[to #42322933 ] Refactor and fix some bugs
1. Fix a bug in trainer's progress bar
2. Fix a bug that trainer does not support dataset in config file
3. Add feature: support go on training via checkpoint file
4. Add feature: support fixed filename when saving best checkpoint
5. Fix a bug that no id2label in config file after finetune of nlp models
6. Fix some other bugs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10138906
3 years ago
wenmeng.zwm
7fb25d7bbb
[to #42322933 ]fix UT error for 830 version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10142442
3 years ago
jiangnana.jnn
adee5d10ae
update EasyCV MsDataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10103248
* update EasyCV MSDataset
3 years ago
dingkun.ldk
54e1a6d88b
[to #42322933 ]830NLP 篇章排序/文本表示模型代码check
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856179
3 years ago
ly119399
b41b10f897
[to #42322933 ] space finetune on generation task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10061562
3 years ago
jiangnana.jnn
5e176da3a1
adapt to msdataset for EasyCV
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9935664
* adapt to msdataset for EasyCV
3 years ago
cyc385202
d4759e4c24
[to #42322933 ] 加入space模型在banking数据集上的finetune代码
加入space模型在banking数据集上的微调代码
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006792
3 years ago
yuze.zyz
01e768503c
[to #42322933 ] Fix random seed for trainer
1. Fix random seed for trainer and init it at the first line of init
2. Add a regress test for fixed training
3. Change the dataset 'dureader_robust_qg' to 'DuReader_robust-QG'
4. Change some datasets from loading hf.datasets to loading msdataset.load
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10029509
3 years ago
行嗔
5cf6910bed
Merge remote-tracking branch 'origin/master' into ofa/finetune
3 years ago
hemu.zp
3d3f9b4537
[to #42322933 ] fix checkpoint format
1. 修复 palm,gpt3,mplug 模型存在的 finetune 后保存 checkpoint 与原有 checkpoint key 字段存在区别无法使用 from_pretrained 导入的问题
2. 调整 test_finetune_mplug.py 为只保存训练结束时的 checkpoint,减少 ci 耗时
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10016517
3 years ago
bin.xue
b870e4eed5
[to #42322933 ] test: use custom config to reduce test time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10011826
、
3 years ago
yuze.zyz
a9c14e4ead
[to #42322933 ] Support saving the best checkpoint for inference
1. Support saving the best checkpoint for inference
2. Fix a bug that _max_iters field does not exist in trainer
3. Fix a bug that function in lambda_lr field cannot be saved to file
4. Fix a bug that save_pretrained would not be called by iterating
5. Fix a bug that interval is not passed from BestCkptHook's init
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9972765
3 years ago
行嗔
db534fe946
add hf dataset
3 years ago
Yingda Chen
39a309b655
[to #42322933 ] reduce train epoch from 3 to w
3 years ago
jiangnana.jnn
1a22fa0222
fix trainer unittest
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9970626
* fix trainer unittest
3 years ago
行嗔
c546f2a8b9
Merge remote-tracking branch 'origin/master' into ofa/finetune
# Conflicts:
# modelscope/preprocessors/multi_modal.py
3 years ago
行嗔
a3aee4bec2
test finetune
3 years ago
shuying.shu
a9deb3895c
[to #42322933 ] movie scene segmentation模型接入
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9872869
3 years ago
mulin.lyh
12698b31a0
[to #44340132 ] fix: ci case run out of gpu memory
3 years ago
feiwu.yfw
2b64cf2bb6
[to #42322933 ]支持从dataset json文件中获取参数
* dataset json file add args
3 years ago