9d0b38b4e4
[to #42322933 ] lazy load on trainer
3 years ago
75da5fd344
[to #42322933 ] Remove beta revision
移除测试中 damo/nlp_palm2.0_text-generation_english-base beta 分支的使用
3 years ago
064f1041a9
[to #42322933 ] Refine the nlp examples of finetuning
1. Refine the nlp finetune examples
2. Remove some useless code
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9631158
3 years ago
21fa71baf0
[to #42322933 ] add/refactor nlp models source code and finetune
1. add sbert,veco,palm,space source code
2. support sbert sequence classification, token classification finetune
3. support veco sequence classification finetune
4. support palm nlg finetune
evaluation result: https://sheet.alibaba-inc.com/#/sheet/f7fdcc7f22bd5105 sheet:Maas
5. add ut for finetunes
6. add veco's taskdataset processor
7. add a common trainer for nlp, and a specific trainer for veco
8. merge some duplicate codes of models, preprocessors, pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9574105
* add basic class of hook&metrics
* pre-commit passed
* change some comments
* pre commit passed
* 1. remove accuracy's groups 2. remove useless hooks 3. simplify priorities
* pre-commit passed
* fix a comment
* Merge branch 'master' into finetune_hooks_metrics
# Conflicts:
# modelscope/metainfo.py
* pre-commit passed
* add basic class of hook&metrics
* pre-commit passed
* change some comments
* pre commit passed
* 1. remove accuracy's groups 2. remove useless hooks 3. simplify priorities
* pre-commit passed
* fix a comment
* Merge branch 'feat/finetune' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into feat/finetune
* mv hooks related to modelscope/trainers/hooks
* mv priority back
* add torch mdoel base and test
* update hooks, trainer, import_util
* add torch epoch based trainer and dis utils
* add hooks
* fix warmup
* format code stype and fix warmup and add warmup unittest
* fix impls
* pre-commit check passed
* update hook and add EpochBasedTrainer
* add trainer unittest
* Merge branch 'feat/add_hooks' into feat/add_task
# Conflicts:
# modelscope/models/base_torch.py
# modelscope/trainers/hooks/hook.py
# modelscope/trainers/trainer.py
* update unittest name
* rewrite taskdataset to trainer
* fix trainer and add unittest
* add unittest
* code: run to forward
* run through... but ugly code
* arrange some cls
* fix some errs
* revert some mistakes
* init check in
* Merge branch 'feat/add_hooks' into feat/add_task
# Conflicts:
# modelscope/trainers/trainer.py
* test with bigger epoch and size
* add the default metrics class
* move build metrics code to a method
* merge add_task
* merge origin add_task
* add device initialization
* remove preprocessor arg for bool
* add task models
* move metric collect logic to metrics class
* pre-commit passed
* fix cr comments
* precommit passed
* add task models
* Merge remote-tracking branch 'origin/feat/add_task' into feat/backbone_head
* add comment
* change comment formats.
* fix comments
* fix ut bug
* fix comments
* add wrapper check
* fix comments
* pre commit passed
* fix cr comments
* solve a loop import problem
* fix ut bug
* fix ut errors
* change dummydataset to msdataset
* precommit passed
* merge add task
* backbone-head is build, model is not correctly loaded
* model load states matched
* result matched
* lint
* add veco/palm_v2 code
* merge master
* merge master success running
* add repr model name level
* Merge branch 'feat/veco_palm' into feat/finetune_sbert_veco
* model test for training
* add token-classification metric add formal ut
* fix running bug
* finetune and pipeline are working with backbone-head
* add nli
* add missing code
* finetune and pipeline are working with backbone-head
* Merge branch 'feat/backbone_head' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/backbone_head
* add a test repo for pr
* remove merge conflicted file
* remove merge conflicted file 1
* lint check
* import error
* none type bug fix
* forward input unpacking or dict bug
* move head into models, add build_backbone with registry, no base method
* merge master
* feat: 1. add interleave dataset method 2. support multiple dataset in trainer.build_dataset 3. support 3 sub tasks in sequence_classification task
* unfinished
* update the task model structure in NLP field
* merge master
* update by comments
* keep the default model id as current on production
* unfinished
* unfinished
* veco can run
* Merge remote-tracking branch 'origin/master' into feat/backbone_head
* add taskmodel for module management
* remove forward_input_is_dict
* unfinished
* token classification started
* update base model structure
* move space to backbone
* remove 'type' in build_from_cfg method
* test update
* bug fix
* on tesing, mess code
* Merge branch 'feat/backbone_head' into feat/refactor_nlp_730
# Conflicts:
# modelscope/metrics/builder.py
# modelscope/models/__init__.py
# modelscope/models/nlp/__init__.py
# modelscope/preprocessors/nlp.py
# modelscope/trainers/trainer.py
# requirements/multi-modal.txt
* add missing merge
* add sofa source code
* refactor
* add veco task dataset
* add veco task dataset
* pre-commit passed
* fix bug of log
* add some features
* merge master
* bug fix
* refine nlp models
* fix the training error
* unfinished
* refactor pipeline
* Merge branch 'feat/backbone_head' into feat/refactor_nlp_730
# Conflicts:
# modelscope/metrics/builder.py
# modelscope/models/nlp/__init__.py
# modelscope/models/nlp/backbones/structbert/modeling_sbert.py
# modelscope/models/nlp/palm_v2/palm_for_text_generation.py
# modelscope/preprocessors/base.py
# modelscope/preprocessors/nlp.py
# modelscope/trainers/trainer.py
* Merge commit 'ab04ceafc5453ce7daa9aa09e37a55f703072a10' into feat/refactor_nlp_730
# Conflicts:
# modelscope/metainfo.py
# modelscope/metrics/builder.py
# modelscope/models/__init__.py
# modelscope/models/base/base_torch_model.py
# modelscope/models/nlp/__init__.py
# modelscope/models/nlp/backbones/space/model/intent_unified_transformer.py
# modelscope/models/nlp/backbones/space/model/model_base.py
# modelscope/models/nlp/palm_v2/palm_for_text_generation.py
# modelscope/models/nlp/sbert_for_sequence_classification.py
# modelscope/models/nlp/sequence_classification.py
# modelscope/models/nlp/space/__init__.py
# modelscope/models/nlp/space_for_dialog_intent_prediction.py
# modelscope/models/nlp/space_for_dialog_modeling.py
# modelscope/models/nlp/space_for_dialog_state_tracking.py
# modelscope/models/nlp/task_model.py
# modelscope/pipelines/nlp/sentiment_classification_pipeline.py
# modelscope/preprocessors/base.py
# modelscope/preprocessors/nlp.py
# modelscope/trainers/trainer.py
* revert changes
* unify sentnece classification postprocess
* revert some changes, move some model files
* pipeline first case run through
* ws pipeline passed
* Merge branch 'feat/refactor_nlp_730' into feat/finetune_sbert_veco
* finetune
* revert code
* revert some code
* ws finetune started, only the accuracy is weird
* Merge branch 'feat/veco_taskdataset' into feat/finetune_sbert_veco
# Conflicts:
# modelscope/task_datasets/veco_dataset.py
# tests/taskdataset/test_veco_dataset.py
* veco+nli finetune started
* Merge branch 'master' into feat/finetune_sbert_veco
# Conflicts:
# modelscope/models/nlp/sbert_for_sequence_classification.py
# modelscope/models/nlp/sbert_for_token_classification.py
# modelscope/models/nlp/sbert_for_zero_shot_classification.py
# modelscope/models/nlp/space/space_for_dialog_intent_prediction.py
# modelscope/models/nlp/space/space_for_dialog_modeling.py
# modelscope/trainers/trainer.py
* add trainer for nlp
* trainer: dataset params passed into preprocessor
* test passed by nlptrainer
* fix some bugs
* fix some bugs
* add backbone/head subclass
* fix regression bugs
* fix bug in token-cls finetune
* support cfg modification
* fix bug
* fix bug
* update requirements
* add some comments and fix some t
* add some comments and revert a argument
* split to two test files
* revert code
* fixbug in precessor
(cherry picked from commit 7a648d096e
3 years ago
3f7a5c8279
[to #42322933 ]人像增强
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9590794
3 years ago
7d348b9ae8
[to #42322933 ] change dummy dataset to msdataset
1. change dummy dataset to msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9586561
* change dummpy dataset to msdataset
* add pre-commit ignore
* Merge commit 'e93339ea877b93fa0c1b9ebfeee8877f78facb0e' into feat/ms_dataset_case
* Merge commit '34840fc5d8a8ee8cd1278efea913d42db522f9c8' into feat/ms_dataset_case
* remove useless ip hosts.
* Merge commit '47dda0a5f9b4b4466177d9acae097a53f8bea8f7' into feat/ms_dataset_case
* Merge commit '21de1e7db035843c6c2caccf382a6e4f7071f96b' into feat/ms_dataset_case
3 years ago
34840fc5d8
[to #43627720 ] support ReduceLROnPlateau and fix lr scheduler
1. Support `ReduceLROnPlateau` lr scheduler, and add `PlateauLrSchedulerHook` for it
2. Support custom `optimizer_hook` and `lr_scheduler_hook`
3. Remove function of save best ckpt from `EvaluationHook`, replace with `BestCkptSaverHook`
4. `evaluation_loop` return metric values directly，move metric computation to `single_gpu_test` and `multi_gpu_test`
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9584322
* [to #43627720 ] support ReduceLROnPlateau and fix lr scheduler
3 years ago
743e876981
[to #43660556 ] msdataset数据集加载
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9552632
* load csv dataset from modelscoop
3 years ago
39c684db24
[to #43115513 ] remove easynlp trainer test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9567392
3 years ago
b3f4ac8acc
[to #43115042 ] add trainer usage doc
1. add trainer doc
2. support local configuration file for trainer
3. update nlp trainer test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9541239
3 years ago
21437650f1
[to #43627720 ] support distributed training
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9551089
* support distributed training
3 years ago
d55525bfb6
[to #43112771 ] requirements check and lazy import support
3 years ago
8120891eb7
[to #42322933 ][730 model] add image denoise
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491966
3 years ago
c112e599fe
[to #42322933 ]enable image segmentation test
enable image segmentation test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9522337
3 years ago
ef8b1f2bd7
[to #42322933 ]add clip fine-tune code
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9497065
3 years ago
2e43b376f5
[to #42322933 ]disable image segmentation test temporarily
3 years ago
321292ceda
[to #42322933 ] add image instance segmentation pipeline and finetune to MaaS-lib
3 years ago
da20fb66e9
[to #43259593 ]添加image-color-enhance, pipeline and trainer
添加image-color-enhance, pipeline and trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9483118
3 years ago
4814b198f0
[to #43112534 ] taskdataset refine and auto placement for data and model
* refine taskdataset interface
* add device placement for trainer
* add device placement for pipeline
* add config checker and fix model placement bug
* fix cycling import
* refactor model init for translation_pipeline
* cv pipelines support kwargs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9463076
3 years ago
68fc437044
[to #42322933 ] Add backbone-head model structure
3 years ago
2c3875c0e1
[to #43299989 ] Fix msdataset
* fix msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9436292
* fix msdataset
3 years ago
0b7b964226
[to #42322933 ] Add palm finetuning
Palm 模型支持 finetuning
3 years ago
f3d739bea7
[to #43105545 ] add default config and new hooks
3 years ago
231f400133
[to #43112534 ] finetune support and first case
co-contributed with 夕陌&雨泓
* add torch epoch based trainer and dis utils
* add hooks including optimizer, lrscheduler, logging, checkpoint, evaluation, time profiling
* add torch mdoel base and test
* add optimizer and lrscheduler module
* add sbert for text classification example
* add task_dataset for dataset-level processor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9338412
3 years ago
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
3 years ago
25a2028b54
[to #41401401 ] modelhub and Trainer support
* add trainer interface
* add trainer script
* add model init support for pipelineadd pipeline tutorial and fix bugs
* add text classification evaluation to maas lib
* add quickstart and prepare env doc
* relax requirements for torch and sentencepiece
* merge release/0.1 and fix conflict
* modelhub support for model and pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868339
3 years ago
zhangzhicheng.zzc
hemu.zp
yuze.zyz
baiguan.yt
jiangnana.jnn
feiwu.yfw
wenmeng.zwm
huizheng.hz
hejunjie.hjj
eniac.xcw
Yingda Chen
wenqi.oywq