Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9501913

    * [to #43259593] refacor image preprocess

This reverts commit bab28ae3fa.

[依赖收集及列表](https://yuque.antfin.com/docs/share/59d1f42c-e061-4e73-903f-0af053a03627#XXbRB)
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9456258

添加image-color-enhance, pipeline and trainer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9483118

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491629

增加虚拟试衣任务，输入模特图，骨骼图，衣服展示图，生成试衣效果图
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9401415

* refine taskdataset interface
 * add device placement for trainer
 * add device placement for pipeline
 * add config checker and fix model placement bug
 * fix cycling import
 * refactor model init for translation_pipeline
 * cv pipelines support kwargs


Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9463076

添加list model查询api
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9446917

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491285

2022/7/22 更新的 rouge_socre 0.0.7 版本存在 import 报错的问题，暂时将 rouge_score 库版本设置为 <= 0.0.4

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9443821

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9409213

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9460900

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9465050

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9435758

* add model nncrf, which includes tcrf(transformer-crf) and lcrf(lstm-crf, will be implemented in 830 version).
* add NER metainfo, pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9440706

    * init

* merge master

添加了基于stylegan2的人像生成算法
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9426478

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9458816

* fix msdataset
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9436292

    * fix msdataset

Palm 模型支持 finetuning

ci 测试迁移新的机器，并且在容器中运行，减小互相干扰的可能
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9427096

    * add docker ci script

* add test code
 * fix bug
 * support gray image
 * update unitest
 * bugfixed
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9419792

将nlp.txt中的en_core_web_sm依赖删除，在代码中下载响应的依赖
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9432253

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9407594

Refactor tts task inputs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9412937

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9415565

1. 修复default data collator的输入类型为tuple时运行会失败的问题
2. 修复default data collator的输入类型为dict时不兼容BatchEncoding的问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9403517

    * fix bug: 1. run failed when datatype is tuple 2. change type checking from dict to Mapping to fit transformers.datasets.BatchEncoding

co-contributed with 夕陌&雨泓

 * add torch epoch based trainer and dis utils
 * add hooks including optimizer, lrscheduler, logging, checkpoint, evaluation, time profiling
 * add torch mdoel base and test
 * add optimizer and lrscheduler module
 * add sbert for text classification example
 * add task_dataset for dataset-level processor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9338412

[To #42322933] Merge same language type voice models into one model card, these changes make demo service much easier to handle different voices.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9353173

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9358893

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9350976

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9273537

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9313928

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9319772

未登录warn提示信息重构，只有遇到请求失败，exception时，如果cookie为空，提示用户login，单元测试用户修改成单独
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9283579

    * [to #42322933] add space dialog-state tracking pipeline 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9227018

    * init

* token to ids

* add model

* model forward ready

* add intent

* intent preprocessor ready

* intent success

* merge master

* test with model hub

* add flake8

* update

* update

* update

* Merge branch 'master' into nlp/space/gen

* delete file about gen

* init

* fix flake8 bug

* [to #42322933] init

* bug fix

* [to #42322933] init

* update pipeline registry info

* Merge remote-tracking branch 'origin/master' into feat/nli

* [to #42322933] init

* [to #42322933] init

* modify forward

* [to #42322933] init

* generation ready

* init

* Merge branch 'master' into feat/zero_shot_classification

# Conflicts:
#	modelscope/preprocessors/__init__.py

* [to #42322933] bugfix

* [to #42322933] pre commit fix

* fill mask

* registry multi models on model and pipeline

* add tests

* test level >= 0

* local gen ready

* merge with master

* dialog modeling ready

* fix comments: rename and refactor AliceMindMLM; adjust pipeline

* space intent and modeling(generation) are ready

* bug fix

* add dep

* add dep

* support dst data processor

* merge with nlp/space/dst

* merge with master

* Merge remote-tracking branch 'origin' into feat/fill_mask

Conflicts:
	modelscope/models/nlp/__init__.py
	modelscope/pipelines/builder.py
	modelscope/pipelines/outputs.py
	modelscope/preprocessors/nlp.py
	requirements/nlp.txt

* merge with master

* merge with master 2/2

* fix comments

* fix isort for pre-commit check

* allow params pass to pipeline's __call__ method

* Merge remote-tracking branch 'origin/master' into feat/zero_shot_classification

* merge with nli task

* merge with sentiment_classification

* merge with zero_shot_classfication

* merge with fill_mask

* merge with space

* merge with master head

* Merge remote-tracking branch 'origin' into feat/fill_mask

Conflicts:
	modelscope/utils/constant.py

* fix: pipeline module_name from model_type to 'fill_mask' & fix merge bug

* unfiinished change

* fix bug

* unfinished

* unfinished

* revise modelhub dependency

* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor

* add eval() to pipeline call

* add test level

* ut run passed

* add default args

* tmp

* merge master

* all ut passed

* remove an useless enum

* revert a mis modification

* revert a mis modification

* Merge commit 'ace8af92465f7d772f035aebe98967726655f12c' into feat/nlp

* commit 'ace8af92465f7d772f035aebe98967726655f12c':
  [to #42322933] Add cv-action-recongnition-pipeline to maas lib
  [to #42463204]  support Pil.Image for image_captioning_pipeline
  [to #42670107] restore pydataset test
  [to #42322933] add create if not exist and add(back) create model example         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
  [to #41474818]fix: fix errors in task name definition

# Conflicts:
#	modelscope/pipelines/builder.py
#	modelscope/utils/constant.py

* Merge branch 'feat/nlp' into feat/nlp_refactor

* feat/nlp:
  [to #42322933] Add cv-action-recongnition-pipeline to maas lib
  [to #42463204]  support Pil.Image for image_captioning_pipeline
  [to #42670107] restore pydataset test
  [to #42322933] add create if not exist and add(back) create model example         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
  [to #41474818]fix: fix errors in task name definition

# Conflicts:
#	modelscope/pipelines/builder.py

* fix compile bug

* refactor space

* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor

* Merge remote-tracking branch 'origin' into feat/fill_mask

* fix

* pre-commit lint

* lint file

* lint file

* lint file

* update modelhub dependency

* lint file

* ignore dst_processor temporary

* solve comment: 1. change MaskedLMModelBase to MaskedLanguageModelBase 2. remove a useless import

* recommit

* remove MaskedLanguageModel from __all__

* Merge commit '1a0d4af55a2eee69d89633874890f50eda8f8700' into feat/nlp_refactor

* commit '1a0d4af55a2eee69d89633874890f50eda8f8700':
  [to #42322933] test level check         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
  [to #42322933] update nlp models name in metainfo         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134657

# Conflicts:
#	modelscope/metainfo.py

* update

* revert pipeline params update

* remove zeroshot

* update sequence classfication outpus

* merge with fill mask

* Merge remote-tracking branch 'origin' into feat/fill_mask

* fix

* init dialog state tracking

* fix flake8 warning of dst

* Merge remote-tracking branch 'origin/feat/fill_mask' into feat/nlp

* merge with master

* remove useless test.py

* add init

* merge nlp

* Merge remote-tracking branch 'origin/master' into feat/nlp

* remove unformatted space trainer

* Merge branch 'feat/nlp' into nlp/space/dst

* revise based on comment except chinease comment

* skip ci blocking

* change Chinese notes of space3.0 into English

* translate chinese comment to english

* add space to metainfo

* space dst pipeline is ready, but model's result is wrong

* merge feat/nlp

* merge with master

* change processor

* change example

* test case ready

* dst loacl ready

* update dst conf

* merge feat/nlp

* inform revise

* inherit bug fix

* init

* add 2 complete examples

* fix bug

* add test case

* merge with master

* modify model name

* add missing setting

* add outputs

* modify test level

* modify chinese comment

* remove useless doc

* merge feat/nlp

* Merge remote-tracking branch 'origin' into nlp/space/dst

* Merge branch 'feat/nlp' into nlp/space/dst

* dst test ready

* merge feat nlp

* space outputs normalization

* update dst

* merge feat nlp

* Merge branch 'master' into nlp/space/dst

* update requirement

* merge with master

* Merge remote-tracking branch 'origin/master' into nlp/space/dst

* formating output

* update requirements/nlp

* merge with master

* add test cases

* Merge remote-tracking branch 'origin/master' into nlp/space/dst

* merge with master

* login warn refactor, error message when exception, ut case to new user

* login warn refactor, error message when exception, ut case to new user

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9316720

Merge frontend, am and vocoder model card into one model card.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9303837

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9300163

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9303027

* rename name of whl to modelscope
* auto install all requirements when running citest
* auto download dynamic lib for aec pipeline
* fix setup.py  audio extras not set
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9297825

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9285266
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9285266

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9281691

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9268865