Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10526747

之前的finetune代码当dataset最后长度不足制定batch size时会出错，现已修正
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10524066

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10481410

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10525516

修改了I/O的代码，以支持modelscope的demo services
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10518318

1. Change structbert dev revision to master revision
2. Fix bug:  Sample code failed because the updating of model configuration
3. Fix bug: Continue training regression failed
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10519992

在demo service场景，同时调用同一个视频文件，会导致ffmpeg处理同名视频的冲突。通过uuid生成唯一的文件名解决这个冲突。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10518178

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10521235

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10506320

添加 bloom 模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10509187

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10318299

Features:
1. Refactor the directory structure of nlp models. All model files are placed into either the model folder or the task_model folder
2. Refactor all the comments to google style
3. Add detail comments to important tasks and nlp models, to list the description of the model, and its preprocessor&trainer
4. Model Exporting now supports a direct all to TorchModelExporter(no need to derive from it)
5. Refactor model save_pretrained method to support direct running(independent from trainer)
6. Remove the judgement of Model in the pipeline base class, to support outer register models running in our pipelines
7. Nlp trainer now has a NLPTrainingArguments class , user can pass arguments into the dataclass, and use it as a normal cfg_modify_fn, to simplify the operation of modify cfg.
8. Merge the BACKBONES and the MODELS, so user can get a backbone with the Model.from_pretrained call
9. Model.from_pretrained now support a task argument, so user can use a backbone and load it with a specific task class.
10. Support Preprocessor.from_pretrained method
11. Add standard return classes to important nlp tasks, so some of the pipelines and the models are independent now, the return values of the models will always be tensors, and the pipelines will take care of the conversion to numpy and the following stuffs.
12. Split the file of the nlp preprocessors, to make the dir structure more clear.

Bugs Fixing:
1. Fix a bug that lr_scheduler can be called earlier than the optimizer's step
2. Fix a bug that the direct call of Pipelines (not from pipeline(xxx)) throws error
3. Fix a bug that the trainer will not call the correct TaskDataset class
4. Fix a bug that the internal loading of dataset will throws error in the trainer class
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10490585

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10506601

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10509580

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465138

1. 修复multi thread引起的问题
2. 增加multi thread的unittest
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10502008

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10507910

    * [to #42322933] remove revision usage for face detection

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10501307

增加对text-ranking任务中文模型的单元测试，以方便得到官方模型打标。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492754

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10507748

    * remove clip ut dev revision

demo service 对接，修改输入接口为可调用的方式
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10502169

服务端文档链接(可能需要登录)：
https://test.modelscope.cn/api/v1/deployer/docs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10478609

适配demoservice，增加视频时间戳输出，每一个结果对应一个时间戳
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10496879

1. 合并star和star3框架
2. 修改star和star3的model type
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492793

* fix output format
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491722

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491994

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491891

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492024

1. 增加传入table_id
2. 将result和table的结构统一
3. 默认开启is_use_sqlite
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492027

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10489981

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491024

修复cpu推理
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10468823

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491951

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10490937

1. Change the logic of using fast tokenizer from mode to user arguments and tokenizer_config.json
This is to fix the problem of RANER must use fast tokenizer in some special models.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10488982

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10453584

新增ofa关于日常场景文字识别的任务，主要包括：
1、新增pipeline及task名称定义；
2、新增pipeline、task、model及prepreocess核心类方法的代码逻辑；
3、其它同步修正的小细节逻辑；
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10471089

修复一行错误代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10477534

    * fix a code bug

更改部分__init__文件的header license
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10393596

modify img_embedding type for image_reid_person
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10477972

为以下三个模型补充 ut
damo/nlp_palm2.0_text-generation_chinese-large
damo/nlp_palm2.0_text-generation_commodity_chinese-base
damo/nlp_palm2.0_text-generation_weather_chinese-base
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10435599

修复pipeline串联时collate_fn异常
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10457058

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10459756

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10467797

    * add uttest for en2fr and fr2en tasks

1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
    TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
     Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465241

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10432300

    * fix cpu error