qianmu.ywh
fc6d0c64bc
add image_depth_estimation: model, pipeline, test
接入图像深度估计模型,新增model、pipeline、test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10857764
3 years ago
Yingda Chen
d5ee8aa66d
move long-running test to level 2
3 years ago
shichen.fsc
acb8d36699
[to #42322933 ] add extractive-summarization and topic-segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10856839
3 years ago
shiyi.zxh
7661470350
ofa增加asr任务
ofa增加asr任务infer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10761019
3 years ago
lulu.lcq
ff171500bb
[to #42322933 ] add dpm-solver for diffusion models
为diffusion模型加入dpm solver支持,相比ddim scheduler快2~6倍。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10826722
3 years ago
zhangzhicheng.zzc
7fc49e5fa0
support table recognition task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10773667
3 years ago
wenmeng.zwm
7c0d7f872c
[to 43878347] support batch inference in pipeline
It is recommented that each pipleine should implement `_batch` to make a list of preprocessed data into a batched data dict.
Then by paasing batch_size=n we can use batch inference in pipline, for example
```python
img_captioning = pipeline(
Tasks.image_captioning,
model='damo/ofa_image-caption_coco_large_en')
results = img_captioning(
[{
'image': 'data/test/images/image_captioning.png'
} for _ in range(6)],
batch_size=2)
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10051193
3 years ago
wendi.hwd
ff55bd9436
support camouflaged-detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10834768
3 years ago
xianzhe.xxz
9da5091d4d
add damoyolo-t & damoyolo-m
1. add damoyolo-t & damoyolo-m models
2. fix the configuration overlap error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10816561
3 years ago
zhangzhicheng.zzc
5f719e542b
[to #42322933 ] add nlp/addr/structure and update token classificaiton related method
3 years ago
james.wjg
541e460f8b
add support for cv/language_guided_video_summarization
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10636269
3 years ago
shuying.shu
085acc64c8
fix bug and change unittest mode
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10680402
3 years ago
caorongyu.cry
e2a9695f93
[to #42322933 ] add synonym
主要做了如下修改:
1. 加入了同义词词典
2. 对SQL进行后处理,如果包含排序,则将空列转化成Primary列
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10670121
3 years ago
zhangzhicheng.zzc
d3519bcbca
[to #42322933 ]token preprocess bug fix
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10608664
3 years ago
yzhao
3f75fcdb79
fix bug
3 years ago
干劲
2759d538bb
fix ut level for unifold
3 years ago
zhangzhicheng.zzc
06abae4dc6
[to #42322933 ]add token-cls test cases and bug fix
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10585502
3 years ago
shouzhou.bx
e72988c2ba
add face detection to face_2d_keypoints_pipeline
3 years ago
yichang.zyc
e2d35fbb14
[to #42322933 ]clip支持finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10572842
3 years ago
Yingda Chen
902019c2e0
[to #42322933 ] disble vgg19_fer
3 years ago
Yingda Chen
29448c0f57
[to #42322933 ] disble vit
3 years ago
Yufeng
261c04b8b5
add Mglm ( #5 )
* mglm init
* add mglm requirements
Co-authored-by: Yufeng <zhuyufeng@gmail.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
3 years ago
xianzhe.xxz
88e8d4291a
[to #42322933 ]"fix: set the eps and momentum of BN consistent with training"
To keep consistent between training and evaluation, change the eps and momentum of BN.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10554451
3 years ago
menrui.mr
c7b0787049
修复初始化过程参数未生效问题
此前文生图模型没有加载configuration.json中的参数 影响默认配置
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10558026
3 years ago
hemu.zp
fa415d8720
[to #42322933 ] Fix bug for bloom and gpt_neo
1. 修复 bloom 和 gpt_neo 模型更新 transformers 4.23 后后处理报错的问题
2. 统一使用 ModelOutput 作为模型输出
3. gpt_neo checkpoint 已上线,修改 ut 为 level2
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10553103
3 years ago
Yingda Chen
374fd3090e
[to #42322933 ]skip referring video tests since model is private
3 years ago
hemu.zp
d0f8547e7e
[to #42322933 ] Fix gpt3 loading checkpoint after finetuning.
1. 修复GPT-3模型无法加载finetune保存的checkpoint的问题
2. 为GPT-3诗词生成模型添加 ut
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10537209
3 years ago
hemu.zp
e4a0e046f9
[to #42322933 ] Add ut for mplug and bloom
为新上线的 langboat/bloom-1b4-zh,damo/mplug_visual-question-answering_coco_base_zh,damo/mplug_image-captioning_coco_base_zh 三个模型添加 ut,test_level 设置为 2
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10524221
3 years ago
caorongyu.cry
3b8fb92c13
[to #42322933 ] debug header ids and header names
修复header_ids和header_names命名反了的问题
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10516557
3 years ago
ran.zhou
13f7e9ceca
[to #42322933 ]SEA multilingual NLP (NER & word segmentation)
添加东南亚小语种NLP支持,包括:
1. 针对泰语,越南语NER的预处理
2. 基于XLMR-CRF架构的分词模型和pipeline
3. 针对泰语分词的预处理
添加了相应pipeline的unittest
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492404
3 years ago
jiaqi.sjq
5190c7de11
[to #41669377 ] tts using default master revision model in UT
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10526747
3 years ago
yuanzheng.yuanzhen
bab54bbce8
[to #42322933 ]support uni fold
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10481410
3 years ago
yuze.zyz
c2da44b371
[to #42322933 ] remove dev model inference and fix some bugs
1. Change structbert dev revision to master revision
2. Fix bug: Sample code failed because the updating of model configuration
3. Fix bug: Continue training regression failed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10519992
3 years ago
zhangzhicheng.zzc
e1ab73b7d8
[to #42322933 ]support type str for for zero-shot labels' input
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10506320
3 years ago
hemu.zp
ffd834fc25
[to #42322933 ] Add bloom model
添加 bloom 模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10509187
3 years ago
yuze.zyz
605cd7f44a
[to #42322933 ] NLP 1030 Refactor
Features:
1. Refactor the directory structure of nlp models. All model files are placed into either the model folder or the task_model folder
2. Refactor all the comments to google style
3. Add detail comments to important tasks and nlp models, to list the description of the model, and its preprocessor&trainer
4. Model Exporting now supports a direct all to TorchModelExporter(no need to derive from it)
5. Refactor model save_pretrained method to support direct running(independent from trainer)
6. Remove the judgement of Model in the pipeline base class, to support outer register models running in our pipelines
7. Nlp trainer now has a NLPTrainingArguments class , user can pass arguments into the dataclass, and use it as a normal cfg_modify_fn, to simplify the operation of modify cfg.
8. Merge the BACKBONES and the MODELS, so user can get a backbone with the Model.from_pretrained call
9. Model.from_pretrained now support a task argument, so user can use a backbone and load it with a specific task class.
10. Support Preprocessor.from_pretrained method
11. Add standard return classes to important nlp tasks, so some of the pipelines and the models are independent now, the return values of the models will always be tensors, and the pipelines will take care of the conversion to numpy and the following stuffs.
12. Split the file of the nlp preprocessors, to make the dir structure more clear.
Bugs Fixing:
1. Fix a bug that lr_scheduler can be called earlier than the optimizer's step
2. Fix a bug that the direct call of Pipelines (not from pipeline(xxx)) throws error
3. Fix a bug that the trainer will not call the correct TaskDataset class
4. Fix a bug that the internal loading of dataset will throws error in the trainer class
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10490585
3 years ago
siyang.ssy
6d51f44dc7
[to #42322933 ]fix input type for video embeding
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10506601
3 years ago
bin.xue
525fa3ea89
[to #42322933 ]test: use 'master' branch in training test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10509580
3 years ago
caorongyu.cry
6178f46910
[to #42322933 ] add ut for multi threads
1. 修复multi thread引起的问题
2. 增加multi thread的unittest
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10502008
3 years ago
yingda.chen
de7b6a06e9
[to #42322933 ] remove revision usage for face detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10507910
* [to #42322933 ] remove revision usage for face detection
3 years ago
zhangyanzhao.zyz
c4dbb69d65
[to #42322933 ]增加对text-ranking任务中文模型的单元测试,以方便得到官方模型打标。
增加对text-ranking任务中文模型的单元测试,以方便得到官方模型打标。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492754
3 years ago
yichang.zyc
35c612a642
[to #42322933 ]去除clip ut中的dev revision
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10507748
* remove clip ut dev revision
3 years ago
ashui.cbh
e223c1b008
[to #42322933 ]merge master after demo service support
demo service 对接,修改输入接口为可调用的方式
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10502169
3 years ago
caorongyu.cry
35644fa0a7
[to #42322933 ] change star3 to space_T_cn
1. 合并star和star3框架
2. 修改star和star3的model type
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492793
3 years ago
zhangzhicheng.zzc
182ba1768f
[to #42322933 ]support multi tasks for part of speech
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491994
3 years ago
yuze.zyz
707cbef013
[to #42322933 ]Fix bug in daily UT
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491891
3 years ago
zhangzhicheng.zzc
2a87dee561
[to #42322933 ]support multi tasks-- will be failed, since configuration has not changed yet
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492024
3 years ago
caorongyu.cry
9edfd7e50c
[to #42322933 ] update tableqa params
1. 增加传入table_id
2. 将result和table的结构统一
3. 默认开启is_use_sqlite
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492027
3 years ago
shichen.fsc
1854ceeb74
[to #42322933 ] Fix all asr models in UT with mistake model_id
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491024
3 years ago
zhangyanzhao.zyz
824ee8232c
[to #42322933 ]更新语义相关性任务英文名称为text ranking,修改对应变量名和类名
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491951
3 years ago