zhangzhicheng.zzc
7fc49e5fa0
support table recognition task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10773667
3 years ago
wenmeng.zwm
7c0d7f872c
[to 43878347] support batch inference in pipeline
It is recommented that each pipleine should implement `_batch` to make a list of preprocessed data into a batched data dict.
Then by paasing batch_size=n we can use batch inference in pipline, for example
```python
img_captioning = pipeline(
Tasks.image_captioning,
model='damo/ofa_image-caption_coco_large_en')
results = img_captioning(
[{
'image': 'data/test/images/image_captioning.png'
} for _ in range(6)],
batch_size=2)
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10051193
3 years ago
wendi.hwd
ff55bd9436
support camouflaged-detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10834768
3 years ago
xianzhe.xxz
9da5091d4d
add damoyolo-t & damoyolo-m
1. add damoyolo-t & damoyolo-m models
2. fix the configuration overlap error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10816561
3 years ago
zhangzhicheng.zzc
5f719e542b
[to #42322933 ] add nlp/addr/structure and update token classificaiton related method
3 years ago
mulin.lyh
90a5efa1c2
[to #46106568 ]feat: parallel run ci case
3 years ago
james.wjg
541e460f8b
add support for cv/language_guided_video_summarization
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10636269
3 years ago
wenmeng.zwm
e5980492a1
make mglm isolated test because mpu init problem
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10728515
* make mglm isolated test because mpu init problem
3 years ago
xiangpeng.wxp
d6ea41fb70
[to #42322933 ] solve memory error for translation finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10713843
* [to #42322933 ] solve memory error for translation finetune
3 years ago
yingda.chen
4e4faa9a30
specifiy file encoding when open text for read
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708723
3 years ago
huizheng.hz
2fe5203571
reduce image denoising test time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10712244
3 years ago
shuying.shu
085acc64c8
fix bug and change unittest mode
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10680402
3 years ago
caorongyu.cry
e2a9695f93
[to #42322933 ] add synonym
主要做了如下修改:
1. 加入了同义词词典
2. 对SQL进行后处理,如果包含排序,则将空列转化成Primary列
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10670121
3 years ago
hemu.zp
0f0fdcae6f
[to #42322933 ] Fix bug for mplug evaluation
修复了 mplug evaluation 使用了错误的 metrics 的问题,将部分中文处理代码独立到 utils 中,为 mplug 添加 trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10612875
3 years ago
zhangzhicheng.zzc
d3519bcbca
[to #42322933 ]token preprocess bug fix
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10608664
3 years ago
翎航
fd4276ad1a
add five finetune task & merge master
3 years ago
翎航
3534970709
add five finetune task & merge master
3 years ago
翎航
a02b2409d8
add five finetune task & merge master
3 years ago
翎航
04377cfd79
Merge branch 'master' into tmp
the new master
3 years ago
翎航
eb82ba9c6f
add finetune & merge master
3 years ago
翎航
0418786cbe
add five task finetune
3 years ago
yzhao
3f75fcdb79
fix bug
3 years ago
mulin.lyh
4429991646
Merge branch dev/msdataset_event_tracking into master
Title: [to #42322933 ] add event tracking
1. add event tracking for dataset downloading pv/uv
2. change datasets version: <=2.5.2
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10593016
3 years ago
班扬
e45ab2c32d
add event tracking
3 years ago
班扬
63a08e7be6
add event tracking
3 years ago
干劲
2759d538bb
fix ut level for unifold
3 years ago
liugao.lg
40b6770956
[to #42322933 ]fix ocr prepreocess & conflict
修复ocr预处理逻辑不一致问题
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10581697
3 years ago
zhangzhicheng.zzc
06abae4dc6
[to #42322933 ]add token-cls test cases and bug fix
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10585502
3 years ago
zhangzhicheng.zzc
0d3b7b0df2
[to #42322933 ]fix bugs relate to token cls
1.修复token classification preprocessor finetune结果错误问题
2.修复word segmentation output 无用属性
3. 修复nlp preprocessor传use_fast错误
4. 修复torch model exporter bug
5. 修复文档撰写过程中发现trainer相关bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10573269
3 years ago
shouzhou.bx
e72988c2ba
add face detection to face_2d_keypoints_pipeline
3 years ago
翎航
11cebb8d64
fix ocr prepreocess & conflict
3 years ago
翎航
3b21ff10ec
fix ocr prepreocess
3 years ago
yichang.zyc
e2d35fbb14
[to #42322933 ]clip支持finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10572842
3 years ago
Yingda Chen
9f7b8b86a3
[to #42322933 ] disble 2dkeypoints training since face_2d_keypoints_dataset is set to be private
3 years ago
Yingda Chen
902019c2e0
[to #42322933 ] disble vgg19_fer
3 years ago
Yingda Chen
29448c0f57
[to #42322933 ] disble vit
3 years ago
mulin.lyh
3791ee7ad2
[to #45821936 ]fix: fix block user specify revision after release_datetime
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10572162
3 years ago
yuze.zyz
4b7e8e89aa
[to #42322933 ] Fix some bugs when downgrade the version of some dependencies
1. Fix bug in model exporting
2. Skip some long trainings in test level 2
3. Refine some comments
4. Fix a bug that mode is not correct when saving checkpoints
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10564716
3 years ago
Yufeng
261c04b8b5
add Mglm ( #5 )
* mglm init
* add mglm requirements
Co-authored-by: Yufeng <zhuyufeng@gmail.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
3 years ago
Yingda Chen
46cfa177aa
[to #42322933 ]skip timeconsuming test
3 years ago
xianzhe.xxz
88e8d4291a
[to #42322933 ]"fix: set the eps and momentum of BN consistent with training"
To keep consistent between training and evaluation, change the eps and momentum of BN.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10554451
3 years ago
menrui.mr
c7b0787049
修复初始化过程参数未生效问题
此前文生图模型没有加载configuration.json中的参数 影响默认配置
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10558026
3 years ago
hemu.zp
fa415d8720
[to #42322933 ] Fix bug for bloom and gpt_neo
1. 修复 bloom 和 gpt_neo 模型更新 transformers 4.23 后后处理报错的问题
2. 统一使用 ModelOutput 作为模型输出
3. gpt_neo checkpoint 已上线,修改 ut 为 level2
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10553103
3 years ago
xingjun.wxj
78f29cf999
[to #42322933 ] Add delete datasets files and upload mode.
1. Add : MsDataset.delete() , support delete dataset file or dir.
2. Add: upload mode, MsDataset.upload(xx, upload_mode=UploadMode.FORCE_UPLOAD), or MsDataset.upload(xx, upload_mode=UploadMode.APPEND_UPLOAD)
if upload_mode = UploadMode.APPEND_UPLOAD, then skip object in case of this object exists.
3. Add: support reload sts token automatically to avoid expire. (current expiration: 24h)
4. Fix: add cookies in api.py for downloading private datasets.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10524449
3 years ago
Yingda Chen
374fd3090e
[to #42322933 ]skip referring video tests since model is private
3 years ago
yuze.zyz
212cf53318
[to #42322933 ] Fix some bugs
1. Add F1 score to sequence classification metric
2. Fix a bug that the evaluate method in trainer does not support a pure pytorch_model.bin
3. Fix a bug in evaluation of veco trainer
4. Add some tips if lr_scheduler in the trainer needs a higher version torch
5. Add some comments
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10532230
3 years ago
shuying.shu
ddcb57440d
[to #42322933 ]add fine-tune code for referring video object segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10539423
3 years ago
mulin.lyh
3b75623be4
[to #45773874 ]fix: get_model revision=None bug, and hub case occasionally delete test model failed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10549680
3 years ago
eniac.xcw
8886c3c1ae
[to #42322933 ]fine tune team on caltech-101
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10525413
3 years ago
yingda.chen
de708dd518
add basic remap column wrapper
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10539917
* add basic remap column wrapper
3 years ago