wenmeng.zwm
fabb4716d4
[to #44610931 ] fix: add device usage when device is None or empty
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10039848
* add device usage when device is None or empty
* update docker env
3 years ago
jiangnana.jnn
930d55d9ad
support EasyCV framework and add Segformer model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9781849
* support EasyCV
3 years ago
wenmeng.zwm
c72e5f4ae8
[to #43878347 ] skip device placement test
skip this test which will result in too much debug log for placement although debug level is canceled after this test case
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9875987
3 years ago
zhangzhicheng.zzc
5b0b54633b
[to #42322933 ]compatible with windows path on only core parts
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9855254
3 years ago
wenmeng.zwm
aaa604cb16
[to #43878347 ] device placement support certain gpu
1. add device util to verify, create and place device
2. pipeline and trainer support update
3. fix pipeline which use tf models does not place model to the right device
usage
```python
pipe = pipeline('damo/xxx', device='cpu')
pipe = pipeline('damo/xxx', device='gpu')
pipe = pipeline('damo/xxx', device='gpu:0')
pipe = pipeline('damo/xxx', device='gpu:2')
pipe = pipeline('damo/xxx', device='cuda')
pipe = pipeline('damo/xxx', device='cuda:1')
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9800672
3 years ago
wenmeng.zwm
7798a6250a
[to #43112692 ] stardarized task name and output
1. task name and output definition: [link](https://alidocs.dingtalk.com/i/nodes/KOEmgBoGwD78vd2bAry3VndLerP9b30a?nav=spaces&navQuery=spaceId%3Dnb9XJNlZxbgrOXyA&iframeQuery=utm_source%3Dportal%26utm_medium%3Dportal_space_file_tree )
2. rearrange task definition and add more outputs definition for tasks
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9585469
3 years ago
wenmeng.zwm
d55525bfb6
[to #43112771 ] requirements check and lazy import support
3 years ago
wenmeng.zwm
4814b198f0
[to #43112534 ] taskdataset refine and auto placement for data and model
* refine taskdataset interface
* add device placement for trainer
* add device placement for pipeline
* add config checker and fix model placement bug
* fix cycling import
* refactor model init for translation_pipeline
* cv pipelines support kwargs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9463076
3 years ago
jiangnana.jnn
f3d739bea7
[to #43105545 ] add default config and new hooks
3 years ago
zhangzhicheng.zzc
407337fbf3
[to #42322933 ] add model profiling
3 years ago
wenmeng.zwm
8e51a073a6
[to #42966122 ] requirements enchanment and self-host repo support
* add self-hosted repo:
* add extra requirements for different field and reduce necessary requirements
* update docker file with so required by audio
* add requirements checker which will be used later when implement lazy import
* remove repeated requirements and replace opencv-python-headless with opencv-python
example usage:
```shell
pip install model_scope[all] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[cv] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[nlp] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[audio] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[multi-modal] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9211383
3 years ago
mulin.lyh
76c6ff6329
[to #42675838 ]merge model hub code
合并model hub 代码
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9096493
3 years ago
yingda.chen
5786b9a0a1
[to #42322933 ]formalize image matting
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9019685
3 years ago
wenmeng.zwm
8a030ead72
[to #42362853 ] feat: rename config to configuration and remove repeated task fileds
1. rename maas_config to configuration
2. remove task field image and video, using cv instead
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9010802
3 years ago
yingda.chen
3c1ec035fd
[to #42322933 ] refine cartoon model and add model op utitlity
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8993758
3 years ago
wenmeng.zwm
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
3 years ago
Yingda Chen
3cbdcb1d3e
fix typo
3 years ago
wenmeng.zwm
5e469008fd
[to #41401401 ] add preprocessor, model and pipeline
* add preprocessor module
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
* fix UT failed
* add test for Compose
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235
* add preprocessor module
* add test for Compose
* fix citest error
* fix abs class error
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* refine models and pipeline interface
* add pipeline folder structure
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
1.add preprossor model pipeline for nlp text classification
2. add corresponding test
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371
* new nlp pipeline
* format pre-commit code
* update easynlp pipeline
* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py
* update test_typeassert.py
* refactor code
1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT
* fix linter test failed
* update requirements.txt
* fix UT failed
* fix citest script to update requirements
3 years ago
wenmeng.zwm
0a756f6a0d
[to #41402703 ] add basic modules
* add constant
* add logger module
* add registry and builder module
* add fileio module
* add requirements and setup.cfg
* add config module and tests
* add citest script
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8718998
3 years ago