modelscope
/
ModelScope
Not watched
1
0
Fork 0
Code
Releases 0 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
22 Commits
1 Branch
10 MB
19 Download
Tree: c6ec7f2fa4
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'c6ec7f2fa4'
${ noResults }
ModelScope/maas_lib/preprocessors/base.py

base.py 296 B
Raw Normal View History

[to #41401401] add preprocessor, model and pipeline * add preprocessor module * add model base and builder * update task constant * add load image preprocessor and its dependency * add pipeline interface and UT covered * support default pipeline for task * add image matting pipeline * refine nlp tokenize interface * add nlp pipeline * fix UT failed * add test for Compose Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235 * add preprocessor module * add test for Compose * fix citest error * fix abs class error * add model base and builder * update task constant * add load image preprocessor and its dependency * add pipeline interface and UT covered * support default pipeline for task * refine models and pipeline interface * add pipeline folder structure * add image matting pipeline * refine nlp tokenize interface * add nlp pipeline 1.add preprossor model pipeline for nlp text classification 2. add corresponding test Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371 * new nlp pipeline * format pre-commit code * update easynlp pipeline * update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py * update test_typeassert.py * refactor code 1. rename typeassert to type_assert 2. use lazy import to make easynlp dependency optional 3. refine image matting UT * fix linter test failed * update requirements.txt * fix UT failed * fix citest script to update requirements
3 years ago
​
​
​
​
​
​
​
​
​
​
​
​
​
 1234567891011121314 
  1. # Copyright (c) Alibaba, Inc. and its affiliates.

  2. 

  3. from abc import ABC, abstractmethod

  4. from typing import Any, Dict

  5. 

  6. 

  7. class Preprocessor(ABC):

  8. 

  9.     def __init__(self, *args, **kwargs):

  10.         pass

  11. 

  12.     @abstractmethod

  13.     def __call__(self, data: Dict[str, Any]) -> Dict[str, Any]:

  14.         pass

致力于通过开放的社区合作，开源AI模型以及相关创新技术，推动基于模型即服务的生态繁荣发展