fubang.zfb
8f81807537
[to #42322933 ] 关系抽取
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9938140
3 years ago
shuying.shu
a9deb3895c
[to #42322933 ] movie scene segmentation模型接入
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9872869
3 years ago
shichen.fsc
2b380f0410
[to #42322933 ] add new Task - document segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9942858
* [Add] add document-segmentation
3 years ago
tanfan.zjh
dc45fce542
[to #42322933 ]新增FAQ问答模型
Maas新增FAQ问答模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9797053
3 years ago
hemu.zp
161555f97d
[to #42322933 ] add mplug image-caption
添加 MPLUG 模型 image-captioning 任务
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9745826
3 years ago
jiangnana.jnn
76482cc3ea
[to #43850241 ] fix processor and collate_fn
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9644184
* fix ditributed training and eval
3 years ago
piaoyu.lxy
2dc3286524
[to #42322933 ] add conversational_text_to_sql pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9580066
3 years ago
yuze.zyz
21fa71baf0
[to #42322933 ] add/refactor nlp models source code and finetune
1. add sbert,veco,palm,space source code
2. support sbert sequence classification, token classification finetune
3. support veco sequence classification finetune
4. support palm nlg finetune
evaluation result: https://sheet.alibaba-inc.com/#/sheet/f7fdcc7f22bd5105 sheet:Maas
5. add ut for finetunes
6. add veco's taskdataset processor
7. add a common trainer for nlp, and a specific trainer for veco
8. merge some duplicate codes of models, preprocessors, pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9574105
* add basic class of hook&metrics
* pre-commit passed
* change some comments
* pre commit passed
* 1. remove accuracy's groups 2. remove useless hooks 3. simplify priorities
* pre-commit passed
* fix a comment
* Merge branch 'master' into finetune_hooks_metrics
# Conflicts:
# modelscope/metainfo.py
* pre-commit passed
* add basic class of hook&metrics
* pre-commit passed
* change some comments
* pre commit passed
* 1. remove accuracy's groups 2. remove useless hooks 3. simplify priorities
* pre-commit passed
* fix a comment
* Merge branch 'feat/finetune' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into feat/finetune
* mv hooks related to modelscope/trainers/hooks
* mv priority back
* add torch mdoel base and test
* update hooks, trainer, import_util
* add torch epoch based trainer and dis utils
* add hooks
* fix warmup
* format code stype and fix warmup and add warmup unittest
* fix impls
* pre-commit check passed
* update hook and add EpochBasedTrainer
* add trainer unittest
* Merge branch 'feat/add_hooks' into feat/add_task
# Conflicts:
# modelscope/models/base_torch.py
# modelscope/trainers/hooks/hook.py
# modelscope/trainers/trainer.py
* update unittest name
* rewrite taskdataset to trainer
* fix trainer and add unittest
* add unittest
* code: run to forward
* run through... but ugly code
* arrange some cls
* fix some errs
* revert some mistakes
* init check in
* Merge branch 'feat/add_hooks' into feat/add_task
# Conflicts:
# modelscope/trainers/trainer.py
* test with bigger epoch and size
* add the default metrics class
* move build metrics code to a method
* merge add_task
* merge origin add_task
* add device initialization
* remove preprocessor arg for bool
* add task models
* move metric collect logic to metrics class
* pre-commit passed
* fix cr comments
* precommit passed
* add task models
* Merge remote-tracking branch 'origin/feat/add_task' into feat/backbone_head
* add comment
* change comment formats.
* fix comments
* fix ut bug
* fix comments
* add wrapper check
* fix comments
* pre commit passed
* fix cr comments
* solve a loop import problem
* fix ut bug
* fix ut errors
* change dummydataset to msdataset
* precommit passed
* merge add task
* backbone-head is build, model is not correctly loaded
* model load states matched
* result matched
* lint
* add veco/palm_v2 code
* merge master
* merge master success running
* add repr model name level
* Merge branch 'feat/veco_palm' into feat/finetune_sbert_veco
* model test for training
* add token-classification metric add formal ut
* fix running bug
* finetune and pipeline are working with backbone-head
* add nli
* add missing code
* finetune and pipeline are working with backbone-head
* Merge branch 'feat/backbone_head' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/backbone_head
* add a test repo for pr
* remove merge conflicted file
* remove merge conflicted file 1
* lint check
* import error
* none type bug fix
* forward input unpacking or dict bug
* move head into models, add build_backbone with registry, no base method
* merge master
* feat: 1. add interleave dataset method 2. support multiple dataset in trainer.build_dataset 3. support 3 sub tasks in sequence_classification task
* unfinished
* update the task model structure in NLP field
* merge master
* update by comments
* keep the default model id as current on production
* unfinished
* unfinished
* veco can run
* Merge remote-tracking branch 'origin/master' into feat/backbone_head
* add taskmodel for module management
* remove forward_input_is_dict
* unfinished
* token classification started
* update base model structure
* move space to backbone
* remove 'type' in build_from_cfg method
* test update
* bug fix
* on tesing, mess code
* Merge branch 'feat/backbone_head' into feat/refactor_nlp_730
# Conflicts:
# modelscope/metrics/builder.py
# modelscope/models/__init__.py
# modelscope/models/nlp/__init__.py
# modelscope/preprocessors/nlp.py
# modelscope/trainers/trainer.py
# requirements/multi-modal.txt
* add missing merge
* add sofa source code
* refactor
* add veco task dataset
* add veco task dataset
* pre-commit passed
* fix bug of log
* add some features
* merge master
* bug fix
* refine nlp models
* fix the training error
* unfinished
* refactor pipeline
* Merge branch 'feat/backbone_head' into feat/refactor_nlp_730
# Conflicts:
# modelscope/metrics/builder.py
# modelscope/models/nlp/__init__.py
# modelscope/models/nlp/backbones/structbert/modeling_sbert.py
# modelscope/models/nlp/palm_v2/palm_for_text_generation.py
# modelscope/preprocessors/base.py
# modelscope/preprocessors/nlp.py
# modelscope/trainers/trainer.py
* Merge commit 'ab04ceafc5453ce7daa9aa09e37a55f703072a10' into feat/refactor_nlp_730
# Conflicts:
# modelscope/metainfo.py
# modelscope/metrics/builder.py
# modelscope/models/__init__.py
# modelscope/models/base/base_torch_model.py
# modelscope/models/nlp/__init__.py
# modelscope/models/nlp/backbones/space/model/intent_unified_transformer.py
# modelscope/models/nlp/backbones/space/model/model_base.py
# modelscope/models/nlp/palm_v2/palm_for_text_generation.py
# modelscope/models/nlp/sbert_for_sequence_classification.py
# modelscope/models/nlp/sequence_classification.py
# modelscope/models/nlp/space/__init__.py
# modelscope/models/nlp/space_for_dialog_intent_prediction.py
# modelscope/models/nlp/space_for_dialog_modeling.py
# modelscope/models/nlp/space_for_dialog_state_tracking.py
# modelscope/models/nlp/task_model.py
# modelscope/pipelines/nlp/sentiment_classification_pipeline.py
# modelscope/preprocessors/base.py
# modelscope/preprocessors/nlp.py
# modelscope/trainers/trainer.py
* revert changes
* unify sentnece classification postprocess
* revert some changes, move some model files
* pipeline first case run through
* ws pipeline passed
* Merge branch 'feat/refactor_nlp_730' into feat/finetune_sbert_veco
* finetune
* revert code
* revert some code
* ws finetune started, only the accuracy is weird
* Merge branch 'feat/veco_taskdataset' into feat/finetune_sbert_veco
# Conflicts:
# modelscope/task_datasets/veco_dataset.py
# tests/taskdataset/test_veco_dataset.py
* veco+nli finetune started
* Merge branch 'master' into feat/finetune_sbert_veco
# Conflicts:
# modelscope/models/nlp/sbert_for_sequence_classification.py
# modelscope/models/nlp/sbert_for_token_classification.py
# modelscope/models/nlp/sbert_for_zero_shot_classification.py
# modelscope/models/nlp/space/space_for_dialog_intent_prediction.py
# modelscope/models/nlp/space/space_for_dialog_modeling.py
# modelscope/trainers/trainer.py
* add trainer for nlp
* trainer: dataset params passed into preprocessor
* test passed by nlptrainer
* fix some bugs
* fix some bugs
* add backbone/head subclass
* fix regression bugs
* fix bug in token-cls finetune
* support cfg modification
* fix bug
* fix bug
* update requirements
* add some comments and fix some t
* add some comments and revert a argument
* split to two test files
* revert code
* fixbug in precessor
(cherry picked from commit 7a648d096e )
* fix ut bug
* support sbert models
* unfinished
* Merge branch 'feat/finetune_sbert_veco' into sly_tmp_veco_finetune
# Conflicts:
# tests/trainers/test_finetune_sequence_classification.py
* fixbug in veco
* fix bug
* fixbug
* correct running params
* remove useless files
* add palm finetuning with cnn_dailymail dataset
* copy space model from sofa
* Merge branch 'feat/finetune_sbert_veco' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into feat/finetune_sbert_veco
* Merge branch 'master' into feat/finetune_sbert_veco
# Conflicts:
# modelscope/metrics/__init__.py
# modelscope/models/__init__.py
# modelscope/models/nlp/__init__.py
# modelscope/models/nlp/backbones/__init__.py
# modelscope/models/nlp/backbones/structbert/modeling_sbert.py
# modelscope/models/nlp/heads/__init__.py
# modelscope/models/nlp/masked_language.py
# modelscope/models/nlp/palm_v2/palm_for_text_generation.py
# modelscope/models/nlp/sbert_for_nli.py
# modelscope/models/nlp/sbert_for_sentence_similarity.py
# modelscope/models/nlp/sbert_for_sentiment_classification.py
# modelscope/models/nlp/sbert_for_sequence_classification.py
# modelscope/models/nlp/sbert_for_token_classification.py
# modelscope/models/nlp/sbert_for_zero_shot_classification.py
# modelscope/models/nlp/sequence_classification.py
# modelscope/models/nlp/space/space_for_dialog_intent_prediction.py
# modelscope/models/nlp/space/space_for_dialog_modeling.py
# modelscope/models/nlp/space/space_for_dialog_state_tracking.py
# modelscope/models/nlp/structbert/adv_utils.py
# modelscope/models/nlp/structbert/configuration_sbert.py
# modelscope/models/nlp/task_models/task_model.py
# modelscope/pipelines/__init__.py
# modelscope/pipelines/nlp/__init__.py
# modelscope/pipelines/nlp/fill_mask_pipeline.py
# modelscope/pipelines/nlp/named_entity_recognition_pipeline.py
# modelscope/pipelines/nlp/nli_pipeline.py
# modelscope/pipelines/nlp/sentence_similarity_pipeline.py
# modelscope/pipelines/nlp/sentiment_classification_pipeline.py
# modelscope/pipelines/nlp/text_generation_pipeline.py
# modelscope/pipelines/nlp/word_segmentation_pipeline.py
# modelscope/pipelines/nlp/zero_shot_classification_pipeline.py
# modelscope/preprocessors/nlp.py
# modelscope/task_datasets/__init__.py
# modelscope/trainers/trainer.py
# modelscope/trainers/utils/inference.py
# modelscope/utils/file_utils.py
# requirements/nlp.txt
# tests/pipelines/test_nli.py
# tests/pipelines/test_sentence_similarity.py
# tests/pipelines/test_sentiment_classification.py
* fix imports
* mark backbone in their own modeling
* pre-commit check passed
* pre-commit passed, remove roberta model
* fix a bug in ast import
* skip all finetune uts
* fix bugs
* pre-commit passed
* bug fixed
* bug fixed
* bug fixed
* bug fixed
* fix ut bug
* fix bug
* fix ut bug
* fix bug
* fix bug
* fixbugs
* fixbug
* revert veco
* revert veco because of core dump
* fix palm bug
* revert veco
* revert mistaken code
* add a test print
* pre-commit check
* test exception
* add test code
* for test
* fix bug and test
* remove test code
* remove useless file
* 1. fix some bugs 2. add backbone ut
* Merge branch 'master' into feat/finetune_refactor_730
# Conflicts:
# modelscope/metainfo.py
# modelscope/metrics/sequence_classification_metric.py
# modelscope/models/nlp/__init__.py
# modelscope/models/nlp/task_models/task_model.py
# modelscope/preprocessors/__init__.py
# modelscope/preprocessors/nlp.py
# modelscope/trainers/trainer.py
# modelscope/trainers/utils/inference.py
# modelscope/utils/file_utils.py
# tests/trainers/test_trainer_with_nlp.py
* pre-commit passed
* revert files
* increase test level
* unregister models
* fix bugs
* fix cr comments
* fix bug in backbone-head
* add sbert backbone
* fix bug
* add test for token-cls-metric
* pre-commit passed
* fix ut comments
* revert normal tokenizer to fast tokenizer
* Merge branch 'master' into feat/finetune_refactor_730
# Conflicts:
# modelscope/models/nlp/__init__.py
# modelscope/models/nlp/backbones/__init__.py
# modelscope/models/nlp/backbones/structbert/__init__.py
# modelscope/models/nlp/masked_language.py
# modelscope/models/nlp/palm_v2/palm_for_text_generation.py
# modelscope/models/nlp/sbert_for_sequence_classification.py
# modelscope/models/nlp/sbert_for_token_classification.py
# modelscope/models/nlp/sbert_for_zero_shot_classification.py
# modelscope/pipelines/nlp/text_generation_pipeline.py
# modelscope/preprocessors/nlp.py
# modelscope/trainers/trainer.py
# modelscope/trainers/utils/inference.py
* fix merge bugs
* pre commit passed
* fix bug
* fix bug
* fix bug
* fix bug from master
* add print
* fix ut bug
* fix bug
* Merge branch 'master' into feat/finetune_refactor_730
* skip task model test
3 years ago
yichang.zyc
d1d2c96dd9
add 6 ofa tasks
3 years ago
klayzhang.zb
ca4b5b2565
[to #42322933 ][NLP] Add text error correction task
NLP新增文本纠错任务
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9540716
3 years ago
bin.xue
e3bffedb87
[to #42322933 ] aec pipeline修改C++库依赖到MinDAEC
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9563105
* use MinDAEC instead of cdll
* feat: ANS pipeline can accept bytes as input and adjust processing order to reduce the amount of computation
3 years ago
wenmeng.zwm
d55525bfb6
[to #43112771 ] requirements check and lazy import support
3 years ago
huizheng.hz
8120891eb7
[to #42322933 ][730 model] add image denoise
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491966
3 years ago
hejunjie.hjj
321292ceda
[to #42322933 ] add image instance segmentation pipeline and finetune to MaaS-lib
3 years ago
wenqi.oywq
da20fb66e9
[to #43259593 ]添加image-color-enhance, pipeline and trainer
添加image-color-enhance, pipeline and trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9483118
3 years ago
shichen.fsc
d7c780069f
[to #42322933 ] add asr inference with pytorch(espnet framework)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9273537
3 years ago
jiaqi.sjq
d313c440c4
[to #9303837 ] Merge frontend am and vocoder into one model card
Merge frontend, am and vocoder model card into one model card.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9303837
3 years ago
wenmeng.zwm
274cf6ffa9
[to #42362425 ] fix audio_requirement and refine quickstart, changelog doc
* make audio requirements optional
* add changelog for version v0.2
* add numpy constraint for compatibility with tensorflow1.15
* update faq
* fix nlp requiring tensorflow
* add torchvision to multimodal dependency
* bump version from 0.2.1 to 0.2.2
* add warning msg when tensorflow is not installed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9268278
3 years ago
智丞
54122b2dab
merge with master
3 years ago
zhangzhicheng.zzc
5b98cc1513
[to #42322933 ]新增:nli,sentiment_classification,dialog_intent,dialog_modeling
添加了,nli,sentiment_classification, dialog_intent, dialog_modeling几个pipeline。同时加入了nlp里面sequence classification一些简单的抽象。
去掉了zero_shot_classification
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9159089
3 years ago
wenmeng.zwm
8e51a073a6
[to #42966122 ] requirements enchanment and self-host repo support
* add self-hosted repo:
* add extra requirements for different field and reduce necessary requirements
* update docker file with so required by audio
* add requirements checker which will be used later when implement lazy import
* remove repeated requirements and replace opencv-python-headless with opencv-python
example usage:
```shell
pip install model_scope[all] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[cv] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[nlp] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[audio] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[multi-modal] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9211383
3 years ago
ly119399
f3146996e8
merge feat nlp
3 years ago
ly119399
4cfc4b43a0
merge feat/nlp
3 years ago
hemu.zp
fabea5604e
[to #42322933 ] Add MPLUG model
添加 MPLUG 模型的 visual question answering 任务 pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9182119
3 years ago
ly119399
3bfb5948e2
merge feat/nlp
3 years ago
智丞
692ea98bbf
skip ci blocking
3 years ago
shichen.fsc
5386748bc4
[to #42322933 ] add some code check
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9122842
* [Add] add KWS code
* [Update] check code linters and formatter
* [Update] update kws code
* Merge branch 'master' into dev/kws
* [Fix] fix kws warning
* [Add] add ROC for KWS
* [Update] add some code check
* feat: Fix confilct, auto commit by WebIDE
* feat: Fix confilct, auto commit by WebIDE
* Merge branch 'master' into dev/kws
* [Update] refactor kws code
* [Update] refactor kws code
* [Update] refactor kws code, bug fix
* [Update] refactor kws code, bug fix
3 years ago
ly119399
80461600f7
merge nlp
3 years ago
ly119399
318ac98a7e
add init
3 years ago
雨泓
c74a252b6c
Merge commit 'ace8af92465f7d772f035aebe98967726655f12c' into feat/nlp
* commit 'ace8af92465f7d772f035aebe98967726655f12c':
[to #42322933 ] Add cv-action-recongnition-pipeline to maas lib
[to #42463204 ] support Pil.Image for image_captioning_pipeline
[to #42670107 ] restore pydataset test
[to #42322933 ] add create if not exist and add(back) create model example Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
[to #41474818 ]fix: fix errors in task name definition
# Conflicts:
# modelscope/pipelines/builder.py
# modelscope/utils/constant.py
3 years ago
lingcai.wl
2019315c54
[to #42463204 ] support Pil.Image for image_captioning_pipeline
3 years ago
智丞
4dfab005ca
merge with space
3 years ago
智丞
8853b0dff1
merge with sentiment_classification
3 years ago
智丞
28fe91c8fd
merge with nli task
3 years ago
yichang.zyc
a2cf3d619e
[to #42322933 ]update ofa caption model
将caption pipeline的实现从pipeline下沉到model,并拆解preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9081211
* [to #41669377 ] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377 ] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* refine doc
* upload ofa for caption(with source code but not whl)
* remove data in gitignore
* append uncommitted data dir in ofa
* remove ofa_dir , use ofa.whl instead.
* update BPE
* rollback changes used in debugging.
* Merge branch 'master' into ofa/image_caption
# Conflicts:
# docs/README.md
# docs/source/conf.py
# docs/source/index.rst
# docs/source/tutorials/pipeline.md
# maas_lib/models/nlp/sequence_classification_model.py
# maas_lib/pipelines/builder.py
# maas_lib/version.py
# setup.py
# tests/pipelines/test_text_classification.py
* 1. fix a bug in pipelines/builder.py.
2. modify model_path to model in image_captioning.py.
* 1. rename test_image_captioning.py.
* format all files using pre-commit.
* add fairseq in requirements.txt
* add fairseq in requirements.txt
* change fairseq path to git repo to a whl on oss in ofa.txt.
* change module_name to 'ofa'
* Merge remote-tracking branch 'origin/master' into ofa/image_caption
# Conflicts:
# maas_lib/pipelines/builder.py
* optim requirements for ofa / refine image_captioning.py
* uncommited change.
* feat: Fix confilct, auto commit by WebIDE
* Merge remote-tracking branch 'origin/master' into ofa/image_caption
# Conflicts:
# maas_lib/pipelines/multi_modal/__init__.py
# modelscope/pipelines/multi_modal/image_captioning.py
# tests/pipelines/test_image_captioning.py
* merge master
* merge master
* merge master
* rename
* Merge remote-tracking branch 'origin/master' into ofa/nlu
* add caption model
* Merge remote-tracking branch 'origin/master' into ofa/nlu
* update ofa caption model
* fix some typo, update unittest
* use local test image
* use local test image
* refactor, ofa -> multi_model
* merge master
* 删除 image_caption_pipeline.py
3 years ago
智丞
05ac2b15d1
merge with master
3 years ago
jiaqi.sjq
b1490bfd7f
[to #9061073 ] feat: merge tts to master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9061073
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9061073
* [to #41669377 ] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377 ] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* refine doc
* merge remote release/0.1 and fix conflict
* Merge branch 'release/0.1' into 'nls/tts'
Release/0.1
See merge request !1700968
* [Add] add tts preprocessor without requirements. finish requirements build later
* [Add] add requirements and frd submodule
* [Fix] remove models submodule
* [Add] add am module
* [Update] update am and vocoder
* [Update] remove submodule
* [Update] add models
* [Fix] fix init error
* [Fix] fix bugs with tts pipeline
* merge master
* [Update] merge from master
* remove frd subdmoule and using wheel from oss
* change scripts
* [Fix] fix bugs in am and vocoder
* [Merge] merge from master
* Merge branch 'master' into nls/tts
* [Fix] fix bugs
* [Fix] fix pep8
* Merge branch 'master' into nls/tts
* [Update] remove hparams and import configuration from kwargs
* Merge branch 'master' into nls/tts
* upgrade tf113 to tf115
* Merge branch 'nls/tts' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into nls/tts
* add multiple versions of ttsfrd
* merge master
* [Fix] fix cr comments
* Merge branch 'master' into nls/tts
* [Fix] fix cr comments 0617
* Merge branch 'master' into nls/tts
* [Fix] remove comment out codes
* [Merge] merge from master
* [Fix] fix crash for incompatible tf and pytorch version, and frd using zip file resource
* Merge branch 'master' into nls/tts
* [Add] add cuda support
3 years ago
智丞
856bd858fd
merge with master
3 years ago
bin.xue
31498c1d6a
[to #41669377 ] add speech AEC pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8973072
* [to #41669377 ] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377 ] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* feat: add audio aec pipeline and preprocessor
* feat: add audio aec model classes
* feat: add audio aec loss functions
* refactor:delete no longer used loss function
* [to #42281043 ] support kwargs in pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8949062
* support kwargs in pipeline
* update develop doc with CR instruction
* Merge branch 'release/0.1' into dev/aec
* style: reformat code by pre-commit tools
* feat:support maas_lib pipeline auto downloading model
* test:add aec test case as sample code
* feat:aec pipeline use config from maashub
* feat:aec pipeline use feature parameters from maashub
* update setup.cfg to disable PEP8 rule W503 in flake8 and yapf
* format:fix double quoted strings, indent issues and optimize import
* refactor:extract some constant in aec pipeline
* refactor: delete no longer used __main__ statement
* chore:change all Chinese comments to English
* fix: change file name style to lower case
* refactor: rename model name
* feat:load C++ .so from LD_LIBRARY_PATH
* feat:register PROPROCESSOR for LinearAECAndFbank
* refactory:move aec process from postprocess() to forward() and update comments
* refactory:add more readable error message when audio sample rate is not 16000
* fix: package maas_lib renamed to modelscope in import statement
* feat: optimize the error message of audio layer classes
* format: delete empty lines
* refactor: rename audio preprocessor and optimize error message
* refactor: change aec model id to damo/speech_dfsmn_aec_psm_16k
* refactor: change sample audio file url to public oss
* Merge branch 'master' into dev/aec
* feat: add output info for aec pipeline
* fix: normalize output audio data to [-1.0, 1.0]
* refactor:use constant from ModelFile
* feat: AEC pipeline can use c++ lib in current working directory and the test will download it
* fix: c++ downloading should work wherever test is triggerd
3 years ago
ly119399
caadf4a39d
local gen ready
3 years ago
zhangzhicheng.zzc
ba471d4492
[to #42322933 ]sentence-similarity
Adding the new task of sentence_similarity, in which the model is the sofa version of structbert
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9016402
* sbert-sentence-similarity
* [to #42322933 ] pip8
* merge with master for file dirs update
* add test cases
* pre-commit lint check
* remove useless file
* download models again~
* skip time consuming test case
* update for pr reviews
* merge with master
* add test level
* reset test level to env level
* [to #42322933 ] init
* [to #42322933 ] init
* adding purge logic in test
* merge with head
* change test level
* using sequence classification processor for similarity
3 years ago
ly119399
b1948cd81c
modify forward
3 years ago
思宏
cf112dbbf7
[to #42322933 ] init
3 years ago
ly119399
e4f2bdce54
bug fix
3 years ago
思宏
414c0c1b3c
init
3 years ago
ly119399
e683a2d4cd
merge master
3 years ago
wenmeng.zwm
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
3 years ago