YangLuo
0a4da64e13
Fix minddata issues
4 years ago
mindspore-ci-bot
34f4260cd1
!15979 Officially support caching over MindRecord dataset
From: @lixiachen
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
4 years ago
ms_yan
ae436cb454
descrease num_worker when mechine has less worker then default
4 years ago
Lixia Chen
5967cb2cd7
Unblock mindrecord under cache
4 years ago
mohammad
9ce28cd34c
split sampler vision IR files
4 years ago
mindspore-ci-bot
1e2e554db3
!15380 Unify minddata include files(except for datasets.h) in scenario of cloud and lite
From: @luoyang42
Reviewed-by: @tiancixiao
Signed-off-by:
4 years ago
YangLuo
bf48400c10
unify include file of minddata
4 years ago
Xiao Tianci
5a9622387c
add folders and CMakeLists for audio operators
4 years ago
mindspore-ci-bot
f9c5060cf2
!14930 Handle ignored returned Status
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
4 years ago
hesham
98f0f36a20
Removed unused include
5 years ago
hesham
6e6eaebb77
Fix unused return value in main code
4 years ago
Zirui Wu
8ebc512d25
plugin infrastruture for mindddata
add single element string tensor support for plugin tensor
5 years ago
mindspore-ci-bot
727203a498
!14911 dataset: Fill op: C++ API support, UTs and Pybind decoupling
From: @cathwong
Reviewed-by:
Signed-off-by:
4 years ago
Cathy Wong
7e6a03487e
dataset: Fill op: C++ API support, UTs and Pybind decoupling
5 years ago
mindspore-ci-bot
e07a69d8f8
!14874 GNN dataset new feature
From: @lizhenglong1992
Reviewed-by:
Signed-off-by:
4 years ago
ms_yan
ecb8d6bc08
add pil version cubic resize
5 years ago
Zhenglong Li
f3895f2b09
Add get edges from nodes function for gnn network
5 years ago
alex-yuyue
83aaed09bb
TensorOp decoupling stage 3 (transform ops)
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
Cathy Wong
78392e0d66
dataset: Pybind change for data transforms
5 years ago
mindspore-ci-bot
0cfd8b7c9e
!13364 Add WordpieceTokenizer and AddDict to Jieba
From: @alexyuyue
Reviewed-by:
Signed-off-by:
5 years ago
hesham
0d86cb1423
Remove rows_per_buffer
5 years ago
ms_yan
b6ef88c168
add stop_dataset_profiler option
5 years ago
alex-yuyue
2d6d608fae
Add WordpieceTokenizer to API and IR. Add AddDict to C++ API
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
Eric
4be0ffb9ba
removing type_id.h from header files
5 years ago
ms_yan
92e86804e1
init add acltdt handle create and destory
add hostpush part modify
optimize previous code
provide aclhandle access method
modify CMakeList format
add device_id parameter into TransferNode
update acltdt api
5 years ago
Eric
82f7c6f2c7
Moving data_helper
exposing json
WIP fix for removing templates
Removing templates part 1
replacing core/constants.h
removed template part 2
Changed fake data to filler data
Fixing CI
Fix CI part 2
CI fix part 2
Fix CI 3
Fixed lizard for data_util
Fixed clang
Fixing CI part 4
5 years ago
alex-yuyue
2457f52596
Fix CI warning and test team issues
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
Eric
ed373f61ac
Adding inheritance to user defined sampler
what if we just do nothing
trying wrapper approach
Fix yolo
5 years ago
Zirui Wu
8022001450
Remove datasets.h dependency on tensor.h and other related dependencies
Replace std::function<TensorRow(TensorRow)> with std::function<MSTensorVec(MSTensor)> by using std::bind
Replace pad_info with MSTensor
Switch TensorShape/dataset::DataType to vector<int64> /mindspore::DataType
Change TypeId to mindspore::DataType in SchemaObj
address review cmts, add CreateFromMSTensor() in tensor.h/.cc
5 years ago
Eric
d328d6eb54
Adding affine
Need to move Affine to image_utilC
Refactored affine
Added affine API
Added API class impl
Removed default from vision ir
Compiling
removed extra file
Spell check
5 years ago
mindspore-ci-bot
ced5575387
!12353 Move sampler IR code to engine/ir
From: @mhmotallebi
Reviewed-by:
Signed-off-by:
5 years ago
mohammad
74bc54b694
push down sampler IR files
5 years ago
mindspore-ci-bot
ed7fef5d5e
!12349 [MD] Push down IR files for transforms and text
From: @tina_mengting_zhang
Reviewed-by:
Signed-off-by:
5 years ago
TinaMengtingZhang
462422acc7
Move transforms and text ir down
5 years ago
mindspore-ci-bot
806b639f02
!9720 restructure python bindings
From: @mhmotallebi
Reviewed-by:
Signed-off-by:
5 years ago
mohammad
52334c8e4d
restructure python bindings
5 years ago
Cathy Wong
fc8b9fc85e
dataset: Push down IR vision files
5 years ago
hesham
37add20783
Fix caching problem after cleanup
5 years ago
mindspore-ci-bot
e6dcb0c31d
!12239 [MD] fix bugs of execute & update doc description in minddata
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
5 years ago
luoyang
cd86788cf3
fix bugs of execute & update doc description in minddata
5 years ago
gongxiaoqing
7f538b51e7
回退 'Pull Request !11074 : replace tdt with acltdt interface'
5 years ago
mindspore-ci-bot
c2582dcab9
!11074 replace tdt with acltdt interface
From: @ms_yan
Reviewed-by: @lilongfei15
Signed-off-by:
5 years ago
hesham
4bbc3445f1
datasets.py cleanup
5 years ago
ms_yan
293f81128d
init add acltdt handle create and destory
add hostpush part modify
optimize previous code
provide aclhandle access method
modify CMakeList format
add device_id parameter into TransferNode
5 years ago
luoyang
fa4f67cbcd
LookupOp: default value of unknown_token support NoneType
5 years ago
lixian
7d2fd6e76c
cxx api refactor: tensor/status/model
5 years ago
mindspore-ci-bot
320ea51308
!11853 Add call for decoupled image and text ops
From: @alexyuyue
Reviewed-by:
Signed-off-by:
5 years ago
yanghaitao1
83cb87bcd1
cpu profiling
add operator profiling part
add op_id param when create task
repair bugs in op cpu sampling
fix wrong order of write and parse cpu_info
add process cpu profiling part
add multiprocessing part(part 1)
adapter cpu_sampling c layer
fix little error in sampling
descrease cirle complex in voc
descrease cirle complex in device_que
5 years ago
alex-yuyue
6fd58dc580
Add call for decoupled image and text ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
Mahdi
8f34faeb7a
Changed bindings to SamplerObj
5 years ago