hesham
3a9695313b
files_need_cleanup fixes
4 years ago
mindspore-ci-bot
2433778dac
!15963 Support getting dynamic_min_max_shape of data
From: @luoyang42
Reviewed-by:
Signed-off-by:
4 years ago
mindspore-ci-bot
730e211e52
!16702 Add GaussianBlur API for CV data processing
From: @tiancixiao
Reviewed-by: @liucunwei,@jonyguo
Signed-off-by: @liucunwei
4 years ago
mindspore-ci-bot
d0978f709a
!16167 CocoDataset add a new column according a new arg extra_metadata
From: @xiefangqi
Reviewed-by:
Signed-off-by:
4 years ago
mindspore-ci-bot
e513786709
!16565 Bug in Normalize when num_channels > 128
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
4 years ago
xiefangqi
53891dbdf7
coco add img_id column
4 years ago
luoyang
13ef5b61f3
support getting dynamic_min_max_shape of data
4 years ago
Xiao Tianci
3f495bbae1
add GaussianBlur API
4 years ago
mindspore-ci-bot
05bbd1d8fa
!16426 Change the permission of cache shared memory to 600 for security
From: @lixiachen
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
4 years ago
mindspore-ci-bot
1cb2d31642
!16509 GNN dataset new feature for invalid edge or node id case
From: @lizhenglong1992
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
4 years ago
hesham
bc92011b5f
Bug in Normalize when num_channels > 128
4 years ago
Zhenglong Li
9284b6d6af
Add special case returned value for get feature function
4 years ago
mindspore-ci-bot
ec9fc5fb3b
!16384 Fix python multiprocessing with shared memory for edge case
From: @robingrosman
Reviewed-by: @mikef
Signed-off-by: @mikef
4 years ago
Lixia Chen
8812111f94
change shared mem perm to 600 & minor other fixes
4 years ago
mindspore-ci-bot
601322356b
!15638 VOCDataset need to add img_id for evaluation
From: @xiefangqi
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
4 years ago
xiefangqi
9b846c7873
voc add image_id column
4 years ago
RobinGrosman
ca88d7d76a
fix edge case and docstring in minddata multiprocessing shared memory code
4 years ago
jonyguo
9452142b50
enhance: enable shuffle infile / files when mindrecord
4 years ago
mindspore-ci-bot
b5cddcb8cc
!16036 Improve performance of multi-processing option for dataset
From: @robingrosman
Reviewed-by:
Signed-off-by:
4 years ago
RobinGrosman
9a7d1fc034
Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue
4 years ago
mindspore-ci-bot
ebed057e72
!16196 If Imagefolder input directory is not right, will occur out of memory error
From: @xiefangqi
Reviewed-by: @ms_yan,@heleiwang,@jonyguo
Signed-off-by: @jonyguo
4 years ago
mindspore-ci-bot
d3a175e30f
!16078 Modify Normalize to accept images with more than 3 channels
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
4 years ago
xiefangqi
e0148f7181
fix minddata directory path problem
4 years ago
mindspore-ci-bot
b86747b9a6
!15813 Convert some pipeline Ops to be inlined
From: @hfarahat
Reviewed-by:
Signed-off-by:
4 years ago
hesham
fd943bbdc0
Modify normalize to support multiple of channels
4 years ago
mindspore-ci-bot
e0422e972e
!16019 If dataset_dir is not a dir or something else validation is not right somehow
From: @xiefangqi
Reviewed-by: @ms_yan,@liucunwei,@jonyguo
Signed-off-by: @liucunwei
4 years ago
mindspore-ci-bot
b85bf60eb8
!15727 VOCDataset read xml will filter invalid bbox automationally
From: @xiefangqi
Reviewed-by: @heleiwang,@jonyguo
Signed-off-by: @jonyguo
4 years ago
mindspore-ci-bot
eb08d2e952
!16024 dataset: modify some error msg in dataset module
From: @ms_yan
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @jonyguo
4 years ago
ms_yan
34dcd2b463
modify log of dataset part
4 years ago
xiefangqi
b6e1fceedc
minddata modify dir validation
4 years ago
Lixia Chen
5967cb2cd7
Unblock mindrecord under cache
4 years ago
hesham
e4c0bd51a5
Modify concat to be an inlined Op
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
4 years ago
mindspore-ci-bot
cefcf6c2ae
!15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
4 years ago
alex-yuyue
9ef4331f56
Add eager tests for transform ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
liyong
587247e793
add support save dynamic shape tensor
4 years ago
xiefangqi
458ff5fed9
md fix voc and manifest error scenario
4 years ago
dinglinhe
54fb72e2b3
Update normalization description at nn/layer/normalization.py
4 years ago
Cathy Wong
636809c255
dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType
4 years ago
mindspore-ci-bot
f9c5060cf2
!14930 Handle ignored returned Status
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
4 years ago
hesham
6e6eaebb77
Fix unused return value in main code
4 years ago
alex-yuyue
97e3232b6d
Add more ut for transform ops and subset sampler
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
mindspore-ci-bot
727203a498
!14911 dataset: Fill op: C++ API support, UTs and Pybind decoupling
From: @cathwong
Reviewed-by:
Signed-off-by:
4 years ago
Cathy Wong
7e6a03487e
dataset: Fill op: C++ API support, UTs and Pybind decoupling
5 years ago
mindspore-ci-bot
e07a69d8f8
!14874 GNN dataset new feature
From: @lizhenglong1992
Reviewed-by:
Signed-off-by:
4 years ago
Zhenglong Li
f3895f2b09
Add get edges from nodes function for gnn network
4 years ago
mindspore-ci-bot
f0f7bf1ed1
!14885 fix: wrong input order
From: @jonyguo
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
4 years ago
jonyguo
a5cc81dc97
fix: wrong input order in test_paddeddataset.py
4 years ago
Lixia Chen
1f2b178a16
Reset CacheClient's status for a new run
Turn off lock only after all data is cached
5 years ago
mindspore-ci-bot
a9ba9b90f6
!14680 MindData Codespell correction
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
5 years ago
luoyang
624511337c
MindData Codespell correction
5 years ago