mindspore-ci-bot
b86747b9a6
!15813 Convert some pipeline Ops to be inlined
From: @hfarahat
Reviewed-by:
Signed-off-by:
4 years ago
mindspore-ci-bot
e0422e972e
!16019 If dataset_dir is not a dir or something else validation is not right somehow
From: @xiefangqi
Reviewed-by: @ms_yan,@liucunwei,@jonyguo
Signed-off-by: @liucunwei
4 years ago
mindspore-ci-bot
b85bf60eb8
!15727 VOCDataset read xml will filter invalid bbox automationally
From: @xiefangqi
Reviewed-by: @heleiwang,@jonyguo
Signed-off-by: @jonyguo
4 years ago
mindspore-ci-bot
eb08d2e952
!16024 dataset: modify some error msg in dataset module
From: @ms_yan
Reviewed-by: @jonyguo,@heleiwang
Signed-off-by: @jonyguo
4 years ago
ms_yan
34dcd2b463
modify log of dataset part
4 years ago
xiefangqi
b6e1fceedc
minddata modify dir validation
4 years ago
Lixia Chen
5967cb2cd7
Unblock mindrecord under cache
4 years ago
hesham
e4c0bd51a5
Modify concat to be an inlined Op
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
4 years ago
mindspore-ci-bot
cefcf6c2ae
!15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
4 years ago
alex-yuyue
9ef4331f56
Add eager tests for transform ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
liyong
587247e793
add support save dynamic shape tensor
4 years ago
xiefangqi
458ff5fed9
md fix voc and manifest error scenario
4 years ago
dinglinhe
54fb72e2b3
Update normalization description at nn/layer/normalization.py
4 years ago
Cathy Wong
636809c255
dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType
4 years ago
mindspore-ci-bot
f9c5060cf2
!14930 Handle ignored returned Status
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
4 years ago
hesham
6e6eaebb77
Fix unused return value in main code
4 years ago
alex-yuyue
97e3232b6d
Add more ut for transform ops and subset sampler
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
4 years ago
mindspore-ci-bot
727203a498
!14911 dataset: Fill op: C++ API support, UTs and Pybind decoupling
From: @cathwong
Reviewed-by:
Signed-off-by:
4 years ago
Cathy Wong
7e6a03487e
dataset: Fill op: C++ API support, UTs and Pybind decoupling
5 years ago
mindspore-ci-bot
e07a69d8f8
!14874 GNN dataset new feature
From: @lizhenglong1992
Reviewed-by:
Signed-off-by:
4 years ago
Zhenglong Li
f3895f2b09
Add get edges from nodes function for gnn network
4 years ago
mindspore-ci-bot
f0f7bf1ed1
!14885 fix: wrong input order
From: @jonyguo
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
4 years ago
jonyguo
a5cc81dc97
fix: wrong input order in test_paddeddataset.py
4 years ago
Lixia Chen
1f2b178a16
Reset CacheClient's status for a new run
Turn off lock only after all data is cached
5 years ago
mindspore-ci-bot
a9ba9b90f6
!14680 MindData Codespell correction
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
5 years ago
luoyang
624511337c
MindData Codespell correction
5 years ago
hesham
8535e89e6c
Remove DataBuffer
5 years ago
hesham
0d86cb1423
Remove rows_per_buffer
5 years ago
mindspore-ci-bot
c99fe1e412
!12841 DataBuffer removal from DE
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago
luoyang
ec21d3f748
Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform
Fix error msg of pythontokenizer
5 years ago
hesham
a9a80693be
Replace Databuffers with TensorRows
5 years ago
xulei2020
4122d1dcce
fix code format bug
5 years ago
YangLuo
f99204b292
fix python tokenizer
5 years ago
Lixia Chen
30017ea5a0
Fix codex issues
5 years ago
mindspore-ci-bot
ac18da3770
!13061 [MD][bugfix] Fix to_json error: can't pickle pyfunc
From: @xiefangqi
Reviewed-by:
Signed-off-by:
5 years ago
Xiao Tianci
4a7100c7f9
fix RandomAffine degree error and some examples in docs
5 years ago
mindspore-ci-bot
682a8926bd
!13176 fix minddata transform issue
From: @luoyang42
Reviewed-by:
Signed-off-by:
5 years ago
xiefangqi
41f3e02e87
fix pyfunc pickle issue
5 years ago
YangLuo
74d7bb41a6
fix minddata transform issue
5 years ago
mindspore-ci-bot
f7040ca134
!13198 Fix get_dataset_size error with PKSampler
From: @ziruiwu
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
1bb789278d
!13200 Fix CI warnings and test team issues
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
5 years ago
Zirui Wu
2692e3cc3d
fix pk sampler's get_dataset error due to num_class unavaiable at pre-runtime
5 years ago
alex-yuyue
2457f52596
Fix CI warning and test team issues
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
RobinGrosman
a0e75b845a
Increase default level of parallelism in mindddata pipeline to 8.
Adjust memory usage to not increase as parallelism increases. it will
stay at same level it would be with 4 parallelism
5 years ago
mindspore-ci-bot
3c7463bf2c
!12943 adding fix to sample script
From: @ezphlow
Reviewed-by:
Signed-off-by:
5 years ago
Eric
ed373f61ac
Adding inheritance to user defined sampler
what if we just do nothing
trying wrapper approach
Fix yolo
5 years ago
YangLuo
74431ad117
Fix bugs of minddata transforms
5 years ago
mindspore-ci-bot
fe53c71b3b
!12843 Add more callable test and clean the input check for tensor ops
From: @alexyuyue
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
5 years ago
alex-yuyue
6d7be32614
Add more callable test and clean the input check
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
mindspore-ci-bot
1c191a65fb
!12765 Fix numpy input to samplers
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago