Junhan Hu
b13e7bc31a
Add python multiprocessing support for Mindspore.dataset
5 年前
qianlong
db80f4ff92
The num_samples and numRows in schema for TFRecordDataset are conflict
5 年前
mindspore-ci-bot
d9e4dcc33b
!483 Optimize skip dataset op
Merge pull request !483 from jiangzhiwen/dataset/skip_opt
5 年前
liyong
f1542a90a3
add pk sampler
5 年前
jiangzhiwen
e1b109e8b8
optimize skip dataset op
5 年前
Cathy Wong
60df369100
Fixup py Normalize doc: takes input CHW
5 年前
mindspore-ci-bot
6369cf27bd
!406 added first row crc check for when reading tfrecord files
Merge pull request !406 from Peilin/first-row-crc-check
5 年前
mindspore-ci-bot
98fbd30a5b
!460 [Data]Add filter operation
Merge pull request !460 from xulei/filter_master
5 年前
mindspore-ci-bot
822a3160e4
!404 [Dataset] Add Python Sampler support for CPP dataset
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
5 年前
xulei2020
c705ea5e5b
add filterOp code
5 年前
Peilin Wang
9bc2134cb7
added checking of first row crc to find invalid tfrecord files
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file
fixed clang format
fixed cppcheck
fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before
fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments
more clang whitespace fixes...
changed print to logger.info
5 年前
yanghaitao
2795e492ff
TextFileDataset
5 年前
Junhan Hu
43a2e99833
Add python sampler support for CPP dataset
5 年前
ms_yan
f0c07c3fa6
Realize take op and add ut
5 年前
mindspore-ci-bot
80333e9f55
!435 Fix dataset serialize and deserialize for MindDataset
Merge pull request !435 from anthonyaje/fix_serdes_dataset
5 年前
mindspore-ci-bot
40f0a4a4f4
!333 Add skip op to Dataset
Merge pull request !333 from jiangzhiwen/dataset/skip
5 年前
mindspore-ci-bot
9e1b5efd1d
!434 Bug in cleaning dataset iterators
Merge pull request !434 from h.farahat/multi_itr_bug
5 年前
anthonyaje
ea297c0889
Fix dataset serdes for MindDataset
5 年前
hesham
3c02c82771
Bug in weak reference.
Add new test cases
5 年前
jzw
3f7054dccb
add skip dataset op
5 年前
mindspore-ci-bot
cf026096a6
!183 Mindspore.dataset CPP sampler for GeneratorDataset
Merge pull request !183 from JunhanHu/cpp_sampler
5 年前
Junhan Hu
9739d3b048
Add CPP sampler support for GeneratorDataset
5 年前
mindspore-ci-bot
30de261c3c
!243 Support nested repeat
Merge pull request !243 from h.farahat/nested_repeat
5 年前
hesham
0fc23eee0f
Support nested repeat
5 年前
xiefangqi
1a1cbc6814
implemention of new api: apply
5 年前
liyong
0ce83e39e1
fix TestShardSampleWrongNumber
adjust internal api
5 年前
liyong
11403492ae
add mindrecord subset random sampler
5 年前
Cathy Wong
59a714c654
Correct shuffle UT buffer_size > #dataset-row as valid
5 年前
jonyguo
c688265671
fix: when use MindDataset block_reade=True hung
5 年前
xiefangqi
bc4602b58e
fix and remove useless import of example, st, ut
5 年前
mindspore-ci-bot
5c22c088bb
!69 Enable skipped dataset zip operator python unit tests
Merge pull request !69 from cathwong/ckw_dataset_py_ut1
5 年前
anzhengqi
6a1b865c91
check num_samples
5 年前
Cathy Wong
2e881276ab
Enable skipped dataset zip python unit tests
Signed-off-by: Cathy Wong <cathy.wong@huawei.com>
5 年前
qianlong
8c88b39da1
Optimize the execution time of test case test_rgb_hsv.py
5 年前
jonyguo
34e42bd6f9
1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset
5 年前
zhunaipan
930a1fb0a8
initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
5 年前