mindspore-ci-bot
fb18671b28
!506 [Dataset] Multiprocessing support for Pyfunc
Merge pull request !506 from JunhanHu/multiprocess_pyfunc
6 years ago
Junhan Hu
b13e7bc31a
Add python multiprocessing support for Mindspore.dataset
6 years ago
xiefangqi
108eeb8e3d
fix voc test cases
6 years ago
qianlong
db80f4ff92
The num_samples and numRows in schema for TFRecordDataset are conflict
6 years ago
liyong
f1542a90a3
add pk sampler
6 years ago
mindspore-ci-bot
6369cf27bd
!406 added first row crc check for when reading tfrecord files
Merge pull request !406 from Peilin/first-row-crc-check
6 years ago
mindspore-ci-bot
98fbd30a5b
!460 [Data]Add filter operation
Merge pull request !460 from xulei/filter_master
6 years ago
mindspore-ci-bot
822a3160e4
!404 [Dataset] Add Python Sampler support for CPP dataset
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
6 years ago
xulei2020
c705ea5e5b
add filterOp code
6 years ago
Peilin Wang
9bc2134cb7
added checking of first row crc to find invalid tfrecord files
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file
fixed clang format
fixed cppcheck
fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before
fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments
more clang whitespace fixes...
changed print to logger.info
6 years ago
yanghaitao
2795e492ff
TextFileDataset
6 years ago
Junhan Hu
43a2e99833
Add python sampler support for CPP dataset
6 years ago
mindspore-ci-bot
3ad73b7d71
!463 !330 dataset: add take operation
Merge pull request !463 from ms_yan/take_op_merge
6 years ago
ms_yan
f0c07c3fa6
Realize take op and add ut
6 years ago
caojian05
852039b726
fix dataset deepcopy failed while depipline referenced in the iterator
6 years ago
mindspore-ci-bot
6c59093fe8
!427 Fix dataset api description
Merge pull request !427 from pengyanjun/fix_dataset_api_description
6 years ago
Yanjun Peng
c69f3be758
fix dataset api description
6 years ago
mindspore-ci-bot
80333e9f55
!435 Fix dataset serialize and deserialize for MindDataset
Merge pull request !435 from anthonyaje/fix_serdes_dataset
6 years ago
mindspore-ci-bot
40f0a4a4f4
!333 Add skip op to Dataset
Merge pull request !333 from jiangzhiwen/dataset/skip
6 years ago
mindspore-ci-bot
9e1b5efd1d
!434 Bug in cleaning dataset iterators
Merge pull request !434 from h.farahat/multi_itr_bug
6 years ago
anthonyaje
ea297c0889
Fix dataset serdes for MindDataset
6 years ago
hesham
3c02c82771
Bug in weak reference.
Add new test cases
6 years ago
jzw
3f7054dccb
add skip dataset op
6 years ago
mindspore-ci-bot
f8a66ca4fc
!422 dataset: repeair GeneratorDataset to_device problem
Merge pull request !422 from ms_yan/Generator_distri
6 years ago
mindspore-ci-bot
0163c11028
!416 Fix apply ops comments
Merge pull request !416 from xiefangqi/br_fix_apply_comment
6 years ago
ms_yan
b9742de3a3
repeair GeneratorDataset to_device problem
6 years ago
anzhengqi
34298e2135
fix commit format error
6 years ago
xiefangqi
1d1e085b0b
fix mindspore.datasets.apply comments
6 years ago
mindspore-ci-bot
c0c0b0985e
!378 Multiple Iterators can cause performance problem
Merge pull request !378 from h.farahat/multi_itr
6 years ago
hesham
fb6c7ba2e1
Fix two problem when we create multiple instances of the same dataset (2 for-loops)
-- Iterator list is keeping all created iterators wihtout cleaning them up
-- alter tree modifies the original.
6 years ago
mindspore-ci-bot
cf026096a6
!183 Mindspore.dataset CPP sampler for GeneratorDataset
Merge pull request !183 from JunhanHu/cpp_sampler
6 years ago
Yanjun Peng
b08a90ab9b
add tdt transfer data limit notice
6 years ago
anzhengqi
e0393b482f
fix schema.parse_columns function
6 years ago
jonyguo
f72b84ffb8
Revert "fix schema.parse_columns function"
This reverts commit 5c2ded8d8e .
6 years ago
anzhengqi
5c2ded8d8e
fix schema.parse_columns function
6 years ago
Junhan Hu
9739d3b048
Add CPP sampler support for GeneratorDataset
6 years ago
mindspore-ci-bot
30de261c3c
!243 Support nested repeat
Merge pull request !243 from h.farahat/nested_repeat
6 years ago
mindspore-ci-bot
9a781025ec
!318 Add get_class_indexing exception
Merge pull request !318 from pengyanjun/fix_get_cladd_indexing_warning
6 years ago
hesham
0fc23eee0f
Support nested repeat
6 years ago
xiefangqi
1a1cbc6814
implemention of new api: apply
6 years ago
Yanjun Peng
950d75e376
add get_class_indexing exception info
6 years ago
mindspore-ci-bot
f1fa2a9941
!273 [MD] update subset random sampler in minddataset
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
6 years ago
liyong
0ce83e39e1
fix TestShardSampleWrongNumber
adjust internal api
6 years ago
Yanjun Peng
732dd01a6a
fix epoch repeat doc problem
6 years ago
liyong
11403492ae
add mindrecord subset random sampler
6 years ago
mindspore-ci-bot
7f8c9ebf10
!194 Fix dataset parameter check
Merge pull request !194 from pengyanjun/fix_dataset_para_validator_check
6 years ago
Yanjun Peng
363632ca9d
fix dataset para validator check
6 years ago
Cathy Wong
917aa02e2a
Correct dataset error checking
6 years ago
mindspore-ci-bot
9930b18508
!165 Use mindspore. instead of mstype. in example
Merge pull request !165 from ghzl/use-mindspore-instead-of-mstype-in-example
6 years ago
guohongzilong
c4f9230f03
usr mindspore. instead of mstype.
6 years ago