mindspore-ci-bot
7878743400
!1638 fixed rounding edge case in split
Merge pull request !1638 from Peilin/splitOp-after-testing
5 years ago
mindspore-ci-bot
0e3dd8149a
!1703 Adding sync_wait input check
Merge pull request !1703 from EricZ/master
5 years ago
Eric
8e1b2107ce
Added example for sync_wait bad batch_num
Added broken test case for cv
Fixed error handling in sync_wait
6 years ago
Peilin Wang
5469be2a97
fixed bug for split, RandomSampler and some other cleanup
add another test case
typo
merge conflict
another PR changed testing behavior, updated test cases in this commit
added input check for use_sampler
addressed code review comments
fixed pylint, not related to my changes
fixed edge case of rounding in getting split sizes
fix pylint
6 years ago
ms_yan
de31113771
repair get_sampler_size problem
5 years ago
yanghaitao
7f5db74457
fix generatorDataset get_dataset_size
5 years ago
ms_yan
074be8cbbd
repair api format problem
5 years ago
mindspore-ci-bot
21da86b393
!1591 add get_dataset_size for CelebADataset
Merge pull request !1591 from yanghaitao/yht_celeba_get_dataset_size
6 years ago
yanghaitao
cc6c7a3f60
add get_dataset_size to celebadataset
6 years ago
ms_yan
5e8db93618
repair some format problem in API
6 years ago
xiefangqi
5e4728c50f
add voc support split
6 years ago
Peilin Wang
d4c93575e7
fixed bug for split, RandomSampler and some other cleanup
add another test case
typo
merge conflict
another PR changed testing behavior, updated test cases in this commit
added input check for use_sampler
addressed code review comments
fixed pylint, not related to my changes
6 years ago
mindspore-ci-bot
41456ac824
!1369 dataset: delete StorageDataset
Merge pull request !1369 from ms_yan/del_storage
6 years ago
ms_yan
d5e896b51c
delete storageDataset Op API and its test case
6 years ago
hesham
6c21e556c4
Clean up work for text python package
6 years ago
mindspore-ci-bot
2e3d55ed87
!1281 Implementation of SplitOp
Merge pull request !1281 from Peilin/splitOp
6 years ago
Peilin Wang
71e8bb1960
general split case done, chaining sampler (basic case) is working
implementation 99% complete
everything and tested except for repeatable shuffling
tested most basic/typical split usecases
cleanup
some more cleanup
fix CI
more ci fix
more ci fixes
more ci fix
more ci fix
more ci fix
added more tests, fixed some bugs
some more clean up and test cases
added shard/shuffle before split warning/error
addressed code review comments and ci
fixed ci
6 years ago
mindspore-ci-bot
ba01949d8f
!1306 Adding warning to sync_wait usage
Merge pull request !1306 from EricZ/master
6 years ago
qianlong
451c20a6f5
Add UnicodeCharTokenizer for nlp
6 years ago
eric
2383ef04de
Added warning message
6 years ago
ms_yan
33f3aee9da
repair format problem in concat op
6 years ago
jiangzhiwen
cb2814b498
flat_map first commit
6 years ago
mindspore-ci-bot
c680cfbf27
!1157 dataset: add concat operation for dataset
Merge pull request !1157 from ms_yan/concat_dataset
6 years ago
mindspore-ci-bot
ab031ee9ea
!1126 VOCDataset support object detection function
Merge pull request !1126 from xiefangqi/voc_support_detection
6 years ago
xiefangqi
c937bad53f
minddata support voc
6 years ago
ms_yan
c0fa7b4b19
init commit of concat dataset
change to use __add__ operation instead ds.concat
6 years ago
mindspore-ci-bot
d9b8e09baf
!1123 To fix GeneratorDataset numpy copy problem
Merge pull request !1123 from pengyanjun/generator_dataset_np_copy_problem
6 years ago
Yanjun Peng
4bf016e67f
fix generator dataset np copy problem
6 years ago
liyong
aa3f89e74f
mindrecord support read file list
6 years ago
Zirui Wu
c2d364a573
batch with padding implemented
support for 1 specific dimension to be None, added validator
fix various CI complains
another round of CI fixes
ci
refactor parts of the code
code refactor
ci fix
comments added, fix bugs
address review comments
address review comments
review cmts
added simple perf test script
update pad code
perf imprv
6 years ago
mindspore-ci-bot
16930c562d
!969 [MD] fix bug in pk sampler of minddataset
Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler
6 years ago
liyong
b520ca9087
fix pk sampler in mindrecord
6 years ago
panfengfeng
ee3be6823f
code format opt
6 years ago
yanghaitao
1e98fa35b8
Terminate python sub-process
6 years ago
panfengfeng
36a935f701
fix dataset format
6 years ago
mindspore-ci-bot
a606c2e4da
!872 [Dataset] Add schema support for GeneratorDataset
Merge pull request !872 from JunhanHu/generator_schema
6 years ago
mindspore-ci-bot
2303453753
!869 Random data op
Merge pull request !869 from JesseKLee/random_data_op
6 years ago
Junhan Hu
c5a8ffe4f4
Add schema support for GeneratorDataset
6 years ago
cathwong
1db48ba835
update mindspore/dataset/engine/datasets.py. Fix typo.
6 years ago
Jesse Lee
270bf831a9
Random Data Op
6 years ago
ervinzhang
d853f94e2d
fix docstring
6 years ago
mindspore-ci-bot
f82e63fecc
!671 Added testcase for sync_wait
Merge pull request !671 from EricZ/master
6 years ago
mindspore-ci-bot
0e3054d527
!466 Deepcopy problem when pyfunc cannot be pickled
Merge pull request !466 from h.farahat/deepcopy
6 years ago
eric
2d115cd04e
Added example for multiple iterator
Added new testcase for multi iterator
Addressing review
Fixed typo
6 years ago
mindspore-ci-bot
78bbacdaac
!601 [Data]Fix the nonstandard comments (add space, add function type)
Merge pull request !601 from xulei/filter_master
6 years ago
mindspore-ci-bot
eefb6edde2
!606 Fix dataset api doc problem
Merge pull request !606 from pengyanjun/fix_dataset_api_doc_change_line
6 years ago
Yanjun Peng
adeed4fe67
fix dataset api doc
6 years ago
yanghaitao
6a6a3cf077
GeneratorDataset column_names support string type
6 years ago
xulei2020
5baee37978
add code
6 years ago
hesham
a9e9266149
Deepcopy problem when pyfunc cannot be pickled
6 years ago