Eric
88bb65768e
Clean up part 1
Removed extra fields in schema
Fixed test cases
Fixing CI
5 years ago
ms_yan
7fa0d9e7e4
add paramter check for numpyslices and num_shards
5 years ago
mindspore-ci-bot
e4451a1a49
!2464 [Dataset] code review & add citation
Merge pull request !2464 from luoyang/pylint
5 years ago
YangLuo
36d1613f9a
!2464 [Dataset] code review & add citation
5 years ago
liyong
68e2097897
fix split erroer message
5 years ago
Cathy Wong
277aba5326
dataset: Fixup docs; remove pylint disabled messages in UT
5 years ago
Jamie Nisbet
c22eac743d
subtree creation in python apis
updates
fix
fix cpplint
fix
5 years ago
heleiwang
0d52888fc5
fix misspell and check parameters
5 years ago
YangLuo
4e3bfcf4c9
!2306 [Dataset] Code review & improve quality
5 years ago
mindspore-ci-bot
a9c309da4c
!2404 [Dataset]rename input variable name to children and output variable to parent
Merge pull request !2404 from xulei/input_output
5 years ago
mindspore-ci-bot
d7d094e1c5
!2231 fix report error in get_dataset_size
Merge pull request !2231 from yanghaitao/yht_get_num_samples
5 years ago
mindspore-ci-bot
78a8bc302d
!2380 Fix CocoDataset issue
Merge pull request !2380 from xiefangqi/xfq_fix_coco_issue_01
5 years ago
xulei2020
3b71bd0d5d
rename input to children, output to parent
5 years ago
ms_yan
cf82aa9035
init remove storage op in c++
init remove storage op test case c++
remove source c++ files
5 years ago
xiefangqi
5703a10b8b
fix CocoDataset issue
5 years ago
mindspore-ci-bot
bbf69912be
!2363 fix TextFildDataset and CLUEDataset does not support to_device
Merge pull request !2363 from yanghaitao/yht_fix_textfiledataset
5 years ago
Yanjun Peng
d14443f123
fix dataset public api build_vocab
5 years ago
yanghaitao
9f336bb735
fix TextFileDataset and CLUEDataset failed with to_device
5 years ago
hesham
11826fb256
DuplicateOp
5 years ago
mindspore-ci-bot
3784220056
!2317 rework on dataset.text.vocab to support any user special_tokens
Merge pull request !2317 from ZiruiWu/vocab_rework
5 years ago
mindspore-ci-bot
e4322baece
!2316 [Dataset] Move python tree transformation into cpp pass
Merge pull request !2316 from JunhanHu/alter_node_cpp
5 years ago
Junhan Hu
57f3732ac3
Move python tree transformation into cpp pass.
5 years ago
Zirui Wu
b6e9504b31
phase I of Vocab rework
phase II vocab rework
added more test cases
fix api doc string
address review cmts and fix CI
address ci complains
fix review cmts
ci
5 years ago
Zirui Wu
8f2674850b
address API doc style and content
addr review cmts
revert
ci
private class
ci
fix ci
address ci
address review cmts
fix style err
5 years ago
kouzhenzhong
98c1f6f876
Dataset: serializer return padd_sample as json str for record
5 years ago
mindspore-ci-bot
ef698a93db
!2185 Dataset: convert schema to json in serializer
Merge pull request !2185 from kouzhenzhong/wide_deep_dataset_graph
5 years ago
mindspore-ci-bot
0d98139f16
!2267 Fix comment errors in graphdata
Merge pull request !2267 from heleiwang/fix_doc
5 years ago
kouzhenzhong
5dc15ce6e2
Dataset: convert schema to json in serializer
5 years ago
heleiwang
ea7d2fc535
fix comment error
5 years ago
Peilin Wang
9d5e4c3ab6
doxygen fix, spelling
5 years ago
ms_yan
fdafc690f8
repair problem in NumpySlicesDataset
5 years ago
panfengfeng
c745b6bd9d
回退 'Pull Request !2189 : dataset: repair some bug in NumpySlicesDataset'
5 years ago
mindspore-ci-bot
c3b1814d61
!2224 [MD] modify padded_sample default value
Merge pull request !2224 from liyong126/mindrecord_fix_mi
5 years ago
mindspore-ci-bot
11a256536d
!2189 dataset: repair some bug in NumpySlicesDataset
Merge pull request !2189 from ms_yan/numpy_slice_repair
5 years ago
ms_yan
5fe9494878
get rid of is_tuple
5 years ago
liyong
1909d26506
fix padded_sample default
5 years ago
yanghaitao1
94cebe4d53
fix sampler get_num_samples
5 years ago
Yanjun Peng
e95220d89d
fix generatordataset para check
5 years ago
ms_yan
d162a7a5ab
repair problem in NumpySlicesDataset
5 years ago
mindspore-ci-bot
625f2421b5
!1977 random walk in gnn node2vec
Merge pull request !1977 from JonathanY/randomwalk
5 years ago
mindspore-ci-bot
898b2fdecd
!2187 Fix comment display issues in BuildVocabDataset
Merge pull request !2187 from ZiruiWu/vocab_rework
5 years ago
Zirui Wu
2794883644
fix selected minor issues
fix review comments
5 years ago
liyong
d4f8f57c7e
add split in minddataset
5 years ago
mindspore-ci-bot
670a512a9a
!2145 Replace np.sum in check_numpyslicesdataset() to correct deprecated warning
Merge pull request !2145 from cathwong/ckw_dataset_npsum_slice_warn
5 years ago
Cathy Wong
201008d49b
Replace np.sum to correct deprecated warning
5 years ago
Peilin Wang
848e07d022
initial commit, start of BucketBatchByLengthOp
c implementation done, just need to call batch/pad
added python api and validator
added pybind/de_pipeline stuff, fixed some compile errors, figure out how null py::function works
added tiny bit of doc
integrated with static batch methods
fixed some bugs
some more bug fixes and cleanup
ci fix
fix ci
ci fix
fix ci
added test_cases and debugged
addressed code review comments
addressed code review comments
ci fix
ci fix
addressed code review comments
addressed code review comments
6 years ago
Jonathan Yan
87d2c27c7f
random walk v1
5 years ago
jonyguo
06b3d48252
1. add set_dataset_size for MindDataset 2. modify parameter dupe_factor from 5 to 10
5 years ago
mindspore-ci-bot
aae2e410ba
!2107 Fix CocoDataset docstring
Merge pull request !2107 from xiefangqi/xfq-coco-docstring
5 years ago
mindspore-ci-bot
a8cf83acf2
!1932 Add CLUE dataset
Merge pull request !1932 from jiangzhiwen/dataset/clue
5 years ago