mindspore-ci-bot
bc0a53cfb1
!3030 minddata support ps-lite feature
Merge pull request !3030 from xiefangqi/md_support-pslite
5 years ago
Zirui Wu
63185cb20f
fix some validators errors
address review cmts
addr review cmts
5 years ago
xiefangqi
add19a591c
md support ps-lite
5 years ago
Jesse Lee
7c1bc5192b
Initial Drop of CacheOp Phase I
6 years ago
ms_yan
dd9bfa8174
modify the check and msg in to_device
5 years ago
ms_yan
83bc1fb343
repair issue for same column name and para check
5 years ago
shenwei
44efabe279
fix api document
5 years ago
Zirui Wu
3b42c360b6
set dataset_size in generator when source has len
5 years ago
mindspore-ci-bot
3cb531435e
!2753 Fix vocdataset/cocodataset docstring problem
Merge pull request !2753 from xiefangqi/xfq_fix_docstring
5 years ago
xiefangqi
741154b9b9
fix voc/coco docstring problem
5 years ago
Eric
88bb65768e
Clean up part 1
Removed extra fields in schema
Fixed test cases
Fixing CI
5 years ago
ms_yan
7fa0d9e7e4
add paramter check for numpyslices and num_shards
5 years ago
YangLuo
36d1613f9a
!2464 [Dataset] code review & add citation
5 years ago
Cathy Wong
277aba5326
dataset: Fixup docs; remove pylint disabled messages in UT
5 years ago
YangLuo
4e3bfcf4c9
!2306 [Dataset] Code review & improve quality
5 years ago
mindspore-ci-bot
a9c309da4c
!2404 [Dataset]rename input variable name to children and output variable to parent
Merge pull request !2404 from xulei/input_output
5 years ago
mindspore-ci-bot
78a8bc302d
!2380 Fix CocoDataset issue
Merge pull request !2380 from xiefangqi/xfq_fix_coco_issue_01
5 years ago
xulei2020
3b71bd0d5d
rename input to children, output to parent
5 years ago
xiefangqi
5703a10b8b
fix CocoDataset issue
5 years ago
mindspore-ci-bot
bbf69912be
!2363 fix TextFildDataset and CLUEDataset does not support to_device
Merge pull request !2363 from yanghaitao/yht_fix_textfiledataset
5 years ago
Yanjun Peng
d14443f123
fix dataset public api build_vocab
5 years ago
yanghaitao
9f336bb735
fix TextFileDataset and CLUEDataset failed with to_device
5 years ago
hesham
11826fb256
DuplicateOp
5 years ago
mindspore-ci-bot
3784220056
!2317 rework on dataset.text.vocab to support any user special_tokens
Merge pull request !2317 from ZiruiWu/vocab_rework
5 years ago
mindspore-ci-bot
e4322baece
!2316 [Dataset] Move python tree transformation into cpp pass
Merge pull request !2316 from JunhanHu/alter_node_cpp
5 years ago
Junhan Hu
57f3732ac3
Move python tree transformation into cpp pass.
5 years ago
Zirui Wu
b6e9504b31
phase I of Vocab rework
phase II vocab rework
added more test cases
fix api doc string
address review cmts and fix CI
address ci complains
fix review cmts
ci
5 years ago
Zirui Wu
8f2674850b
address API doc style and content
addr review cmts
revert
ci
private class
ci
fix ci
address ci
address review cmts
fix style err
5 years ago
Peilin Wang
9d5e4c3ab6
doxygen fix, spelling
5 years ago
ms_yan
fdafc690f8
repair problem in NumpySlicesDataset
5 years ago
panfengfeng
c745b6bd9d
回退 'Pull Request !2189 : dataset: repair some bug in NumpySlicesDataset'
5 years ago
mindspore-ci-bot
c3b1814d61
!2224 [MD] modify padded_sample default value
Merge pull request !2224 from liyong126/mindrecord_fix_mi
5 years ago
ms_yan
5fe9494878
get rid of is_tuple
5 years ago
liyong
1909d26506
fix padded_sample default
5 years ago
ms_yan
d162a7a5ab
repair problem in NumpySlicesDataset
5 years ago
mindspore-ci-bot
898b2fdecd
!2187 Fix comment display issues in BuildVocabDataset
Merge pull request !2187 from ZiruiWu/vocab_rework
5 years ago
Zirui Wu
2794883644
fix selected minor issues
fix review comments
5 years ago
liyong
d4f8f57c7e
add split in minddataset
5 years ago
Peilin Wang
848e07d022
initial commit, start of BucketBatchByLengthOp
c implementation done, just need to call batch/pad
added python api and validator
added pybind/de_pipeline stuff, fixed some compile errors, figure out how null py::function works
added tiny bit of doc
integrated with static batch methods
fixed some bugs
some more bug fixes and cleanup
ci fix
fix ci
ci fix
fix ci
added test_cases and debugged
addressed code review comments
addressed code review comments
ci fix
ci fix
addressed code review comments
addressed code review comments
5 years ago
jonyguo
06b3d48252
1. add set_dataset_size for MindDataset 2. modify parameter dupe_factor from 5 to 10
5 years ago
mindspore-ci-bot
aae2e410ba
!2107 Fix CocoDataset docstring
Merge pull request !2107 from xiefangqi/xfq-coco-docstring
5 years ago
jiangzhiwen
e0e167a000
add CLUE dataset
5 years ago
xiefangqi
a70da6ad47
fix CocoDataset docstring
5 years ago
Zirui Wu
880ce5ea26
implemented from_dataset
fix complie error
more tests
address CI complains
fix ci
adress review comments
address review cmts
5 years ago
ms_yan
bc22c172b8
add TensorDataset and its ut
6 years ago
xiefangqi
097cbcc0cb
CocoDataset implementation
5 years ago
liyong
feff8899ac
support padding samples
6 years ago
Jamie Nisbet
51bc0c0460
consistent design for num_samples
updates
more update
more work
more fixin
post rebase updates
clang formatting
code review recovery
ci fixes
updates
update
update
update
6 years ago
ms_yan
a3f7531500
repair format and type problem in split
5 years ago
mindspore-ci-bot
58794ab2d9
!1659 fix get_dataset_size error for GeneratorDataset
Merge pull request !1659 from yanghaitao/yht_generator_get_dataset_size
5 years ago