Jesse Lee
6cfa0891b4
Addressing comments for PR 2602
5 years ago
Jamie Nisbet
2ffe76981d
added a pre pass for node removals
cpplint
5 years ago
Jesse Lee
a0a863f20c
Stage 2 porting
5 years ago
mindspore-ci-bot
9b4399480a
!2321 Connector throughput performance metric
Merge pull request !2321 from Alexey_Shevlyakov/connector_throughput_dev
5 years ago
jonyguo
41d16a3c77
enhance: 1. fix api comment, 2. del dead code
5 years ago
YangLuo
36d1613f9a
!2464 [Dataset] code review & add citation
5 years ago
Alexey Shevlyakov
698abf75fc
Connector throughput + PerfData + CyclicArray
5 years ago
Jamie Nisbet
c22eac743d
subtree creation in python apis
updates
fix
fix cpplint
fix
5 years ago
mindspore-ci-bot
6ba89d432a
!2473 Compute column name id map during tree prepare phase
Merge pull request !2473 from lixiachen/compute_column_map
5 years ago
Lixia Chen
4fa6d5621c
Compute column map before launch the tree.
5 years ago
ms_yan
e829535a86
change GetTensor into GetRow to avoid NullPtr
5 years ago
YangLuo
4e3bfcf4c9
!2306 [Dataset] Code review & improve quality
5 years ago
ms_yan
cf82aa9035
init remove storage op in c++
init remove storage op test case c++
remove source c++ files
5 years ago
panfengfeng
b78efd5b9e
fix gpu invalid input data
5 years ago
mindspore-ci-bot
3784220056
!2317 rework on dataset.text.vocab to support any user special_tokens
Merge pull request !2317 from ZiruiWu/vocab_rework
5 years ago
mindspore-ci-bot
e4322baece
!2316 [Dataset] Move python tree transformation into cpp pass
Merge pull request !2316 from JunhanHu/alter_node_cpp
5 years ago
Junhan Hu
57f3732ac3
Move python tree transformation into cpp pass.
5 years ago
Zirui Wu
b6e9504b31
phase I of Vocab rework
phase II vocab rework
added more test cases
fix api doc string
address review cmts and fix CI
address ci complains
fix review cmts
ci
5 years ago
Zirui Wu
8f2674850b
address API doc style and content
addr review cmts
revert
ci
private class
ci
fix ci
address ci
address review cmts
fix style err
5 years ago
mindspore-ci-bot
d0c5071cab
!1993 [Dataset] Fix codedex.
Merge pull request !1993 from luoyang/pylint
5 years ago
yanghaitao
993165cfd5
fix profiling size is -1
5 years ago
mindspore-ci-bot
a4048e192c
!2256 Rename Sampler::Reset() to Sampler::ResetSampler()
Merge pull request !2256 from JesseKLee/sampler
5 years ago
Jesse Lee
dcfdff6021
Rename Sampler Reset
5 years ago
Yang
dee8471d23
!1993 [Dataset] Fix codedex.
5 years ago
mindspore-ci-bot
ca94916ef9
!2184 CocoDataset add category_id check
Merge pull request !2184 from xiefangqi/xfq_fix_coco_issue
5 years ago
Jesse Lee
287ca71260
Remove dead code
5 years ago
xiefangqi
aab190fcdb
CocoDataset add category_id validation
5 years ago
Peilin Wang
848e07d022
initial commit, start of BucketBatchByLengthOp
c implementation done, just need to call batch/pad
added python api and validator
added pybind/de_pipeline stuff, fixed some compile errors, figure out how null py::function works
added tiny bit of doc
integrated with static batch methods
fixed some bugs
some more bug fixes and cleanup
ci fix
fix ci
ci fix
fix ci
added test_cases and debugged
addressed code review comments
addressed code review comments
ci fix
ci fix
addressed code review comments
addressed code review comments
5 years ago
mindspore-ci-bot
a8cf83acf2
!1932 Add CLUE dataset
Merge pull request !1932 from jiangzhiwen/dataset/clue
5 years ago
jiangzhiwen
e0e167a000
add CLUE dataset
5 years ago
hesham
a22763b612
Bug in CIFAR after removing GetMutabble buffer
Fixes # I1KIPC
5 years ago
yanghaitao
53cee6589e
fix profiling capacity
5 years ago
mindspore-ci-bot
c661087b99
!2029 Create TensorRow class that supports a row id
Merge pull request !2029 from lixiachen/lixia/tensorrow
5 years ago
Lixia Chen
6ae88c3987
Create TensorRow class that supports a row id.
5 years ago
mindspore-ci-bot
a2a90800a0
!2053 add check if there is no data
Merge pull request !2053 from yanghaitao/yht_no_data
5 years ago
yanghaitao
20524f37e4
add check for num_rows
5 years ago
mindspore-ci-bot
8eb8663fbd
!2000 Make GetMutableBuffer protected
Merge pull request !2000 from h.farahat/tensor_mutabble_buffer
5 years ago
mindspore-ci-bot
1b5d9a1194
!1981 Implemented from_dataset, a way to build a vocab from existing dataset
Merge pull request !1981 from ZiruiWu/from_dataset_dev
5 years ago
hesham
0c5e47111b
- Move MutableBuffer to be protected
- Add new CreateTensors
5 years ago
Zirui Wu
880ce5ea26
implemented from_dataset
fix complie error
more tests
address CI complains
fix ci
adress review comments
address review cmts
5 years ago
Alexey Shevlyakov
4e333a2f22
MindData profiler infrastructure
5 years ago
Jesse Lee
a18b04e0f8
Fix coco
5 years ago
mindspore-ci-bot
beefb20c01
!1983 Remove inheritance of Sampler from DatasetOp
Merge pull request !1983 from JesseKLee/sampler
5 years ago
mindspore-ci-bot
b3da41bd7a
!1913 CocoDataset implementation
Merge pull request !1913 from xiefangqi/xfq_support_coco
5 years ago
xiefangqi
097cbcc0cb
CocoDataset implementation
5 years ago
Jesse Lee
255adf7c6e
Remove inheritance of Sampler from DatasetOp
5 years ago
mindspore-ci-bot
5eb95599f6
!1874 Updates to string tensor
Merge pull request !1874 from h.farahat/string_tensor_updates
5 years ago
hesham
f837ddc956
- Bug when empty strings sent to Python
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
5 years ago
xiefangqi
8fdfe34f3c
fix codex problems
5 years ago
mindspore-ci-bot
1973594bd1
!1774 [MD] minddataset support padding samples
Merge pull request !1774 from liyong126/mindrecord_padded_sample
5 years ago