hesham
b9495a9ccc
Truncate Pair
5 years ago
mindspore-ci-bot
ea829e89c3
!2198 Add MaskOp to dataset
Merge pull request !2198 from h.farahat/mask_op
5 years ago
mindspore-ci-bot
808380a9f9
!2142 Cleanup dataset UT: refactor visualize()
Merge pull request !2142 from Tinazhang/reorg-visualize
5 years ago
ms_yan
fdafc690f8
repair problem in NumpySlicesDataset
5 years ago
Tinazhang
169eaf73c7
reorganize util function visualize()
5 years ago
qianlong
4f16f036be
Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp
add CaseFold, NormalizeUTF8
add RegexReplace
add RegexTokenizer
add BasicTokenizer
add WordpieceTokenizer
add BertTokenizer
5 years ago
hesham
f2462bb00d
Mask Op
5 years ago
mindspore-ci-bot
ca94916ef9
!2184 CocoDataset add category_id check
Merge pull request !2184 from xiefangqi/xfq_fix_coco_issue
5 years ago
mindspore-ci-bot
625f2421b5
!1977 random walk in gnn node2vec
Merge pull request !1977 from JonathanY/randomwalk
5 years ago
mindspore-ci-bot
3adbde56b2
!2162 SliceOp
Merge pull request !2162 from h.farahat/slice_op
5 years ago
mindspore-ci-bot
898b2fdecd
!2187 Fix comment display issues in BuildVocabDataset
Merge pull request !2187 from ZiruiWu/vocab_rework
5 years ago
Zirui Wu
2794883644
fix selected minor issues
fix review comments
5 years ago
xiefangqi
aab190fcdb
CocoDataset add category_id validation
5 years ago
liyong
d4f8f57c7e
add split in minddataset
5 years ago
hesham
e2012a1de9
Slice Op
5 years ago
mindspore-ci-bot
dceb3c2be4
!2026 Change C++ behavior in RandomCropAndResize
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
5 years ago
Mahdi
add29f95f5
resolved issues in the comments
5 years ago
mindspore-ci-bot
2cab44a637
!2028 FillOp for BERT
Merge pull request !2028 from nhussain/fillOp_learning
5 years ago
nhussain
dd9bf09f0a
added FillOp for #119 - special Ops
5 years ago
Peilin Wang
848e07d022
initial commit, start of BucketBatchByLengthOp
c implementation done, just need to call batch/pad
added python api and validator
added pybind/de_pipeline stuff, fixed some compile errors, figure out how null py::function works
added tiny bit of doc
integrated with static batch methods
fixed some bugs
some more bug fixes and cleanup
ci fix
fix ci
ci fix
fix ci
added test_cases and debugged
addressed code review comments
addressed code review comments
ci fix
ci fix
addressed code review comments
addressed code review comments
5 years ago
Jonathan Yan
87d2c27c7f
random walk v1
5 years ago
mindspore-ci-bot
a8cf83acf2
!1932 Add CLUE dataset
Merge pull request !1932 from jiangzhiwen/dataset/clue
5 years ago
jiangzhiwen
e0e167a000
add CLUE dataset
5 years ago
hesham
a22763b612
Bug in CIFAR after removing GetMutabble buffer
Fixes # I1KIPC
5 years ago
jonyguo
bb2082daec
fix: MindDataset padded log error
5 years ago
mindspore-ci-bot
3085e51e45
!1922 check parameter num_samples of sampler
Merge pull request !1922 from yanghaitao/yht_check_num_samples_sampler
5 years ago
mindspore-ci-bot
1b5d9a1194
!1981 Implemented from_dataset, a way to build a vocab from existing dataset
Merge pull request !1981 from ZiruiWu/from_dataset_dev
5 years ago
Zirui Wu
880ce5ea26
implemented from_dataset
fix complie error
more tests
address CI complains
fix ci
adress review comments
address review cmts
5 years ago
Alexey Shevlyakov
4e333a2f22
MindData profiler infrastructure
5 years ago
mindspore-ci-bot
0a95223f25
!1910 RandomColorAdjust error for grayscale images
Merge pull request !1910 from MahdiRahmaniHanzaki/I1J9SQ-random-color-adjust-bug
5 years ago
yanghaitao
8f16cff12e
add para check for sampler
5 years ago
jonyguo
1de7271afc
add floatxx test case
5 years ago
ms_yan
bc22c172b8
add TensorDataset and its ut
5 years ago
mindspore-ci-bot
251a6667a5
!1989 fix MindDataset distribute shuffle error
Merge pull request !1989 from guozhijian/fix_distribute_shuffle
5 years ago
mindspore-ci-bot
b3da41bd7a
!1913 CocoDataset implementation
Merge pull request !1913 from xiefangqi/xfq_support_coco
5 years ago
xiefangqi
097cbcc0cb
CocoDataset implementation
5 years ago
jonyguo
96859f44b6
fix: MindDataset distribute shuffle bug
5 years ago
Mahdi
ba2e2dced4
fixed some warnings and typos
5 years ago
Tinazhang
2812cd57db
fix pylint error
5 years ago
mindspore-ci-bot
fe0c3e9a8f
!1908 Add UT to six data vision transforms ops
Merge pull request !1908 from Tinazhang/ut-normalize
5 years ago
heleiwang
3ece8dd090
1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API
2. mod cora and citeseer conversion script
5 years ago
mindspore-ci-bot
5eb95599f6
!1874 Updates to string tensor
Merge pull request !1874 from h.farahat/string_tensor_updates
5 years ago
Tinazhang
c3de5c7a54
adding new TCs to six ops and skip md5 case in RandomPerspective
5 years ago
hesham
f837ddc956
- Bug when empty strings sent to Python
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
5 years ago
liyong
feff8899ac
support padding samples
5 years ago
mindspore-ci-bot
5c21616293
!1807 Implemented Ngram TensorOp for dataset
Merge pull request !1807 from ZiruiWu/ngram_dev
5 years ago
Zirui Wu
dbf9936ec4
Implemented n-gram for dataset TensorOp
5 years ago
Jamie Nisbet
51bc0c0460
consistent design for num_samples
updates
more update
more work
more fixin
post rebase updates
clang formatting
code review recovery
ci fixes
updates
update
update
update
5 years ago
Tinazhang
33fe66fd1e
fix error handling for bigger crop size case
5 years ago
Yang
5522edc4b5
!1713 [Dataset] Clean pylint.
5 years ago