qianlong
4f16f036be
Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp
add CaseFold, NormalizeUTF8
add RegexReplace
add RegexTokenizer
add BasicTokenizer
add WordpieceTokenizer
add BertTokenizer
5 years ago
mindspore-ci-bot
ca94916ef9
!2184 CocoDataset add category_id check
Merge pull request !2184 from xiefangqi/xfq_fix_coco_issue
5 years ago
mindspore-ci-bot
625f2421b5
!1977 random walk in gnn node2vec
Merge pull request !1977 from JonathanY/randomwalk
5 years ago
xiefangqi
aab190fcdb
CocoDataset add category_id validation
5 years ago
jonyguo
3353a20d8b
add tool: tfrecord to mindrecord
5 years ago
mindspore-ci-bot
dceb3c2be4
!2026 Change C++ behavior in RandomCropAndResize
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
5 years ago
Mahdi
add29f95f5
resolved issues in the comments
5 years ago
Jonathan Yan
87d2c27c7f
random walk v1
5 years ago
jiangzhiwen
e0e167a000
add CLUE dataset
5 years ago
ms_yan
bc22c172b8
add TensorDataset and its ut
5 years ago
mindspore-ci-bot
b3da41bd7a
!1913 CocoDataset implementation
Merge pull request !1913 from xiefangqi/xfq_support_coco
5 years ago
xiefangqi
097cbcc0cb
CocoDataset implementation
5 years ago
mindspore-ci-bot
fe0c3e9a8f
!1908 Add UT to six data vision transforms ops
Merge pull request !1908 from Tinazhang/ut-normalize
5 years ago
heleiwang
3ece8dd090
1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API
2. mod cora and citeseer conversion script
5 years ago
Tinazhang
c3de5c7a54
adding new TCs to six ops and skip md5 case in RandomPerspective
5 years ago
mindspore-ci-bot
976b4793d1
!1544 Python Unit Test for TenCrop
Merge pull request !1544 from MahdiRahmaniHanzaki/I1IHNG-ten-crop
5 years ago
Tinazhang
f4a61fdbb2
Adding new UT cases and missing TCs in PY Ops.
5 years ago
Mahdi
dfc097019b
Added TenCrop test
Added unit tests for both testing the functinality of the TenCrop and
its error messages. Due to the similarity of this method to FiveCrop the
test cases are similar to FiveCrop test cases.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>
added error_msg function call in the main method
refactored the test and added visual representation of the results
Separated the two error cases into two different functions and used the
visualize function in util.py to plot the result of TenCrop.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>
Added new test cases
Added new test cases including test case for checking the error message
when the size variable is not a positive integer, test case for
rectangle crop, test case for vertical flip setting, and testing for
similarity of the result of TenCrop for the same input data in different runs.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>
changed visualize in test_five_crop
Changed the visualize function in test_five_crop to use the already
existing function in util.py
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>
made generate_golden variable global
5 years ago
Yang
abca62f407
10:00 26/5 clean pylint
5 years ago
mindspore-ci-bot
aeb4c52f2d
!1379 Creating new UTs to three vision transformation ops
Merge pull request !1379 from Tinazhang/linearTrans
5 years ago
Tinazhang
7322839b04
add UTs for LinearTransformation, ToPIL, ToType
5 years ago
Peilin Wang
0cbcc7200b
made shuffle determinisitc for subsequent epochs
5 years ago
mindspore-ci-bot
458436186c
!1365 Clean up work for text python sub-package
Merge pull request !1365 from h.farahat/text_namespace
5 years ago
mindspore-ci-bot
6f733ec113
!1308 Stage 2 of adding support for string Tensor
Merge pull request !1308 from h.farahat/string_tensor2
5 years ago
hesham
6c21e556c4
Clean up work for text python package
5 years ago
heleiwang
599a449e0b
Support processing GNN data
5 years ago
hesham
df361d1d26
Change mem layout of string tensor
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
5 years ago
mindspore-ci-bot
58e6d7d950
!1341 Added lookup and vocab to mindspore.dataset.text
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
5 years ago
jonwe
bb51bb88d7
add compress in mindrecord
5 years ago
Zirui Wu
25ab2ef303
Implemented lookup and vocab
5 years ago
qianlong
451c20a6f5
Add UnicodeCharTokenizer for nlp
5 years ago
xulei2020
163b6b7ea7
add jieba c++ code
5 years ago
Tinazhang
17cecf2cf5
Added TCs to RandomCrop and RandomCropAndResize and modified visalize() calling
5 years ago
jinyaohui
bcfaff97f9
clean pylint
5 years ago
jiangzhiwen
cb2814b498
flat_map first commit
5 years ago
mindspore-ci-bot
ab031ee9ea
!1126 VOCDataset support object detection function
Merge pull request !1126 from xiefangqi/voc_support_detection
5 years ago
xiefangqi
c937bad53f
minddata support voc
5 years ago
Cathy Wong
913074e656
Cleanup dataset UT: resolve skipped test units
5 years ago
Cathy Wong
49ef53f164
Cleanup dataset UT: util.py internals
5 years ago
mindspore-ci-bot
2860fd9338
!984 Add unit test case for HWC2CHW.
Merge pull request !984 from Tinazhang/hwc2chw
5 years ago
Tinazhang
c8b5586c7f
add unit test for HWC2CHWC
5 years ago
Cathy Wong
58226addd6
Cleanup dataset UT: use md5 npz in test_zip for images
5 years ago
Cathy Wong
772e6c1461
Cleanup dataset UT: test_batch, save_and_check support
5 years ago
eric
36fffb7706
Added example md5 generation
Comparison example
Added md5 and comparison example for py_transforms
Added md5 check for images
5 years ago
Jesse Lee
270bf831a9
Random Data Op
5 years ago
yanghaitao
1cb3bead32
skip black line for TextFileDataset
5 years ago
qianlong
db80f4ff92
The num_samples and numRows in schema for TFRecordDataset are conflict
5 years ago
liyong
f1542a90a3
add pk sampler
5 years ago
mindspore-ci-bot
6369cf27bd
!406 added first row crc check for when reading tfrecord files
Merge pull request !406 from Peilin/first-row-crc-check
5 years ago
xulei2020
c705ea5e5b
add filterOp code
5 years ago