mindspore-ci-bot
ad9db524bb
!1394 Fix comment error and mod parameter check in graphdata
Merge pull request !1394 from heleiwang/fix_comments_error
5 years ago
heleiwang
f28f883cac
fix comments error and modify parameter check
5 years ago
ms_yan
d6f27f5a4a
repair parameter problem in Uniform augmentation
5 years ago
mindspore-ci-bot
4d72cb7227
!1386 dataset: repair parameter peoblem in api example
Merge pull request !1386 from ms_yan/random_op_example
5 years ago
ms_yan
5540fc61b0
repair parameter problem in randomColor API example etc
5 years ago
mindspore-ci-bot
41456ac824
!1369 dataset: delete StorageDataset
Merge pull request !1369 from ms_yan/del_storage
5 years ago
mindspore-ci-bot
a528797253
!1377 Code Fix for Uniform Augmentation
Merge pull request !1377 from Tinazhang/cc
5 years ago
mindspore-ci-bot
458436186c
!1365 Clean up work for text python sub-package
Merge pull request !1365 from h.farahat/text_namespace
5 years ago
Tinazhang
b390883c6a
Bug fix
6 years ago
ms_yan
d5e896b51c
delete storageDataset Op API and its test case
5 years ago
mindspore-ci-bot
6f733ec113
!1308 Stage 2 of adding support for string Tensor
Merge pull request !1308 from h.farahat/string_tensor2
5 years ago
hesham
6c21e556c4
Clean up work for text python package
5 years ago
heleiwang
599a449e0b
Support processing GNN data
6 years ago
hesham
df361d1d26
Change mem layout of string tensor
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
6 years ago
mindspore-ci-bot
58e6d7d950
!1341 Added lookup and vocab to mindspore.dataset.text
Merge pull request !1341 from ZiruiWu/vocab_and_lookup
6 years ago
mindspore-ci-bot
2e3d55ed87
!1281 Implementation of SplitOp
Merge pull request !1281 from Peilin/splitOp
6 years ago
Peilin Wang
71e8bb1960
general split case done, chaining sampler (basic case) is working
implementation 99% complete
everything and tested except for repeatable shuffling
tested most basic/typical split usecases
cleanup
some more cleanup
fix CI
more ci fix
more ci fixes
more ci fix
more ci fix
more ci fix
added more tests, fixed some bugs
some more clean up and test cases
added shard/shuffle before split warning/error
addressed code review comments and ci
fixed ci
6 years ago
Zirui Wu
25ab2ef303
Implemented lookup and vocab
6 years ago
mindspore-ci-bot
ba01949d8f
!1306 Adding warning to sync_wait usage
Merge pull request !1306 from EricZ/master
6 years ago
mindspore-ci-bot
65607a9d17
!1309 [Data]Modify Jieba path url And Add function comment for JiebTokenizer
Merge pull request !1309 from xulei/cppjieba0518
6 years ago
xulei2020
da8e095bd3
add jieba c++ code
6 years ago
qianlong
451c20a6f5
Add UnicodeCharTokenizer for nlp
6 years ago
eric
2383ef04de
Added warning message
6 years ago
xulei2020
163b6b7ea7
add jieba c++ code
6 years ago
ms_yan
33f3aee9da
repair format problem in concat op
6 years ago
jiangzhiwen
cb2814b498
flat_map first commit
6 years ago
mindspore-ci-bot
c680cfbf27
!1157 dataset: add concat operation for dataset
Merge pull request !1157 from ms_yan/concat_dataset
6 years ago
mindspore-ci-bot
ab031ee9ea
!1126 VOCDataset support object detection function
Merge pull request !1126 from xiefangqi/voc_support_detection
6 years ago
xiefangqi
c937bad53f
minddata support voc
6 years ago
ms_yan
c0fa7b4b19
init commit of concat dataset
change to use __add__ operation instead ds.concat
6 years ago
jonyguo
be2e7531ca
fix: MindDataset parameter shard_id & num_shards check
6 years ago
mindspore-ci-bot
d9b8e09baf
!1123 To fix GeneratorDataset numpy copy problem
Merge pull request !1123 from pengyanjun/generator_dataset_np_copy_problem
6 years ago
Yanjun Peng
4bf016e67f
fix generator dataset np copy problem
6 years ago
liyong
aa3f89e74f
mindrecord support read file list
6 years ago
mindspore-ci-bot
6c79c00a3f
!979 dataset: repair parameter check in rename Op
Merge pull request !979 from ms_yan/rename_columns
6 years ago
Zirui Wu
c2d364a573
batch with padding implemented
support for 1 specific dimension to be None, added validator
fix various CI complains
another round of CI fixes
ci
refactor parts of the code
code refactor
ci fix
comments added, fix bugs
address review comments
address review comments
review cmts
added simple perf test script
update pad code
perf imprv
6 years ago
mindspore-ci-bot
16930c562d
!969 [MD] fix bug in pk sampler of minddataset
Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler
6 years ago
ms_yan
d95a2e9ccf
repair num of input columns and output columns check
6 years ago
liyong
b520ca9087
fix pk sampler in mindrecord
6 years ago
panfengfeng
ee3be6823f
code format opt
6 years ago
eric
36fffb7706
Added example md5 generation
Comparison example
Added md5 and comparison example for py_transforms
Added md5 check for images
6 years ago
mindspore-ci-bot
a5374de0fe
!907 Terminate sub-process in python
Merge pull request !907 from yanghaitao/yht_python_multi_process
6 years ago
eric
26cb3e8a5f
Added test function to show that seed doesn't work.
Added testcase to show that c image aug don't use seed properly
Added passing test cases
Added working testcases for using seed
Added additional test cases to show seed use
Added test case for seed
6 years ago
yanghaitao
1e98fa35b8
Terminate python sub-process
6 years ago
mindspore-ci-bot
c880562ba9
!895 fix dataset comment format
Merge pull request !895 from panfengfeng/panff/fix_dataset_format
6 years ago
panfengfeng
36a935f701
fix dataset format
6 years ago
panfengfeng
76fda356f6
fix randomaffine error
6 years ago
panfengfeng
5e7cef7e3d
fix generatordataset check shuffle parameter
6 years ago
mindspore-ci-bot
8af10eb51e
!875 Reject python OP in operations argument for C++ uniform augmentation OP
Merge pull request !875 from AdelShafiei/ua_py
6 years ago
Adel Shafiei
d15bd04bfe
added input validation to reject python op in C++ uniform augmentation operations list
6 years ago