hesham
0ba0595caf
DatasetNode as a base for all IR nodes
5 years ago
Mahdi
5005b434e6
Fixed repeat issue with GetDatasetSize
5 years ago
Zirui Wu
4f882a81eb
revert the weighted_random_sampler change in pr7866
5 years ago
mindspore-ci-bot
cacebd1211
!7933 Cache performance updates
Merge pull request !7933 from Jamie/CacheOp_dev
5 years ago
mindspore-ci-bot
7ef7bef1d8
!7796 [MD] Enable C++ cache api for non-mappable datasets
Merge pull request !7796 from lixiachen/cache_c_api_nonmappable
5 years ago
Lixia Chen
572c5e5f29
Rebase up to 542a52fbf8
5 years ago
YangLuo
dfd9df577d
[MD] code review
5 years ago
mindspore-ci-bot
8f44074796
!7866 [MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer
Merge pull request !7866 from luoyang/c-api-pyfunc
5 years ago
luoyang
52d278e858
[MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer
5 years ago
Zirui Wu
814044963b
add validation check in tfrecord_node
update ut
5 years ago
Zirui Wu
ea97197311
fix tfrecord_op core dump
add test case
fix ci
fix ci round 2
address review cmts
5 years ago
mindspore-ci-bot
c39c3ccfbe
!7734 Redesigned GetNumClasses
Merge pull request !7734 from Alex Yuyue/IR_dataset_input
5 years ago
mindspore-ci-bot
163544795f
!7922 add params check for offset in distributed_sampler
Merge pull request !7922 from xiaotianci/fix_distributed_sampler
5 years ago
mindspore-ci-bot
b93264d323
!7832 Modify profiling file mode to 600
Merge pull request !7832 from yanghaitao/yht_modify_profile_file_mode
5 years ago
Xiao Tianci
823e52f1dc
add params checking of offset in distributed_sampler
add related comment to explain
add related UT
5 years ago
Lixia Chen
02ddddfe7e
Enable caching over non-mappable dataset c++ api
and caching over Album dataset
5 years ago
yanghaitao1
a5da6fcd56
modify file mode after profiling finished
5 years ago
mindspore-ci-bot
75609c8612
!7876 Validate the DatasetNode before building it in TreeAdapter
Merge pull request !7876 from ZiruiWu/validate_in_tree_adatper
5 years ago
Zirui Wu
41facc168c
validate param added during tree prepare
5 years ago
alex-yuyue
913a49f3af
Add support for C++ API: GetNumClasses
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
Xiao Tianci
9649efb98a
remove redundant root()
5 years ago
Eric
5c37b95992
Added Crop, need decode.
Added decode for source operators
Partial lite build fix
Only crop op enabled
Removed opencv from mdlite "full" build
Adding tests
disabling tests for now, compiling
Halfway done adding normalize
Log linking failed for lite
Added normalize, and resize
Addressing comments part 1
Added CI fix part 1
Added CI fix part 2
added CI fix part 3
Added CI fix part 4
can't remove long
Removed open cv build completely
Removed packaging code for open cv
Disable lint check for C type
Fix CI issues part five
5 years ago
mindspore-ci-bot
3376e0d034
!7704 [MD] Add testcases for cache c api
Merge pull request !7704 from lixiachen/cache_c_api
5 years ago
mindspore-ci-bot
d81bd7b17b
!7710 Add c++ API for GetRepeatCount and GetBatchSize
Merge pull request !7710 from h.farahat/getBatchRepeat
5 years ago
mindspore-ci-bot
7982f05038
!7730 [MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
Merge pull request !7730 from luoyang/c-api-pyfunc
5 years ago
luoyang
f0e976dbda
[MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
5 years ago
hesham
f3880f8355
Add GetBatchSizer and GetRepeatCount to c++ API
5 years ago
Xiao Tianci
7b1b457ccf
c++ api add DeviceQueue
5 years ago
mindspore-ci-bot
3d194137da
!7702 Redesigned GetOutputType and GetOutputShape
Merge pull request !7702 from Alex Yuyue/IR_dataset_input
5 years ago
alex-yuyue
2906659673
Add support for GetOutputTypes and GetOutputShapes
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
shenwei41
3108595885
Add SyncWaitNode class
5 years ago
mindspore-ci-bot
fe2852df82
!7703 C++ API: Add a parameter validation and fix incorrect format of error message for TFrecord
Merge pull request !7703 from TinaMengtingZhang/fix_tfrecord_issue_I1YKU6_I1YKXL
5 years ago
mindspore-ci-bot
7b98e611dd
!7705 Resolved BucketBatchByLength duplicate column name problem
Merge pull request !7705 from MahdiRahmaniHanzaki/bucket-batch-duplicate-column
5 years ago
Lixia Chen
bc396febae
Add testcases for cache c api
5 years ago
tinazhang
e7346dd3a9
add a validation code to fix issue I1YKU6 and corresponded ut, fix format issue I1YKXL
5 years ago
Mahdi
0e03f5b0dd
Added GetDatasetSize
5 years ago
Mahdi
94e916b0c2
Fixed duplicate column problem in BucketBatchByLength
5 years ago
Cathy Wong
051bc60edb
C++ API: ValidateParams support for TensorOps; plus minor dataset fixes
5 years ago
mindspore-ci-bot
3355bb5f2f
!7657 Leaf node IR breakdown, port to engine/ir/datasetops/source/
Merge pull request !7657 from ZiruiWu/ir_breakdown_leaf_nodes
5 years ago
mindspore-ci-bot
de4da6457e
!7650 modify variable type from int to int32_t
Merge pull request !7650 from anzhengqi/fixed-variable-type
5 years ago
mindspore-ci-bot
9d35fdc4e5
!7653 [MD] C++ api SaveOp
Merge pull request !7653 from luoyang/c-api-pyfunc
5 years ago
Zirui Wu
cfc50e231a
Added IR breakdown for remaining ops after PR7596
fix android build failure
fix include in datasets.cc
attempting fix android build
fix complie err x86
5 years ago
luoyang
8e60cfe800
[MD] C++ api save
5 years ago
hesham
c94162ac94
Add c++ API for dataset Caching
5 years ago
anzhengqi
516c53f1f0
modify int as int32_t
5 years ago
mindspore-ci-bot
45913d0682
!7591 fix stuck problem when using sink_size.
Merge pull request !7591 from anzhengqi/I1YI87-fix-sink_size-stuck
5 years ago
mindspore-ci-bot
e09e154391
!7596 IR breakdown for 8 non-leaf nodes (except MapOp)
Merge pull request !7596 from ZiruiWu/ir_breakdown_non_leaf
5 years ago
mindspore-ci-bot
49f02bfbed
!7564 [MD]Fix Type Convert error in arm32
Merge pull request !7564 from xulei/cmake
5 years ago
Zirui Wu
d471552fc5
shuffle take repeat bucketbatch buildvocab repeat shuffle take project concat rename node IR added
concat, bucketbatch project rename
fix ci round 1
fix ci round 2
fix up
fix ci
5 years ago
mindspore-ci-bot
629a0f1e8d
!7594 Add Generator IR for mindspore::dataset::GeneratorOp
Merge pull request !7594 from ZiruiWu/generator_ir
5 years ago