Zirui Wu
78c1aa1d96
Implemented Callback for Dataset
implment pause in MapOp, added more to callback
add ds_callback
- Initial drop of Python DSCallback
- Pybind DSCallback
- Pybind DSCallback
added callback to mapOp
- de_pipeline DSCallback
- de_pipeline DSCallback
add test case, segfault for now
fix seg fault
- de_pipeline DSCallback
remove 1 line
update callback test case, now works
use builder class for mapOp callback
- de_pipeline DSCallback
- de_pipeline DSCallback
- de_pipeline DSCallback
better test case
minor fix
add comments and minor clean ups
get rid of nullptr in MapOp, use other flag instead
fix a bug ParseMapOp only takes 1 callback
- Added WaitedDSCalabck
refactor callback param
fix text case incorrect number
- added testing
fix cpp test case
- added testing
- revert back lenet changes
- cleanup test_callbacks.py
- cleanup test_callbacks.py
fix CI stage I
fix CI stage II
fix CI and update epoch counter
- add validation
- add more testing test_callbacks.py
use random data op to do tests
adjust when to call EpochBegin/End
- add repeat with callback
- addressing reviewers' comments
- docstring and CI fixes
- docstring and CI fixes
- docstring and CI fixes
- rebase with upstream/master
fix cpp test case
fix review comments
addr review cmts, add test case
5 years ago
Eric
d799373950
Added created from memory
5 years ago
YangLuo
b50ae27c72
!4597 [Dataset] C++ API Support for build_vocab
5 years ago
nhussain
eb9a611041
remove old defaults
5 years ago
mindspore-ci-bot
cda930f9e4
!4759 Fix duplicate column names of CSV Dataset
Merge pull request !4759 from jiangzhiwen/dataset/fix_duplicate_column_names
5 years ago
jiangzhiwen
74be92d698
fix duplicate column names
5 years ago
mindspore-ci-bot
d541e261a0
!4696 C++ API Support for CSV Dataset
Merge pull request !4696 from jiangzhiwen/jzw/c_api_csv
5 years ago
mindspore-ci-bot
0fa0cd7bfe
!4710 Fix tfreader multi-thread issue
Merge pull request !4710 from xiefangqi/xfq_fix_tfreader_issue
5 years ago
mindspore-ci-bot
256dccc651
!4498 Gnn data processing supports distributed scenarios
Merge pull request !4498 from heleiwang/gnn_distributed
5 years ago
jiangzhiwen
39df25f803
c++ api for CSV Dataset
5 years ago
heleiwang
8ee4d8e92d
Gnn data processing supports distributed scenarios
5 years ago
mindspore-ci-bot
6868b9b6fa
!4422 Minddata new dataset api ==> RandomData
Merge pull request !4422 from xiefangqi/xfq_c++api_randomdata
5 years ago
xiefangqi
8e0a7bfbd3
fix tfreader WaitPost register failed
5 years ago
mindspore-ci-bot
58523a41fe
!4392 use builtin float16 for arm
Merge pull request !4392 from xychow/use-float16-in-arm-neon
5 years ago
xiefangqi
b91e56375e
add randomdataset and schema
5 years ago
nhussain
738ae2c78d
change api to use std_vector
try to display image
5 years ago
islam_amin
979111d0ef
Added Posterize Op
5 years ago
mindspore-ci-bot
883957ace5
!4676 Add DecodeOp c++ parameter validate
Merge pull request !4676 from xiefangqi/xfq_fix_decode_twice
5 years ago
xiefangqi
a8cc48c6b8
Add decodeOp validate
5 years ago
qianlong
aab95ea160
fix softdvpp python api doc
5 years ago
mindspore-ci-bot
026ed2b803
!4638 fix core when use weighted_random_sampler
Merge pull request !4638 from yanghaitao/yht_fix_weighted_sampler
5 years ago
jiangzhiwen
a88273bd3f
c++ api support for Manifest Dataset
5 years ago
mindspore-ci-bot
b681ef5fc6
!4625 fix tf_read_op issue
Merge pull request !4625 from xiefangqi/fix_tfrecord_issue
5 years ago
mindspore-ci-bot
cc23f1d819
!4630 Adding wrapper around CreateFromMemory
Merge pull request !4630 from EricZ/md_tensor_from_mem
5 years ago
mindspore-ci-bot
113ff6ca24
!4367 CutMixBatch Augmentation Op
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
5 years ago
Eric
26d968afcb
Added created from memory
5 years ago
mahdi
3ecc53fb4e
Added CutMix
5 years ago
xiefangqi
0355de9ab2
fix tfrecord issue
5 years ago
yanghaitao
6cf0c29461
fix weighted random sampler core
5 years ago
mayang
c410c6a6e2
soft_dvpp_decode_resize_jpeg_op issue resolved, input size can be an int, break the constraints of input size being sequence (height, width)
5 years ago
zhousiyi
e1aa49a4b7
use built-in float16 in arm_neon.h for lite arm
5 years ago
Cathy Wong
9c8af0d1cf
C++ API: Provide validate param functions
5 years ago
mindspore-ci-bot
7d70fb4dc4
!3769 add RandomColorOp
Merge pull request !3769 from Alexey_Shevlyakov/ColorOp
5 years ago
mindspore-ci-bot
ebdea65f70
!4402 [Dataset] Fix c_api bugs
Merge pull request !4402 from luoyang/c-api-pyfunc
5 years ago
Alexey Shevlyakov
8526d5414d
RandomColor
5 years ago
Cathy Wong
b575b913e2
C++ API: Provide AddShuffleOp
Shuffle: shuffle_size -> buffer_size
5 years ago
mindspore-ci-bot
2953720169
!4322 Adding RGBA color conversion
Merge pull request !4322 from EricZ/bitmap_support
5 years ago
mindspore-ci-bot
7a10e07fc6
!4383 Add distributedSampler to concatOP
Merge pull request !4383 from genglishuai/genglshOK
5 years ago
eric
6a41b44724
Added wrapper around color change function
5 years ago
genglishuai
4d4df68d1e
add DistributedSampler for Concat op
5 years ago
luoyang
373adaa553
!4402 [Dataset] Fix c_api bugs
5 years ago
mindspore-ci-bot
ed1244558c
!4366 Fixing param type in c++ api and fixing python validator for Repeat Op
Merge pull request !4366 from TinaMengtingZhang/cpp-api-repeat-count
5 years ago
mindspore-ci-bot
9cc1ca1a19
!3753 CSV dataset reading a file that begins with a blank line will crash
Merge pull request !3753 from jiangzhiwen/dataset/csv_fix_blank_line_header
5 years ago
jiangzhiwen
4673de9f96
fix blank line at header
5 years ago
tinazhang
0868720eb7
fix parameter type for repeat op in c++ api and added c++/python ut.
5 years ago
shenwei41
6913c96f11
Alarm modification
5 years ago
mindspore-ci-bot
5adba834d0
!3819 C++ API Support for CLUE Dataset
Merge pull request !3819 from jiangzhiwen/jzw/c_api_clue
5 years ago
jiangzhiwen
5842a0212f
c++ api support for CLUE Dataset
5 years ago
mindspore-ci-bot
2905fb8c64
!4311 Fix minddata monitoring
Merge pull request !4311 from anthonyaje/monitor_fix
5 years ago
mindspore-ci-bot
9276a9d2fb
!3771 C++ API Support for TextFile Dataset
Merge pull request !3771 from cathwong/ckw_c_api_textfile_nosampler
5 years ago