jonyguo
6df1a43ec2
fix: padded dataset with non div & repeat
5 years ago
Eric
c79db93c48
Initial commit for album
Added linter fix for album dataset
Added testDataset
Adding signature
Added JsonDataset example API
Example dataset
Resolving format
More fixing
Refactor
Small fix
Added compiling album dataset
Running tests
Added linter fix #1
Passing UT
Added dataset API
Addressing clang
Clang part 2
Fixing pass
Fixed tree check
lint fix
Added lint fix part 2
5 years ago
mindspore-ci-bot
9d7250c483
!4776 Introduce 2 extra ctrl flags to DataBuffer in dataset, address remaining cmts to PR4632
Merge pull request !4776 from ZiruiWu/map_callback_follow_up
5 years ago
Zirui Wu
74c1e6da60
introducing pause and quit flags to DataBuffer
fix review cmts
fix ci
fix Ci
fixci
address ci
ci
- add timeout
- add more test cases
fix CI
address review cmts
5 years ago
mindspore-ci-bot
82c888f065
!4930 Fix CI cifar hang issue
Merge pull request !4930 from xiefangqi/fix_cifar_nofile_issue
5 years ago
xiefangqi
e3e7820413
fix cifar stuck problem
5 years ago
zhoufeng
22ec976ef7
fix compilation warnings
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
5 years ago
limingqi107
5b76e8f3d7
gpu add format transform pass
5 years ago
Jesse Lee
8a08d0c37b
Phase 2 of CacheOp
5 years ago
Zirui Wu
78c1aa1d96
Implemented Callback for Dataset
implment pause in MapOp, added more to callback
add ds_callback
- Initial drop of Python DSCallback
- Pybind DSCallback
- Pybind DSCallback
added callback to mapOp
- de_pipeline DSCallback
- de_pipeline DSCallback
add test case, segfault for now
fix seg fault
- de_pipeline DSCallback
remove 1 line
update callback test case, now works
use builder class for mapOp callback
- de_pipeline DSCallback
- de_pipeline DSCallback
- de_pipeline DSCallback
better test case
minor fix
add comments and minor clean ups
get rid of nullptr in MapOp, use other flag instead
fix a bug ParseMapOp only takes 1 callback
- Added WaitedDSCalabck
refactor callback param
fix text case incorrect number
- added testing
fix cpp test case
- added testing
- revert back lenet changes
- cleanup test_callbacks.py
- cleanup test_callbacks.py
fix CI stage I
fix CI stage II
fix CI and update epoch counter
- add validation
- add more testing test_callbacks.py
use random data op to do tests
adjust when to call EpochBegin/End
- add repeat with callback
- addressing reviewers' comments
- docstring and CI fixes
- docstring and CI fixes
- docstring and CI fixes
- rebase with upstream/master
fix cpp test case
fix review comments
addr review cmts, add test case
5 years ago
mindspore-ci-bot
cda930f9e4
!4759 Fix duplicate column names of CSV Dataset
Merge pull request !4759 from jiangzhiwen/dataset/fix_duplicate_column_names
5 years ago
jiangzhiwen
74be92d698
fix duplicate column names
5 years ago
mindspore-ci-bot
0fa0cd7bfe
!4710 Fix tfreader multi-thread issue
Merge pull request !4710 from xiefangqi/xfq_fix_tfreader_issue
5 years ago
mindspore-ci-bot
6868b9b6fa
!4422 Minddata new dataset api ==> RandomData
Merge pull request !4422 from xiefangqi/xfq_c++api_randomdata
5 years ago
xiefangqi
8e0a7bfbd3
fix tfreader WaitPost register failed
5 years ago
mindspore-ci-bot
58523a41fe
!4392 use builtin float16 for arm
Merge pull request !4392 from xychow/use-float16-in-arm-neon
5 years ago
xiefangqi
b91e56375e
add randomdataset and schema
5 years ago
mindspore-ci-bot
026ed2b803
!4638 fix core when use weighted_random_sampler
Merge pull request !4638 from yanghaitao/yht_fix_weighted_sampler
5 years ago
mindspore-ci-bot
b681ef5fc6
!4625 fix tf_read_op issue
Merge pull request !4625 from xiefangqi/fix_tfrecord_issue
5 years ago
xiefangqi
0355de9ab2
fix tfrecord issue
5 years ago
yanghaitao
6cf0c29461
fix weighted random sampler core
5 years ago
zhousiyi
e1aa49a4b7
use built-in float16 in arm_neon.h for lite arm
5 years ago
genglishuai
4d4df68d1e
add DistributedSampler for Concat op
5 years ago
mindspore-ci-bot
9cc1ca1a19
!3753 CSV dataset reading a file that begins with a blank line will crash
Merge pull request !3753 from jiangzhiwen/dataset/csv_fix_blank_line_header
5 years ago
jiangzhiwen
4673de9f96
fix blank line at header
5 years ago
jiangzhiwen
5842a0212f
c++ api support for CLUE Dataset
5 years ago
mindspore-ci-bot
e19d382473
!3346 Maintain epoch/repeat count for ops
Merge pull request !3346 from lixiachen/repeat_rework
5 years ago
Lixia Chen
ac85b77b76
Maintain epoch/repeat count for ops
5 years ago
mindspore-ci-bot
57fd31b221
!4029 CSV dataset's rows counting adapts the eof of Euler OS
Merge pull request !4029 from jiangzhiwen/dataset/adapt_eof_fix
5 years ago
jiangzhiwen
1125c71776
count rows function adapt euler eof
5 years ago
nhussain
ed4d4107ca
change print structure
5 years ago
mindspore-ci-bot
52689a7dcf
!3938 decoupling core and context
Merge pull request !3938 from liubuyu/master
5 years ago
liubuyu
d81862a916
decoupling core and context
5 years ago
xiefangqi
d315dad732
fix another range id problem on e2e testcases
5 years ago
mindspore-ci-bot
ebda55506e
!3716 Adapt the eof of Euler OS
Merge pull request !3716 from jiangzhiwen/dataset/adapt_eof
5 years ago
jiangzhiwen
471ecfcaae
adapt euler eof
5 years ago
Eric
8c018da468
Fixing issues in distributed sampler
Added Distributed sampler option
Fix style
5 years ago
mindspore-ci-bot
634d797ca3
!3549 MapOp refactor for device augmentation (part 1)
Merge pull request !3549 from anthonyaje/device_augment_mapop_refactor1
5 years ago
dengyutao
388e43f7cb
delete parameter block_reader for MindDataset
5 years ago
jiangzhiwen
1eda0ef071
change num_samples definition
5 years ago
mindspore-ci-bot
d06da1d270
!3603 Check that the number columns of names and default matches
Merge pull request !3603 from jiangzhiwen/fix_column_names_exceeded
5 years ago
jiangzhiwen
2cc6b5cb52
fix number of columns not match
5 years ago
anthonyaje
a7eaf2736a
First drop of MapOp refactor to support device augment.
Refactored MapOp to in preparation to support device augment
Minor fix
5 years ago
mindspore-ci-bot
b6c7273bb6
!3551 [MD] Fix Broken C++ Only Build
Merge pull request !3551 from nhussain/fix_cpp_only_build
5 years ago
guansongsong
620d951e5e
Merge branch 'ql/fix_cache_core' of https://gitee.com/qianlong21st/mindspore into ql/fix_cache_core
5 years ago
nhussain
b65125b0a1
add more ifdef and include statments for pybind
5 years ago
mindspore-ci-bot
84c8b85ddc
!3452 [MD] Gets rid of uncessary print calls
Merge pull request !3452 from nhussain/refactor_name_function
5 years ago
mindspore-ci-bot
9c06a564d1
!2983 Dataset Tensor class cleanup
Merge pull request !2983 from h.farahat/tensor_class
5 years ago
mindspore-ci-bot
7ac8c2df8a
!3395 Remove crutch and fix memory leak
Merge pull request !3395 from Alexey_Shevlyakov/remove_windows_define
5 years ago
qianlong
bf87b1d1fb
fix cache op core dump
5 years ago