fary86
3f323e48e2
Add submodule id for log interface
6 years ago
Jamie Nisbet
7b7b2fa7a0
remove column name id map from data buffer
clang format updates
self-review cleanups
cpplint fix
review updates
ci fixes
6 years ago
jonyguo
cf352d190f
format func name for mindrecord
6 years ago
jonyguo
d4d236bcce
fix: use MindDataset by column_names get data error in some situation
6 years ago
caifubi
cb70daa355
format code
6 years ago
mindspore-ci-bot
2303453753
!869 Random data op
Merge pull request !869 from JesseKLee/random_data_op
6 years ago
Jesse Lee
270bf831a9
Random Data Op
6 years ago
mindspore-ci-bot
323ea9d869
!830 Update the print methods for displaying execution tree info diagnostics
Merge pull request !830 from Jamie/operator_print
6 years ago
Jamie Nisbet
2facd80c8d
updated print functions for info diagnostics
fix some ci failures
more ci fixes
more ci fails
yet another ci fail
more ci stuff
still ci
more ci
more ci
more ci
6 years ago
Jesse Lee
332398d20a
Check return code from WaitPost::Register
6 years ago
mindspore-ci-bot
3ec19ca9d3
!793 More understandable error msg when number of rows is zero
Merge pull request !793 from yanghaitao/yht_err_msg_num_rows_zero
6 years ago
yanghaitao
eb60ef00d1
More understandable err msg when num rows is zero
6 years ago
mindspore-ci-bot
c47ef8ee4e
!711 Address first epoch always shuffle with same seed init of random sampler
Merge pull request !711 from ZiruiWu/mindspore_master_only
6 years ago
mindspore-ci-bot
e6473f0765
!736 Skip blank line for TextFileDataset
Merge pull request !736 from yanghaitao/yht_tftextfile_black_line
6 years ago
yanghaitao
1cb3bead32
skip black line for TextFileDataset
6 years ago
Zirui Wu
8c3931cf1d
fix first epoch always shuffle with default seed in random sampler
fix ut
6 years ago
zhoufeng
b681cec8f2
cmake refactor
6 years ago
qianlong
db80f4ff92
The num_samples and numRows in schema for TFRecordDataset are conflict
6 years ago
liyong
f1542a90a3
add pk sampler
6 years ago
mindspore-ci-bot
6369cf27bd
!406 added first row crc check for when reading tfrecord files
Merge pull request !406 from Peilin/first-row-crc-check
6 years ago
mindspore-ci-bot
822a3160e4
!404 [Dataset] Add Python Sampler support for CPP dataset
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
6 years ago
Peilin Wang
9bc2134cb7
added checking of first row crc to find invalid tfrecord files
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file
fixed clang format
fixed cppcheck
fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before
fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments
more clang whitespace fixes...
changed print to logger.info
6 years ago
yanghaitao
2795e492ff
TextFileDataset
6 years ago
Junhan Hu
d0ae610832
Review
6 years ago
Junhan Hu
43a2e99833
Add python sampler support for CPP dataset
6 years ago
Junhan Hu
9739d3b048
Add CPP sampler support for GeneratorDataset
6 years ago
mindspore-ci-bot
d9cd681c30
!207 Fix potential overflow in batch by changing int32 to int64
Merge pull request !207 from ZiruiWu/batch_info_overflow
6 years ago
dengwentao
b5ca2a3e30
:modify protobuf cmake
6 years ago
Zirui Wu
19f2ea6d41
change int32 to int64 to avoid overflow in batch
fix clang
pybind fix
6 years ago
mindspore-ci-bot
cc75cb357c
!168 remove mindspore::make_unique and make_unique.h
Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique
6 years ago
jonyguo
20d1b64443
fix: error info is not exactly when column list invalid
6 years ago
Jonathan Yan
9d0fde29f4
remove ENABLE_MINDRECORD flag
6 years ago
Alexey Shevlyakov
84d780c1a4
remove make_unique.h
6 years ago
Peilin Wang
0ae77bb0db
TFReaderOp fix, threads will exit after reading necessary amount of rows
changes from yanpanhui 524009: added set_dataset_size and changed get_dataest_size according to ME requirements
CI fixes
6 years ago
zhunaipan
930a1fb0a8
initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
6 years ago