mindspore2022

Commit Graph

Author	SHA1	Message	Date
mindspore-ci-bot	c47ef8ee4e	!711 Address first epoch always shuffle with same seed init of random sampler Merge pull request !711 from ZiruiWu/mindspore_master_only	5 years ago
mindspore-ci-bot	e6473f0765	!736 Skip blank line for TextFileDataset Merge pull request !736 from yanghaitao/yht_tftextfile_black_line	5 years ago
yanghaitao	1cb3bead32	skip black line for TextFileDataset	5 years ago
Zirui Wu	8c3931cf1d	fix first epoch always shuffle with default seed in random sampler fix ut	5 years ago
zhoufeng	b681cec8f2	cmake refactor	5 years ago
qianlong	db80f4ff92	The num_samples and numRows in schema for TFRecordDataset are conflict	6 years ago
liyong	f1542a90a3	add pk sampler	6 years ago
mindspore-ci-bot	6369cf27bd	!406 added first row crc check for when reading tfrecord files Merge pull request !406 from Peilin/first-row-crc-check	6 years ago
mindspore-ci-bot	822a3160e4	!404 [Dataset] Add Python Sampler support for CPP dataset Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset	6 years ago
Peilin Wang	9bc2134cb7	added checking of first row crc to find invalid tfrecord files addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file fixed clang format fixed cppcheck fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments more clang whitespace fixes... changed print to logger.info	6 years ago
yanghaitao	2795e492ff	TextFileDataset	6 years ago
Junhan Hu	d0ae610832	Review	6 years ago
Junhan Hu	43a2e99833	Add python sampler support for CPP dataset	6 years ago
Junhan Hu	9739d3b048	Add CPP sampler support for GeneratorDataset	6 years ago
mindspore-ci-bot	d9cd681c30	!207 Fix potential overflow in batch by changing int32 to int64 Merge pull request !207 from ZiruiWu/batch_info_overflow	6 years ago
dengwentao	b5ca2a3e30	:modify protobuf cmake	6 years ago
Zirui Wu	19f2ea6d41	change int32 to int64 to avoid overflow in batch fix clang pybind fix	6 years ago
mindspore-ci-bot	cc75cb357c	!168 remove mindspore::make_unique and make_unique.h Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique	6 years ago
jonyguo	20d1b64443	fix: error info is not exactly when column list invalid	6 years ago
Jonathan Yan	9d0fde29f4	remove ENABLE_MINDRECORD flag	6 years ago
Alexey Shevlyakov	84d780c1a4	remove make_unique.h	6 years ago
Peilin Wang	0ae77bb0db	TFReaderOp fix, threads will exit after reading necessary amount of rows changes from yanpanhui 524009: added set_dataset_size and changed get_dataest_size according to ME requirements CI fixes	6 years ago
zhunaipan	930a1fb0a8	initial version Signed-off-by: leonwanghui <leon.wanghui@huawei.com>	6 years ago

23 Commits (a8d81c8b7bf9d54ae66ce8cab15836610e624724)