mindspore

Commit Graph

Author	SHA1	Message	Date
liyong	aa3f89e74f	mindrecord support read file list	5 years ago
Cathy Wong	49ef53f164	Cleanup dataset UT: util.py internals	5 years ago
mindspore-ci-bot	2860fd9338	!984 Add unit test case for HWC2CHW. Merge pull request !984 from Tinazhang/hwc2chw	5 years ago
Tinazhang	c8b5586c7f	add unit test for HWC2CHWC	5 years ago
Cathy Wong	58226addd6	Cleanup dataset UT: use md5 npz in test_zip for images	5 years ago
mindspore-ci-bot	47f5abceb4	!960 Adding example for grayscale Merge pull request !960 from EricZ/grayscale_fix	5 years ago
mindspore-ci-bot	078dd86cfe	!507 Implemented padded_batch Merge pull request !507 from ZiruiWu/batch_with_padding	5 years ago
mindspore-ci-bot	de7625777f	!951 fix: MindDataset with columns_name parameter cause errors in some scenes Merge pull request !951 from guozhijian/fix_read_by_columns	5 years ago
eric	0f0548f21b	Added test case for grayscale support	5 years ago
Zirui Wu	c2d364a573	batch with padding implemented support for 1 specific dimension to be None, added validator fix various CI complains another round of CI fixes ci refactor parts of the code code refactor ci fix comments added, fix bugs address review comments address review comments review cmts added simple perf test script update pad code perf imprv	5 years ago
jonyguo	d4d236bcce	fix: use MindDataset by column_names get data error in some situation	5 years ago
liyong	b520ca9087	fix pk sampler in mindrecord	5 years ago
Cathy Wong	772e6c1461	Cleanup dataset UT: test_batch, save_and_check support	5 years ago
eric	36fffb7706	Added example md5 generation Comparison example Added md5 and comparison example for py_transforms Added md5 check for images	5 years ago
Junhan Hu	83c68ca2ef	Skip pyfunc test case	5 years ago
eric	26cb3e8a5f	Added test function to show that seed doesn't work. Added testcase to show that c image aug don't use seed properly Added passing test cases Added working testcases for using seed Added additional test cases to show seed use Added test case for seed	5 years ago
ms_yan	c56fe3aa2d	modify take op with an operator	5 years ago
mindspore-ci-bot	8af10eb51e	!875 Reject python OP in operations argument for C++ uniform augmentation OP Merge pull request !875 from AdelShafiei/ua_py	5 years ago
Adel Shafiei	d15bd04bfe	added input validation to reject python op in C++ uniform augmentation operations list	5 years ago
mindspore-ci-bot	a606c2e4da	!872 [Dataset] Add schema support for GeneratorDataset Merge pull request !872 from JunhanHu/generator_schema	5 years ago
mindspore-ci-bot	2303453753	!869 Random data op Merge pull request !869 from JesseKLee/random_data_op	5 years ago
Junhan Hu	c5a8ffe4f4	Add schema support for GeneratorDataset	5 years ago
Jesse Lee	5236d0c3c0	Replace print with logger.info	5 years ago
mindspore-ci-bot	8d3695f666	!672 Added UT for uniform augmentation C++ OP Merge pull request !672 from AdelShafiei/ua_ut	5 years ago
Jesse Lee	270bf831a9	Random Data Op	5 years ago
jiangzhiwen	34bfa2f7c9	fix skip	5 years ago
Adel Shafiei	3322e65da9	added ut for uniform augment C++ op	5 years ago
mindspore-ci-bot	b37db1edf5	!603 [MD] update pk sampler in minddataset Merge pull request !603 from liyong126/update_pk_sampler	5 years ago
mindspore-ci-bot	f82e63fecc	!671 Added testcase for sync_wait Merge pull request !671 from EricZ/master	5 years ago
mindspore-ci-bot	0e3054d527	!466 Deepcopy problem when pyfunc cannot be pickled Merge pull request !466 from h.farahat/deepcopy	5 years ago
liyong	bfba630aa2	update pK_sampler	5 years ago
Zirui Wu	8c3931cf1d	fix first epoch always shuffle with default seed in random sampler fix ut	5 years ago
eric	2d115cd04e	Added example for multiple iterator Added new testcase for multi iterator Addressing review Fixed typo	5 years ago
hesham	a9e9266149	Deepcopy problem when pyfunc cannot be pickled	5 years ago
mindspore-ci-bot	aad5771a62	!524 Added support for UA augmentation ops with tests Merge pull request !524 from alashkari/ua-ops	5 years ago
Amir Lashkari	56e7a7deb5	Added UniformAugment + Python Augmentation Ops	5 years ago
mindspore-ci-bot	dc0491caf9	!508 [Dataset] Adding sync_wait operator for dataset Merge pull request !508 from EricZ/master	5 years ago
eric	cd94518769	X# This is a combination of 2 commits. Initial commit for dataset op python Added signature to barrier Adde compiling barrier code Rebasing, fixed new compile errors Final fix for make_unique Added pybind API for barrier Fixed pyfunc invocation python interface - sync_wait !1 sync_wait python interface * python interface - sync_wait fix test update test update test Added new test case add test case test for shuffle + batch Added two-sync test case Restrited that no shuffle after sync Added sync to pipeline info block first databuffer as well Intelligently get batch size Fix default case Lock Pair shares among all iterators Added fix for empty character Fixed up test case formatting Fix end of epoch in sync_wait Fixing CI	5 years ago
Junhan Hu	78001ac9e6	Add multiprocessing support for Mindspore.Dataset.GeneratorDataset	5 years ago
mindspore-ci-bot	fb18671b28	!506 [Dataset] Multiprocessing support for Pyfunc Merge pull request !506 from JunhanHu/multiprocess_pyfunc	5 years ago
Junhan Hu	b13e7bc31a	Add python multiprocessing support for Mindspore.dataset	5 years ago
qianlong	db80f4ff92	The num_samples and numRows in schema for TFRecordDataset are conflict	5 years ago
mindspore-ci-bot	d9e4dcc33b	!483 Optimize skip dataset op Merge pull request !483 from jiangzhiwen/dataset/skip_opt	5 years ago
liyong	f1542a90a3	add pk sampler	5 years ago
jiangzhiwen	e1b109e8b8	optimize skip dataset op	5 years ago
Cathy Wong	60df369100	Fixup py Normalize doc: takes input CHW	5 years ago
mindspore-ci-bot	6369cf27bd	!406 added first row crc check for when reading tfrecord files Merge pull request !406 from Peilin/first-row-crc-check	5 years ago
mindspore-ci-bot	98fbd30a5b	!460 [Data]Add filter operation Merge pull request !460 from xulei/filter_master	5 years ago
mindspore-ci-bot	822a3160e4	!404 [Dataset] Add Python Sampler support for CPP dataset Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset	5 years ago
xulei2020	c705ea5e5b	add filterOp code	5 years ago

1 2

76 Commits (aa3f89e74f16f6de1efc92b4ac7ae66f83b05652)