mindspore2022

Commit Graph

Author	SHA1	Message	Date
Jesse Lee	a0a863f20c	Stage 2 porting	5 years ago
ms_yan	e829535a86	change GetTensor into GetRow to avoid NullPtr	5 years ago
ms_yan	cf82aa9035	init remove storage op in c++ init remove storage op test case c++ remove source c++ files	5 years ago
Jesse Lee	dcfdff6021	Rename Sampler Reset	5 years ago
hesham	0c5e47111b	- Move MutableBuffer to be protected - Add new CreateTensors	5 years ago
Jesse Lee	255adf7c6e	Remove inheritance of Sampler from DatasetOp	5 years ago
Jamie Nisbet	51bc0c0460	consistent design for num_samples updates more update more work more fixin post rebase updates clang formatting code review recovery ci fixes updates update update update	5 years ago
Peilin Wang	3ef3d1433d	fixed num_samples bug for RandomSampler	5 years ago
Peilin Wang	d4c93575e7	fixed bug for split, RandomSampler and some other cleanup add another test case typo merge conflict another PR changed testing behavior, updated test cases in this commit added input check for use_sampler addressed code review comments fixed pylint, not related to my changes	5 years ago
hesham	df361d1d26	Change mem layout of string tensor add support for MindRecord and TFRecord ---- optimize tensorshape optimize tensorshape and FlatIndex TFRecord and MindRecord support for string tensor Modify mem layout Add new constructor Add method Allocate Change some GetMutableBuffer usages to AllocateBuffer	5 years ago
Peilin Wang	71e8bb1960	general split case done, chaining sampler (basic case) is working implementation 99% complete everything and tested except for repeatable shuffling tested most basic/typical split usecases cleanup some more cleanup fix CI more ci fix more ci fixes more ci fix more ci fix more ci fix added more tests, fixed some bugs some more clean up and test cases added shard/shuffle before split warning/error addressed code review comments and ci fixed ci	5 years ago
hesham	e8ca243364	-Add DE_STRING -replace switch'case by indexing - Add test case - Add constructors - Add getItem string - Fix bugs - Add more tests - Tensor iterator - asNumpy - TextFileDataset - Tensor(Numpy) - Super > 2D - Add more test cases for GeneratorDataset - Change StartAddr to GetBuffer and GetMutableNuffer - Raise an error if batch is used with strings Clean-up work	5 years ago
fary86	3f323e48e2	Add submodule id for log interface	6 years ago
Jamie Nisbet	7b7b2fa7a0	remove column name id map from data buffer clang format updates self-review cleanups cpplint fix review updates ci fixes	5 years ago
Zirui Wu	8c3931cf1d	fix first epoch always shuffle with default seed in random sampler fix ut	6 years ago
Junhan Hu	d0ae610832	Review	6 years ago
Junhan Hu	43a2e99833	Add python sampler support for CPP dataset	6 years ago
Junhan Hu	9739d3b048	Add CPP sampler support for GeneratorDataset	6 years ago
Alexey Shevlyakov	84d780c1a4	remove make_unique.h	6 years ago
zhunaipan	930a1fb0a8	initial version Signed-off-by: leonwanghui <leon.wanghui@huawei.com>	6 years ago

20 Commits (c94dea6a512eddb6cbe8b591268d82d7b9aa3209)