liyong
2172934177
fix doc issue2
4 years ago
jonyguo
b8205ee995
add testcase
4 years ago
liyong
3191160eca
fix some issue
4 years ago
yanghaoran
c44de68591
takedown test_datasets_generator to ensure gate stability
4 years ago
jonyguo
4378014ffb
fix: when return numpy in GeneratorDataset
4 years ago
ms_yan
192983b5da
check operator mixed or not
4 years ago
xiefangqi
f74b5cea0c
optimize datasetops error msg
4 years ago
jonyguo
58c9112c2e
fix: generator dataset with source zip
4 years ago
RobinGrosman
c90efc0403
add check for shm available when num_devices=1 to avoid bus errors
-Required modifying tests to reduce memory usage to check doesn't fail during CI
-Also required fixing max_rowsize to be externalized from map+batch() function
4 years ago
hetshah
2c1666fd06
set num epochs for iterators that use the default value
add explicit paramter for infinite iterators
set appropriate value for num_epoch param for iteratos
fix long lines
remove trailing whitespace
fixed typo
remove comment
fixed comments
fixed test
4 years ago
jonyguo
c408867085
fix: hung when user return Tensor in generator
4 years ago
xiefangqi
57f68d35bd
fix generator 14 ut problem
4 years ago
YangLuo
17c121b087
Give concreted error when mappable dataset lack __len__ method
4 years ago
ms_yan
be65ebcb28
complete dataset log
4 years ago
RobinGrosman
ca88d7d76a
fix edge case and docstring in minddata multiprocessing shared memory code
4 years ago
RobinGrosman
9a7d1fc034
Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue
4 years ago
hesham
58193bc469
User explicit deepcopy
5 years ago
ms_yan
0cb5c47856
add err modify
5 years ago
YangLuo
f5a85510f2
[MD] dataset op log changes
5 years ago
xiefangqi
9b3c33e157
minddata iterator output ms_tensor
5 years ago
nhussain
92e99ff224
change map calls
5 years ago
nhussain
3bac9d3713
switch input columns and operation
change ImagefolderDV2 name
change ds.transforms.vision to ds.vision
change batch api to match map api more closely
compose op changes
test_pylint
remove compose op from vision, move to transform module, refactor map and batch to use column_order
5 years ago
Lixia Chen
27d5281641
Change epoch count to 1 for python testcases
5 years ago
anzhengqi
3e31ac6d62
all Dataset support get_dataset_size
5 years ago
tony_liu2
269b477684
use np.testing.assert instead of asserting
fix line lengths
fix spacing
reverse a few changes
5 years ago
Cathy Wong
04eb4f89c7
Cleanup dataset UT: Replace save_and_check
5 years ago