luoyang
f0e976dbda
[MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
5 years ago
Cathy Wong
e971a3aed9
dataset API docstring: Update datasets.py and config.py
5 years ago
Cathy Wong
f7adf648e9
dataset API docstring: Update datasets, samplers, graphdata and text
5 years ago
nhussain
3bac9d3713
switch input columns and operation
change ImagefolderDV2 name
change ds.transforms.vision to ds.vision
change batch api to match map api more closely
compose op changes
test_pylint
remove compose op from vision, move to transform module, refactor map and batch to use column_order
5 years ago
nhussain
eb9a611041
remove old defaults
5 years ago
genglishuai
4d4df68d1e
add DistributedSampler for Concat op
5 years ago
liyong
7341421d3b
fix num samples in pk sampler
5 years ago
liyong
e2ea1fa0df
activate num_samples in distributed samplers
5 years ago
YangLuo
4e3bfcf4c9
!2306 [Dataset] Code review & improve quality
5 years ago
mindspore-ci-bot
d7d094e1c5
!2231 fix report error in get_dataset_size
Merge pull request !2231 from yanghaitao/yht_get_num_samples
5 years ago
yanghaitao1
94cebe4d53
fix sampler get_num_samples
5 years ago
liyong
d4f8f57c7e
add split in minddataset
5 years ago
mindspore-ci-bot
9282b9473d
!2059 fix SubsetSampler error
Merge pull request !2059 from yanghaitao/yht_fix_subset_samplers
5 years ago
yanghaitao
5b0fb71343
fix SubsetSampler
5 years ago
mindspore-ci-bot
a3ab142f1c
!2042 fix document api error
Merge pull request !2042 from yanghaitao/yht_fix_api_document
5 years ago
yanghaitao
c12ffc1e90
fix api document
5 years ago
yanghaitao
8f16cff12e
add para check for sampler
5 years ago
yanghaitao
9c2a72c55e
check if num_samples is 0 in sampler
5 years ago
Jamie Nisbet
51bc0c0460
consistent design for num_samples
updates
more update
more work
more fixin
post rebase updates
clang formatting
code review recovery
ci fixes
updates
update
update
update
6 years ago
yanghaitao
2e3e31de90
fix subsetrandomsampler
5 years ago
Peilin Wang
d4c93575e7
fixed bug for split, RandomSampler and some other cleanup
add another test case
typo
merge conflict
another PR changed testing behavior, updated test cases in this commit
added input check for use_sampler
addressed code review comments
fixed pylint, not related to my changes
6 years ago
Peilin Wang
71e8bb1960
general split case done, chaining sampler (basic case) is working
implementation 99% complete
everything and tested except for repeatable shuffling
tested most basic/typical split usecases
cleanup
some more cleanup
fix CI
more ci fix
more ci fixes
more ci fix
more ci fix
more ci fix
added more tests, fixed some bugs
some more clean up and test cases
added shard/shuffle before split warning/error
addressed code review comments and ci
fixed ci
6 years ago
Junhan Hu
1e904ddcee
Fix CI warning of samplers.py
6 years ago
liyong
bfba630aa2
update pK_sampler
6 years ago
liyong
f1542a90a3
add pk sampler
6 years ago
Junhan Hu
43a2e99833
Add python sampler support for CPP dataset
6 years ago
Yanjun Peng
c69f3be758
fix dataset api description
6 years ago
Junhan Hu
9739d3b048
Add CPP sampler support for GeneratorDataset
6 years ago
liyong
0ce83e39e1
fix TestShardSampleWrongNumber
adjust internal api
6 years ago
Yanjun Peng
363632ca9d
fix dataset para validator check
6 years ago
zhunaipan
930a1fb0a8
initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
6 years ago