liyong
79891feadb
fix shuffle and num_samples issue
4 years ago
ms_yan
fe36c57961
msadd example for common used Api
4 years ago
xiefangqi
d6a6a5c6f8
fix dataset api comments
4 years ago
YangLuo
465d956661
Fix docs
4 years ago
shenwei41
19436375d8
update API of sampler
4 years ago
mohammad
e9d358c30e
fix file_need_clean master
4 years ago
Zirui Wu
f31d9b3a2d
fix CI
fix CI
4 years ago
jonyguo
9452142b50
enhance: enable shuffle infile / files when mindrecord
5 years ago
mindspore-ci-bot
0cfd8b7c9e
!13364 Add WordpieceTokenizer and AddDict to Jieba
From: @alexyuyue
Reviewed-by:
Signed-off-by:
5 years ago
alex-yuyue
2d6d608fae
Add WordpieceTokenizer to API and IR. Add AddDict to C++ API
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
Xiao Tianci
4f1dbc6cd5
correct error message of soft_dvpp ops and fix example of IterSampler
5 years ago
mindspore-ci-bot
a0b17ea6c6
!13130 Fix source len is not divisible by batch_size in user defined sampler
From: @luoyang42
Reviewed-by:
Signed-off-by:
5 years ago
alex-yuyue
2457f52596
Fix CI warning and test team issues
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
luoyang
25ff4c9312
Fix source len is not divisible by batch_size in user defined sampler
5 years ago
mindspore-ci-bot
3c7463bf2c
!12943 adding fix to sample script
From: @ezphlow
Reviewed-by:
Signed-off-by:
5 years ago
Eric
ed373f61ac
Adding inheritance to user defined sampler
what if we just do nothing
trying wrapper approach
Fix yolo
5 years ago
Xiao Tianci
bf69444b3a
fix the examples in docs of minddata
5 years ago
hesham
616d1a1f3d
Fix sampler supporting numpy input
5 years ago
hesham
aa4298721a
Fix sampler error messages
5 years ago
YangLuo
d8ace8f041
fix minddata issues
5 years ago
luoyang
416ad23e9d
fix resize & randomcoloradjust
fix sampler
5 years ago
mindspore-ci-bot
e6dcb0c31d
!12239 [MD] fix bugs of execute & update doc description in minddata
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
5 years ago
luoyang
cd86788cf3
fix bugs of execute & update doc description in minddata
5 years ago
hesham
4bbc3445f1
datasets.py cleanup
5 years ago
mindspore-ci-bot
620b2f4256
!10821 #I28T16[improve examples in dataset API document to make it okay to run(part1)]
From: @ming__blue
Reviewed-by:
Signed-off-by:
5 years ago
hesham
1185218335
Support list of IDs as a sampler
5 years ago
13465716071
3594bd581c
Mindcon Shandong bug fix part1
fix rebase confict
5 years ago
Mahdi
8f34faeb7a
Changed bindings to SamplerObj
5 years ago
hesham
7120c66998
Add SubsetSampler
5 years ago
luoyang
415c8b08a5
fix issues of MD:
1. description of num_shard in datasets.py
2. add param validation for sampler
3. add description for add_child in sampler.py
5 years ago
Xiao Tianci
f7093efe6a
modify return description in comments
5 years ago
Nat Sutyanyong
5e1bb0b697
boilerplate code for future IR optimizer
add 2 test cases to IRNode Deepcopy()
address review cmts
fix ut
samplerObj copy
ci
fix ci
fix ci round III
address further review cmts
add a missing macro
fix merge conflict
fix complie err
fix lite compile err
fix compile err
fix lite compile round III
address an issue
fix minor comments
5 years ago
liyong
5b035408f6
fix deepycopy bug
5 years ago
ms_yan
0cb5c47856
add err modify
5 years ago
YangLuo
82cc7c3f63
[MD] Revert changes to weighted_random_sampler in PR7866
5 years ago
mindspore-ci-bot
8f44074796
!7866 [MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer
Merge pull request !7866 from luoyang/c-api-pyfunc
5 years ago
luoyang
52d278e858
[MD] C++ API support build_sentence_piece_vocab_node & sentence_piece_tokenizer
5 years ago
Xiao Tianci
823e52f1dc
add params checking of offset in distributed_sampler
add related comment to explain
add related UT
5 years ago
luoyang
f0e976dbda
[MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
5 years ago
Cathy Wong
e971a3aed9
dataset API docstring: Update datasets.py and config.py
5 years ago
Cathy Wong
f7adf648e9
dataset API docstring: Update datasets, samplers, graphdata and text
5 years ago
nhussain
3bac9d3713
switch input columns and operation
change ImagefolderDV2 name
change ds.transforms.vision to ds.vision
change batch api to match map api more closely
compose op changes
test_pylint
remove compose op from vision, move to transform module, refactor map and batch to use column_order
5 years ago
nhussain
eb9a611041
remove old defaults
5 years ago
genglishuai
4d4df68d1e
add DistributedSampler for Concat op
5 years ago
liyong
7341421d3b
fix num samples in pk sampler
5 years ago
liyong
e2ea1fa0df
activate num_samples in distributed samplers
5 years ago
YangLuo
4e3bfcf4c9
!2306 [Dataset] Code review & improve quality
5 years ago
mindspore-ci-bot
d7d094e1c5
!2231 fix report error in get_dataset_size
Merge pull request !2231 from yanghaitao/yht_get_num_samples
5 years ago
yanghaitao1
94cebe4d53
fix sampler get_num_samples
5 years ago
liyong
d4f8f57c7e
add split in minddataset
5 years ago