panfengfeng
5e7cef7e3d
fix generatordataset check shuffle parameter
6 years ago
Junhan Hu
c5a8ffe4f4
Add schema support for GeneratorDataset
6 years ago
yanghaitao
203b05d458
num_shards and sampler is not supported if source does not have __getitem__
6 years ago
yanghaitao
c87e174661
checkout python_multiprocess type for map
6 years ago
yanghaitao
60f2663326
Check TfFileDataset num_shards and shard_id
6 years ago
ms_yan
763aa1067e
Add Error catch for giving too many input parameters
6 years ago
mindspore-ci-bot
eda63a559a
!477 Fix VOC dataset test cases
Merge pull request !477 from xiefangqi/xfq_fix_voc
6 years ago
eric
cd94518769
X# This is a combination of 2 commits.
Initial commit for dataset op python
Added signature to barrier
Adde compiling barrier code
Rebasing, fixed new compile errors
Final fix for make_unique
Added pybind API for barrier
Fixed pyfunc invocation
python interface - sync_wait
!1 sync_wait python interface
* python interface - sync_wait
fix test
update test
update test
Added new test case
add test case
test for shuffle + batch
Added two-sync test case
Restrited that no shuffle after sync
Added sync to pipeline info
block first databuffer as well
Intelligently get batch size
Fix default case
Lock Pair shares among all iterators
Added fix for empty character
Fixed up test case formatting
Fix end of epoch in sync_wait
Fixing CI
6 years ago
xiefangqi
108eeb8e3d
fix voc test cases
6 years ago
mindspore-ci-bot
98fbd30a5b
!460 [Data]Add filter operation
Merge pull request !460 from xulei/filter_master
6 years ago
mindspore-ci-bot
822a3160e4
!404 [Dataset] Add Python Sampler support for CPP dataset
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
6 years ago
xulei2020
c705ea5e5b
add filterOp code
6 years ago
yanghaitao
2795e492ff
TextFileDataset
6 years ago
Junhan Hu
43a2e99833
Add python sampler support for CPP dataset
6 years ago
ms_yan
f0c07c3fa6
Realize take op and add ut
6 years ago
jzw
3f7054dccb
add skip dataset op
6 years ago
Junhan Hu
9739d3b048
Add CPP sampler support for GeneratorDataset
6 years ago
mindspore-ci-bot
7f8c9ebf10
!194 Fix dataset parameter check
Merge pull request !194 from pengyanjun/fix_dataset_para_validator_check
6 years ago
Yanjun Peng
363632ca9d
fix dataset para validator check
6 years ago
Cathy Wong
917aa02e2a
Correct dataset error checking
6 years ago
ms_yan
ff38eff9ae
add parameter check for Class Schema
6 years ago
chang zherui
7696c21e65
fix runtest.sh for python ut
6 years ago
ms_yan
fc9d088794
add parameter check for Class Schema
6 years ago
anzhengqi
6a1b865c91
check num_samples
6 years ago
ms_yan
7b5640da4e
Repair parameter check problem in TFRecordDataset
6 years ago
zhunaipan
930a1fb0a8
initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
6 years ago