mindspore-ci-bot
7982f05038
!7730 [MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
Merge pull request !7730 from luoyang/c-api-pyfunc
5 years ago
luoyang
f0e976dbda
[MD] Fix bugs in WeightedRandomSampler & SubsetRandomSampler
5 years ago
heleiwang
4f946bc54b
Modify the processing method of multiple processes in the GeneratorDataset:
1. Start the child process in the init phase
2. At the beginning of each epoch, the child process is not recreated, but the child process created at the beginning is used
5 years ago
liyong
ee042b90f7
fix num_sample in sequentialSampler and randomSampler
5 years ago
mindspore-ci-bot
4e40f1e3ae
!7618 add per_batch_map useage in api comment
Merge pull request !7618 from guozhijian/add_per_batch_map_usage_in_api
5 years ago
jonyguo
f258697901
add per_batch_map usage in api comment
5 years ago
mindspore-ci-bot
1ee9c4d014
!6645 [MD] add unique op
Merge pull request !6645 from liyong126/md_unique_op
5 years ago
liyong
fb2bd156c9
add unique op
5 years ago
anzhengqi
5cf079595e
fix sink_size error
5 years ago
luoyang
2dc8e5f421
[MD] C++ api add MindDataset
5 years ago
chenzomi
79131e8da7
[ME] add float check function
5 years ago
mindspore-ci-bot
c1b9efe8e6
!7050 dataset API docstring: Update/add text examples
Merge pull request !7050 from cathwong/ckw_api_text_examples
5 years ago
Cathy Wong
e0aaf847aa
dataset API docstring: Update/add text examples
5 years ago
mindspore-ci-bot
6f77ec45f1
!6905 [MD] Enable cache for more leaf datasets
Merge pull request !6905 from lixiachen/CacheOp_dev
5 years ago
xiefangqi
e7fc0fbcd5
minddata fix compose comment example
5 years ago
xiefangqi
82bc278e26
minddata use new ps api
5 years ago
Lixia Chen
477808e622
Enable cache for other leaf ops
5 years ago
mindspore-ci-bot
0d8015b043
!5300 [MD] Add nD Slice Support
Merge pull request !5300 from nhussain/slice_op
5 years ago
YangLuo
977c41db01
Fix timeout of GeneratorDataset multiprocessing
5 years ago
mindspore-ci-bot
4c0b3c1bd3
!6017 per_batch_map needs to support x input columns and y output columns
Merge pull request !6017 from ZiruiWu/per_batch_map_multi_col
5 years ago
mindspore-ci-bot
e88e114a50
!5930 Cache server phase 2 single node
Merge pull request !5930 from Jamie/CacheOp_dev
5 years ago
nhussain
77d507279c
first working implementation
add string implementation, can handle partial string slices
finish core implementation, added Index object
fix up the logic
add in new SliceOption object, cleaning up tests
5 years ago
Lixia Chen
983827ec5c
Rebase up to 88ded11f59
5 years ago
Zirui Wu
0cab373223
per_batch_map supports x num_columns to y num_columns
decided to use project after batch as well
per_batch_map 1->x colunm works
add more test case
add test cases, project after map
col order hahaah
fix ci
add test cases
addr review cmts
ci
fix build err
fix test case failure
ci
5 years ago
mindspore-ci-bot
2f3add4acd
!6301 [MD] Combine c++ and python ops in map
Merge pull request !6301 from nhussain/c_py_compose
5 years ago
nhussain
fda9462682
embed python compose op
Leaf ops do self-reset.
embed python compose op
add implicit compose op
more tests
5 years ago
YangLuo
2fa3e2ea2f
Add comment for "relax timeout constraint" & "try to call terminate"
5 years ago
YangLuo
291cf767ee
relax time constraint for GeneratorWorker
5 years ago
liyong
0e40596bce
fix concat log
5 years ago
mindspore-ci-bot
e2fd5704d6
!6588 check if pyfunc timeout valid
Merge pull request !6588 from yanghaitao/yht_protect_pyfunc_timeout
5 years ago
yanghaitao1
8b4591c482
protect pyfunc timeout
5 years ago
mindspore-ci-bot
ea9870bf05
!6576 TFRecordDataset add notes
Merge pull request !6576 from heleiwang/mod_tfrecord_api
5 years ago
Eric
4e2d530adc
Added timeout for sync_wait
5 years ago
shenwei41
f2e34b2eaf
Clean up the view code
5 years ago
heleiwang
13ed9f99b3
TFRecordDataset add notes
5 years ago
mindspore-ci-bot
53a82fa6e0
!6472 fix get_dataset_size error in CelebaDataset when usage is not 'all'
Merge pull request !6472 from yanghaitao/yht_celeba_get_dataset_size
5 years ago
yanghaitao1
4ff4c17632
fix get_dataset_size in CelebADataset when usage is not all
5 years ago
xiefangqi
a6360cb2e4
add output_numpy validation to iterator
5 years ago
mindspore-ci-bot
1cfad93704
!6479 fix bucket_batch_by_length show pyfunc timeout
Merge pull request !6479 from yanghaitao/yht_bucket_batch_ci
5 years ago
yanghaitao1
da15495d7b
fix bucket_batch ci error
5 years ago
mindspore-ci-bot
d09025acab
!6451 check if partition file exists when usage is not all in CelebADataset
Merge pull request !6451 from yanghaitao/yht_celeba_log
5 years ago
yanghaitao1
f55f274bb4
check list_eval_partition.txt file
5 years ago
Cathy Wong
e971a3aed9
dataset API docstring: Update datasets.py and config.py
5 years ago
liyong
0e306850f2
fix mixup comment
5 years ago
mindspore-ci-bot
e60e4920f9
!6346 add timeout value to pyfunc
Merge pull request !6346 from yanghaitao/yht_pyfunc_timeout
5 years ago
yanghaitao1
95f54de5d6
add timeout for pyfunc
5 years ago
mindspore-ci-bot
f6ac30ef29
!6221 stop send data to device after end of sequence
Merge pull request !6221 from anzhengqi/stop-send-at-eos
5 years ago
anzhengqi
8e1a2ef5ae
stop send data to device after end of sequence
5 years ago
Cathy Wong
f7adf648e9
dataset API docstring: Update datasets, samplers, graphdata and text
5 years ago
mindspore-ci-bot
10aec24510
!6113 Unify minddata seed to set_seed
Merge pull request !6113 from xiefangqi/md_unify_seed
5 years ago