chenzomi
79131e8da7
[ME] add float check function
5 years ago
mindspore-ci-bot
c1b9efe8e6
!7050 dataset API docstring: Update/add text examples
Merge pull request !7050 from cathwong/ckw_api_text_examples
5 years ago
Cathy Wong
e0aaf847aa
dataset API docstring: Update/add text examples
5 years ago
mindspore-ci-bot
6f77ec45f1
!6905 [MD] Enable cache for more leaf datasets
Merge pull request !6905 from lixiachen/CacheOp_dev
5 years ago
xiefangqi
e7fc0fbcd5
minddata fix compose comment example
5 years ago
xiefangqi
82bc278e26
minddata use new ps api
5 years ago
Lixia Chen
477808e622
Enable cache for other leaf ops
5 years ago
mindspore-ci-bot
0d8015b043
!5300 [MD] Add nD Slice Support
Merge pull request !5300 from nhussain/slice_op
5 years ago
YangLuo
977c41db01
Fix timeout of GeneratorDataset multiprocessing
5 years ago
mindspore-ci-bot
4c0b3c1bd3
!6017 per_batch_map needs to support x input columns and y output columns
Merge pull request !6017 from ZiruiWu/per_batch_map_multi_col
5 years ago
mindspore-ci-bot
e88e114a50
!5930 Cache server phase 2 single node
Merge pull request !5930 from Jamie/CacheOp_dev
5 years ago
nhussain
77d507279c
first working implementation
add string implementation, can handle partial string slices
finish core implementation, added Index object
fix up the logic
add in new SliceOption object, cleaning up tests
5 years ago
Lixia Chen
983827ec5c
Rebase up to 88ded11f59
5 years ago
Zirui Wu
0cab373223
per_batch_map supports x num_columns to y num_columns
decided to use project after batch as well
per_batch_map 1->x colunm works
add more test case
add test cases, project after map
col order hahaah
fix ci
add test cases
addr review cmts
ci
fix build err
fix test case failure
ci
5 years ago
mindspore-ci-bot
2f3add4acd
!6301 [MD] Combine c++ and python ops in map
Merge pull request !6301 from nhussain/c_py_compose
5 years ago
nhussain
fda9462682
embed python compose op
Leaf ops do self-reset.
embed python compose op
add implicit compose op
more tests
5 years ago
YangLuo
2fa3e2ea2f
Add comment for "relax timeout constraint" & "try to call terminate"
5 years ago
YangLuo
291cf767ee
relax time constraint for GeneratorWorker
5 years ago
liyong
0e40596bce
fix concat log
5 years ago
mindspore-ci-bot
e2fd5704d6
!6588 check if pyfunc timeout valid
Merge pull request !6588 from yanghaitao/yht_protect_pyfunc_timeout
5 years ago
yanghaitao1
8b4591c482
protect pyfunc timeout
5 years ago
mindspore-ci-bot
ea9870bf05
!6576 TFRecordDataset add notes
Merge pull request !6576 from heleiwang/mod_tfrecord_api
5 years ago
Eric
4e2d530adc
Added timeout for sync_wait
5 years ago
shenwei41
f2e34b2eaf
Clean up the view code
5 years ago
heleiwang
13ed9f99b3
TFRecordDataset add notes
5 years ago
mindspore-ci-bot
53a82fa6e0
!6472 fix get_dataset_size error in CelebaDataset when usage is not 'all'
Merge pull request !6472 from yanghaitao/yht_celeba_get_dataset_size
5 years ago
yanghaitao1
4ff4c17632
fix get_dataset_size in CelebADataset when usage is not all
5 years ago
xiefangqi
a6360cb2e4
add output_numpy validation to iterator
5 years ago
mindspore-ci-bot
1cfad93704
!6479 fix bucket_batch_by_length show pyfunc timeout
Merge pull request !6479 from yanghaitao/yht_bucket_batch_ci
5 years ago
yanghaitao1
da15495d7b
fix bucket_batch ci error
5 years ago
mindspore-ci-bot
d09025acab
!6451 check if partition file exists when usage is not all in CelebADataset
Merge pull request !6451 from yanghaitao/yht_celeba_log
5 years ago
yanghaitao1
f55f274bb4
check list_eval_partition.txt file
5 years ago
Cathy Wong
e971a3aed9
dataset API docstring: Update datasets.py and config.py
5 years ago
liyong
0e306850f2
fix mixup comment
5 years ago
mindspore-ci-bot
e60e4920f9
!6346 add timeout value to pyfunc
Merge pull request !6346 from yanghaitao/yht_pyfunc_timeout
5 years ago
yanghaitao1
95f54de5d6
add timeout for pyfunc
5 years ago
mindspore-ci-bot
f6ac30ef29
!6221 stop send data to device after end of sequence
Merge pull request !6221 from anzhengqi/stop-send-at-eos
5 years ago
anzhengqi
8e1a2ef5ae
stop send data to device after end of sequence
5 years ago
Cathy Wong
f7adf648e9
dataset API docstring: Update datasets, samplers, graphdata and text
5 years ago
mindspore-ci-bot
10aec24510
!6113 Unify minddata seed to set_seed
Merge pull request !6113 from xiefangqi/md_unify_seed
5 years ago
mindspore-ci-bot
9824d0b20f
!6142 MindData fix batch ops issue
Merge pull request !6142 from xiefangqi/md_fix_map_issue
5 years ago
xiefangqi
b269c57dfb
minddata unify seed to set_seed
5 years ago
mindspore-ci-bot
f450d324bb
!6090 [MD] Temporarily disable DatasetCache for the current release
Merge pull request !6090 from lixiachen/disable_cache
5 years ago
xiefangqi
653c79b4af
md fix per_batch_map issue
5 years ago
liyong
16147669a6
fix num_samples in concatDataset
5 years ago
mindspore-ci-bot
28e2b0253e
!6086 Order dict by column_id in create_dict_iterator()
Merge pull request !6086 from ZiruiWu/order_dict_in_create_dict_iterator
5 years ago
Zirui Wu
d54ba374b9
order dict by column_id in create_dict_iterator()
fix CI
5 years ago
Lixia Chen
30a2cce595
Disable cache
5 years ago
nhussain
96de2ffdb6
fix errors from old compose call in Python
5 years ago
mindspore-ci-bot
d8c09067ce
!5801 [MD][Feature] minddata iterator output ms_tensor
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
5 years ago