mindspore-ci-bot
923dd47b0f
!12331 Adding validators back to check method
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca,@robingrosman
Signed-off-by: @robingrosman
5 years ago
Eric
5d91fa6d77
changed discription
Added validator checks
Added builtin sampler check
Added proper input check for samplers
5 years ago
hesham
58193bc469
User explicit deepcopy
5 years ago
mindspore-ci-bot
8d55cd9d89
!12295 Fix Dataset cache problem after cleanup
From: @hfarahat
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
5 years ago
hesham
37add20783
Fix caching problem after cleanup
5 years ago
Xiao Tianci
3e85e124d7
fix some errors of minddata docs
5 years ago
mindspore-ci-bot
e6dcb0c31d
!12239 [MD] fix bugs of execute & update doc description in minddata
From: @luoyang42
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
5 years ago
luoyang
cd86788cf3
fix bugs of execute & update doc description in minddata
5 years ago
gongxiaoqing
7f538b51e7
回退 'Pull Request !11074 : replace tdt with acltdt interface'
5 years ago
mindspore-ci-bot
c2582dcab9
!11074 replace tdt with acltdt interface
From: @ms_yan
Reviewed-by: @lilongfei15
Signed-off-by:
5 years ago
hesham
4bbc3445f1
datasets.py cleanup
5 years ago
hesham
edfb2e1414
Issue#1:
DistributedSampler with GeneratorOp bug
Issue#2:
GeneratorOp with iterable source doesn't respect num_samples
Issue#3:
Generator with schemas does not take samplers
5 years ago
ms_yan
293f81128d
init add acltdt handle create and destory
add hostpush part modify
optimize previous code
provide aclhandle access method
modify CMakeList format
add device_id parameter into TransferNode
5 years ago
mindspore-ci-bot
620b2f4256
!10821 #I28T16[improve examples in dataset API document to make it okay to run(part1)]
From: @ming__blue
Reviewed-by:
Signed-off-by:
5 years ago
hesham
1185218335
Support list of IDs as a sampler
5 years ago
13465716071
3594bd581c
Mindcon Shandong bug fix part1
fix rebase confict
5 years ago
yanghaitao1
83cb87bcd1
cpu profiling
add operator profiling part
add op_id param when create task
repair bugs in op cpu sampling
fix wrong order of write and parse cpu_info
add process cpu profiling part
add multiprocessing part(part 1)
adapter cpu_sampling c layer
fix little error in sampling
descrease cirle complex in voc
descrease cirle complex in device_que
5 years ago
ms_yan
fa2a854057
fix GeneratorDataset unable to do serialize
5 years ago
hesham
7120c66998
Add SubsetSampler
5 years ago
mindspore-ci-bot
f2fd357ffc
!11623 fix issues of MD
From: @luoyang42
Reviewed-by:
Signed-off-by:
5 years ago
luoyang
415c8b08a5
fix issues of MD:
1. description of num_shard in datasets.py
2. add param validation for sampler
3. add description for add_child in sampler.py
5 years ago
mindspore-ci-bot
029ea5d1f3
!11301 Push sampler to GeneratorOp c++
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago
hesham
c3278c983d
Move GeneratorOp sampler to c++
5 years ago
mindspore-ci-bot
2beb916bf5
!11427 TextOp decoupling
From: @alexyuyue
Reviewed-by:
Signed-off-by:
5 years ago
mohammad
b5e91139e2
add GetDatasetSize to concat node
5 years ago
alex-yuyue
a8675f8227
TextOp decoupling
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
Xiao Tianci
f7093efe6a
modify return description in comments
5 years ago
anzhengqi
50b783ee13
fix generator or user defined sampler len method unmatch iter method
5 years ago
TinaMengtingZhang
4812fece80
[Part I] Push down json save logic to IR and add getter to each IR node
5 years ago
mindspore-ci-bot
7957a3b6f5
!10988 Tensor op decoupling stage 1
From: @ezphlow
Reviewed-by:
Signed-off-by:
5 years ago
Eric
be46ccf721
Started vision decoupling
map validate params
Changing bindings
Change behavior of vision.cc
Added signature and changed Cmake
Compiling
Need to fix compile
Added compiling random transforms
python changes for decoupling
two failed test case remaining
Compiling random choice
passes all ut
Changed assert
review comments
Added validate params
add back return value
Fix lint
py lint fix
pylint 2
Addressing comments
5 years ago
xiefangqi
bd0cf9ed43
minddata fix generatordataset get_dataset_size issue
5 years ago
heleiwang
41d629b486
fix map exit hang
5 years ago
Xiao
ca03265748
fix docs of APIs which support both str and list of str
5 years ago
mindspore-ci-bot
eaf1d76d6f
!10401 fix GeneratorDataset join error
From: @heleiwang
Reviewed-by: @liucunwei,@wangyue01
Signed-off-by: @liucunwei
5 years ago
ms_yan
deb1e6e965
use from_numpy and add do_copy option
5 years ago
heleiwang
8b1518845d
fix GeneratorDataset join error
5 years ago
liyong
8e3fea27d7
fix pool not running bug
5 years ago
mindspore-ci-bot
ea2cabcfec
!10137 fix GeneratorDataset multiprocessing hangs
From: @heleiwang
Reviewed-by:
Signed-off-by:
5 years ago
heleiwang
ef9363fd21
fix GeneratorDataset multiprocessing hangs
5 years ago
luoyang
47f20f6547
Fix copy _batch_size of dataset
5 years ago
luoyang
c0ec20f16d
Fix deepcopy of BatchDataset
5 years ago
mindspore-ci-bot
a1edf7b03f
!10024 Fix bug of not calling __del__ of Map and Batch
From: @hfarahat
Reviewed-by: @nsyca,@pandoublefeng
Signed-off-by: @pandoublefeng
5 years ago
mindspore-ci-bot
77ef49a4f3
!10025 Minor modification for DatasetCache docstring
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
5 years ago
Lixia Chen
23e90216d9
Minor modification for DatasetCache docstring
5 years ago
hesham
f45fa1672b
Fix bug of not calling __del__ of Map and Batch
5 years ago
mindspore-ci-bot
bccf04d36c
!8378 [MD][GPU] minddata device_que push optimizer
From: @xiefangqi
Reviewed-by:
Signed-off-by:
5 years ago
xiefangqi
ae36071fc8
add push opt logic
5 years ago
jonyguo
4d11796893
fix: sync_wait without warning info
5 years ago
Zirui Wu
77521e78d2
staging
5 years ago