mindspore-ci-bot
b85bf60eb8
!15727 VOCDataset read xml will filter invalid bbox automationally
From: @xiefangqi
Reviewed-by: @heleiwang,@jonyguo
Signed-off-by: @jonyguo
4 years ago
mindspore-ci-bot
46948b3eca
!16004 TFRecordDataset read big tfrecord file has to waiting more than 30s
From: @xiefangqi
Reviewed-by: @heleiwang,@jonyguo
Signed-off-by: @jonyguo
4 years ago
xiefangqi
c8bdf80078
tfrecord add big file warning
4 years ago
Lixia Chen
5967cb2cd7
Unblock mindrecord under cache
4 years ago
mindspore-ci-bot
1e2e554db3
!15380 Unify minddata include files(except for datasets.h) in scenario of cloud and lite
From: @luoyang42
Reviewed-by: @tiancixiao
Signed-off-by:
4 years ago
xiefangqi
458ff5fed9
md fix voc and manifest error scenario
4 years ago
Jamie Nisbet
515c936b85
MindRecord becomes a mappable dataset
updates
review touches
ci fixes
ci fix
ci fixin
ci fix
review updates
further cleanup
updates
updates
update
update comment
5 years ago
YangLuo
bf48400c10
unify include file of minddata
4 years ago
hesham
d167095b6d
Fix bug in checking status return in CSVOp
4 years ago
mindspore-ci-bot
f9c5060cf2
!14930 Handle ignored returned Status
From: @hfarahat
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @robingrosman
4 years ago
hesham
98f0f36a20
Removed unused include
5 years ago
hesham
6e6eaebb77
Fix unused return value in main code
5 years ago
mindspore-ci-bot
1d89109d19
!14929 Cleanup stale comments about DataBuffers
From: @hfarahat
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @pandoublefeng
4 years ago
hesham
15354569f2
Cleanup stale comments about DataBuffers
5 years ago
mohammad
cc42b2c221
fix codedex + add docstring
5 years ago
hesham
97cf4e516e
Address 3 code issues:
1- access out of bound memory in toFlatIndex
2- CreateFromNPArray function is 50>
3- duplicate variable init
5 years ago
hesham
8535e89e6c
Remove DataBuffer
5 years ago
hesham
0d86cb1423
Remove rows_per_buffer
5 years ago
hesham
a9a80693be
Replace Databuffers with TensorRows
5 years ago
mindspore-ci-bot
0bb4841427
!13291 Add a base class for Non-mappable source ops
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago
xiefangqi
a81f0fbbfa
tfrecord file name log fix
5 years ago
hesham
c877ac255b
Add NonMappableLeafOp and unify TfReader and TextFile, CSV, Clue and CSV
5 years ago
mindspore-ci-bot
1edbbe56ba
!13290 Add a base class for Mappable source ops
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago
hesham
a220a8d74b
Add MappableLeafOp and unify Album, ImageFolder, CelebA, Cifar, Coco, Manifest, Mnist, VOC and MindRecord
5 years ago
Eric
38944eafc4
Added get dataset size and fix macro
5 years ago
mindspore-ci-bot
9790a976e7
!13211 Fix CsvDataset OP
From: @lizhenglong1992
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @heleiwang
5 years ago
mindspore-ci-bot
7e8fa13197
!13136 【MD】【BUG】Fix log print for MD
From: @xulei2020
Reviewed-by: @heleiwang
Signed-off-by: @heleiwang
5 years ago
Eric
82f7c6f2c7
Moving data_helper
exposing json
WIP fix for removing templates
Removing templates part 1
replacing core/constants.h
removed template part 2
Changed fake data to filler data
Fixing CI
Fix CI part 2
CI fix part 2
Fix CI 3
Fixed lizard for data_util
Fixed clang
Fixing CI part 4
5 years ago
Zhenglong Li
6b3df8af51
Fix CsvDataset Operation bug
5 years ago
Zirui Wu
2692e3cc3d
fix pk sampler's get_dataset error due to num_class unavaiable at pre-runtime
5 years ago
xulei2020
4a4f555308
fix log print bug for MD
5 years ago
mindspore-ci-bot
62a6f783b3
!12809 Added pull-based prototype
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
5 years ago
Mahdi
9c3c36217e
Added pull based prototype
5 years ago
xiefangqi
b465b859c0
fix line twice problem
5 years ago
Mahdi
4b106f184c
Fixed an issue with SequentialSampler
5 years ago
hesham
edfb2e1414
Issue#1:
DistributedSampler with GeneratorOp bug
Issue#2:
GeneratorOp with iterable source doesn't respect num_samples
Issue#3:
Generator with schemas does not take samplers
5 years ago
Nat Sutyanyong
46483d89b1
Completely remove unused ExecTree optimizer code, rewrite ExecutionTree::Prepare()
5 years ago
lixian
7d2fd6e76c
cxx api refactor: tensor/status/model
5 years ago
Nat Sutyanyong
5a7dc0accc
Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer
5 years ago
yanghaitao1
83cb87bcd1
cpu profiling
add operator profiling part
add op_id param when create task
repair bugs in op cpu sampling
fix wrong order of write and parse cpu_info
add process cpu profiling part
add multiprocessing part(part 1)
adapter cpu_sampling c layer
fix little error in sampling
descrease cirle complex in voc
descrease cirle complex in device_que
5 years ago
mindspore-ci-bot
794af6d094
!11834 [MD] Fix error msg description of dataset
From: @xiefangqi
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
5 years ago
xiefangqi
3d72282f26
fix error msg issue
5 years ago
hesham
7120c66998
Add SubsetSampler
5 years ago
Lixia Chen
922e1f4f36
Migrate CacheTransformPass
5 years ago
mindspore-ci-bot
029ea5d1f3
!11301 Push sampler to GeneratorOp c++
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago
xsmq
73b7154e55
fix cmakelint error
5 years ago
hesham
c3278c983d
Move GeneratorOp sampler to c++
5 years ago
xiefangqi
3f76abcdee
minddata err msg add file path
5 years ago
anzhengqi
50b783ee13
fix generator or user defined sampler len method unmatch iter method
5 years ago
TinaMengtingZhang
4812fece80
[Part I] Push down json save logic to IR and add getter to each IR node
5 years ago