mindspore-ci-bot
f45890c3f6
!14136 Improve cache server spilling performance
From: @lixiachen
Reviewed-by: @robingrosman,@pandoublefeng
Signed-off-by: @pandoublefeng
5 years ago
xiefangqi
db43f196a7
fix codex&cpplint&pylint
5 years ago
Lixia Chen
9a16a2cf5c
Improve cache server spilling perf
5 years ago
mindspore-ci-bot
a9ba9b90f6
!14680 MindData Codespell correction
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
5 years ago
luoyang
624511337c
MindData Codespell correction
5 years ago
hesham
8535e89e6c
Remove DataBuffer
5 years ago
hesham
0d86cb1423
Remove rows_per_buffer
5 years ago
hesham
a9a80693be
Replace Databuffers with TensorRows
5 years ago
mindspore-ci-bot
0bb4841427
!13291 Add a base class for Non-mappable source ops
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
3d4a1aaff1
!14428 fix codex issue for minddata profiling
From: @robingrosman
Reviewed-by: @pandoublefeng,@nsyca
Signed-off-by: @pandoublefeng
5 years ago
xiefangqi
a81f0fbbfa
tfrecord file name log fix
5 years ago
hesham
c877ac255b
Add NonMappableLeafOp and unify TfReader and TextFile, CSV, Clue and CSV
5 years ago
mindspore-ci-bot
1edbbe56ba
!13290 Add a base class for Mappable source ops
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago
hesham
a220a8d74b
Add MappableLeafOp and unify Album, ImageFolder, CelebA, Cifar, Coco, Manifest, Mnist, VOC and MindRecord
5 years ago
yepei6
5da7fb36c5
modify the tensorprint handle create process
5 years ago
RobinGrosman
f4a735e3b6
fix codex and cpplint errors in cpu_samples.cc and parallel_op.cc
5 years ago
Eric
38944eafc4
Added get dataset size and fix macro
5 years ago
mindspore-ci-bot
c7b6b1d24e
!14268 dataset: add stop_dataset_profiler option
From: @ms_yan
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
5 years ago
ms_yan
b6ef88c168
add stop_dataset_profiler option
5 years ago
xiefangqi
de856a1bac
md fix gpu core dump problem
5 years ago
mindspore-ci-bot
6e997ad3fc
!14003 [MD][Profiling] Fix Device ID profiling error
From: @xiefangqi
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
5 years ago
xiefangqi
dbe4e7ff82
md fix gpu profiling device id issue
5 years ago
zhoufeng
e4c59a1c8f
library size optimization for 310
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
5 years ago
ms_yan
c59349e096
avoid double free for tdt channel
5 years ago
xiefangqi
f6fa72f61f
Revert "Fix profiling device id error"
This reverts commit b9f45b49ff .
5 years ago
xiefangqi
b9f45b49ff
Fix profiling device id error
5 years ago
mindspore-ci-bot
c0aa5f8132
!13365 Fix random rotation input check
From: @ezphlow
Reviewed-by:
Signed-off-by:
5 years ago
Eric
4be0ffb9ba
removing type_id.h from header files
5 years ago
Eric
47f5e2867d
Added input check fix to random rotation
5 years ago
RobinGrosman
c616150fd6
Add analysis of profiling to warn if dataset parallel_workers should be increased
This message will currently only be printed if profiling of minddata is enabled.
Profiling of minddata is not enabled by default.
5 years ago
Lixia Chen
30017ea5a0
Fix codex issues
5 years ago
ms_yan
92e86804e1
init add acltdt handle create and destory
add hostpush part modify
optimize previous code
provide aclhandle access method
modify CMakeList format
add device_id parameter into TransferNode
update acltdt api
5 years ago
mindspore-ci-bot
9790a976e7
!13211 Fix CsvDataset OP
From: @lizhenglong1992
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @heleiwang
5 years ago
mindspore-ci-bot
7e8fa13197
!13136 【MD】【BUG】Fix log print for MD
From: @xulei2020
Reviewed-by: @heleiwang
Signed-off-by: @heleiwang
5 years ago
mindspore-ci-bot
98a87ad969
!13220 Add data helper to C++ API
From: @ezphlow
Reviewed-by:
Signed-off-by:
5 years ago
Eric
82f7c6f2c7
Moving data_helper
exposing json
WIP fix for removing templates
Removing templates part 1
replacing core/constants.h
removed template part 2
Changed fake data to filler data
Fixing CI
Fix CI part 2
CI fix part 2
Fix CI 3
Fixed lizard for data_util
Fixed clang
Fixing CI part 4
5 years ago
Zhenglong Li
6b3df8af51
Fix CsvDataset Operation bug
5 years ago
mohammad
551e45e5b9
fix codedex
5 years ago
mindspore-ci-bot
f7040ca134
!13198 Fix get_dataset_size error with PKSampler
From: @ziruiwu
Reviewed-by:
Signed-off-by:
5 years ago
Zirui Wu
2692e3cc3d
fix pk sampler's get_dataset error due to num_class unavaiable at pre-runtime
5 years ago
RobinGrosman
a0e75b845a
Increase default level of parallelism in mindddata pipeline to 8.
Adjust memory usage to not increase as parallelism increases. it will
stay at same level it would be with 4 parallelism
5 years ago
xulei2020
4a4f555308
fix log print bug for MD
5 years ago
mindspore-ci-bot
62149265d5
!13066 [MD][usability] Fix batch_op log level
From: @xiefangqi
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei
5 years ago
mindspore-ci-bot
62a6f783b3
!12809 Added pull-based prototype
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
5 years ago
xiefangqi
425fdc8beb
fix batch log level
5 years ago
Mahdi
9c3c36217e
Added pull based prototype
5 years ago
tinazhang66
5b7bdb9493
fix issues on displaying configuration of cache server
5 years ago
xulei2020
17144219e7
fix MD log Bug
5 years ago
mindspore-ci-bot
5135c214b7
!12882 [MD][bugfix] Fix line_of_code print twice issue
From: @xiefangqi
Reviewed-by: @heleiwang,@pandoublefeng
Signed-off-by: @pandoublefeng
5 years ago
mindspore-ci-bot
68728d1034
!12794 [MD][RDR] minddata add rdr record infomation
From: @xiefangqi
Reviewed-by:
Signed-off-by:
5 years ago