Mahdi
4b106f184c
Fixed an issue with SequentialSampler
5 years ago
xiefangqi
93d7642374
fix gpu rank_id problem
5 years ago
lizhenyu
6649153c49
add input data type check for ps cache mode
5 years ago
gongxiaoqing
7f538b51e7
回退 'Pull Request !11074 : replace tdt with acltdt interface'
5 years ago
mindspore-ci-bot
c2582dcab9
!11074 replace tdt with acltdt interface
From: @ms_yan
Reviewed-by: @lilongfei15
Signed-off-by:
5 years ago
hesham
edfb2e1414
Issue#1:
DistributedSampler with GeneratorOp bug
Issue#2:
GeneratorOp with iterable source doesn't respect num_samples
Issue#3:
Generator with schemas does not take samplers
5 years ago
Nat Sutyanyong
46483d89b1
Completely remove unused ExecTree optimizer code, rewrite ExecutionTree::Prepare()
5 years ago
mindspore-ci-bot
e8f4cafd02
!11950 Overwrite default port/hostname from env variables for cache_admin
From: @lixiachen
Reviewed-by:
Signed-off-by:
5 years ago
ms_yan
293f81128d
init add acltdt handle create and destory
add hostpush part modify
optimize previous code
provide aclhandle access method
modify CMakeList format
add device_id parameter into TransferNode
5 years ago
xulei2020
ee09b38f00
add code for MD lite C++ include and api
5 years ago
Lixia Chen
97cd142f8d
Overwrite default port/hostname from env variables
update copyright
add examples to CacheClient docstring
5 years ago
lixian
7d2fd6e76c
cxx api refactor: tensor/status/model
5 years ago
Nat Sutyanyong
5a7dc0accc
Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer
5 years ago
yanghaitao1
83cb87bcd1
cpu profiling
add operator profiling part
add op_id param when create task
repair bugs in op cpu sampling
fix wrong order of write and parse cpu_info
add process cpu profiling part
add multiprocessing part(part 1)
adapter cpu_sampling c layer
fix little error in sampling
descrease cirle complex in voc
descrease cirle complex in device_que
5 years ago
mindspore-ci-bot
794af6d094
!11834 [MD] Fix error msg description of dataset
From: @xiefangqi
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
5 years ago
xiefangqi
3d72282f26
fix error msg issue
5 years ago
hesham
7120c66998
Add SubsetSampler
5 years ago
Lixia Chen
922e1f4f36
Migrate CacheTransformPass
5 years ago
mindspore-ci-bot
029ea5d1f3
!11301 Push sampler to GeneratorOp c++
From: @hfarahat
Reviewed-by:
Signed-off-by:
5 years ago
xsmq
73b7154e55
fix cmakelint error
5 years ago
hesham
c3278c983d
Move GeneratorOp sampler to c++
5 years ago
xiefangqi
3f76abcdee
minddata err msg add file path
5 years ago
anzhengqi
50b783ee13
fix generator or user defined sampler len method unmatch iter method
5 years ago
mindspore-ci-bot
a575af7198
!9951 Print the row_id for map when error happens
From: @alexyuyue
Reviewed-by:
Signed-off-by:
5 years ago
Cathy Wong
4b1ccf9dd5
dataset: Use int32_t for text's vocab_size
5 years ago
alex-yuyue
a7e3913210
Print the row_id for map when error happens
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
5 years ago
TinaMengtingZhang
4812fece80
[Part I] Push down json save logic to IR and add getter to each IR node
5 years ago
mindspore-ci-bot
f076bc6524
!11113 dataset: minor fixes which resolve codedex CI CONST_POINTER_PARAM alarms
From: @cathwong
Reviewed-by: @nsyca
Signed-off-by: @nsyca
5 years ago
Cathy Wong
440ddefb73
dataset: codedex CI fixes for const pointer
5 years ago
xulei2020
026cdcd6fc
fix build for md pipeline
5 years ago
mindspore-ci-bot
03e655f14a
!10070 Fixing GetDatasetSize issue with chained samplers
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
5fd77356c9
!9687 Adding AddChild functionality to SamplerObj
From: @mahdirahmanihanzaki
Reviewed-by:
Signed-off-by:
5 years ago
xiefangqi
466bf6cad3
fix get_data_info runtime error
5 years ago
mindspore-ci-bot
fbf7c88733
!10413 Minor cache changes requested by HQ
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
5 years ago
Lixia Chen
b86ad055be
Minor fix (requested by HQ)
5 years ago
Zirui Wu
0a31f563a7
minor fixes
5 years ago
luoyang
c956de3327
optimize set_num_rows log
5 years ago
mindspore-ci-bot
0c78a8a9d5
!10190 ps cache data process thread support exit when exceptions occur
From: @zyli2020
Reviewed-by: @limingqi107
Signed-off-by: @limingqi107
5 years ago
lizhenyu
1f99cd7d86
ps cache data process thread support exit when exceptions occur
5 years ago
xiefangqi
f644e9da46
Fix devicequeue multi-machine problem
5 years ago
Mahdi
98ea8fa6ea
Added tests for chain samplers, fixed GetDatasetSize issue with chained samplers
5 years ago
mindspore-ci-bot
fc11b7dd68
!10074 Fix a testcase error when shuffle is above cache
From: @lixiachen
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei,@liucunwei
5 years ago
mindspore-ci-bot
6035823c4b
!10044 fix get num classes of concat
From: @luoyang42
Reviewed-by: @liucunwei,@heleiwang,@liucunwei
Signed-off-by: @liucunwei,@liucunwei
5 years ago
Lixia Chen
a7f0e13234
Remove special treatment for cache above repeat
5 years ago
limingqi107
f223413ce9
fix ps cache data prefetch
5 years ago
YangLuo
df9f4f41e8
fix get num classes of concat
5 years ago
Xiao Tianci
633f97bb48
fix get dataset size in distributed scenario
5 years ago
mindspore-ci-bot
bccf04d36c
!8378 [MD][GPU] minddata device_que push optimizer
From: @xiefangqi
Reviewed-by:
Signed-off-by:
5 years ago
xiefangqi
ae36071fc8
add push opt logic
5 years ago
mindspore-ci-bot
95074dcb6d
!9816 add ps cache init info
From: @limingqi107
Reviewed-by: @chujinjin,@cristoval
Signed-off-by: @cristoval
5 years ago