lizhenyu
8bddfba9e2
fix ps cache process data thread can not exit
5 years ago
He Wei
7d9a783993
[auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.
The ControlDepend primitive is removed and there are two primitives added:
1. UpdateState:
```
a = Assign(para, value)
```
became:
```
a = Assign(para, value, u)
u = UpdateState(u, a)
```
2. Load:
```
x = Add(para, value)
```
became:
```
p = Load(para, u)
x = Add(p, value)
u = UpdateState(u, p)
```
5 years ago
lizhenyu
6649153c49
add input data type check for ps cache mode
5 years ago
chendongsheng
40f2571f7e
added http client
5 years ago
gaoyong10
124e82de3b
fix distribute train in sprase mode
5 years ago
lizhenyu
f17534af08
ps cache support sparse
5 years ago
mindspore-ci-bot
16944856f9
!11457 PS cache insert linear
From: @gaoyong10
Reviewed-by:
Signed-off-by:
5 years ago
chendongsheng
a43d0f8767
fixed message header
5 years ago
gaoyong10
5bdd2eb18c
ps cache parse linear
5 years ago
chendongsheng
c7fe82b43d
Custom data transmission format
5 years ago
xsmq
73b7154e55
fix cmakelint error
5 years ago
mindspore-ci-bot
6728e47ca7
!11216 Optimized code
From: @anancds
Reviewed-by:
Signed-off-by:
5 years ago
mindspore-ci-bot
16d19f2d26
!11293 PS Cache ParseData Parallel
From: @gaoyong10
Reviewed-by:
Signed-off-by:
5 years ago
gaoyong10
600f95553a
ps cache parse parallel
5 years ago
chendongsheng
09a15be893
protobuf change bytes to Any
5 years ago
chendongsheng
048534b75e
Switch bare pointer to shared_ptr
5 years ago
mindspore-ci-bot
16a7265c91
!10991 ps cache performance refine
From: @zyli2020
Reviewed-by: @cristoval,@limingqi107
Signed-off-by: @limingqi107
5 years ago
limingqi107
798cca42e5
ps cache code review
5 years ago
lizhenyu
e13deeea72
ps cache performance refine
5 years ago
chendongsheng
b289c6184a
added retry and unit test
5 years ago
lizhenyu
7eb49cfce7
[bugfix] server core dump after traning
5 years ago
mindspore-ci-bot
b96d4315dc
!10393 added collective send and receive
From: @anancds
Reviewed-by:
Signed-off-by:
5 years ago
limingqi107
eb98e55843
fix ascend ps cache loss invaild
5 years ago
chendongsheng
24345595f3
added collective send and receive
5 years ago
limingqi107
5227d6d16d
fix ps cache error print
5 years ago
limingqi107
951570a089
ps cache sync before release res
5 years ago
limingqi107
b42b9b6c80
fix the ps cache data channel dead lock
5 years ago
mindspore-ci-bot
5d94eaff21
!10303 ps cache support save checkpoint
From: @zyli2020
Reviewed-by:
Signed-off-by:
5 years ago
lizhenyu
4269dcece5
ps cache support save checkpoint
5 years ago
chendongsheng
ee23af58d8
fixed codex
5 years ago
limingqi107
01e9ca5922
support ps cache data process thread exit
5 years ago
lizhenyu
1f99cd7d86
ps cache data process thread support exit when exceptions occur
5 years ago
lizhenyu
ecb64b8e14
[bugfix]:add ps cache status reset
5 years ago
limingqi107
a844d52b42
add ps cache check
5 years ago
chendongsheng
6226f21f1d
added scheduler node
5 years ago
mindspore-ci-bot
d5a2489acc
!9934 Supports embedding table with broadcast slicer
From: @zpac
Reviewed-by: @limingqi107,@kisnwang
Signed-off-by: @kisnwang
5 years ago
ZPaC
db629a9382
Supports embedding table with broadcast slicer
5 years ago
chendongsheng
2d2bf2d0ee
added server node
5 years ago
mindspore-ci-bot
95074dcb6d
!9816 add ps cache init info
From: @limingqi107
Reviewed-by: @chujinjin,@cristoval
Signed-off-by: @cristoval
5 years ago
limingqi107
31dd182a49
add ps cache init info
5 years ago
chendongsheng
ee4132889e
added worker node
5 years ago
lizhenyu
e3f7ae61db
add ps cache manager
5 years ago
limingqi107
eca951c7bc
add ps cache manager
5 years ago
limingqi107
660a087ffd
add ps cache
5 years ago
limingqi107
a5f57ce8a0
add ps cache
5 years ago
chendongsheng
72980a8a48
added node
5 years ago
anancds
fc380b8071
updated cluster config and proto
5 years ago
mindspore-ci-bot
77dca3ef0b
!8973 Fix int64_t error in ps mode
From: @zpac
Reviewed-by: @kisnwang,@limingqi107
Signed-off-by: @limingqi107
5 years ago
ZPaC
8f6ba323cb
Fix int64_t error is ps mode
5 years ago
anancds
7c73bc50f4
fixed codex
5 years ago