Merge pull request !3213 from liubuyu/dev

Merge pull request !3162 from lianliguang/split-tuple-node-to-make-tuple

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

Merge pull request !3173 from kisnwang/fix-gpu-while

Merge pull request !3169 from zhoufeng/xiu-ba-ge

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

Merge pull request !2989 from kisnwang/two-step-reduce-sparse-gradient

Merge pull request !3063 from ZPaC/add-ps-training-mode

Merge pull request !3125 from zhoufeng/xiu-ba-ge

Merge pull request !3092 from VectorSL/momentum

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

Merge pull request !3033 from lianliguang/primi-decoupling-v2

fix Cppcheck error

Merge pull request !2931 from zhoufeng/liantiao1

Merge pull request !3082 from chujinjin/fix_argmaxwithvalue_error_in_pynative_mode

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

move pre-execution of debugger from rungraph to build/compile graph

support partial mem reuse for a scope of nodes

set default mem reuse to be true for debugger

remove some redundant lines

remove redundant code and fix a bug for supporting partial no mem reuse a scope of nodes

resolve CI errors

Solve CI errors

solve cpplint errors

solve CI build error

manually fix the CI compile UT error

Optimize code for mem reuse support

Debug optimization of debugger memory reuse

debug code for debugger memory reuse part2

address clang-format errors

Switch memory reuse on and off based on environment variable

Fix typo

Fix typo

Load watchpoint value only

fix bugs

Addressed comments from lupengcheng

fix typo

Fix typo

fix CI errors

refactor some code

fix typo

addressed comments from canadian teamates

remove locking from TensorLoader

fix CI errors

add lock to tensor_loader

fix rebase-to-master conflict

fix rebase conflicts

fix rebase conflicts part 2

fix rebase conflicts part 3