Merge pull request !3118 from jjfeing/master

Merge pull request !3140 from hexia/add_serving_option

Merge pull request !3097 from wangqiuliang/replace-unsafe-function

Removed log header

Merge pull request !3131 from zhangbuxue/change_shape_and_dtype_of_tensor_from_interface_to_attr

Merge pull request !3144 from nhussain/dataset_check

Merge pull request !3143 from TinaMengtingZhang/dataset-op-ut-mnist

Merge pull request !3101 from islam_amin/autocontrast_op

Merge pull request !3077 from ava/invert

Merge pull request !3138 from ZiruiWu/random_tensor_ops

Merge pull request !3137 from cathwong/ckw_dataset_ut_cleanup7

Merge pull request !3088 from lianliguang/primitive-decoupling

follow up

Merge pull request !3063 from ZPaC/add-ps-training-mode

Merge pull request !3045 from chenweifeng/sort

Merge pull request !3003 from chenweifeng/broadcastto

Merge pull request !3095 from Simson/push-to-opensource

Merge pull request !3050 from liuxiao93/Tan/TruncateDiv/TruncateMOd

Merge pull request !3125 from zhoufeng/xiu-ba-ge

Merge pull request !3092 from VectorSL/momentum

Merge pull request !3099 from looop5/update_akg

Merge pull request !3083 from zhaoting/master

Merge pull request !3112 from caifubi/data-dump-build

Merge pull request !2878 from mindspore_ding/checkpoint_mindspore_new

Merge pull request !3091 from VectorSL/batchnorm_grad

Merge pull request !3090 from VectorSL/batchnorm-cast

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

Merge pull request !3049 from liyong126/dataset_save_op

Merge pull request !3111 from peixu_ren/custom_gpu

Merge pull request !3033 from lianliguang/primi-decoupling-v2

Merge pull request !3069 from gziyan/optimizer_parallel_v2

Merge pull request !3081 from JoyLvliang/enable-stream-sync-when-context-is-graph-but-run-in-pynative