Merge pull request !1367 from jjfeing/master

Merge pull request !1339 from JichenZhao/layernorm_mean_var_shape

Merge pull request !1320 from JichenZhao/applyrms_squaresumall_cumprod_reduceprod

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

Merge pull request !1335 from caifubi/get-device-datatype-in-memcpy

Merge pull request !1289 from GongLiyao/add_vm_support_sin_cumsum

Merge pull request !1254 from caifubi/change-uintprt_t-to-void-ptr

Merge pull request !1299 from sunsuodong/ops_int32

Merge pull request !1282 from jiangjinsheng/vm_prelu

Merge pull request !1210 from chenweifeng/cudnn_exception

Merge pull request !1205 from chenweifeng/unsorted_segment_sum

Merge pull request !1058 from sunsuodong/lstm_ops

Merge pull request !1240 from jjfeing/master

1.Support Broadcast op
2.Support communication op as graph output
3.Optimize Communication op memory alocation
4.support hccl multi-group

Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder

iou

NMSWithMask

larsupdate testcase

sgd testcase

Merge pull request !1178 from zhouneng/add_vm_support_roialign

Merge pull request !1162 from lianliguang/using-device-dtype-to-create-transdata-kernel-build-info

Merge pull request !1113 from dengwentao/rts

Merge pull request !1155 from fary86/fix_bug_of_log_interface

1.GLOG_v can not control log level of MindData
2.Sub module ids of some source files under directory `kernel` and `device` are incorrect
3.GLOG_v can not control log level when using dlog

Merge pull request !1132 from lianliguang/add-attr-op-pattern-to-kernel-build-info

Merge pull request !1115 from wangcong/master

Merge pull request !1128 from Margaret_wangrui/master