Merge pull request !976 from zhaozhenlong/adapt-lamb-nextmv-with-decay

Merge pull request !952 from thlinh/dev_May6th_improve_zero_fill_like_zero

Merge pull request !990 from casgj/gaojing

new subtree with 9 nodes and after that a Renormalize pass is needed to simplified it back to a tensor. The new algorithm will
create the tensor while visiting in the pass, therefore only a single node is created and no Renormalize will be needed for this pass
(if other passes requires then Renormalize will still be called but no further infer is needed for the created tensor)

Signed-off-by: Hoai Linh Tran h00472437 <hoai.linh.tran@huawei.com>

Code review

Merge pull request !985 from jjfeing/master

Merge pull request !971 from Simson/push-to-opensource

Merge pull request !956 from zjun/optimize_host_trans

Merge pull request !975 from Etone.Chan/master

Merge pull request !973 from huanghui/enhance-add-memcpy-async-pass

Merge pull request !978 from xulei/filter_op

Merge pull request !979 from ms_yan/rename_columns

Merge pull request !960 from EricZ/grayscale_fix

Merge pull request !507 from ZiruiWu/batch_with_padding

Merge pull request !951 from guozhijian/fix_read_by_columns

Merge pull request !982 from JesseKLee/bad_rc

support for 1 specific dimension to be None, added validator

fix various CI complains

another round of CI fixes

ci

refactor parts of the code

code refactor

ci fix

comments added, fix bugs

address review comments

address review comments

review cmts

added simple perf test script

update pad code

perf imprv

Merge pull request !969 from liyong126/fix_mindrecord_pk_sampler

Merge pull request !974 from zhaoting/master

Merge pull request !968 from zhouneng/add_examples_for_nn

Merge pull request !965 from JichenZhao/globalbn_doc_fix

Merge pull request !937 from JoyLvliang/fix-set-output-addr-fail-in-gpu-pynative

Merge pull request !935 from zhangbuxue/develop_scatter_max_op_and_dock_ge

Merge pull request !970 from huanghui/update-print-log-level

Merge pull request !957 from jiangjinsheng/space_to_batch

Merge pull request !322 from chenweifeng/rmsprop

Merge pull request !323 from chenweifeng/concat

Merge pull request !324 from chenweifeng/slice

Merge pull request !372 from chenweifeng/batchmatmul

Merge pull request !502 from chenweifeng/gelu

Merge pull request !516 from chenweifeng/tanh

Merge pull request !945 from chenweifeng/unary

Merge pull request !812 from jinyaohui/train_eval

Merge pull request !962 from VectorSL/conv-init-update

Merge pull request !859 from Xiaoda/support-inferring-phase-parallel-strategy-searching

Merge pull request !934 from chenweifeng/broadcast