for bert_thor 2nd

for bert_thor 3rd

for bert_thor 4th

Merge pull request !3531 from baihuawei/0727

Merge pull request !3540 from liyong126/fix_mindrecord_log

Merge pull request !3569 from xiefangqi/md_fix_flat_head

Merge pull request !3236 from lingyunli63/use_full_akg_to_support_gpu

Merge pull request !3507 from Giancarlo/pm_commutative_ops

Merge pull request !3532 from guansongsong/gss_fix_api

Merge pull request !3571 from guansongsong/gss/fix_cache_core

Merge pull request !3453 from zichun_ye/resolve_attr_pr

Merge pull request !3565 from fary86/adjust_format_and_check_scripts

Merge pull request !3521 from caojian05/ms_master_dev3

Merge pull request !3568 from zhangbuxue/support_bprop_for_const_in_pynative_mode_and_develop_stridedslice

Create a new pass named ValueBasedEliminate to reduce the load of Arithmetic Simplify

Code review

Merge pull request !3562 from yuchaojie/add_nccl_default_allreduce_fusion_group

update logic for cache

clean up code

add test cases for new api

update include of code

specify the resolve attr to ClassMember

avoid resolve attr of self

directory 'mindspore/core'

Merge pull request !3472 from Xiaoda/13-add-gpu-costmodel

Merge pull request !3528 from Simson/push-to-opensource

Merge pull request !3435 from yangzhenzhang/add-tile-op

added cdf, logcdf, survival, logsurvival, entropy, mode, cross_entropy wrapper

Merge pull request !3550 from JesseKLee/merge_op_fix

Merge pull request !3449 from MahdiRahmaniHanzaki/cifar100-c-api

Merge pull request !3508 from ms_yan/vgg_gpu

merge the script

optimize the script

Merge pull request !3529 from ZPaC/pass-optimizer-attrs-to-push

Merge pull request !3519 from anzhengqi/remove-log

Merge pull request !3538 from LiHongzhang/f50_t20

Merge pull request !3534 from chenfei_mindspore/release-make-tuple-of-load-input-data

Merge pull request !3526 from dinghao/master

Merge pull request !3484 from caifubi/data-dump