Merge pull request !4500 from yuchaojie/transformer_st

Merge pull request !4412 from linqingke/mass

Merge pull request !4459 from chengxb7532/master

Merge pull request !4460 from zongha/master

Merge pull request !4284 from yao_yf/remove_to_full_tensor_and_load_inputs_in_exexute_stage

2nd for update thor bert

Merge pull request !4391 from chenfei_mindspore/master

Merge pull request !4319 from chengxb7532/master

Merge pull request !3942 from yao_yf/embeddinglookup_wrap

Merge pull request !4187 from hanhuifeng/tinybert_suit_gpu

Merge pull request !4269 from fary86/change_export_interface

Merge pull request !4275 from yuchaojie/add_allreduce_group_for_resnet_gpu

Merge pull request !4097 from gengdongjie/master

Merge pull request !4272 from yoonlee666/bugfix

Merge pull request !4053 from panbingao/master

Merge pull request !4227 from panbingao/pylintfix

Merge pull request !4186 from yoonlee666/bugfix

Merge pull request !4193 from wukesong/modify_epoch

Merge pull request !4199 from chenzhongming/quant

Merge pull request !4181 from zhouyaqiang0/master

Merge pull request !4041 from chengxb7532/master

Merge pull request !4122 from yoonlee666/master_bug

Merge pull request !4092 from vlne-v1/quant-matmul-fix