Merge pull request !30494 from YuJianfeng/recompute

Merge pull request !30531 from zhuyuxiao/I4S85V_doc

Merge pull request !29997 from Xiaoda/124-moe-changes

Merge pull request !30512 from zhangyi/code_docs_master

Merge pull request !30432 from changzherui/add_ckpt_check

Merge pull request !30460 from xiaotianci/modify_api_docs

1) extending _Linear's input as 4-dimension tensor: [outer_batch, expert_dim, -1, hidden], and _Liner's BatchMatMul becomes BatchMatMul(4_dim_tensor, 3_dim_tensor);
2) configuring the _Linear's BatchMatMul sharding strategy as [[dp, ep, 1, 1], [ep, 1, mp]];
3) introducing a new parameter 'expert_parallel' in TransformerOpParallelConfig, creating a new class MoEParallelConfig to include 'data_parallel', 'model_parallel' and 'expert_parallel';
4) changing parallel config for FeedForward, TransformerEncoderLayer, TransformerDecoderLayer.

Merge pull request !30329 from luoyang/code_docs_chinese

Merge pull request !30170 from shenwei41/code_docs_chinese

Merge pull request !30374 from jinjiali-kali/code_docs_master

Merge pull request !30269 from zhangfanghe/code_docs_zfh_20220219_nn

Merge pull request !30271 from zhangfanghe/code_docs_zfh_20220219_ops1

Merge pull request !30272 from zhangfanghe/code_docs_zfh_20220219_ops2

Merge pull request !30346 from lianliguang/code_docs_ms

Merge pull request !30085 from lichen/code_docs_add_transformer_api

Merge pull request !30195 from linqingke/code_docs_api

Merge pull request !30254 from Songyuanwei/api

Merge pull request !30026 from liyong126/add_mindrecord_chn_doc

Merge pull request !30192 from xiaotianci/code_docs_add_chinese_api

Merge pull request !30033 from maning202007/code_docs_dump_api

Merge pull request !30044 from changzherui/mod_cn_api3

Merge pull request !30172 from huangbingjian/code_docs_memory

Merge pull request !29947 from zhangfanghe/code_docs_zfh_20220111