Merge pull request !26556 from lilei/modify_parallel_API_note

Merge pull request !26006 from yao_yf/add_transformer_slice_activation_config

slice recompute activation

fix matmul name

Add if else for past none

Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports

Merge pull request !23596 from Xiaoda/89-moe-adaption

fix pangu error

fix leakyrelu error

1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.

adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports