Add if else for past none

Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports

Merge pull request !23596 from Xiaoda/89-moe-adaption

fix pangu error

fix leakyrelu error

Merge pull request !23328 from huangxinjing/fix_error_msg

1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.

adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports