Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init

1) using 'swc index of strategy_cost_' as reshape's selected strategy;
2) when encountering reshape in BFS, select the 'swc index' with zero communication cost;
3) when encountering a reshape that is already visited, check whether there exists communication between reshape and current operator. It is OK if communication happens between two configured operators;
4) currently, two consecutive reshapes are not supported;
5) adjusting BFS structure in graph_costmodel.cc;
6) adjusting some code in step_auto_parallel.cc to avoid cyclomatic complexity.

Add support for no pipeline accugradient

Add delay tag for fusion op

Optimizer the visite order

add mirror for mini step control

Move the group to attributes

Add gradient_shard control for the mini step

Fix code stype

Fix ut description

Add interface

Merge pull request !25765 from TuDouNi/neighborExchangeV2

Merge pull request !24790 from zhuyuxiao/master

Merge pull request !24568 from zhuyuxiao/master

Merge pull request !23537 from linqingke/pangu

Merge pull request !23569 from Bert0108/resizebilinear_parallel_ops

Merge pull request !23544 from zhuyuxiao/master

Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

Merge pull request !20585 from huanghui/add-security-isolate-for-DumpIR

Merge pull request !23365 from fangzehua/print_sec

1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.

Merge pull request !23004 from huangxinjing/args_check

Merge pull request !21776 from mindspore_ding/set_device_id_master_0813

Merge pull request !22255 from yao_yf/recompute_interface_modify

Merge pull request !22650 from yao_yf/fixed_sparse_attention_modify

Merge pull request !21835 from zhoufeng/revert-same-input-to-comm-op

This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface

- Fix the key generating.
- Distinguish the executors.

adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports

Merge pull request !22346 from Xiaoda/86-fix-the-fullname-scope-bug

Merge pull request !22360 from huangxinjing/fix_transformer_mirror_error

Merge pull request !22386 from zhoufeng/fix-neighbor-empty-input-bak

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>