Merge pull request !26804 from yao_yf/virtual_dataset_avoid_auto_parallel

Merge pull request !26619 from 王志伟/parallel_ut_refactoring1

2) 'sharding_propagation' moves to 'search_mode';

Merge pull request !26006 from yao_yf/add_transformer_slice_activation_config

Merge pull request !26414 from yao_yf/fault_recover_by_mirror_group_fix_opt_shard

slice recompute activation

1) when propagate sharding strategy from one op to another, try to find the strategy with zero communication cost;
2) if there is no such strategy, find the strategy with minimum communication cost, and raise a warning;

Merge pull request !26350 from yangzhenzhang/add-check-for-resize-op

Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init

1) using 'swc index of strategy_cost_' as reshape's selected strategy;
2) when encountering reshape in BFS, select the 'swc index' with zero communication cost;
3) when encountering a reshape that is already visited, check whether there exists communication between reshape and current operator. It is OK if communication happens between two configured operators;
4) currently, two consecutive reshapes are not supported;
5) adjusting BFS structure in graph_costmodel.cc;
6) adjusting some code in step_auto_parallel.cc to avoid cyclomatic complexity.

Add support for no pipeline accugradient

Add delay tag for fusion op

Optimizer the visite order

add mirror for mini step control

Move the group to attributes

Add gradient_shard control for the mini step

Fix code stype

Fix ut description

Add interface

Merge pull request !25765 from TuDouNi/neighborExchangeV2

Merge pull request !24790 from zhuyuxiao/master

Merge pull request !24568 from zhuyuxiao/master

Merge pull request !23537 from linqingke/pangu

Merge pull request !23569 from Bert0108/resizebilinear_parallel_ops

Merge pull request !23544 from zhuyuxiao/master

Add layer norm judge

Fix layer norm name error

Fix input tyoe check

Fix ut test

Add 3d supports

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

Merge pull request !20585 from huanghui/add-security-isolate-for-DumpIR

Merge pull request !23365 from fangzehua/print_sec

1) extend the Liner cell for including BatchMatMul implementation, in
which the first dimension indicates the expert number;
2) implement a Switch (top1) router;
3) implement a MoE cell, which extends the FeedForward cell.

Merge pull request !23004 from huangxinjing/args_check

Merge pull request !21776 from mindspore_ding/set_device_id_master_0813

Merge pull request !22255 from yao_yf/recompute_interface_modify

Merge pull request !22650 from yao_yf/fixed_sparse_attention_modify