Merge pull request !22255 from yao_yf/recompute_interface_modify

Merge pull request !22650 from yao_yf/fixed_sparse_attention_modify

Merge pull request !21835 from zhoufeng/revert-same-input-to-comm-op

This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface

- Fix the key generating.
- Distinguish the executors.

adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports

Merge pull request !22346 from Xiaoda/86-fix-the-fullname-scope-bug

Merge pull request !22360 from huangxinjing/fix_transformer_mirror_error

Merge pull request !22386 from zhoufeng/fix-neighbor-empty-input-bak

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line

Merge pull request !21551 from yao_yf/auto_parallel_context_dataset_strategy_union

Merge pull request !21805 from yangzhenzhang/auto-parallel-support-adafactor-opt

Merge pull request !21809 from huangxinjing/transformer_improved

Merge pull request !21761 from yao_yf/comm_recompute_interface

split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers

Merge pull request !21627 from zhoufeng/alltoall_exception

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>

Merge pull request !21528 from huangxinjing/add_print

Merge pull request !20960 from lichen/add_replace_graph_for_conv2d

Merge pull request !20520 from lichen/add_op_AllToAllv

Merge pull request !20411 from gziyan/enable_opt_shard_predict