Merge pull request !26918 from lichen/pipeline_adapt_interleaved

Merge pull request !26804 from yao_yf/virtual_dataset_avoid_auto_parallel

Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.

Merge pull request !26600 from Xiaoda/105-adjusting-sharding-propagation

Merge pull request !26572 from yao_yf/virtual_dataset_fix_repeat_right

Merge pull request !26383 from yao_yf/reshape_dont_replace_shape_when_no_other_redistribution

Merge pull request !26335 from xulei/ms_mac_compile_br

1) when propagate sharding strategy from one op to another, try to find the strategy with zero communication cost;
2) if there is no such strategy, find the strategy with minimum communication cost, and raise a warning;

Merge pull request !26350 from yangzhenzhang/add-check-for-resize-op

Merge pull request !26292 from Cononlly/master

Merge pull request !26276 from Xiaoda/100-adjusting-for-cycle-complexity

Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init

1) using 'swc index of strategy_cost_' as reshape's selected strategy;
2) when encountering reshape in BFS, select the 'swc index' with zero communication cost;
3) when encountering a reshape that is already visited, check whether there exists communication between reshape and current operator. It is OK if communication happens between two configured operators;
4) currently, two consecutive reshapes are not supported;
5) adjusting BFS structure in graph_costmodel.cc;
6) adjusting some code in step_auto_parallel.cc to avoid cyclomatic complexity.

Add support for no pipeline accugradient

Add delay tag for fusion op

Optimizer the visite order

add mirror for mini step control

Move the group to attributes

Add gradient_shard control for the mini step

Fix code stype

Fix ut description

Add interface

Merge pull request !25765 from TuDouNi/neighborExchangeV2

Merge pull request !25544 from yangzhenzhang/add-parallel-op-for-resizenearestneighbor

修改：     ops/operations/_inner_ops.py
	修改：     ops/operations/_quant_ops.py
	修改：     ops/operations/array_ops.py
	修改：     ops/operations/comm_ops.py
	修改：     ops/operations/math_ops.py
	修改：     ops/operations/quantum_ops.py
	修改：     ops/operations/rl_ops.py
	修改：     ops/operations/sponge_ops.py
	修改：     ops/operations/sponge_update_ops.py
	修改：     train/__init__.py
	修改：     common/tensor.py
	修改：     train/serialization.py
	修改：     ccsrc/pipeline/jit/parse/parse.h
	修改：     explainer/benchmark/_attribution/metric.py
	修改：     ops/composite/multitype_ops/_constexpr_utils.py
	修改：     ops/operations/comm_ops.py

	修改：     RELEASE.md
	修改：     mindspore/_extends/parse/standard_method.py
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
	修改：     mindspore/ccsrc/frontend/parallel/strategy.h
	修改：     mindspore/common/tensor.py
	修改：     mindspore/core/abstract/prim_arrays.cc
	修改：     mindspore/core/abstract/prim_nn.cc
	修改：     mindspore/core/ops/conv2d.cc
	修改：     mindspore/core/ops/logical_and.h
	修改：     mindspore/core/ops/logical_not.h
	修改：     mindspore/core/ops/logical_or.h
	修改：     mindspore/core/ops/reduce_all.h
	修改：     mindspore/core/ops/reduce_any.h
	修改：     mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
	修改：     mindspore/nn/layer/quant.py
	修改：     mindspore/nn/optim/sgd.py
	修改：     mindspore/nn/sparse/sparse.py
	修改：     mindspore/numpy/array_creations.py
	修改：     mindspore/numpy/array_ops.py
	修改：     mindspore/numpy/logic_ops.py
	修改：     mindspore/numpy/math_ops.py
	修改：     mindspore/ops/operations/_inner_ops.py
	修改：     mindspore/ops/operations/array_ops.py
	修改：     mindspore/ops/operations/rl_ops.py
	修改：     mindspore/train/_utils.py
	修改：     tests/ut/python/model/test_lenet_core_after_exception.py

	修改：     mindspore/_extends/parse/standard_method.py
	修改：     mindspore/ops/operations/rl_ops.py

	修改：     mindspore/core/abstract/prim_nn.cc
	修改：     mindspore/core/ops/conv2d.cc

	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改：     mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
	修改：     mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
	修改：     mindspore/ccsrc/fl/server/server.cc
	修改：     mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
	修改：     mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
	修改：     mindspore/ccsrc/frontend/optimizer/irpass/inline.h
	修改：     mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
	修改：     mindspore/ccsrc/minddata/dataset/core/tensor.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
	修改：     mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
	修改：     mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
	修改：     mindspore/ccsrc/pipeline/jit/action.cc
	修改：     mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
	修改：     mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
	修改：     mindspore/compression/quant/quant_utils.py
	修改：     mindspore/core/abstract/prim_nn.cc
	修改：     mindspore/dataset/engine/validators.py
	修改：     mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
	修改：     mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
	修改：     mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
	修改：     mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
	修改：     mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
	修改：     mindspore/lite/tools/common/graph_util.h
	修改：     mindspore/lite/tools/optimizer/fisson/fisson_util.cc
	修改：     mindspore/ops/composite/math_ops.py
	修改：     mindspore/ops/operations/_inner_ops.py
	修改：     mindspore/ops/operations/array_ops.py
	修改：     mindspore/ops/operations/math_ops.py
	修改：     mindspore/ops/operations/other_ops.py

	修改：     mindspore/boost/boost_cell_wrapper.py
	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
	修改：     mindspore/ccsrc/common/trans.cc
	修改：     mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
	修改：     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
	修改：     mindspore/lite/src/common/log_util.h
	修改：     mindspore/nn/wrap/loss_scale.py
	修改：     mindspore/parallel/nn/moe.py
	修改：     tests/mindspore_test_framework/mindspore_test.py

	修改：     mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
	修改：     mindspore/lite/tools/common/graph_util.h

	修改：     mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc

	修改：     mindspore/core/ops/conv2d.cc

	修改：     tests/ut/python/model/test_lenet_core_after_exception.py

Merge pull request !23569 from Bert0108/resizebilinear_parallel_ops

Merge pull request !24024 from Margaret_wangrui/StandardNormal_gpu_kernel_select

Merge pull request !23544 from zhuyuxiao/master

Merge pull request !23351 from wangjun/uniformreal_parallel_ops

Merge pull request !23675 from yangzhenzhang/check-data-format-for-conv2d

Merge pull request !23635 from lichen/fix_DTS

Signed-off-by: zhoufeng <zhoufeng54@huawei.com>