huangbingjian
66309632c1
fix the negative axis problem of reduce_eliminate
4 years ago
lianliguang
0dc5d7f4f9
modify some eroor log and remove some useless code
4 years ago
huanghui
767caad833
Support fused node corresponding code print
4 years ago
i-robot
b472850a75
!26594 Replace std::unordered_map/set with robin-hood-hashing
Merge pull request !26594 from hewei/use_robin_hood
4 years ago
i-robot
519f14a909
!26006 slice recompute activation
Merge pull request !26006 from yao_yf/add_transformer_slice_activation_config
4 years ago
He Wei
41dcac9c49
Replace std::unordered_map/set with robin-hood-hashing
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing )
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.
1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
- mindspore::HashMap as an alias of robin_hood::unordered_map;
- mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
- `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
- `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
- `std::unordered_map` --> `mindspore::HashMap`;
- `std::unordered_set` --> `mindspore::HashSet`;
- `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
- `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
- AnfNodeConfig hash and equal;
- Fix a bug in `Slice::operator==()`;
- Fix a bug in `CNode::HasPrimalAttr()`;
- Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
- Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
- As parameter of functions that exposed to python by pybind11;
- Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
4 years ago
i-robot
e6ad3f42b1
!26524 clean code, fix cyclomatic complexity problems
Merge pull request !26524 from huangbingjian/clean_code_master
4 years ago
i-robot
3269c9b881
!26335 Support MindSpore on MacOS
Merge pull request !26335 from xulei/ms_mac_compile_br
4 years ago
yao_yf
188d39da83
slice_activation_in_recompute
slice recompute activation
4 years ago
huangbingjian
e623173965
clean code
4 years ago
i-robot
32fe511d76
!26198 After the env_getitem nodes are eliminated, eliminate the remaining env_setitem with updatestate.
Merge pull request !26198 from Margaret_wangrui/env_updatestate
4 years ago
xiefangqi
24ac2382ff
mac compile
4 years ago
Margaret_wangrui
d4e13790c9
After the env_getitem nodes are eliminated, eliminate the remaining env_setitem with updatestate
4 years ago
huanghui
35cb09a536
compiler support dump flag
4 years ago
He Wei
c7910cbd37
Fix cyclomatic complexity
4 years ago
i-robot
ae87f31dea
!25088 Optimize the comment and log descriptions for the python source code
Merge pull request !25088 from zhunaipan/master
4 years ago
zhunaipan
8ce4e62725
optimize the comment and log description
修改: ops/operations/_inner_ops.py
修改: ops/operations/_quant_ops.py
修改: ops/operations/array_ops.py
修改: ops/operations/comm_ops.py
修改: ops/operations/math_ops.py
修改: ops/operations/quantum_ops.py
修改: ops/operations/rl_ops.py
修改: ops/operations/sponge_ops.py
修改: ops/operations/sponge_update_ops.py
修改: train/__init__.py
修改: common/tensor.py
修改: train/serialization.py
修改: ccsrc/pipeline/jit/parse/parse.h
修改: explainer/benchmark/_attribution/metric.py
修改: ops/composite/multitype_ops/_constexpr_utils.py
修改: ops/operations/comm_ops.py
修改: RELEASE.md
修改: mindspore/_extends/parse/standard_method.py
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
修改: mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
修改: mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
修改: mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
修改: mindspore/ccsrc/frontend/parallel/strategy.h
修改: mindspore/common/tensor.py
修改: mindspore/core/abstract/prim_arrays.cc
修改: mindspore/core/abstract/prim_nn.cc
修改: mindspore/core/ops/conv2d.cc
修改: mindspore/core/ops/logical_and.h
修改: mindspore/core/ops/logical_not.h
修改: mindspore/core/ops/logical_or.h
修改: mindspore/core/ops/reduce_all.h
修改: mindspore/core/ops/reduce_any.h
修改: mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
修改: mindspore/nn/layer/quant.py
修改: mindspore/nn/optim/sgd.py
修改: mindspore/nn/sparse/sparse.py
修改: mindspore/numpy/array_creations.py
修改: mindspore/numpy/array_ops.py
修改: mindspore/numpy/logic_ops.py
修改: mindspore/numpy/math_ops.py
修改: mindspore/ops/operations/_inner_ops.py
修改: mindspore/ops/operations/array_ops.py
修改: mindspore/ops/operations/rl_ops.py
修改: mindspore/train/_utils.py
修改: tests/ut/python/model/test_lenet_core_after_exception.py
修改: mindspore/_extends/parse/standard_method.py
修改: mindspore/ops/operations/rl_ops.py
修改: mindspore/core/abstract/prim_nn.cc
修改: mindspore/core/ops/conv2d.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
修改: mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
修改: mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
修改: mindspore/ccsrc/fl/server/server.cc
修改: mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
修改: mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
修改: mindspore/ccsrc/frontend/optimizer/irpass/inline.h
修改: mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
修改: mindspore/ccsrc/minddata/dataset/core/tensor.cc
修改: mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
修改: mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
修改: mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
修改: mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
修改: mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
修改: mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
修改: mindspore/ccsrc/pipeline/jit/action.cc
修改: mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
修改: mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
修改: mindspore/compression/quant/quant_utils.py
修改: mindspore/core/abstract/prim_nn.cc
修改: mindspore/dataset/engine/validators.py
修改: mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
修改: mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
修改: mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
修改: mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
修改: mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
修改: mindspore/lite/tools/common/graph_util.h
修改: mindspore/lite/tools/optimizer/fisson/fisson_util.cc
修改: mindspore/ops/composite/math_ops.py
修改: mindspore/ops/operations/_inner_ops.py
修改: mindspore/ops/operations/array_ops.py
修改: mindspore/ops/operations/math_ops.py
修改: mindspore/ops/operations/other_ops.py
修改: mindspore/boost/boost_cell_wrapper.py
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
修改: mindspore/ccsrc/common/trans.cc
修改: mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
修改: mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
修改: mindspore/lite/src/common/log_util.h
修改: mindspore/nn/wrap/loss_scale.py
修改: mindspore/parallel/nn/moe.py
修改: tests/mindspore_test_framework/mindspore_test.py
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
修改: mindspore/lite/tools/common/graph_util.h
修改: mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
修改: mindspore/core/ops/conv2d.cc
修改: tests/ut/python/model/test_lenet_core_after_exception.py
4 years ago
i-robot
8cf8e4ddd3
!21778 support tensor slice when slice result should be caculated in runtime mode
Merge pull request !21778 from lianliguang/support-dynamic-slice
4 years ago
i-robot
cf54d0c158
!24897 set abstract in TupleListGetitemDependReorder
Merge pull request !24897 from huangbingjian/abstract_master
4 years ago
fangzehua
53009276d1
add cpu dynamic memory
4 years ago
lianliguang
72c7706d22
support dynamic slice in runtime mode
4 years ago
huangbingjian
b1a654424f
set abstract in TupleListGetitemDependReorder
4 years ago
i-robot
338ab157c7
!24193 fix endless loop in analyze phase
Merge pull request !24193 from xychow/fix-analyze-endless-loop
4 years ago
zhousiyi
3a4aae8df9
Eval shortcircuit abstract from primal abstract if it's a fprop
4 years ago
i-robot
37aa41f5d2
!24145 Fix output type mismatch of ResizeBilinear
Merge pull request !24145 from chenhaozhe/fix-resizebilinear-mismatch
4 years ago
Margaret_wangrui
a944ed0625
eliminate env_setitem in maketuple which attach upadtestate and no other user use
4 years ago
chenhaozhe
b7b6b3ccb5
Add temporary patch for output type dismatch of ResizeBilinear
4 years ago
i-robot
11c3e1c193
!24051 Pclint and docs fix.
Merge pull request !24051 from linqingke/bug_fix
4 years ago
i-robot
9eebaefa2c
!24040 Add constraints of control flow with side effect
Merge pull request !24040 from chenfei_mindspore/add_constraint_of_control_side_effect_train
4 years ago
i-robot
2eb47e4296
!23524 Eliminate useless FuncGraph
Merge pull request !23524 from Margaret_wangrui/remove_unuse_func
4 years ago
linqingke
2e697ab110
pclint and docs fix.
4 years ago
i-robot
f98cc8dce2
!23599 Handle real to complex in bprob
Merge pull request !23599 from zhouyaqiang0/complex_ops
4 years ago
chenfei
393e22aa16
add check switch with side effect
4 years ago
zhouyaqiang
3d01cb0c3d
handle real to complex bprob
4 years ago
i-robot
d9e6edfc9f
!23669 Fix inline pass problem in switch.
Merge pull request !23669 from LiangZhibo/inline
4 years ago
l00591931
092fcc40c9
Fix inline pass problem on switch
4 years ago
i-robot
54b7175ea0
!23744 Fix codedex warning
Merge pull request !23744 from LiangZhibo/codedex
4 years ago
i-robot
2c9a7b03ac
!23771 Fix boost docs problems.
Merge pull request !23771 from linqingke/bug_fix
4 years ago
linqingke
b3b319d5ca
fix boost docs problems.
4 years ago
i-robot
b825fd281d
!23697 fix warnings of pclint plus, codedex and codecheck at 0917
Merge pull request !23697 from huanghui/clean-warnings-0917
4 years ago
huanghui
80416a71e0
fix warnings of pclint plus, codedex and codecheck
4 years ago
jiangshuqiang
c2bd061889
fix summary isolation
4 years ago
l00591931
247386af9b
Fix codedex
4 years ago
Margaret_wangrui
f261ad55f3
1、Eliminate useless FuncGraph 2、fix problem which node used by incorporate_call and updatestate
4 years ago
7347157+joylvliang@user.noreply.gitee.com
6e59598f99
correct_wrong_info_when_using_ms_function_with_bprop
4 years ago
i-robot
7db248e084
!21933 Fix unknown kernel select failed.
Merge pull request !21933 from linqingke/bug_fix
4 years ago
i-robot
19848c2ec3
!22995 Clean PClint
Merge pull request !22995 from Margaret_wangrui/pclint_clean
4 years ago
yao_yf
d749690a61
adjust parallel optimizer recompute allgather depend
4 years ago
Margaret_wangrui
f678962c0e
PClint clean
4 years ago
linqingke
dd852c18e0
Fix unknown node bug.
4 years ago