huanghui
c4d61629b5
fix wrong scope and debug info
4 years ago
i-robot
6f95837c0e
!26825 [Fallback] supports the use of attr/method on the interpreted nodes
Merge pull request !26825 from huangbingjian/support_numpy_method
4 years ago
i-robot
d1e4e674ab
!26690 Add supoort resolving outer lambda function for ops.Partial.
Merge pull request !26690 from hezhenhao1/add_lambda
4 years ago
huangbingjian
cf4a4ba900
Partially support numpy attr/method
4 years ago
hezhenhao1
4af312d17e
Add supoort resolving outer lambda function for ops.Partial.
4 years ago
Margaret_wangrui
922678edef
Revert "Add the check of function return None."
This reverts commit f9a384456a .
4 years ago
i-robot
d251800c62
!26705 Add the check of function return None.
Merge pull request !26705 from Margaret_wangrui/return_none
4 years ago
Margaret_wangrui
f9a384456a
Add the check of function return None.
4 years ago
He Wei
41dcac9c49
Replace std::unordered_map/set with robin-hood-hashing
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing )
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.
1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
- mindspore::HashMap as an alias of robin_hood::unordered_map;
- mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
- `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
- `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
- `std::unordered_map` --> `mindspore::HashMap`;
- `std::unordered_set` --> `mindspore::HashSet`;
- `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
- `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
- AnfNodeConfig hash and equal;
- Fix a bug in `Slice::operator==()`;
- Fix a bug in `CNode::HasPrimalAttr()`;
- Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
- Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
- As parameter of functions that exposed to python by pybind11;
- Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
4 years ago
i-robot
9dfe08b805
!25909 [Fallback] Add global Py param when processing global namespace info
Merge pull request !25909 from huangbingjian/update_global_params
4 years ago
i-robot
aad9d146a3
!26166 optimize mixed precision performance for pynative
Merge pull request !26166 from chujinjin/optimize_mixed_precision_performance_for_pynative
4 years ago
chujinjin
4eebb43f62
optimize mixed precision performance for pynative
4 years ago
Margaret_wangrui
5ed8a9c918
Ignore the check with FuncGraph node in AddLocalPyParam.
4 years ago
i-robot
9b00c2d941
!26047 [ME][Fallback] Modify fallback log level
Merge pull request !26047 from Margaret_wangrui/fallback_log
4 years ago
Margaret_wangrui
ea95e2c7d2
modify fallback log level
4 years ago
zjun
2e3a7ee839
Improve the hit rate of tensor
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
huangbingjian
d0ca18b921
Add global Py param when processing global namespace info.
4 years ago
i-robot
3fbc32fa13
!25531 Avoid repeat specilized of while header
Merge pull request !25531 from chenfei_mindspore/tracking_id_fix
4 years ago
He Wei
fd8bbb4d96
Optimize isa() and type id related code.
1. Let 'isa<T>()' calls 'IsSameTypeId()' when T is final,
and we add 'final' mark to some final classes derived from Base;
2. Generate type id at compile time using constexpr hash function,
remove TypeIdManager and related code;
3. Add a tool script 'scripts/check_tid.sh' to check tid uniqueness;
4. Improve type search in 'proto_exporter.cc' and 'convert_utils_py.cc';
5. Add some missed MS_DECLARE_PARENT;
6. Ensure calls of 'parent_t::IsFromTypeId()' are all inlined.
4 years ago
i-robot
3a5c3e9955
!25528 [Fallback] Not add the node of function type into local dict.
Merge pull request !25528 from 张清华/opt_fallback
4 years ago
Zhang Qinghua
46fe2d92f0
[Fallback] Not add the node of function type into local dict.
4 years ago
Margaret_wangrui
6275cdcf7a
add fallback testcases
4 years ago
Zhang Qinghua
e8b421fe6e
Enable JIT Fallback in default.
4 years ago
chenfei
5d452d4140
avoid while header twice specilized because of tracking id
4 years ago
i-robot
6f413ee29d
!25155 Support ops, nn and numpy namespaces, and add test case.
Merge pull request !25155 from 张清华/opt_fallback
4 years ago
Zhang Qinghua
6a79e262ae
Support ops, nn and numpy namespaces, and add test case.
4 years ago
i-robot
ae87f31dea
!25088 Optimize the comment and log descriptions for the python source code
Merge pull request !25088 from zhunaipan/master
4 years ago
zhunaipan
8ce4e62725
optimize the comment and log description
修改: ops/operations/_inner_ops.py
修改: ops/operations/_quant_ops.py
修改: ops/operations/array_ops.py
修改: ops/operations/comm_ops.py
修改: ops/operations/math_ops.py
修改: ops/operations/quantum_ops.py
修改: ops/operations/rl_ops.py
修改: ops/operations/sponge_ops.py
修改: ops/operations/sponge_update_ops.py
修改: train/__init__.py
修改: common/tensor.py
修改: train/serialization.py
修改: ccsrc/pipeline/jit/parse/parse.h
修改: explainer/benchmark/_attribution/metric.py
修改: ops/composite/multitype_ops/_constexpr_utils.py
修改: ops/operations/comm_ops.py
修改: RELEASE.md
修改: mindspore/_extends/parse/standard_method.py
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
修改: mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
修改: mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
修改: mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
修改: mindspore/ccsrc/frontend/parallel/strategy.h
修改: mindspore/common/tensor.py
修改: mindspore/core/abstract/prim_arrays.cc
修改: mindspore/core/abstract/prim_nn.cc
修改: mindspore/core/ops/conv2d.cc
修改: mindspore/core/ops/logical_and.h
修改: mindspore/core/ops/logical_not.h
修改: mindspore/core/ops/logical_or.h
修改: mindspore/core/ops/reduce_all.h
修改: mindspore/core/ops/reduce_any.h
修改: mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
修改: mindspore/nn/layer/quant.py
修改: mindspore/nn/optim/sgd.py
修改: mindspore/nn/sparse/sparse.py
修改: mindspore/numpy/array_creations.py
修改: mindspore/numpy/array_ops.py
修改: mindspore/numpy/logic_ops.py
修改: mindspore/numpy/math_ops.py
修改: mindspore/ops/operations/_inner_ops.py
修改: mindspore/ops/operations/array_ops.py
修改: mindspore/ops/operations/rl_ops.py
修改: mindspore/train/_utils.py
修改: tests/ut/python/model/test_lenet_core_after_exception.py
修改: mindspore/_extends/parse/standard_method.py
修改: mindspore/ops/operations/rl_ops.py
修改: mindspore/core/abstract/prim_nn.cc
修改: mindspore/core/ops/conv2d.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
修改: mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
修改: mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
修改: mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
修改: mindspore/ccsrc/fl/server/server.cc
修改: mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
修改: mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
修改: mindspore/ccsrc/frontend/optimizer/irpass/inline.h
修改: mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
修改: mindspore/ccsrc/minddata/dataset/core/tensor.cc
修改: mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
修改: mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
修改: mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
修改: mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
修改: mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
修改: mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
修改: mindspore/ccsrc/pipeline/jit/action.cc
修改: mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
修改: mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
修改: mindspore/compression/quant/quant_utils.py
修改: mindspore/core/abstract/prim_nn.cc
修改: mindspore/dataset/engine/validators.py
修改: mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
修改: mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
修改: mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
修改: mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
修改: mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
修改: mindspore/lite/tools/common/graph_util.h
修改: mindspore/lite/tools/optimizer/fisson/fisson_util.cc
修改: mindspore/ops/composite/math_ops.py
修改: mindspore/ops/operations/_inner_ops.py
修改: mindspore/ops/operations/array_ops.py
修改: mindspore/ops/operations/math_ops.py
修改: mindspore/ops/operations/other_ops.py
修改: mindspore/boost/boost_cell_wrapper.py
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
修改: mindspore/ccsrc/common/trans.cc
修改: mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
修改: mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
修改: mindspore/lite/src/common/log_util.h
修改: mindspore/nn/wrap/loss_scale.py
修改: mindspore/parallel/nn/moe.py
修改: tests/mindspore_test_framework/mindspore_test.py
修改: mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
修改: mindspore/lite/tools/common/graph_util.h
修改: mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
修改: mindspore/core/ops/conv2d.cc
修改: tests/ut/python/model/test_lenet_core_after_exception.py
4 years ago
i-robot
6f50988b73
!24368 [Fallback] Ignore the func graph in local parameters.
Merge pull request !24368 from 张清华/opt_fallback
4 years ago
i-robot
8cf8e4ddd3
!21778 support tensor slice when slice result should be caculated in runtime mode
Merge pull request !21778 from lianliguang/support-dynamic-slice
4 years ago
Zhang Qinghua
e5456f0ad6
[Fallback] Ignore the func graph in local parameters.
4 years ago
lianliguang
72c7706d22
support dynamic slice in runtime mode
4 years ago
Margaret_wangrui
78fc2e45ff
Fix the resolve problem with parameters with the same name
4 years ago
huanghui
23b5d2a23c
not set debug_info for top_graph's call_node
4 years ago
He Wei
57c75a9479
Support construct CNode by move inputs in
4 years ago
i-robot
9309a11999
!23352 [Fallback] Handle interpreted node as input, set function Parameters and update local params if need.
Merge pull request !23352 from 张清华/opt_fallback
4 years ago
Zhang Qinghua
9fbd118319
Handle interpreted node as input, set function Parameters and update local params if need.
4 years ago
huanghui
80416a71e0
fix warnings of pclint plus, codedex and codecheck
4 years ago
yujianfeng
6e04468900
Clean code for compiler
4 years ago
zhangzhaoju
4296881a16
syntax
4 years ago
Zhang Qinghua
bcfb274074
[Fallback] Fix previous block parameters problem, and add test cases.
4 years ago
i-robot
7978aae666
!22946 Handle if break else break situation of control flow
Merge pull request !22946 from chenfei_mindspore/pr_dead_block
4 years ago
chenfei
f6fe46e469
support if break else break situation
add trace guard
4 years ago
Zhang Qinghua
6edea0ed3c
Add supported namespace for fallback.
4 years ago
Zhang Qinghua
7203989c26
Support fallback feature in Graph mode (1).
4 years ago
i-robot
0ad0d9144e
!22081 [ME]Code clean of master
Merge pull request !22081 from chenfei_mindspore/code_clean_of_master
4 years ago
He Wei
6a23f6979a
Support 'no_eliminate' primitive
4 years ago
chenfei
72cab0262e
code clean
4 years ago
lichenever
5812076512
Refactor_part_of_pipeline
4 years ago
ms_yan
36a8886ca2
Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab .
Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"
This reverts commit 4e6f7dc97d .
delete pass_registry_test.cc
comment hiai_nlu_model_multi.pb related line
4 years ago