245d981841
fix codex
4 years ago
583eb32723
[MD] Add more UT and a ST for failover reset
4 years ago
260cebf650
[MD] skip node pushdown optimization pass for Reset
4 years ago
b90cf43562
!30553 Support dataset reset() to recover after failure
Merge pull request !30553 from h.farahat/reset
4 years ago
f01d841113
!27943 [MD][Autotune] Save/Load Autotune config
Merge pull request !27943 from harshvardhangupta/save_load_at_config
4 years ago
a3dec34833
Dataset failover reset
4 years ago
bd61adbb72
Implement save/load of autotune dataset pipeline configuration #27943
4 years ago
6de37045ff
Added TypeCast op in dataset offload.
4 years ago
91696f2dbe
fix codex and code check
4 years ago
35993ba145
pc lint plus and code check fixes
4 years ago
0c10f52eb4
Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).
Updated auto_offload test in test_map_offload.py.
Changed MapNode.offload type from bool->int in bindings.cc.
Changed manual offload flag from int->enum.
Update offload end of pipeline detection to be column-specific.
4 years ago
37d5e81cc4
optimize offloaf enabled info log
4 years ago
bae1dd3bb0
Revert "Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc)."
This reverts commit 84d38e547a
4 years ago
84d38e547a
Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).
Updated auto_offload test in test_map_offload.py.
Changed MapNode.offload type from bool->int in bindings.cc.
Changed manual offload flag from int->enum.
4 years ago
fb5505cc50
add header file
4 years ago
22e03ab12e
Adding offload hardware accelerator.
4 years ago
8ce4e62725
optimize the comment and log description
修改： ops/operations/_inner_ops.py
修改： ops/operations/_quant_ops.py
修改： ops/operations/array_ops.py
修改： ops/operations/comm_ops.py
修改： ops/operations/math_ops.py
修改： ops/operations/quantum_ops.py
修改： ops/operations/rl_ops.py
修改： ops/operations/sponge_ops.py
修改： ops/operations/sponge_update_ops.py
修改： train/__init__.py
修改： common/tensor.py
修改： train/serialization.py
修改： ccsrc/pipeline/jit/parse/parse.h
修改： explainer/benchmark/_attribution/metric.py
修改： ops/composite/multitype_ops/_constexpr_utils.py
修改： ops/operations/comm_ops.py
修改： RELEASE.md
修改： mindspore/_extends/parse/standard_method.py
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
修改： mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
修改： mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
修改： mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
修改： mindspore/ccsrc/frontend/parallel/strategy.h
修改： mindspore/common/tensor.py
修改： mindspore/core/abstract/prim_arrays.cc
修改： mindspore/core/abstract/prim_nn.cc
修改： mindspore/core/ops/conv2d.cc
修改： mindspore/core/ops/logical_and.h
修改： mindspore/core/ops/logical_not.h
修改： mindspore/core/ops/logical_or.h
修改： mindspore/core/ops/reduce_all.h
修改： mindspore/core/ops/reduce_any.h
修改： mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
修改： mindspore/nn/layer/quant.py
修改： mindspore/nn/optim/sgd.py
修改： mindspore/nn/sparse/sparse.py
修改： mindspore/numpy/array_creations.py
修改： mindspore/numpy/array_ops.py
修改： mindspore/numpy/logic_ops.py
修改： mindspore/numpy/math_ops.py
修改： mindspore/ops/operations/_inner_ops.py
修改： mindspore/ops/operations/array_ops.py
修改： mindspore/ops/operations/rl_ops.py
修改： mindspore/train/_utils.py
修改： tests/ut/python/model/test_lenet_core_after_exception.py
修改： mindspore/_extends/parse/standard_method.py
修改： mindspore/ops/operations/rl_ops.py
修改： mindspore/core/abstract/prim_nn.cc
修改： mindspore/core/ops/conv2d.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
修改： mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
修改： mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
修改： mindspore/ccsrc/fl/server/server.cc
修改： mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
修改： mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
修改： mindspore/ccsrc/frontend/optimizer/irpass/inline.h
修改： mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
修改： mindspore/ccsrc/minddata/dataset/core/tensor.cc
修改： mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
修改： mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
修改： mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
修改： mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
修改： mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
修改： mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
修改： mindspore/ccsrc/pipeline/jit/action.cc
修改： mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
修改： mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
修改： mindspore/compression/quant/quant_utils.py
修改： mindspore/core/abstract/prim_nn.cc
修改： mindspore/dataset/engine/validators.py
修改： mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
修改： mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
修改： mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
修改： mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
修改： mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
修改： mindspore/lite/tools/common/graph_util.h
修改： mindspore/lite/tools/optimizer/fisson/fisson_util.cc
修改： mindspore/ops/composite/math_ops.py
修改： mindspore/ops/operations/_inner_ops.py
修改： mindspore/ops/operations/array_ops.py
修改： mindspore/ops/operations/math_ops.py
修改： mindspore/ops/operations/other_ops.py
修改： mindspore/boost/boost_cell_wrapper.py
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
修改： mindspore/ccsrc/common/trans.cc
修改： mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
修改： mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
修改： mindspore/lite/src/common/log_util.h
修改： mindspore/nn/wrap/loss_scale.py
修改： mindspore/parallel/nn/moe.py
修改： tests/mindspore_test_framework/mindspore_test.py
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
修改： mindspore/lite/tools/common/graph_util.h
修改： mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
修改： mindspore/core/ops/conv2d.cc
修改： tests/ut/python/model/test_lenet_core_after_exception.py
4 years ago
f5d7bdfc68
fixed code quality issues
4 years ago
567f137a39
sync code
4 years ago
36a8886ca2
Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab4e6f7dc97d
4 years ago
4e6f7dc97d
[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset
4 years ago
0e2efc2501
fix minddata code clean
4 years ago
8c1b561149
Fix cache code check warnings
4 years ago
5967cb2cd7
Unblock mindrecord under cache
5 years ago
bf48400c10
unify include file of minddata
5 years ago
98f0f36a20
Removed unused include
5 years ago
624511337c
MindData Codespell correction
5 years ago
4be0ffb9ba
removing type_id.h from header files
5 years ago
518828b639
Support 3 composed data ops and cleanup code
5 years ago
46483d89b1
Completely remove unused ExecTree optimizer code, rewrite ExecutionTree::Prepare()
5 years ago
7d2fd6e76c
cxx api refactor: tensor/status/model
5 years ago
5a7dc0accc
Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer
5 years ago
922e1f4f36
Migrate CacheTransformPass
5 years ago
a3b10213b7
dataset: Resolve protected parent_access from DeepCopyPass
5 years ago
e28fb6ce4d
Tested with new test cases and all dataset UTs passed
5 years ago
440ddefb73
dataset: codedex CI fixes for const pointer
5 years ago
0e68575e77
port over getter pass
port over tensor_op_fusion pass
add fusion support for prebuildOpeartion (TensorOpeartion)
5 years ago
4f569677b7
redundant_codes
Signed-off-by: zhupuxu <zhupuxu@huawei.com>
5 years ago
41ea1621c5
Tidy up TreeAdapter::Compile
5 years ago
4cb78f2e03
Remove Repeat(1),Take(-1), and Skip(0) in NodeRemovalPass
5 years ago
d69a29a44e
Migrate 3 pre passes to IR optimizer, namely, cache_error_pass, epoch_injection, and removal_pass
5 years ago
9ed31ea2cb
!9339 Disable getter optimization pass
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @nsyca
5 years ago
4ffd9b578f
!9331 More cache minor fix for HQ testers
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
5 years ago
db2a8b5e1d
Disable getter pass
5 years ago
2ddb1fb75e
More CRC fix and blocking BatchOp under cache
5 years ago
ae2e7b9db9
!9250 Fix unexpected error printing when calling cache_admin --stop and other log related issues
From: @tina_mengting_zhang
Reviewed-by: @nsyca,@liucunwei
Signed-off-by: @nsyca
5 years ago
1b19118adc
fix error msg issues from test team and move hostname/port to CacheClientGreeter
5 years ago
23487fae09
fix get_shape/type and a segfault in getter_pass
add test case
5 years ago
36bfd0d8ad
address left over cmts from 8802
5 years ago
27698866d1
Block take/skip under cache and fix docstring
and other minor changes per the request of HQ testers
5 years ago
luoyang
mohammad
i-robot
h.farahat
harshvardhangupta
markuskunej
Xiao Tianci
xiefangqi
liu-yongqi-63
rescue
zhunaipan
hetshah
liyong
ms_yan
djc
Lixia Chen
Eric
TinaMengtingZhang
Nat Sutyanyong
lixian
Cathy Wong
Zirui Wu
zhupuxu
mindspore-ci-bot