245d981841
fix codex
4 years ago
583eb32723
[MD] Add more UT and a ST for failover reset
4 years ago
260cebf650
[MD] skip node pushdown optimization pass for Reset
4 years ago
b90cf43562
!30553 Support dataset reset() to recover after failure
Merge pull request !30553 from h.farahat/reset
4 years ago
f01d841113
!27943 [MD][Autotune] Save/Load Autotune config
Merge pull request !27943 from harshvardhangupta/save_load_at_config
4 years ago
a3dec34833
Dataset failover reset
4 years ago
bd61adbb72
Implement save/load of autotune dataset pipeline configuration #27943
4 years ago
6de37045ff
Added TypeCast op in dataset offload.
4 years ago
91696f2dbe
fix codex and code check
4 years ago
35993ba145
pc lint plus and code check fixes
4 years ago
0c10f52eb4
Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).
Updated auto_offload test in test_map_offload.py.
Changed MapNode.offload type from bool->int in bindings.cc.
Changed manual offload flag from int->enum.
Update offload end of pipeline detection to be column-specific.
4 years ago
37d5e81cc4
optimize offloaf enabled info log
4 years ago
bae1dd3bb0
Revert "Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc)."
This reverts commit 84d38e547a
4 years ago
84d38e547a
Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).
Updated auto_offload test in test_map_offload.py.
Changed MapNode.offload type from bool->int in bindings.cc.
Changed manual offload flag from int->enum.
4 years ago
fb5505cc50
add header file
4 years ago
22e03ab12e
Adding offload hardware accelerator.
4 years ago
8ce4e62725
optimize the comment and log description
修改： ops/operations/_inner_ops.py
修改： ops/operations/_quant_ops.py
修改： ops/operations/array_ops.py
修改： ops/operations/comm_ops.py
修改： ops/operations/math_ops.py
修改： ops/operations/quantum_ops.py
修改： ops/operations/rl_ops.py
修改： ops/operations/sponge_ops.py
修改： ops/operations/sponge_update_ops.py
修改： train/__init__.py
修改： common/tensor.py
修改： train/serialization.py
修改： ccsrc/pipeline/jit/parse/parse.h
修改： explainer/benchmark/_attribution/metric.py
修改： ops/composite/multitype_ops/_constexpr_utils.py
修改： ops/operations/comm_ops.py
修改： RELEASE.md
修改： mindspore/_extends/parse/standard_method.py
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/concat_offset_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/dynamic_shape_cpu_kernel.cc
修改： mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.cc
修改： mindspore/ccsrc/frontend/parallel/ops_info/tile_info.cc
修改： mindspore/ccsrc/frontend/parallel/ops_info/transpose_info.cc
修改： mindspore/ccsrc/frontend/parallel/strategy.h
修改： mindspore/common/tensor.py
修改： mindspore/core/abstract/prim_arrays.cc
修改： mindspore/core/abstract/prim_nn.cc
修改： mindspore/core/ops/conv2d.cc
修改： mindspore/core/ops/logical_and.h
修改： mindspore/core/ops/logical_not.h
修改： mindspore/core/ops/logical_or.h
修改： mindspore/core/ops/reduce_all.h
修改： mindspore/core/ops/reduce_any.h
修改： mindspore/lite/src/runtime/kernel/arm/fp32_grad/sgd.cc
修改： mindspore/nn/layer/quant.py
修改： mindspore/nn/optim/sgd.py
修改： mindspore/nn/sparse/sparse.py
修改： mindspore/numpy/array_creations.py
修改： mindspore/numpy/array_ops.py
修改： mindspore/numpy/logic_ops.py
修改： mindspore/numpy/math_ops.py
修改： mindspore/ops/operations/_inner_ops.py
修改： mindspore/ops/operations/array_ops.py
修改： mindspore/ops/operations/rl_ops.py
修改： mindspore/train/_utils.py
修改： tests/ut/python/model/test_lenet_core_after_exception.py
修改： mindspore/_extends/parse/standard_method.py
修改： mindspore/ops/operations/rl_ops.py
修改： mindspore/core/abstract/prim_nn.cc
修改： mindspore/core/ops/conv2d.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/ctcloss_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_pull_weight_kernel.h
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/fl/fused_push_weight_kernel.h
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_filter_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/mkldnn/conv2d_grad_input_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_ftrl_ps_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/ps/sparse_apply_lazy_adam_ps_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/rolling_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/scatter_arithmetic_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
修改： mindspore/ccsrc/backend/kernel_compiler/gpu/arrays/split_gpu_kernel.h
修改： mindspore/ccsrc/backend/kernel_compiler/gpu/math/broadcast_gpu_kernel.h
修改： mindspore/ccsrc/backend/kernel_compiler/gpu/nn/conv2d_grad_input_gpu_kernel.h
修改： mindspore/ccsrc/fl/server/server.cc
修改： mindspore/ccsrc/frontend/optimizer/ad/kpynative.cc
修改： mindspore/ccsrc/frontend/optimizer/irpass/incorporate_getitem.h
修改： mindspore/ccsrc/frontend/optimizer/irpass/inline.h
修改： mindspore/ccsrc/minddata/dataset/core/device_tensor.cc
修改： mindspore/ccsrc/minddata/dataset/core/tensor.cc
修改： mindspore/ccsrc/minddata/dataset/engine/datasetops/source/emnist_op.cc
修改： mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mnist_op.cc
修改： mindspore/ccsrc/minddata/dataset/engine/datasetops/source/qmnist_op.cc
修改： mindspore/ccsrc/minddata/dataset/engine/ir/datasetops/dataset_node.cc
修改： mindspore/ccsrc/minddata/dataset/engine/opt/pre/epoch_ctrl_pass.cc
修改： mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.cc
修改： mindspore/ccsrc/pipeline/jit/action.cc
修改： mindspore/ccsrc/pipeline/jit/static_analysis/evaluator.cc
修改： mindspore/ccsrc/runtime/device/ascend/executor/tiling/op_tiling_adapter.cc
修改： mindspore/compression/quant/quant_utils.py
修改： mindspore/core/abstract/prim_nn.cc
修改： mindspore/dataset/engine/validators.py
修改： mindspore/lite/micro/coder/opcoders/nnacl/fp32/affine_fp32_coder.cc
修改： mindspore/lite/micro/coder/opcoders/nnacl/int8/affine_int8_coder.cc
修改： mindspore/lite/src/runtime/kernel/ascend310/src/custom_kernel.cc
修改： mindspore/lite/src/runtime/kernel/opencl/kernel/matmul.cc
修改： mindspore/lite/src/runtime/kernel/opencl/kernel/strassen.cc
修改： mindspore/lite/tools/common/graph_util.h
修改： mindspore/lite/tools/optimizer/fisson/fisson_util.cc
修改： mindspore/ops/composite/math_ops.py
修改： mindspore/ops/operations/_inner_ops.py
修改： mindspore/ops/operations/array_ops.py
修改： mindspore/ops/operations/math_ops.py
修改： mindspore/ops/operations/other_ops.py
修改： mindspore/boost/boost_cell_wrapper.py
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/update_cache_cpu_kernel.cc
修改： mindspore/ccsrc/common/trans.cc
修改： mindspore/ccsrc/frontend/parallel/cache_embedding/cache_embedding.cc
修改： mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
修改： mindspore/lite/src/common/log_util.h
修改： mindspore/nn/wrap/loss_scale.py
修改： mindspore/parallel/nn/moe.py
修改： tests/mindspore_test_framework/mindspore_test.py
修改： mindspore/ccsrc/backend/kernel_compiler/cpu/split_cpu_kernel.cc
修改： mindspore/lite/tools/common/graph_util.h
修改： mindspore/ccsrc/frontend/parallel/ops_info/gather_info.cc
修改： mindspore/core/ops/conv2d.cc
修改： tests/ut/python/model/test_lenet_core_after_exception.py
4 years ago
f5d7bdfc68
fixed code quality issues
4 years ago
567f137a39
sync code
4 years ago
36a8886ca2
Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab4e6f7dc97d
4 years ago
b077aa1cab
[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset
4 years ago
4e6f7dc97d
[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset
4 years ago
0e2efc2501
fix minddata code clean
4 years ago
59efbb88ec
fix waring
4 years ago
8c1b561149
Fix cache code check warnings
4 years ago
f31d9b3a2d
fix CI
fix CI
4 years ago
5967cb2cd7
Unblock mindrecord under cache
5 years ago
9ce28cd34c
split sampler vision IR files
5 years ago
bf48400c10
unify include file of minddata
5 years ago
98f0f36a20
Removed unused include
5 years ago
624511337c
MindData Codespell correction
5 years ago
4be0ffb9ba
removing type_id.h from header files
5 years ago
518828b639
Support 3 composed data ops and cleanup code
5 years ago
462422acc7
Move transforms and text ir down
5 years ago
fc8b9fc85e
dataset: Push down IR vision files
5 years ago
46483d89b1
Completely remove unused ExecTree optimizer code, rewrite ExecutionTree::Prepare()
5 years ago
ee09b38f00
add code for MD lite C++ include and api
5 years ago
7d2fd6e76c
cxx api refactor: tensor/status/model
5 years ago
5a7dc0accc
Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer
5 years ago
922e1f4f36
Migrate CacheTransformPass
5 years ago
73b7154e55
fix cmakelint error
5 years ago
a3b10213b7
dataset: Resolve protected parent_access from DeepCopyPass
5 years ago
273865a72b
Rename SamplerObj::Build() to SamplerBuild()
5 years ago
e28fb6ce4d
Tested with new test cases and all dataset UTs passed
5 years ago
686772cce7
Migrate GeneratorOp resetting logic to IR optimizer (incl. debug code)
with comments from the peer view addressed
5 years ago
440ddefb73
dataset: codedex CI fixes for const pointer
5 years ago
b355f5402b
!10309 Port over getter pass and tensor fusion pass to IR
From: @ziruiwu
Reviewed-by:
Signed-off-by:
5 years ago
e6a25379ed
dataset: minor fixes which resolve codedex CI alarms
5 years ago
0e68575e77
port over getter pass
port over tensor_op_fusion pass
add fusion support for prebuildOpeartion (TensorOpeartion)
5 years ago
c017893178
fix selected issues in checkbot
5 years ago
luoyang
mohammad
i-robot
h.farahat
harshvardhangupta
markuskunej
Xiao Tianci
xiefangqi
liu-yongqi-63
rescue
zhunaipan
hetshah
liyong
ms_yan
djc
shenwei41
Lixia Chen
Zirui Wu
Eric
TinaMengtingZhang
Cathy Wong
Nat Sutyanyong
xulei2020
lixian
xsmq
mindspore-ci-bot