Jimmy Qi
2a4a98ce9d
Refactor original kernal name so all output tensors are included in stat
dump
4 years ago
i-robot
a92d97adb2
!25850 Add CANN tensor data callback support for ascend async dump - part2
Merge pull request !25850 from TinaMengtingZhang/cann_api_adapt
4 years ago
TinaMengtingZhang
07b653103e
Support Cann callback api for ascend async dump
4 years ago
He Wei
41dcac9c49
Replace std::unordered_map/set with robin-hood-hashing
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing )
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.
1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
- mindspore::HashMap as an alias of robin_hood::unordered_map;
- mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
- `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
- `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
- `std::unordered_map` --> `mindspore::HashMap`;
- `std::unordered_set` --> `mindspore::HashSet`;
- `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
- `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
- AnfNodeConfig hash and equal;
- Fix a bug in `Slice::operator==()`;
- Fix a bug in `CNode::HasPrimalAttr()`;
- Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
- Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
- As parameter of functions that exposed to python by pybind11;
- Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
4 years ago
sabrinasun
e7d7476a8e
fix dynamic shape dump issue and apply comments from cell dump pr
4 years ago
sabrinasun
99a434672f
support cell dump when dump_mode=2
4 years ago
Jimmy Qi
b21c099767
Add option to dump tensor statistics in csv format
4 years ago
i-robot
938da844be
!25916 correct log level
Merge pull request !25916 from john_tzanakakis/jt_bug_fixes
4 years ago
Parastoo Ashtari
4acbd2a3c9
Fix issue for graph history in async dump when dataset_sink_mode=true
4 years ago
John Tzanakakis
61c18e522c
correct log level
4 years ago
i-robot
257bb3500d
!25785 change dump path to avoid invalid symbol in ci path
Merge pull request !25785 from yelihua/dev
4 years ago
i-robot
76f4f77cc2
!24520 Add graph run history to dump structure
Merge pull request !24520 from parastooashtari/multi_root_graph_dump
4 years ago
parastooashtari
1a59dc37bf
add graph execution order history to dump
4 years ago
yelihua
f9f2058055
change dump path to avoid invalid symbol in path
4 years ago
maning202007
62db88f8e2
Fix the test_async_overflow_watchpoints_hit smoke test error
Change the LOG of setting mode to EXCEPTION level
4 years ago
maning202007
badfaadc0d
Fix code warnings in debugger
4 years ago
maning202007
8ee33007b1
add const to the data_ptr definition
Fix pclint for debugger
fix bugs
fix duplicated code issue
Fix the depth of method over 4 issue
fix comments
fix CI errors
remove redundancy arguments
4 years ago
i-robot
7ef95c4df9
!24874 Code clean of mc
Merge pull request !24874 from chenfei_mindspore/code_clean_1012
4 years ago
chenfei
16bff0128a
code clean 1012
4 years ago
sabrinasun
41d737553a
sync commercial branch self check fix to master
4 years ago
Margaret_wangrui
f5791cf62e
clean pclint
4 years ago
i-robot
9e17c29b91
!23940 code check
Merge pull request !23940 from zhaosida/code_clean_master
4 years ago
i-robot
eaf3837a6a
!23874 Clean pclint and codedex warning
Merge pull request !23874 from Margaret_wangrui/pclint_clean
4 years ago
zhaosida
7bbad8a84e
self code check
4 years ago
Margaret_wangrui
70052d2aee
clean pclint and codedex warning
4 years ago
i-robot
542819f08f
!23566 Support multi root graph GPU dump mindrt runtime
Merge pull request !23566 from parastooashtari/multi_root_graph_gpu
4 years ago
Parastoo Ashtari
7c9ecff30b
support multi network dump in GPU
4 years ago
rescue
a67275d857
read ms version from version.txt
4 years ago
i-robot
0fa3fa78fb
!23709 Clean security and codex warning
Merge pull request !23709 from yelihua/dev
4 years ago
huanghui
80416a71e0
fix warnings of pclint plus, codedex and codecheck
4 years ago
i-robot
38bab297ec
!23732 Fix code self-check issues for online dbg in master
Merge pull request !23732 from TinaMengtingZhang/code_self_check_master
4 years ago
yelihua
83b3f6fef7
delete Common::GetRealPath
4 years ago
TinaMengtingZhang
f4db1dabe0
Merge code safety check to master
4 years ago
caifubi
0683b7fd75
clean codex
4 years ago
John Tzanakakis
4b77150f94
make async dump when sink_mode=False use input_ctrl_tensor like sink_mode=True
4 years ago
i-robot
b9b017f200
!23492 Fix ascend sink_mode True e2e dump issue
Merge pull request !23492 from parastooashtari/sink_ascend_dump
4 years ago
Parastoo Ashtari
ce773462a5
fix ascend sink_mode e2e dump issue
4 years ago
baihuawei
e1e11b9a47
fix some bugs
4 years ago
i-robot
0430e60d5a
!23203 Fix for multi root graph dump issue in ascend
Merge pull request !23203 from parastooashtari/multi_root_graph_dump
4 years ago
Parastoo Ashtari
c198b7c1a8
Fix multi root graph dump issue
4 years ago
yelihua
7c3994e48e
use Common::CreatePrefixPath instead of Common::GetRealPath
4 years ago
yelihua
801121a140
add common get realpath method
4 years ago
maning202007
de3a5ee9ad
Update teh ms_version to 1.5.0 for debugger
4 years ago
chenfei
72cab0262e
code clean
4 years ago
ms_yan
36a8886ca2
Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab .
Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"
This reverts commit 4e6f7dc97d .
delete pass_registry_test.cc
comment hiai_nlu_model_multi.pb related line
4 years ago
djc
b077aa1cab
[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset
4 years ago
djc
4e6f7dc97d
[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset
4 years ago
Margaret_wangrui
eb20962136
clean pclint
4 years ago
yelihua
72e6058265
get rank id when set hccl env for single card train
4 years ago
i-robot
bd78bf0146
!21808 raise exception when failed to dump mem to file
Merge pull request !21808 from yelihua/dev
4 years ago