Parastoo Ashtari
dadcadec03
fix graph history dump issue for ascend kernel by kernel
4 years ago
i-robot
92770ef12e
!30200 Improve A+M dump performance
Merge pull request !30200 from TinaMengtingZhang/a_m_dump_perf
4 years ago
yelihua
5d70b3a7d8
enable dump when met exception during train
4 years ago
TinaMengtingZhang
4a8d3defe7
Enhance the perfomance of A+M dump: Parallelize ConverFormatForTensorAndDump and refactoring
4 years ago
i-robot
330cacf905
!30573 Catch abnormals from sto functions in debug
Merge pull request !30573 from maning202007/master
4 years ago
maning202007
9328041de4
Catch abnormals from sto functions in debug
Fix type errors
Fix bugs
Fix cycle depth
4 years ago
zhoufeng
f49b195c39
extract common as an independent shared library
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
4 years ago
maning202007
54a69ebd82
Fix DumpParameters issue when only need dump input data
Fix code warnings in debug
Fix code warnings2
4 years ago
TinaMengtingZhang
ab5aba46ff
fix input parameter dump error
4 years ago
TinaMengtingZhang
e576292862
dump statistic file in kernel by kernel mode
4 years ago
marui
d47e79b04c
Refactor ccsrc directories and CMakeLists files
4 years ago
i-robot
fe74be4830
!29701 Support dump parameters using origin_parameter_order, fix DumpConstantData issue and refactor debugger mindRT code
Merge pull request !29701 from parastooashtari/kernel_level_dump
4 years ago
Parastoo Ashtari
f6bebc7d97
use origin_parameter_order to load and dump params mindRT
Refactor mindRT code
Fix DumpConstantData issue
4 years ago
TinaMengtingZhang
6a00f9797a
sync up codex warning fix for dump and debugger to open source branch
4 years ago
Parastoo Ashtari
bc228d4d58
support cell dump for ascend kernel-by-kernel mode
4 years ago
Parastoo Ashtari
c6f5fb06f2
add comments for dump and debugger code.
4 years ago
i-robot
f254f9a295
!29218 Show IsDumpEnabled warning message only once
Merge pull request !29218 from parastooashtari/kernel_level_dump
4 years ago
Parastoo Ashtari
44103b14ec
Print IsDumpEnabled warning message once
4 years ago
TinaMengtingZhang
16bb7407a2
Delete dead code in debugger & dump.
4 years ago
Parastoo Ashtari
8d96ee8b46
Move DumpConstantData to DebugOnStepEnd for ascend MindRT and add check for kGraphOpRun
4 years ago
lby
e6857a6553
using cube to get c0 value
4 years ago
yelihua
3bcd6cb9aa
didn't print msg when dump mode is not 1
4 years ago
i-robot
6f6977a73b
!27941 Ascend kernel level dump
Merge pull request !27941 from parastooashtari/kernel_level_dump
4 years ago
Parastoo Ashtari
b832e218c3
kernel by kernel dump
4 years ago
sabrinasun
3f5416a556
fix constant dump bug and fix ci warning
4 years ago
i-robot
1c5a47a8a8
!27815 Do not skip statistic if type is not supported
Merge pull request !27815 from Jimmy Qi/datatype
4 years ago
i-robot
ec90e501dc
!27839 Save non-tensor value in pb
Merge pull request !27839 from sabrinasun_59ee/fix
4 years ago
sabrinasun
2bd107731f
save non-tensor value in pb
4 years ago
Jimmy Qi
48140c69c2
Do not skip statistic if type is not supported
4 years ago
i-robot
4361357795
!27746 Fix log info in A+M dump
Merge pull request !27746 from TinaMengtingZhang/fix_log
4 years ago
i-robot
4ac1ba29a1
!27688 Dump data type in human readable format
Merge pull request !27688 from Jimmy Qi/datatype
4 years ago
i-robot
8d648e0f1e
!19673 Seperate constant from pb file
Merge pull request !19673 from sabrinasun_59ee/constant
4 years ago
TinaMengtingZhang
57a7e91c18
fix log info if format&type is not found
4 years ago
Jimmy Qi
dcf6c7af19
Write data type in human readable format
4 years ago
sabrinasun
542d715217
seperate constant from pb
4 years ago
i-robot
46e12035bf
!27502 Print null for min, max, avg values when tensor only has NaNs and Infs
Merge pull request !27502 from Jimmy Qi/stat-null
4 years ago
Parastoo Ashtari
26a928a888
fix sink true history file bug
4 years ago
Jimmy Qi
6f2b70c21f
Print null for min, max, avg values for NaN tensor
4 years ago
i-robot
cb361b9123
!26755 Debugger support for ascend mindrt
Merge pull request !26755 from parastooashtari/ascend_runtime
4 years ago
Parastoo Ashtari
76f074b77e
Debugger support ascend mindrt
4 years ago
Jimmy Qi
b9d1a4920c
Add statistic dump for ascend
4 years ago
sabrinasun
c095908772
fix enable=false still dump issue for cell dump
4 years ago
Jimmy Qi
2a4a98ce9d
Refactor original kernal name so all output tensors are included in stat
dump
4 years ago
i-robot
a92d97adb2
!25850 Add CANN tensor data callback support for ascend async dump - part2
Merge pull request !25850 from TinaMengtingZhang/cann_api_adapt
4 years ago
TinaMengtingZhang
07b653103e
Support Cann callback api for ascend async dump
4 years ago
He Wei
41dcac9c49
Replace std::unordered_map/set with robin-hood-hashing
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing )
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.
1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
- mindspore::HashMap as an alias of robin_hood::unordered_map;
- mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
- `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
- `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
- `std::unordered_map` --> `mindspore::HashMap`;
- `std::unordered_set` --> `mindspore::HashSet`;
- `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
- `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
- AnfNodeConfig hash and equal;
- Fix a bug in `Slice::operator==()`;
- Fix a bug in `CNode::HasPrimalAttr()`;
- Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
- Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
- As parameter of functions that exposed to python by pybind11;
- Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
4 years ago
sabrinasun
e7d7476a8e
fix dynamic shape dump issue and apply comments from cell dump pr
4 years ago
sabrinasun
99a434672f
support cell dump when dump_mode=2
4 years ago
Jimmy Qi
b21c099767
Add option to dump tensor statistics in csv format
4 years ago
i-robot
938da844be
!25916 correct log level
Merge pull request !25916 from john_tzanakakis/jt_bug_fixes
4 years ago