mindspore-ci-bot
5b6de4a67b
!441 Remove profiler user interface and parser.
Merge pull request !441 from yuximiao/yuximiao_profiler
5 years ago
mindspore-ci-bot
a5cabe8ca7
!440 Change the mindinsight multiprocessing computing code to use a unified manager, add new features
Merge pull request !440 from wenkai/pref_opt_0720_1cp1
5 years ago
wenkai
26fabf4770
Refactor the mindinsight multiprocessing computing code to use a unified manager.
Main features:
1. Use the ComputingResourceManager to manage all computing workers.
2. Ensure fair worker number between summary directories at first. So every summary directories in cache will be loaded simultaneously.
3. When a summary directory is loaded, it's worker will be released, and other unfinished summary directories can use the released workers to speed up. This way we solved the slow worker problem.
Code changes:
1. Added computing_resource_mgr.py
2. Passed ComputingResourceManager instances instead of workers_count
3. Simplified the _load_single_fine() function a bit.
5 years ago
yuximiao
d3cc7a89a3
remove profiler user interface.
5 years ago
Li Hongzhang
3da4d71dff
add the resource monitor api
- collect_cpu
- collect_mem
- collect_npu
5 years ago
yelihua
f8f5c7a987
classify reduce events into different types
5 years ago
wangshuide2020
e8ffeb70ef
Support tensor visualization. 1.Tensor display in a table, it can support no more than two dimensions tensor visualization; 2.Tensor histogram visualization for all step in cache.
5 years ago
wenkai
c610544905
fix ZeroDivisionError when original bucket width is 0 by checking the width.
5 years ago
chenchao99
a0433c14d3
Revert "update the display column name in ui"
This reverts commit a828f6681c .
5 years ago
mindspore-ci-bot
419b7f8aff
!389 Modify the time unit of aicpu profiling data
Merge pull request !389 from 治愈系潇洒哥/master
5 years ago
askmiao
271aa093fe
modify aicpu timeunit ,from us to ms
5 years ago
chenchao99
a828f6681c
update the display column name in ui
5 years ago
chenchao99
0d8808e5b3
update the display name of aicore detail execution time
5 years ago
chenchao99
70733cc415
fix the result of the number of decimal points of aicore type execution time
5 years ago
wangshuide2020
0fad2218fd
add null byte check in the api of get_plugins
5 years ago
askmiao
9cd1fafa17
adapte diff aicpu kernel
5 years ago
mindspore-ci-bot
1e0e31bed1
!319 add aicpu ut test case
Merge pull request !319 from 治愈系潇洒哥/master
5 years ago
askmiao
f9d5fa3b59
add and modify ut case
5 years ago
chenchao99
79a0187450
add op analyser and minddata pipeline analyser st
5 years ago
mindspore-ci-bot
85938f28d8
!313 Remove the TrainLineage, EvalLineage and related UT/ST
Merge pull request !313 from 李鸿章/rm_lineage_cb
5 years ago
Li Hongzhang
7ce9f9bd58
remove TrainLineage, EvalLineage and related ut/st
5 years ago
chenchao99
d9508ea7e3
fix ci problem of function length
5 years ago
mindspore-ci-bot
6f953c0cfe
!282 add path_prefix argument for start command
Merge pull request !282 from liangyongxiong/path-prefix
5 years ago
liangyongxiong
f2f80b177a
add path_prefix argument for start command
5 years ago
yuximiao
70857c7b5f
adapt profiling source path change
5 years ago
yelihua
15065c1095
enable to show the fp and bp point
5 years ago
mindspore-ci-bot
5266b191e4
!286 Adapt the framework file update
Merge pull request !286 from chenchao99/profiler_framework
5 years ago
mindspore-ci-bot
3956a90a39
!287 Change the method to find the step trace files.
Merge pull request !287 from yelihua/dev_profiler
5 years ago
chenchao99
5cffc9412a
Adapt the framework file update.
Modify points: 1. adapt the task id change; 2. support parsing point
files; 3. adapt the source path change
5 years ago
yelihua
82ed137d4f
change the method to find step trace files
5 years ago
zhangyunshu
50b4b0b97a
Add new feature for Profiler:
Collect timeline information after training finished.
Support timeline display on web UI.
5 years ago
root
449bec1fa2
featrue for proposer
5 years ago
mindspore-ci-bot
8e0cfd601c
!270 feature of minddata pipeline information parser and analyser, including ut
Merge pull request !270 from chenchao99/profiler_pipeline
5 years ago
chenchao99
ee3f241205
add feature of minddata pipeline stage analysing function
5 years ago
quyongxiu1
9a93920fd0
fix some mapping relationships and add tests to verify the relationship
5 years ago
mindspore-ci-bot
bcdc61cc54
!273 Converter: use the AST to analyze and modify network definition script
Merge pull request !273 from ggpolar/br_wzk_dev
5 years ago
ggpolar
7cad801da3
parse scripts by AST in converter module.
Use the AST replaces the importlib/inspect modules to analyze and modify network definition script.
The importlib/inspect must load python script to analyze, but AST analysis is static code analysis and is very secure.
5 years ago
yelihua
7abccc0724
add summary info for step trace graph and change the name.
5 years ago
yelihua
37761b8193
fix the sensitive warning
5 years ago
yelihua
a7f89778e5
deal with empty reduce proc.
5 years ago
yelihua
c52d050193
update ut, st and validation.
5 years ago
quyongxiu
8c0104f420
add a new op mapping
add op mappings
fix pylint
fix mistake { as [
add tests
add test for eye and revise func and mappings
revise mapping and add test
fix pylint
fix pylint
5 years ago
mindspore-ci-bot
09f2462170
!169 add ut for framework parser
Merge pull request !169 from chenchao99/profiler_ut
5 years ago
luopengting
f83eadc907
enhance float cmp in tests.lineagemgr, fix probabilistic failure in st
5 years ago
mindspore-ci-bot
56e2723388
!228 Fix function too long.
Merge pull request !228 from yuximiao/master
5 years ago
chenchao99
7c539eef05
add ut for framework parser
5 years ago
yuximiao
858d824ea0
fix function too long
5 years ago
liangyongxiong
d3b797d973
add ut for scalars comparision
5 years ago
mindspore-ci-bot
b2062a9857
!189 fix the bug that when the profiler parameter subgraph is Default or Gradients, the profiler analyse will raise an exception
Merge pull request !189 from chenchao99/profiler_analyser
5 years ago
ggpolar
8cdd069581
modify mindconverter/README.md and st.
5 years ago