He Wei
41dcac9c49
Replace std::unordered_map/set with robin-hood-hashing
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing )
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.
1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
- mindspore::HashMap as an alias of robin_hood::unordered_map;
- mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
- `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
- `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
- `std::unordered_map` --> `mindspore::HashMap`;
- `std::unordered_set` --> `mindspore::HashSet`;
- `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
- `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
- AnfNodeConfig hash and equal;
- Fix a bug in `Slice::operator==()`;
- Fix a bug in `CNode::HasPrimalAttr()`;
- Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
- Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
- As parameter of functions that exposed to python by pybind11;
- Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
4 years ago
l00591931
9353bd10a4
Enable tuple as variable in optimizer
4 years ago
gaoyong10
83ee99b07d
Get output nodes by control node.
4 years ago
limingqi107
8ef51f22c1
unified runtime optimize the graph output
4 years ago
LaiYongqiang
9bfb2d99fa
refactor device loop control
4 years ago
limingqi107
19330b6f82
unified runtime support graph sink output update
4 years ago
He Wei
57c75a9479
Support construct CNode by move inputs in
4 years ago
hwjiaorui
eaa3dc57b7
add dynamic shape attr pass
4 years ago
i-robot
b95a6d459d
!23906 add the interface of ascend supporting unified time
Merge pull request !23906 from limingqi107/new_actor_runtime
4 years ago
limingqi107
3e19107875
add the interface of ascend supporting unified time
4 years ago
zhaosida
7bbad8a84e
self code check
4 years ago
i-robot
0fa3fa78fb
!23709 Clean security and codex warning
Merge pull request !23709 from yelihua/dev
4 years ago
yelihua
83b3f6fef7
delete Common::GetRealPath
4 years ago
jiangshuqiang
c2bd061889
fix summary isolation
4 years ago
i-robot
dc84031179
!23568 make async dump when sink_mode=False use input_ctrl_tensor like sink_mode=True
Merge pull request !23568 from john_tzanakakis/jt_bug_fixes
4 years ago
John Tzanakakis
4b77150f94
make async dump when sink_mode=False use input_ctrl_tensor like sink_mode=True
4 years ago
kswang
a0dc465041
add mem scheduler
4 years ago
djc
b077aa1cab
[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset
4 years ago
djc
4e6f7dc97d
[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset
4 years ago
simson
5b34859541
modify the limit of axis of reduce ops
4 years ago
wilfChen
126bfff431
fix graph execution acquire gil.
4 years ago
limingqi107
8c690e3d18
unified runtime codedex fixed
4 years ago
gaoyong10
03021379d4
Fix ocean and sponge net.
4 years ago
kswang
09aa4d77fa
fix gpu ps hung up bug
4 years ago
l00591931
c7bc867ae4
Add CloneCNodeWithInfos for kernel graph
4 years ago
kswang
42155e7e5c
add updated parameter for graph
4 years ago
i-robot
b9d5f1ddab
!18304 code clean
Merge pull request !18304 from yuchaojie/code-clean2
4 years ago
yuchaojie
273f03db77
code clean
4 years ago
gaoyong10
3051ed82f9
Fix the no input actor control link in control flow.
4 years ago
i-robot
1cdaa12cfd
!18093 [Debugger] Add root graph id to sub graph's pb file
Merge pull request !18093 from TinaMengtingZhang/add_graph_id
4 years ago
TinaMengtingZhang
dd6884eb6f
add root graph id to pb file
4 years ago
limingqi107
7f634d12f0
actor runtime support GraphKrenel
4 years ago
kswang
9d5f754135
format codes
4 years ago
mindspore-ci-bot
802f8620dd
!16949 remove duplicate code
From: @kisnwang
Reviewed-by: @zhoufeng54,@yuchaojie
Signed-off-by: @yuchaojie
4 years ago
kswang
5e8cbedd9a
remove duplicate code
4 years ago
limingqi107
d405964aab
actor runtimie supports allreduce multi-stream
4 years ago
kswang
bc1f132d32
format some code
4 years ago
wilfChen
095c99d199
gpu inference
4 years ago
limingqi107
3029cb12ee
actor runtime support host and devcie
4 years ago
limingqi107
d8399e61e7
graph scheduler support multi graphs
4 years ago
liangzelang
269a30a820
delete unused code
4 years ago
mindspore-ci-bot
25ce6a104e
!15600 add the continue memory alloc of communication kernel for actor runtime
From: @limingqi107
Reviewed-by: @wilfchen,@cristoval
Signed-off-by: @cristoval
4 years ago
limingqi107
fba1dd8f2f
add the continue memory alloc of communication kernel for actor runtime
4 years ago
mindspore-ci-bot
dad61aab28
!15613 fix pclint warnings
From: @Margaret_wangrui
Reviewed-by: @zhoufeng54,@jjfeing
Signed-off-by: @jjfeing
4 years ago
Margaret_wangrui
1353b7451d
fix pclint warnings
4 years ago
lianliguang
5849706968
clean pclint warning
4 years ago
liangzelang
052a803c63
adapt to mem reuse
5 years ago
limingqi107
2f5b786daa
add dump info and fix process bug of actor runtime
5 years ago
mindspore-ci-bot
e2260a2f09
!14612 remove ControlDepend
From: @huangbingjian
Reviewed-by:
Signed-off-by:
5 years ago
huangbingjian
63a89925ff
remove ControlDepend and its use
5 years ago