chujinjin
d20c9d93d8
support pynative heterogeneous
4 years ago
He Wei
41dcac9c49
Replace std::unordered_map/set with robin-hood-hashing
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing )
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.
1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
- mindspore::HashMap as an alias of robin_hood::unordered_map;
- mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
- `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
- `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
- `std::unordered_map` --> `mindspore::HashMap`;
- `std::unordered_set` --> `mindspore::HashSet`;
- `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
- `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
- AnfNodeConfig hash and equal;
- Fix a bug in `Slice::operator==()`;
- Fix a bug in `CNode::HasPrimalAttr()`;
- Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
- Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
- As parameter of functions that exposed to python by pybind11;
- Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
4 years ago
7347157+joylvliang@user.noreply.gitee.com
272b7ba410
fix_pc_lint_problem
4 years ago
zjun
06b4865139
Fix high grad cache
Signed-off-by: zjun <zhangjun0@huawei.com>
Modify currg to forwardfg
35767d9b3e Modify currg to forwardfg
Fix grad order
b4858330e1 Fix grad order
4 years ago
i-robot
0bb81093f8
!25583 Fix clean code
Merge pull request !25583 from zjun/fix_code_check_1
4 years ago
zhang__sss
8bae4d9d50
grad
4 years ago
7347157+joylvliang@user.noreply.gitee.com
bccb3d0db6
enable_psenet_run
4 years ago
zjun
8d3f74371e
Fix clean code
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
7347157+joylvliang@user.noreply.gitee.com
b3bb415136
code_self_check_for_master
4 years ago
7347157+joylvliang@user.noreply.gitee.com
9fed6b3513
pclint_and_codedex
4 years ago
i-robot
848f31b6d9
!23263 Enable PyNative LAZY BUILD in Cell automatically
Merge pull request !23263 from caifubi/master-enable-async-build-in-cell
4 years ago
zjun
69b2d9455c
Fix grad operation would be affected by different order
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
caifubi
9357931761
Enable PyNative Lazy Build in Cell automatically
4 years ago
7347157+joylvliang@user.noreply.gitee.com
c93ac8c098
add_graph_flag_info_for_phase
4 years ago
7347157+joylvliang@user.noreply.gitee.com
be267185bf
optimize_codes_for_ms_function
4 years ago
zjun
b5dfe05dd0
Use cache for mix
77b4f906af
use cell input cast
83fb06b93c
time 115 ok
15288c220c
Add ostringstream
4713a6ca57
4 years ago
i-robot
0531edfa67
!20918 Eliminate forward CNode in grad graph decorated by ms_function
Merge pull request !20918 from JoyLvliang/eliminate_forward_cnode_in_grad_graph_decorated_by_ms_function
4 years ago
i-robot
29caae557f
!22494 fix high grad bug
Merge pull request !22494 from zjun/fix_high_grad
4 years ago
caifubi
537fce0ee1
PyNative Kernel Parallel Build
1. Create Tensor and DeviceAddress for output before Launch.
2. Push Launch/Build Task to Queue and execute togather.
4 years ago
7347157+joylvliang@user.noreply.gitee.com
0fb07a6377
eliminate_forward_cnode_in_grad_graph_decorated_by_ms_function
4 years ago
zjun
892287a1bc
Fix high order bug
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
ms_yan
36a8886ca2
Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab .
Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"
This reverts commit 4e6f7dc97d .
delete pass_registry_test.cc
comment hiai_nlu_model_multi.pb related line
4 years ago
djc
4e6f7dc97d
[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset
4 years ago
zjun
35aab6144d
Fix pynative memory leak
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
LaiYongqiang
5e79bd6349
get kernel build server dir path from python
4 years ago
i-robot
9490f835c9
!21740 Add the cache tag in the case of dynamic images
Merge pull request !21740 from zjun/Add_Dynamic_Graph_Flag
4 years ago
chujinjin
b692d5bb15
fix python 3.8 args error
4 years ago
zjun
a6ef66bfd4
Add the cache tag in the case of dynamic images
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
zhangzhaoju
e034570c24
Delete unused Code
4 years ago
zjun
5f76c0e418
Fix pclint
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
i-robot
8823a56463
!19809 Support non tensor as inputs of outermost cell in pynative
Merge pull request !19809 from JoyLvliang/Support_non_tensor_as_inputs_of_outermost_cell_in_pynative
4 years ago
i-robot
f059d49f37
!20059 Fix pynative switch layer
Merge pull request !20059 from zjun/fix_switch_layer
4 years ago
7347157+joylvliang@user.noreply.gitee.com
f020fd5865
Support_non_tensor_as_inputs_of_outermost_cell_in_pynative
4 years ago
zjun
fecef828e8
Fix switch layer
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
zjun
513c67cf5e
Fix dynamic shape to opinfo
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
zjun
1af8735a19
Fix shen
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
7347157+joylvliang@user.noreply.gitee.com
6efc47853f
fix_bug_of_resnet50_512_batch_size_memory_not_enough
4 years ago
joylvliang
356c9361bd
fix_memory_not_enough_in_pynative_mode
4 years ago
zjun
4e550e5b42
Fix sens bug
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
mindspore-ci-bot
4db1ad903b
!17596 Reset op info in op_exec_Info when it be cached
From: @joylvliang
Reviewed-by: @ginfung,@chujinjin,@ginfung
Signed-off-by: @chujinjin
4 years ago
joylvliang
7c49225003
add_input_tensor_replace_in_pynative
4 years ago
zhangzhaoju
49430559b6
Change key value for prim_abs_list_
The attrs of prim could be changed while optimize, so the key is a copy
of prim attrs
4 years ago
mindspore-ci-bot
00d00877be
!17396 Fix bug of loss can not converge when temp cell in network
From: @joylvliang
Reviewed-by: @ginfung,@chujinjin
Signed-off-by: @chujinjin
4 years ago
joylvliang
05cfa6dd1c
fix_bug_of_efficientnet_not_work
4 years ago
zjun
8a5731d899
Fix bprop bug
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
zjun
462723978c
Fix bprop bug
Signed-off-by: zjun <zhangjun0@huawei.com>
4 years ago
zjun
d53355819a
Opitimze pyantive process
Signed-off-by: zjun <zhangjun0@huawei.com>
5 years ago
lvliang
b118bd0c89
fix_bug_of_fprop_graph_is_nullptr_when_using_cache
5 years ago
mindspore-ci-bot
a76342f2cd
!16547 Change keyvalue for prim_abs_list_, avoid mismatch
From: @zhangzhaoju
Reviewed-by: @zh_qh,@ginfung,@ginfung
Signed-off-by: @zh_qh
5 years ago
zhangzhaoju
7beca017d4
Change key of prim_abs_list_ for pynative mod
5 years ago