Megvii Engine Team
273c0e8745
fix(autodiff): fix some bugs in relation to 2nd order grad
1. implement double backward for batchnorm
2. fix grad attach in nested grad manager
3. pad empty tensor for unsatisfied output_has_grad
4. support double backward for jit subgraph
5. support double backward for autodiff.Function
6. readd debug flag MGE_LOG_OP_DISPATCH
GitOrigin-RevId: cd31ddc620
3 years ago
Megvii Engine Team
177001d5e5
refactor(dispatch): allow dynamic type creation
GitOrigin-RevId: 27dde05cff
3 years ago
Megvii Engine Team
ca00177719
perf(dispatch): speed up dispatch system
GitOrigin-RevId: eabbe3e021
4 years ago
Megvii Engine Team
7be7656c9f
fix(imperative): explicitly manage global structures
GitOrigin-RevId: 0f910c34b6
4 years ago
Megvii Engine Team
0bdd0b1467
refactor(dispatch): switch to new dispatch system
GitOrigin-RevId: 32dd49a23a
4 years ago
Megvii Engine Team
369c2ccc5a
style(all): reformat c++ code
GitOrigin-RevId: 3ffd1b211f
4 years ago
Megvii Engine Team
000517c641
fix(grad): stop using exception in grad_override
GitOrigin-RevId: 00ae38d48b
4 years ago
Megvii Engine Team
a605f38b26
refactor(opmeth): add OpMethCache struct
GitOrigin-RevId: c1ebe15672
4 years ago
Megvii Engine Team
0b8dc2c98b
refactor(subgraph): add generic encoded_graph
GitOrigin-RevId: 56d90be0e7
4 years ago
Megvii Engine Team
8480302da8
fix(autograd): make higher order grad experimental
GitOrigin-RevId: 81e1eb0ebf
4 years ago
Megvii Engine Team
72531f2b4a
test(autograd): add more tests for higher order grad
GitOrigin-RevId: 5fc308f87a
4 years ago
Megvii Engine Team
522e556b83
feat(autodiff): support higher order grad
GitOrigin-RevId: 86390d2179
4 years ago
Megvii Engine Team
b7e596b4a1
perf(autograd): copy inputs before capture in backward_graph_grad_rule
GitOrigin-RevId: 8b9c067b2d
4 years ago
Megvii Engine Team
241b35a697
refactor(ops): remove BackwardGraph op
GitOrigin-RevId: eda20e5760
4 years ago
Megvii Engine Team
4f240ec2d3
refactor(mge/jit): make trace return any kind of output
GitOrigin-RevId: fd1265c661
4 years ago
Megvii Engine Team
364afec033
chore(mge): update copyright years
GitOrigin-RevId: 3c0690bcc1
5 years ago
Megvii Engine Team
c53abcdf1d
chore(mge): minor improvements related to grad
GitOrigin-RevId: 102467d79d
5 years ago
Megvii Engine Team
278b2baa8c
perf(mge): add memory optimization for backward graph
precompute ops in forward to reduce saved tensor size
GitOrigin-RevId: d67043ba82
5 years ago
Megvii Engine Team
288c2e08b5
fix(mge/autodiff): fix expand_dims and grad rule fallback
GitOrigin-RevId: 4aae771222
5 years ago
Megvii Engine Team
3faba54f28
fix(mge): fix segfault with Function returning unused grads
GitOrigin-RevId: 0cce845923
5 years ago
Megvii Engine Team
75129cf071
chore(mge): clean up before merge to dev
* remove dead test
* clean some codes
* fix test_fake_quant due to change of implementation
GitOrigin-RevId: f030a9966d
5 years ago
Megvii Engine Team
4d75f691a0
feat(mge): restore remote send/recv
GitOrigin-RevId: 8b78fd5591
5 years ago
Megvii Engine Team
9fb5581f1d
refactor(mge): add specialized grad rule support
GitOrigin-RevId: 141ff0a24f
5 years ago
Megvii Engine Team
dc2507453b
feat(mge): add python custom op
GitOrigin-RevId: 35da0bb301
5 years ago
Megvii Engine Team
60c44b084c
refactor(mge): refactor to prepare for custom grad rules
GitOrigin-RevId: 4bd8850fdf
5 years ago
Megvii Engine Team
b310f2615b
feat(mge/imperative): implement trace and dump under new core implementation
GitOrigin-RevId: 4edc38eaf2
5 years ago
Megvii Engine Team
147cef52a0
refactor(mge/imperative): implement new tensor system
GitOrigin-RevId: 2dd4e460ac
5 years ago