nihui
dadc640c66
x86 avx512 optimization ( #3581 )
* unified relu avx512
* unifed clip avx512
* unaryop avx512
* sigmoid avx512
* binaryop avx512
* padding convolution avx512
* convolutiondepthwise avx512
* innerproduct avx512
* reshape avx512
* slice avx512
* hardsigmoid hardswish avx512
* swish avx512
* pooling avx512
* crop avx512
* convolution sgemm pack16
* convolution 3x3 winograd pack16
* interp avx512
* convolution sgemm pack1to16
* convolution sgemm pack16to8
* convolution sgemm pack8to16
* convolution sgemm pack16to4
* fix vulkan permute pack8
* fix vulkan convolution gemm pack8to1
4 years ago
nihui
a9c59bb93c
add -mavx512bw flag for avx512 build ( #3671 )
4 years ago
nihui
be7cae2bef
mips msa optimization for convolutiondepthwise innerproduct int8 ( #3679 )
4 years ago
nihui
4eb279ce26
add loongson mmi compiler header, less msa prefetch distance ( #3678 )
4 years ago
nihui
c09d7b3591
mips msa optimization for convolution int8 ( #3675 )
* basic mips msa optimization for convolution int8
* mips msa optimization for convolution int8 gemm
* mips msa optimization for convolution int8 winograd pack8to4/pack8to1
* mention msa maddv/msubv intrinsics bug
4 years ago
nihui
72c467d1d9
mips msa optimization for quantize dequantize requantize ( #3672 )
4 years ago
WuJinxuan
e984f9f40d
add multiheadattention arm ( #3667 )
* add:multiheadattention_arm
* pass the test in local
* add omp
* return naive
Co-authored-by: EdVince <EdVince@users.noreply.github.com>
4 years ago
nihui
559e5b23f9
vulkan tensorcore optimization ( #3628 )
* query and enable cooperative matrix
* fix build with old vulkan sdk
* implement cooperative matrix optimization
* add nvidia-t4 coverage
* adjust test option for more coverage
4 years ago
nihui
4302f78f55
less specialization constant for vulkan conv1x1s1d1 shaders ( #3657 )
4 years ago
tpoisonooo
aab476f5b6
fix build warning ( #3651 )
4 years ago
nihui
9c92df814f
better condition for mixing vulkan winograd f23 and f43
4 years ago
nihui
944829838b
vulkan conv1x1s1d1 for any packing ( #3646 )
4 years ago
nihui
62a872bad3
vulkan winograd for any packing ( #3645 )
4 years ago
nihui
9e3cc1c5df
two stage vulkan innerproduct ( #3642 )
4 years ago
nihui
677d54d496
fuse vulkan winograd pad and crop ( #3640 )
4 years ago
nihui
002c07d4ec
mix vulkan winograd f23 and f43 ( #3639 )
* mix vulkan winograd f23 and f43
* larget epsilon for winograd optimization test
4 years ago
nihui
d42e048b56
pnnx convert torch.addmm ( #3634 )
4 years ago
nihui
3ddd65e18c
massive vulkan optimization part3 ( #3632 )
* implicit gemm
* unroll direct conv by 2x2x2
4 years ago
nihui
cfcb1cffa9
massive vulkan optimization part2 ( #3621 )
* vulkan local memory optimization for conv1x1 pack4 and winograd on dgpu
* unified innerproduct pipeline creation
* reorder deconvolution weight layout
* flexible local memory data type
* more local memory optimization for conv/deconv gemm
4 years ago
tpoisonooo
edd3a78ffe
style(src/layer): remove unused para and var ( #3623 )
Co-authored-by: MegEngine <megengine@megvii.com>
Co-authored-by: tpoisonooo <tpoisonooo@users.noreply.github.com>
4 years ago
nihui
6e19ab26ba
massive vulkan optimization ( #3602 )
* vulkan deconvolution sgemm col2im
* vulkan convolution winograd43
* improve fp16s numeric stablity
* vulkan convolution im2col sgemm
* check squeezenet top2, as top3 vs top4 score too close..
4 years ago
nihui
8f25ba0cab
enable fp16a on mali-g31
4 years ago
Kenji Mouri
8e29c42080
Improve SSE2 implementations in x86 targets. ( #3605 )
* Make some typos for SSE2 floor.
* Improve the implementation of SSE2 abs.
* Improve the implementation of SSE2 ceil.
4 years ago
Kenji Mouri
2b4a2125e6
Add SSE2 implementation of floor and ceil in x86 targets. ( #3595 )
* Add SSE2 implementation of floor and ceil in x86 targets.
* apply code-format changes
* Update the SSE2 floor implementation.
Co-authored-by: MouriNaruto <MouriNaruto@users.noreply.github.com>
4 years ago
Kenji Mouri
e4f6b118a2
Fix comment typo because it should be itm[6][6]. ( #3591 )
4 years ago
nihuini
b053a8c6d5
fix unlocked pool allocator destroyed too early issue in gpu convdw and deconvdw inference
4 years ago
nihui
30e106b185
add another mali g52 device id
4 years ago
nihui
2880eff264
deconv1d deconv3d ( #3584 )
* fix sigmoid returns nan with very large input
4 years ago
Yoh
f5b90a5333
Add unaryop x86 ( #3579 )
Co-authored-by: Yoh <wangpeizhou@bilibili.com>
Co-authored-by: Yoh-Z <Yoh-Z@users.noreply.github.com>
4 years ago
nihuini
bc188ece58
update modelwriter for new operators
4 years ago
nihui
457e066eb5
x86 f16c infrastructure ( #3577 )
4 years ago
Yoh
4b68e3f9c1
Opt avxmath ( #3563 )
* optimize x86 avx exp log sincos fma
* optimize avx&sse_mathfun exp,log,cos,sin,sincos and add fnmadd to x86_usability
Co-authored-by: Yoh-Z <Yoh-Z@users.noreply.github.com>
4 years ago
nihui
920aa79f04
drop x86 avx2 fp16 ( #3568 )
4 years ago
nihui
76e32e9ee6
fix interp nearest by scale factor, fix issue #3555 ( #3565 )
* lets accept the float div vs recp error
4 years ago
tpoisonooo
cfacba273f
improvement(binaryop): use MAKE_FUNCTION macro ( #3559 )
Co-authored-by: MegEngine <megengine@megvii.com>
Co-authored-by: tpoisonooo <tpoisonooo@users.noreply.github.com>
4 years ago
nihui
d452eca28f
convert torch.matmul, eliminate noop pad and identity op, fuse transpose matmul, fuse select to unbind ( #3554 )
4 years ago
nihui
4654030541
decouple x86 fma avx2 ( #3560 )
4 years ago
nihui
e1a8c87bc8
wrap namespace for function objects ( #3558 )
4 years ago
nihuini
69737ad169
fix permute vulkan
4 years ago
nihuini
d6df25c73f
fix avx512 ci
4 years ago
nihuini
57a7101fc6
fix ci, second try
4 years ago
nihuini
cfedcfdc57
fix ci, first try
4 years ago
nihui
d276ecd401
fix avx512 illegal instruction ( #3550 )
4 years ago
nihuini
51ecc33d9d
check avx512vl extension for discarding old-slow avx512 chips, enable avx512 option by default
4 years ago
nihui
3f2799d706
always build tightly packed weight, fix #3545 ( #3547 )
4 years ago
nihui
a46edcf720
x86 optimization for interp ( #3546 )
4 years ago
nihui
139554b36e
rewrite convolution x86 sgemm pack1 ( #3544 )
4 years ago
Yoh
d2999b8d53
Optimize scale x86 ( #3540 )
Co-authored-by: Yoh-Z <Yoh-Z@users.noreply.github.com>
4 years ago
nihui
fb6283c8b0
x86 avx fma optimization ( #3543 )
4 years ago
nihui
3181616439
treat old reduction axes param as failure
4 years ago