* discard weight memory for x86 and vulkan
* drop arm innerproduct weight
* drop arm convolution weight
* drop arm convolutiondepthwise weight
* drop x86 vulkan deconvolution deconvolutiondepthwise weight
* drop arm deconvolution deconvolutiondepthwise weight
* arm neon assembly optimization for innerproduct pack4

* feat(src/layer): add vision_transformer benchmark and relative layer

* refactor(testutil.h): add para for RandomMat

* convolution winograd pack16to1

* x86 deconvolution and deconvolutiondepthwise

* simpleomp allow 32 arguments

* drop shadow variable workaround

* less winograd test error

* unified relu avx512

* unifed clip avx512

* unaryop avx512

* sigmoid avx512

* binaryop avx512

* padding convolution avx512

* convolutiondepthwise avx512

* innerproduct avx512

* reshape avx512

* slice avx512

* hardsigmoid hardswish avx512

* swish avx512

* pooling avx512

* crop avx512

* convolution sgemm pack16

* convolution 3x3 winograd pack16

* interp avx512

* convolution sgemm pack1to16

* convolution sgemm pack16to8

* convolution sgemm pack8to16

* convolution sgemm pack16to4

* fix vulkan permute pack8

* fix vulkan convolution gemm pack8to1

* query and enable cooperative matrix

* fix build with old vulkan sdk

* implement cooperative matrix optimization

* add nvidia-t4 coverage

* adjust test option for more coverage

* mix vulkan winograd f23 and f43

* larget epsilon for winograd optimization test

* vulkan deconvolution sgemm col2im

* vulkan convolution winograd43

* improve fp16s numeric stablity

* vulkan convolution im2col sgemm

* check squeezenet top2, as top3 vs top4 score too close..

* fix sigmoid returns nan with very large input

Co-authored-by: ElvisYu <elvisyuovo@gmail.com>
Co-authored-by: 余浩文 <m18107220188@163.com>
Co-authored-by: nihui <nihui@users.noreply.github.com>
Co-authored-by: Zr2223 <67497651+Zr2223@users.noreply.github.com>
Co-authored-by: Zr2223 <Zr2223@users.noreply.github.com>

Co-authored-by: ElvisYu <elvisyuovo@gmail.com>
Co-authored-by: 余浩文 <m18107220188@163.com>
Co-authored-by: Zr2223 <67497651+Zr2223@users.noreply.github.com>

* add general fused activation
* add NCNN_FORCE_INLINE option

* Fix codepaths for fp16 weights when only AVX is enabled

* Disable opt overrides

* Update SDK url

* Update vulkan SDK download version

* Debugging risv pad

* apply code-format changes

* fix padding test

* fix mips slice test

* fix lrn test

* implement mish swish image shader, fix pooling adaptive image storage support, drop debug output

* update ci ubuntu 18.04

Co-authored-by: nihui <shuizhuyuanluo@126.com>

* arm neon optimization for requantize leakyrelu

* add missing changes

* Update test_requantize.cpp

* more test coverage

* implement convolution1d and pooling1d

* add conv1d pool1d test

* fuse convolution1d activation

* update operator doc

* fix vulkan adpative pooling