Co-authored-by: ElvisYu <elvisyuovo@gmail.com>
Co-authored-by: 余浩文 <m18107220188@163.com>
Co-authored-by: Zr2223 <67497651+Zr2223@users.noreply.github.com>

* added a number of optimized sse layers, specifically to increase performance of mobilenet style networks

* use general fmadd

* forceline x86 fmadd for better performance

* fix msvc compile warning

* simplify swish implementation

* Use activation layer for better performance

* Optimize x86 ConvolutionDepthWise activation

* add general fused activation
* add NCNN_FORCE_INLINE option

* build macos vulkan

* drop rt

* load swiftshader

* workaround swiftshader fltmax fp16 nan

Co-authored-by: zhuo@mbp <imzhuo@foxmail.com>

* Fix codepaths for fp16 weights when only AVX is enabled

* Disable opt overrides

* Update SDK url

* Update vulkan SDK download version

* Debugging risv pad

* apply code-format changes

* fix padding test

* fix mips slice test

* fix lrn test

* implement mish swish image shader, fix pooling adaptive image storage support, drop debug output

* update ci ubuntu 18.04

Co-authored-by: nihui <shuizhuyuanluo@126.com>

* RVV optimzied DropOut

* RVV optimized GRU, fp32

* RVV optimized GRU, fp16

* RVV optimzed Softmax

* Use RVV spec 0.7.1 for C906.

* Fix code style issue.

* Update convolution_sgemm_packn_fp16s.h

RVV_SPEC_0_7 update

* apply code-format changes

Co-authored-by: Zhang Xianyi <xianyi@perfxlab.com>
Co-authored-by: yaobyPerfxlab <yaobyPerfxlab@users.noreply.github.com>

* arm neon optimization for requantize leakyrelu

* add missing changes

* Update test_requantize.cpp

* more test coverage

* RVV optimized HardSwish, with fp16 support

* RVV optimized HardSigmoid, with fp16 support

* apply code-format changes

Co-authored-by: thelastlin <thelastlin@users.noreply.github.com>