* fine grained winograd options

* x86 optimization for convolution winograd f23 pack4/pack8/pack16

* fix avx512 and t4 ci

* fix fast direct conv path

* winograd63 is actually slower than winograd43 on very large channel

* convolution winograd pack16to1

* x86 deconvolution and deconvolutiondepthwise

* simpleomp allow 32 arguments

* drop shadow variable workaround

* less winograd test error

* unified relu avx512

* unifed clip avx512

* unaryop avx512

* sigmoid avx512

* binaryop avx512

* padding convolution avx512

* convolutiondepthwise avx512

* innerproduct avx512

* reshape avx512

* slice avx512

* hardsigmoid hardswish avx512

* swish avx512

* pooling avx512

* crop avx512

* convolution sgemm pack16

* convolution 3x3 winograd pack16

* interp avx512

* convolution sgemm pack1to16

* convolution sgemm pack16to8

* convolution sgemm pack8to16

* convolution sgemm pack16to4

* fix vulkan permute pack8

* fix vulkan convolution gemm pack8to1

* mix vulkan winograd f23 and f43

* larget epsilon for winograd optimization test

Co-authored-by: ElvisYu <elvisyuovo@gmail.com>
Co-authored-by: 余浩文 <m18107220188@163.com>
Co-authored-by: Zr2223 <67497651+Zr2223@users.noreply.github.com>

* add general fused activation
* add NCNN_FORCE_INLINE option

* quantize and dequantize tests

* unify activation and usability function

* drop NCNN_REQUANT cmake option, test dequantize requantize pack8, fix webassembly build

* benchmark use requantize int8 model

* arm neon optimization for conv3x3s1 winograd42

* better condition

* Update test_convolution.cpp

* Update test_convolution.cpp

* more proper conditions

* arm neon optimization for general im2col sgemm pack4

* add sgemm

* wip

* wip

* fix armv7 build

* more conditions blah blah

* code format

* fix convolution

* move packed convolution to seperated header source

* unify weight data bf16

* proper conditions

* conv3x3s2 sgemm pack4 test

* perf(innerproduct-arm): add aarch64 gemm

* fix(innerproduct): fix compilation errror

* fix(armv7-innerproduct): fix armv7 compilation error

* fix(innerproduct): fix gemm param

* fix(int8): update mock scales and fix runtime error

* fix(compilation): fix compilation error

* runtime cpu dispatch

* force thread one

* disable openmp for coverage

* simplify test layer

* print NCNN_TARGET_ARCH

* less ci build variants

* weight fp16 storage option

* test convdw int8

* apple a12 a13

* ncnn_add_layer ncnn_add_shader cmake macro

* added avx versions of commonly used layers

* Restyled by clang-format

* Restyled by astyle

* Restyled by clang-format

* Restyled by astyle

* Unroll loops and increase test coverage

* Restyled/pull 1897 (#13)

* Restyle

Co-authored-by: Restyled.io <commits@restyled.io>

* cleanup variable declaration

* fix ctest

* Restyled/pull 1897 (#14)

Restyle
Co-authored-by: Restyled.io <commits@restyled.io>

* Fix ctest for convolutions without AVX.

Co-authored-by: Restyled.io <commits@restyled.io>

* Fix winograd 3x3 avx and extend test converage

* fix ctest on non-avx path

* Restyled by clang-format

* Restyled by astyle

* Restyled by clang-format

* Restyled by astyle

* remove unused broadcasts

* Comment with #if 0

Co-authored-by: Restyled.io <commits@restyled.io>

* use Mat class for Shape description

* shape specialization constant in compute shader

* wip

* wip

* test forward_inplace, add binaryop unaryop sigmoid test

* fix arm unaryop test

* fix arm binaryop test

* make shape hint optional, cast int8 to fp32, add cast test

* wip

* follow the good and old local size setting for conv1x1

* the optimal local size rewrite

* fix build on msvc

* add permute shader for all packing layout, add permute test

* concat and slice patial shape constant, slice test

* fix slice test

* interp test

* add lrn test, test packing layout implicitly

* add eltwise test

* add normalize test

* add instancenorm test

* reorg shape constant

* simple local group size partition

* add shape constant param

* skip compile caffe tools

* add convolution_int8 requant test

* fix

* test int8requant

* revert code

* clean code

* fix CI error

* resolve review advices

* Update convolution_arm.cpp

Co-authored-by: nihui <shuizhuyuanluo@126.com>

* cpu test

* wip

* ci run test

* travis ci for arm64

* arm64 ctest

* copy vulkan loader

* wip

* run

* Update ccpp.yml

* gpu test

* swiftshader

* cache macos swiftshader

* try MoltenVK

* try vulkaninfo

* give swiftshader another try

* disable failed macos gpu test

* more conv test, fix conv3x3s1 gpu test fail

* fix deconvolution test

* dilation test

* cmake option to build tests

* ncnn_add_layer_test macro

* host barrier before upload and after download, handle packing layout option

* test packing layout

* wip

* wip

* merge deconvolution packing and non-packing code

* merge convolution packing and non-packing code

* pass top_blob_count param

* fix build

* take care of non-coherent mappable memory