* wip

* wip

* wip

* fix avx2 test

* wip

* fix slice pack8 test

* fix flatten pack8 test

* fix binaryop pack8 test

* fix interp pack8 test

* rewrite cast test for different blob type and packing

* test_hardswish.cpp: Add unittest of HardSwish

* ncnn: test: Add support for ROIPooling test

* test: Fix bottom_blob of ROIPooling test

* test_hardsigmoid.cpp: Add unittest of HardSigmoid

* fix requant relu6 bug

* fix

* delete pipeline change in forward/forward_inplace avoid race in multithreading

* test_clip.cpp: Add unittest of clip

* fix

* fix

* ncnn: test: Add support for ELU test
*For now alpha was generated by RandomFloat(0.001f, 1000.f)

* test: ELU_test: Remove duplicated cases

* use Mat class for Shape description

* shape specialization constant in compute shader

* wip

* wip

* test forward_inplace, add binaryop unaryop sigmoid test

* fix arm unaryop test

* fix arm binaryop test

* make shape hint optional, cast int8 to fp32, add cast test

* wip

* follow the good and old local size setting for conv1x1

* the optimal local size rewrite

* fix build on msvc

* add permute shader for all packing layout, add permute test

* concat and slice patial shape constant, slice test

* fix slice test

* interp test

* add lrn test, test packing layout implicitly

* add eltwise test

* add normalize test

* add instancenorm test

* reorg shape constant

* simple local group size partition

* add shape constant param

* skip compile caffe tools

* add convolution_int8 requant test

* fix

* test int8requant

* revert code

* clean code

* fix CI error

* resolve review advices

* Update convolution_arm.cpp

Co-authored-by: nihui <shuizhuyuanluo@126.com>

* add AbsVal layer test

* add 2d and 1d data test for AbsVal layer

* sort by alphabet

* add folder property for a better looking in visual studio or other property supported IDEs

* fix condition for not found protobuf

* 1. capitalize to lowercase
2. rename visual folder 'test' to 'tests'

* fix chgemm result dismatch

* fix misuse ldc as n

* fix gemm finished

* test conv_gemm_int8 and conv1x1_int8 passed

* format code

* cpu test

* wip

* ci run test

* travis ci for arm64

* arm64 ctest

* copy vulkan loader

* wip

* run

* Update ccpp.yml

* gpu test

* swiftshader

* cache macos swiftshader

* try MoltenVK

* try vulkaninfo

* give swiftshader another try

* disable failed macos gpu test

* more conv test, fix conv3x3s1 gpu test fail

* fix deconvolution test

* dilation test

* cmake option to build tests

* ncnn_add_layer_test macro

* host barrier before upload and after download, handle packing layout option

* test packing layout

* wip

* wip

* merge deconvolution packing and non-packing code

* merge convolution packing and non-packing code

* pass top_blob_count param

* fix build

* take care of non-coherent mappable memory