* vkmat and command api breaks

* always use compute queue for compute buffer transfer

* no barrier for readonly weight buffer

* record clone, drop queue_owner

* bring back layer forward

* fix validation errors

* lifecycle inside command makes life easier

* update doc

* record_import_android_hardware_buffer

* wip

* wip

* wip

* fix avx2 test

* wip

* fix slice pack8 test

* fix flatten pack8 test

* fix binaryop pack8 test

* fix interp pack8 test

* rewrite cast test for different blob type and packing

* test_hardswish.cpp: Add unittest of HardSwish

* ncnn: test: Add support for ROIPooling test

* test: Fix bottom_blob of ROIPooling test

* test_hardsigmoid.cpp: Add unittest of HardSigmoid

* fix requant relu6 bug

* fix

* delete pipeline change in forward/forward_inplace avoid race in multithreading

* test_clip.cpp: Add unittest of clip

* fix

* fix

* ncnn: test: Add support for ELU test
*For now alpha was generated by RandomFloat(0.001f, 1000.f)

* test: ELU_test: Remove duplicated cases

* use Mat class for Shape description

* shape specialization constant in compute shader

* wip

* wip

* test forward_inplace, add binaryop unaryop sigmoid test

* fix arm unaryop test

* fix arm binaryop test

* make shape hint optional, cast int8 to fp32, add cast test

* wip

* follow the good and old local size setting for conv1x1

* the optimal local size rewrite

* fix build on msvc

* add permute shader for all packing layout, add permute test

* concat and slice patial shape constant, slice test

* fix slice test

* interp test

* add lrn test, test packing layout implicitly

* add eltwise test

* add normalize test

* add instancenorm test

* reorg shape constant

* simple local group size partition

* add shape constant param

* skip compile caffe tools

* add convolution_int8 requant test

* fix

* test int8requant

* revert code

* clean code

* fix CI error

* resolve review advices

* Update convolution_arm.cpp

Co-authored-by: nihui <shuizhuyuanluo@126.com>

* add AbsVal layer test

* add 2d and 1d data test for AbsVal layer

* sort by alphabet

* add folder property for a better looking in visual studio or other property supported IDEs

* fix condition for not found protobuf

* 1. capitalize to lowercase
2. rename visual folder 'test' to 'tests'

* fix chgemm result dismatch

* fix misuse ldc as n

* fix gemm finished

* test conv_gemm_int8 and conv1x1_int8 passed

* format code