* quantize and dequantize tests

* unify activation and usability function

* drop NCNN_REQUANT cmake option, test dequantize requantize pack8, fix webassembly build

* benchmark use requantize int8 model

* use local pool allocator

* detach extract feat from local allocator

* fix test

* feat: add denormal options

Flush-To-Zero(FTZ) and Denormals-Are-Zero(DAZ) are modes that bypass IEEE754 methods of dealing with denormal floating-point numbers on x86_64 and some x86 CPUs.

* feat: Integrate `flush_denormals` into `Extractor::extract`

* chore: replace global variable with `ThreadLocalStorage`

* add bridge image for adreno image storage upload and download

* enable sbn1, print bugbilz flag

* blacklist old adreno

* let user choose use_image_storage option even when bug_storage_buffer_no_l1

* build shared lib and enable lto

* reserved for layer and option

* allocator pimpl

* datareader pimpl

* paramdict pimpl, disable copy assign for allocator and datareader

* modelbin pimpl

* net extractor pimpl

* gpu pimple

* disable copy assign vulkandevice, code format

* command pimpl, dummy image readonly

* pipeline pipelinecache pimpl, export platform class

* code format, export simple family

* update ci

* disable lto on android armv7, merge webassembly ci

* link libgcc, fix macos dylib version

* pipeline pimpl, gpu info pimpl

* destroy gpu info after vulkan device

* ignore msvc stl class warning

* fix ncnn_paramdict_get_float return type

* fix vktransfer upload fp16 without flatten, add command test

* cmake option for platform api uses
* adroid gpu ci does not rely on glslangvalidator, add android termux ci

Co-authored-by: yangfengmax <yangfengmax@didichuxing.com>

* add custom layer destroyer

* set default layer destroyer with 0

* Add readme for keras2ncnn

* Add supported model variants

* Fix supported model variants

* Add extract without convert pack/fp1632

* SSE2: BatchNorm

* Fixed batch norm in AVX configuration

* Optimized register size switch

* Attempt to pass CI

* Attempt to pass CI

* Bias op

* Element wise ops

* Support packing on x86 by default

* Fixed macro range in bias

* Use aligned read for packed data

* Update testutil.h

* Update pooling_x86.cpp

* Support wasn SIMD

* Fix emscripten compiler flags

* fix build

* more ci fix

* concat x86 pack4

* flatten x86 pack4

* more x86 pack4

* ci pass

* fix

* enable sse2 mathfun

* enable --experimental-wasm-simd

Co-authored-by: nihui <shuizhuyuanluo@126.com>
Co-authored-by: nihuini <nihuini@tencent.com>

* drop bug_layout_binding_id_alias flag

* runtime cpu dispatch

* force thread one

* disable openmp for coverage

* simplify test layer

* print NCNN_TARGET_ARCH

* less ci build variants

* weight fp16 storage option

* test convdw int8

* apple a12 a13

* ncnn_add_layer ncnn_add_shader cmake macro

* online pipeline cache wip

* device-wide pipeline cache

* enable model-wide pipeline cache

* drop pre-created shader modules

* always use pipeline cache

* use implicit model-wide pipeline cache, code format

* code clean

* added avx implementations of FC and Max pool

* Specify AVX2

* Small fixes and using Fused avx activations

* fix type casting

* fixing some CI errors

* Fix code format

* fix pooling test

* remove vector typedef

* More compile fixes

* remove vector typedef

* set c++ version to 17

* Force c++ 17

* Fixing mathfun

* Try and workaround typedef issues

* typefix

* Remove typedef

* switch to static inline

* attempting to fix msvc bug

* Verified MSVX FIX

* Fixing clang build

* commit before switch

* More avx and packing implementation

* Fix ctest

* starting the depthwise pack 8 implementation

* Unrolled loop

* add depthwise pack 8 implementations

* Working 1x1 pack 8 implementation added

* revert incorrect changes

* added conact elempack 8

* more elempack enabled layers added and started on the conversion of the winograd pack4 conv 3x3

* Added code formatting

* fix styling

* Unroll loops

* unrolling loops

* Added more elempac layers for mobilenet v3

* revert commit

* fix code style

* remove arm neon references

* remove pack4 references

* More cleanup

* added packing avx code

* fixing linux build ctests

* remove usage of aligned loads

* More aligned mem ops removed

* Cleanup, revert some files and remove not working winograd and shufflechannel implementation

* add stackoverflow referal

* Fix windows build

* Restyled by clang-format

* Restyled by astyle

* Restyled by clang-format

* Restyled by astyle

* implement requested chaanges

* remove reshape

* revert arm file change

* Restyled by clang-format

* Restyled by astyle

* Restyled by clang-format

* Restyled by astyle

* fix unterminated directive

Co-authored-by: Restyled.io <commits@restyled.io>