nihuini
6c41822d35
do not remove optional hidden output for lstm/gru/rnn
5 years ago
nihuini
5e85f447e6
convert mxnet channel padding, fix some lgtm warnings
5 years ago
nihui
5fe75f19ef
architecture changes for int8 packing ( #2771 )
* quantize and dequantize tests
* unify activation and usability function
* drop NCNN_REQUANT cmake option, test dequantize requantize pack8, fix webassembly build
* benchmark use requantize int8 model
5 years ago
nihui
d4a7abc218
fix onnx2ncnn clip without max blob, fix #2788
5 years ago
restyled-io[bot]
5f00ba89d2
feat(ncnnoptimize): replace denormals to zero on layers with weights ( #2690 )
* feat(ncnnoptimize): replace denormals to zero on layers with weights
Co-authored-by: youngsoo.lee <youngsoo15.lee@gmail.com>
Co-authored-by: Restyled.io <commits@restyled.io>
5 years ago
nihui
19c183cacc
fix ncnnoptimize default cut range
5 years ago
restyled-io[bot]
5e565cfa8a
Restyle add net Cut Function ( #2763 )
* add ncnnoptimise cut net function
* add ncnnoptimise cut net function
* Restyled by clang-format
* Restyled by astyle
* Restyled by clang-format
* Restyled by astyle
Co-authored-by: chenty <admin@chenty.com>
Co-authored-by: Restyled.io <commits@restyled.io>
5 years ago
nihuini
15d63ec0f5
fuse onnx multiheadattention with same qkv blob
5 years ago
nihuini
e449435dbe
fix mlir2ncnn warning, prettier alignment :)
5 years ago
nihuini
c8ccccf045
adapt mlir changes
5 years ago
nihuini
c17eb4e208
multiheadattention layer
5 years ago
nihuini
b0d16325b1
fuse onnx binaryop with scalar
5 years ago
nihuini
f7cbcaa72b
fix onnx normalize expand ghost shape
5 years ago
nihuini
c910574b5b
fuse onnx multiheadattention
5 years ago
nihuini
f2a5ea7678
fix layernorm ghost input without affine
5 years ago
nihuini
7ac23ab34d
fuse onnx layernorm, fix 2-dim layernorm implementation, add test
5 years ago
nihui
d3d16d2413
fix ncnnoptimize crash on models with multiple custom layers
5 years ago
nihuini
a1839f6bce
fix ncnnoptimize shufflechannel reverse mode
5 years ago
nihuini
5b72a37544
fix megvii style shufflechannel blob count mismatch
5 years ago
nihuini
f47fbcbf83
preserve the very first onnx constant dimension size when we guess it is not the batchsize one, fix #2487
5 years ago
nihuini
0e79532975
topological sort onnx nodes, convert onnxruntime bert ops
5 years ago
Guoxia Wang
f3c48cd063
Fix bug of adaptive pool in int8 quantization model ( #2637 )
5 years ago
daquexian
f684dc236b
allow set llvm/mlir dirs from cli ( #2624 )
5 years ago
Zhuo Zhang
30a4482506
fix typo in comment in ncnn2int8.cpp ( #2627 )
5 years ago
nihuini
6550a517ef
adapt mlir api changes, update tf dialect
5 years ago
nihui
b01728a3be
fix crash when eliminating memory footprint on undefined blobs, fix #2609
5 years ago
nihuini
11c569fc52
fix in-between empty input node
5 years ago
nihuini
5bd07030ab
remove onnx expand shape node
5 years ago
nihui
4f2907d129
arm neon optimization for rnn ( #2601 )
5 years ago
nihuini
6572e98f66
handle onnx transpose 102 201 after lstm
5 years ago
nihui
ef3550b52f
gru and rnn layer ( #2572 )
5 years ago
nihuini
cf853bd3ce
convert onnx gru rnn graph
5 years ago
Guoxia Wang
13d0bfcfd0
fix onnx2ncnn adaptive pool conversion bug, remove no used weights node ( #2570 )
5 years ago
nihuini
8790de3507
better onnx lstm fusion
5 years ago
nihuini
9b949d65b3
fuse onnx lstm, codeformat exclude pybind11, fix #2562
5 years ago
Guoxia Wang
609f63c57e
support PyTorch AdaptiveAvgPool2d and AdaptiveMaxPool2d ( #2546 )
* support pytorch adaptive pool
* support onnx2ncnn adaptive pool convert
* support ncnnoptimize adaptive pool param write
* fix adaptive pool out_shape order
* fix adaptive pool out_shape order, H and W can be either a int
add test case, set support_vulkan = false Pooling_vulkan::create_pipeline
* review adaptive pool
* fix typo
* add adaptive pool forward in pooling_x86.cpp pooling_arm.cpp
fix out_w, out_h id naming convention
* fix typo
* don't support packing, bf16, int8, image for adaptive pool
* Restyled by clang-format
* Restyled by astyle
* Restyled by clang-format
* Restyled by astyle
Co-authored-by: Restyled.io <commits@restyled.io>
5 years ago
nihui
54c0a13b9f
build shared library ( #2525 )
* build shared lib and enable lto
* reserved for layer and option
* allocator pimpl
* datareader pimpl
* paramdict pimpl, disable copy assign for allocator and datareader
* modelbin pimpl
* net extractor pimpl
* gpu pimple
* disable copy assign vulkandevice, code format
* command pimpl, dummy image readonly
* pipeline pipelinecache pimpl, export platform class
* code format, export simple family
* update ci
* disable lto on android armv7, merge webassembly ci
* link libgcc, fix macos dylib version
* pipeline pimpl, gpu info pimpl
* destroy gpu info after vulkan device
* ignore msvc stl class warning
* fix ncnn_paramdict_get_float return type
* fix vktransfer upload fp16 without flatten, add command test
5 years ago
nihuini
fbf0ffda53
pixelshuffle nhwc mode, convert onnx DepthToSpace mode DCR, convert mlir tf.DepthToSpace
5 years ago
nihuini
b35b06be6d
reorg nhwc mode, code format
5 years ago
nihuini
417b6874f8
fix onnx2ncnn printf format error
5 years ago
nihuini
aa695831f1
rewrite most mlir2ncnn node_reference and binary weight logic, convert tf.SpaceToDepth
5 years ago
nihuini
1963672332
rewrite most onnx2ncnn node_reference and binary weight logic
5 years ago
nihui
343bc3b7dc
single blob consumer ( #2493 )
5 years ago
nihui
0f7b3b4461
aborted is not error, use skipped instead
5 years ago
nihuini
cc773ec8e5
adapt mlir api changes
5 years ago
nihuini
5d40a42e2f
shorter blob name
5 years ago
nihuini
38b6387bc5
ncnnoptimize and ncnn2mem now accepts weight-less custom layer
5 years ago
Zhuo Zhang
62cdc14200
fix onnx2ncnn.cpp shadowed variables warning ( #2443 )
5 years ago
Zhuo Zhang
f3ac7d6261
fix mxnet2ncnn.cpp shadowed variable warning ( #2442 )
5 years ago
nihuini
75c1f09b5d
do not count onnx constant node twice, fix #2425
5 years ago