nihui
39c055d7f2
crop axes starts ends expression ( #5976 )
* skip dynamic tensor index
* handle clone oom
1 year ago
nihui
eed257df1f
ci update llvmpipe ( #5954 )
* check image fp16
1 year ago
nihui
07267f2618
softmax 4d test and vulkan, softmax unified elempack optimization for x86 arm riscv ( #5931 )
1 year ago
nihui
6396a732ef
reshape shape expression, drop reshape permute, test reshape oom ( #5918 )
1 year ago
Yexuan Wu
3571d7e8ec
Support better API to detect big little core in windows after win7 ( #5927 )
1 year ago
erquren
c9e0c877f9
add missing license header ( #5925 )
1 year ago
nihui
1e3fcb9dda
paramdict value string type, natural array representation ( #5915 )
1 year ago
nihui
23890900c2
x86 optimization for convolution int8 gemm ( #5874 )
* cmake check compiler test cannot be optimized out
* drop requant pack4
1 year ago
nihui
4a70be45ed
fix requantize pack4to8 ( #5893 )
1 year ago
nihui
ff5b554003
restrict one dim quantize scale size, test quantize oom ( #5892 )
* restrict one dim quantize scale size
* sse2 requantize pack8
1 year ago
nihui
956bccd295
restrict one dim requantize scale bias size ( #5888 )
1 year ago
nihui
48e1260a6f
restrict one dim dequantize scale bias size ( #5886 )
1 year ago
nihui
21a71d3673
slim x86 dequantize ( #5879 )
* remove dequantize pack8 test, seems to be useless
1 year ago
nihui
a13958ef47
optimize ncnn test building time ( #5867 )
1 year ago
nihui
39cf4f6018
slim reduction ( #5866 )
1 year ago
nihui
44e0d95c0d
x86 sse2/xop/avx/avx2/avx512/vnni/vnniint8 optimization for gemm int8 ( #5763 )
* skip round problem
* sde on ubuntu24
1 year ago
nihui
a9553fcc15
skip unaryop round halfway cases for powerpc ( #5814 )
1 year ago
nihui
19caca3140
port rvv intrinsic 1.0+ ( #5642 )
* zfh zvfh xtheadvector infra
* dispatch for rvv and xtheadvector
* dispatch for non-vector zfh
* port xtheadvector recp rsqrt trunc
* general rvv gemm
* c906 and c910 ci
* old tuple code clean
* update riscv64 ci
* update build doc
* drop old th1520 toolchain
1 year ago
nihui
0734b657d9
spectrogram and inverse spectrogram ( #5779 )
* only supports hann, hamming and all-one window
* inverse spectrogram does not support length parameter
* spectrogram always returns torch.view_as_real(out) as ncnn does not support complex typed mat yet
* inverse spectrogram always accepts torch.view_as_complex(in) as ncnn does not support complex typed mat yet
1 year ago
nihui
e7602a206b
fix gemm arm int8 scales descales offset ( #5750 )
1 year ago
nihui
8fe62812c9
arm neon optimization for layernorm fp32/bf16s/fp16s ( #5746 )
1 year ago
nihui
66b54cbea2
multiheadattention int8 quantization ( #5733 )
* x86 vulkan fallback
* comment about bf16s
1 year ago
nihui
1c7af00499
gemm int8 quantization ( #5706 )
* quantize gemm
* write gemm quantize scales
* update doc
* less openmp args
* x86 riscv fallback
* skip gemm vulkan int8
* fix noint8 test, fix arm bf16 test
* enable vfpv4 on neon build only
* fix gemm vulkan without C
* fp16 pack8 output
* enable elempack=8 only for asimdhp+
* tiled gemm int8 test
* opt arm64 tiles, fix asimdhp dispatch
1 year ago
nihui
5df5413c81
embed int8 quantization and add embed test ( #5667 )
1 year ago
nihui
fdf0df3079
RMSNorm ( #5630 )
1 year ago
nihui
3752d71200
fix potential fp16s bf16s conflicts on arm vfpv4 ( #5578 )
* fix potential fp16s bf16s conflicts on armv7 vfpv4
* but prefer fp16 on armv8.2
2 years ago
nihui
4c3debae2d
multiheadattention scale param ( #5526 )
* update swiftshader
* skip vs2017 swiftshader
2 years ago
nihui
8235cad999
mha allow qdim differs from embed_dim ( #5519 )
* test mha oom
2 years ago
nihui
39c27de47b
test concat oom ( #5502 )
2 years ago
nihui
093c516898
test slice oom ( #5501 )
2 years ago
nihui
da7d1a10f7
test x86 arm convolution oom ( #5492 )
* skip mips loongarch riscv oom test atm
* test softmax oom
2 years ago
nihui
08b7d99a75
rnn/lstm/gru dynamic quantization ( #5435 )
2 years ago
nihui
9ce7930413
x86 optimization for convolution tiled gemm ( #5426 )
2 years ago
nihui
e3758fdd19
fix test reduction warning ( #5397 )
2 years ago
nihui
984d6dd844
promote vfpv4 for auto fp16 storage conversion ( #5325 )
* promote vfpv4 for auto fp16 storage conversion
* always report neon and vfpv4 for arm64
2 years ago
nihui
5329d32e74
check vulkan fp16 uniform support and implement lfp conversion without fp16u ( #5287 )
2 years ago
nihui
556b79ce4d
create layer decoupled ( #5258 )
* create layer decoupled
* no more virtual public
* allow build test with shared library
* decouple cpu vulkan
* drop old scripts
2 years ago
nihui
ded0b78bb2
fix nvidia vulkan crash on exit ( #5234 )
2 years ago
nihui
eea3fc9b41
optimize vulkan global pooling ( #5191 )
Co-authored-by: nihui <nihui@users.noreply.github.com>
Co-authored-by: michaelcai <michaelcai@tencent.com>
2 years ago
nihui
4136de3b8d
arm optimization for convolution int8 packed unified elempack ( #5147 )
2 years ago
nihui
4494aadd74
deconvolution dynamic weight ( #5119 )
2 years ago
nihui
14e14a9ae8
slice with indices ( #5103 )
2 years ago
邓实诚
a1e3ebf8e5
implement simplemath ( #4905 )
* complete abs, fmod and sin function in simplemath.h
* remove some unused variables in simplemath.cpp
* modify test-coverage.yml and add some functions to simplemath.cpp
* modify erf.cpp which included math.h
* include platform.h for NCNN_SIMPLEMATH definition
* move utility constants and functions in simplemath.h to simplemath.cpp
* guard simplemath functions with extern "C"
* add NCNN_EXPORT macro in simplemath.h
* include plateform.h and guard all declarations with NCNN_SIMPLEMATH
* clean unused code in test_unaryop.cpp
* guard #include <vector> with NCNN_SIMPLEMATH in benchncnn.cpp
* add 'static' to guard functions that not declarated in header file
* modify sin and cos with better implementation
---------
Co-authored-by: HonestDeng <HonestDeng@users.noreply.github.com>
2 years ago
Yoh
3f437d3f3d
Grid sample op ( #4373 )
* pnnx support grid_sample op
* complete the permute and gridsample operator fusion
* spilt calculation into two stages and support permute fusion
2 years ago
nihui
7b02425246
x86 optimization for convolution int8 winograd unified elempack ( #5054 )
2 years ago
FhqTreap
1d7720efe8
fix test conv1d ( #5049 )
2 years ago
nihui
78aca88d67
elu 4d and selu 4d ( #5047 )
2 years ago
Beq Jal
019176c6b2
selu and shufflechannel on x86 ( #5017 )
2 years ago
Amir Ramezani
7e5fa3ade3
shrink operator ( #5022 )
2 years ago
nihui
c8662cce5e
arm optimization for convolution int8 gemm unified elempack ( #5016 )
2 years ago