佰阅
391152f500
c_api surpport set_vulkan_device ( #5610 )
1 year ago
quink
92e0b8253b
arm/convolution_3x3_pack1to8_fp16s: prefer ldr/str over ld1/st1 ( #5603 )
Depending on the arch, ldr/str can be faster than ld1/st1, especially
for loading to one lane form. For example, on Cortex A75,
1. execution latency of 'ldr q0' and 'ldr h0' are 5
2. execution latency of 'ld1 {v0.16b}' is 6
3. execution latency of 'ld1 {v0.h}[0]' is 8
On Cortex X3,
1. execution latency of 'ldr q0' and 'ldr h0' are 6
2. execution latency of 'ld1 {v0.16b}' is 6
3. execution latency of 'ld1 {v0.h}[0]' is 8
Signed-off-by: Zhao Zhili <zhilizhao@tencent.com>
1 year ago
nihui
997c8926d7
use ruapu detection only on windows arm, enable cpu powerinfo with mingw compiler ( #5593 )
2 years ago
zhangyang2057
081a9c39c8
Fix tanh typo for rvv. ( #5584 )
* Fix tanh typo for rvv.
* Fix tanh for rvv fp16.
2 years ago
nihui
3752d71200
fix potential fp16s bf16s conflicts on arm vfpv4 ( #5578 )
* fix potential fp16s bf16s conflicts on armv7 vfpv4
* but prefer fp16 on armv8.2
2 years ago
quink
a05c113f80
Add wasi support ( #5534 )
* benchmark: Don't use std::thread when NCNN_THREADS is OFF
* Add wasi support
cmake -B build -DCMAKE_BUILD_TYPE=Release \
--toolchain ${wasi_sdk}/share/cmake/wasi-sdk.cmake \
-DNCNN_RUNTIME_CPU=OFF \
-DNCNN_DISABLE_EXCEPTION=ON \
-DNCNN_THREADS=OFF
cmake --build build
After build, you can run benchncnn on cmdline with wasmtime:
wasmtime --dir . benchncnn
2 years ago
nihui
4c3debae2d
multiheadattention scale param ( #5526 )
* update swiftshader
* skip vs2017 swiftshader
2 years ago
Xyzhao
fbd6690d6c
fix: add NCNN_PLATFORM_API macro for VkAndroidHardwareBufferImageAllocator ( #5521 )
2 years ago
nihui
8235cad999
mha allow qdim differs from embed_dim ( #5519 )
* test mha oom
2 years ago
nihui
39c27de47b
test concat oom ( #5502 )
2 years ago
nihui
093c516898
test slice oom ( #5501 )
2 years ago
Wei Wu
bb54d575a0
Update ruapu.h to the latest version. ( #5499 )
The updated ruapu adds support for multiple architectures such as RISC-V, MIPS, and Loongson, and can detect more Arm features.
The latest version is 10b02b3755 .
2 years ago
nihui
da7d1a10f7
test x86 arm convolution oom ( #5492 )
* skip mips loongarch riscv oom test atm
* test softmax oom
2 years ago
nihui
102e98970f
fix unexpected abs error on powerpc vsx ( #5498 )
2 years ago
nihui
19ea54f266
more x86 vnni optimization for lstm ( #5496 )
* workaround vs2019 crash
2 years ago
nihui
debc33fee2
arm handle allocation failures ( #5490 )
2 years ago
nihui
b4379630fb
x86 handle allocation failures ( #5489 )
2 years ago
TianZer
b0de947b32
fix mingw64 avx crash and termux build issue ( #5464 )
* Remove two potential warnings for VisualStudio
* fix mingw64 avx crash
* fix build issue in termux
2 years ago
Asd-g
bbf2e5d533
create_gpu_instance: do not perform destroy_gpu_instance() ( #5437 )
When performing destroy_gpu_instance(), g_instance.created is always 0.
2 years ago
nihui
c4a007406d
windows clang ci ( #5469 )
* windows clang ci
* clang msvc use x86intrin.h for xop
* test arm64 compiler features
2 years ago
nihui
08b7d99a75
rnn/lstm/gru dynamic quantization ( #5435 )
2 years ago
Tabbleman
b8fefb977d
clear warning: unused variable while building on x86-wsl platform ( #5444 )
2 years ago
quink
e31be492d5
c_api: Fix function prototypes with no argument ( #5436 )
Here is a big difference between C and C++. foo() in C means that
the funtion takes an unspecified number of arguments, while
foo(void) means the function takes no argument.
Fix -Wstrict-prototypes warning.
Signed-off-by: Zhao Zhili <zhilizhao@tencent.com>
2 years ago
nihui
6cdd7110be
fix instruction extension dispatch ( #5427 )
2 years ago
nihui
9ce7930413
x86 optimization for convolution tiled gemm ( #5426 )
2 years ago
nihui
0fd25d6c70
fix arm riscv build with NCNN_BF16=OFF ( #5422 )
2 years ago
nihui
db035d602d
update ncnnoptimize layers, lightmode=false keeps original weight ( #5414 )
2 years ago
nihui
056509a034
fix create_pipeline crash in vulkan-enabled layer without calling load_param/load_model first ( #5410 )
2 years ago
張小凡
3b048d1923
destroy_gpu_instance() function wait for all devices to be idle before destroy ( #4763 )
* destroy_gpu_instance() will internally ensure that all vulkan devices are idle before proceeding with destruction.
2 years ago
nihui
69640594f7
unified macos ios ci, drop 32bit support, drop ios arm64e, default to ios 13 ( #5403 )
2 years ago
nihui
5a8f79f7c7
add apple A17 and M3 family macro ( #5405 )
2 years ago
nihui
2a07aa2d79
unified mac-catalyst ci ( #5402 )
* fix moltenvk static linking
2 years ago
nihui
fafb897ff7
update ios toolchain, add visionos ci, update watchos, ncnn target ilp32 ( #5399 )
2 years ago
nihui
824b79a314
fix rvv extract blob with fp16 enabled, fix #5360 ( #5398 )
2 years ago
nihui
7cc89108b3
try more known vulkan library with simplevk ( #5396 )
2 years ago
nihui
2f65729873
fix riscv v build with old cpp standard, fix #5366 ( #5391 )
2 years ago
nihui
167501f0c6
fix softmax arm fp16s sum error, fix #5340 ( #5393 )
2 years ago
nihui
6595743bb2
shift before adding for dropping additional double bit from vqdmulhq_s16, fix #5263 ( #5390 )
2 years ago
nihui
84256b1494
pnnx enhance functionize ( #5387 )
* pnnx fix some undefined dtype
* fix ncnn convdw1d dynamic weight loading
2 years ago
Shatyuka
5a11c383a2
Support LLVM OpenMP runtime for MSVC ( #5370 )
with `/openmp:llvm` compile option
2 years ago
hokamilkv
74fda386f3
Update convolution_im2col_gemm_int8.h ( #5365 )
remove _sum0=_sum0
2 years ago
Shatyuka
e7748e5311
Fix `destroy_gpu_instance` crash ( #5353 )
* Fix `destroy_gpu_instance` crash
* Additional check and clear
2 years ago
Shatyuka
ddd17dd907
Fix build error with NCNN_PIXEL_DRAWING off ( #5346 )
2 years ago
nihui
4797d19873
ruapu cpu isa detection ( #5341 )
2 years ago
nihui
984d6dd844
promote vfpv4 for auto fp16 storage conversion ( #5325 )
* promote vfpv4 for auto fp16 storage conversion
* always report neon and vfpv4 for arm64
2 years ago
nihui
5b536af234
fix uwp build ( #5328 )
2 years ago
nihui
d38bdbdb84
fix debug build on some compiler, fix #5295 ( #5326 )
2 years ago
nihui
87d7165848
disable signal based detectisa if being debugged ( #5280 )
2 years ago
Justin Fung
f6763262d1
Add draw rectangle, draw text, draw circle, and draw line to C API ( #5324 )
2 years ago
Xinyu Yang
7ac42680cf
RVV: Refine riscv gemm fp32 ( #5303 )
* replace storexxx to vsseg2e32_v_f32m1
* refine transpose
---------
Co-authored-by: Xinyu302 <Xinyu302@users.noreply.github.com>
2 years ago