ncnn/benchmark/RankCards

• Rank the boards.

Rank the boards.

The table below is generated by RankCards, using the timings found in the /ncnn/benchmark/README.md file.

First, the best set of timings is selected from each board.

The set is then compared to a reference set by calculating the ratio of each model one by one and averaging all results.

Finally, the boards are ranked from fast to slow.

	Board	Ratio
1	NVIDIA Quadro RTX 8000 (TU102 SM x 72 + Tensor Core x 576)	0.123
2	nVIDIA RTX2080 of Desktop	0.126
3	NVIDIA GeForce RTX 3060 Ti of Desktop[2023-10-12]	0.136
4	nVIDIA RTX2060 of Notebook	0.167
5	Intel® Core™ i7-13700K of Desktop[2023-10-12]	0.199
6	NVIDIA RTX3090 (GA102 SM x 82 + Tensor Core 328)	0.204
7	AMD Radeon RX 6900 XT of Desktop[2023-10-12]	0.211
8	MacBook Pro (13-inch, M1, 2020)	0.26
9	AWS c5.4xlarge Instance (Intel Xeon Platinum 8124M @ 3.399GHz, Ubuntu 20.04.6 LTS x86_64)	0.317
10	AMD Ryzen 9 5950X 16-Core of Desktop[2023-10-12]	0.333
11	NVIDIA Jetson AGX Orin (Cortex-A78AE 2.2 GHz x 12 + Ampere@1.3 GHz Tensor Cores 64)	0.37
12	AMD Ryzen 5700g (Zen3 3.8 GHz ~ 4.6 GHz x 8)	0.37
13	HUAWEI KunPeng 920 3211K (x24 cores)	0.377
14	HUAWEI KunPeng 920 2251K (x8 cores)	0.418
15	nVIDIA RTX A3000 of Notebook (6GB)	0.434
16	Intel(R) UHD Graphics 770 of Desktop[2023-10-12]	0.473
17	OrangePi5, Rockchip RK3588s (Quad Core A76 2.4GHz + Quad Core A55 1.8GHz)	0.492
18	Qualcomm SM8150-AC Snapdragon 855+ (Kyro485 2.96 GHz + 2.42 GHz x 3 + 1.80 GHz x 4 + Adreno 640)	0.498
19	Rockchip RK3588 (Quad Core A76 2.4GHz + Quad Core A55 1.8GHz)	0.583
20	NVIDIA Jetson Orin Nano	0.641
21	Station-M3/ROC-RK3588S-PC, Rockchip RK3588S (Quad Core A76 2.4GHz + Quad Core A55 1.8GHz + Mali-G610) StationOS (Android)	0.696
22	NVIDIA Jetson AGX Xavier (Carmel 2.2 GHz x 8 + Volta Tensor Cores 64)	0.809
23	Loongson 3A6000 (LA664 2.5GHz * 4+4)	0.86
24	Hyper-V Linux Guest with GPU-PV enabled (Intel Core i7-11800H, NVIDIA GeForce RTX 3070 Laptop GPU)	0.898
25	Raspberry Pi 5 Broadcom BCM2712, Cortex-A76 (ARMv8) (2.4GHz x 4)	1
26	Rockchip RK3588 (Cortex-A76 2.4GHz x 4 + Cortex-A55 1.8GHz x 4)	1.01
27	Hyper-V Linux Guest with GPU-PV enabled (Intel Core i7-7700K, NVIDIA GeForce GTX 1050 Ti)	1.24
28	Phytium FT-2000+/64 (FTC662 armv8 2.4GHz x 8)	1.36
29	AMD Ryzen Embedded V1605B (Zen 2.0 GHz ~ 3.6 GHz x 4 + Radeon Vega 8 1.1GHz 8CU)	1.62
30	Avaota Aim T527, Allwinner T527 (Cortex-A55 2.2GHz x 4 + Cortex-A55 1.8GHz x 4)	1.75
31	Loongson 3A5000 (LA464 2.5GHz * 4)	1.79
32	NVIDIA Jetson Nano	1.82
33	Qualcomm MSM8996 Pro Snapdragon 821 (Kyro 2.35GHz x 2 + Kyro 2.19GHz x 2)	1.83
34	AMD Ryzen Threadripper 3970X (Zen2 3.7 GHz ~ 4.5 GHz x 32)	1.83
35	Intel Celeron N5105	2.12
36	MacBook Pro (15-inch, 2019) - 2.6GHz six cores Intel Core i7 && Radeon Pro 555X 4GB && Intel UHD Graphics 630 1536MB	2.49
37	Loongson 3A4000 (GS464V 1.8GHz * 4 with MSA128)	2.54
38	Khadas VIM3, Amlogic A311D (Cortex-A73 2.2GHz x 4 + Cortex-A53 1.8GHz x 2)	2.71
39	Kirin 970 (Cortex-A73 2.4GHz x 4 + Cortex-A53 1.8GHz x 4)	2.74
40	Qualcomm MSM8998 Snapdragon 835 (Kyro 2.45GHz x 4 + Kyro 1.9GHz x 4 + Adreno 540)	2.77
41	Qualcomm MSM6150 Snapdragon 675 (Kyro460 2.0GHz x 2 + Kyro460 1.7GHz x 6 + Adreno 612)	2.81
42	Station P2, Rockchip RK3568 (Cortex-A55 2.0GHz x 4)	2.9
43	Rock3A, Rockchip RK3568 (Cortex-A55 2.0GHz x 4) ubuntu 20.04	2.93
44	Qualcomm MSM8994 Snapdragon 810 (Cortex-A57 2.0GHz x 4 + Cortex-A53 1.55GHz x 4)	2.95
45	Loongson 3A4000 (GS464V 1.8GHz * 4 with MSA128)	3.2
46	Raspberry Pi 4 Model B Broadcom BCM2711B0, Cortex-A72 (ARMv8) (1.8GHz x 4)	3.88
47	Qualcomm SDM660 Snapdragon 660 (Kyro260 2.2GHz x 4 + Kyro260 1.84GHz x 4 + Adreno 512)	3.96
48	Rockchip RK3399 (Cortex-A72 1.8GHz x 2 + Cortex-A53 1.5GHz x 4)	3.99
49	OrangePi4 LTS, Rockchip RK3399 (Cortex-A72 1.8GHz x 2 + Cortex-A53 1.5GHz x 4)	4
50	Phytium FT-2000/4 (FTC663 armv8 2.2GHz x 4)	4.13
51	RDK X3 Module (Cortex-A53 1.5GHz x 4) aarch64	4.6
52	Station-M2/ROC-RK3566-PC, Rockchip RK3566 (Cortex-A55 1.8GHz x 4 + Mali-G52) StationOS (Android)	4.92
53	Rockchip RK3288-CG.W (Cortex-A17 1.8GHz x 4)	5.21
54	Intel Atom x5-Z8350	5.83
55	Qualcomm MSM8916 Snapdragon 410 (Cortex-A53 1.2GHz x 4)	5.93
56	NanoPi R2S, Rockchip RK3328 (Cortex-A53 1.3GHz x 4) Armbian focal (21.05.1) aarch64	5.93
57	EAIDK 310, Rockchip RK3228H (Cortex-A53 1.3GHz x 4) fedora-28 aarch64	6.53
58	Raspberry Pi 3 Model B+ Broadcom BCM2837B0, Cortex-A53 (ARMv8) (1.4GHz x 4)	7.71
59	iPhone 5S (Apple A7 1.3GHz x 2)	8.1
60	Raspberry Pi 5 Broadcom BCM2712, VideoCore VII Graphics (Vulkan 1.2)	10.3
61	Raspberry Pi Zero 2 W Broadcom BCM2710A1, Cortex-A53 (ARMv8) (1.0GHz x 4)	10.7
62	Loongson 3A3000 (GS464E 1.45GHz * 4)	12.6
63	AXERA AX620A (Cortex-A7 1.0GHz * 4)	14.8
64	Loongson 2K1000 (GS264 1.0GHz x 2)	19
65	Loongson 2K1000LA (LA264 1.0GHz * 2)	19
66	Banana Pi M2 Zero 2 AllWinner H2+, Cortex-A7 (ARMv7-A) (1.2GHz x 4)	21.1
67	Freescale i.MX7 Dual (Cortex A7 1.0GHz x 2)	21.6
68	Sunway SW831 (sw_64 2.5GHz * 8)	31.2
69	Intel Celeron M 420 (Yonah 1.60 GHz x 1)	33.4
70	HiSilicon Hi3519V101 (Cortex-A17 1.2GHz x 1)	34
71	Z7-Lite 7020 XC7Z020CLG400-2 (Cortex-A9 766MHz x 2)	35.2
72	Amlogic S805 (Cortex-A5, 4 × 1.536GHz)	46
73	VisionFive2 , JH7110 (SiFive-U74(RV64GC) 1.5GHz x 4) riscv64	52
74	T-Head TH1520 (C910V, 1.848 GHz x 4 + BXM-4-64 PowerVR)	60.5
75	Sunway SW421 (sw_64 1.7GHz * 4)	87.7
76	Ingenic T40XP Xburst2 Core X2 1.4Ghz (without MSA)	132