Rajalakshmi Srinivasaraghavan
09d47af2c0
Optimize zscal function for POWER10
This patch makes use of new POWER10 vector pair instructions for
loads and stores.
4 years ago
Martin Kroeker
ef0238ba2b
Merge pull request #3130 from martin-frbg/issue3128
Replace spurious AVX512 requirement in the Haswell srot microkernel with an AVX2/FMA3 guard
4 years ago
Martin Kroeker
a9f6f7ad39
Remove spurious AVX512 requirement and add AVX2/FMA3 guard
4 years ago
Rajalakshmi Srinivasaraghavan
41646ed006
Optimize s/dasum function for POWER10
This patch makes use of new POWER10 vector pair instructions for
loads and stores.
4 years ago
Rajalakshmi Srinivasaraghavan
0571c3187b
POWER10: Rename mma builtins
The LLVM and GCC teams agreed to rename the __builtin_mma_assemble_pair and
__builtin_mma_disassemble_pair built-ins to __builtin_vsx_assemble_pair and
__builtin_vsx_disassemble_pair respectively. This patch is to make
corresponding changes in dgemm kernel. Also made changes in
inputs to those builtins to avoid some potential typecasting issues.
Reference gcc commit id:77ef995c1fbcab76a2a69b9f4700bcfd005d8e62
4 years ago
Martin Kroeker
292d1af1a0
Update omatcopy_rt.c
5 years ago
Martin Kroeker
325b398e3c
Update omatcopy_rt.c
5 years ago
Martin Kroeker
6f5667b4d4
Enable optimized S/D OMATCOPY_RT
5 years ago
Martin Kroeker
cceeee7806
Add optimized omatcopy_rt
5 years ago
Martin Kroeker
0a4546b742
Typo fix
5 years ago
Martin Kroeker
b1eed27a54
Replace naive omatcopy_rt with 4x4 blocked implementation
as suggested by MigMuc in issue 2532
5 years ago
Martin Kroeker
47691c031f
Use Haswell optimizations for Zen as well
5 years ago
Martin Kroeker
ce7ddd8921
Use Haswell optimizations for Zen as well
5 years ago
Martin Kroeker
950c047b49
Use Haswell optimizations for Zen as well
5 years ago
Martin Kroeker
46509953a9
Use Haswell optimizations for Zen as well
5 years ago
Martin Kroeker
db348dcff2
Enable optimized srot/drot kernels from Haswell
5 years ago
Rajalakshmi Srinivasaraghavan
2056ffc227
Optimize cscal function for POWER10
This patch makes use of new POWER10 vector pair instructions for
loads and stores.
5 years ago
Rajalakshmi Srinivasaraghavan
3ede843d50
Optimize s/dscal function for POWER10
This patch makes use of new POWER10 vector pair instructions for
loads and stores.
5 years ago
Martin Kroeker
69a5558203
Merge pull request #3059 from Guobing-Chen/BF16_gemm
Initial code for Cooperlake BF16 GEMM kernel
5 years ago
Martin Kroeker
d6905403e3
Merge pull request #3068 from alexhenrie/scan-build
scan-build fixes
5 years ago
Rajalakshmi Srinivasaraghavan
439b93f6d2
Optimize s/drot function for POWER10
This patch makes use of new POWER10 vector pair instructions for
loads and stores.
5 years ago
Rajalakshmi Srinivasaraghavan
eff7c9166e
Optimize cdot function for POWER10
This patch makes use of new POWER10 vector pair instructions for
loads and stores.
5 years ago
Alex Henrie
202fc9e8ed
Fix uninitialized argument value in dasum_k
5 years ago
Martin Kroeker
e378b24487
Merge pull request #3067 from albertziegenhagel/fix-generic-cmake
Fix building "generic" TRMM kernel with CMake
5 years ago
Albert Ziegenhagel
e3f4063683
Fix building "generic" TRMM kernel with CMake
The CMake "TARGET_CORE" variables stores the "generic" target name in all lowercase letters, but gets compared to an all uppercase string, which results in the wrong TRMM kernel being selected.
This commit converts the TARGET_CORE to all uppercase before comparing its value to make sure case mismatches are not an issue in the future anymore.
5 years ago
Martin Kroeker
b716c0ef01
Add workaround for NVIDIA HPC
5 years ago
Martin Kroeker
2efa3b70dc
Add workaround for NVIDIA HPC
5 years ago
Martin Kroeker
49959d4f1c
Add workaround for NVIDIA HPC
5 years ago
Martin Kroeker
0f27a03607
Add workaround for NVIDIA HPC mishandling of the asm DOT kernels
5 years ago
Martin Kroeker
c2a8ebfe69
Add workaround for NVIDIA HPC mishandling of the asm DOT kernels
5 years ago
Martin Kroeker
43aac5bacc
Support NVIDIA HPC compiler
5 years ago
Chen, Guobing
b0beb0b1ca
Initial code for Cooperlake BF16 GEMM kernel
5 years ago
Rajalakshmi Srinivasaraghavan
601b711c78
Optimize swap function for POWER10
This patch makes use of new POWER10 vector pair instructions for
loads and stores.
5 years ago
Ashwin Sekhar T K
1b2508362b
arm64: Fix nrm2 for input vectors with Inf
Fix double precision nrm2 kernels returning NaN when the
input vectors contain Inf/-Inf.
5 years ago
Martin Kroeker
3559c5d7a2
Merge pull request #3048 from martin-frbg/issue2998
Temporarily revert to the old NRM2 kernels for ThunderX2/3 and NeoverseN1
5 years ago
Martin Kroeker
8631e2976a
Temporarily revert to the old nrm2 kernels
5 years ago
Martin Kroeker
2768bc1764
Temporarily revert to the old nrm2 kernels
5 years ago
Martin Kroeker
6f4698ee1f
Temporarily revert to the old nrm2 kernel
5 years ago
Martin Kroeker
114eb159a4
Disable FMA intrinsics in the srot kernel when the compiler is PGI/NVIDIA
5 years ago
Martin Kroeker
005cce5507
Amend SkylakeX options to support the NVIDIA compiler
5 years ago
Martin Kroeker
c73d8ee40d
Conditionally add -mfma to compiler options where needed
5 years ago
Rajalakshmi Srinivasaraghavan
2fb11f873b
POWER10: Improve copy performance
This patch aligns the stores to 32 byte boundary for scopy and dcopy
before entering into vector pair loop. For ccopy, changed the store
instructions to stxv to improve performance of unaligned cases.
5 years ago
Martin Kroeker
043128cbe5
Merge pull request #3029 from RajalakshmiSR/axpyp10
POWER10: Improve axpy performance
5 years ago
Martin Kroeker
3331ca492d
Merge pull request #3021 from austinpagan/trsm_p10
POWER: Added special unrolled vectorized versions of "Solve" for specific si…
5 years ago
Rajalakshmi Srinivasaraghavan
346e30a46a
POWER10: Improve axpy performance
This patch aligns the stores to 32 byte boundary for saxpy and daxpy
before entering into vector pair loop. Fox caxpy, changed the store
instructions to stxv to improve performance of unaligned cases.
5 years ago
gxw
4b548857d6
Add msa support for loongson
1. Using core loongson3r3 and loongson3r4 for loongson
2. Add DYNAMIC_ARCH for loongson
Change-Id: I1c6b54dbeca3a0cc31d1222af36a7e9bd6ab54c1
5 years ago
Martin Kroeker
7f11e33e8d
Merge pull request #3025 from TiredNotTear/develop
MIPS: Fix two bugs
5 years ago
Martin Kroeker
53e0837809
Merge pull request #3022 from jinboson/develop
Fix test errors reported by cblas_cgemm & cblas_ctrmm
5 years ago
Hao Chen
ad38bd0e89
Fix failed cgemv and zgemv test case after using msa optimization
The cgemv and zgemv test case will call cgemv_n/t_msa.c zgemv_n/t_msa.c files in MIPS environment.
When the macro CONJ is defined, the calculation result will be wrong due to the wrong definition of OP2.
This patch updates the value of OP2 and passes the corresponding test.
5 years ago
Hao Chen
47b639cc9b
Fix failed sswap and dswap case by using msa optimization
The swap test case will call sswap_msa.c and dswap_msa.c files in MIPS environmnet.
When inc_x or inc_y is equal to zero, the calculation result of the two functions will be wrong.
This patch adds the processing of inc_x or inc_y equal to zero, and the swap test case has passed.
5 years ago