|
|
|
@@ -2,6 +2,13 @@ |
|
|
|
|
|
|
|
 |
|
|
|
|
|
|
|
[](https://discord.gg/M2fS4PNj) |
|
|
|
[](https://www.nuget.org/packages/LLamaSharp) |
|
|
|
[](https://www.nuget.org/packages/LLamaSharp.Backend.Cpu) |
|
|
|
[](https://www.nuget.org/packages/LLamaSharp.Backend.Cuda11) |
|
|
|
[](https://www.nuget.org/packages/LLamaSharp.Backend.Cuda12) |
|
|
|
|
|
|
|
|
|
|
|
The C#/.NET binding of [llama.cpp](https://github.com/ggerganov/llama.cpp). It provides APIs to inference the LLaMa Models and deploy it on native environment or Web. It works on |
|
|
|
both Windows and Linux and does NOT require compiling llama.cpp yourself. |
|
|
|
|
|
|
|
|