You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Martin Evans ec49bdd6eb - Most importantly: Fixed issue in `SamplingApi`, `Memory` was pinned, but never unpinned! 2 years ago
..
GgmlInitParams.cs feat: support loading and saving state. 2 years ago
LLamaContextParams.cs feat: update quantize native params. 2 years ago
LLamaFtype.cs feat: update quantize native params. 2 years ago
LLamaModelQuantizeParams.cs Various minor XML docs fixes 2 years ago
LLamaTokenData.cs refactor: LLamaModel and LLamaExecutor. 2 years ago
LLamaTokenDataArray.cs - Most importantly: Fixed issue in `SamplingApi`, `Memory` was pinned, but never unpinned! 2 years ago
NativeApi.Quantize.cs Various minor XML docs fixes 2 years ago
NativeApi.Sampling.cs - Most importantly: Fixed issue in `SamplingApi`, `Memory` was pinned, but never unpinned! 2 years ago
NativeApi.cs Merge pull request #56 from martindevans/memory_mapped_save_loading_and_saving 2 years ago
NativeInfo.cs feat: add the framework and basic usages. 2 years ago
SafeLLamaContextHandle.cs feat: add get-embedding api to LLamaModel. 2 years ago
SafeLLamaHandleBase.cs feat: add get-embedding api to LLamaModel. 2 years ago
SamplingApi.cs - Most importantly: Fixed issue in `SamplingApi`, `Memory` was pinned, but never unpinned! 2 years ago

C#/.NET上易用的LLM高性能推理框架,支持LLaMA和LLaVA系列模型。

C# Text Metal JavaScript HTML+Razor other