You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Martin Evans 91bcefc852 comment on IModelParamsExtensions 2 years ago
..
Abstractions Replaced `nint` with `float[]?` in Model params, which is much more user friendly! 2 years ago
Common Merge pull request #81 from martindevans/tensor_splits_array 2 years ago
Exceptions Various minor XML docs fixes 2 years ago
Extensions comment on IModelParamsExtensions 2 years ago
Native Moved `Eval` out of `Utils` and into `SafeLLamaContextHandle` 2 years ago
OldVersion Merge pull request #68 from martindevans/sampling_improvements 2 years ago
runtimes fix: update the dlls. 2 years ago
ChatSession.cs InferenceParams abstractions 2 years ago
LLamaEmbedder.cs - Moved tokenization from `Utils.Tokenize` into `SafeLLamaContextHandle.Tokenize`, one less thing in `Utils`. 2 years ago
LLamaExecutorBase.cs InferenceParams abstractions 2 years ago
LLamaInstructExecutor.cs Moved `TokenToString` from Utils into `SafeLLamaContextHandle` (thin wrappers around the same method in `SafeLlamaModelHandle`) 2 years ago
LLamaInteractExecutor.cs Moved `TokenToString` from Utils into `SafeLLamaContextHandle` (thin wrappers around the same method in `SafeLlamaModelHandle`) 2 years ago
LLamaModel.cs Moved `Eval` out of `Utils` and into `SafeLLamaContextHandle` 2 years ago
LLamaQuantizer.cs Various minor XML docs fixes 2 years ago
LLamaSharp.Runtime.targets fix: update the dlls. 2 years ago
LLamaSharp.csproj fix breaking change in llama.cpp; bind to latest version llama.cpp to support new quantization method 2 years ago
LLamaStatelessExecutor.cs Applied fix from #84 (antiprompt does not work in stateless executor) 2 years ago
LLamaTransforms.cs Merge branch 'master' into more_multi_enumeration_fixes 2 years ago
ResettableLLamaModel.cs ModelParams abstraction 2 years ago
Utils.cs Fixed `ToLlamaContextParams` using the wrong parameter for `use_mmap` 2 years ago

C#/.NET上易用的LLM高性能推理框架,支持LLaMA和LLaVA系列模型。

C# Text Metal JavaScript HTML+Razor other