scisharp
/
LLamaSharp
Not watched
1
0
Fork 0
Code
Releases 17 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
939 Commits
8 Branches
333 MB
147 Download
 
 
 
 
 
 
Tree: 1e69e265b6
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '1e69e265b6'
${ noResults }
LLamaSharp/LLama
Martin Evans 1e69e265b6 Moved some native methods to do with creating/destroying resources into their respective handles. There is **no** safe way to call most of these methods, everything must be done through through handles. 2 years ago
..
Abstractions Code cleanup driven by R# suggestions: 2 years ago
Common Code cleanup driven by R# suggestions: 2 years ago
Exceptions Assorted cleanup leftover after the huge change in the last PR (comments, syntax style, etc) 2 years ago
Extensions Added runtime checks that UseMemoryLock and UseMemorymap are actually supported. 2 years ago
Grammars Code cleanup driven by R# suggestions: 2 years ago
Native Moved some native methods to do with creating/destroying resources into their respective handles. There is **no** safe way to call most of these methods, everything must be done through through handles. 2 years ago
Sampling - Removed the object wrappers and configurable pipeline, they can be better written in code. 2 years ago
runtimes Updated binaries: 2 years ago
AntipromptProcessor.cs Make AntipromptProcessor public 2 years ago
AssemblyAttributes.cs - Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system. 2 years ago
ChatSession.cs Rebuild ChatSession class 2 years ago
GlobalSuppressions.cs - Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system. 2 years ago
LLamaContext.cs Code cleanup driven by R# suggestions: 2 years ago
LLamaEmbedder.cs - Removed some `unsafe` where it wasn't necessary 2 years ago
LLamaExecutorBase.cs Fixed LLamaExecutorBase.cs 2 years ago
LLamaInstructExecutor.cs - Added `SamplingPipeline` to inference params which overrides all other options with an entirely custom pipeline. 2 years ago
LLamaInteractExecutor.cs - Added `SamplingPipeline` to inference params which overrides all other options with an entirely custom pipeline. 2 years ago
LLamaQuantizer.cs - Removed some `unsafe` where it wasn't necessary 2 years ago
LLamaSharp.Runtime.targets Added `native/` back into path prefix 2 years ago
LLamaSharp.csproj Prevent compilation errors due to duplicated assembly info 2 years ago
LLamaStatelessExecutor.cs Resetting the custom sampling pipeline in the stateless executor 2 years ago
LLamaTransforms.cs - Improved coverage of `GBNFGrammarParser` up to 96% 2 years ago
LLamaWeights.cs Code cleanup driven by R# suggestions: 2 years ago
StreamingTokenDecoder.cs feat: optimize apis for cuda feature detection. 2 years ago
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

C#/.NET上易用的LLM高性能推理框架，支持LLaMA和LLaVA系列模型。

C# Text Metal JavaScript HTML+Razor other