scisharp
/
LLamaSharp
Not watched
1
0
Fork 0
Code
Releases 17 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
1101 Commits
8 Branches
333 MB
146 Download
 
 
 
 
 
 
Tree: b2f7dbb39b
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'b2f7dbb39b'
${ noResults }
LLamaSharp/LLama
eublefar b2f7dbb39b AddPromptAsync method for stateful executors, Chat session initialize from history and process system message methods for pre-processing prompts. Serializing executor state to JSON, to avoid saved states from being updated by reference. 1 year ago
..
Abstractions Assorted small changes to clean up some code warnings 1 year ago
Batched Assorted small changes to clean up some code warnings 1 year ago
Common Updated everything to work with llama.cpp ce32060198b7e2d6a13a9b8e1e1369e3c295ae2a 2 years ago
Exceptions Swapped `StatelessExecutor` to use `llama_decode`! 2 years ago
Extensions Updated everything to work with llama.cpp ce32060198b7e2d6a13a9b8e1e1369e3c295ae2a 2 years ago
Grammars Code cleanup driven by R# suggestions: 2 years ago
Native Removed `llama_eval`. It is going to be completely removed in the next version of llama.cpp (#553) 1 year ago
Sampling `ReadOnlySpan<float>` in ISamplingPipeline (#538) 1 year ago
runtimes Merge pull request #479 from martindevans/update_binaries_feb_2024 2 years ago
AntipromptProcessor.cs Make AntipromptProcessor public 2 years ago
AssemblyAttributes.cs - Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system. 2 years ago
ChatSession.cs AddPromptAsync method for stateful executors, Chat session initialize from history and process system message methods for pre-processing prompts. Serializing executor state to JSON, to avoid saved states from being updated by reference. 1 year ago
GlobalSuppressions.cs - Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system. 2 years ago
LLamaContext.cs AddPromptAsync method for stateful executors, Chat session initialize from history and process system message methods for pre-processing prompts. Serializing executor state to JSON, to avoid saved states from being updated by reference. 1 year ago
LLamaEmbedder.cs Normalizing embeddings in `LLamaEmbedder`. As is done in llama.cpp: https://github.com/ggerganov/llama.cpp/blob/2891c8aa9af17f4ff636ff3868bc34ff72b56e25/examples/embedding/embedding.cpp#L92 1 year ago
LLamaExecutorBase.cs AddPromptAsync method for stateful executors, Chat session initialize from history and process system message methods for pre-processing prompts. Serializing executor state to JSON, to avoid saved states from being updated by reference. 1 year ago
LLamaInstructExecutor.cs Chat session Get/Load in-memory state operations, reset state ops for stateful executors and context 1 year ago
LLamaInteractExecutor.cs Chat session Get/Load in-memory state operations, reset state ops for stateful executors and context 1 year ago
LLamaQuantizer.cs Added new file types to quantisation 2 years ago
LLamaSharp.Runtime.targets Use llama instead of libllama in `[DllImport]` 2 years ago
LLamaSharp.csproj 0.10.0 1 year ago
LLamaStatelessExecutor.cs Removed `llama_eval`. It is going to be completely removed in the next version of llama.cpp (#553) 1 year ago
LLamaTransforms.cs - Improved coverage of `GBNFGrammarParser` up to 96% 2 years ago
LLamaWeights.cs Improved the BatchedDecoding demo: 2 years ago
StreamingTokenDecoder.cs Assorted small changes to clean up some code warnings 1 year ago
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

C#/.NET上易用的LLM高性能推理框架，支持LLaMA和LLaVA系列模型。

C# Text Metal JavaScript HTML+Razor other