LLamaSharp

333 MB

Tree: d9b4e1fde7

Author	SHA1	Message	Date
Martin Evans	f860f88c36	Code cleanup driven by R# suggestions: - Made `NativeApi` into a `static class` (it's not intended to be instantiated) - Moved `LLamaTokenType` enum out into a separate file - Made `LLamaSeqId` and `LLamaPos` into `record struct`, convenient to have equality etc	2 years ago
Martin Evans	b34f72a883	- Added `SamplingPipeline` to inference params which overrides all other options with an entirely custom pipeline. - Added a `Sample` method to `LLamaContext` which uses a custom pipeline - Modified all executors to use the custom pipeline if it exists	2 years ago
Martin Evans	d743516070	- Added support for the MinP sampler - Cleaned up comments in implementations of `IInferenceParams` - Removed default values for all parameters in `LLamaContext.Sample` - they're never used and probably _shouldn't_ ever be used	2 years ago
Martin Evans	c786fb0ec8	Using `IReadOnlyList` instead of `IEnumerable` in `IInferenceParams`	2 years ago
redthing1	296ba607de	make InferenceParams a record so we can use with	2 years ago
Martin Evans	d79a6556a1	Removed 3 unused properties of `InferenceParams`	2 years ago
Martin Evans	64416ca23c	- Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`) - Integrated grammar into sampling - Added a test for the grammar sampling	2 years ago
sa_ddam213	bac9cba01a	InferenceParams abstractions	2 years ago
Martin Evans	36735f7908	Fixed spelling of "mirostat" instead of "mirostate"	2 years ago
Yaohui Liu	1062fe1a7e	feat: upgrade the native libraries.	2 years ago
Yaohui Liu	3bf74ec9b9	feat: add chat session for refactored code.	3 years ago

11 Commits (d9b4e1fde72b7cdcddc048b80cbfb4be19a96c2a)