LLamaSharp

333 MB

Tree: 71f4e2ae4a

Author	SHA1	Message	Date
Martin Evans	2056078aef	Initial changes required for GGUF support	2 years ago
Martin Evans	93f24f8a51	Switched to properly typed `Encoding` property	2 years ago
Martin Evans	759ae26f36	Merge branch 'master' into grammar_basics	2 years ago
Martin Evans	a9e6f21ab8	- Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring! - Passing encoding in the `IModelParams`, which reduces how often encoding needs to be passed around	2 years ago
Martin Evans	64416ca23c	- Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`) - Integrated grammar into sampling - Added a test for the grammar sampling	2 years ago
Martin Evans	2c933c57a1	Fixed ModelOptions in Web project	2 years ago
sa_ddam213	bac9cba01a	InferenceParams abstractions	2 years ago
sa_ddam213	2a04e31b7d	ModelParams abstraction	2 years ago
sa_ddam213	3fec7a63c7	Add Instruct and Stateless support	2 years ago
sa_ddam213	d9fbd56f10	Strongly type connection status	2 years ago