LLamaSharp

333 MB

Tree: ea12ff4e07

Author	SHA1	Message	Date
Martin Evans	2eb52b1630	made casts to/from int explicit, fixed places affected	2 years ago
Martin Evans	42be9b136d	Switched form using raw integers, to a `LLamaToken` struct	2 years ago
Martin Evans	835958398c	- Removed the object wrappers and configurable pipeline, they can be better written in code. - Added BaseSamplingPipeline which provides a base impl of `ISamplingPipeline` - Added `DefaultSamplingPipeline` which mimics normal llama.cpp sampling	2 years ago
Martin Evans	3afc007499	- Added "protected" logits, instead of the awkward save/load mechanism - Added an example usage to one of the tests	2 years ago
Martin Evans	b34f72a883	- Added `SamplingPipeline` to inference params which overrides all other options with an entirely custom pipeline. - Added a `Sample` method to `LLamaContext` which uses a custom pipeline - Modified all executors to use the custom pipeline if it exists	2 years ago
Martin Evans	33358124db	Initial pass at a new sampling pipeline	2 years ago