Martin Evans
|
2056078aef
|
Initial changes required for GGUF support
|
2 years ago |
Martin Evans
|
a911b77dec
|
Various minor changes, resolving about 100 ReSharper code quality warnings
|
2 years ago |
Martin Evans
|
93f24f8a51
|
Switched to properly typed `Encoding` property
|
2 years ago |
Martin Evans
|
2830e5755c
|
- Applied a lot of minor R# code quality suggestions. Lots of unnecessary imports removed.
- Deleted `NativeInfo` (internal class, not used anywhere)
|
2 years ago |
Martin Evans
|
759ae26f36
|
Merge branch 'master' into grammar_basics
|
2 years ago |
Martin Evans
|
a9e6f21ab8
|
- Creating and destroying contexts in the stateless executor, saving memory. It now uses zero memory when not inferring!
- Passing encoding in the `IModelParams`, which reduces how often encoding needs to be passed around
|
2 years ago |
Martin Evans
|
64416ca23c
|
- Created a slightly nicer way to create grammar (from `IReadOnlyList<IReadOnlyList<LLamaGrammarElement>>`)
- Integrated grammar into sampling
- Added a test for the grammar sampling
|
2 years ago |
Martin Evans
|
f3511e390f
|
WIP demonstrating changes to support multi-context. You can see this in use in `TalkToYourself`, along with notes on what still needs improving.
The biggest single change is renaming `LLamaModel` to `LLamaContext`
|
2 years ago |
Martin Evans
|
685eb3b9c2
|
Replaced `nint` with `float[]?` in Model params, which is much more user friendly!
|
2 years ago |
sa_ddam213
|
bac9cba01a
|
InferenceParams abstractions
|
2 years ago |
sa_ddam213
|
2a04e31b7d
|
ModelParams abstraction
|
2 years ago |
Martin Evans
|
2e76b79af6
|
Various minor XML docs fixes
|
2 years ago |
Marcel
|
65925eac4f
|
Added documentation for the interfaces
|
3 years ago |
Marcel
|
b911b2548b
|
move interfaces into abstractions folder
|
3 years ago |
Yaohui Liu
|
3bf74ec9b9
|
feat: add chat session for refactored code.
|
3 years ago |
Yaohui Liu
|
908b79e855
|
feat: add stateless executor.
|
3 years ago |
Yaohui Liu
|
e603a09137
|
fix: state loading and saving not working.
|
3 years ago |
Yaohui Liu
|
5679e08718
|
feat: add ILLamaExecutor.InferAsync.
|
3 years ago |
Yaohui Liu
|
264fb9a706
|
refactor: LLamaModel and LLamaExecutor.
|
3 years ago |