Rinne
bfe9cc8961
Merge pull request #78 from SciSharp/rinne-dev
feat: update the llama backends.
2 years ago
Yaohui Liu
1b15d28fc9
ci: remove MACOS ci pipelines.
2 years ago
Martin Evans
5e15077766
Merge pull request #80 from saddam213/ExposeNative
Expose some native classes
2 years ago
Yaohui Liu
bb46a990d0
fix: add bug info for native api.
2 years ago
Yaohui Liu
e64c05126b
ci: update ci content.
2 years ago
Yaohui Liu
f16db72841
ci: add debug info.
2 years ago
Yaohui Liu
a59160a5cb
ci: update ci content.
2 years ago
Yaohui Liu
5fe13bd9f7
fix: update the dlls.
2 years ago
sa_ddam213
372894e1d4
Expose some native classes
2 years ago
Martin Evans
d2e9f9d96d
Added `ldd -r libllama.so` to try and discover is dependencies are missing
2 years ago
Yaohui Liu
d3775c527e
ci: add info to debug the ci error.
2 years ago
Yaohui Liu
6b2a06902e
fix: the ci error.
2 years ago
Yaohui Liu
546ba28a68
fix: ci error caused by branch merge.
2 years ago
Yaohui Liu
fc17e91d1a
feat: add backend for MACOS.
2 years ago
Yaohui Liu
9fcbd16b74
Merge branch 'master' of github.com:SciSharp/LLamaSharp into rinne-dev
2 years ago
Yaohui Liu
2968125daf
feat: update the llama backends.
2 years ago
Martin Evans
fa75e9d964
Merge pull request #77 from SignalRT/master
Update llama.cpp binaries to 5f631c2 and align the LlamaContext
2 years ago
Martin Evans
fe3bd11dfa
Merge branch 'master' into master
2 years ago
Martin Evans
b2ef8e6a26
Merge pull request #74 from martindevans/github_actions
GitHub actions
2 years ago
Martin Evans
d6fc83e981
- Added a folder with a 7B Llama2 model, automatically downloaded from huggingface. This can be used for unit tests.
- Caching that folder, so CI only has to download it once.
2 years ago
Martin Evans
c46751ae66
Fixed yaml syntax
2 years ago
Martin Evans
1545b821d7
Cleaned up installing multiple dotnets
2 years ago
Martin Evans
71b1ccd2f7
Always installing both 6 and 7
2 years ago
Martin Evans
618e02fb9c
- moved dotnet version into matrix
- using 6.0.x instead of 7.0.x
2 years ago
Martin Evans
7ef07104e7
Added queue fix, so that CI can pass
2 years ago
Martin Evans
e7e3df6c6b
fixed capitalisation
2 years ago
Martin Evans
ccf635e4db
Added GH action for some simple CI
2 years ago
SignalRT
528a7aafcb
Merge test changes from @martindevans
The poc of the test is working know. Finally the problem error seems to be related with the process stopping.
Once I changed the context with today llama.cpp binaries is working OK
2 years ago
SignalRT
348f2c7d72
Update llama.cpp binaries to 5f631c2 and align the context to that version
It solves the problem with netstandard2 (is it really netstandard2 a thing right now?)
Change context to solve problems.
5f631c2679
2 years ago
Rinne
94fde3abd6
Merge pull request #72 from martindevans/fixed_mirostate_mu
Fixed Mirostate Sampling
2 years ago
Rinne
075b785a4d
Merge branch 'master' into fixed_mirostate_mu
2 years ago
Rinne
c641dbdb83
Merge pull request #69 from martindevans/fixed_mirostat_spelling
Fixed Spelling Mirostate -> Mirostat
2 years ago
Rinne
8d37abd787
Merge pull request #68 from martindevans/sampling_improvements
Fixed Memory pinning in Sampling API
2 years ago
Rinne
1d29b240b2
Merge pull request #64 from martindevans/new_llama_state_loading_mechanism
Low level new loading system
2 years ago
Martin Evans
add3d5528b
Removed `MarshalAs` on array
2 years ago
Martin Evans
2245b84906
Update LLamaContextParams.cs
2 years ago
Martin Evans
c64507cb41
Correctly passing through mu value to mirostate instead of resetting it every time.
2 years ago
Rinne
0e438e6303
Merge pull request #63 from martindevans/more_multi_enumeration_fixes
Fixed More Multiple Enumeration
2 years ago
Rinne
cd015055a8
Merge branch 'master' into more_multi_enumeration_fixes
2 years ago
Rinne
e5ca18fd86
Merge pull request #54 from martindevans/fix_multiple_enumeration
Fixed Multiple Enumeration
2 years ago
Martin Evans
23629a15f8
Merge pull request #1 from saddam213/new_llama_state_loading_mechanism
LLamaContextParams epsilon and tensor split changes
2 years ago
sa_ddam213
3e252c81f6
LLamaContextParams epsilon and tensor split changes
2 years ago
Martin Evans
36735f7908
Fixed spelling of "mirostat" instead of "mirostate"
2 years ago
Martin Evans
ec49bdd6eb
- Most importantly: Fixed issue in `SamplingApi`, `Memory` was pinned, but never unpinned!
- Moved repeated code to convert `LLamaTokenDataArray` into a `LLamaTokenDataArrayNative` into a helper method.
- Modified all call sites to dispose the `MemoryHandle`
- Saved one copy of the `List<LLamaTokenData>` into a `LLamaTokenData[]` in `LlamaModel`
2 years ago
Martin Evans
6985d3ab60
Added comments on two properties
2 years ago
Martin Evans
c974c8429e
Removed leftover `using`
2 years ago
Martin Evans
afb9d24f3a
Added model `Tokenize` method
2 years ago
Martin Evans
369c915afe
Added TokenToString conversion on model handle
2 years ago
Martin Evans
b721072aa5
Exposed some extra model properties on safe handle
2 years ago
Martin Evans
44b1e93609
Moved LoRA loading into `SafeLlamaModelHandle`
2 years ago