Martin Evans
74c19b10af
Merge pull request #145 from martindevans/disable_test_parallel
Disable test parallelism
2 years ago
Martin Evans
4a53cdc56b
Merge pull request #142 from SciSharp/rinne-dev
refactor: remove old version files.
2 years ago
Martin Evans
21cbecb82d
Disable test parallelism to prevent fix CI
2 years ago
Martin Evans
b70c07963d
Merge pull request #144 from martindevans/remove_LLamaNewlineTokens
Remove LLamaNewlineTokens from InteractiveExecutorState
2 years ago
Martin Evans
33035c82bf
- Removed `LLamaNewlineTokens` from `InteractiveExecutorState`. This is always set in the constructor from the context, so there's no point serializing it.
2 years ago
jlsantiago
5a119c4ee1
Update MacOS Binaries ( #143 )
* Restore macOS pipelines
* Generate Metal binaries.
2 years ago
Yaohui Liu
18294a725e
refactor: remove old version files.
2 years ago
Martin Evans
b1f33fa20e
Placed the `noavx` file for Linux and Windows in the root `deps` folder, these will be used as the default if nothing else is loaded
2 years ago
Martin Evans
cfb3defeee
Changed paths to no longer include OS name (no need, .dll and .so file extensions are enough)
2 years ago
Martin Evans
025741a73e
Fixed My Name
The D is for my middle name 😄
2 years ago
Rinne
b82e9f8fb0
Merge pull request #141 from SciSharp/rinne-dev
docs: update the docs to follow new version.
2 years ago
Yaohui Liu
20b5363601
fix: remove the history commit of embedding length property.
2 years ago
Yaohui Liu
3a847623ab
docs: update the docs to follow new version.
2 years ago
Yaohui Liu
ca6624edb3
Merge branch 'master' of github.com:SciSharp/LLamaSharp into rinne-dev
2 years ago
Rinne
4e83e48ad1
Merge pull request #122 from martindevans/gguf
Add GGUF support
2 years ago
Martin Evans
97349d93be
Merge branch 'gguf' of github.com:martindevans/LLamaSharp into gguf
2 years ago
Martin Evans
bcf06e2652
Added some comments on various native methods
2 years ago
Martin Evans
4d079bf641
Merge pull request #140 from martindevans/grammar_exception_types
grammar_exception_types
2 years ago
Martin Evans
af680ac2d7
Created a hierarchy of exceptions for grammar format issues. This allows the base catch-all exception to be caught for general handling, or more specific exceptions to be caught for more specific handling.
2 years ago
Rinne
1533ee7dbf
Merge pull request #138 from drasticactions/semantic-kernel
Enable Semantic kernel support
2 years ago
Tim Miller
d4a57fffef
README, Cleanup
2 years ago
Tim Miller
2bde188c64
Change Namespace
2 years ago
Tim Miller
326c802be7
Have weights generate context
2 years ago
Martin Evans
cb506cca1c
Merge pull request #4 from SignalRT/GGUF-MERGE
Changes to compile in VS Mac + change model to llama2
2 years ago
Martin Evans
6b48157b20
Merge pull request #137 from martindevans/grammar_improvements
Higher Level Grammar System
2 years ago
Tim Miller
a81edacbfb
Remove embedding for now
2 years ago
Tim Miller
98bfbe1d50
Update
2 years ago
Tim Miller
3bca3b632e
New line
2 years ago
Tim Miller
9a1d6f99f2
Add Semantic Kernel support
2 years ago
Martin Evans
a70c7170dd
- Created a higher level `Grammar` class which is immutable and contains a list of grammar rules. This is the main "entry point" to the grammar system.
- Made all the mechanics of grammar parsing (GBNFGrammarParser, ParseState) internal. Just call `Grammar.Parse("whatever")`.
- Added a `GrammarRule` class which validates elements on construction (this allows constructing grammar without parsing GBNF).
- It should be impossible for a `GrammarRule` to represent an invalid rule.
2 years ago
SignalRT
fb007e5921
Changes to compile in VS Mac + change model to llama2
This commit includes changes to compile en VS Mac + changest to use llama2 not codellama.
It includes MacOS binaries in memory and metal
2 years ago
Martin Evans
40e76a70c5
Merge pull request #136 from Mihaiii/grammar_parser
Translating the grammar parser
2 years ago
Mihai
24d3e1bfa8
Address PR review comment
2 years ago
Mihai
60790c5aac
Address code review comments (create custom exception, move printing to the ParseState class, rethrow error).
2 years ago
Mihai
71f02e08c2
Add grammar example
2 years ago
Mihai
920efaca44
Add original test
2 years ago
Mihai
2ae1891c13
Bug fixes after running tests.
SymbolIds is now SortedDictionary (although I'm not sure it really needs to be) because the test was failing due to expected value being in another order. The C++ data structure if SymbolIds is std::map<std::string, uint32_t> so the items are ordered by key.
2 years ago
Mihai
0bd495276b
Add initial tests + fix bugs. Still WIP since the test is failing.
2 years ago
Mihai
0f373fcc6d
Finish grammar_parser translation from C++ to C#
2 years ago
Mihai
3c919b56fe
Use ReadOnlySpan everywhere instead of ReadOnlyMemeory and instead of returning tuple, reference the ReadOnlySpan.
2 years ago
Mihai
8b4ec6d973
Address PR change requests
2 years ago
Martin Evans
516c291e3f
Updated some of the docs
2 years ago
Mihai
7f31276bdf
[WIP] Translating the GrammarParser
2 years ago
Martin Evans
c9d08b943e
Added binaries for CUDA+Linux
2 years ago
Martin Evans
e34491855e
Merge pull request #135 from martindevans/really-fixed-cublas-paths
Fixed those cublas paths again
2 years ago
Martin Evans
229151ca37
Fixed those cublas paths again
2 years ago
Martin Evans
d0ca63fea5
Merge pull request #134 from martindevans/final-linux-cublas-fix
Fixed the cublas linux paths again
2 years ago
Martin Evans
dc4ef4f1a0
Fixed the cublas linux paths again
2 years ago
Martin Evans
82b7c1a475
Merge pull request #133 from martindevans/linux_cublas_final_path
fixed linux cublas paths in final step
2 years ago
Martin Evans
d695923711
fixed linux cublas paths in final step
2 years ago