Mihai
7f31276bdf
[WIP] Translating the GrammarParser
2 years ago
Martin Evans
e34491855e
Merge pull request #135 from martindevans/really-fixed-cublas-paths
Fixed those cublas paths again
2 years ago
Martin Evans
229151ca37
Fixed those cublas paths again
2 years ago
Martin Evans
d0ca63fea5
Merge pull request #134 from martindevans/final-linux-cublas-fix
Fixed the cublas linux paths again
2 years ago
Martin Evans
dc4ef4f1a0
Fixed the cublas linux paths again
2 years ago
Martin Evans
82b7c1a475
Merge pull request #133 from martindevans/linux_cublas_final_path
fixed linux cublas paths in final step
2 years ago
Martin Evans
d695923711
fixed linux cublas paths in final step
2 years ago
Martin Evans
bdc1ea6560
Merge pull request #132 from martindevans/linux-cublas
Fixed linux cublas filenames
2 years ago
Martin Evans
c88717ace6
Fixed linux cublas file names
2 years ago
Martin Evans
c7096948c0
Fixed linux cublas filenames
2 years ago
Martin Evans
086fd5345c
Merge pull request #131 from martindevans/linux-cublas
Linux cublas
2 years ago
Martin Evans
e4dc543d24
Removed x86_64 macos build
2 years ago
Martin Evans
318ccd433f
Fixed linux cublas filepaths
2 years ago
Martin Evans
86398d400d
Added cublas target for Linux
2 years ago
Martin Evans
f86aa98300
Merge pull request #130 from martindevans/cublas_fix_paths
Fixed cuda paths again
2 years ago
Martin Evans
91ed8e8ccf
Fixed cuda paths again
2 years ago
Martin Evans
ea5d8a4695
Merge pull request #127 from martindevans/cublas_fix_paths
Fixed paths
2 years ago
Martin Evans
d076b723f5
Fixed paths
2 years ago
Martin Evans
5328f443b9
Dependency Building In Github Action ( #126 )
* new github action to build deps (manually triggered)
2 years ago
Martin Evans
964f497c50
Merge pull request #125 from martindevans/native_sampling_api_improvements
Removed unnecessary parameters from some low level sampler methods
2 years ago
Martin Evans
826c6aaec3
cleaned up higher level code using the sampling API:
- Fixed multiple enumeration
- Fixed newline penalisation
2 years ago
Martin Evans
cf4754db44
Removed unnecessary parameters from some low level sampler methods
2 years ago
Martin Evans
0ce5cf97fc
Merge pull request #124 from martindevans/native_sampling_api_improvements
Two small improvements to the native sampling API
2 years ago
Martin Evans
f70525fec2
Two small improvements to the native sampling API:
- Modified `llama_sample_token_mirostat` and `llama_sample_token_mirostat_v2` to take `ref float` instead of as a `float*`. Less pointers is always good.
- Modified `llama_sample_repetition_penalty` and `llama_sample_frequency_and_presence_penalties` to take pointers instead of arrays. This allows the use non non allocating types (e.g. Span) instead of arrays
- Modified higher level API to accept `Memory<int>` instead of `int[]`, which can be used to reduce allocations at call sites
2 years ago
Martin Evans
da3dffe812
Merge pull request #120 from martindevans/code_warnings_cleanup
ReSharper code warnings cleanup
2 years ago
Martin Evans
a911b77dec
Various minor changes, resolving about 100 ReSharper code quality warnings
2 years ago
Martin Evans
5a6c6de0dc
Merge pull request #115 from martindevans/model_params_record
ModelsParams record class
2 years ago
Martin Evans
d367317c2c
Merge pull request #119 from martindevans/improved_cloning
Improved Cloning
2 years ago
Martin Evans
70be6c7368
Removed `virtual` method in newly sealed class
2 years ago
Martin Evans
ebacdb666d
- Moved the lower level state get/set methods onto SafeLLamaContextHandle
- Used those methods to add a `Clone` method to SafeLLamaContextHandle
- Simplified `LLamaContext` by using the new methods
- Sealed `LLamaContext` and `LLamaEmbedder`
2 years ago
Martin Evans
77aa5fa0d0
Added `JsonConverter` attribute, so System.Text.Json serialization is seamless
2 years ago
Martin Evans
df80ec9161
Merge pull request #97 from martindevans/embedder_tests
Embedder Test
2 years ago
Martin Evans
634bd3feed
Loosened requirements even more!
2 years ago
Martin Evans
9587699a60
loosened requirements even further for CI
2 years ago
Martin Evans
bc70358b3e
expanded epsilon enough to allow CI to pass
2 years ago
Martin Evans
469b5e6fcd
Merge pull request #117 from martindevans/more_obsoletion
OldVersion obsoletion notices
2 years ago
Martin Evans
804686818c
Merge branch 'embedder_tests' of github.com:martindevans/LLamaSharp into embedder_tests
2 years ago
Martin Evans
058c4e84b1
Rewritten LLamaEmbedder to use `LLamaContext` instead of the lower level handles
2 years ago
Martin Evans
08501db155
cleaned up basic test a bit
2 years ago
Martin Evans
498ed109c1
Fixed dot product based test
2 years ago
Martin Evans
35e48691ea
Added a known correct value to the unit tests
3 years ago
Martin Evans
dff308e31b
Added a test for the LLamaEmbedder
3 years ago
Martin Evans
829f32b27d
- Added `Obsolete` attributes to the entire `OldVersion` namespace, so they can be removed in the future
- Minor changes to cleanup some of the compiler warnings
2 years ago
Martin Evans
ee772a2921
added `using` statement instead of full qualification
2 years ago
Martin Evans
93f24f8a51
Switched to properly typed `Encoding` property
2 years ago
Martin Evans
d92e2664ac
Merge pull request #116 from zombieguy98/master
Changed type conversion
2 years ago
zombieguy
45b01d5a78
Improved type conversion
Type conversion is now done in the property rather than the utils class and uses the System.Convert class to ensure consistency.
2 years ago
Martin Evans
29df14cd9c
Converted ModelParams into a `record` class. This has several advantages:
- Equality, hashing etc all implemented automatically
- Default values are defined in just one place (the properties) instead of the constructor as well
- Added test to ensure that serialization works properly
2 years ago
Martin Evans
42fc5e4983
Merge pull request #114 from martindevans/minor_code_cleanup
Minor Code Cleanup
2 years ago
Martin Evans
2830e5755c
- Applied a lot of minor R# code quality suggestions. Lots of unnecessary imports removed.
- Deleted `NativeInfo` (internal class, not used anywhere)
2 years ago