Martin Evans
4b11feddef
Merge pull request #436 from SciSharp/dependabot/nuget/Microsoft.AspNetCore.OpenApi-8.0.1
build(deps): bump Microsoft.AspNetCore.OpenApi from 8.0.0 to 8.0.1
2 years ago
Martin Evans
1cb9bcd55c
Merge pull request #440 from martindevans/additional_special_string_tokenizer_tests
Extra Tokenization Tests
2 years ago
Martin Evans
1472704e12
Added a test with examples of troublesome strings from 0.9.1
2 years ago
Martin Evans
73172bbaba
Merge pull request #438 from martindevans/cleanup_model_unnecessary_unsafe
Model Metadata Loading Cleanup
2 years ago
Martin Evans
ce1d302e7e
Moved some native methods into `SafeLlamaModelHandle`, these methods are all wrapped in safer accessors with no extra costs so there is no need to expose them.
2 years ago
Martin Evans
4ef618012e
Merge pull request #437 from martindevans/check_model_path_exists
Check Model Path Exists
2 years ago
Martin Evans
1e86755071
- Removed unnecessary `unsafe` block in model metadata loading
- Clarified comments on native metadata loading methods
2 years ago
Martin Evans
de2b20aae5
- Added a specific exception for failing to load model weights.
- Checking if model is readable
2 years ago
Martin Evans
096e0e75f8
Check that the model file actually exists immediately before loading it. Improve #395
2 years ago
dependabot[bot]
853fccd9d0
build(deps): bump Microsoft.AspNetCore.OpenApi from 8.0.0 to 8.0.1
Bumps [Microsoft.AspNetCore.OpenApi](https://github.com/dotnet/aspnetcore ) from 8.0.0 to 8.0.1.
- [Release notes](https://github.com/dotnet/aspnetcore/releases )
- [Changelog](https://github.com/dotnet/aspnetcore/blob/main/docs/ReleasePlanning.md )
- [Commits](https://github.com/dotnet/aspnetcore/compare/v8.0.0...v8.0.1 )
---
updated-dependencies:
- dependency-name: Microsoft.AspNetCore.OpenApi
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2 years ago
Martin Evans
3c6af909dd
Merge pull request #434 from martindevans/stateless_eos_check
Added a check for EOS token in LLamaStatelessExecutor
2 years ago
Martin Evans
5b41c8e5d5
Merge pull request #433 from martindevans/tokenizer_fixes_newline
Tokenizer Fixes For Issue 430
2 years ago
Martin Evans
f160fbd6d1
Added a check for EOS token in LLamaStatelessExecutor
2 years ago
Martin Evans
2ea2048b78
- Added a test for tokenizing just a new line (reproduce issue https://github.com/SciSharp/LLamaSharp/issues/430 )
- Properly displaying `LLamaToken`
- Removed all tokenisation code in `SafeLLamaContextHandle` - just pass it all through to the `SafeLlamaModelHandle`
- Improved `SafeLlamaModelHandle` tokenisation:
- Renting an array, for one less allocation
- Not using `&tokens[0]` to take a pointer to an array, this is redundant and doesn't work on empty arrays
2 years ago
Martin Evans
ba477b83a0
Merge pull request #428 from martindevans/fix_streaming_text_decoder
StreamingTextDecoder Fix & Tests
2 years ago
Martin Evans
98635a0d5a
Fixed decoding of large tokens (over 16 bytes) in streaming text decoder
2 years ago
Martin Evans
54dffe7e03
Merge pull request #427 from SciSharp/Oceania2018-patch-1
Update README.md
2 years ago
Haiping
e5c8126c1c
Update README.md
2 years ago
Martin Evans
402a110a3a
Merge pull request #404 from martindevans/switched_to_LLamaToken_struct
LLamaToken Struct
2 years ago
Martin Evans
d9b4e1fde7
Merge pull request #424 from Kaotic3/GpuLayerCountChange
Gpu layer count change
2 years ago
Steven Kennedy
988f2fa302
Reverted Net8.0
2 years ago
Kaotic3
984632bfed
Merge branch 'SciSharp:master' into master
2 years ago
Steven Kennedy
cf2e9e35f8
Updating the GpuLayerCount to mirror the Python Port of Llama.cpp
2 years ago
Martin Evans
267523e22a
Merge pull request #420 from SciSharp/dependabot/nuget/xunit-2.6.5
build(deps): bump xunit from 2.6.4 to 2.6.5
2 years ago
dependabot[bot]
4a6f07943c
build(deps): bump xunit from 2.6.4 to 2.6.5
Bumps [xunit](https://github.com/xunit/xunit ) from 2.6.4 to 2.6.5.
- [Commits](https://github.com/xunit/xunit/compare/2.6.4...2.6.5 )
---
updated-dependencies:
- dependency-name: xunit
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2 years ago
Martin Evans
b2334b888e
Merge pull request #418 from martindevans/grammar_test
Grammar Test (#394 repro)
2 years ago
Martin Evans
eebe4cb120
Added a new test (commented out for now) which reproduces the issue reported in #394
2 years ago
Martin Evans
b620e749a1
Merge pull request #415 from martindevans/readme_example_code_fix
Fixed example code in readme
2 years ago
Martin Evans
9573e2c9ba
Merge pull request #417 from martindevans/safe_handle_initialisation
Safer Handle Initialisation
2 years ago
Martin Evans
1e69e265b6
Moved some native methods to do with creating/destroying resources into their respective handles. There is **no** safe way to call most of these methods, everything must be done through through handles.
2 years ago
Martin Evans
c696cda44b
Merge pull request #416 from martindevans/IModelParams_better_exception
Improved exceptions in IModelParams for unknown KV override types.
2 years ago
Martin Evans
8416cb866a
Improved exceptions in IModelParams for unknown KV override types.
2 years ago
Martin Evans
b68bc3548d
Fixed example code in readme
2 years ago
Martin Evans
d74e6c75d5
Merge pull request #413 from SciSharp/martindevans-patch-1
Update README.md
2 years ago
Martin Evans
368410ed41
Update README.md
2 years ago
Martin Evans
91157fe4da
Merge pull request #412 from martindevans/Release_0.9.1
Release 0.9.1 (hotfix)
2 years ago
Martin Evans
02f6c064fb
Added the final nuget push back into the workflows
2 years ago
Martin Evans
d457cc3c1e
Merge pull request #411 from martindevans/test_pr2
Test Release PR 2
2 years ago
Martin Evans
5a4e6d8e07
Fixed copy path for binaries
2 years ago
Martin Evans
cdb98f2874
Merge pull request #410 from martindevans/test_pr
Test PR
2 years ago
Martin Evans
4d1e73b6d1
Test PR with unimportant change to test the fixed auto-release pipeline
2 years ago
Martin Evans
308aec363a
Merge pull request #409 from martindevans/fixed_prepare_release
Fixed prepare_release script
2 years ago
Martin Evans
fef9c9f3f2
Temporarily disabled nuget push, for testing
2 years ago
Martin Evans
2166c2dbcf
Formatting of error return
2 years ago
Martin Evans
072873a8a1
Added -e flag, to terminate prepare_release script if there are any errors
2 years ago
Martin Evans
c38bc0a342
Fixed prepare_release.sh script so it can properly copy all of the binary deps
2 years ago
Martin Evans
4952d55216
Merge pull request #398 from martindevans/0.9.0_readme_update
Updated readme for 0.9.0 release
2 years ago
Martin Evans
b3b54e662a
Merge pull request #408 from asmirnov82/fix_semantic_kernel_readme
Fix typos in SemanticKernel README file
2 years ago
Aleksei Smirnov
cc892a5eed
Fix typos in SemanticKernel README file
2 years ago
Martin Evans
1e81b0b91c
Update README.md
Fixed readme: Max -> Mac
2 years ago