Rinne
833b2d3abf
fix doc ci
2 years ago
Rinne
7a8fd4f88f
fix doc ci
2 years ago
Rinne
448fd37c75
fix doc ci
2 years ago
Rinne
a47c3a01bf
fix doc ci
2 years ago
Rinne
b70115f37d
fix doc ci
2 years ago
Rinne
0773e68111
fix doc ci
2 years ago
Rinne
8be9e8ae70
fix doc ci
2 years ago
Rinne
cb81295524
fix doc ci
2 years ago
Rinne
76be973689
fix doc ci
2 years ago
Rinne
53d68ca075
fix ci
2 years ago
Rinne
9b0850f066
fix ci
2 years ago
Rinne
66eb09b816
fix ci
2 years ago
Rinne
4f56e7297f
fix ci
2 years ago
Rinne
47bf9a8f66
fix ci
2 years ago
Rinne
ae24be0215
fix ci
2 years ago
Rinne
e63fa778fa
trigger workflow on doc_ci branch.
2 years ago
Rinne
c90f97021b
fix ci
2 years ago
Rinne
23a5cb5355
disable build ci.
2 years ago
Rinne
f5f0ab4502
ci: initialize the doc deployment ci.
2 years ago
Rinne
b9cec018c0
temporarily disable build ci.
2 years ago
Rinne
b9444452eb
docs: refactor the documentations.
2 years ago
Rinne
7e53bac1f0
docs: update README.
2 years ago
Rinne
156f369e33
Merge pull request #609 from SignalRT/LlavaExecutor
Feature: LLava executor
2 years ago
Rinne
5e17e0f7c7
Merge pull request #630 from zsogitbe/master
KernelMemory update with adding the use of already loaded model
2 years ago
Zoli Somogyi
91e5a3f543
Code optimization
2 years ago
Zoli Somogyi
127c3edd44
KernelMemory update with adding the use of already loaded model
When using KernelMemory one may have already loaded a model which can then be used with this extension instead of loading the model again.
2 years ago
Rinne
9ee6ae3319
Merge pull request #615 from ChengYen-Tang/master
[LLama.KernelMemory] Fixed System.ArgumentException: EmbeddingMode must be true & #617
2 years ago
SignalRT
bc487decae
Delete default prompt
2 years ago
SignalRT
43677c511c
Change interface to support multiple images and add the capabitlity to render the image in the console
2 years ago
SignalRT
2d9a114f66
Include comments and include some checks
2 years ago
SignalRT
f66044fba2
Restore CI on master
2 years ago
SignalRT
8907adcd8e
Clean up duplicate property
2 years ago
SignalRT
4c013aefd4
Disable Llava Embed test on CI
2 years ago
SignalRT
e8732efadd
Example InteractiveExecutor
Add an Example and modifications to the interactive executor to enable Llava Models.
Just a preview / demo
2 years ago
SignalRT
59a3323c94
Temporary change to compile on current branch
2 years ago
SignalRT
df6a207e95
Revert "Try only to add cublas for the moment"
This reverts commit 5fda26c610 .
2 years ago
SignalRT
6589878314
Try only to add cublas for the moment
2 years ago
SignalRT
23a2df7aff
Add Cuda llava_shared library
2 years ago
Rinne
b677cdc6a3
Merge pull request #560 from eublefar/feature/chat-session-state-management
Chat session state management
2 years ago
Martin Evans
e2705be6c8
Fixed off by one error in LLamaBatch sampling position ( #626 )
2 years ago
Martin Evans
a2d3a847dd
Disabled LLava tests, they're too slow and are crashing CI ( #625 )
2 years ago
Martin Evans
91d72e7465
Keeping track of positions where logits will be generated in a batch and what sequence those logits are associated with. ( #624 )
2 years ago
eublefar
b8cd5b7ee5
loadTransforms flag for LoadSession methods
2 years ago
eublefar
9440f153da
Make process message method more flexible
2 years ago
Kenneth Tang
e4c2f57e43
Merge branch 'SciSharp:master' into master
2 years ago
Martin Evans
268f3a6b07
BatchedExecutor Fixed Forking ( #621 )
* Previously when a conversation was forked this would result in both the parent and the child sharing exactly the same logits. Since sampling is allowed to modify logits this could lead to issues in sampling (e.g. one conversation is sampled and overwrites logits to be all zero, second conversation is sampled and generates nonsense). Fixed this by setting a "forked" flag, logits are copied if this flag is set. Flag is cleared next time the conversation is prompted so this extra copying only happens once after a fork occurs.
* Removed finalizer from `BatchedExecutor`. This class does not directly own any unmanaged resources so it is not necessary.
2 years ago
Kenneth Tang
9e4109f774
Unable to load the model onto multiple GPUs ( #617 )
2 years ago
Kenneth Tang
6216197196
Merge branch 'SciSharp:master' into master
2 years ago
Martin Evans
ad682fbebd
`BatchedExecutor.Create()` method ( #613 )
Replaced `BatchedExecutor.Prompt(string)` method with `BatchedExecutor.Create()` method. This improves the API in two ways:
- A conversation can be created, without immediately prompting it
- Other prompting overloads (e.g. prompt with token list) can be used without duplicating all the overloads onto `BatchedExecutor`
Added `BatchSize` property to `LLamaContext`
2 years ago
Kenneth Tang
3fda708eaa
Fix System.ArgumentException: EmbeddingMode must be true
2 years ago