Rinne
|
08e668a313
|
Merge pull request #26 from mlof/document-interfaces
Document interfaces
|
3 years ago |
Rinne
|
fa9b5f7af6
|
Merge pull request #25 from mlof/fix-queue-typo
fix: typo in FixedSizeQueue
|
3 years ago |
Marcel
|
65925eac4f
|
Added documentation for the interfaces
|
3 years ago |
Marcel
|
b911b2548b
|
move interfaces into abstractions folder
|
3 years ago |
Marcel
|
762fd7c1ae
|
Fixed a typo in FixedSizeQueue
|
3 years ago |
Rinne
|
69849d3fc0
|
Merge pull request #24 from SignalRT/master
MacOS Arm64 support
|
3 years ago |
Yaohui Liu
|
a3b8186f20
|
feat: support save and load chat session.
|
3 years ago |
Yaohui Liu
|
bdbd6aa824
|
feat: add transforms for chat session.
|
3 years ago |
SignalRT
|
429af3d234
|
Merge branch 'SciSharp:master' into master
|
3 years ago |
Yaohui Liu
|
b567399b65
|
refactor: allow customized logger.
|
3 years ago |
SignalRT
|
b326dfc43f
|
MacOS Support
Add Arm64 as platform
|
3 years ago |
SignalRT
|
f7cf453366
|
MacOS Dynamic Link Libraries
Add MacOS Dynamic Link Libraries
|
3 years ago |
Yaohui Liu
|
3bf74ec9b9
|
feat: add chat session for refactored code.
|
3 years ago |
Yaohui Liu
|
908b79e855
|
feat: add stateless executor.
|
3 years ago |
Yaohui Liu
|
e603a09137
|
fix: state loading and saving not working.
|
3 years ago |
Yaohui Liu
|
5679e08718
|
feat: add ILLamaExecutor.InferAsync.
|
3 years ago |
Yaohui Liu
|
aaa0cba9f8
|
test: update the examples after refactoring.
|
3 years ago |
Yaohui Liu
|
264fb9a706
|
refactor: LLamaModel and LLamaExecutor.
|
3 years ago |
Yaohui Liu
|
3a62f087fe
|
fix: encoding error when using other languages.
|
3 years ago |
Rinne
|
4d34f0b116
|
docs: update discord link.
|
3 years ago |
Yaohui Liu
|
9a4bf8e844
|
docs: add verified models info.
|
3 years ago |
Yaohui Liu
|
25cf2a6ca9
|
docs: add qq group info to readme.
|
3 years ago |
Yaohui Liu
|
e77afa76d0
|
feat: change default param of n_gpu_layers to 20.
|
3 years ago |
Yaohui Liu
|
a545ab7eda
|
test: remove dumplicated space of example output.
|
3 years ago |
Yaohui Liu
|
e21589afa6
|
fix: n_gpu_layers not work in latest commit.
|
3 years ago |
Yaohui Liu
|
513d566361
|
refactor: remove dependency for third-party logger.
|
3 years ago |
Yaohui Liu
|
3e53ed4753
|
fix: build error after dropping LLamaModelV1.
|
3 years ago |
Yaohui Liu
|
56c56b9c51
|
refactor: drop LLamaModelV1.
|
3 years ago |
Yaohui Liu
|
18c2ff2395
|
refactor: instruct mode and examples.
|
3 years ago |
Yaohui Liu
|
421e3f32c7
|
feat: add tokenize and detokenize apis to LLamaModel.
|
3 years ago |
Yaohui Liu
|
e926b0690f
|
docs: add comments to LLamaModel methods.
|
3 years ago |
Yaohui Liu
|
4e1b6cf4e9
|
fix: optimize loading and saving state.
|
3 years ago |
Yaohui Liu
|
55d5a8ae51
|
fix: quantization error with fp16.
|
3 years ago |
Yaohui Liu
|
19979f664a
|
feat: support loading and saving state.
|
3 years ago |
Yaohui Liu
|
1573ae049f
|
docs: update the readme.
|
3 years ago |
Yaohui Liu
|
d6bd1b7107
|
fix: add check for model file path.
|
3 years ago |
Yaohui Liu
|
889975979d
|
docs: add badge to readme.
|
3 years ago |
Yaohui Liu
|
a65ad44291
|
build: add readme to package.
|
3 years ago |
Yaohui Liu
|
8e4fbe7bac
|
docs: update the readme.
|
3 years ago |
Yaohui Liu
|
2490cf17f4
|
build: update to v0.2.3.
|
3 years ago |
Yaohui Liu
|
00d91cf99e
|
refactor: some parts of code of LLamaModel.
|
3 years ago |
Yaohui Liu
|
afedd3c949
|
fix: errors when input is not English or too long.
|
3 years ago |
Yaohui Liu
|
ea5f9d38ac
|
fix: always add bos when inference.
|
3 years ago |
Yaohui Liu
|
1fca06dc7f
|
fix: n_gpu_layers miss in llama context.
|
3 years ago |
Yaohui Liu
|
4314f64b9c
|
feat: add check for backend package.
|
3 years ago |
Yaohui Liu
|
1fd35eca3e
|
docs: update the prompt resource info.
|
3 years ago |
Yaohui Liu
|
a7b9d29083
|
docs: update the readme file.
|
3 years ago |
Yaohui Liu
|
bcd4c5605b
|
feat: add n_gpu_layers and prompt_cache_all params.
|
3 years ago |
Yaohui Liu
|
f17fd889be
|
build: optimize the building of LLama.
|
3 years ago |
Yaohui Liu
|
998c0cb98d
|
Merge branch 'master' of github.com:SciSharp/LLamaSharp
|
3 years ago |