Yaohui Liu
|
9a4bf8e844
|
docs: add verified models info.
|
3 years ago |
Yaohui Liu
|
e77afa76d0
|
feat: change default param of n_gpu_layers to 20.
|
3 years ago |
Yaohui Liu
|
e21589afa6
|
fix: n_gpu_layers not work in latest commit.
|
3 years ago |
Yaohui Liu
|
513d566361
|
refactor: remove dependency for third-party logger.
|
3 years ago |
Yaohui Liu
|
3e53ed4753
|
fix: build error after dropping LLamaModelV1.
|
3 years ago |
Yaohui Liu
|
56c56b9c51
|
refactor: drop LLamaModelV1.
|
3 years ago |
Yaohui Liu
|
18c2ff2395
|
refactor: instruct mode and examples.
|
3 years ago |
Yaohui Liu
|
421e3f32c7
|
feat: add tokenize and detokenize apis to LLamaModel.
|
3 years ago |
Yaohui Liu
|
e926b0690f
|
docs: add comments to LLamaModel methods.
|
3 years ago |
Yaohui Liu
|
4e1b6cf4e9
|
fix: optimize loading and saving state.
|
3 years ago |
Yaohui Liu
|
55d5a8ae51
|
fix: quantization error with fp16.
|
3 years ago |
Yaohui Liu
|
19979f664a
|
feat: support loading and saving state.
|
3 years ago |
Yaohui Liu
|
d6bd1b7107
|
fix: add check for model file path.
|
3 years ago |
Yaohui Liu
|
a65ad44291
|
build: add readme to package.
|
3 years ago |
Yaohui Liu
|
2490cf17f4
|
build: update to v0.2.3.
|
3 years ago |
Yaohui Liu
|
00d91cf99e
|
refactor: some parts of code of LLamaModel.
|
3 years ago |
Yaohui Liu
|
afedd3c949
|
fix: errors when input is not English or too long.
|
3 years ago |
Yaohui Liu
|
ea5f9d38ac
|
fix: always add bos when inference.
|
3 years ago |
Yaohui Liu
|
1fca06dc7f
|
fix: n_gpu_layers miss in llama context.
|
3 years ago |
Yaohui Liu
|
4314f64b9c
|
feat: add check for backend package.
|
3 years ago |
Yaohui Liu
|
bcd4c5605b
|
feat: add n_gpu_layers and prompt_cache_all params.
|
3 years ago |
Yaohui Liu
|
f17fd889be
|
build: optimize the building of LLama.
|
3 years ago |
Yaohui Liu
|
9c0f3aedba
|
refactor: change some file names.
|
3 years ago |
Yaohui Liu
|
f5a01c346d
|
feat: enable history for chat session.
|
3 years ago |
Yaohui Liu
|
aa2b064d1d
|
fix: add IDisposable to model classes.
|
3 years ago |
Yaohui Liu
|
6ffcb5306b
|
refactor: use official api of quantization instead.
|
3 years ago |
Yaohui Liu
|
0958bbac2c
|
feat: add get-embedding api to LLamaModel.
|
3 years ago |
Yaohui Liu
|
d76619c01b
|
docs: add more comments to obselete class LLamaModelV1.
|
3 years ago |
Haiping Chen
|
21c36cbf80
|
Added WebAPI.
|
3 years ago |
Yaohui Liu
|
a9a5bbdbd3
|
build: revise the building of master branch.
|
3 years ago |
Yaohui Liu
|
33067f990f
|
feat: run quantization in csharp.
|
3 years ago |
Yaohui Liu
|
118d410d52
|
build: revise build informations.
|
3 years ago |
Yaohui Liu
|
856d6549de
|
build: add linux support.
|
3 years ago |
Yaohui Liu
|
02524ae4eb
|
build: add package informations.
|
3 years ago |
Yaohui Liu
|
fce10f3c4f
|
feat: add ChatSession.
|
3 years ago |
Yaohui Liu
|
d6a7997e46
|
feat: add gpt model.
|
3 years ago |
Yaohui Liu
|
5a79edeb51
|
feat: add the framework and basic usages.
|
3 years ago |