autogen

Tree: a4b6372813

History

PythicCoder 6a3acc4548 Feature add Add LlamaCppChatCompletionClient and llama-cpp (#5326 ) This pull request introduces the integration of the `llama-cpp` library into the `autogen-ext` package, with significant changes to the project dependencies and the implementation of a new chat completion client. The most important changes include updating the project dependencies, adding a new module for the `LlamaCppChatCompletionClient`, and implementing the client with various functionalities. ### Project Dependencies: * [`python/packages/autogen-ext/pyproject.toml`](diffhunk://#diff-095119d4420ff09059557bd25681211d1772c2be0fbe0ff2d551a3726eff1b4bR34-R38): Added `llama-cpp-python` as a new dependency under the `llama-cpp` section. ### New Module: * [`python/packages/autogen-ext/src/autogen_ext/models/llama_cpp/__init__.py`](diffhunk://#diff-42ae3ba17d51ca917634c4ea3c5969cf930297c288a783f8d9c126f2accef71dR1-R8): Introduced the `LlamaCppChatCompletionClient` class and handled import errors with a descriptive message for missing dependencies. ### Implementation of `LlamaCppChatCompletionClient`: * `python/packages/autogen-ext/src/autogen_ext/models/llama_cpp/_llama_cpp_completion_client.py`: - Added the `LlamaCppChatCompletionClient` class with methods to initialize the client, create chat completions, detect and execute tools, and handle streaming responses. - Included detailed logging for debugging purposes and implemented methods to count tokens, track usage, and provide model information.…d chat capabilities <!-- Thank you for your contribution! Please review https://microsoft.github.io/autogen/docs/Contribute before opening a pull request. --> <!-- Please add a reviewer to the assignee section when you create a PR. If you don't have the access to it, we will shortly find a reviewer and assign them to your PR. --> ## Why are these changes needed? <!-- Please give a short summary of the change and the problem this solves. --> ## Related issue number <!-- For example: "Closes #1234" --> ## Checks - [X ] I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally. - [X ] I've added tests (if relevant) corresponding to the changes introduced in this PR. - [ X] I've made sure all auto checks have passed. --------- Co-authored-by: aribornstein <x@x.com> Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com> Co-authored-by: Ryan Sweet <rysweet@microsoft.com>		1 year ago
..
test_aca_dynamic_sessions.py	Refactor code executor namespace (#4538)	1 year ago

test_aca_user_defined_functions.py	Refactor code executor namespace (#4538)	1 year ago

test_commandline_code_executor.py	Feature add Add LlamaCppChatCompletionClient and llama-cpp (#5326)	1 year ago

test_docker_commandline_code_executor.py	Make CodeExecutor Serializable/Declarative (#5527)	1 year ago

test_jupyter_code_executor.py	Make CodeExecutor Serializable/Declarative (#5527)	1 year ago

test_user_defined_functions.py	Move local code exec to ext, uplevel components (#4557)	1 year ago

This is a mirror of AutoGen from GitHub. AutoGen is a framework that enables the development of LLM applications using multiple agents that can converse with each other to solve tasks.

Python SVG Jupyter Notebook C# TSX other

jackgerrits@users.noreply.github.com ekzhu@users.noreply.github.com wang.chi@microsoft.com rysweet@microsoft.com bigmiao.zhang@gmail.com adamfo@microsoft.com gagb@users.noreply.github.com victordibia@microsoft.com bnujli@gmail.com qingyun.wu@psu.edu liususan091219@users.noreply.github.com kostapetan@gmail.com jack@jackgerrits.com jaalber@microsoft.com davor@airt.ai shaokunzhang529@gmail.com griffinbassman@gmail.com 32823396+kevin666aa@users.noreply.github.com adam.fourney@gmail.com 49209570+peterychang@users.noreply.github.com leosantospinheiro@gmail.com qw2ky@virginia.edu 49699333+dependabot[bot]@users.noreply.github.com 66362098+marklysze@users.noreply.github.com hahahah2021@163.com

Contributors (25+) All

Contributors (25+)
All