autogen

282 MB

Tree: 6bc896f6e2

Author	SHA1	Message	Date
Victor Dibia	170b8cc893	Make ChatCompletionCache support component config (#5658 ) <!-- Thank you for your contribution! Please review https://microsoft.github.io/autogen/docs/Contribute before opening a pull request. --> This PR makes makes ChatCompletionCache support component config <!-- Please add a reviewer to the assignee section when you create a PR. If you don't have the access to it, we will shortly find a reviewer and assign them to your PR. --> ## Why are these changes needed? Ensures we have a path to serializing ChatCompletionCache , similar to the ChatCompletion client that it wraps. This PR does the following - Makes CacheStore serializable first (part of this includes converting from Protocol to base class). Makes it's derivatives serializable as well (diskcache, redis) - Makes ChatCompletionCache serializable - Adds some tests <!-- Please give a short summary of the change and the problem this solves. --> ## Related issue number <!-- For example: "Closes #1234" --> Closes #5141 ## Checks - [ ] I've included any doc changes needed for <https://microsoft.github.io/autogen/>. See <https://github.com/microsoft/autogen/blob/main/CONTRIBUTING.md> to build and test documentation locally. - [ ] I've added tests (if relevant) corresponding to the changes introduced in this PR. - [ ] I've made sure all auto checks have passed. cc @nour-bouzid	1 year ago
Eric Zhu	225eb9d0b2	feat: introduce ModelClientStreamingChunkEvent for streaming model output and update handling in agents and console (#5208 ) Resolves #3983 * introduce `model_client_stream` parameter in `AssistantAgent` to enable token-level streaming output. * introduce `ModelClientStreamingChunkEvent` as a type of `AgentEvent` to pass the streaming chunks to the application via `run_stream` and `on_messages_stream`. Although this will not affect the inner messages list in the final `Response` or `TaskResult`. * handle this new message type in `Console`.	1 year ago
Sachin Joglekar	8926206479	Implement default in-memory store for ChatCompletionCache (#5188 )	1 year ago
Sachin Joglekar	8bd65c672f	Add ChatCompletionCache along with AbstractStore for caching completions (#4924 ) * Add ChatCompletionCache along with AbstractStore for caching completions * Addressing comments * Improve interface for cachestore * Improve documentation & revert protocol * Make cache store typed, and improve docs * remove unnecessary casts	1 year ago

4 Commits (6bc896f6e23f604eb5e94de10df8a1706c9c84ed)