The `SemanticKernelAgent` class has been updated to include an optional
`modelServiceId` parameter, allowing the specification of a service ID
for the model.
## Why are these changes needed?
Currently, `SemanticKernelAgent` uses the parameterless method for
resolving `IChatCompletionSerivce`. This will fail, when multiple models
are registered in the Kernel.
To support different models registered in the Kernel, I adopted the
resolving of the `IChatCompletionSerivce` within the
`SemanticKernelAgent` with an optional parameter. When it is not set, I
resolve the default instance, otherwise, I use the optional parameter as
a servide id for resolving the `IChatCompletionSerivce` service.
## Related issue number
## Checks
- [x] I've included any doc changes needed for
https://microsoft.github.io/autogen/. See
https://microsoft.github.io/autogen/docs/Contribute#documentation to
build and test documentation locally.
- [x] I've added tests (if relevant) corresponding to the changes
introduced in this PR.
- [x] I've made sure all auto checks have passed.
---------
Co-authored-by: Ryan Sweet <rysweet@microsoft.com>
Co-authored-by: Xiaoyun Zhang <bigmiao.zhang@gmail.com>
Right now if a remote agent sends a message that local agents do not
listen to (and thus will never configure a deserializer for), or if the
first agent in the iteration is one such, the runtime will throw an
unnecessary exception an come down, even though the deserialized message
will never actually be needed before a deserializer is registered.
The fix will downgrade that to a warning.
* Also updates the HelloAgent sample to be more amenable to being used
with gRPC directly, without configuring environment variables.
* integration tests used to use the samples - now they are separate
* patch dictionary problem in serializer
* add Message Registry with dead letter queue that gets checked on new
subs.
<!-- Thank you for your contribution! Please review
https://microsoft.github.io/autogen/docs/Contribute before opening a
pull request. -->
<!-- Please add a reviewer to the assignee section when you create a PR.
If you don't have the access to it, we will shortly find a reviewer and
assign them to your PR. -->
## Why are these changes needed?
<!-- Please give a short summary of the change and the problem this
solves. -->
## Related issue number
<!-- For example: "Closes #1234" -->
## Checks
- [ ] I've included any doc changes needed for
https://microsoft.github.io/autogen/. See
https://microsoft.github.io/autogen/docs/Contribute#documentation to
build and test documentation locally.
- [ ] I've added tests (if relevant) corresponding to the changes
introduced in this PR.
- [ ] I've made sure all auto checks have passed.
* There was an inconsistentcy between the package names that prevented
xlang from working even though the actual types were 1:1 compatible
* Also moves the HelloAgent aspire project into the Hello solution
folder
This is in preparation for releasing the Microsoft.AutoGen.Core NuGet
package.
* Moves IHandle<> to Microsoft.AutoGen.Contracts
* Makes KVStringParseHelper internal
* Updates versions of certain dependencies
* Updates NuGet package properties
* Enables deterministic build
* Enables ContinuousIntegrationBuild in CI
* Enable configuring SelfDelivery (defaults to false) when using
AgentsAppBuilder
* Also fixes the predicate for self-delivery
---------
Co-authored-by: Griffin Bassman <griffinbassman@gmail.com>
Moves the semantics of message delivery in .NET to be closer to Python
(up to vagaries of differences in Threading)
* Creates a message delivery queue in InProcessRuntime
* Creates Start/Stop/WaitForIdle APIs on InProcessRuntime
* Creates API to step individual messages
* Updates InProcessRuntime to play well with IHost as an IHostedService
Changes to align the .NET code more with the python codebase.
* rename *Worker to *Runtime
* refactor shared runtime elements to AgentRuntimeBase
* align runtime interface with python
## Why are these changes needed?
Aligning the .NET with the python code and then we can evolve together
from there.
## Related issue number
Closes#5201
* fix python path
* update HelloAgent to enable grpc
* agents app remove webapplication and add grpc
* add di for client
* adding events types to grpc di
* warnings to information
* improve logging, add some error handling; fix grpc startup
* improve error logging
* cleaning up publishing of messages and message handling.
* WbApplication->HostedApplication
* formatting
* WebApplication -> HostApplication
* ensure correct .NET versions are available for integration test
* moves AgentId into Agent
* Renames AgentRuntime to AgentMessenger (more accurate name)
* Remove IAgentRuntime Interface
* changes constructor of Agent to take IAgentWorker instead of IAgentRuntime
* move optional base agents to separate package
* rename main sdk to Core
* reduce dependency graph
Co-authored-by: @rysweet
Authored-by: @kostapetan
Co-authored-by: @kopetan-ms
* refactor renaming agent base
* 1st draft
* 1st draft
* format
* rename the tsts
* move IagentWorker
* 1st draft
* format
* gen-proto
* run gen-proto-samples
* format
* merge problem format
* renaming package
* update folder name to match extension structure
* more renaming and adding tags
* fix header
---------
Co-authored-by: Ryan Sweet <rysweet@microsoft.com>
* add subscription response
* fix send subscription response
* add register agent type response
* adding a test
* working on shaping up a test
* appsettins update for backend
* another appsettings
* fixup aspire hosting
* enable AGENT_HOST var from aspire
* add SendMessageAsync
* remove broken test
* test compiles and runs but is not (yet) correct
* subscriptions grain wireup.
* temp assert true.
* remove DI for SubscriptionGrain
* add xlang python code
* add subscription response
* rebond
* Update to .NET 9.0
* Fix Backend project SDK
* Package updates
* get RegisterAgentTypeRequest working
* fix exceptions
* add error handling for requests
* whoops
* send cloud event message type
* processing cloudevents
* trying tosend proto data - doesn't work
* trying to pack proto_data
* fix (#4238)
* pack the Message from agents_events
* format - not sure why these?
* format
* cleanup, error handling, xlang sample publishes messages that can be heard by .NET and vice versa
* format
* sdk version
* sdk vers
* net8
* back to net8
* remove netstandard2
* fix used
* remove unused
* more cleanup
* remove unneeded package
* I'm terrible at writing tests
* deserialize the cloud events and sent them as events
* comment
* cleanup
* await
* Delete dotnet/samples/Hello/Backend/Backend.csproj
unneeded change
* whoops
* merge main python back into here
* revert back to local
* revert some of the helloAgents changes.
* [.NET] Add happy path test for in-memory agent && Simplify HelloAgent example && some clean-up in extension APIs (#4227)
* add happy path test
* remove unnecessary namespace
* fix build error
* Update AgentBaseTests.cs
* revert changes
---------
* fix busted merge from main
* addressing review comments
* make internal
* case sensitive rename step 1
* case sensitive rename step 2
* remove!
---------
Co-authored-by: Peter Chang <petchang@microsoft.com>
Co-authored-by: Reuben Bond <reuben.bond@gmail.com>
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
Co-authored-by: Xiaoyun Zhang <bigmiao.zhang@gmail.com>
closes#3950closes#3702
What this is doing:
I am refactoring the services on the .NET runtime and attempting to clarify the naming and organization.
I added this doc to help capture the naming and concepts.
AgentRuntime / Worker should work similar to the python version and enables running the whole agent system in one process. For remote the system uses the versions of the services in the grpc folder.
lots of other bug fixes/threading cleanup - passing cancellation token throughout
Services update clarifies the naming and roles:
Worker: Hosts the Agents and is a client to the Gateway
Gateway:
-- RPC gateway for the other services APIs
-- Provides an RPC bridge between the workers and the Event Bus
Registry: keeps track of the agents in the system and which events they can handle
AgentState: persistent state for agents
* simplify publishing imessage contracts
use new api
complete adoption
remove unused project
more delete
more delete
* rename methods
* formatting
* Add task type that are messages to enable multi-modal tasks. (#4091)
* Add task type that are messages to enable multi-modal tasks.
* fix test
---------
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* Wait for acknowledgment when sending message to gRPC channel
* Add CancellationToken parameters to API surface
* Clean up the Hello sample, support Aspire 9.0, & fix shutdown
changes to AgentBase and HostBuilderExtensions to enable leveraging handlers from composition (interfaces) vs inheritance... see HelloAgents sample for usage
closes#3928
is related to #3925
Remove unused code, refactor AgentBase and AgentWorker/Runtime to use interfaces throughout to enable future implementation of alternate runtimes and separation of the gprpc service from Agent Base (for future in-memory version).
Also adds the missing RegisterAgentResponse methods
adopts the new Microsoft.Extensions.AI abstractions
adds a base InferenceAgent
fixes a lot of pain points in the runtime wrt startup/shutdown
fixes some uncaught exceptions in the grpc stream reading
adds an example for running the backend service in its own process
adds an example of an agent that connects to OpenAI/Ollama
adds an example of wrapping an agent app in .NET Aspire
upgrades some dependencies and removes some others
Known bugs: #3922
cedricmendelin
Jacob Alber
Ryan Sweet
Xiaoyun Zhang
Jack Gerrits
Griffin Bassman
Jack Gerrits
raimondasl
Diego Colombo
Reuben Bond
David Luong
Andreas Volkmann
Niklas Gustafsson