MC918562: Microsoft Teams: Stream Custom Agent and Bot Responses

Announcement IDMC918562Published Date10-25-2024
ServiceMicrosoft TeamsLast Updated10-25-2024
CategoryPlan for changeExpiration Date02-03-2025
Roadmap ID422261Action Required by Date
TagsAdmin impact, New feature, User impact


Summary
                Custom engine agents and Teams bots will soon stream responses, offering real-time updates and incremental delivery of replies, enhancing user experience. This feature will roll out from mid-November to late-December 2024. Organizations may need to update training and documentation accordingly. Roadmap ID: 422261.


More Information

Custom engine agents and Teams bots can now stream responses like Microsoft Copilot. They can provide real-time updates on their actions while delivering parts of the response as they generate it, making interactions feel faster and more engaging.

When this will happen:

Targeted Release: We will begin rolling out mid-November 2024 and expect to complete by late-November 2024.

General Availability (Worldwide): We will begin rolling out mid-December 2024 and expect to complete by late-December 2024.

How this will affect your organization:

When users interact with a custom engine agent or Teams bot that streams its response, they will experience the new UX.

Users will first see informative updates from the agent on what it is doing while it generates a response to the user's message:

Stream Custom Agent and Bot Responses

Once the agent has performed prerequisite actions and is ready to respond, users will start to see the agent's response flow in as incremental chunks until the full response is available. This experience is very similar to how the response iteratively appears on leading AI experiences like ChatGPT or Copilot:

Stream Custom Agent and Bot Responses

Users will have the option to stop generating the response if they feel the agent is headed down an ineffective path. Users can simply click on the stop button underneath the response, and this will stop the agent's response. Users can then prompt the agent again:

Stream Custom Agent and Bot Responses

What you need to do to prepare:

You may consider updating your training and documentation as appropriate.

Previous Post Next Post