Skip to content

Commit

Permalink
Updated README to refer to signalr branch
Browse files Browse the repository at this point in the history
  • Loading branch information
kevinguo-ed authored Jan 14, 2025
1 parent fd451e3 commit 443153b
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -371,6 +371,8 @@ to production. Here are some things to consider:

- **Loadtesting**: We recommend running a loadtest for your expected number of users.

- **Stream tokens to web clients**: Consider using SignalR library which allows bi-directional communication between clients and server. You can easily reuse the single persistent connection for streaming down tokens to clients and receiving signals from them. SignalR simplifies implementing common features in AI chatbot, such as token cancellation. When leveraging [Azure SignalR service](https://learn.microsoft.com/azure/azure-signalr/signalr-overview), you can easily scale to 1M connections. Additionally, Azure SignalR fits nicely in a serverless deployment, providing a cost-efficient solution without worrying about server management. Refer to the [signalr branch](https://github.com/Azure-Samples/azure-search-openai-demo-csharp/tree/signalr) for code sample.

### Resources

- [Revolutionize your Enterprise Data with ChatGPT: Next-gen Apps w/ Azure OpenAI and Azure AI Search](https://aka.ms/entgptsearchblog)
Expand Down

0 comments on commit 443153b

Please sign in to comment.