Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Image output from chat (similar to ChatGPT) #1238

Open
wbcmthh42 opened this issue Jan 21, 2025 · 0 comments
Open

Image output from chat (similar to ChatGPT) #1238

wbcmthh42 opened this issue Jan 21, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@wbcmthh42
Copy link

Is your feature request related to this sample app, or to an Azure service, such as Azure OpenAI or Azure AI Search?
This feature request is related to this sample app's functionality, specifically focusing on enhancing the chatbot's capability to output images, such as charts, that are generated dynamically from code.

Is your feature request related to a problem? Please describe.
Currently, the chatbot is unable to generate and output visual representations, such as charts, directly from code. This limitation makes it challenging to present data-driven insights or visualizations in real-time conversations, which are essential for many analytics and reporting use cases. For instance, users might want to query the chatbot for a summary of data, and seeing a chart alongside the textual explanation would greatly enhance understanding and engagement.

Describe the solution you'd like
I would like the chatbot to support the generation and display of images, specifically charts, created from code executed during the conversation. This could involve integrating with libraries like Matplotlib or Plotly for chart generation and enabling the app to render these charts within the chatbot interface seamlessly.

Is this feature specific to your use case or your organization, or would it apply broadly across other uses of this app?
While my primary use case involves using the chatbot for data-driven discussions and decision-making, this feature would have broad applications across various domains. For example:

Business users could view financial or sales charts generated in real time.
Educational tools could provide visual learning aids directly in a conversational interface.
Data analysts and scientists could interact with datasets and receive visual outputs for better insights.

Describe alternatives you've considered
Alternatives include generating the charts separately in a standalone tool and uploading them manually into the conversation. However, this approach disrupts workflow and detracts from the real-time conversational experience. Another option is embedding pre-created visual content, but this lacks the flexibility of generating charts dynamically based on user inputs or code execution.

Additional context
This feature could utilize existing Azure services, such as Azure OpenAI for handling natural language inputs and integrating with Python-based libraries for code execution and chart generation. Having this capability would significantly improve the chatbot's utility for data visualization and interactive analysis.

@wbcmthh42 wbcmthh42 added the enhancement New feature or request label Jan 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant