AI Search with GPT4o omits 'tool'

[harpalshergill]

Hello,

in app.py, there is the following set of code which omits the role=tool. I am trying to understand why?
I have a setup with AI Search index to bring the dataset back. my model_args correctly load the extra settings for ai search index.

when i ask question, there is often a case when i do not get the answer. but if i ask same question I do get it.

any insight on this would be appreciated. thank you.

async def send_chat_request(request_body, request_headers):
    filtered_messages = []
    messages = request_body.get("messages", [])
    for message in messages:
        if message.get("role") != 'tool':
            filtered_messages.append(message)
            
    request_body['messages'] = filtered_messages