Add API Service

[Mini-Right]

Service Startu

cd GOT-OCR2.0/GOT-OCR-2.0-master
python3 GOT/demo/run_ocr_serve.py

Test Code

import requests


def invoke():
    url = "http://127.0.0.1:6006/inference"
    img_path = r"image_path"
    files = {'file': open(img_path, 'rb')}
    response = requests.post(url, files=files)
    print(response.text)


if __name__ == '__main__':
    invoke()

[feuler]

You need to change line 175 from:

uvicorn.run(app="run_ocr:app", host="0.0.0.0", port=6006, workers=1)
to
uvicorn.run(app="run_ocr_serve:app", host="0.0.0.0", port=6006, workers=1)

[zhenfenxiao]

I'm curious that whether GOTQwenForCausalLM is thread safe? Have you tested the case that multiple requests coming at the same time?