Skip to content
This repository has been archived by the owner on Jul 17, 2024. It is now read-only.

⚗️ Llava 13b model repository trained by liuhaotian managed by DVC

Notifications You must be signed in to change notification settings

instill-ai/model-llava-13b-dvc

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

26 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Task Tags
VisualQuestionAnswering
VisualQuestionAnswering
Llava-13b

Model-Llava-13b-dvc

🔥🔥🔥 Deploy Llava-v1.6-13b model on VDP.

This repo contains Llava-v1.6-13b and Llava-v1.6-7b model in transformers format managed using DVC. For information about available extra parameters, please refer to the documentation on GenerationConfig in the Transformer library.

Notes:

  • Disk Space Requirements: 50G
  • GPU Memory Requirements: 30G
  • That some parameters is prohibited by Llava such as frequency_penalty
{
    "task_inputs": [
        {
            "visual_question_answering": {
              "prompt": "What is unusual inside this image?",
              "prompt_image_url": "https://artifacts.instill.tech/imgs/dog.jpg",
              // "prompt_image_url": "https://storage.googleapis.com/public-europe-west2-c-artifacts/imgs/sample1.png",
              "max_new_tokens": "300",
              "temperature": "0.9",
              "top_k": "30",
              "random_seed": "42",
              "extra_params": "{\"top_p\": 0.8}" 
            }
        }
    ]
}