Task | Tags | ||
---|---|---|---|
VisualQuestionAnswering |
|
🔥🔥🔥 Deploy Llava-v1.6-13b model on VDP.
This repo contains Llava-v1.6-13b and Llava-v1.6-7b model in transformers format managed using DVC. For information about available extra parameters, please refer to the documentation on GenerationConfig in the Transformer library.
Notes:
- Disk Space Requirements: 50G
- GPU Memory Requirements: 30G
- That some parameters is prohibited by Llava such as
frequency_penalty
{
"task_inputs": [
{
"visual_question_answering": {
"prompt": "What is unusual inside this image?",
"prompt_image_url": "https://artifacts.instill.tech/imgs/dog.jpg",
// "prompt_image_url": "https://storage.googleapis.com/public-europe-west2-c-artifacts/imgs/sample1.png",
"max_new_tokens": "300",
"temperature": "0.9",
"top_k": "30",
"random_seed": "42",
"extra_params": "{\"top_p\": 0.8}"
}
}
]
}