THis is a great piece of code for using on the command prompt with Llama.cpp. That also means you can throw it into.
Find the models here: https://huggingface.co/concedo/llama-joycaption-beta-one-hf-llava-mmproj-gguf
or
https://huggingface.co/Jobaar/Llama-JoyCaption-Alpha-Two-VQA-Test-1-GGUF/tree/main
Be sure to download the mmproj file as well
java or python code for use in your apps! Great way to give your bots "eyes".
llama-mtmd-cli.exe --model <gguf-model-location-on-pc> --mmproj <gguf-mmproj-model-on-pc> --image <location-of-image-on-pc> --prompt "Print out the text in this image"
Leave a Reply