Vision Models
Caption and describe images with Gemini or OpenAI vision providers during ingest.
What is it?
Vision providers that produce captions, descriptions, and entities from images, merged into ingest text before chunking.
Why does it exist?
OCR reads glyphs; vision models explain what an image means — charts, UI layout, diagrams.
How does it work?
import { geminiVision, openaiVision } from "wolbarg";
vision: geminiVision({ apiKey: process.env.GEMINI_API_KEY! })
// or
vision: openaiVision({ apiKey: process.env.OPENAI_API_KEY! })OCR text, captions, descriptions, and entities are concatenated before chunking. Configure either or both providers.
When should it be used?
Charts, product photos, and UI screenshots where labels alone are insufficient. Prefer OCR-only for dense text scans to save cost.
Performance notes
- Vision calls dominate ingest latency for images
- Cache originals outside Wolbarg if you re-process often