Tag: model_hallucination

2 entries

Posts

VLMs Hallucinate

I've done some experimentation extracting structured data from documents using VLMs. A summary of one approach I've tried can be found in my repo, impulse. I've found using Protobufs to be a relatively effective approach for extracting values from documents. The high-level idea is you write a...

vlms model_hallucination
Logs

2024-07-31

I tried stacking multiple pages of a pdf vertically as a single image to a model, then doing data extraction from this. It didn't work. I imagine this is because models aren't trained on much data like this. The inference seemed to output made up data. Multiple studies have shown that...

vlms rst model_hallucination