Faking Vision(FV) is an experiment in making visual information available to blind, non-living things.
It started very practically: I was trying to turn an image into flat files containing its visual information. That led to a bigger question: could a flat-file representation be model-agnostic — so that different systems given the same representation would produce the same object inventory and spatial relationships?
The attached examples a image (last image) turned into flat files by AI and then generated into image by another AI (so a generator which runs FV analysis on an image and turns it into flat files and another AI renderer which can ingest the flat files with FV algo and return an image).
(More examples available on twitter thread. https://x.com/MemoryPrismV1/status/2093276351549833484 )
Then came the next questions:
Can the same approach describe video rather than a single image?
Can visual information from different sources be sewn, stitched or patchworked together — for example image data, spatial information, lidar-derived information, etc.?
And once visual structure is represented this way, what happens if we deliberately manipulate it?
That last question is where Faking Vision became particularly interesting.
The underlying principles came from another project of mine, Making Vision, where I worked out a basic framework for how a visual system can acquire visual structure, extract useful information, generate candidates, selectively promote things for deeper processing, compare current information with existing knowledge, and update what it learns.
https://www.memoryprism.com/readings/making-vision
Faking Vision is the practical counterpart: if those are some of the things a visual system needs to do, can I construct and manipulate the information supplied to a blind system so that it can perform those operations?
I have been developing the flat-file representation, algorithm and testing process myself.
Now I need something I don't have:
models.
I want to test this with actual video-capable vision models, preferably several different ones, rather than build the experiment around a single system.
I'm not looking for someone to develop the project or explain computer vision to me. 😄
I have the experiment.
I have the process.
I have test material.
I need models to poke.
If you have access to a video-capable model/API/research system and would be willing to let me run some controlled test material through it, please come talk to me.
I have more examples here:
https://x.com/MemoryPrismV1/status/2093276351549833484