Region similarity

About

A vision model describes every region of an image with a long list of numbers, its features. Two regions get a high similarity score when their features are large and point in the same direction (their dot product). The lines connect the pairs of regions with the highest scores, so you can see which parts of two images the model considers alike. Thicker, brighter lines mean more similar. Everything runs in your browser, and your images never leave your device.

How to use

• Change image picks an example or an image from your device for each side.
• Point at a region, or move to it with Tab and the arrow keys, to see its strongest connections to the other image.
• Click regions (or press Enter) to select them: the lines then start only at the selected regions, until you clear the selection.
• Connections sets how many lines are drawn; Model switches the model, which is downloaded when you select it.

See also the LaFAM demo, which shows where a vision model looks.