Every painting is passed through a CLIP image model (ViT-B/32, open-source) that turns the picture into a 512-number vector capturing what it looks like (composition, palette, subject, handling), with no captions or labels involved. Two works are “similar” when their vectors point the same way (cosine similarity); that drives Visually closest and Painters nearest this work in each painting’s card.
This map lays all embedded works out in 2-D with t-SNE, so visually alike paintings land near each other. The dots can be coloured by painter, period or school, or by each work’s own dominant colour (the average of its pixels), captured while embedding. Painters nearest this work and the “If you like … try” chips average a painter’s vectors into one “fingerprint” and compare fingerprints.
Everything is computed offline and shipped as small precomputed files: the page itself runs no AI. Coverage grows as more works are embedded. Images © their sources via Wikimedia Commons.