Live demo

Outpainting

Observe a field through a window. The backbone encodes the window alone, as one partition and so one embedding, and decodes the whole field from it, beyond what it saw.

Checking the server…
Observed window drag it over the input
Window shape
Window size
Position
Input a sample, your own image, or a painted field
The Daedalus outpainting and the ground truth appear here, with the observed window framed.
How it works

Decoding beyond the observed domain

Only the points inside the window are encoded, all of them into one embedding; the decoder then answers every point of the domain from that embedding, outside the window as well as inside it.
1

Observe a window

Only the pixels inside the window are given to the model; everything around it is hidden.

2

Encode the window

The window's pixels, an unstructured cloud of points, form one partition: they are normalized into its frame and encoded into a single embedding on the sphere.

3

Decode beyond it

The decoder is a function of the coordinate, so it can be asked about any point: every pixel of the image, inside the window and outside it, is decoded from the one embedding, which continues the field past the window's edge.

4

Compare

An interpolation cannot reach beyond the observed points, so the baseline repeats the nearest observed pixel. The peak signal-to-noise ratio (PSNR) is measured outside the window only.

The backbone was never trained to outpaint. A smooth field continues well from one embedding, since it describes a smooth function that does not stop at the edge of what was seen; a detailed field or a photograph does not, as nothing outside the window says what is there. The presets are smooth fields that one partition represents reliably.