aiphotosbooth

Updated

HOW THE BACKDROP SWAP WORKS

Step out of
the room.

Every backdrop swap starts by deciding which pixels are you.

Old booths did it with a sheet of bright green. Newer ones use software trained on tens of thousands of cut-out photos. Both are making the same thing: a matte that says how much of each pixel belongs to the person in front.

CUT OUT pixel by pixel

Check your shot
A party photo booth with a camera on a tripod and a soft ring light facing a plain backdrop, with a guest seen from behind stepping into place
AI-generated image, not a photograph of a real person or place.
  • Colour keys need a clean backing
  • AI mattes guess from shape
  • Hair is always the hard part
  • One matte, two ways to make it

THE SHORT ANSWER

A mask that
knows the edges.

The booth never sees a person.
It sees pixels, and estimates which ones to keep.

COLOUR KEY

The green screen way

Every pixel close to the backing colour is made transparent. Green and blue are used because they differ most in hue from human skin.

What trips it up

AI MATTING

No screen needed

A neural network looks at the whole photo and predicts an alpha matte: a value for every pixel from fully background to fully you.

See the numbers

EDGES

Why hair is hard

Fine or frizzy hair lets the background show through, so edge pixels are part person, part room. Both methods struggle there.

Get a cleaner cut

A QUICK SHOT CHECK

What is behind
you and on you?

Pick a situation to see how likely it is to leave a messy cutout. The bar shows how hard the scene makes the job.

Shot check

Choose a situation
Plain backing, unlike your clothesClean cut

The easiest case. The most important factor for a colour key is a clear colour difference between the subject and the backing.

Shadows or a shiny backdropPatchy edges

A shadow reads as a darker colour and may not be replaced. Shiny fabric reflects light unevenly; a matte surface gives a more even colour range.

Fine or frizzy hairSoft, fuzzy edge

Fine detail such as frizzy hair may not resolve properly, and partly transparent things like sheer fabric cause problems too.

Busy room in colours like yoursHard for AI

The Deep Image Matting authors note that earlier methods did badly when foreground and background colours were similar or textures were complicated.

Green top on a green screenYou vanish

Anything that matches the key colour is treated as background and replaced, which is how presenters in the wrong colour can seem to disappear.

Sources: Wikipedia, Chroma key (lighting, clothing and tolerances sections); Xu et al., Deep Image Matting (CVPR 2017).

Based on how chroma keying and image matting are described in the sources below. General information about how the technique works.

TWO NUMBERS WORTH KNOWING

Taught on photos,
fast enough for video.

One figure on how matting models learn,
one on how quickly a newer one runs.

49,300 images

Images in the Deep Image Matting training set

The 2017 Deep Image Matting paper built a large dataset of 49,300 training images and 1,000 test images to teach a network to predict alpha mattes.

TRAINING DATA · CVPR 2017

67 frames/s

Portrait matting, single photo, no green screen

MODNet, a trimap-free portrait matting network, ran at 67 frames per second on a 1080Ti graphics card, from a single input image.

SPEED · MODNET

Earlier matting networks needed a trimap, a rough hand-drawn map of sure foreground, sure background and unknown edge. Removing that step is what lets a booth cut people out automatically.

FOUR THINGS THAT HELP

Help the software
see your outline.

Whether the booth uses a screen or a model, the same few habits make the edge easier to find.

  • Avoid the backing colour

    On a green screen, skip green clothes and accessories; anything that colour can be keyed out with the background.

  • Stand away from the backdrop

    Light reflected off a coloured screen tints the edges of the subject, known as spill. A bit of distance reduces it.

  • Keep the light even

    Even lighting with no shadows on the backdrop keeps the colour range narrow, so the key is cleaner.

  • Give the AI a contrast

    Matting models find edges more easily when you do not blend into the room behind you in colour or pattern.

An empty studio corner with a smooth green screen lit evenly by two large softbox lights
AI-generated image, not a photograph of a real person or place.
Fine, backlit strands of curly hair against a bright green fabric backdrop, seen close up
AI-generated image, not a photograph of a real person or place.

WHERE IT CAME FROM

From a genie
to the party booth.

A scene of a genie escaping from a bottle in The Thief of Bagdad (1940), credited to Larry Butler, was the first use of a proper bluescreen process for a travelling matte. In the early 1970s, US and British television began using green backdrops instead of blue.

The digital alpha channel was introduced by Alvy Ray Smith and Ed Catmull in the late 1970s, and a 1984 paper by Thomas Porter and Tom Duff set out how to combine layers with it. AI matting still produces that same kind of per-pixel matte.

Questions

Questions people ask

Why are green screens green?

Green and blue differ most in hue from human skin. Television moved from blue to green partly because presenters often wore blue, and green clothing is less common.

How can a booth remove a background without a screen?

A neural network is trained on many cut-out photos and learns to predict an alpha matte from the image itself. Background Matting (2020) took a different route: an extra photo of the empty background.

What is an alpha matte?

A greyscale map with a value for every pixel, from fully background to fully foreground. Values in between let hair and soft edges blend into the new backdrop.

Why does my hair look cut off?

Fine strands let the background show through, so edge pixels are a mix of you and the room. Chroma key sources note that frizzy hair may not resolve properly, and matting research focuses on these edges.

What is a difference matte?

A colour key that uses any still background: the empty scene is captured first and then subtracted. Objects that resemble the background can be removed by mistake, and camera noise can leave patches.

References

  1. Wikipedia: Chroma key (history, process, lighting and clothing)
  2. Wikipedia: Alpha compositing (history of the alpha channel)
  3. Xu, Price, Cohen and Huang: Deep Image Matting (CVPR 2017), arXiv
  4. Sengupta et al.: Background Matting: The World is Your Green Screen (CVPR 2020), arXiv
  5. Ke et al.: MODNet, Real-Time Trimap-Free Portrait Matting, arXiv
  6. Ronneberger, Fischer and Brox: U-Net, Convolutional Networks for Image Segmentation (MICCAI 2015), arXiv

ABOUT THIS NAME

Interested in leasing aiphotosbooth.com?

aiphotosbooth.com is part of the DoodleSale portfolio. It isn't in an auction right now, but you can ask about leasing it.

Ask about this name