Blog / VFX Techniques

Before and After: How Compositing Transforms Raw Footage

Sourav Chatterjee Sourav Chatterjee
10 min read

There’s a gap between what most people think compositing is and what it actually does. If you’ve never worked closely with a VFX team, you might picture compositing as green screen work, placing an actor in front of a different background. That’s part of it. But it’s a bit like describing surgery as “cutting things.” Technically accurate. Wildly incomplete.

Compositing is where every element of a visual effects shot gets assembled into a single, cohesive image that looks like it was captured by a camera in a real place. The raw ingredients might include live-action plates, CG renders, matte paintings, rotoscopy mattes, particle effects, and color corrections. The compositor’s job is to make all of those pieces feel like they belong together, to the point where the audience never questions what they’re seeing.

Great compositing starts with solid matchmove and tracking. Without accurate camera data, CG elements won’t sit convincingly in the scene, and no amount of color correction or edge refinement will fix that disconnect.

The best way to understand what compositing actually delivers is to look at the transformation itself. What does the client hand over, and what do they get back? Let’s walk through six categories of compositing work that represent the bulk of what professional studios deliver.

1. Sky Replacement: Controlling What Nature Won’t

What the client provides: Exterior footage shot across multiple days where weather and sky conditions are inconsistent. A sunset scene where the sky was overcast on the shooting day. An establishing shot of a city where the sky is blown out and featureless.

What they get back: Shots with consistent, dramatic, or story-appropriate skies that match across the entire sequence. Natural cloud movement, proper atmospheric perspective, and light interaction between the new sky and the existing environment.

Why it’s harder than it looks: A sky isn’t just an image pasted above the horizon line. It’s a light source. When you replace a sky, the color temperature and intensity of the ambient light needs to feel consistent with the new sky. A warm golden-hour sky over a scene that was clearly lit by flat overcast light will look immediately wrong, even if the viewer can’t articulate why.

Good compositors handle this by adjusting the color grade of the foreground elements to match the lighting conditions the new sky implies. They’ll add atmospheric haze at the horizon where the sky meets the environment. They’ll ensure that reflective surfaces, water, glass, car hoods, pick up the new sky appropriately. And they’ll track the sky replacement to any camera movement so it feels locked to the scene.

Productions use sky replacement constantly. It’s one of the most cost-effective VFX interventions because the alternative, waiting for perfect weather or scheduling reshoots, is exponentially more expensive than fixing it in post.

2. Set Extension: Making Small Builds Feel Massive

What the client provides: Footage shot on a partial set or location that only covers what’s directly in front of the camera. A period drama filmed in a warehouse with one wall dressed as a Victorian interior. An action sequence shot in a parking structure that needs to look like a military facility.

What they get back: Shots where the environment extends seamlessly beyond what was physically built, complete with architectural details, appropriate lighting, depth of field, and atmospheric effects that sell the scale.

Why it’s harder than it looks: Set extensions fail when they feel like paintings hanging behind the actors. The key challenge is depth. Real environments have parallax, objects at different distances that shift at different rates as the camera moves. A flat matte painting won’t exhibit parallax, and audiences register the flatness even if they don’t consciously identify the problem.

Professional set extensions are built with multiple depth layers, or full 3D geometry projected with textures, that respond naturally to camera movement. The compositor then integrates these elements with the live-action plate by matching grain structure, lens characteristics (chromatic aberration, vignetting, depth of field), and the subtle imperfections that make digital imagery feel photographic rather than synthetic.

The before and after on a set extension is often the most dramatic transformation in a VFX breakdown. A shot that on set looked like actors standing in front of a partial wall becomes a full environment that supports the story’s world.

3. Wire and Rig Removal: Erasing the Mechanics of Filmmaking

What the client provides: Footage of stunts, practical effects, or suspended props where the support systems are visible. An actor on a wire harness performing a fight sequence. A car suspended by a crane for a crash shot. Tracking markers covering an actor’s face for performance capture reference.

What they get back: Clean shots where every wire, rig, marker, and piece of visible equipment has been removed without disrupting the natural movement and texture of the scene.

Why it’s harder than it looks: Removing a wire sounds simple: paint it out and fill in what was behind it. But wires move against complex backgrounds. They cross over skin, hair, fabric, and out-of-focus areas. They create subtle shadows and reflections. And the area behind them needs to be reconstructed frame by frame in a way that maintains the texture, movement, and lighting of the original scene.

When a wire crosses an actor’s body during movement, the compositor needs to reconstruct the body surface behind it while preserving the natural motion. When a wire crosses a detailed background, the fill needs to match the surrounding detail without repeating patterns or creating artifacts. It’s meticulous, frame-level work, and on a stunt-heavy production, there might be hundreds of these shots.

The clean version should look like the wire was never there. Not “we painted something over it,” but “there was never anything to paint over.” That distinction is the difference between cleanup that holds up on a cinema screen and cleanup that looks like a Photoshop job.

4. Character Integration: Placing the Digital Into the Real

What the client provides: A live-action plate shot with stand-ins, reference objects, or empty space where a digital character or element will be placed. CG renders of the character from the 3D department, typically delivered as multiple passes: beauty, specular, reflection, shadow, ambient occlusion.

What they get back: A finished shot where the CG character exists convincingly in the live-action environment, casting appropriate shadows, affected by the scene’s lighting, interacting with real objects, and maintaining proper depth relationships with everything around it.

Why it’s harder than it looks: The human eye is extraordinarily sensitive to faces and body movement. Even subtle errors in how light falls on a CG character, or how a shadow grounds them in the scene, will trigger an uncanny valley response. The compositor’s job is to bridge the gap between the technically correct CG render and the messy, imperfect reality of the live-action plate.

This means adding lens effects that the CG render won’t have by default: bloom on highlights, chromatic aberration at frame edges, subtle motion blur that matches the plate’s shutter characteristics. It means adjusting the CG lighting to match not just the overall scene illumination but the specific quality of light in that moment, the color bounce from a nearby wall, the soft fill from an overcast sky, the directional shadows from practical lights on set.

Contact shadows are critical. When a character stands on a surface, the shadow where their feet meet the ground is what sells the contact. Get it wrong and the character floats. Get it right and the audience never questions the integration.

For film and TV productions that rely heavily on CG characters, the compositing stage is where the performance either lives or dies on screen. The 3D department can deliver a technically perfect render, but without skilled compositing, it won’t feel real.

5. Color and Mood Transformation: Reshaping the Emotional Tone

What the client provides: Footage that was shot under conditions that don’t match the story’s emotional beat. A tense night scene shot during magic hour for safety reasons. A romantic sequence filmed on a dreary day. Footage from different shooting days that needs to feel like a continuous scene.

What they get back: Shots where the color, contrast, and atmospheric quality have been transformed to match the intended mood, with consistency across the entire sequence regardless of when each shot was actually filmed.

Why it’s harder than it looks: Color correction and color grading exist at the editorial level, but compositing-level color work goes deeper. It’s not just applying a LUT or shifting the overall color balance. It’s selective, layered manipulation that treats different elements of the frame differently.

A day-to-night conversion, for example, requires darkening the overall image while maintaining visible detail in shadow areas. Practical light sources in the frame, street lamps, car headlights, windows, need to become the dominant light sources, which means creating light spill, glow effects, and appropriate falloff that wasn’t present in the original plate. The sky needs to become a convincing night sky. Reflective surfaces need to respond to the new lighting conditions.

The result should look like the scene was shot at night with proper lighting. Not like someone turned down the brightness on a daytime shot. That distinction requires compositing craft, not just color tools.

Sequence consistency is equally demanding. When shots in a conversation were filmed hours or days apart, the light conditions are different in each one. The compositor needs to normalize these differences so that cutting between shots feels continuous. Skin tones, background exposure, highlight color, shadow density, all of it needs to match closely enough that the edit flows naturally.

6. Invisible Fixes: The Work Nobody Notices

What the client provides: Footage with problems that weren’t apparent on set but became deal-breakers in editorial review. A boom mic dipping into frame. A crew member’s reflection in a window. Equipment visible at frame edges. Continuity errors between takes: a prop in a different position, a costume change that wasn’t caught, a clock showing the wrong time.

What they get back: Clean shots where every distraction has been removed and every continuity issue has been resolved, so seamlessly that nobody watching the finished film would ever suspect the corrections were made.

Why it’s harder than it looks: Every invisible fix requires the compositor to create something that wasn’t captured by the camera. When you remove a boom mic from the top of frame, you need to extend the ceiling or sky that was hidden behind it. When you paint out a crew reflection, you need to fill the glass with a convincing reflection that matches the scene. When you fix a continuity error, you need to alter the object without disrupting the surrounding detail or the natural motion of the shot.

These fixes are often dismissed as “simple cleanup,” but they represent some of the most technically demanding compositing work. The margin for error is essentially zero. If the fix is visible, it hasn’t worked. The audience should never have a reason to look twice at the area where the correction was made.

Cleanup and paint work at this level requires artists who understand how surfaces, light, and movement behave well enough to recreate them from scratch. It’s not filter work. It’s digital craftsmanship applied one frame at a time.

What Compositing Actually Delivers

Across all six categories, there’s a common thread: compositing takes what production captured and transforms it into what the story requires. Sometimes that transformation is dramatic, a bare soundstage becoming a complete environment. Sometimes it’s invisible, a wire removed so cleanly that nobody on the post-production team can identify which shots had rigs.

The value of professional compositing isn’t in any single technique. It’s in the judgment to know which techniques a shot needs, the skill to execute them at a level that holds up on a cinema screen, and the pipeline discipline to do it consistently across hundreds of shots without quality variation.

For production teams evaluating VFX partners, compositing quality is the ultimate test. It’s the last stage in the pipeline, which means it’s where every upstream decision becomes visible. A studio with exceptional compositing can elevate decent 3D renders into photorealistic shots. A studio with weak compositing will undermine even the best assets.

We’ve built our compositing pipeline around delivering exactly the kind of transformations described here, shot after shot, at a consistency that production teams can rely on. If you want to see how that looks in practice, we’re always happy to walk through examples from our work and show you the before and after firsthand.

Common Questions

Questions readers ask after this post.

What does compositing actually do beyond greenscreen?
Compositing is the integration craft that combines plates, CG, matte paintings, simulations, and clean elements into final frames. Greenscreen extraction is one technique inside compositing; the broader craft includes mood changes (lighting and color treatments), content updates (refreshing existing footage with new elements), background swaps, set extensions, screen replacements, beauty work, and stylized aesthetic blends.
What are the most common compositing transformations on commercial work?
Mood changes (time of day, weather, atmosphere), content rehashing (refreshing legacy spots with new product or branding), background swaps (transporting talent to a different environment), screen compositing (phone screens, monitors, billboards), stylized aesthetic work (surreal or genre-specific looks), and set extensions (expanding limited practical sets into larger environments). Each has its own pipeline considerations.
How do you tell if a shot needs compositing or just color grading?
Color grading shifts the look uniformly across the frame; compositing replaces or alters specific elements within the frame. If the brief is 'make this scene feel cooler and moodier' that's a grading note; if it's 'replace the building behind the actor' that's compositing. Some shots need both — compositing handles the element change, grading unifies the look across the sequence.
Sourav Chatterjee

Sourav Chatterjee

Founder, FXiation Digitals

Over a decade in VFX production, leading FXiation Digitals across compositing, 3D, and visual effects for studios in 15+ countries.

Need VFX for your project?

Get a free consultation from our team.

Get a Quote