Cyberpunk 2077 Gaussian Splat (Video Game Splat Test)

This is the scene referenced in our Gaussian Splat tutorial on YouTube. In this example, we used OBS to screen record the car in game from 360 angles, then trained the splat in Postshot, then import in After Effects with the Gaussian Splatting plugin, and then animated to have the explosion and camera turn around effect. Overall I think this effect came out well.

I'll be posting the splat files in another post soon. The files are a little large so I'm figuring out the best storage method. Thanks for your patience!

Link to Gaussian Splat tutorial: https://youtu.be/Xn4h0vJ-wYQ?si=xb-qaLD73O1AoBeR

Breaking Down the Gaussian Splat Process for Game Footage

1. Recording the Scene with OBS

The first step involved capturing footage directly from Cyberpunk 2077. We used OBS (Open Broadcaster Software), a popular screen recording tool, to record the in-game car from multiple angles—360 degrees in every direction, as best as we could. The goal here was to capture every possible perspective of the object so that we could later manipulate and animate it as needed in post-production.

Using OBS allowed us to maintain high fidelity in the visuals while providing a seamless way to gather the raw footage needed for the splat training.

2. Training the Splat in Postshot

Once we had the footage, we trained the Gaussian Splat in Postshot, a technique that breaks down complex animations into manageable data points—creating a splat representation of the scene. Essentially, the splatting method maps the depth and texture of the car model, allowing us to reconstruct it with dynamic lighting, perspective shifts, and depth effects.

Gaussian Splatting is incredibly useful when working with objects in 3D environments. Rather than animating frame by frame or using high-resource-consuming 3D models, this method allows for a “cheat” in creating 3D-like effects that are both efficient and visually striking.

3. Importing into After Effects for Animation

After the splat data was trained in Postshot, we imported it into After Effects using the Gaussian Splatting plugin. The flexibility of After Effects combined with the splat data meant we could animate the scene with much more freedom, allowing for dramatic camera movements and explosive effects with minimal lag or rendering issues.

For this test, we applied an explosion effect and timed it to occur as the camera rotated around the car.

Why Gaussian Splatting Matters for VFX Artists, Game Designers, and Everyone Else!

Gaussian Splatting is more than just a niche technique for visual effects enthusiasts—it's part of a broader movement towards more efficient, data-driven animations. In traditional VFX workflows, animating 3D objects with realistic depth, lighting, and perspective requires significant computational power and time. Gaussian Splatting offers a faster, more efficient solution by relying on the “splat” method to create 3D-like depth without all the overhead of detailed 3D models.

This approach not only speeds up the workflow but also opens the door for more creative freedom. Effects like explosions, scene transitions, and complex camera moves are easier to execute, allowing artists to focus on the creative aspects of animation rather than the technical limitations. Oooo and don't get me started on 4D Gaussian Splatting, that's for another day.