Digital Extension Experiments
Added 2024-01-27 13:22:01 +0000 UTCDiving into a couple digital extensions! Basically any time I'm on set I'm my own VFX supervisor, and these are the types of compositing techniques I'm thinking about when I'm framing up the shot to hopefully avoid signing myself up for a big headache later in post :P
The one bit I gloss over is the initial 3d tracking and projection, mostly because I've already covered it quite a bit and I think I'll be covering it again really soon, but if you want to see me get into it:
Digital Extensions without Greenscreen
And a more whimsical (if older) one- Making Boring Places more Interesting.
Oh! And here's Nathan's fantastic Projector addon.
Comments
so basically you are compositing in the shader graph. It would be really cool if there was a way to subtract and plus the grain overtop completely in blender using this workflow
Paul Pierantozzi
2024-06-12 05:41:19 +0000 UTCOh see this is why I need to watch these videos in order. All my questions about the later video are answered in this one. Duh. Hang on while I go slip my head into a hole.
Phil South
2024-03-12 11:23:18 +0000 UTCI'm a bit late - but as for migrating the camera projected texture to the new secondary back-up texture I would've just done a texture transfer bake in Blender from the projected texture to the new texture, once at the beginning of the shot and another time at the end, and merge those. Should work, no?
Chromfell
2024-02-10 06:54:05 +0000 UTCoh god these 3D comp hacks with the luma channel blew my mind
Maxim Leo Diehl
2024-02-07 21:51:20 +0000 UTCMoney for cans! Like in Europe. And like the deposit the US used to have for bottles and cans. They ought to bring it back, it gives a great incentive to recycle!
Lukas Sprehn
2024-02-04 15:42:31 +0000 UTCyour phrasing of "hitting old blender" is so accurate lol, blender is super smooth and easy to use until you wanna do something unusual and then you uncover these strange archaic bits of it that are really unintuitive. Also, one way of dealing with the reflections could be to replace the puddles with an actual reflective material. Maybe draw a mask with texture painting or something. Could cause more problems than it solves but maybe it could also work well
Tardsmat
2024-02-03 21:13:20 +0000 UTCThat's actually simpler in my opinion, would it be more demanding in terms of computer resources ? Or is there no downside ?
Nathel Sunrider
2024-01-30 14:34:12 +0000 UTCBig thanks to Platyelf and LucKleuskens !! I'm working on 3.6LTS, so I fully removed the addon and the zip file, re-downloaded the 0.1.0 from github. Then I installed the addon and to be able to enable it I went to "C:\Users\*username*\AppData\Roaming\Blender Foundation\Blender\3.6\scripts\addons", and renamed the file from “camera_projector-0.1.0” to “camera_projector-0”, just as you said Platyelf ! Refreshed Blender, click "enable", then it worked and life is now more simple and beautiful ! Thanks for helping and thanks Nathan and Ian for the addon !
Nathel Sunrider
2024-01-30 14:24:34 +0000 UTClooks Like im having the same issue. in blender 3.6 its working. but not in 4.0. Edit: Seems like completely removing the addon, downloading the latest (same as 2 years ago i think :P) and installing fixed it for me.
Luc Kleuskens
2024-01-30 11:47:12 +0000 UTCgreat stuff ! You might have seen it, but Switchlight Studio has video normal extraction now for relighting from footage, maybe this could integrate nicely to further integrate / relight live action footage in your scenes. I quickly tried with the blender addon, and it's promising as you can animate lights in 3d space directly in Blender. Cheers !
Clément Jolivet
2024-01-30 10:13:09 +0000 UTCI managed to fix the problem by changing the file name for the addon from “camera_projector-0.2.0” to “camera_projector-0”
Platyelf
2024-01-30 00:01:28 +0000 UTCSame problem here, unfortunately :(
Ricardo Peixoto
2024-01-29 22:09:28 +0000 UTCAwesome! If you're really worried about lining up the texture to the view, you can always bake straight from the projected texture onto a clean one. You need to do it in a few steps though, so it's not necessarily easier.
Robin Squares
2024-01-29 10:48:18 +0000 UTCI feel like with this workflow somebody could make a mod of blender to be like an after effects alternative. If you modified the UI a lot and automated certain things.
Mark
2024-01-28 18:51:00 +0000 UTCI played with this for a few hours this evening. I had the best results with just replacing the water with an in-scene plane with a musgrave bump map. Didn't spend a ton of time on it, but it uses the same multi-plane luma-keyed silhouette technique. I may have to find one with a foreground to see how that would work. https://photos.app.goo.gl/S2KmZcf4hGhAGifP8
Mark Miller
2024-01-28 04:18:07 +0000 UTCLol. The version of your comment that came in my email notification was perfectly truncated, and I initially misunderstood. :)
Mark Miller
2024-01-28 03:48:22 +0000 UTCI'm in 3.6 LTS but had the same problem in 4.0 when I tried a month ago I think... I'll retry again but I don't have a lot of expectations anymore :') Thanks for your time !
Nathel Sunrider
2024-01-28 02:31:33 +0000 UTCNo that's it exactly- adding light TO the scene isn't toooo tricky in this case (I've got all those video textures of water reflections, hopefully they could line up a bit), but subtracting seems really tricky, even with luma keys and stuff. I'm always curious how folks do water extensions in movies! I need to experiment with it more in the next week!
Ian Hubert
2024-01-28 01:44:47 +0000 UTCKeep it coming Ian! Can’t get enough !
Luke Evans
2024-01-28 01:20:10 +0000 UTCOoo- which version of blender are you in??
Ian Hubert
2024-01-28 00:26:37 +0000 UTCYeah. I can't think of a way to do this well without separate view layers and the compositor, which takes you out of the whole "viewport as compositor" experience, but maybe if it's just filling in those reflections, it's fine. In a tripod scene like that, you could also just bake it.
Mark Miller
2024-01-27 21:22:56 +0000 UTCYou could mirror the buildings down along the y-axis, give them a material that makes them fade to transparency the further down they go. Make the water-layer slightly transparent and add some kind of blurry translucent plane between the water-layer and the building "reflections". Not sure how convincing that would look though.
skes
2024-01-27 20:41:32 +0000 UTClet’s go Nathan actually working at blender now, that’s so sick.
Sam Schippers
2024-01-27 20:31:35 +0000 UTCRather than painting in the texture I've used a different method where I just duplicated the projecting camera and moved it on to a frame where is covers the clipped texture. Clear all the keyframes and turn off refresh in the shader so it's just contantly projecting that one frame. Then same just add the texture from the moving projecting camera on top. If the geomtery is well lined up it should be pretty seamless and saves having to manually line up painting in the texture.
Peter Mackey
2024-01-27 20:02:50 +0000 UTCThis is a really fun one. The last scene at the water's edge really reminded me of old school Disney multi-plane stuff. Super-powerful "viewport as compositor" stuff. I was really hoping you were going to show some cool trick to make the building reflections in the water instead of just seeing the bright sky reflected there. Those kind of reflections seem like the hardest part of digital extensions across water.
Mark Miller
2024-01-27 19:34:27 +0000 UTCHey Ian ! Thanks a lot it's a lot of very useful informations again :o But I have a python error when enabling the camera projector addon where it tells me that at line 333 there's no module named "camera_projector-0"... I tried the two versions with no success. Thanks anyway for everything !
Nathel Sunrider
2024-01-27 19:14:16 +0000 UTCit's super cool you post more frequently now :)
Tomasz Zarucki
2024-01-27 14:08:55 +0000 UTCDope video //dope boy (yes,hes back)
alex
2024-01-27 13:24:05 +0000 UTCNice!!!
Kieron Estrada
2024-01-27 13:23:53 +0000 UTC
