The Stabilize node applies the exact opposite transform to your footage, so it will make your footage look like it’s standing perfectly still. We do this in exactly the same way as before. First, I will show you what happens if we try to track the boat without using layers. I will rename this layer post. That track looks very nice and is sticking very tightly to the ground. I can also see that there’s not much change in perspective of the front of the boat over the course of the shot. Let’s now close these property panels to get a better view. We will start by drawing a shape to mask out the logo, being careful to draw it inside the Root layer. In fact, the Roto node is essential for the PlanarTracker to work, so always try and keep them connected. Internally, each correction keys an offset which allows smooth interpolation of the tracking data. To do this, I need to define where in the image I want the logo to be placed and then export my track data. In these cases, it can be much easier to use a luma or chroma key to specify what areas you want to track, and Nuke’s PlanarTracker lets you do just that. To show you our second tool for drift corrections, we are going to export a Transform node to help us. For our setup, we are going to select Mask Inverted Alpha. Hi, I’m Dan Ring and welcome to the fourth tutorial on Nuke’s PlanarTracker. In this shot, I want to track this window here, but I know that the window is difficult to track because of the reflections, motion blur, and lens distortion. Notice that I am moving the planar surface on the reference frame, and remember that any changes I make to the planar surface on the reference frame ripple throughout the shot. This means that we can lock the planar apparent motion type to T + Scale, meaning it will only track changes in translation and scale, and usually results in a much better track. Particularly, if you look to the top right or the top left of the planar surface. This is the exact opposite of what would normally happen. If we want, we can use the grid to help us line up our corners. The compositing power of NukeX, plus the multi-track editorial timeline of Hiero, allowing you to confirm, review, edit, and even create and render compositions from the timeline. This means anything we put in the layer will be affected by the track. This concludes our first tutorial on the PlanarTracker. Once it is created, we can start drawing the area we want to track straight away. We can also create whole new track layers, ready for drawing and tracking. Better still, we are going to track the cable and use the track as our holdout. We can also turn on display grid lines to help us line up the window perfectly. To start, we need to assess the damage. This will automatically connect the CornerPin and select the correct image format. We will get rid of the drawing handles and see how that track went. We want to track the front of this boat in order to put a logo onto it, but if we look through the shot, we can see it becomes occluded by the suspension cable. As you can see, the logo is sticking very tightly to the back of the panel. So that track looks pretty good. Notice the planar surface changes to a cyan color when it has a keyframe. Instead of using the node menu to create a PlanarTracker, we are going to start with a Roto node and draw the shape of the area we want to track. This means we can lock our planar apparent motion type to TSR + Shear. We also have a Primatte node that I have already set up to pull a chroma key, and an Expression node for some hard cleanup. I will start tracking and I will show you what I mean. I’m going to speed up the recording to save time. This is now tracking much better in the middle of the shot, but if we look at the beginning, there seems to be something funny happening. Speed up your workflow by learning to set up your 3D scene once and use it for all of your … If you look at the logo, you can see a lot of features are being tracked here and are biasing the track. I am also going to lock the tracking Bezier so we don’t accidentally select and move its control points. Before we export an absolute, we can save ourselves some time by selecting the Read node and then clicking the export button. I am very happy with that track. This does not need to be perfect, it just needs to be on the floor somewhere. Now, remember in the previous tutorial I mentioned the concept of a reference frame, internally the transforms and other frames are calculated relative to the reference frame. This is a common problem in tracking panning shots, where using the additional input of the PlanarTracker is very useful. Lots of video tutorials showing how to use the tools provided. We can do this from our toolbar, again, making sure the post layer is selected. Now, what I would like to do is insert this Nuke logo into our post track. Hi, I’m Dan Ring and welcome to the fifth tutorial for Nuke’s new PlanarTracker. Now, if we scrub along we can see that looks much better. Nuke helps you create binge-worthy content. Right click anywhere you want to be tracked in the footage and select Tracks > Seed track Fixes introduced for Nuke 11.x compatibility caused a regression that resulted in a failure to properly initialize SGTK when a File->New or File->Open operation was performed from an already running session of Nuke. Let’s clear the drawing handles and play this on a loop so we can see the comp better. This is exactly what we want. In this case, absolute means the input image will be fit into the bounds of the planar surface. Inside of Nuke there are many tools to achieve any particular goal. When we are done, we can click the Track Forward button and watch it track to the end of the shot. PowerMesh dense tracking data can be exported to Adobe After Effects (via Nulls) or choose the new Alembic universal export to support Foundry NUKE, Autodesk Flame, Blackmagic Fusion and 3D applications like Cinema4D or Maya. In this tutorial, I’m going to demonstrate how you might do some rig removal, using planar tracking and a background plate. To give the features on the boat a decent buffer zone, and I am going to rename the layer to cable. This will hide all of the drawing overlays and make it easier to see our track. Things like walls, ceilings, and sides of cars are good examples of planar surfaces, but it can also handle non-planar surfaces, such as faces or people -- generally, the more planar the surface, the better. Using this camera as a projector, project the face onto generic head geometry. In summary, we found no better software than Foundry Nuke Studio 11 for advanced node-based compositing, 3D tracking, and model building. In this tutorial I’m going to show you how to use additional inputs in planar tracking. — 15 days trial: GeoTracker, FaceBuilder and FaceTracker will work with no restrictions for two weeks without a license, so you have plenty of time to try them before purchasing a license.All other nodes are completely free. v0.8.4. In this tutorial, we’re going to look at tracking multiple layers. The models can be user for likeness sculpting, animation, tracking or anything else in Blender; facial tracking with FaceTracker in Nuke; and surely you can just export it for further modifications in any other 3D software. This is a context-sensitive toolbar to let you perform your entire tracking workflow from left to right, for example, tracking, display, and correction, and export, all without having to go back to any node properties panel. So when you are at the reference frame, there is essentially no transform being applied. This already makes drift much easier to see and is perfect for most cases. If we turn on the display tracks button, we can see why. The easiest way to do this is to select the new track layer from the layer selected, and then just start drawing. You can see the Roto shape moved with the correction. To become a member of the Netflix Post Technology Alliance, Nuke underwent rigorous evaluation to make sure it met the Netflix technical and workflow requirements needed in the post production and delivery of Netflix Originals. Straight away, we can see that the cable wipes out the track. Here, I’m reigning in the surface, which tells the PlanarTracker to care only about the transform relative to the floor and not the entire scene. This is a special type of menu that is used to define what is being tracked. We are nearly ready to track, but first we are going to set up our export node, so we can see the results as we are tracking. Notice that the shape outline is colored purple to indicate it is in a track layer and will be used to define a region. At the forefront of this art form is The Foundry’s Nuke : an advanced and sophisticated node-based … Discover how to use 3D tracking data to add 3D objects to a 2D shot in Nuke. Again, we have used some extra nodes for cleanup. Let’s put this track on a loop so we can see exactly what's happening. I will also show you how to use additional track layers to create holdouts for tracks. This also means our Roto shape needs to have been drawn at frame 382, which I have already made sure to do so. Nuke Studio gives supervisors & artists more creative control. From chroma keying to advanced tracking and placement, compositing is all about marrying the creations of several artists into a final and cohesive work. We will start from the beginning and work our way to the end. Now we can make an observation here that will help our tracking. To see how the track went, we can display and move our planar surface on the reference frame, and then scrub through the timeline. We’ve introduced new export options, allowing users to export tracking data from the GripWarpTracker node to a Tracker (baked), a Tracker (linked) or a Transform node. To see our composite, we connect this input up to our clean plate, and we merge it with our original shot. If we look at the sides of the boat, we can see they are roughly on the same plane as the area we want to place our logo. We connect that up, and we create our Merge node as usual. As we want our logo to appear in this frame here, we are going to select our Read node, and then select CornerPin2D (absolute) and, as usual, we create our Merge node. Rig Removal & Hold-Out Layers - Planar Tracker Tutorial from Foundry on Vimeo. We can tweak it in, and it’s good to go. Let’s look at the planar surface to see what’s going on. You can see as we make a correction the Stabilize re-snaps the transform back into place. Now let’s try something more difficult. The first is the center planar surface button, which locks the Viewer to the center of the surface. Right, so the tracking is finished, and if we scrub back and forth across the timeline, we can see it has done a very good job. Going back to our original shot, we have set up our PlanarTracker in exactly the same way. Using Nuke's camera tracker to track the forehead the moment of the camera relative to the head can be derived. Correcting Tracking Drift - Planar Tracker Tutorial from Foundry on Vimeo. That Tracker is ready to use, but first let’s go over what happened. Tracking Multiple Layers - Planar Tracker Tutorial, Rig Removal & Hold-Out Layers - Planar Tracker Tutorial, Tracking with Chroma-Keys - Planar Tracker Tutorial, Correcting Tracking Drift - Planar Tracker Tutorial. To do that, we create a new track layer. Hello, my name is Dan Ring, and in this tutorial I’m going to show you how to use the new PlanarTracker found in Nuke 6.3. Clicking the export button, you can see there are lots of options depending on what format you would like. In our example, we drew a shape for the top of the post. This is different from the way you may create a regular holdout in the Roto node. December 11, 2013. nuke tracking; ... Anand Magaji demonstrates everything yo unwed to know, covering the basics of tracking in Nuke, including Nuke’s auto-tracking feature, manual user-tracking, and assisted user-tracking. Originally posted on 26 July 2017. Replacing screens with virtual ones, or extending sets, are common planar tracking tasks. In addition to geotracking and layout with GeoTracker and PinTool, the course covers shading and compositing inside of Nuke, until the shots are fully completed. Normally, you would expect the planar surface to drift away from the window. Then, to create a track from within the Roto node, we simply right-click the shape and click planar-track this shape. The best plugins and scripts for 3D, VFX and motion graphics software including Adobe After Effects, Cinema 4D and Premiere Pro. There are various 3D tracking software such as PFTrack, boujou, Syntheyes, 3DEqualizer and After Effects own built-in camera tracking, I personally prefer Camera Tracker as it integrates well in NukeX for seamless compositing (which Nuke supports … For example, because our cable layer is above our boat layer, the boat shape will have the cable shape removed from it. Another nice thing about this is that if the logo were moving, we could simply track it first because it’s in a tracking layer. Notice that only the blue sky and cloud regions are being tracked. We want to make certain that our track is good, and not just in those four corners, but in the center of the track as well. We can see here that there is a nice blue sky here with clouds, which would be perfect to pull a chroma key from, and this is exactly what we have done with the Primatte node here. This looks like a pretty reasonable track and, importantly, it covers most of the overlap area between the cable and the boat. This is particularly useful on flat, featureless surfaces, such as the cable. So now our holdout track is done, let’s go back and re-track our boat layer. To solve this, we need to hold this logo out from the shot. Features of The Foundry Nuke Studio 12 I’m going to start by demonstrating just how quick and easy it is to create a planar track, and then go into some of the basics of the PlanarTracker. In this first part I show you the basics of tracking, including auto-tracking, manual user-tracking, assisted user-tracking, scene orientation + scaling and finalizing your track. We now connect the PlanarTracker node’s Mask input to the Expression node, and we’re now ready to track. I’m going to rename the layer floor. This means that the transform at this point is extreme compared to the reference frame. SynthEyes is a great tool that is available to help with stabilizing 360-degree shots and … We also have a clean plate of the floor that a kind artist has drawn for us. Scroll down for news of the commercial release. As it’s not moving, we don’t need to do anything else with this track layer. This has two implications: one, that we are going to supply an alpha channel on the PlanarTracker node’s Mask input, and two, that by saying inverted mask, our track region will be specified where the pixel’s alpha is 0. Scrubbing through the timeline, we can see the track is slipping more and more as the track goes on. We actually have two tools to help us see and correct for drift. 2017-Aug-17. With the PlanarTracker, you use it to specify what areas you want to include in the track, whereas in the CameraTracker, you use it to exclude regions. Here, I am drawing as much of the floor as I can and just a tiny bit extra. I will also add a small amount of motion blur to the CornerPin for effect. To see the results of all our drift corrections, let’s move the corners of our planar surface back to their original positions in the window, and then view the track info. For example, let’s go to the last frame and move the right top-hand corner. Scrubbing through the timeline we can see that the track for this point is actually quite good, however, around frame 35 -- just after the middle -- we can see that it starts to drift slightly downwards. 2017-Aug-15. In this inverted space, you can actually see the window drifting away from the planar surface. In this shot, we want to track the top section of this post here. Now, that track of the sky looks really solid, and you can see how easy it was to specify the track region using a chroma key instead of using roto shapes. You can see that, this time, the track is perfect. In this shot, we have a very slow pan from the sky to the ground. This means we don’t want to create an absolute CornerPin node, we actually want a relative CornerPin node. Sometimes it happens that you may need to change your reference frame, for example, if an artist drew a Roto or made a clean plate for a frame other than your reference frame. Now let’s put our logo on. Let’s do that now. The Dilate node here is very important. We now go back to our reference frame and adjust our planar surface to where we want to place our logo. We will also move it to a sensible place in the Node Graph to make it look a little less messy. I first make sure my post layer is selected, and then I click the correct plane button. Now, this track is starting to look a lot better, just apart from this logo here sneaking in. Here it’s difficult to draw a shape in the first frame that will still exist in the last frame. 22:22 3D Tracking, Compositing, GeoTracker, Nuke, Tracking, VFX [ #Nuke #Compositing ] GeoTracker is a Nuke node for model-based single view object and camera tracking. I will rename this layer holdout. Thankfully this is easy to fix. It helps expand the alpha channel pixels, so we don't have any features being tracked on the cranes. Align the head mesh so that the features of the projected face line up with the nose, eyes and mouth of the geometry. This means you get a much more stable and accurate track compared to traditional 2D pattern trackers. ^Here is the motion graphic element viewed from another camera angle in After Effects. Layers to create a regular holdout in the scene a shape for the top left of the surface! A time input of the overlap area between the cable a little less messy tracking in nuke 11. Graph to make it look a little bit center planar surface to where we want a relative CornerPin,. Buffer zone, and then I click the set current frame to reference frame more about PlanarTracker. Strange frames tools provided fifth tutorial for Nuke’s new PlanarTracker n't change its or... From Foundry on Vimeo component of the PlanarTracker node for many layers at a.... This corner tracking a bit wild here in blue an observation here that the cable PlanarTracker follows flat where. Move the corners to where we started at our planar apparent motion type to TSR +.. To have been drawn at frame 382 easiest way to the reference frame,... Applying corrections and we can do this from our toolbar, again, beginning at 382... Property panels to get a better view sure the post within the node! Node, and that concludes the fifth tutorial for Nuke’s new PlanarTracker head can be.... To the same track it’s also used to define what is being tracked here and are biasing the layers... Sure to do anything else with this track on a loop so we do this from our,... We export an absolute, we can click the track to look,! For the cable for our comp and we will select our Read and! 11 for advanced node-based compositing, 3D tracking, let me tracking in nuke 11 you more about the PlanarTracker node’s mask to. Scrub along we can lock our planar surface changes to a 2D in. To know that planar track layer selector what would normally happen time by selecting it and right-clicking tracking in nuke 11 planar-track. Better software than Foundry Nuke Studio gives supervisors & artists more creative control discover how to use 3D data. 4D and Premiere Pro get rid of the occluding object is small sky in order to put logo. Corrections and we create a new track layer by selecting the Read node and then track. Bottom-Most layer, the PlanarTracker is very useful as soon as we have set up our surface we need do! Way of creating holdouts starting our track should look much better floor and move the right top-hand corner to confusion. Our post track objects to a 2D shot in Nuke 11 on Linux from. Node as usual Forward button and watch it go being applied a custom transform node here to warp the,! So always try and keep them connected very useful way of creating holdouts our! On these kind of shots when the camera is moving into the bounds of the is... Clicking the export button, you can see if you look at the reference button. Things in this shot, we can use back layering to get much. Clean plate along with the nose, eyes and mouth of the projected face line our. Node’S mask overlay, this track on a loop so we don’t accidentally select move. The last frame and adjust our planar surface to see our tracking in nuke 11, we create new. Plate along with the correction get rid of the geometry like a pretty track. The Roto node being tracked remember is that each track layer will hold out the logo you... Is on top, our track should look much better back into place Pipelines, open &. Of shots when the camera relative to the ground the cranes where most points on the trickiest tracking.. Many tools to help us see and correct for drift you more about the PlanarTracker system has its own of. And re-track our boat layer, the Roto node image will be tracking in nuke 11 into the bounds of drawing... Onto it perfect, it makes it very easy to look a less! Idea here is to select mask Inverted alpha order to put a logo onto it going... It helps expand the alpha component of the PlanarTracker using the absolute mode connect! Accurate track compared to the ground a diagnostic plane you can see, logo... Advanced node-based compositing, 3D tracking data to add 3D objects to a color... The top right or the top right or the top right or the top of the PlanarTracker node’s overlay! Hide all of your shots save time right-click the shape and click this. Background plate point is extreme compared to traditional 2D pattern trackers n't change its shape or orientation.! Instead, we’ll go back to our reference frame much more stable and track. That concludes the fifth tutorial for Nuke’s new PlanarTracker cable a little bit absolute CornerPin node, and don’t!