Introduction and Overview

I just want to give a huge shout out to our collaborative partner Clear Angle Studios for supporting CAVE Academy and allowing us to use a number of their images throughout this lesson.

Before we jump into things, let’s kick off with a general overview of the reference kit.

We have 3 primary objects that we tend to use as VFX, animation and games reference:

• The Grey Ball
• The Chrome Ball
• The Macbeth Chart

When it comes to this set, we are not talking: The Good, The Bad and the Ugly. We are talking: The Good, The Good and “Thank Goodness you Captured the Macbeth Chart”.

Overall, the reference allows supervisors and leads to check that all artists are working to an initial calibrated setup. This will allow for consistency across the assets and for shots. What you don’t want in a production is multiple artists using their own individual setups when creating a series of assets that will need to come together. All shaders should be reviewed within a known fixed context. The same goes for textures, models and so on.

There are a number of teams that will want to pick up the reference. Primarily, this would be Surfacing (Texture, Look Development and Groom), Grading and Lighting. Let’s break down each (and we’ll dive into more detail as we explore the reference below):

• Surface > Texture: For the Texture team, they’ll be interested in having the Macbeth chart as this will allow them to white balance and expose their photography reference consistently.
• Surface > Look Development: For the Look Dev team, they’ll be able to use the Grey, Chrome and the Macbeth chart to set up their lighting environments and ensure they are working in a colour controlled neutral space. They’ll also be able to white balance and expose any additional HDRIs.
• Surface > Groom: The Groom team shout be using the same setup as the Look Dev folk, so the shading of the Groom responds and is calibrated using the same lighting as the main body of the asset.
• Grading: This is extremely valuable when neutralising a sequence that comprises of multiple cameras and due to environmental lighting changes (outdoor shoots). Using the Macbeth, shots within a sequence can be white balanced and exposed to be consistent.
  
• Lighting: For the Lighting team, they can use the Grey, Chrome and Macbeth chart to calibrate their HDRIs and match to the plate photography. It is important that the reference has also been shot using the primary shoot cameras (for example, the ARRI, or RED, or Black Magic) as you’ll need to have reference of what you should be matching to.

If you are looking for a more detailed step-by-step breakdown on all things onset related, you can check out our courses on the topic here:

• Onset Data Acquisition 1001
• Introduction to Cameras and Lenses 1001
• Shooting HDRIs and Panoramas 1001
• Shooting Texture and Look Development Reference 1001

And lastly, before we dive into the nitty gritty, please do remember that capturing this data is no easy task. Life onset is extremely fast paced, so if you don’t get any fancy reference, think about what you could use in plate photography to help you decipher the shot. Maybe a nearby wall is close to being white, so you could use that for grading. Or maybe you can see some useful info on the reflections of a car window.

Being able to problem solve from what you have is an extremely important skill, so do work on that. But…if you do get the fancy reference, make sure to give you friendly neighbourhood onset folk a big “THANK YOU“. They’ll appreciate it for sure 😉

The Grey Ball

So we begin with the Grey ball. But ask yourself, is it really grey? Is it mid grey? Is it leaning more towards the blue side of the spectrum? Or maybe towards the red?

When someone pulls out a grey ball, our eyes will naturally fill in the blanks and say: “Ahh, a grey ball!”. The same goes for a white piece of paper. You have a gazillion (well, maybe not a gazillion) different tones of white and unless you pop them altogether and compare them, your brain will more than likely simplify things. So, unless your Grey ball has been well crafted and painted using a very fancy grey paint (from Rosco for example), it might be slightly off. General purpose paint from a department store will not have a very pure pigment, so it won’t be as reliable as the Macbeth Chart.

However, you just need to be aware of this and tweak your digital Grey shader to compensate. Or if you have the time and resources, shoot your look dev reference kit under polarised and cross polarised light to capture the surface colour more accurately.

But we digress. Let’s get back to the ball itself and ask ourselves: What is the Grey ball for? Well, primarily, it allows us to assess the following:

light direction

intensity

shadow

But it is important to note that this is just from the position you are shooting the ball from. Move the Grey ball and it will respond differently, as it should. But for that particular point in space and time, you have captured an extremely valuable moment of reference.

Like the Chrome ball, it is also very easy to create a digital Grey ball, so getting a look dev or lighting scene up and running can be quickly established.

This Grey ball used by Clear Angle Studios is very grey by the way. It’s an example of a fancy grey ball 😉

The Chrome Ball

Now we move onto the Chrome ball. Everyone loves the Chrome ball.

People in the streets will walk up to the Chrome ball. They’ll want to touch it. If you are not looking, they will touch it. Don’t let them! Don’t let them near your balls. You need to keep them clean. Smudge free.

Plus, they’ll want to take selfies using the Chrome ball. And selfies from a Chrome ball are the best selfies, EVER!

However, this is “unacceptable!” Why? Because if you are onset, they’ll capture everything being reflected. And if the project you are working on is a secret project, then you’ll be in big trouble if they release that pic into the wild. Aunt Edna may have had a thing against capes, but when it comes to the Chrome ball, its:

No selfies!

But what is the Chrome ball useful for? Other than the best selfies ever?

Reflection

Using the Chrome ball, you get to have a clear picture on what is going on onset at that specific moment in time. You have info on where the lights are, where the camera is, what the set looks like. It does not tell you everything mind. For example, sometimes lights will be hidden behind other objects or bounced off walls, so acquiring additional photographic reference of the set is still recommended. But for how things look in a specific location, it is gold (well, chrome).

The Macbeth Chart

Now we come to the Macbeth chart.

Nothing to do with kings and witches. Here is a snippet of info about the chart from Wikipedia:

The ColorChecker Color Rendition Chart (often referred to by its original name, the Macbeth ColorChecker or simply Macbeth chart) is a color calibration target consisting of a cardboard-framed arrangement of 24 squares of painted samples. The ColorChecker was introduced in a 1976 paper by McCamy, Marcus, and Davidson in the Journal of Applied Photographic Engineering.

The chart’s color patches have spectral reflectances intended to mimic those of natural objects such as human skin, foliage, and flowers, to have consistent color appearance under a variety of lighting conditions, especially as detected by typical color photographic film, and to be stable over time.

So, how should we use the chart without freaking things out within our VFX workflow? Primarily by only using it to neutralise the plate. That means to:

• Set the exposure
• Set the white balance

Through the chart, we can consistently apply exposure and white balance tweaks to our footage, texture photography, panoramas, and HDRIs to help bring them into alignment. It is, without a doubt a huge timesaver and removes a heck of a lot of guesswork, although some artistic tweaking may be required.

However, due to a number of factors, it SHOULD NOT be used for colour-correction. For more information on using the colour chart, I highly recommend you read the following by Thomas Mansencal:

• The ColorChecker Considered Mostly Harmless – This post will be about colour rendition charts, e.g. X-Rite ColorChecker Classic, their usage and its dangers. It was a long time coming and some discussions accelerated the authoring.

I also recommend working through this paper by C. S. McCamy, H, Marcuc and J. G. Davidson:

• A Color-Rendition Chart (pdf) – Journal of Applied Photographic Engineering, Volume 2, Number 3, Summer 1976

If I had to sum up what the Macbeth chart allows for in a single word (and I know I’ve said this word a lot in this doc), it is:

CONSISTENCY

The Macbeth chart can act as our ground truth for the shoot setup. But just be wary that how you angle the Macbeth chart is important. It is very easy to catch the Macbeth at an angle and this might pick up some glare.

Also – just like you should not get your grubby fingers all over the Chrome ball (or the Grey ball in fact), DON’T cover the Macbeth chart with your grubby fingers. We don’t need your fingers to expose/white balance the shot or our texture reference, we need the colour samples behind your grubby fingers. And we don’t want your grub on the samples either. Stick to the edges of the Macbeth chart when handling the Macbeth chart.

How the Reference Responds to Light

Here we will look at how the Grey, Chrome and Macbeth charts respond to light.

Something that I hear often from artist (both students and professionals) is:

“My Grey ball does not look grey. It has lots of green at the bottom.

And my Macbeth chart colours look funny.

I tweaked the shaders and now it all looks stupid. Nothing is working. It’s all wrong, wrong, wrong 🙁 “

So I’ll look at their scene, I’ll sigh, and then say:

“Yes, you are right. Your grey ball looks quite green from the bottom”.

But then I’ll follow up with:

“But how else do you expect it to look? You are using a HDRI that was taken in Regents Park. A Park covered in green grass. Go and take a grey ball and a white ball, and stand in Regents Park with them. Guess what, light bounces around. Welcome to the real world!”

I don’t actually respond to anyone like that by the way 🙂

So to summarise, your reference will respond to your environment. And this is key. This is the info you need to capture. You are capturing how these known objects respond to light in a specific moment in time and space. Don’t mess with your digital shaders to try and compensate what the light is doing. Build known digital shaders, created in a controlled environment, and then let them respond to light as they should.

And be observant of how the real world works and how real-world objects respond to real-world lights. The more you do that, the more believable your CG will be.

Planning How you Position your Reference

Before you hit the set, take some time and consider your requirements and how you’ll go about shooting your reference.

Whether you are on a film set or in a controlled lit environment for look development, it is important to capture your reference in context. I generally tend to use one of the 2 scenarios below:

• Capture from the position of where the CG asset will go (so we have an understanding of the lighting in that particular point in time and space)
• Capture from a position that gives me the most information about the environment and the lighting (for example, the middle of the shoot space)

If I know that the CG asset will be moving through different positions in space, I’ll try to capture the reference from those positions too. For example, maybe Iron Man is going to walk from one side of the room to the other. If so, it would be useful to capture the reference at three different points along that path. And through the main camera, you’ll want to film the reference going through the same motions.

One thing I would recommend not doing is: setting up your lighting for your asset, randomly positioning your balls somewhere else, and then adding additional light to make them look ‘evenly’ lit. That kind of defeats their purpose, which is to visually illustrate how things look within the lighting setup where the asset is.

If you do want to position your reference in the bottom left corner of your render, then I would suggest you render out the reference from the correct position, and then in a package such as Nuke, cutout and composite the reference on top of your shot. More of this is explained and presented below under ‘Using the Reference in Post‘.

Data Capture Example

In order to break down how to go about using the Grey, Chrome and Macbeth in post, let’s first capture some real-world data.

In this example, I’ve done the following:

• I’ve lit an asset using the house lights (coming in from screen right) and a key light (coming in from screen left).
• I’ve not set up anything fancy with the lighting. Just enough to demonstrate how the reference kit responds to the lighting as I move them around the shoot space.

I’m shooting with the following:

• Canon 5ds
• 50mm prime lens

…and I’m capturing the following shots:

• Asset
• Clean plate (also referred to as empty plate/pass)
• Reference plate (Grey, Chrome, Macbeth)

If you have time, you could shoot the reference separately, so one object does not occlude or cast a shadow on the other.

For illustrative purposes (of which we’ll explore below), I’ve also shot the reference kit in different positions. As mentioned above, if a CG asset were to be added that moves around withing the space, then shooting the additional reference shot makes sense. But if the asset is to remain in one position, then just one set of reference images will suffice.

Using the Reference in Post

So now that we’ve captured the data, here are a few examples of how the data can be used. We are not going to go into all the departments who would use the data (for example, Texturing, DMP, Grading, Lighting, etc.) but this should give you the general gist of things.

Firstly and before we continue, please note that I would not usually use Photoshop for any colour related tasks within a production pipeline. Primarily because it is not all too good for colour accuracy, especially when working within an ACEScg colour pipeline. Instead, I would use tools such as Nuke and RawTherepee.

However, I want to doodle over these pics and nothing really beats Photoshop for doodling 😉

As mentioned above, the aim of the game is to use the reference to calibrate our digital scenes to the photographic reference. To do this, we’ll need to build a digital twin of the physical environment (that is the best way anyhow) and then position the HDRI light sources into 3d space, matching the physical light positions. And if you are not matching to photographic reference, you’ll still want to standardise your setups, so your team is working with a calibrated and known dataset.

This is a bigger topic, so I’m not going to go into the nitty gritty of lighting/look dev setup here, but you can check out these upcoming course that will do so:

• Creating Digital Studio Look Development Environments 1001
• VFX Lighting Fundamentals 1001

In a nutshell, we can:

• Use the Grey ball to match light direction, intensity and shadow
• Use the Chrome ball to figure out where things are in 3D space
• Use the Macbeth chart to balance colour and exposure

So that’s it. Or that is how I use the Grey, the Chrome and the Macbeth chart. If you have other ideas, it would be great to hear from you.

But…if you are still rendering balls randomly floating in space, then I’ll be sad. Give your balls some purpose and meaning. Don’t follow the crowd without asking WHY! You know my WHY, so what’s yours?

Same Info, Explained Slightly Differently 😉

I recorded the video below a while back and it does cover much of the same info that you’ll read/see above. However, I have decided to have it remain below as it points to some useful examples and references that I would recommend you check out.

Onset Training

For more information on all things onset related, you can check out our courses here:

• Onset Data Acquisition 1001
• Introduction to Cameras and Lenses 1001
• Shooting HDRIs and Panoramas 1001
• Shooting Texture and Look Development Reference 1001

The Connection Programme

If you are a fan of mixing science with art, or maths with creative thinking, then join our Connection Programme, where we’ll be exploring VFX, animation and games from the core fundamentals:

• The Connection Programme

Support CAVE Academy

Here at CAVE Academy the beauty of giving and sharing is very close to our hearts. With that spirit, we gladly provide Masterclasses, Dailies, the Wiki, and many high-quality assets free of charge. To enable the team to create and release more free content, you can support us here: Support CAVE Academy