Within the early days of digital cinematography, it appeared like 2K is likely to be sufficient for digital cinema and HD could be a decades-long normal for broadcast.
However quickly sufficient, Hollywood studios began ending at 4K. And streamers like Netflix and Amazon Prime made 4K a brand new supply normal for the period of peak TV. As DPs discovered how 4K cameras may enhance the standard of 2K deliverables, the advantages of taking pictures for larger decision supply began to turn out to be clear.
After which RED Digital Cinema launched 5K, 6K and 8K sensors, Sony launched the 6K Venice, and ARRI stepped up with the 4.5K Alexa LF and the 6.5K Alexa 65.
To a point, it makes excellent sense: extra pixels means extra element, which implies higher photos. Proper?
However then Blackmagic Design compelled the query final yr with the introduction of the URSA Mini Pro 12K: what number of Ks do we actually want?
To discover the query, we interviewed working cinematographers to learn the way they’re already utilizing 12K as a device, and we sat down with Blackmagic Design to listen to their rationale for pushing seize resolutions even larger.
What’s it good for?
“The thought of 12K isn’t that everybody ought to shoot 12K,” says Bob Caniglia, Blackmagic’s director of gross sales operations in North America.
“The thought is you need to use 12K for the conditions that require it.”
So what sort of conditions want nearly ten instances the decision of UHD?
Take into consideration the 20-foot-high LED partitions which might be used for Mandalorian-style productions, the place a number of photographs are stitched collectively to create an ultra-high-resolution wraparound digital set. Or large outside screens that require equally large quantities of element to make an affect.
Even in the event you solely count on to ship at decrease HD or UHD resolutions, extra pixels provide you with extra choices.
When you shoot at 12K with a handheld digital camera, the additional decision provides you loads of further margin in submit for stabilization and reframing, yielding a last consequence that mimics a well-composed Steadicam shot.
And in the event you shoot a big scene with a single 12K digital camera—one thing like a large shot of a panorama or soccer discipline—you’ll be able to zoom into particular areas of curiosity and extract great-looking frames that also have full 4K decision.
In essence, taking pictures 12K is like having a number of cameras on location for the value of 1 (although, after all, lens alternative will affect the artistic potentialities of the shot tremendously.)
“It’s additionally an 80 megapixel nonetheless digital camera,” notes Blackmagic lead digital camera specialist Tor Johansen. “You are able to do very giant prints, as much as 42 inches, and nonetheless be tremendous clear and sharp.”
However even when 12K is technically advantageous, good DPs are at all times cautious of workflow necessities. You gained’t save a lot time taking pictures if the 12K recordsdata require far more storage than you’ve budgeted for, or if the processing necessities sluggish post-production to a crawl.
Because it seems, a 12K format may be manageable and introduces some compelling new artistic capabilities.
Past the Bayer filter
Let’s begin by looking beneath the hood of the Ursa Mini Professional 12K.
Blackmagic Design selected a model new sensor design for the Ursa Mini Professional 12K that, uniquely, doesn’t use the Bayer Sample Filter.
What does that imply? The brand new sensor captures equal quantities of purple, inexperienced and blue gentle.
The Bayer color pattern (utilized by most digital cameras in the marketplace) was devised to match the physiology of the human visual system. Merely put, our eyes are extra delicate to inexperienced gentle than different wavelengths, so the Bayer sample has two green-sensitive photosites for each one purple or blue photosite.
However BMD’s 12K sensor makes use of a special coloration filter array (CFA) that captures “symmetrical” coloration data, which will increase coloration decision. It additionally simplifies the arithmetic concerned to the purpose the place pictures may be scaled on the sensor itself.
So what does that imply in essentially the most sensible sense?
It implies that, whether or not you determine to shoot in 12K, 8K, or 4K, the picture will probably be sampled from the sensor’s full seize space, relatively than from a smaller, windowed space. You’ll get precisely the sphere of view you’d count on from a given piece of glass and a Tremendous 35 sensor, irrespective of which seize decision you select.
Anybody who’s ever immediately realized on set that their widest lens isn’t broad sufficient to seize a scene in a digital camera’s cropped or windowed mode will respect simply how helpful that is. It permits the digital camera to be extra usable for a wider vary of tasks.
On the similar time, scaling the picture on the sensor itself truly reduces the quantity of knowledge coming off of the sensor, which means the digital camera can file at larger body charges throughout the board—60fps at 12K and 120fps at 8K.
(It’s value noting that there’s a Tremendous 16 mode that permits you to file at as much as 220fps from a cropped 4K portion of the 12K sensor. This would possibly come in useful in the event you want these excessive body charges and don’t thoughts the narrower discipline of view of the windowed picture.)
Small photosites, large dynamic vary
Yet one more factor about that new coloration filter.
Whereas bigger photosites usually enable the gathering of extra gentle (which implies extra sensitivity and extra dynamic vary), squeezing higher-resolutions onto sensors means you want smaller, extra tightly packed pixels. And that’s a major commerce off.
This inherent compromise is likely one of the acknowledged causes ARRI held out so lengthy earlier than releasing cameras that file at 4K and better resolutions: the Alexa’s 3.4K sensor had reached a candy spot between sharpness and sensitivity, buying and selling sheer decision for excellent low-light efficiency and low noise.
To fight that impact, the URSA Mini Professional 12K’s CFA contains not simply purple, blue and inexperienced photosites however an equal variety of “white” or clear photosites that enable it to seize extra details about gentle depth.
BMD doesn’t disclose all the details about the exact color configuration, however let’s consider it as a 6×6 grid with six purple, six inexperienced, and 6 blue photosites together with 18 white photosites that gather extra gentle than their color-filtered counterparts.
It’s necessary to notice right here that the “RGBW” grid isn’t a brand new thought. However Blackmagic’s use of the tech would possibly be.
They declare that combining the luma-only photosites with coloration information from the RGB photosites helps keep a full dynamic vary whereas preserving photosites as small as doable. And with a pixel pitch of simply 2.2 microns and 14 stops of dynamic vary on the brand new sensor, we’re inclined to imagine them (for distinction, the URSA Mini Professional 4.6k’s sensor has a pixel pitch of 5.5 microns with 15 stops).
In fact Blackmagic isn’t utilizing precise magic of their {hardware} design. Different corporations are already experimenting with totally different CFA tech.
For instance, Sony’s “Quad Bayer” filter arranges pixels in 2×2 arrays of a single coloration, relatively than alternating colours photosite by photosite. Samsung calls the identical know-how “Tetracell.” And these rival applied sciences have already been in the marketplace for a number of years
However relatively than detracting from BMD’s claims, this competitors helps validate them. There appears to be a rising recognition of the Bayer sample’s limits, and a willingness by producers to experiment with new forms of CFAs that present particular technical benefits.
Within the case of BMD’s new 12K sensor, which means higher coloration constancy and larger dynamic vary at even larger resolutions.
Making it manageable: Blackmagic RAW
So regardless of the elevated general decision, BMD’s 12K sensor captures a picture that maintains a superb quantity of dynamic vary. However how do you deal with that quantity of knowledge?
That’s the place Blackmagic RAW comes into play.
This new codec is designed to alleviate among the stress on post-production workflows by dealing with a part of the uncooked processing contained in the digital camera itself.
Now if that assertion units off any alarm bells in your thoughts, pause and take a step again for a second. Whereas it’s true that Blackmagic RAW isn’t a completely raw format, there are some appreciable advantages this method supplies.
First, as a result of among the heavy computational lifting is partially dealt with on the time of seize, many submit workflows can undertake 12K with out large IT upgrades. The footage may be performed again on extra normal computer systems, relatively than being restricted to beefy workstations.
Second, Blackmagic RAW considerably reduces the storage necessities for seize media and on-set backups (relative to different codecs). So you can begin taking pictures with a number of 12K cameras with out large quantities of pricey, ultra-fast flash storage, or with out ready obscene quantities of time simply to switch and backup recordsdata.
“I’ve experimented with 18:1 [compression], and I’m actually shocked at how clear it’s,” says Johansen.
“I’d say most customers are doing 8:1. Lots of people need the bottom compression for the very best quality, however we’re not seeing the distinction. 5:1 compression is 578 MB/sec, however 8:1 is roughly half of that [361 MB/sec], and the image high quality is simply nearly as good.”
So the Blackmagic RAW codec is the spine that permits an ecosystem that features the Ursa Mini Professional 12K {hardware}, the corporate’s coloration science, and its Resolve color-grading software program.
Or, as Caniglia places it, “When you might have full management over every of these elements, you might have much more management over the way it’s going to have a look at the tip.”
Sensible purposes
12K seize is already shaking up the digital camera world, with DPs gravitating to the high-res format for each technical and aesthetic causes.
VFX cinematographers are among the many early adopters, since elevated decision interprets on to higher-quality imagery, particularly when creating blue-screen or green-screen composites.
David Stump, the chairman of the ASC’s digital camera committee and creator of Digital Cinematography: Fundamentals, Tools, Techniques, and Workflows, cites Nyquist principle, which has lengthy dictated sure design choices in digital cameras.
In a nutshell, the Nyquist Limit defines the minimal variety of pixels required for a digital sensor to correctly pattern element in a picture.
As a result of it takes two pixels to create a visual line pair, or unit of element, in a picture, Nyquist tells us {that a} high-definition sensor with 1920 x 1080 pixels is ready to resolve not more than 960 line pairs or “cycles” horizontally and 540 vertically.
Skilled cameras incorporate an optical low-pass filter that’s calibrated particularly to remove any element above the sensor’s Nyquist restrict to keep away from unnatural artifacts similar to aliasing and moiré.
A digital camera with a a lot larger decision sensor can enable a lot finer ranges of element by earlier than the filtration kicks in. And sampling at a better frequency—with a better horizontal and vertical sensor decision—yields larger accuracy.
“The extra slices you narrow an image into, the extra precisely you’ll be able to reproduce it,” Stump says.
“If I’ve higher-resolution pictures, I’ve cleaner mattes from blue-screen or green-screen composites. Extra sampling means finer matte edges whenever you’re reducing pictures aside and reassembling them as composites.”
One other large profit is the 12K body’s potential to comprise a jittery picture whereas leaving loads of margin on all sides for digital stabilization.
“When you’re driving down a rocky highway taking pictures background plates for a picture and the cameras are bouncing everywhere, you’ll be able to punch into the picture and stabilize it,” Stump explains.
“You haven’t decimated the decision of the picture as a result of you might have a lot to spare. Equally, you might have super flexibility to reframe and resize issues to repair any working errors which might be made on stage.”
At Stargate Digital, the place DP Sam Nicholson, ASC, was an early advocate of the “digital backlot,” it’s not a lot a query of whether or not they shoot at 12K as it’s what number of 12K cameras they use on a shoot.
“I feel my file is taking pictures with eight of them directly,” Nicholson says. “Typically, 4 of them is a reasonably normal raise proper now.”
“You will have super flexibility to reframe and resize issues to repair any working errors which might be made on stage.
One current shoot noticed 4 12K cameras on a stabilized driving rig capturing a 360-degree atmosphere for virtual production. One other mission concerned a fleet of fifteen 12K and 8K cameras capturing environments from a touring subway prepare. Every take was half-hour and generated round 150 TB of footage.
Nicholson’s philosophy is to shoot with essentially the most decision and dynamic vary doable in order that the footage may be pushed and manipulated aggressively, as wanted, in post-production.
However you don’t need to be a VFX DP to get an honest ROI on 12K. Kevin Garcia, video companion and movie director with MixOne Sound, used the URSA Mini Professional 12K to shoot a 2021 Grammys pre-show efficiency.
“It’s been fairly freaking unbelievable,” he says. He’s equally more likely to shoot a regular band interview in 12K, which saves appreciable effort and time in comparison with a multi-camera set-up by permitting him to punch in to totally different 4K sections within the bigger 12K body.
“I did an interview with a five-piece band,” he says. “I didn’t need to arrange three cameras, so I made a decision, ‘I’m not going to.’ I arrange one [12K] digital camera and punched-in to 4K, and it was nonetheless vivid. It didn’t look upscaled or downscaled, and it turned a one-camera shoot into 5.”
For Garcia, the principle argument in opposition to taking pictures every thing in 12K is the storage necessities. Recording reside performances that run for an hour or two and not using a break at excessive decision can fill discs shortly. However even 8K provides compelling benefits for HD and 4K deliveries.
For Phoenix Classes, a streaming live performance collection that includes performances by Jimmy Eat World, he shot 8K footage with 4 Ursa Mini Professional 12Ks rolling alongside two Ursa Mini Professional 4.6K G2s. The upper-res footage gave him alternatives to reframe photographs and even crop the picture to create new angles within the edit. Even simply downscaling the picture to 4K yields glorious outcomes.
When extra is healthier
So to recap, what number of Ks do we actually want?
Effectively, it depends upon what you’re making an attempt to do.
If you must create a high-resolution backdrop for digital manufacturing or a convincing 360-degree VR or AR atmosphere, you want extra pixels. When you want distinctive readability and coloration decision for an HD or UHD deliverable, you want higher pixels. And since you must flip every thing round on time and on funds, you want an environment friendly post-production pipeline.
As BMD has proven us, you’ll be able to have extra and higher pixels with out destroying your workflow. Because of the hyper-efficient codecs, 12K brings filmmakers extra choices, with out grinding post-production to a halt.
Whereas Blackmagic will be the first firm to launch a 12K digital camera, different producers are always working behind the scenes to enhance coloration decision, cut back noise, and lengthen dynamic vary.
The brand new Exmor R sensor in Sony’s PXW-FX9 cinema digital camera, for instance, downsamples from the sensor’s native 6K decision (on this case, 6008 x 3168 pixels) for 4K output, yielding extra correct coloration copy than a local 4K sensor.
It’s inconceivable to think about that Sony and different digital camera distributors aren’t already creating their very own {hardware} and software program to ship manageable workflows at ultra-high resolutions that match or exceed BMD’s 12K providing.
However what about supply requirements? Can we count on that streaming and broadcast resolutions have plateaued at 4K? Even when there’s a pause, don’t count on it to final lengthy. Japanese director Kiyoshi Kurosawa’s latest drama already broadcasts at 8K, and NHK has committed to 8K live broadcasts for the Tokyo Olympics in the summertime of 2021.
As filmmakers, we should always demand the best constancy doable at each step of the artistic course of. We owe it to ourselves, to our shoppers, and to our audiences to ship the very best pictures—those that the majority clearly and utterly seize the tales unfolding in entrance of our cameras—utilizing essentially the most versatile instruments at our disposal.
Think about if Hollywood had determined that 35mm movie decision was “sufficient.” The cinema and filmmaking panorama of immediately could be radically totally different (and sure much less artistic).
To not point out the profound affect new mediums and instruments have on cinematic storytelling.
The wealthy coloration, lush textures, and immersive panoramas captured in epics like Lawrence of Arabia, Ben Hur, and Kenneth Branagh’s attractive tackle Hamlet have been all enabled by 70mm celluloid.
After which there are the indomitable filmmakers who attain for IMAX, to create among the most awe-inspiring experiences in cinema. Consider the vertiginous sweep of the Burj Khalifa set piece in Mission: Unimaginable – Ghost Protocol, or the visceral handheld panoramas of Dunkirk.
Every of those unbelievable cinematic moments was doable as a result of visionary filmmakers insisted on utilizing new instruments and methods that enabled the very highest requirements of imaging high quality accessible to them.
So when you may not want to leap to 12K seize straight away, don’t get too snug with 4K. As a result of there will probably be extra Ks in our future—much more than 12K.
And that’s a superb factor for filmmakers.
Leave a Reply