Day 1
_________________________________________
Session 1
general overview of workflows and formats in digital film and home entertainment
– by Flying Eye – media management consultants; ie getting the techies and creatives to understand each other.
Background: jan. 19th Kodak files chapter 11 bankruptcy protection.
Film continues to dominate archiving, but digital acqusition taking over in production – one could say has taken over.
SDTV –> HDTV –> 4K (digital cinema)
Digital workflow allows for crossover between production and post; this is not only possible but even likely. (and desirable?)
– fewer steps digital – digital than film-digital
– DCI is still active; produces SMTE standards. last revision 26.01.2012 www.dcimovies.com
– DCI focusess on distribution & security
– DCI also gives specs for testing of distribution
Last 3 years have seen an almost exponential growth of digital and 3d screens compared to film-only
Rumour that Hollywood will stop releasing 35mm in 2013. This will have a major effect on those screens that have not converted to digital –> but what about arthouse? archiving? less industrialised territories? second run? festivals?
Issues:
– projection brightness
– higher framerates (48fps)
– heigher resolution (8k+)
(these last two have big implications for production and post pipeline)
– industry still learning to handle 3d
– film language for 3d still under development
As always, the choice of camera is chosing the right tool for the job – should not be a choice based solely on technological considerations
Interesting development also in DLSR; both Canon and Nikon have released new cameras this month. N D800 (better colour but more noise) and MKIII (less noise but more moire and false colour)
Brand new! Digital Bolex announced last week.
Acquisition formats
– resolution
– bit depth
– compression
– colour space
mm.
Field recording: disk based, flash memory (SSD, etc.) and tape based
With online storage of masters, one can move away from a “sequential” post to a collaborative one.
– also Cloud-based. Example, Hugo Cabaret moved 3PB data between 11 different collaborators in post. ref Pixomondo – teams all over the world working on the same production.
Consumer delivery: IMF – interoperable master format
– standard for mastering for all consumer delivery formats.
Frame rate: 24 vs. 25 fps –> DCI compliance requires 24 BUT the latest standards allow for 25 fps DCPs for cinematic release; but even though the standards exist, the equipment to play 25 fps is not widespread.
___________________________________________
Session 2
Broadcast Changes.
John Ive from IABM (http://theiabm.org/)
represents the broadcast equipment manufacturers
analogue –> digital –> IT/IP
– this last element is what has actually changed workflow
More delivery platforms and consumption habits are changing; leads to both creative, business and technological need to adapt.
– how to future-proof in a situation where change is accelerating?
Drivers in the consumer world
– live programming
– multichannel pay-tv
– recorded media – multi-format
– video on demand
70% of tablet owners use them while watching TV (UK)
Daily viewing hours still increasing
From tape to file – file = video + audio + metadata
Analogue and digital are still linear / sequetial workflows –> IT/IP changing all that
IT is faster than real time and paralell
“ingest once, use anywhere”
But why are we struggling?
– have to unlearn ingrained workflows
– exponential rise in content
– formats!
– cost of investments and upgrades
– too many things changing at the same time
Metadata – provides the context necessary to make sense of data.
– there is no “one size fits all” as different organisatons need different metadata.
Workflow
key in IT-workflow becomes media asset management.
Existing cloud services – worth checking out to see the (possible) future of media asset management.
Security is an issue in cloud storage
– local laws where the servers are; which agencies can access my files?
– leakage and hacking?
_______________________________________________
Session 3
Peter Adams – editor of Anonymous
editing and VFX
– shot on Alexa
– communication between editing, VFX and production was key in both prep and production
– got technical files from the camera. DP predefined different luts that were applied to the dailies and a form of pre-grading
–> gave DP a chance to pre-grade, and the looks were changed along the way. Eliminated dailies colour grading and predefined som set-ups for the colour grading
– raw material recorded to hard drives, copied at the end of each day by a quality controll dept. – replaces the lab
– this dept. produced timed and synced dailies, already logged and organised.
Editor and director watched dailies at the end of each shooting day
– Started editing while the shoot was going on.
– often involved sound and vfx while cutting scenes in order to get the full effect
VFX and editing started working and testing together about a week before production started.
– technical compatibility as important as collaboration
Good communication also key to ensuring efficiency; avoid wasted labour
– back and forth collaboration allowed adjusting plans to ensure maksimum efficiency
By cutting along the way, the editor had a cut ready for a (internal) screening about 2 weeks after principal photography was finished.
– worked another 2 weeks on a directors cut
– another couple of weeks, then another screening
Editing moved to LA, but VFX still in Germany.
– an assistant stayed in Babelsburg, but editor and main assistant moved.
– conference calls with VFX every two days.
– used a watch folder (dropbox) and a player called cinesync – which allows you to draw on images and the drawings are synced real time between LA and Germany
– moved editing to London in so the director could do ADR with the actors
Recreating historical London from before the fire: combination of VFX and production design – CGI and sets, set extentions, etc. This required extensive previsualisation between those two depts. – but editing was not involved in animatics, etc.
______________________________________________
Session 4
s3D Now! – research project
On the effect of 3D on storytelling, production and sound, in addition to testing workflows
3 main research questions
– optical phenomena in 3d and their limits
– staffing on 3d productions
– sound in 3d films; how is it different from 2d
Project entails a short film, a behind the scenes doc and a book
Sound for 3D – there is no litterature right now
– how does 3D effect set sound and post sound?
some challenges
– clocking with many devices
– stereographers equipment is noisy
– same is true of data wrangler
Shooting
– more wide shots, longer shots, fewer ots. –> difficult to get mics close
Post
– need 3d image for sound post in order to miks to the correct space
– increased detail level in sound design
– new approaches for surround channels since the audience is inside the space and sound must reinforce this
– may need different playback systems – eg. 7.1
Sound concept
– must remember the room / space is a stylistic device ie. a storytelling device
– directors must learn to include more departments
MORE PREP.
3D Alliance Karlsruhe
investigating storytelling in 3D
forms alliances between art and science (esp. mathematics)
Beyond – 3d filmfestival
* 3D symposium 22-24 june. *
Working towards directing attention from technical aspects to creative aspects
big challenges: no standards and lack of educated people.
3D requires a new dramaturgy; one that uses space actively
– both in terms of staging and emotionally
Requires new rhythms in editing
“in 3d, the post people become painters”
___________________________________________________
DAY 2
Session 1: The Law of the Internet with Prof. Jan Bernd Nordemann
Intellectual Property rights: remember everyone who has had creative input in the film — editor, cinematographer, actors, composers, etc. — owns the intellectual property rights to their work. The Producer needs to remember to acquire all these rights for distribution.
– in particular internet and “all unknown media” rights
– need explicit agreements for “non film use” –> for example merchandising, books, etc.; also prequels, sequels, remakes, etc.
Old programmes – anything before 1995 – are problematic for internet distribution
– especially from before 1965
Why? Before 1965 no mention of unknown media in contracts. –> rights remained with the creator/author
In 2008 German law granted distribution rights to producers for content created 1966-late 70s for what were “unknown media” in that time period. ie. video, internet.
– The authors can make a separate remuneration claim to a governing body.
In US the situation is different under “work for hire” provisions –> producers retain more distribution rights
In the case of full funding by a broadcaster, the internet and unknown media distribution rights may be with the broadcaster. At the very least, the broadcaster retains the “7-day catch up” distribution.
– VOD a separate issue.
No one “right” on the net. Many different forms and rights of distribution on the net.
– EST – electronic sell through (purchase)
– VOD – on demand viewing by time-limited download, but not sale.
– Streaming – on demand viewing, but no downloaded copy for viewing
Remuneration
– free
– free with advertising
– pay-per-view
– subscription
– etc., etc.
Geographically limitet rights – based on geolocation of IPs
– there is a question about the EU; must rights be whole EU or can there be rights specified for individual states
Music rights are the most complicated thing, in part because of national composers & musicians rights organisations. In some cases, rights must be negotiated with individual performers and composers –> this is a major hurdle for film distribution.
Another aspect: live streaming of TV.
Creative Commons. Has become part of the copyright system, but is free of remuneration. –> since it is noncommercial there is a limit on the kinds of content that will be CC licensed.
Platforms have to adhere to national laws for all territories in which they are available.
– example: youth protection (age limits) could determine at what time you can stream certain content in certain territories
Piracy. Still unresolved. Copyright vs. individual freedom.
_________________________________________
Session 2: Production Designer Sebastian Krawinkel about Anonymous
Every scene in Anonymous was designed, and built either physically or digitally.
Used a modular system – elements that could be moved and reused in different ways.
Original idea was to shoot plates in England, and use them in CGI. In actual fact only one plate was used.
Made models which were shot, then manipulated in VFX to create London
Art dept. researched and built large parts of 16th century London – Art. dept. made many 3D models, then handed these to VFX for completion.
Krawinkel had 12 weeks prep for research.
Based sets and 3d designs on contemporary paitings of London. Houses based on existing houses that survive from that era.
Extensive previs, both 2d and 3d
Close working relationship between Art Dept. and VFX in prep.; sharing of concepts and files; planning of physical and digital elements
In the interiors, modules were built and reused in many sets; simply fleshed out with some unique elements in order to distract the eye from the reuse of elements,
Primary interior lighting from candles; used “candle wranglers” and special 3-wicked candles. (Chose to shoot Alexa because the candlelight caused noise in in the footage from the Red camera that was tested)
In certain situations, the modular sets were combined with CGI and digital sets
Used 5 different sets, so that while one was being filmed, the other 5 were in various states of preparation.
Modular system works when architecture is geometrical, the director is very visual and can see possibilities, and the AD can make a schedule that works.
__________________________________________________
Session 3 – 3D storytelling and workflow planning
Part 1 with Ludger Pfanz
3d has a history all the way back to Lumiere and Meliers
Digital 3d allows perfect sync in projection
Theses
– 3d starts with the script
– from “frame” to “stage”
– space has meaning
– depth dramaturgy
How to organise space for 3D
– Topos: space –> space has potential and dynamism
“What is not in the script cannot be staged” – scriptwriters need to learn to write for 3d space.
– for example, in Coraline the day world is flat, while the night world has a lot of depth
Can layer an image to have more going on different levels –> mise en scene
Alex Weimer & co. – “Lost Place” a case study in 3D filmmaking
Mystery thriller, based on real backstory of US cold war experiments.
How to make the 3D count?
Things that lend themselves to 3d
– ensemble cast
– limited number of locations, which are explored by the characters
Depth chart: an analysis of the script to decide which scenes need more or less depth, where parallax is in front or behind the screen
Can increase Vertigo-effect by increasing inter-axial distance between cameras (for example) –> puts a strain on the viewer
Production considerations
– stereo rigs can weigh in excess of 40 kgs.
– changing rigs can take several hours of calibration
– stereographer becomes a key crew member; important to give them the time and space to work
– special rig for steadicam – down to approx. 25 kgs.
– stereoscopic mirror rig eats about 1 stop
Editors observations.
kept each eye separate – even on separate hard drives
Used Avid media composer 6 – latest version has 3d capability; allows linking two picture and one sound clip to create a stereoscopic clip.
What about pacing? – the pace of the editing and choice of footage to use determined by the action and shots exactly as with 2d
Cut in 2d, then view sequence in 3d.
Some differences
– backgrounds are a bigger distraction in 3d – even if out of fokus. Need to be aware of this
– tracking shots can, if necessary, be held longer in 3d.
– lens flare and reflection is a bigger problem in 3d.
VFX and post production; on set data wrangling
– data integrity key; backups and more backups.
– DIT followed file naming convention agreed upon in prep.
VFX did on-set check and screenings of footage; used After Effects since the editing workflow had not yet been established
Involved in prep in order to avoid overwork in post 😉
gathered textures, etc. on location
built websites, graphics, phone apps, etc. etc. in advance so they were filmed “live” during production – again to avoid work in post.
Have not yet decided on software package, but considering Fusion rather than Nuke.
Big challenge creating effects that also have to have depth.
_______________________________________________
DAY 3
Session 1 – Case Study ARTE – broadcast workflow in the transition from tape to file
ARTE is a grouping of public television networks; French and German cooperation, started in 1992
Head office in Strasbourg
Tapeless: started with SD tapeless in 2001; went live in 2005
Introduced HD in 2008
APIOS: database for managing broadcast assets; uses metadata to automate programming, archiving, etc.
– also manages audience number, etc.
– this system is available for all now, can also be used for archiving, vod, etc.
HD-tapeless: decision to go tapeless made in 2008
BCE won the contract to effect the changeover to tapeless
APIOS is based on Oracle and on Windows-only.
Going tapeless has much simplified by removing steps, need for synchronisations
(MAM = media asset management: key feature of tapeless system)
In a changeover like this, change management — training & listening — are key
To any such system, metadata is key –> it is crucial that this is entered and managed correctly.
_________________________________________
DAY 4
Session 1: Case study Melancholia: Pan-european co-production with Peter Hjorth
check http://www.gearless/MEL%20VFX%20featurette%201stcut.mov
NB: Peter works exactly the way we want to teach Digital Visual Design.
Melancholia had collaborators from Denmark, Sweden and Germany on the post production effects.
Peter worked as a “VFX Director” – closely with Director, DoP and PD throughout the production cycle
Partners in VFX included:
– Pixomondo in Germany
– Film Gate from Sweden
Peter and his VFX producer Karen were hired at the script stage
– made some models, working with the scientists who provided a large amount of the background reseach for the film.
– first VFX breakdown and budget already two months before preproduction started; worked closely with the films producer to find a solution that works with the total budget
Storyboard
– Peter worked with Lars, DP, PD and 1st AD
– final film very close to storyboard
Developed the colour and look of the Planet Melancholia; worked with Gaffer and DP so they could find a gel they used to give the effect of the light from Mel. shining through windows, etc.
Predefining what is needed; working with production to ensure what is needed is filmed.
Karen did cost estimates to see what is best done on set, what is best done in post.
The general trade-off is big, wide shots better as post VFX, while smaller, closer shots better as on-set SFX
Involved in planning 2nd unit shooting – ended up saving time and money
Made a production plan for FX shots
Financing
breakdown based on final script
gave all studios same breakdown, storyboards in order to get best possible bids.
shots were cut all the way until the end in order to make the budget work, or in some cases redistribute resources
Economy not the only factor in chosing post studios
– artistic style and visual understanding
– experience and capacity
– key competences
– personal contact
– location (travel time for Peter and Karen) –> this was a factor in chosing German Pixomondo over a Canadian competitor.
Tight schedule: shooting finished in September; film had to be ready for pre-Cannes screening in March
Budget har to consider shooting costs, personnel, construction, post hardware, travel, file transfers, etc. etc.
4-country co-production; there are national demands for where budget is spent – VFX also has to help by spending in those regions… (plus a large list of other investors)
— Worth noting that Film i Väst (Göteborg & Trollhättan) is a major booster of filming and post in that region —
The Shoot
Peter on set all days when vfx-shots planned
Input in how actors responded to the Melancholia planet in the sky
participated in shooting reference elements, plates, inserts, spinter unit with sfx and art dept. (most high speed); 2nd unit of varying sizes (inkl. model shoot), special elements (in this case, Northern Lights on Iceland), pickups (greenscreen)
Editing
Important to keep track of the shots used, that the vfx plan is still being followed; see if new shots come up, etc. –> important to follow up that the total VFX shots stays within the budget.
Peter takes job of VFX-editior: does rough versions of vfx shots once there is a “real” cut of the film available
Make vfx-demos for the post studios involved, allow them to start sketching their versions while waiting for the final version of the picture
Post studios provided temp versions for screenings
VFX
Online of film to vfx studios
briefings and presentation of shorts
VFX production schedule finalised
maintain communication and make visits, viewings — this is key to ensure what is delivered is what was wanted.
VFS shots to foley, sound editing, music
Coordination important, to ensure everyone knows who does what, when, and also movement of files, scheduling of approvals and viewings, etc.
Important also to coordinate with Producer to fit promo and trailer production into the schedule; they can really destroy a post schedule otherwise.
Peter works much like a director with the vfx-providers; is the creative leader of the team and needs to get the most out of the different artists.
– tools like Skype and Cinesync are useful, but there is no substitute for sitting and speaking in the same room.
worked with ftp –> still the easiest way to distribute files.
Grading
Peter supervises the delivery of every vfx-shot; also attends final grading
involved in creation of LUTs for dailies; ensure all vfx shots work with the LUTs
Grading requires delivery of alpha layers; mistakes in grading can ruin the effect of compositing!
Things like stars can cause major problems in downconversion for release formats — all these versions must also be checked.
This case shows how important it is for the FILM that the VFX director is involved from script to delivery.
Q&A
Alexa – shot 10-bit log with on-board compression codec.
______________________________________________
DAY 5
Session 1: Visual effects photography and 3D with Mark Weingartner
Visual effects and CGI are not the same thing: not all vfx are CG, although they may have CG elements.
– many elements, plates, miniatures, etc. are shot, then manipulated, composited in post.
Useful book: VES Handbook of visual effects
Things like Vistavision still used for f/x
For 3d models – use lidar scans instead of photos for plates.
Session 2: “101 It’s Easy” –> new company helping production companies make transition to file-based
Protection of media is key
Digital allows sharing and collaboration to a much greater extent; this increases complication
Cloud-based file management is key to collaboration and sharing; producers need a system that can be secure but flexible.
Session 3: Dolby PRM-3200 reference monitor
John Bleau
New monitor a response to the lack of a proper display in post after CRT discontinued.
– main problem is there is no longer a universal reference standard
– LCD and plasma have severe colour and black/contrast limitations.
– OLED and plasma have a short life
– DLP best colour, but poor contrast, poor blacks
Dolby monitor 40000:1 contrast, 12-bit colour. Can handle raw output from Alexa, for example.
$40,000 –
Calibration probe is another $30,000…
Session 4: Digital Gremlins! with DP Keith Partridge (films extreme locations, etc.)
or… the many deaths of digital footage…
One way to kill a camera…–> drowning
Cameras don’t like water! Adventure cinematography can get wet…
Other ways –> dropping and freezing.
Logistics of the shoot determine choice of equipment
When one is in a remote location it’s crucial to use things one is familiar with –> if something goes wrong you can quickly fix it / find a solution
Session 5: Pixomondo and Hugo Cabaret
shot on Alexas with a 3d beamsplitter rig.
extensive metadata recorded
Nuke for compositing
VFX involved in setting up the LUTs
One pitfall of 3d: stereo artifacts
– 2-stage removal process: automatic tools followed by manual cleanup
– not all stereo artifacts are in camera; some are real-world etc. occlusions and reflections –> in both cases they are visible to one eye and not the other; creates an annoying effect and need to be dealt with.
Tools used included both rotoscoping and CGI
in this case: vfx was not involved in chosing shooting format.
Session 6: Summary
SD and tape (with the exception of HDCamSR?) are gone from post; soon from production?
Codec chaos…
Film?
In broadcast today, 1080i50 is the format — but not the format of the future.
How many pixels are enough?
Chosing a camera today is becoming as much a creative choice – much as chosing a film stock (Kodak vs. Fuji) was before
Next technological advancement on display side is autostereoscopic (no glasses) –> holoscopic interesting but still a ways off
Stereoscopic 3D is here to stay, but needs to be driven by story, not money!
Filebased –> leads to demands on coordination, integration and compatibility in order to allow effective creative sharing.
– key question is how to make the technology/infrastructure invisible so the creatives can get on with their work!
Archiving: digitise tapes or lose them. Film is still supreme on the theatrical side, but what will replace it? Very important to resolve this.
In broadcast, adminstrative and production worlds are moving closer – driven in part by consolidation of databases. How close should they get?
As an aside, this was the first time I used my iPad 2 as my primary computing device for an extended period. The laptop stayed in the hotel room while I wrote, checked mail, etc. on the iPad with my Logitech fold-up keyboard (Norwegian link). The battery lasted all day without trouble (used about 10% per hour when in use constantly – just as advertised).
