A 3D study of mortality exploring new photographic processes, in this case photogrammetry. This project was the brain child of Marshmallow Laser Feast and created in collaboration with Analog, ourselves FBFX and the band Duologue. The project is the beginning of a deeper study by Marshmallow into filmmaking for the virtual reality environment. The entire video is CGI and created from photogrammetry scans.
Using our 94-camera high resolution scanning rig, we created a number of scans of model Beryl Nesbitt. The scans then went to MLF’s long-term VFX collaborators Analog where they snatched a magical moment of the sunset through a window (the Analog Studio toilet), as a spherical panoramic HDR photo. These 2 photographic processes combined in 3D software where the toilet sunset illuminated Berlys photo scanned form. Through a combined will to really push the boundaries we also decided to move the whole body rig in for a head scan. Aligning our 94 cameras close to Beryl’s head allowed us to capture the wonderful detail in her face and the striking look which is the centrepiece of the stunning video. We wanted to go beyond the limits of the audience’s eyeballs – using 3D to reveal different perspectives on the human form.
Photogrammetry pushes the boundaries forwards of 3D scanning. The rig we have built at FBFX allows us to capture scans of dynamic poses. This ability to capture detailed scans of people in motion is a real step forward in 3D scanning and moves the technology into a position where it is a powerful tool in the creative process. Most clearly seen in our work for the Nike Mercurial Boot with ManvsMachine (https://vimeo.com/95755233). Combined with the beautiful photo textures the process is helping produce some of the most hyper realistic computer graphics ever seen.
TECHNICAL DETAILS:
The female model was created using the photogrammetry scanning process at our base at Shepperton Studios. The system allows us to capture 360º 3D scans in 1/13,000th of a second, with 16k photorealistic textures. After taking a set of 94 images simultaneously, they are loaded into a photogrammetry software package called Agisoft. This reviews the pictures looking for distinct pixels, then matches identical pixels on different images and through triangulation creates a point cloud. A few steps later the software has generated a detailed 3D mesh of our scanned subject. The beauty of the system is its ability to capture scans while the subjects are moving, allowing for dynamic and detailed 3D models.
After some work in ZBrush the 3D assets were taken to our good friends Analog where they developed the textures, shaders and lighting. Extra ZBrush sculpting/detailing work was done for extreme close-up shots and huge 16k texture maps were painted with Mari.
Analog like to use the strengths of many 3D applications and this one was rendered entirely with Vray & 3DsMax – with the incredibly dense cloth simulations created using ‘Marvelous Designer’ at high frame rates & further speed interpolations done within 3dsmax.
Particular attention was paid to the eyes of the actress to enable extreme close-ups with multiple layers of hand sculpted Iris models. Thousands of tiny hairs were also created as separate render passes which could be added over the face and body areas. Compositing was done within NUKE, with final colour corrections and exports piped through AfterFX. The aim was always to carry this photo realism and detail through to the Realtime OCULUS RIFT environment and we look forward to revealing that later this year.
Links:
https://www.fbfxdigital.co.uk/#!duologue-memex/c1sem
https://www.marshmallowlaserfeast.com/
https://analogstudio.co.uk/work
https://www.duologuemusic.co.uk/
