Were you mesmerised by the controversial digital humans in 'Rogue One,'? Industrial Light & Magic (ILM)'s achievement in setting a new level of photoreal facial animation impressed viewers and evidently, the effort involved has reaped success. In fact, the same facial performance-capture solving system (developed at ILM by Kiran Bhat, Michael Koperwas, Brian Cantwell, and Paige Warner) will be among the Academy’s 18 Sci-Tech honorees this year.
On February 11, Academy of Motion Picture Arts and Sciences will present awards at Beverly Hills. For India, these awards will hold a special value - as among the award winners is Tamil Nadu's Kiran Bhat, the Kovai engineer.
But, do you know who is Kiran Bhat?
Business Standard brings to you everything you need to know about this 41-year-old techie, who has made the country proud.
1. Kiran Bhat is an alumnus of Stanes Anglo Indian School in Coimbatore
2. Bhat went on to do his double degree in EEE and Mechanical Engineering at BITS Pilani and his PhD in robotics and artificial intelligence from the School of Computer Science, Carnegie Mellon University, Pittsburg.
3. Kiran along with his team from ILM developed the facial performance-capture system.
4. Kiran quit ILM almost a year ago and has started his own venture Loom.ai. His company enables a new era of virtual communication by automatically converting selfies into expressive 3D avatars. The animatable and expressive faces can be used to power applications in VR, gaming, messaging, e-commerce and virtual classrooms for individuals and businesses around the world.
5. He has also built a technology for creating personalised and 3D digital avatars from photographs that can be plugged into games, messaging bots, social virtual reality and e-commerce.
6. In an interview to The Hindu, Kiran Bhat said, "I was always fascinated with understanding movement and nature. So, studying facial movements and representing it in a computer felt like the ultimate challenge in this aspect."
7. He currently resides in San Francisco, California.
Where has this technology been used?
Kiran said, in a report published in The Times of India, "This was first used in Avengers for the character Hulk where we captured the expressions of Mark Ruffalo. A helmet fit with two cameras was placed on Ruffalo's head when he acted on the set. With this, we transferred Raffalo's expressions into the digital character."
Photoreal facial animation was also used in other movies like Pirates of the Caribbean, Teenage Mutant Ninja Turtle, Warcraft, Star Wars Episode VII and Star Wars Rogue One.
While in Avengers, Hulk was created with Mark Ruffalo, a person who is alive, in Star Wars Rogue One, Peter Cushing was recreated. "We sought help of Guy Henry who studied Peter Cushing's work. He enacted like him and we captured his expressions," said Kiran.
What is Photoreal facial animation technology?
This system enables high-fidelity facial performance transfer from actors to digital characters in large-scale productions while retaining full artistic control, and integrates stable rig-based solving and the resolution of secondary detail in a controllable pipeline.
Ever since the announcement, social media has been abuzz with congratulatory messages for Kiran.
Here are some tweets from the techie's new fanbase: