Faceware Technologies

Faceware Technologies is an American company that designs facial animation and motion capture technology.[1][2] The company was established under Image Metrics and became its own company at the beginning of 2012.[3][4]

Faceware Technologies
FormerlyImage Metrics
IndustryEntertainment, software development
Founded2012
ProductsFacial Animation and Motion Capture (MoCap) Technology
Websitefacewaretech.com

Faceware produces software used to capture an actor's performance and transfer it onto an animated character, as well as hardware needed to capture the performances.[5] The software line includes Faceware Analyzer, Faceware Retargeter, and Faceware Live.[6][7]

Faceware software is used by film studios and video game developers including Rockstar Games, Bungie, Cloud Imperium Games, and 2K in games such as Grand Theft Auto V, Destiny, Star Citizen, and Halo: Reach.[6][8][9][10][11][12]

Through its application in the video game industry, Faceware won the Develop Award while it was still part of Image Metrics for Technical Innovation in 2008.[13] It won the Develop Award again for Creative Contribution: Visuals in 2014.[14] Faceware received Best of Show recognition at the Game Developers Conference 2011 in San Francisco[15] as well as Computer Graphics World's Silver Edge Award at SIGGRAPH 2014[16] and 2016.[17] Finally, Faceware won the XDS Gary Award in 2016 for its contributions to the Faceware-EA presentation at the 2016 XDS Summit.

History

Image Metrics, founded in 2000, is a provider of facial animation and motion capture technology within the video game and entertainment industries.[1][3] In 2008, Image Metrics offered a beta version of its facial animation technology to visual effects and film studios. The technology captured an actor's performance on video, analyzed it, and mapped it onto a CG model.[1][2] The release of the beta allowed studios to incorporate the facial animation technology into internal pipelines rather than going to the Image Metrics studio as they had in the past.[2][18] The first studio to beta test Image Metric's software in 2009 was the visual effects studio Double Negative out of London.[18]

In 2010, Image Metrics launched the facial animation technology platform Faceware. Faceware focused on increasing creative control, efficiency and production speed for animators. The software could be integrated into any pipeline or used with any game engine. Image Metrics provided training to learn the Faceware platform. The first studio to sign on as a Faceware customer was Bungie, which incorporated the software into its in-house production.[5] Image Metrics acquired FacePro in 2010, a company that provided automated lip synchronization which could be altered for accurate results, and Image Metrics integrated the acquired technology into its facial animation software.[19][20] Also in 2010, Image Metrics bought Character-FX, a character animation company.[8][21][22][23] Character-FX produced tools for use in Autodesk’s Maya and 3DS Max which aide in the creation of character facial rigs using an automated weighting transfer system that rapidly shifts facial features on a character to create lifelike movement.[4][8][23]

Image Metrics raised $8 million in funding and went public through a reverse merger in 2010 with International Cellular Industries. Image Metrics became wholly owned by International Cellular industries, which changed its name and took on facial animation technology as its sole line of business.[6][24][25] Faceware 3.0 was announced in March 2011. The upgrade included auto-pose, a shared pose database, and curve refinement.[26] Image Metrics led a workshop and presentation about Faceware 3.0 at the CTN Animation Expo 2011 titled "Faceware: Creating an Immersive Experience through Facial Animation."[27] Faceware's technology was displayed at Edinburgh Interactive in August 2011 to show its ability to add player facial animation from webcam or Kinect sensor into a game in real time.[28][29]

Image Metrics sold the Faceware software to its spinoff company, Faceware Technologies, in January 2012.[3][4] Following the spinoff, Faceware Technologies focused on producing and distributing its technology to professional animators.[3] The technology was tested through Universities, including the University of Portsmouth.[30]

Faceware launched its 3D facial animation tools, software packages Faceware Analyzer and Faceware Retargeter with the Head-Mounted Camera System (HMCS). Analyzer tracks and processes live footage of an actor and Retargeter transfers that movement onto the face of a computer-generated character. The Head-Mounted Camera System is not required to use the software. Six actors can be captured simultaneously.[31]

Faceware Live was shown for the first time at SIGGRAPH 2013.[32] It was created to enable the real-time capture and retargeting of facial movements. The live capture of facial performance can use any video source to track and translate facial expressions into a set of animation values and transfer the captured data onto a 3D animated character in real time.[7] In 2014, Faceware released Faceware Live 2.0. The update included the option to stream multiple characters simultaneously, instant calibration, improved facial tracking, consistent calibration, and support for high-frame-rate cameras.[33]

In 2015, Faceware launched a plugin for Unreal Engine 4 called Faceware Live. The company co-developed the plugin with Australia-based Opaque Multimedia. It makes motion capture of expressions and other facial movements possible with any video camera through Faceware's markerless 3D facial motion capture software.[34]

In 2016, Faceware announced the launch of Faceware Interactive, which is focused on the development of software and hardware that can be used in the creation of digital characters with whom real people can interact.[35]

Partners

Faceware Technologies partnered with Binari Sonori in 2014 to develop a video-based localization service.[36][37] Also in 2014, Faceware Technologies entered a global partnership with Vicon, a company focused on motion capture. The partnership would focus on developing new technology to expand into full-body motion capture data. The first step of the integration was to make the Faceware software compatible with Vicon's head rig, Cara, to allow data acquired from Cara to be processed and transferred into Faceware products.[38][39]

Overview

Faceware Technologies has two main aspects of facial animation software.[6]

Faceware Analyzer is a stand-alone single-camera facial tracking software that converts videos of facial motion into files that can be used for Faceware Retargeter. The Lite version of the software can automatically track facial movements which can be applied to 3D models with Faceware Retargeter. The Pro version can perform shot specific custom calibrations, import and export actor data, auto indicate tracking regions, and has server and local licensing options. The data captured by Faceware Analyzer is then processed in Faceware Retargeter.[6]

Faceware Retargeter 4.0 was announced in 2014. Faceware Retargeter uses facial tracking data created in Analyzer to create facial animation in a pose-based workflow. The upgrade has a plug-in for Autodesk animation tools, advanced character expression sets, visual tracking data, shared pose thumbnails, and batch processing. The Lite version of the Retargeter software transfers actor's performances onto animated characters and reduces and smooths key frames. The Pro version includes custom poses, intelligent pose suggestions, shared pose libraries, and the ability to backup and restore jobs.[6]

Faceware Live aims to create natural looking faces and facial expressions in real-time. Any video source can be used with the software's one-button calibration. The captured video is transferred onto a 3D animated character. This process combines image processing and data streaming to translate facial expressions into a set of animation values.[7][33]

Faceware has hardware options that can be rented or purchased. Available hardware is the entry level GoPro Headcam Kit and the Professional Headcam System.[6] The Indie Facial Mo-cap package includes hardware, a camera and headmount, and the tools to use it.[40]

Selected works

Faceware software is used by companies such as Activision-Blizzard, Bethesda, Ubisoft, Electronic Arts, Sony, Cloud Imperium Games, and Microsoft. Rockstar Games used the software in games such as Grand Theft Auto V and Red Dead Redemption and Bungie used Faceware in games including Destiny and Halo: Reach. Faceware has also been used in other games like XCOM2, Dying Light: The Following, Hitman, EA Sports UFC 2, Fragments for Microsoft's HoloLens, DOOM, Mirror's Edge Catalyst, Kingsglaive, F1 2016, ReCore, Destiny: Rise of Iron, Mafia III, Call of Duty Infinite Warfare, Killzone:Shadow Fall, NBA 2K10-2K17, Sleeping Dogs, Crysis 2 and 3, Star Citizen, and in movies like The Curious Case of Benjamin Button and Robert Zemeckis's The Walk.[6][8][9][10][31][41][42][43]

References
  1. "Image Metrics Launches Beta Version of Facial Animation Solution". Red Orbit. August 14, 2008. Retrieved May 5, 2015.
  2. "Image Metrics launches beta of its facial animation system". CG Press. Aug 13, 2008. Retrieved May 5, 2015.
  3. Dean Takahashi (January 19, 2012). "Image Metrics sells its Faceware face animation technology to spin-off". Venture Beat. Retrieved May 5, 2015.
  4. Rachel Weber (January 19, 2012). "Image Metrics launches spin-off company". Games Industry. Retrieved May 5, 2015.
  5. Eric Caoili (March 8, 2010). "Pre-GDC: Image Metrics Launches Faceware, Signs Bungie". Gamasutra. Retrieved May 5, 2015.
  6. Randall Newton (October 3, 2013). "Faceware upgrades facial motion capture product line". Graphic Speak. Retrieved May 5, 2015.
  7. "Face Off With Faceware Live". Organic Motion. Retrieved May 5, 2015.
  8. Dean Takahashi (June 30, 2010). "Image Metrics Acquires Character-FX to build realistic 3D game avatars". Venture Beat. Retrieved May 5, 2015.
  9. David Veselka (March 20, 2014). "Destiny to Use Faceware Tech For Increased Character Detail". Mp1st. Retrieved May 5, 2015.
  10. Alex Osborn. "Interview: Faceware's Peter Busch Talks Motion Capture for Destiny". GameRevolution. Retrieved May 5, 2015.
  11. Alex Osborn. "Interview: Faceware's Peter Busch Talks Motion Capture for Destiny". Game Revolution. Retrieved May 6, 2015.
  12. "Cloud Imperium Games Adds Faceware Player-Driven Facial Animation To 'Star Citizen'". Tom's Hardware. 2017-08-25. Retrieved 2017-08-26.
  13. "Develop Awards 2008". Games Industry. July 31, 2008. Retrieved April 21, 2015.
  14. Rob Crossley (August 11, 2011). "'Your face is animation's future' - Image Metrics". Develop. Retrieved May 6, 2015.
  15. David Scarpitta (April 14, 2011). "Image Metrics' FACEWARE 3.0 Named 'Best of Show' at GDC 2011". Das Reviews. Retrieved April 20, 2015.
  16. "CGW Announces Silver Edge Winners from SIGGRAPH 2014". CGW. August 20, 2014. Retrieved April 20, 2015.
  17. "Computer Graphics World Selects SIGGRAPH 2016 Best of Show | Computer Graphics World". www.cgw.com. Retrieved 2016-12-13.
  18. "Image Metrics and Double Negative testing markerless facial capture". Variety. March 3, 2009. Retrieved May 5, 2015.
  19. "Image Metrics Acquires Leading Lip Sync Technology Company FacePro". .Net Developer's Journal. August 5, 2010. Retrieved May 5, 2015.
  20. Tom McLean (August 6, 2010). "Image Metrics Seals Deal for Lip-Syncers FacePro". Animation Magazine. Retrieved May 5, 2015.
  21. Kathleen Maher (March 29, 2011). "Image Metrics looks for new opportunities". Graphic Speak. Retrieved May 5, 2015.
  22. David Jenkins (July 1, 2010). "Image Metrics acquires facial animation firm Character-FX". Games Industry. Retrieved May 5, 2015.
  23. "Character-FX sold to Image Metrics". Broadcast Now. July 6, 2010. Retrieved May 5, 2015.
  24. "What is the history of Image Metrics Inc and the latest information about Image Metrics Inc?". Beaver Creek News. Retrieved May 6, 2015.
  25. David Jenkins (March 11, 2010). "Image Metrics settles $8 million funding deal". Games Industry. Retrieved May 6, 2015.
  26. "Image Metrics' Faceware 3.0 Facial Animation Software Now Available". Computer Graphics World. March 1, 2011. Retrieved May 6, 2015.
  27. "Image Metrics to Host Faceware Demos and Workshop at CTN Animation Expo 2011". Develop. Retrieved April 21, 2015.
  28. Connor Beaton (August 11, 2011). "Image Metrics To Reinvent Facial Animation". zConnection International. Retrieved May 6, 2015.
  29. James Batchelor (April 29, 2014). "Almost 140 companies shortlisted for the 2014 Develop Awards across 24 categories – are you among them?". Develop. Retrieved May 6, 2015.
  30. Chris McMahon. "Faceware rolls out new educational program". 3D Artist Online. Retrieved May 5, 2015.
  31. Jim Thacker (May 31, 2012). "Faceware launches facial animation tools line-up". CG Channel. Retrieved May 5, 2015.
  32. Jon K. Carroll (July 29, 2013). "SIGGRAPH 2013: Faceware Technologies Debuts Faceware Live". Tom's Hardware. Retrieved May 5, 2015.
  33. Jim Thacker (August 8, 2014). "Faceware Technologies ships Faceware Live 2.0". CG Channel. Retrieved May 5, 2015.
  34. Carbotte, Kevin (August 11, 2015). "Facial Motion Capture In Unreal Engine Can Now Be Done With Any Camera". TomsHardware. Retrieved September 16, 2015.
  35. Hurst, Adriene. "Faceware's Interactive Division to Focus on Live-to-Virtual Interactions". www.digitalmediaworld.tv. Retrieved 2016-12-13.
  36. "Faceware Technologies Partners with Binari Sonori to Offer New Video-Based Localization Service". Gaming Bolt. April 30, 2014. Retrieved May 5, 2015.
  37. "Faceware & Binari Sonori Talk the Talk on Video Voice Localization". Digital Media World. Archived from the original on March 20, 2015. Retrieved May 5, 2015.
  38. "Faceware and Vicon Partner to Improve Facial & Full-Body Mocap". Digital Media World. January 28, 2014. Archived from the original on May 30, 2015. Retrieved May 5, 2015.
  39. Brittany Hillen (January 28, 2014). "Faceware and Vicon pair up motion capture products in new partnership". Slash Gear. Retrieved May 5, 2015.
  40. Will Freeman (April 29, 2014). "The Facial animation firm has conceived a new offering for indies and mobile teams. Peter Busch tells Develop what it delivers". Develop. Retrieved May 6, 2015.
  41. "Step-by-step: a walkthrough of The Walk". fxguide. 2015-10-11. Retrieved 2016-12-13.
  42. "Faceware Launches the Indie Facial Mocap Package for Mobile Game Devs". Game Academy. March 5, 2014. Retrieved May 5, 2015.
  43. Jennifer Wolfe (March 6, 2014). "Faceware Tech Launches New Indie Facial Mocap Package". Animation World Network. Retrieved May 5, 2015.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.