Pro Nov 2024 MC
October 30, 2024
The Ultimate Guide to Creating ARKit 52 Facial Blendshapes
Learn how to create and use ARKit blendshapes, focusing on their connection to the Facial Action Coding System (FACS). Bring human-like emotions to your digital characters using the 52 ARKit blendshapes for realistic facial expressions.
Created by
Pooya Deperson
Product Designer
Melinda Ozel
Expression Expert
The assets and information on this page are the result of research, curation, and the integration of multiple resources.
The Louise head model is available for free at eisko.com/louise
The Claire head model is available for free at nvidia.com/omniverse
What are ARKit 52 facial blendshapes?
Apple ARKit's 52 facial blendshapes are a set of predefined expressions designed for creating realistic facial animations. Widely used in AI-powered motion capture, multi-camera rigs, and laser marker systems.
Blendshapes, often referred to as "morph targets" control vertex movements on a scale from 0.0 to 1.0. At 0.0, the face is in its neutral state "eyes open & mouth closed"), while at 1.0, it represents a distinct expression (e.g., left eye closed).
Blendshapes terminology in 3D softwares
Blendshapes are called Morph Targets in 3ds Max, Shape Keys in Blender, Blend Shapes in Maya and Houdini, and PoseMorph in Cinema 4D. Although the names vary, they all serve the same function.
Creating a Blendshape is a technique used by 3D artists to store the movement of vertices from their initial position (0.0) to their final position (1.0).
Face Blendshapes
The order of Blendshapes in the 3D software doesn't affect the result.
Resources & attribution
The 3D assets featured on this page were essential, and completing it would not have been possible without these incredible resources.
Classification of Mouth Action Units: Using Local Binary Patterns
https://www.semanticscholar.org/paper/Classification-of-Mouth-Action-Units%3A-Using-Local-Bargal/d0e895a272d684a91c1b1b1af29747f92919d823
Extraocular Muscles,Eyewiki
https://eyewiki.org/Extraocular_Muscles
Action Unit Reference, Py-feat
https://py-feat.org/pages/au_reference.html
Facial action coding system, iMotions
https://imotions.com/blog/learning/research-fundamentals/facial-action-coding-system/#head-movement-action-units
Melinda Ozel, Expression Researcher & Educator
https://melindaozel.com/
Polygonal mind creating blendshapes for VRchat
https://www.polygonalmind.com/blog/creating-a-vrchat-avatar-with-blend-shapes-visemes
ARKit face blendshapes
https://arkit-face-blendshapes.com/
Hinzka haten blog iPhone blendshapes
https://hinzka.hatenablog.com/entry/2020/06/15/072929
Vroid Studio 3D Character Creation Studio
https://vroid.com/en/studio
VMagicMirror Perfect Sync Tips
https://malaybaku.github.io/VMagicMirror/en/tips/perfect_sync/
クリックで実装！パーフェクトシンク BY HANA Tool
https://hinzka.hatenablog.com/entry/2020/10/12/014540
VRM format
https://vrm.dev/en/
Apple Official Developer Documentation on ARKit Facial Blendshapes
https://developer.apple.com/documentation/arkit/arfaceanchor/blendshapelocation
Dr.G Bhanu Prakash Animated Medical Videos
https://www.youtube.com/watch?v=KW7U9DK8HZk
Software used
This project was completed using various 3D software tools and rendering methods, detailed below.
BlendshapebrowDownLeft
FACS Action UnitAU4 brow lowerer
ARKit DetailsThe coefficient describing downward movement of the outer portion of the left eyebrow.
Muscle(s) & AU Functioncorrugator supercilii, depressor supercilii, procerus. Lowers and knits the brows.
BlendshapebrowDownRight
Action UnitAU4 brow lowerer
ARKit DetailsThe coefficient describing downward movement of the outer portion of the right eyebrow.
Muscle(s) & AU Functioncorrugator supercilii, depressor supercilii, procerus. Lowers and knits the brows.
BlendshapebrowInnerUp
Action UnitAU1 inner brow raiser
ARKit DetailsThe coefficient describing upward movement of the inner portion of both eyebrows.
Muscle(s) & AU Functionfrontalis, medial portion. Raises the inner eyebrow area.
BlendshapebrowOuterUpLeft
Action UnitAU2 outer brow raiser
ARKit DetailsThe coefficient describing upward movement of the outer portion of the left eyebrow.
Muscle(s) & AU Functionfrontalis, lateral portion. Raises the outer eyebrow area.
BlendshapebrowOuterUpRight
Action UnitAU2 outer brow raiser
ARKit DetailsThe coefficient describing upward movement of the outer portion of the right eyebrow.
Muscle(s) & AU Functionfrontalis, lateral portion. Raises the outer eyebrow area.
BlendshapeeyeBlinkLeft
Action UnitAU43 eye closureAU45 blink
ARKit DetailsThe coefficient describing closure of the eyelids over the left eye.
Muscle(s) & AU Functionrelaxation of levator palpebrae superioris and contraction of the palpebral portion of orbicularis oculi. AU45 briefly closes the eyelids, while AU43 closes them for longer.
BlendshapeeyeLookDownLeft
Action UnitAU64 eyes down
ARKit DetailsThe coefficient describing movement of the left eyelids consistent with a downward gaze.
Muscle(s) & AU Functioninferior rectus & superior oblique. Involves the downward gaze of the eyes.
BlendshapeeyeLookInLeft
Action UnitM62 eyes turn right
ARKit DetailsThe coefficient describing movement of the left eyelids consistent with a rightward gaze.
Muscle(s) & AU Functionmedial rectus. Involves the rightward gaze of the eyes.
BlendshapeeyeLookOutLeft
Action UnitM61 eyes turn left
ARKit DetailsThe coefficient describing movement of the left eyelids consistent with a leftward gaze.
Muscle(s) & AU Functionlateral rectus . The action of M61 involves the leftward gaze of the eyes.
BlendshapeeyeLookUpLeft
Action UnitM63 eyes up
ARKit DetailsThe coefficient describing movement of the left eyelids consistent with an upward gaze.
Muscle(s) & AU Functionsuperior rectus, inferior oblique. Involves the upward gaze of the upward gaze of the eyes.
BlendshapeeyeSquintLeft
Action UnitAU7 lid tightener
ARKit DetailsThe coefficient describing contraction of the face around the left eye.
Muscle(s) & AU Functionorbicularis oculi, palpebral portion. Narrows the eye opening primarily via the raising of the lower eyelid.
BlendshapeeyeWideLeft
Action UnitAU5 upper lid raiser
ARKit DetailsThe coefficient describing a widening of the eyelids around the left eye.
Muscle(s) & AU Functionlevator palpebrae superioris. Widens the eye opening by raising the upper eyelid.
BlendshapeeyeBlinkRight
Action UnitAU45 blinkAU43 eye closure
ARKit DetailsThe coefficient describing closure of the eyelids over the right eye.
Muscle(s) & AU Functionrelaxation of levator palpebrae superioris and contraction of the palpebral portion of orbicularis oculi. AU45 briefly closes the eyelids, while AU43 closes them for longer.
BlendshapeeyeLookDownRight
Action UnitM64 eyes down
ARKit DetailsThe coefficient describing movement of the right eyelids consistent with a downward gaze.
Muscle(s) & AU Functioninferior rectus & superior oblique. Involves the downward gaze of the eyes.
BlendshapeeyeLookInRight
Action UnitM61 eyes turn left
ARKit DetailsThe coefficient describing movement of the right eyelids consistent with a leftward gaze.
Muscle(s) & AU Functionmedial rectus. Involves the leftward gaze of the eyes.
BlendshapeeyeLookOutRight
Action UnitM62 eyes turn right
ARKit DetailsThe coefficient describing movement of the right eyelids consistent with a rightward gaze.
Muscle(s) & AU Functionlateral rectus. Involves the rightward gaze of the eyes.
BlendshapeeyeLookUpRight
Action UnitM63 eyes up
ARKit DetailsThe coefficient describing movement of the right eyelids consistent with an upward gaze.
Muscle(s) & AU Functionsuperior rectus, inferior oblique. Involves the upward gaze of the upward gaze of the eyes.
BlendshapeeyeSquintRight
Action UnitAU7 lid tightener
ARKit DetailsThe coefficient describing contraction of the face around the left eye.
Muscle(s) & AU Functionorbicularis oculi, palpebral portion. Narrows the eye opening primarily via the raising of the lower eyelid.
BlendshapeeyeWideRight
Action UnitAU5 upper lid raiser
ARKit DetailsThe coefficient describing a widening of the eyelids around the left eye.
Muscle(s) & AU Functionlevator palpebrae superioris. Widens the eye opening by raising the upper eyelid.
BlendshapejawForward
Action UnitAD29 thrust
ARKit DetailsThe coefficient describing forward movement of the lower jaw.
Muscle(s) & AU Functionpterygoids (and some masseter). Pushes the lower jaw forward.
BlendshapejawLeft
Action UnitAD30 jaw sideways
ARKit DetailsThe coefficient describing leftward movement of the lower jaw.
Muscle(s) & AU Functionpterygoids and temporalis. Moves the jaw to the side (either left or right).
BlendshapejawRight
Action UnitAD30 jaw sideways
ARKit DetailsThe coefficient describing rightward movement of the lower jaw.
Muscle(s) & AU Functionpterygoids and temporalis. Moves the jaw to the side (either left or right).
BlendshapejawOpen
Action UnitAU26 jaw dropAU27 mouth stretch
ARKit DetailsThe coefficient describing an opening of the lower jaw.
Muscle(s) & AU FunctionAU26: relaxation of masseter, temporalis, and internal pterygoid, AU27: lateral pterygoid and the suprahyoid muscles. AU26 moderately lowers the jaw through relaxation, while AU27 forcefully lowers it further. AU26 represents mild jaw opening, and AU27 marks the extreme end of the spectrum.
BlendshapejawRight
Action UnitAU8 lips toward each otherAU26 jaw drop/AU27 mouth stretch
ARKit DetailsThe coefficient describing closure of the lips independent of jaw position.
Muscle(s) & AU FunctionAU8: orbicularis oris, AU26: masseter, relaxed temporalis & relaxed internal pterygoid, AU27: pterygoids, digastric. Brings the lips together by lowering the upper lip & raising the lower lip.
BlendshapemouthClose
Action UnitAU 22 lip funneler
ARKit DetailsThe coefficient describing contraction of both lips into an open shape.
Muscle(s) & AU Functionorbicularis oris. Projects & fans the lips outward.
BlendshapemouthPucker
Action UnitAU18 lip pucker
ARKit DetailsThe coefficient describing contraction and compression of both closed lips.
Muscle(s) & AU Functionincisivus labii superioris, incisivus labii inferioris. Draws the lip corners toward each other causing the fleshy part of the lips to protrude.
BlendshapemouthLeft
Action UnitN/A a mixture of actions
ARKit DetailsThe coefficient describing leftward movement of both lips together.
Muscle(s) & AU FunctionN/A: a mixture of asymmetric muscle contractions on each side of the face.
BlendshapemouthRight
Action UnitN/A a mixture of actions
ARKit DetailsThe coefficient describing rightward movement of both lips together.
Muscle(s) & AU FunctionN/A: a mixture of asymmetric muscle contractions on each side of the face.
BlendshapemouthSmileLeft
Action UnitAU12 lip corner puller
ARKit DetailsThe coefficient describing upward movement of the left corner of the mouth.
Muscle(s) & AU Functionzygomaticus major. Draws the lip corners up, back, & laterally.
BlendshapemouthSmileRight
Action UnitAU12 lip corner puller
ARKit DetailsThe coefficient describing upward movement of the right corner of the mouth.
Muscle(s) & AU Functionzygomaticus major. Draws the lip corners up, back, & laterally.
BlendshapemouthFrownLeft
Action UnitAU15 lip corner depressor
ARKit DetailsThe coefficient describing downward movement of the left corner of the mouth
Muscle(s) & AU Functiondepressor anguli oris. Draws the lip corners downard.
BlendshapemouthFrownRight
Action UnitAU15 lip corner depressor
ARKit DetailsThe coefficient describing downward movement of the right corner of the mouth.
Muscle(s) & AU Functiondepressor anguli oris. Draws the lip corners downard.
BlendshapemouthDimpleLeft
Action UnitAU14 Dimpler
ARKit DetailsThe coefficient describing backward movement of the left corner of the mouth.
Muscle(s) & AU Functionbuccinator. Draws the lip corners back against the teeth.
BlendshapemouthDimpleRight
Action UnitAU14 Dimpler
ARKit DetailsThe coefficient describing backward movement of the right corner of the mouth.
Muscle(s) & AU Functionbuccinator. Draws the lip corners back against the teeth.
BlendshapemouthStretchLeft
Action UnitAU20 lip stretcher
ARKit DetailsThe coefficient describing leftward movement of the left corner of the mouth.
Muscle(s) & AU Functionrisorius. Draws the lip corners laterally, stretching the fleshy part of the lips.
BlendshapemouthStretchRight
Action UnitAU20 lip stretcher
ARKit DetailsThe coefficient describing leftward movement of the left corner of the mouth.
Muscle(s) & AU Functionrisorius. Draws the lip corners laterally, stretching the fleshy part of the lips.
BlendshapemouthRollLower
Action UnitAU28 lip suck (bottom)
ARKit DetailsThe coefficient describing movement of the lower lip toward the inside of the mouth.
Muscle(s) & AU Functionorbicularis oris. The bottom portion of AU28 draws the lower lip into the mouth opening, wrapping it around the lower teeth.
BlendshapemouthRollLower
Action UnitAU28 lip suck (top)
ARKit DetailsThe coefficient describing movement of the upper lip toward the inside of the mouth.
Muscle(s) & AU Functionorbicularis oris. The top portion of AU28 draws the upper lip into the mouth opening, wrapping it around the upper teeth.
BlendshapemouthShrugLower
Action UnitAU17 chin raiser
ARKit DetailsThe coefficient describing outward movement of the lower lip.
Muscle(s) & AU Functionmentalis. Pushes up the lower lip and chin area.
BlendshapemouthShrugUpper
Action UnitAU17 chin raiser
ARKit DetailsThe coefficient describing outward movement of the upper lip.
Muscle(s) & AU Functionmentalis. Pushes up the lower lip and chin area.
BlendshapemouthPressLeft
Action UnitAU24 lip presser
ARKit DetailsThe coefficient describing upward compression of the lower lip on the left side.
Muscle(s) & AU Functionorbicularis oris. Presses the upper and lower lips against each other.
BlendshapemouthPressRight
Action UnitAU24 lip presser
ARKit DetailsThe coefficient describing upward compression of the lower lip on the right side.
Muscle(s) & AU Functionorbicularis oris. Presses the upper and lower lips against each other.
BlendshapemouthLowerDownRight
Action UnitAU16 lower lip depressor
ARKit DetailsThe coefficient describing downward movement of the lower lip on the right side.
Muscle(s) & AU Functiondepressor labii inferioris. Draws the lower lip downward and laterally.
BlendshapemouthLowerDownLeft
Action UnitAU16 lower lip depressor
ARKit DetailsThe coefficient describing downward movement of the lower lip on the left side.
Muscle(s) & AU Functiondepressor labii inferioris. Draws the lower lip downward and laterally.
BlendshapemouthUpperUpLeft
Action UnitAU10 upper lip raiser
ARKit DetailsThe coefficient describing upward movement of the upper lip on the left side.
Muscle(s) & AU Functionlevator labii superioris. AU10 lifts the top, more laterally than AU9 but more medially than AU11.
BlendshapemouthUpperUpRight
Action UnitAU10 upper lip raiser
ARKit DetailsThe coefficient describing upward movement of the upper lip on the right side.
Muscle(s) & AU Functionlevator labii superioris. AU10 lifts the upper lip, more laterally than AU9 but more medially than AU11.
BlendshapecheekPuff
Action UnitAD34 puff
ARKit DetailsThe coefficient describing outward movement of both cheeks.
Muscle(s) & AU Functionbuccinator, orbicularis oris. Expands the cheeks by forcing air into them.
BlendshapecheekSquintLeft
Action UnitAU6 cheek raiser
ARKit DetailsThe coefficient describing upward movement of the cheek around and below the left eye.
Muscle(s) & AU Functionorbicularis oculi, orbital portion. Tightens the outer rings of the eye orbit and squeezes the lateral eye corners.
BlendshapecheekSquintRight
Action UnitAU6 cheek raiser
ARKit DetailsThe coefficient describing upward movement of the cheek around and below the right eye.
Muscle(s) & AU Functionorbicularis oculi, orbital portion. Tightens the outer rings of the eye orbit and squeezes the lateral eye corners.
BlendshapenoseSneerLeft
Action UnitAU9 nose wrinkler
ARKit DetailsThe coefficient describing a raising of the left side of the nose around the nostril.
Muscle(s) & AU Functionlevator labii superioris alaeque nasi. Lifts the sides of the nose, nostrils, and central upper lip area.
BlendshapenoseSneerRight
Action UnitAU9 nose wrinkler
ARKit Detailslevator labii superioris alaeque nasi. Lifts the sides of the nose, nostrils, and central upper lip area.
Muscle(s) & AU FunctionThe coefficient describing a raising of the right side of the nose around the nostril.
