Skip to content

Latest commit

 

History

History
745 lines (613 loc) · 17.4 KB

README.md

File metadata and controls

745 lines (613 loc) · 17.4 KB
Raw

FACSHuman v0.0.1 Alpha

FACSHuman plugin for MakeHuman project

Create pictures and videos of facial expressions for your experiments.

This work is based on the Facial Action coding System :

Ekman, P., Friesen, W. V., & Hager, J. C. (2002). Facial action coding system. A Human Face.

This plugin allow you to create facial expressions by moving the corresponding Action Units (AU) described in the FACS Manual. Additional plugins are available to create scene (lights placement and lights colors) and animations.

Paper

Please cite the following paper if you use this plugin for your research :

Gilbert, M., Demarchi, S., & Urdapilleta, I. (2021). FACSHuman, a software program for creating experimental material by modeling 3D facial expressions. Behavior Research Methods. https://doi.org/10.3758/s13428-021-01559-9 Pdf is available here : https://link.springer.com/content/pdf/10.3758/s13428-021-01559-9.pdf

The conference

Gilbert, M., Demarchi, S., & Urdapilleta, I. (2018). FACSHuman a Software to Create Experimental Material by Modeling 3D Facial Expression. Proceedings of the 18th International Conference on Intelligent Virtual Agents - IVA ’18, 333‑334. https://doi.org/10.1145/3267851.3267865 - ISBN: 978-1-4503-6013-5

  1. https://iva2018.westernsydney.edu.au/
  2. https://dl.acm.org/citation.cfm?id=3267865#

Link to my profile

https://www.researchgate.net/profile/Michael_Gilbert10

Documentation

Get started

Download and install MakeHuman from here http://www.makehumancommunity.org/content/downloads.html and follow the instructions for your Operating System.

Then start MakeHuman once to create the MH directory in your home/YOURUSER/Document/

For MH

If you have any questions about the installation and the use of this software :

http://www.makehumancommunity.org/wiki/Main_Page

http://www.makehumancommunity.org/forum/

FACSHuman Installation

Main files (the core)

Put this files inside the plugin directory of your MH installation (not in the plugin directory of MH in USER/Document/makehuman)

File Usage
7_FACSHuman.py (main program)
8_FACSAnim.py (to create facial animation)
9_FACS_scene_editor.py (to edit/create scene)

Target files of the AUs

All the FACSHuman target files were created with Blender and the MH tools for Blender.

Place targets files directory into :

For lastest version of MH :

/home/YOUR_USER/Documents/makehuman/YOUR_NUMBER/data/FACSHuman/

For earlier versions :

/home/YOUR_USER/Documents/makehuman/data/FACSHuman/

This directory contains :

  • 00 Emotions
  • 01 Upper Face AUs
  • 02 Lower Face AUs
  • 03 Lip Parting and Jaw Opening
  • 04 Eye Positions
  • 05 Head Positions
  • 06 Miscellaneous AUs
  • au.json
  • black.jpg

Whithout these files plugins do not work

Additional ressources

Teeth, eyes, eylashes and tongue are modified versions of materials assets from the http://www.makehumancommunity.org/

Place directories in :

for lastest version of MH :

/home/YOUR_USER/Documents/makehuman/YOUR_NUMBER/data/...

for earlier versions :

/home/YOUR_USER/Documents/makehuman/data/...

Teeth

In order to avoid teeth distortion (original models) when you use mouth opening AUs, you need to use the modified facs models.

Place it in /teeth

This directory contains :

  • FACSTeeth01
  • FACSTeeth01a
  • FACSTeeth01b
  • FACSTeeth02
  • FACSTeeth02a
  • FACSTeeth02b
  • FACSteeth03
  • FACSteeth03_bw
  • FACSteeth04

Eyes

Place it in /eyes

This directory contains :

  • black_map.png
  • /eyes_no_cornea
  • /facs-poly
  • makehuman_eye_specular.png
  • makehuman_eye_specular2.png
  • /materials
  • /real_pupil_no-cornea
  • specular_map.png
  • specular_map_invert.png
  • specular_map_white_b.png

Eyelashes

Place it in /eyelashes

This directory contains :

  • FACSEyeLashes01

Tongue

Place it in /tongue

This directory contains :

  • FACSTongue
  • FACSTongue_bw (black and white model)

Custom

Place it in /custom

This directory contains :

  • close_lips.target

This target is useful to close the small gap between lips of the MH model.

Additional installations

FACSvatar

An Open Source Modular Framework From Face to FACS Based Avatar Animation (Unity3D / Blender) More on FACSvatar: https://github.com/NumesSanguis/FACSvatar

FFmpeg

If you want to use the video production inside FACSHuman you need to install FFmpeg tools :

https://ffmpeg.org/about.html

and put this software into the path of your computer.

You will find the procedure on the net depending of your operating system.

Information

https://www.michaelgilbert.fr/facshuman/

FACSHuman is a plugin for Makehuman.

If you have any questions please contact me not the MH Team

Demo videos

More tutorials videos will be available soon.

All AUs demonstration

IMAGE ALT TEXT HERE

Full demo

IMAGE ALT TEXT HERE

FACSvatar Datas

IMAGE ALT TEXT HERE

https://www.youtube.com/channel/UCEAepvD886XqB6wikmXW8Qg

Usable Action Units in FACSHuman

Table 1: Usable Action Units in FACS
Action units Simple Right / Left Alternative
Upper Face AUs      
1 Inner Brow Raise X X X
2 Outer Brow Raise X X X
4 Brow Lowerer X X X (41,42,44)
5 Upper Lid Raise X X  
6 Cheek Raise X X X (2)
7 Lids Tight X X  
43 Eye Closure X X  
45 Blink Use 43 Use 43  
46 Wink Use 43 Use 43  
70 Brows Not Visible - - -
71 Eyes Not Visible - - -
Head Positions      
51 Turn Left X    
52 Turn Right X    
53 Head Up X    
54 Head Down X    
55 Tilt Left X    
56 Tilt Right X    
57 Forward X    
58 Back X    
Eye Positions      
61 Eyes Left X X  
62 Eyes Right X X  
63 Eyes Up X X  
64 Eyes Down X X  
65 Walleye X    
66 Crosseye      
Lip Parting and Jaw Opening      
25 Lips Part X X X
26 Jaw Drop X   X(4)
27 Mouth Stretch Use 26    
Table 2: Lower Face and Miscellaneous Action Units
Action units Simple Right / Left Alternative
Lower Face AUs      
9 Nose Wrinkle X X X
10 Upper Lip Raiser X + 25 X  
11 Nasolabial Furrow Deepener X X  
12 Lip Corner Puller X X X(2)
13 Sharp Lip Puller X X  
14 Dimpler X X  
15 Lip Corner Depressor X X  
16 Lower Lip Depress X X  
17 Chin Raiser X   X
18 Lip Pucker X   X
20 Lip Stretch X    
22 Lip Funneler X   X(2)
23 Lip Tightener X    
24 Lip Presser X    
28 Lips Suck X   X(2)
72 Lower Face Not Visible - - -
Miscellaneous AUs      
8 Lips Toward Each Other - - -
19 Tongue Show X + 26    
21 Neck Tightener - - -
29 Jaw Thrust X    
30 Jaw Sideways X    
31 Jaw Clencher X    
32 Bite X    
33 Blow X    
34 Puff X    
35 Cheek Suck X    
36 Tongue Bulge - - -
37 Lip Wipe - - -
38 Nostril Dilate X    
39 Nostril Compress X    
Table 3: Additional Action Units
FACSHuman Simple Right / Left Alternative
pupils dilatation X X  
pupils constriction X X  
Table 4: Table of legends
X : Usable in the module
-  : non implemented
+ : Usable with …
(Num) : Alternative Action units