Research Projects of I-Chen Lin

Ongoing projects at CAIG Lab, NCTU

Realistic 3D Facial Animation

Our goal is to synthesize realistic facial animation. To achieve the goal, we research on advanced face modeling, facial motion analysis/capture, model deformation and realistic rendering.

Character Motion Analysis and Synthesis

This research project is to tackle problems in character motion synthesis (from motion transition, motion blending, motion adjustment, to motion compression). We're also interested in motion effects on characters' appearance.

Image-based and Interactive 3D Modeling

This project focuses on rapid and accurate 3D scene reconstruction, modeling complex objects (e.g. plants) and advanced modeling interfaces.

My work at CMLab, NTU

Mirror Mocap
Automatic and efficient extraction of dense 3D facial animation parameters
  • Automatic tracking more than 300 facial markers with detection/rectification of false trajectories.
  • Efficient tracking on a regular PC (300 markers at 9.2fps on Pentium4 PC)

(* with demo video, instruction and executable program download)

Realistic 3D FAPs
Extracting 3D facial animation parameters from mirror-reflected multi-view video clips
  • An accurate algorithm for reconstruction of planar mirrors' structures and markers' 3D positions.
  • Semi-automatic facial motion tracking (50 markers).

(* with demo video)

VR Talk
A Web-enabled and speech-driven talking head system
  • low-bit-rate requirement.
  • 6Kbps including animation and voice.

(* with on-line demo plug-ins)

 

Go back to I-Chen Lin's main page