Many facial expressions by blendshape

Hello all,

I am working on making faces movies from neutral expression to many facial expressions.

I want to use the website(https://www.3dscanstore.com/index.php?route=product/product&product_id=535)'s 3d scans, but I have no idea how to morph the object files from neutral expression to other expressions.
Especially, I have a hard time making the eyes perfectly(same color as Row texture data).

Do you have any ideas to get perfect movies as early as possible?

Thank you,
Masa

Hello Masa,

The head model that you mentioned only contains a retopologized neutral expression. In order to blend between different expressions, you need to convert corresponding expression scans into the same topology. You can do that using an OpticalFlowWrapping node in Wrap3. After you have all the expressions in the same topology, blending between them can be done using Blendshape node in Wrap3 or in almost any 3D-software like Maya or 3DsMax.

Thank you for your great help.
I can know how to make it.

And I’m sorry my English is not good enough.
So, I think I can’t ask you the questions perfectly.

I’ll post the questions having the details and improving English later.

Hello all,
I rewrote the sentences. Thank you for reading my questions.

I bought the head scan data (URL:https://www.3dscanstore.com/index.php?route=product/product&path=90_93&product_id=535).
These data include

  • Mesh object data of neutral expression and texture of it (except eyes and teeth)
  • Mesh object data of the eyes and texture of it
  • Mesh object data of the teeth and texture of it
  • raw object data of neutral,smile,jaw open and eyes closed expressions and texture of them

My goal is to make facial expression changes closer to the raw face scan data.
So, I thought it was better to use Wrapping and Blendshape with Wrap3.

I can create the Blendshapes except eyes and teeth, however I have no idea how to match eyes, teeth and tongue to raw texture.
Especially the eyes texture of the purchased data is different from the eye texture of the raw texture. I want to unify the eyes texture of the raw data.

Do you have a way to wrapping the texture of only the eye or teeth part?

And, I would be pleased if you could tell me if there are other recommended methods.

Thank you,
Masa

Hello Masa,

I don’t think eyes or teeth texture should change depending on expression. I would take the same texture regardless of an expression.

I don’t know of any smart way to match eye rotation, tongue geometry and teeth transform automatically to a scan of expression. I think in most cases they are matched by animators inside a facial rig or by a facial capture system. Not sure if Wrap can solve this eye/tongue/teeth matching problem.

Dear Andrew Krovopuskov,

Thank you for your advises.

I don’t think eyes or teeth texture should change depending on expression too,
but the texture data of the eyes in the package is different from the texture of the raw data.
I want to make the texture closer to the raw data.

And, I’m wondering how to make teeth morphing.
Optical Flow Wrapping Tutorial Part 3 does not introduce a morphing method of teeth.

How do you usually do so?

Your advice is very helpful for me.
Thank you,
Masa