Texture Optical flow correction for blendshapes

Hi All,

i have a feature request that will solve a lot of headaches…

Blendshapes
Solving Meshes, This process solves half of our problem. We need to align the texture points , since during the projection process you cant keep the texture points at the same space in the uv, we need to post process the texture, otherwise, when you perform a blend between two facial expressions, you will get a “fade” effect in you difuse / normal, thats occours because your texture are not aligned perfectly… we need to perform an optical flow calculation to find the offset between those points (for the entire texture) and then apply these coorections to the mesh…

here you can find a link to a example of what i am talking about… http://www.filmicworlds.com/2014/03/25/facial-animation-gdc-slides/

would love to see a solution inside Wrap…

Thanks a lot

Hello! That’s an excelent point and we are working on the optical flow tool.
Here you can see our early test:
https://drive.google.com/file/d/0BxeSaP5E4JfvQmNQdm9VTC1qZms/view?usp=sharing
Please download the video for better quality. However this approach requires too much user interaction and we are working on making it much more robust and automatic.

WOW, Thats looks pretty good… is there any explanation about how it works?
is it possible to download and try it?

this will be a great update for the wrap.

thanks for repply

The solution in the video is not the best one, it still requires a lot of hand work. We do have a private test application of the old solution but it’s really painful to use. The new solution should be much robust and requires much less user interaction but we are only at the beginning of development.

Hello Andrew,

Do you have a beta for testing available?

Best,

Dan

Hello Dan,

I have just sent you an email with details on where to download the beta.

Hello Andrew,

is there any news on this topic?

it is possible to evaluate an optical flow demo version ?

thanks

Hey, we are very close to release of OpticalFlowWrapping node. You are welcome to participate in beta-testing, I’ll send you instructions in PM in a minute.

I would like to participate in beta testing. I’ll pm you my contact details

Thank you for your interest in beta-testing! Have just sent you instructions on the email!