Will we have 3D Selfies soon?

in #science7 years ago (edited)

It looks like 3D Selfies will come very soon thanks to a technology developed by a group of scientists from the universities of Nottingham and Kingston.

obama.jpg

Unlike how it is currently done 3D reconstruction of the image of a face where you normally need photos from various angles of the same and the machine must establish parallels and concordances between images through complex algorithms, the team of scientists decided to use another method. They decided to train a Neural Convolutional Network (CNN) with 2D images of faces and scanning or 3D facial models of them.

training-cnn.jpg
Credit

Thanks to being convolucional has memory therefore this CNN ...

... works with just a single 2D facial image, does not require accurate alignment nor establishes dense correspondence between images, works for arbitrary facial poses and expressions, and can be used to reconstruct the whole 3D facial geometry (including the non-visible parts of the face) bypassing the construction (during training) and fitting (during testing) of a 3D Morphable Model. ... performs direct regression of a volumetric representation of the 3D facial geometry from a single 2D image.

They have a page where you can upload your own image and create your face in 3D as I did with the photo of Obama at the beginning of the publication (that photo is given as an example on the page). From what I have been able to see the modeling is super fast and also give you the option to download the OBJ file from the 3D construction of the face.

I am sure that very soon we will have the option of 3D Selfies on the phones. I see it coming.


To learn more about this new technology of 3D scanning from a 2D photo here I leave the link to the website.



Banner-eu-uk.jpg

Banner-usa-can-aust.jpg

Sort:  

This 3D face feature is already in honor 8 pro smartphone.

This same feature? I do not think so ... the honor 8 use 2 cameras, here we are talking about just one camera. A photo taked with a normal camera can be extruded ... this is what is happening here.

Dear thar is honor 8 pro. The same is in honor 9. See this

Oh it is pretty nice what u can do with this cellphone :) thanks for sharing really!!! but it is a different technology (again ;) ) You have to take a photo around your face for the 3D stuff ;) The idea here is that you do not need it, you take a normal 2D photo and the machine create ur 3D face alone.

You should upload a pic of yourself and try it... u will see what I mean :)
Here http://www.cs.nott.ac.uk/~psxasj/3dme/index.php

Great step forward, reminds of deep learning by mobileye or the REM which Intel aquired a few months ago. It's a different topic but the technology behind is a similar approach to automate many things currently a lot of manual work is necessary to achieve a fraction of reliable solution or the same 3D result. Fantastic, thanks for sharing the news! My full upvote!

Thanks a lot! ... and you are welcome :) this is indeed a great step forward in AI techs in general for sure ... did you saw the video with the 3d face reconstruction in real time? Imagine an AI driving a car, and the AI can really "see" in 3D around it only having normal cameras ;)

I like to see it (when talk about AI development) as a whole, that is, any advance helps all regardless of what use we are going to give them in the future.

Yes i think that would be great with cheap industry cameras (like Mobileye already does for high safety standards with very small size of information) but has also it's limits based on light conditions and based on photogrammetry if no other sensor is used, experiences which produces relatively good guesses the more system learned, similar to a human. Everywhere where is no absolutely precise 3D scan of environment necessary such technology can do great things combined with AI i agree. And combined with Lidar, Radar it's simply superior to a human driver! I'll look for the video, you made me curious. 😁

In the upcoming years i see a great shift in auto industry alone but also many others. Tesla as colorful character is just the peak of the iceberg.

Thank you!

Video is after the links to articles and social media http://aaronsplace.co.uk/papers/jackson2017recon/

@minnowpond1 has voted on behalf of @minnowpond. If you would like to recieve upvotes from minnowponds team on all your posts, simply FOLLOW @minnowpond.

        To receive an upvote send 0.25 SBD to @minnowpond with your posts url as the memo
        To receive an reSteem send 0.75 SBD to @minnowpond with your posts url as the memo
        To receive an upvote and a reSteem send 1.00SBD to @minnowpond with your posts url as the memo

Ur comments are not adding anything, they look more like spam. It is not the first time.

sorry plz.

No problem. U are always welcome to coment but do it in a proper way.

ok. please pick up - vote

Coin Marketplace

STEEM 0.29
TRX 0.21
JST 0.039
BTC 97628.39
ETH 3725.53
USDT 1.00
SBD 3.98