{"id":332794,"date":"2017-02-08T20:11:16","date_gmt":"2017-02-08T12:11:16","guid":{"rendered":"http:\/\/techcrunch.com\/?p=1449506"},"modified":"2017-02-08T20:11:16","modified_gmt":"2017-02-08T12:11:16","slug":"faceapp-uses-neural-networks-for-photorealistic-selfie-tweaks","status":"publish","type":"post","link":"https:\/\/people.utm.my\/asmawisham\/faceapp-uses-neural-networks-for-photorealistic-selfie-tweaks\/","title":{"rendered":"FaceApp uses neural networks for photorealistic selfie tweaks"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/faceapp-trump-smile.jpg?w=738\" class=\"\"\/><\/p>\n<p>Why so serious Donald Trump? Maybe you\u2019d find less need\u00a0to reach for ALL CAPS as you <a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2017\/01\/25\/the-risky-business-of-trump-the-twittering-president\/\">compose your tweets<\/a> if you smiled a little more? Go on, have a go\u2026 There, not so hard was it!<\/p>\n<p>Okay, okay, if you\u2019re finding the vision\u00a0of Trump\u2019s visage with a smile on it\u00a0generating\u00a0\u2018uncanny valley\u2019 levels of unease and creepiness you\u2019d be right.<\/p>\n<p>The smile is FAKE NEWS folks! Created, after the fact, by a photo-realistic face-morphing iOS app, called <a target=\"_blank\" href=\"https:\/\/itunes.apple.com\/us\/app\/faceapp-add-smile-change-gender\/id1180884341\">FaceApp<\/a>, which\u00a0uses neural networks to edit selfies \u2014 letting users bend reality in a few choice ways, such as by adding\u00a0a smile, or shaving off a few years or applying a beautifying \u2018hotness\u2019 filter. Who said augmented reality requires donning a pair of goggles?<\/p>\n<p>FaceApp is being developed by a small team out of Saint-Petersburg, Russia.<\/p>\n<p>\u201cWe developed a new technology that uses neural networks to modify a <span class=\"il\">face<\/span> on any photo while keeping it photorealistic. For example, it can add a smile, change gender and age, or just make you more attractive,\u201d explains\u00a0founder and CEO\u00a0Yaroslav Goncharov, a former head of department at Yandex who is funding the project out of his own pocket.<\/p>\n<p>Selfie beautification apps aren\u2019t new of course. Recently a veteran of the category, <a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2017\/01\/19\/meitu-app-collects-personal-data\/\">Meitu<\/a>, that\u2019s\u00a0been popular in China for years picked up some steam in\u00a0the US \u2014 offering a \u2018<a target=\"_blank\" href=\"http:\/\/www.huffingtonpost.com\/2015\/04\/14\/vaseline-camera-trick-effect_n_7062900.html\">vaseline screen<\/a>\u2018 style effect to soften and smooth\u00a0skin tones and add <em>kawaii<\/em>\u00a0glints to eyes.<\/p>\n<p>Another example,\u00a0<a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2016\/06\/09\/lollicam-is-a-real-time-mobile-video-tool-for-adding-cinematic-effects-to-selfies\/\">Lollycam<\/a>, also offers beautification filters plus the ability to augment selfies in all sorts of creative ways with additional cinematic effects.<\/p>\n<p>And that\u2019s just two of the indie options kicking around the category \u2014 which also includes plenty of sophisticated in-house selfie-styling options\u00a0at social sharing giants like <a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2016\/12\/23\/snapchat-games\/\">Snapchat<\/a>.\u00a0But the enduring popularity of selfies suggests\u00a0humanity\u2019s inner Narcissus remains prone to being tickled by tricks and tweaks that can put a new spin on the presentation of self. So the ideas keep coming.<\/p>\n<p>Goncharov also says FaceApp is taking a different\u00a0tack by not applying a filter to selfies. Rather it\u2019s using deep learning technology to alter the photo itself.<\/p>\n<p>\u201cOur main differentiator is photorealism,\u201d he tells TechCrunch. \u201cAfter applying a filter, it is still your photo. Other apps intentionally change a picture in a way it is entertaining, but not a real photo anymore (Meitu can make you an anime character, Prisma turns it to art, MSQRD adds cartoon masks etc.).<\/p>\n<p>\u201cWe believe that such entertaining effects are subject to trends, but photorealism is timeless.\u201d<\/p>\n<p>\u201cIn addition to a sound product concept, we think that we are quite ahead in terms of technology. As far as I know, there are no products or research papers that can claim similar quality on this task,\u201d he adds.<\/p>\n<p>Whether photorealism really is\u00a0timeless in an era of increasing reality augmentation remains to be seen. But Goncharov reckons he has a viral hit on his hands, saying\u00a0FaceApp has racked up more than a\u00a0million downloads just two\u00a0weeks since launch (the app is iOS only for now).<\/p>\n<p>Countries where it\u2019s been making the biggest\u00a0splash so far include Japan, Netherlands, Hong Kong, Norway, Russia, and Argentina, with\u00a0Goncharov\u00a0noting\u00a0the app has\u00a0topped the\u00a0App Store charts in four countries, and made top iOS app in the Photo &#038; Video category in seven so far.<\/p>\n<p>Another Russian-made photo-altering app, <a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2016\/06\/24\/prisma-uses-ai-to-turn-your-photos-into-graphic-novel-fodder-double-quick\/\">Prisma<\/a>, which uses AI to apply style transfer art effects to images, also picked up steam quickly last summer, grabbing 1.6M downloads for its photo-tweaking tool in a week \u2014\u00a0going on to pass more than 70M downloads (and bag ~2M active daily users) within six months, with <a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2016\/10\/25\/facebook-video-filters\/\">copycats aplenty<\/a>. (Prisma has now <a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2016\/12\/20\/prisma-launches-a-social-feed-to-see-if-style-can-transfer-into-a-platform\/\">launched a\u00a0social-sharing platform<\/a>\u00a0of its own to try to turn a photo\u00a0feature tool into a fully fledged community.)<\/p>\n<p>Safe to say, the network effects of mainstream photo-sharing platforms such as\u00a0Instagram, where both Prisma pics\u00a0and FaceApp selfies have gained eyeballs,\u00a0are able to lift newcomers into the limelight relatively quickly \u2014 at least if they have something people find novel enough to share. But how sustainable\u00a0such\u00a0fast-rising\u00a0virality\u00a0is,\u00a0is the key\u00a0question for apps that piggyback on platform giants.<\/p>\n<p>In terms of the specific technology it\u2019s\u00a0using to alter\u00a0selfies in a photorealistic way,\u00a0Goncharov says FaceApp makes use of\u00a0\u201cdeep generative convolutional neural networks\u201d.<\/p>\n<p>\u201cThis technology is quite mature for some tasks, such as artistic style transfer or super-resolution, but has extreme challenges for photo-realistic tasks especially with high resolution images,\u201d he argues. \u201cI don\u2019t think similar effects can be achieved with conventional (not deep learning) algorithms.<\/p>\n<p>\u201cAdding a smile may look like a simple modification on the surface but, in fact, is extremely difficult. Smiling is not just lips moving \u2014 the entire face changes in a subtle, but complicated, way. Also, for this effect to work on most real life photos, you need to account for too many factors: posture, lighting, skin color, shape of lips and eyes, photo quality, etc.\u201d<\/p>\n<p>Testing the app I found the quality of the results do vary a fair bit \u2014 depending on the selfie you\u2019re applying them to\u00a0and the particular effect you\u2019re trying to achieve.<\/p>\n<p>As well as adding a smile, there are options for aging a selfie, making it look younger, making it more attractive, and a gender-bending feature\u00a0(changing male selfies to females and\u00a0vice versa). Photos have to be uploaded to FaceApp\u2019s servers for processing, but at the time we tested it it was only taking a few\u00a0seconds from tap to finished effect.<\/p>\n<p>Some results (such as the added smile) look generally more plausible\u00a0than others (the aging effect is pretty obviously unreal). But at a quick glance most of the effects are at least\u00a0in\u00a0the photo-realistic ballpark, even if they\u2019re also a bit surreal\/creepy\u2026<\/p>\n<div id=\"attachment_1450062\" class=\"wp-caption aligncenter c4\" readability=\"35\"><a href=\"https:\/\/techcrunch.com\/2017\/02\/08\/faceapp-uses-neural-networks-for-photorealistic-selfie-tweaks\/image1-1-5\/\" rel=\"attachment wp-att-1450062\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-1450062 size-large\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/image1-1.jpg?w=680&#038;h=680\" alt=\"FaceApp effects\" width=\"680\" height=\"680\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/image1-1.jpg?w=680&#038;h=680 680w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/image1-1.jpg?w=150&#038;h=150 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/image1-1.jpg?w=300&#038;h=300 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/image1-1.jpg?w=768&#038;h=768 768w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/image1-1.jpg 774w\" sizes=\"(max-width: 680px) 100vw, 680px\"\/><\/a><\/p>\n<p class=\"wp-caption-text\">Clockwise from top left: Unedited image, female version, added smile, hotness filter<\/p>\n<\/div>\n<p>Goncharov says the team of four full-time engineers developed FaceApp\u2019s core tech in-house, though he confirms they are using some AI open source libraries \u2014 such as Google\u2019s Tensorflow.<\/p>\n<p>\u201cThey are relatively low level\/general use libraries that can be used to build almost anything,\u201d he says, adding: \u201cIt took us eight months to release the first version of FaceApp, thanks to our prior background in deep learning and computer vision.\u201d<\/p>\n<p>He also says\u00a0they have spent nothing on marketing for FaceApp at this point, with all early growth being organic, thanks to social shares. (Morphed photos being automatically badged\u00a0with \u2018FaceApp\u2019 and\u00a0the app pushing social share options at users immediately after they process\u00a0an image will be helping there.)<\/p>\n<p>How might the team monetize the app, assuming they can keep growing usage? One option might be sponsored filters, says Goncharov. \u201cOur upcoming effects would support it in a nice way. Before we start to implement this, we need to hit quite high numbers in terms of daily active users to use this model efficiently. However, given the app performance we see, we believe that it is a viable option.\u201d<\/p>\n<p>A lot might depend on the variety and quality of the\u00a0upcoming effects \u2014 i.e. if FaceApp is to be anything more than a flash in the selfie styling pan. Adding a smile to a famously grumpy selfie is\u00a0fun once, but\u00a0doesn\u2019t seem to offer lasting\u00a0utility.<\/p>\n<p>Still, some smiles are a lot more winning than others\u2026<\/p>\n<p><a href=\"https:\/\/techcrunch.com\/2017\/02\/08\/faceapp-uses-neural-networks-for-photorealistic-selfie-tweaks\/img_4277\/\" rel=\"attachment wp-att-1450066\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-1450066 aligncenter\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/img_4277.jpg?w=680&#038;h=680\" alt=\"FaceApp smile\" width=\"680\" height=\"680\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/img_4277.jpg?w=680&#038;h=680 680w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/img_4277.jpg?w=150&#038;h=150 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/img_4277.jpg?w=300&#038;h=300 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/img_4277.jpg?w=768&#038;h=768 768w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/img_4277.jpg 1280w\" sizes=\"(max-width: 680px) 100vw, 680px\"\/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" width=\"680\" height=\"414\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/faceapp-trump-smile.jpg?w=680\" class=\"attachment-large size-large wp-post-image\" alt=\"faceapp-trump-smile\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/faceapp-trump-smile.jpg?w=680 680w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/faceapp-trump-smile.jpg?w=150 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/faceapp-trump-smile.jpg?w=300 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/faceapp-trump-smile.jpg?w=768 768w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/02\/faceapp-trump-smile.jpg 849w\" sizes=\"(max-width: 680px) 100vw, 680px\" \/>&nbsp;If you&#8217;re finding the vision of Trump&#8217;s visage with a smile on it generating &#8216;uncanny valley&#8217; levels of unease and creepiness you&#8217;d be right. The smile is FAKE NEWS folks! Created, after the fact, by a photo-realistic face-morphing iOS app, called FaceApp&#8230; <a href=\"https:\/\/techcrunch.com\/2017\/02\/08\/faceapp-uses-neural-networks-for-photorealistic-selfie-tweaks\/?ncid=rss\">Read More<\/a><\/p>\n<div class=\"feedflare\">\n<a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=JF1HRTzjkYI:P66qp95OEuk:2mJPEYqXBVI\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=2mJPEYqXBVI\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=JF1HRTzjkYI:P66qp95OEuk:7Q72WNTAKBA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=7Q72WNTAKBA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=JF1HRTzjkYI:P66qp95OEuk:yIl2AUoC8zA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=yIl2AUoC8zA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=JF1HRTzjkYI:P66qp95OEuk:-BTjWOF_DHI\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?i=JF1HRTzjkYI:P66qp95OEuk:-BTjWOF_DHI\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=JF1HRTzjkYI:P66qp95OEuk:D7DqB2pKExk\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?i=JF1HRTzjkYI:P66qp95OEuk:D7DqB2pKExk\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=JF1HRTzjkYI:P66qp95OEuk:qj6IDK7rITs\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=qj6IDK7rITs\" border=\"0\"><\/img><\/a>\n<\/div>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~r\/Techcrunch\/~4\/JF1HRTzjkYI\" height=\"1\" width=\"1\" alt=\"\"\/> <\/p>\n","protected":false},"author":5817,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[25],"tags":[59,66,26],"class_list":["post-332794","post","type-post","status-publish","format-standard","hentry","category-technology","tag-media","tag-techcrunch","tag-technology"],"_links":{"self":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/332794","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/users\/5817"}],"replies":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/comments?post=332794"}],"version-history":[{"count":0,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/332794\/revisions"}],"wp:attachment":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/media?parent=332794"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/categories?post=332794"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/tags?post=332794"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}