{"id":343141,"date":"2017-06-09T03:42:03","date_gmt":"2017-06-08T19:42:03","guid":{"rendered":"http:\/\/techcrunch.com\/?p=1501280"},"modified":"2017-06-09T03:42:03","modified_gmt":"2017-06-08T19:42:03","slug":"spektral-raises-2-8-million-for-development-of-ai-powered-green-screen-technology","status":"publish","type":"post","link":"https:\/\/people.utm.my\/asmawisham\/spektral-raises-2-8-million-for-development-of-ai-powered-green-screen-technology\/","title":{"rendered":"Spektral raises $2.8 million for development of AI-powered green screen technology"},"content":{"rendered":"

<\/p>\n

The augmented reality acquisition space is hot \u2014 Facebook, Snap, Apple and others are throwing money at teams and technologies that promise to increase user engagement. Spektral<\/a>, a Danish startup, is the latest venture-backed visual effects company setting its sights on the massive space. Spektral is announcing a $2.8 million round today from Litecap<\/a> and Amp Ventures<\/a> to continue development of its machine learning-powered, real-time, green screen technology.<\/p>\n

Spektral, unlike 99 percent of venture-backed startups doesn\u2019t have a product or at least not in the traditional tech sense. Instead of spending time on a go-to-market, Spektral has been investing heavily in research and development. After first pursuing still frames under the name CloudCutout<\/a>, the team is moving into real time video \u2014 combining machine learning with spectral graph theory to separate people and objects from their original backgrounds and overlay them in a new stream.<\/p>\n

\"\"<\/p>\n

It\u2019s quite easy to imagine this technology being implemented into Snapchat or Messenger, but just because it\u2019s obvious doesn\u2019t make it statistically likely. This is probably why Spektral is making the effort to show how its technology could be useful in other use cases, like production and advertising.<\/p>\n

Other research groups have been exploring how machine learning could open up new design possibilities for separating objects from their backgrounds. Adobe, the Beckman Institute for Advanced Science and Technology and the University of Illinois at Urbana-Champaign worked together to publish research<\/a> on automating that process. That said, video and pictures are two entirely different monsters.<\/p>\n

Hair strokes have long been a key criteria for judging cut outs.\u00a0Toke Jansen, founder and CTO of Spektral, explained to me just how easy it is to underestimate the difficulty of cutting around hair. Equipped with scissors, a human can cut around complex shapes without thinking about it. But even with the latest deep learning models trained on over a million images, machines struggle.<\/p>\n

Spektral, as the name implies, is experimenting with\u00a0spectral clustering for image segmentation within a video frame. This additional information can be added in as a prior to augment more traditional models. In the future, this technology could pave the way for more complex video editing. The team alluded to object manipulation, perhaps moving your friends hand wave with your own, as a natural next step.<\/p>\n

To get the company and its technology to the next phase, it\u2019s brining on a number of domain experts. Most notably,\u00a0Danny Lange, the head of machine learning at Unity, is joining the startup\u2019s Board of Directors.\u00a0Lange was formerly the leader of machine learning efforts at Uber.<\/p>\n","protected":false},"excerpt":{"rendered":"

\"\" The augmented reality acquisition space is hot — Facebook, Snap, Apple and others are throwing money at teams and technologies that promise to increase user engagement. Spektral, a Danish startup, is the latest venture-backed visual effects company setting its sights on the massive space. Spektral is announcing a $2.8 million round today from Litecap and Amp Ventures to continue… Read More<\/a><\/p>\n

\n<\/img><\/a> <\/img><\/a> <\/img><\/a> <\/img><\/a> <\/img><\/a> <\/img><\/a>\n<\/div>\n

\"\"\/ <\/p>\n","protected":false},"author":5817,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[25],"tags":[59,66,26],"class_list":["post-343141","post","type-post","status-publish","format-standard","hentry","category-technology","tag-media","tag-techcrunch","tag-technology"],"_links":{"self":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/343141","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/users\/5817"}],"replies":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/comments?post=343141"}],"version-history":[{"count":0,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/343141\/revisions"}],"wp:attachment":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/media?parent=343141"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/categories?post=343141"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/tags?post=343141"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}