{"id":340436,"date":"2017-05-09T17:54:59","date_gmt":"2017-05-09T09:54:59","guid":{"rendered":"http:\/\/techcrunch.com\/?p=1487016"},"modified":"2017-05-09T17:54:59","modified_gmt":"2017-05-09T09:54:59","slug":"how-a-tap-could-tame-the-smart-home","status":"publish","type":"post","link":"https:\/\/people.utm.my\/asmawisham\/how-a-tap-could-tame-the-smart-home\/","title":{"rendered":"How a tap could tame the smart home"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/05\/fridgeapp.jpg?w=738\" class=\"\"\/><\/p>\n<p id=\"speakable-summary\">Here\u2019s a novel fix for the headache of interacting with\u00a0all sorts of\u00a0connected devices: researchers at Carnegie Mellon University have devised a system that lets smartphone users tap their phone\u00a0against an IoT device in order to have a contextual menu automatically loaded on screen \u2014 thereby saving them from having to scramble around looking for the correct app to control each\u00a0device. Or fiddling with actual physical buttons and trying to navigate less consumer friendly menus.<\/p>\n<p>So, in other words,\u00a0\u201cno more scrolling through endless pages of apps on your phone to control with your supposed \u2018smart home&#8217;\u201d, as CMU researcher Chris Harrison puts it.<\/p>\n<p>The system, called Deus EM-Machina (see what they did there?), leverages\u00a0the fact that\u00a0electromagnetic noise is emitted from everyday electrical objects to power a device classifier \u2014 they\u2019re using\u00a0a smartphone kitted out with an EM-sensor that can detect what IoT device it\u2019s resting on \u2014 enabling\u00a0contextual functionality to be pushed to\u00a0the smartphone screen so it can be a dynamic\u00a0control device.<\/p>\n<p>And while researchers at CMU\u2019s Future Interfaces Group have\u00a0<a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2016\/05\/13\/making-wearables-more-useful-and-smart-homes-less-of-a-chore\/\">previously shown<\/a> a similar electromagnetic sensing system running on a\u00a0wearable device \u2014 also for powering contextual awareness of other\u00a0devices \u2014 the use of a smartphone as the control device in this\u00a0latest research\u00a0scenario means\u00a0richer menus can\u00a0be made available to users, allowing more control functions to be supported.<\/p>\n<p>Introducing the research in a\u00a0<a target=\"_blank\" href=\"http:\/\/chrisharrison.net\/projects\/emphone\/EMPhone.pdf\">paper<\/a>\u00a0they write:<\/p>\n<blockquote readability=\"13\">\n<p>We propose an approach where users simply tap a smartphone to an appliance to discover and rapidly utilize contextual functionality. To achieve this, our prototype smartphone recognizes physical contact with uninstrumented appliances, and summons appliance-specific interfaces. Our user study suggests high accuracy \u2013 98.8% recognition accuracy among 17 appliances. Finally, to underscore the immediate feasibility and utility of our system, we built twelve example applications, including six fully functional end-to-end demonstrations<\/p>\n<\/blockquote>\n<p>Examples of the apps the researchers built to demonstrate the sensing system\u00a0are shown in the below video \u2014 including controlling a thermostat; configuring\u00a0a router; printing a document that\u2019s on screen on the mobile device with a single print button push; sending text from a mobile to a desktop computer; and more.<\/p>\n<p><span class=\"embed-youtube\"><iframe loading=\"lazy\" class=\"youtube-player\" type=\"text\/html\" width=\"640\" height=\"390\" src=\"https:\/\/www.youtube.com\/embed\/eInfzdZ-9fE?version=3&amp;rel=1&amp;fs=1&amp;autohide=2&amp;showsearch=0&amp;showinfo=1&amp;iv_load_policy=1&amp;wmode=transparent\" allowfullscreen=\"true\">[embedded content]<\/iframe><\/span><\/p>\n<p>The researchers created a background Android service running alongside their IoT device classifier that pushes so-called \u201ccontextual charms\u201d onto the screen for certain\u00a0applications \u2014 aka small floating buttons that appear at the right edge of an app when the phone touches a supported device, and which can execute commands (such as a \u201ccast charm\u201d to stream video content to a smart TV, or a print button to print what\u2019s on screen).<\/p>\n<p>\u201cWe envision that future smart appliance applications would register their device\u2019s EM signature and a set of verbs with the charm system service upon installation, which would enable existing apps to immediately take advantage of appliances and devices in a user\u2019s environment. This is analogous to the current paradigm of applications registering Android \u201cshare\u201d handlers to support system-wide sharing of content to e.g., social media,\u201d they write on this.<\/p>\n<p>Discussing limitations of the system in general\u00a0they emphasize the need for\u00a0IoT devices to have\u00a0open APIs, noting:\u00a0\u201cWe initially set out to produce full-stack implementations for all of the network-connected devices on our list. However, we were stymied by the lack of public APIs on several of them. Furthermore, even when APIs were available, some were vendor-locked (e.g., the Apple TV casting APIs were only open to Apple devices). In order for the future Internet of Things to have true impact, open APIs are a strong requirement. Until then, our system will be limited by the inability to talk to all smart devices.\u201d<\/p>\n<p>Other limitations include difficulties recognizing multiple instances of the same device (e.g. more than one connected thermostat); and external interference from powerline noise which can confuse the device classifier. The sensing system also cannot work if a device is truly powered off \u2014 although the researchers note that low power or sleep modes might still render an IoT object detectable.<\/p>\n<p>The research is being presented this week at the\u00a0ACM CHI Conference in Denver.\u00a0CMU is\u00a0also presenting\u00a0<a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2017\/05\/08\/new-technique-turns-anything-into-a-touch-sensor\/\">another interesting bit of interface research<\/a> at the conference \u2014 which involves using\u00a0a conductive spray paint and an array of electrodes to turn any surface into a touch-sensitive surface.<\/p>\n","protected":false},"excerpt":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" width=\"680\" height=\"453\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/05\/fridgeapp.jpg?w=680\" class=\"attachment-large size-large wp-post-image\" alt=\"\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/05\/fridgeapp.jpg?w=680 680w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/05\/fridgeapp.jpg?w=1360 1360w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/05\/fridgeapp.jpg?w=150 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/05\/fridgeapp.jpg?w=300 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/05\/fridgeapp.jpg?w=768 768w\" sizes=\"(max-width: 680px) 100vw, 680px\" \/>&nbsp;Here&#8217;s a novel fix for the headache of interacting with all sorts of connected devices: researchers at Carnegie Mellon University have devised a system that lets smartphone users tap their phone against an IoT device in order to have a contextual menu automatically loaded on screen. <a href=\"https:\/\/techcrunch.com\/2017\/05\/09\/how-a-tap-could-tame-the-smart-home\/?ncid=rss\">Read More<\/a><\/p>\n<div class=\"feedflare\">\n<a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=ZCixGQFF__w:K13brr-2uqk:2mJPEYqXBVI\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=2mJPEYqXBVI\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=ZCixGQFF__w:K13brr-2uqk:7Q72WNTAKBA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=7Q72WNTAKBA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=ZCixGQFF__w:K13brr-2uqk:yIl2AUoC8zA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=yIl2AUoC8zA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=ZCixGQFF__w:K13brr-2uqk:-BTjWOF_DHI\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?i=ZCixGQFF__w:K13brr-2uqk:-BTjWOF_DHI\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=ZCixGQFF__w:K13brr-2uqk:D7DqB2pKExk\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?i=ZCixGQFF__w:K13brr-2uqk:D7DqB2pKExk\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=ZCixGQFF__w:K13brr-2uqk:qj6IDK7rITs\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=qj6IDK7rITs\" border=\"0\"><\/img><\/a>\n<\/div>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~r\/Techcrunch\/~4\/ZCixGQFF__w\" height=\"1\" width=\"1\" alt=\"\"\/> <\/p>\n","protected":false},"author":5817,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[25],"tags":[59,66,26],"class_list":["post-340436","post","type-post","status-publish","format-standard","hentry","category-technology","tag-media","tag-techcrunch","tag-technology"],"_links":{"self":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/340436","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/users\/5817"}],"replies":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/comments?post=340436"}],"version-history":[{"count":0,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/340436\/revisions"}],"wp:attachment":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/media?parent=340436"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/categories?post=340436"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/tags?post=340436"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}