{"id":343165,"date":"2017-06-09T06:35:08","date_gmt":"2017-06-08T22:35:08","guid":{"rendered":"http:\/\/techcrunch.com\/?p=1501490"},"modified":"2017-06-09T06:35:08","modified_gmt":"2017-06-08T22:35:08","slug":"teaching-teams-of-drones-to-work-alongside-humans-and-nature","status":"publish","type":"post","link":"https:\/\/people.utm.my\/asmawisham\/teaching-teams-of-drones-to-work-alongside-humans-and-nature\/","title":{"rendered":"Teaching teams of drones to work alongside humans and nature"},"content":{"rendered":"<p class=\"first\"><span class=\"s1\">The <a target=\"_blank\" href=\"http:\/\/rasl.ri.cmu.edu\/\" rel=\"noopener\">Robust Reactive Systems Lab<\/a>\u00a0just might have the highest ceilings of any laboratory on the Carnegie Mellon campus. It\u2019s big and drafty, and were it not for the rows of computer workstations dotting the room, it might easily be mistaken for an airplane hangar. The centerpiece is a scaffolding structure surrounded on all four sides by netting that looks more like a batting cage than a serious piece of lab equipment at one of the world\u2019s foremost robotics schools.<\/span><\/p>\n<p id=\"speakable-summary\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/cmulab.jpg?w=680&amp;h=453\" alt=\"\" width=\"680\" height=\"453\" class=\"aligncenter size-large wp-image-1501507\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/cmulab.jpg?w=680&amp;h=453 680w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/cmulab.jpg?w=1360&amp;h=906 1360w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/cmulab.jpg?w=150&amp;h=100 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/cmulab.jpg?w=300&amp;h=200 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/cmulab.jpg?w=768&amp;h=512 768w\" sizes=\"(max-width: 680px) 100vw, 680px\"\/><\/p>\n<p class=\"p1\"><span class=\"s1\">But when the demo starts, everyone stops and watches. Fifteen pocket-sized drones are lined up, three by five. All at once, bright lights flash beneath each, moments before suddenly lifting off in unison. The drones split into smaller groups and explore the boundaries of the cage, before converging again and moving around as one. The batting cage is a motion capture arena, designed to track the quadcopters\u2019 choreographed movement with pinpoint accuracy.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">The whole thing is mesmerizing. Like a real-world, robotic kaleidoscope, set to the soundtrack of dozens of tiny whirring propellers. It\u2019s the final demo on a packed day\u2019s trip to CMU\u2019s Pittsburgh campus, and it may well be the most visually impressive. That\u2019s by design. The team has been putting its research to use creating drone performances. One popped up in <a target=\"_blank\" href=\"http:\/\/www.papermag.com\/aurora-winter-bird-video-2157618893.html\" rel=\"noopener\">a recent music video by Norwegian electro-pop singer Aurora<\/a>, and the team is working with CMU\u2019s art department to employee them as part of an upcoming live theatrical performance.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drone7.jpg?w=680&amp;h=453\" alt=\"\" width=\"680\" height=\"453\" class=\"aligncenter size-large wp-image-1501494\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drone7.jpg?w=680&amp;h=453 680w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drone7.jpg?w=1360&amp;h=906 1360w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drone7.jpg?w=150&amp;h=100 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drone7.jpg?w=300&amp;h=200 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drone7.jpg?w=768&amp;h=512 768w\" sizes=\"(max-width: 680px) 100vw, 680px\"\/><\/p>\n<p class=\"p1\"><span class=\"s1\">Grad student, Ellen A. Cappo admits that the drone choreography was prepared in advance for the sake of our cameras, but the team is working on something far more complex. \u201cI\u2019m looking at examples where you don\u2019t know ahead of time what you want to do,\u201d she explains. \u201cIf you\u2019re using the code base that you\u2019re working on here, Lady Gaga could have gestured her hands and directed all the robots in real time [<a target=\"_blank\" href=\"https:\/\/techcrunch.com\/2017\/02\/05\/intel-powered-the-drones-during-lady-gagas-super-bowl-halftime-show\/\" rel=\"noopener\">at the Super Bowl<\/a>], as part of her performance in an improvisational manner.\u201d<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Cappo\u2019s work centers on the relationship between humans and robots. The team is building complex systems capable of responding to user controls, while correcting for human errors and, hopefully, avoiding disaster before it occurs. Cappo\u2019s flight planner is designed to do much of the heavy lifting on the backend, determining the best ways to execute commands without running afoul of the sorts of problems that can occur when one individual is attempting to pilot a number of systems all at once.<\/span><\/p>\n<aside class=\"inset inset-sm inset-section\">\n<section class=\"aside section video-aside crunchreport collapse collapse-adjacent\" data-video-id=\"5938853fe0fa177b0c45c52e\">\n<h2 class=\"collapse-title section-title\">Latest <span>Crunch Report<\/span><\/h2>\n<div class=\"collapse-body cf\">\n<ul class=\"vid-list cf\">\n<li class=\"block vid-feature\" data-lightbox-omniture=\"crunchreport\" readability=\"-2\">\n<div class=\"block block-inset\" readability=\"7\"><a href=\"https:\/\/techcrunch.com\/video\/spacex-launching-secret-spaceplane-crunch-report\/5938853fe0fa177b0c45c52e\/?ncid=rightrail_cr\"><img decoding=\"async\" src=\"https:\/\/img.vidible.tv\/prod\/2017-06\/07\/5938853fe0fa177b0c45c52e\/5938857fe6604d49cb2695f2_o_U_v1.jpg?w=300&amp;h=170\" alt=\"SpaceX Launching Secret Spaceplane | Crunch Report\" data-lightbox-url=\"https:\/\/techcrunch.com\/video\/spacex-launching-secret-spaceplane-crunch-report\/5938853fe0fa177b0c45c52e\/lightbox\"\/><\/a><\/p>\n<p><h3>SpaceX Launching Secret Spaceplane | Crunch Report<\/h3>\n<\/p>\n<\/div>\n<\/li>\n<\/ul>\n<p><a href=\"https:\/\/techcrunch.com\/video\/crunchreport\/?ncid=rightrail_crmore\" class=\"text-btn\" data-omni-sm=\"rightrail_crmore\">Watch More Episodes<\/a><\/div>\n<\/section>\n<\/aside>\n<p class=\"p3\"><span class=\"s1\">\u201cWe\u2019re taking the intent, but dealing with all the low-level questions that the human user doesn\u2019t want to think about, or that are difficult for the human user to think about,\u201d explains Cappo. \u201cLike making sure the motors don\u2019t saturate, because the human told the robot to go somewhere more quickly than the robot is physically capable of.\u201d<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1501493\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=1024&amp;h=683\" alt=\"\" width=\"1024\" height=\"683\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=1024&amp;h=683 1024w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=150&amp;h=100 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=300&amp;h=200 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=768&amp;h=512 768w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=680&amp;h=453 680w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg 1855w\" sizes=\"(max-width: 1024px) 100vw, 1024px\"\/><\/p>\n<p class=\"p3\"><span class=\"s1\">The system could one day help industries deploy drones in groups to perform inspections or assist with disaster recovery \u2014 the sorts of difficult, dirty and dangerous jobs analysts so often cite when discussing the importance of automation in the future of the job market. The system isn\u2019t limited to drones, either. It could potentially be applied to any manner of robots in a group. But as it happens, the consumer drone market is playing a major role in making the technology accessible for school research groups.<\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">\u201cThe hobbyist market has come really far in recent years,\u201d explains Cappo. \u201cSo these devices are fairly affordable. But they have enough computational power on-board for something like this, where I want to study the interaction between multiple systems, I can buy something that is computationally advanced enough to execute the controls I need, but cheap enough for me to buy them in bulk.\u201d<\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">Labmate Vishnu Desaraju, a CMU PhD student, employees a larger variety of drone for his demo. His, too, takes place in the motion capture arena, but now the team fires up eight high-powered floor fans stacked atop one another in various configurations. It\u2019s a makeshift system designed to mimic natural wind.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1501491\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/dronelab5.png?w=1024&amp;h=683\" alt=\"\" width=\"1024\" height=\"683\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/dronelab5.png?w=1024&amp;h=683 1024w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/dronelab5.png?w=2048&amp;h=1366 2048w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/dronelab5.png?w=150&amp;h=100 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/dronelab5.png?w=300&amp;h=200 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/dronelab5.png?w=768&amp;h=512 768w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/dronelab5.png?w=680&amp;h=453 680w\" sizes=\"(max-width: 1024px) 100vw, 1024px\"\/><\/p>\n<aside class=\"inset inset-sm inset-section\">\n<div class=\"section aside crunchbase-cluster collapse\">\n<h3 class=\"section-title collapse-title\">Crunchbase<\/h3>\n<\/p><\/div>\n<\/aside>\n<p class=\"p1\"><span class=\"s1\">Like Cappo\u2019s system, the second demo is designed to help drones avoid disaster in real-world settings, only instead of correcting human error, Desaraju\u2019s work focuses on the chaotic impacts of nature on a poor-flying drone.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">\u201cThere are a number of techniques that we can use to control the vehicles,\u201d explains Desaraju. \u201cBut a lot of these assume that vehicles are operating in very nice conditions. So, how do we handle conditions that are not so nice, like really windy conditions or cases where you have a lot of uncertainty to account for. What I\u2019m looking at is how we actually learn new control strategies and policies as we go, but do so in a rigorous manner so we don\u2019t crash the vehicle as we\u2019re trying to learn.\u201d<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">The demo lacks the impressive visual scale of the one that preceded it, but there\u2019s a fascinating subtle element visible as the drone slowly adapts to its surroundings. In the first demo, the drone wobbles, unsure of how to respond to its environment. But with each flight, it gets better, slowly adjusting to the external forces.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1501495\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones1.jpg?w=1024&amp;h=683\" alt=\"\" width=\"1024\" height=\"683\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones1.jpg?w=1024&amp;h=683 1024w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones1.jpg?w=2048&amp;h=1366 2048w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones1.jpg?w=150&amp;h=100 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones1.jpg?w=300&amp;h=200 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones1.jpg?w=768&amp;h=512 768w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones1.jpg?w=680&amp;h=453 680w\" sizes=\"(max-width: 1024px) 100vw, 1024px\"\/><\/p>\n<p class=\"p1\"><span class=\"s1\">\u201cWe were looking at different flight and control strategies,\u201d says Desaraju. \u201cWe realized that control was really the limiting factor, because we don\u2019t have a good way to compensate for these types of disturbances. There are existing techniques that do try to address this, but they\u2019re looking at one particular instance. No matter what sort of circumstance we\u2019re working in, we want to be able to learn a custom set of behaviors for the scenario.\u201d<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Like Cappo\u2019s demo, Desaraju\u2019s system could offer an important level of support for those looking to employ drones in the workplace, from surveys to photographers. Or, for that matter, Lady Gaga.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" width=\"680\" height=\"453\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=680\" class=\"attachment-large size-large wp-post-image\" alt=\"\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=680 680w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=1360 1360w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=150 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=300 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/06\/drones2.jpg?w=768 768w\" sizes=\"(max-width: 680px) 100vw, 680px\" \/>&nbsp;The Robust Reactive Systems Lab\u00a0just might have the highest ceilings of any lab on the Carnegie Mellon campus. It&#8217;s big and drafty, and were it not for the rows of computer workstations, it might easily be mistaken for an airplane hangar. The centerpiece looks more like a batting cage than a serious piece of lab equipment. But when the demo starts, everyone stops and watches. <a href=\"https:\/\/techcrunch.com\/2017\/06\/08\/teaching-teams-of-drones-to-work-alongside-humans-and-nature\/?ncid=rss\">Read More<\/a><\/p>\n<div class=\"feedflare\">\n<a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=nf4niqKEaM0:0VpYQCckuFk:2mJPEYqXBVI\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=2mJPEYqXBVI\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=nf4niqKEaM0:0VpYQCckuFk:7Q72WNTAKBA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=7Q72WNTAKBA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=nf4niqKEaM0:0VpYQCckuFk:yIl2AUoC8zA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=yIl2AUoC8zA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=nf4niqKEaM0:0VpYQCckuFk:-BTjWOF_DHI\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?i=nf4niqKEaM0:0VpYQCckuFk:-BTjWOF_DHI\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=nf4niqKEaM0:0VpYQCckuFk:D7DqB2pKExk\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?i=nf4niqKEaM0:0VpYQCckuFk:D7DqB2pKExk\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=nf4niqKEaM0:0VpYQCckuFk:qj6IDK7rITs\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=qj6IDK7rITs\" border=\"0\"><\/img><\/a>\n<\/div>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~r\/Techcrunch\/~4\/nf4niqKEaM0\" height=\"1\" width=\"1\" alt=\"\"\/> <\/p>\n","protected":false},"author":5817,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[25],"tags":[59,66,26],"class_list":["post-343165","post","type-post","status-publish","format-standard","hentry","category-technology","tag-media","tag-techcrunch","tag-technology"],"_links":{"self":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/343165","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/users\/5817"}],"replies":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/comments?post=343165"}],"version-history":[{"count":0,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/343165\/revisions"}],"wp:attachment":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/media?parent=343165"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/categories?post=343165"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/tags?post=343165"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}