{"id":336086,"date":"2017-03-17T20:07:56","date_gmt":"2017-03-17T12:07:56","guid":{"rendered":"http:\/\/techcrunch.com\/?p=1465673"},"modified":"2017-03-17T20:07:56","modified_gmt":"2017-03-17T12:07:56","slug":"tilt-gesture-keyboard-could-hold-promise-for-typing-in-vr","status":"publish","type":"post","link":"https:\/\/people.utm.my\/asmawisham\/tilt-gesture-keyboard-could-hold-promise-for-typing-in-vr\/","title":{"rendered":"Tilt gesture keyboard could hold promise for typing in VR"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/03\/screen-shot-2017-03-17-at-10-40-40-am.png?w=738\" class=\"\"\/><\/p>\n<p>Keyboard nerds like me could\u00a0become\u00a0a dying breed if the voice-controlled future accelerates at us quite as quickly\u00a0as companies like Alexa-owning Amazon hope. But in the interim, with\u00a0screens still loitering\u00a0in the orbits of our fingertips, texting remains the done thing\u00a0(well, not counting\u00a0kids who prefer\u00a0recording voice messages to send to each others\u2019 messaging apps \u2014 I know, I know, path of least resistance and all that\u2026).<\/p>\n<p>Meanwhile, there are more types and growing numbers of computing devices in play than ever before, from\u00a0wearables to\u00a0VR headsets, so interface researchers are finding\u00a0additional reasons\u00a0to\u00a0optimize keyboard-based\u00a0usability kinks.<\/p>\n<p>To wit: a\u00a0group of researchers, led by postgraduate student Hui-Shyong Yeo at the University of St Andrews, has come up with\u00a0a tilt-based typing technique designed \u2014 at first glance \u2014\u00a0to be an alternative for\u00a0users of larger smartphones (phablets) or\u00a0tablets; to enable one-handed typing, i.e. when your palm won\u2019t easily stretch across\u00a0the full span of glass. And many a cracked smartphone screen can\u00a0surely be blamed\u00a0on an unfortunate typing accident.<\/p>\n<p>The researchers have\u00a0called their tilt-based entry keyboard SWiM for short: aka\u00a0\u2018Shape Writing in Motion\u2019. The core\u00a0text entry technique is akin to gesture-based keyboards like Swype, where users use fingers to trace patterns over the keys to spell out words. (Indeed, they utilized Swype\u2019s interface for this portion of the tech.) But the twist is SWiM users tilt the\u00a0device with their dominant wrist to form the shades needed to form the words. So no\u00a0finger-dragging necessary, just a little wrist dexterity.<\/p>\n<p>\u201cThe dominant hand typically exhibits finer temporal and spatial resolutions,\u201d they write\u00a0in a\u00a0research paper detailing the study, which also specifies that their technique only relies on pitch and roll for text input, as \u201cthe dexterity of yaw using one\u2019s hand is very limited\u201d.<\/p>\n<p>\u201cOur tilt-based technique allows one-handed text entry and also lends itself as a suitable text entry method for remote controllers, wearable devices, and for virtual reality text entry, where users cannot see the keyboard input device,\u201d they add.<\/p>\n<p>The researchers found that\u00a0first time users who tested the tilt-based input system as part of the study\u00a0were able to\u00a0achieve a rate of 15 words per minute after \u201cminimal practice\u201d, and a rate of 32 wpm after around\u00a090 minutes of practice.<\/p>\n<p><span class=\"embed-youtube c5\"><iframe loading=\"lazy\" class=\"youtube-player c4\" type=\"text\/html\" width=\"640\" height=\"390\" src=\"https:\/\/www.youtube.com\/embed\/8BuXIlQ7_XM?version=3&#038;rel=1&#038;fs=1&#038;autohide=2&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;wmode=transparent\" allowfullscreen=\"true\">[embedded content]<\/iframe><\/span><\/p>\n<p>To begin and end words using the tilt method \u2014 which utilizes accelerometer\/gyroscope tech embedded into modern mobiles \u2014 the researchers came up with an additional on-screen button they call the \u201cchat head\u201d. This is a semi translucent bubble-like object that can be user-positioned on the screen. To type using\u00a0SWiM the user taps on the chat head to start forming a word via\u00a0tilting a pointer ball over the keys, before tapping\u00a0a second time on the chat head to complete a word (which also inserts a space).<\/p>\n<p>The chat head also supports gestures such as a left or\u00a0right swipe which can be used for other gesture-based functions \u2014 such as deleting a word from the suggestions bar above the keyboard. Words can also be selected from the suggestions bar via tilting the pointer\u00a0to a suggested word and short clicking on the chat head.<\/p>\n<p>In the paper, the researchers describe\u00a0SWiM as \u201cfast and easy to learn compared to many existing single-handed text entry techniques\u201d. The study involved a small number of participants conducting a transcription and a composition task using the technique (and also comparing their input to their standard typing and standard shape writing).<\/p>\n<p>The study also looked at performance improvement over time via a longitudinal pilot with one participant who took\u00a0part in six\u00a0separate typing sessions \u2014 their SWiM entry rate rose\u00a0from\u00a015.60wpm during the first session to 32.18wpm by the sixth; an improvement rate of 106.3 per cent; also a\u00a0much larger gain at the end of all the sessions than for normal typing (22.8%) and normal shape writing (29.5%).<\/p>\n<p>Tilt as an input method for typing has been considered before \u2014 not least as a spoof option by SwiftKey for\u00a0a\u00a0<a target=\"_blank\" href=\"https:\/\/blog.swiftkey.com\/swiftkey-tilt\/\">2013\u00a0April Fools<\/a>\u00a0joke \u2014 but experiments have yet to turn into any extended commercial rollouts. Yet as computing shifts into more types of devices \u2014 including those with very small screens or screens that can\u2019t easily be touched \u2014\u00a0the need for alternative and\/or supplementary input methods does, arguably, step up.<\/p>\n<p>The researchers especially see potential for the technique to be useful in VR.\u00a0\u201cWe believe our technique to be well suited for input in virtual reality (VR) applications. When wearing a VR headset, the user often cannot see the keyboard. Thus, a simple controller that supports tilt (e.g., Google VR controller, Oculus Touch) can use SWiM for text input,\u201d they write, adding: \u201cOur studies show that the technique has high immediate efficacy and is reasonably fast.\u201d<\/p>\n<p>Their first next step will be to release an installable version of the keyboard for users of touchscreen devices.\u00a0\u201cIn the future, we plan to integrate our technique with a gesture keyboard and release it as an installable touchscreen keyboard application,\u201d they write.<\/p>\n<p>\u201cWe will continue to investigate which factors affect tilt-based shape writing and hope to improve SWiM over time. Lastly, we aim to use this technique on other devices, such as smartwatches, digital pendants, and head-mounted displays (HMD), which already have built-in tilt sensors.\u201d<\/p>\n<p>The research paper, entitled \u2018Investigating tilt-based gesture keyboard entry for single-handed text entry on large devices\u2019, will be published by the ACM SIGCHI in the upcoming <em>Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" width=\"680\" height=\"392\" src=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/03\/screen-shot-2017-03-17-at-10-40-40-am.png?w=680\" class=\"attachment-large size-large wp-post-image\" alt=\"\" srcset=\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/03\/screen-shot-2017-03-17-at-10-40-40-am.png?w=680 680w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/03\/screen-shot-2017-03-17-at-10-40-40-am.png?w=150 150w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/03\/screen-shot-2017-03-17-at-10-40-40-am.png?w=300 300w, https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/03\/screen-shot-2017-03-17-at-10-40-40-am.png 748w\" sizes=\"(max-width: 680px) 100vw, 680px\" \/>&nbsp;A group of researchers are demonstrating a tilt-based typing technique they&#8217;ve designed that could be an alternative option for users of larger smartphones or for inputting text when in VR. <a href=\"https:\/\/techcrunch.com\/2017\/03\/17\/tilt-gesture-keyboard-could-hold-promise-for-typing-in-vr\/?ncid=rss\">Read More<\/a><\/p>\n<div class=\"feedflare\">\n<a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=kcJG2yuyTEg:pJUjiYGfJtM:2mJPEYqXBVI\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=2mJPEYqXBVI\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=kcJG2yuyTEg:pJUjiYGfJtM:7Q72WNTAKBA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=7Q72WNTAKBA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=kcJG2yuyTEg:pJUjiYGfJtM:yIl2AUoC8zA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=yIl2AUoC8zA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=kcJG2yuyTEg:pJUjiYGfJtM:-BTjWOF_DHI\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?i=kcJG2yuyTEg:pJUjiYGfJtM:-BTjWOF_DHI\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=kcJG2yuyTEg:pJUjiYGfJtM:D7DqB2pKExk\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?i=kcJG2yuyTEg:pJUjiYGfJtM:D7DqB2pKExk\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?a=kcJG2yuyTEg:pJUjiYGfJtM:qj6IDK7rITs\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/Techcrunch?d=qj6IDK7rITs\" border=\"0\"><\/img><\/a>\n<\/div>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~r\/Techcrunch\/~4\/kcJG2yuyTEg\" height=\"1\" width=\"1\" alt=\"\"\/> <\/p>\n","protected":false},"author":5817,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[25],"tags":[59,66,26],"class_list":["post-336086","post","type-post","status-publish","format-standard","hentry","category-technology","tag-media","tag-techcrunch","tag-technology"],"_links":{"self":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/336086","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/users\/5817"}],"replies":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/comments?post=336086"}],"version-history":[{"count":0,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/336086\/revisions"}],"wp:attachment":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/media?parent=336086"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/categories?post=336086"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/tags?post=336086"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}