![](\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/05\/nvidia.jpg?w=738\")
<\/p>\n<\/p>\n
I helped work on a thing last weekend that I can\u2019t write about, yet, and then last week I found my way to San Jose for Nvidia\u2019s GPU Technology Conference, and fine, all right, OK, I\u2019m convinced: now that the smartphone boom is plateauing, AI\/deep learning is the new cool face of technology \u2014 and, at least for now<\/a>, Nvidia bestrides it like many parallel colossi.<\/p>\n I use the metaphor \u201ccoal face\u201d advisedly. It\u2019s the place where advances are being made, where the most value is being created \u2026 but it\u2019s also a messy business, often with little visibility, with many ways to go terribly wrong. Neural networks are still more applied science than they are engineering, although it\u2019s beginning to move along that spectrum. The Nvidia GPU conference featured a sizable zone of scientific posters exploring the cutting edge of GPU usage, something you don\u2019t see at a lot of tech conferences. It turns out some of those smug academic Ph.Ds were onto something after all. Who knew?<\/p>\n I feel slightly awkward writing about this stuff; I suppose it\u2019s how tech journalists who aren\u2019t engineers themselves must feel most of the time. All I have in the hands-on AI\/ML\/deep-learning\/neural-network experience is some time I\u2019ve spent playing around with TensorFlow<\/a>, a graduate-level neural-network course I took back in the day, and some book research. Normally when I write about software I do with the confidence of someone who\u2019s been paid to write software for a long time. Now, though, I feel a bit like an explorer in a strange land.<\/p>\n What even to call it? None of the names we use actually quite seem to fit. \u201cArtifical intelligence\u201d and \u201cmachine intelligence\u201d have become the de facto standard, but it writes a misleading check the technology\u2019s still a long way off from cashing. \u201cPattern recognition\u201d elide the fact that we\u2019ve gone way past recognition, and into translation and generation of patterns. \u201cMachine learning\u201d includes a host of historical techniques which don\u2019t seem so relevant any more, in the age of neural networks, and yet \u201cneural networks\u201d is both too narrow and too broad. \u201cDeep learning\u201d has something of a specific technical meaning, but it seems the least bad option, and it\u2019s what Nvidia CEO Jensen Huang<\/a> uses, so let\u2019s go with that. For now. In ten years, though, who knows, maybe \u201cAI\u201d will seem somewhat less presumptuous.<\/p>\n Deep learning opens up entire new categories<\/em> of problems and makes them solvable. Only 2.5 years ago XKCD could joke<\/a> that it would take \u201ca research team and five years\u201d to write software to determine whether a picture contained the image of a bird, and most of the industry nodded knowledgeably and laughed. Thirty months later, that joke seems painfully dated. Today we measure the solution not in years of developer time, but in days of GPU time.<\/p>\n So what are the implications, and opportunities, and possible abuses, of computer vision which is as semantically powerful as ours, able \u2014 if sufficiently well trained, and not overfitted \u2014 to recognize objects, threats, possibilities, human age and expression and social class? Of the ability to generate patterns, and copy them, to reimagine any image in the style of any other, be it Old Master or photo filter? Of the capacity to do this kind of pattern recognition, translation, and generation for any<\/em> sufficiently broad set of data, not just images? Or of implicit biases, or inexplicable reasoning, that wind up secretly poisoning such systems?<\/p>\n \u2026Yeah, I don\u2019t know either. (Other than: yet more uses for images means yet more cameras in ever more places.) What I can<\/em> tell you is that the real explosion in deep learning applications will come when this technology is accessible to the average engineer, just as smartphones really<\/em> started to take off when anyone with a phone and a laptop could start submitting apps to the App Store.<\/p>\n And we\u2019re a ways away from that yet. This technology is moving so fast that the tooling around it seems to be failing to keep up, and also, conceptually, it\u2019s all still a little opaque and forbidding to the average engineer. A whole lot of modern software engineers are autodidacts without much formal training in algorithms, much less higher math. Even if they do have formal training, big-O notation, Turing machines, NP-completeness, etc., are one thing; tensor operations and stochastic gradient descent algorithms are quite another.<\/p>\n What\u2019s more, to do anything really<\/em> interesting, sheer brainpower won\u2019t be enough; you\u2019ll need massive datasets, to train your system. Does that make deep learning winner-took-all before it even started? Even if you find open data, and you have a whole new novel deep-learning notion, you\u2019ll still need large quantities of very expensive GPUs or very expensive GPU time. This stuff isn\u2019t near<\/em> as accessible, yet, as apps were during the smartphone boom\u2026<\/p>\n \u2026which is of course part of its charm. App and web coding has descended into something pretty close to plumbing, in places, of late. I\u2019ve stopped asking interviewees what their favorite algorithm is, because even those who understand what I\u2019m asking really struggle to answer, and it doesn\u2019t seem fair to ask a question which may not really be all that germane to their job. So frankly it\u2019s something of a relief to see that the next big thing is limited, for now, to a high priest\/priestesshood with a deep fundamental and theoretical grounding. It\u2019s the way things are supposed to be. And it\u2019s extra evidence, if you\u2019ll pardon the circular reasoning, that this is the next big thing.<\/p>\n And yet I sound a note of caution. There\u2019s only so much these high priests and priestesses can do, and when both the science and the tools are still under frantic development, progress tends to be patchy and punctuated rather than pervasive. Like the Internet itself, in its early years, don\u2019t overestimate deep learning\u2019s impact in the short term \u2014 but, like the Internet itself, don\u2019t under<\/em>estimate its impact in the long run.<\/p>\n","protected":false},"excerpt":{"rendered":"![\"\"](\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/05\/nvidia.jpg?w=680\")
I helped work on a thing last weekend that I can’t write about, yet, and then last week I found my way to San Jose for Nvidia’s GPU Technology Conference, and fine, all right, OK, I’m convinced: now that the smartphone boom is plateauing, AI\/deep learning is the new cool face of technology — and, at least for now, Nvidia bestrides it like many parallel colossi. I use… Read More<\/a><\/p>\n\n<\/img><\/a>
<\/img><\/a>
<\/img><\/a>
<\/img><\/a>
<\/img><\/a>
<\/img><\/a>\n<\/div>\n
<\/p>\n","protected":false},"author":5817,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[25],"tags":[59,66,26],"class_list":["post-340882","post","type-post","status-publish","format-standard","hentry","category-technology","tag-media","tag-techcrunch","tag-technology"],"_links":{"self":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/340882","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/users\/5817"}],"replies":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/comments?post=340882"}],"version-history":[{"count":0,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/340882\/revisions"}],"wp:attachment":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/media?parent=340882"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/categories?post=340882"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/tags?post=340882"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}