![](\"https:\/\/tctechcrunch2011.files.wordpress.com\/2016\/06\/youtube-logo.jpg?w=738\"){kind=logo}
<\/p>\n<\/p>\n
YouTube has long<\/a> had an automatic captioning system that, thanks to\u00a0Google\u2019s machine learning advances in recent years, has gotten pretty good at automatically transcribing spoken words in a video. As the company announced<\/a> today, its technology is now able to take this a step further by also captioning some of the ambient sounds like [LAUGHTER], [APPLAUSE] and [MUSIC].<\/p>\n For now, the automatic effects captioning is\u00a0actually restricted to those exactly these three sounds. The reason for this, Google says, is due to the fact that these are also exactly the sounds that most video producers manually caption right now.<\/p>\n \u201cWhile the sound space is obviously far richer and provides even more contextually relevant information than these three classes, the semantic information conveyed by these sound effects in the caption track is relatively unambiguous, as opposed to sounds like [RING] which raises the question of \u201cwhat was it that rang \u2013 a bell, an alarm, a phone?,\u201d Google engineer Sourish Chaudhuri explains in today\u2019s announcement.<\/p>\n Now that Google has the systems in place to caption those sounds, though, it should relatively easy to also caption other sounds as well.<\/p>\n In the backend, YouTube\u2019s\u00a0sound captioning system is based on a Deep Neural Network model\u00a0the team trained on a set of weakly labeled data<\/a>. Whenever a new video is now uploaded to YouTube, the\u00a0new system runs and tries to identify these sounds.\u00a0For those of you who want to know more about how the team achieved this (and how it used a modified Viterbi algorithm<\/a>), Google\u2019s own blog<\/a> post\u00a0provides more details.<\/p>\n Featured Image: ERIC PIERMONT<\/a>\/Getty Images<\/small><\/p>\n","protected":false},"excerpt":{"rendered":"![\"\"](\"https:\/\/tctechcrunch2011.files.wordpress.com\/2017\/03\/image00-2.png?w=1024&h=235\")
<\/a><\/p>\n![\"\"](\"https:\/\/tctechcrunch2011.files.wordpress.com\/2016\/06\/youtube-logo.jpg?w=680\"){kind=logo}
YouTube has long had an automatic captioning system that, thanks to\u00a0Google’s machine learning advances in recent years, has gotten pretty good at automatically transcribing spoken words in a video. As the company announced today, its technology is now able to take this a step further by also captioning some of the ambient sounds like [LAUGHTER], [APPLAUSE] and [MUSIC].
\nFor now, the… Read More<\/a><\/p>\n\n<\/img><\/a>
<\/img><\/a>
<\/img><\/a>
<\/img><\/a>
<\/img><\/a>
<\/img><\/a>\n<\/div>\n
<\/p>\n","protected":false},"author":5817,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[25],"tags":[59,66,26],"class_list":["post-336614","post","type-post","status-publish","format-standard","hentry","category-technology","tag-media","tag-techcrunch","tag-technology"],"_links":{"self":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/336614","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/users\/5817"}],"replies":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/comments?post=336614"}],"version-history":[{"count":0,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/336614\/revisions"}],"wp:attachment":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/media?parent=336614"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/categories?post=336614"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/tags?post=336614"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}