{"id":124708,"date":"2024-11-11T20:00:31","date_gmt":"2024-11-11T13:00:31","guid":{"rendered":"https:\/\/hotvideos24.online\/?p=124708"},"modified":"2024-11-11T20:00:31","modified_gmt":"2024-11-11T13:00:31","slug":"how-a-stubborn-computer-scientist-accidentally-launched-the-deep-learning-boom","status":"publish","type":"post","link":"https:\/\/hotvideos24.online\/?p=124708","title":{"rendered":"How a stubborn computer scientist accidentally launched the deep learning boom"},"content":{"rendered":"<p> <script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-3711241968723425\"\r\n     crossorigin=\"anonymous\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-layout-key=\"-fb+5w+4e-db+86\"\r\n     data-ad-client=\"ca-pub-3711241968723425\"\r\n     data-ad-slot=\"7910942971\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script><br \/>\n<\/p>\n<div>\n<p>So in 2006, Nvidia announced the CUDA platform. CUDA allows programmers to write \u201ckernels,\u201d short programs designed to run on a single execution unit. Kernels allow a big computing task to be split up into bite-sized chunks that can be processed in parallel. This allows certain kinds of calculations to be completed far faster than with a CPU alone.<\/p>\n<p>But there was little interest in CUDA when it was first introduced, <a href=\"https:\/\/www.newyorker.com\/magazine\/2023\/12\/04\/how-jensen-huangs-nvidia-is-powering-the-ai-revolution\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">wrote Steven Witt<\/a> in The New Yorker last year:<\/p>\n<blockquote>\n<p>When CUDA was released, in late 2006, Wall Street reacted with dismay. Huang was bringing supercomputing to the masses, but the masses had shown no indication that they wanted such a thing.<\/p>\n<p>\u201cThey were spending a fortune on this new chip architecture,\u201d Ben Gilbert, the co-host of \u201cAcquired,\u201d a popular Silicon Valley podcast, said. \u201cThey were spending many billions targeting an obscure corner of academic and scientific computing, which was not a large market at the time\u2014certainly less than the billions they were pouring in.\u201d<\/p>\n<p>Huang argued that the simple existence of CUDA would enlarge the supercomputing sector. This view was not widely held, and by the end of 2008, Nvidia\u2019s stock price had declined by seventy percent\u2026<\/p>\n<p>Downloads of CUDA hit a peak in 2009, then declined for three years. Board members worried that Nvidia\u2019s depressed stock price would make it a target for corporate raiders.<\/p>\n<\/blockquote>\n<p>Huang wasn\u2019t specifically thinking about AI or neural networks when he created the CUDA platform. But it turned out that Hinton\u2019s backpropagation algorithm could easily be split up into bite-sized chunks. So training neural networks turned out to be a killer app for CUDA.<\/p>\n<p>According to Witt, Hinton was quick to recognize the potential of CUDA:<\/p>\n<blockquote>\n<p>In 2009, Hinton\u2019s research group used Nvidia\u2019s CUDA platform to train a neural network to recognize human speech. He was surprised by the quality of the results, which he presented at a conference later that year. He then reached out to Nvidia. \u201cI sent an e-mail saying, \u2018Look, I just told a thousand machine-learning researchers they should go and buy Nvidia cards. Can you send me a free one?\u2019 \u201d Hinton told me. \u201cThey said no.\u201d<\/p>\n<\/blockquote>\n<p>Despite the snub, Hinton and his graduate students, Alex Krizhevsky and Ilya Sutskever, obtained a pair of <a href=\"https:\/\/www.techpowerup.com\/gpu-specs\/geforce-gtx-580.c270\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">Nvidia GTX 580 GPUs<\/a> for the AlexNet project. Each GPU had 512 execution units, allowing Krizhevsky and Sutskever to train a neural network hundreds of times faster than would be possible with a CPU. This speed allowed them to train a larger model\u2014and to train it on many more training images. And they would need all that extra computing power to tackle the massive ImageNet dataset.<\/p>\n<\/p><\/div>\n<p><script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-3711241968723425\"\r\n     crossorigin=\"anonymous\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-layout-key=\"-fb+5w+4e-db+86\"\r\n     data-ad-client=\"ca-pub-3711241968723425\"\r\n     data-ad-slot=\"7910942971\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script><br \/>\n<br \/><div data-type=\"_mgwidget\" data-widget-id=\"1660802\">\r\n<\/div>\r\n<script>(function(w,q){w[q]=w[q]||[];w[q].push([\"_mgc.load\"])})(window,\"_mgq\");\r\n<\/script>\r\n<br \/>\n<br \/><a href=\"https:\/\/arstechnica.com\/ai\/2024\/11\/how-a-stubborn-computer-scientist-accidentally-launched-the-deep-learning-boom\/\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>So in 2006, Nvidia announced the CUDA platform. CUDA allows programmers to write \u201ckernels,\u201d short programs designed to run on a single execution unit. Kernels allow a big computing task &hellip; <a href=\"https:\/\/hotvideos24.online\/?p=124708\" class=\"more-link\">Read More<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8630],"tags":[],"class_list":["post-124708","post","type-post","status-publish","format-standard","hentry","category-technology","entry"],"_links":{"self":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts\/124708","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=124708"}],"version-history":[{"count":0,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts\/124708\/revisions"}],"wp:attachment":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=124708"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=124708"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=124708"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}