{"id":118273,"date":"2024-10-25T17:01:45","date_gmt":"2024-10-25T10:01:45","guid":{"rendered":"https:\/\/hotvideos24.online\/?p=118273"},"modified":"2024-10-25T17:01:45","modified_gmt":"2024-10-25T10:01:45","slug":"meta-just-beat-google-and-apple-in-the-race-to-put-powerful-ai-on-phones","status":"publish","type":"post","link":"https:\/\/hotvideos24.online\/?p=118273","title":{"rendered":"Meta just beat Google and Apple in the race to put powerful AI on phones"},"content":{"rendered":" <script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-3711241968723425\"\r\n     crossorigin=\"anonymous\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-layout-key=\"-fb+5w+4e-db+86\"\r\n     data-ad-client=\"ca-pub-3711241968723425\"\r\n     data-ad-slot=\"7910942971\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script>\r\n<br><div>\n\t\t\t\t<div id=\"boilerplate_2682874\" class=\"post-boilerplate boilerplate-before\">\n<p><em>Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. <a href=\"https:\/\/venturebeat.com\/newsletters\/?utm_source=VBsite&amp;utm_medium=desktopNav\" data-type=\"link\" data-id=\"https:\/\/venturebeat.com\/newsletters\/?utm_source=VBsite&amp;utm_medium=desktopNav\">Learn More<\/a><\/em><\/p>\n\n\n\n<hr class=\"wp-block-separator has-css-opacity is-style-wide\"\/>\n<\/div><p><a href=\"https:\/\/ai.meta.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Meta Platforms<\/a> has created smaller versions of its Llama artificial intelligence models that can run on smartphones and tablets, opening new possibilities for AI beyond data centers.<\/p>\n\n\n\n<p>The company announced compressed versions of its <a href=\"https:\/\/ai.meta.com\/blog\/meta-llama-quantized-lightweight-models\/\" target=\"_blank\" rel=\"noreferrer noopener\">Llama 3.2 1B<\/a> and <a href=\"https:\/\/ai.meta.com\/blog\/meta-llama-quantized-lightweight-models\/\" target=\"_blank\" rel=\"noreferrer noopener\">3B models<\/a> today that run up to four times faster while using less than half the memory of earlier versions. These smaller models perform nearly as well as their larger counterparts, according to Meta\u2019s testing.<\/p>\n\n\n\n\n\n\n\n<p>The advancement uses a compression technique called <a href=\"https:\/\/huggingface.co\/docs\/optimum\/en\/concept_guides\/quantization\">quantization<\/a>, which simplifies the mathematical calculations that power AI models. Meta combined two methods: <a href=\"https:\/\/huggingface.co\/papers\/2309.14717\" target=\"_blank\" rel=\"noreferrer noopener\">Quantization-Aware Training with LoRA adaptors (QLoRA)<\/a> to maintain accuracy, and <a href=\"https:\/\/huggingface.co\/docs\/optimum\/en\/concept_guides\/quantization\" target=\"_blank\" rel=\"noreferrer noopener\">SpinQuant<\/a> to improve portability.<\/p>\n\n\n\n<p>This technical achievement solves a key problem: running advanced AI without massive computing power. Until now, sophisticated AI models required data centers and specialized hardware.<\/p>\n\n\n\n<p>Tests on <a href=\"https:\/\/www.oneplus.com\/us\/oneplus-12\" target=\"_blank\" rel=\"noreferrer noopener\">OnePlus 12<\/a> Android phones showed the compressed models were 56% smaller and used 41% less memory while processing text more than twice as fast. The models can handle texts up to 8,000 characters, enough for most mobile apps.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1920\" height=\"974\" src=\"https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?w=800\" alt=\"\" class=\"wp-image-2979949\" srcset=\"https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png 1920w, https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?resize=300,152 300w, https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?resize=768,390 768w, https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?resize=800,406 800w, https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?resize=1536,779 1536w, https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?resize=100,50 100w, https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?resize=400,203 400w, https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?resize=750,380 750w, https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?resize=578,293 578w, https:\/\/venturebeat.com\/wp-content\/uploads\/2024\/10\/464307751_477718101949854_4588809159017166700_n.png?resize=930,472 930w\" sizes=\"(max-width: 1920px) 100vw, 1920px\"\/><figcaption class=\"wp-element-caption\">Meta\u2019s compressed AI models (SpinQuant and QLoRA) show dramatic improvements in speed and efficiency compared to standard versions when tested on Android phones. The smaller models run up to four times faster while using half the memory. (Credit: Meta)<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-tech-giants-race-to-define-ai-s-mobile-future\">Tech giants race to define AI\u2019s mobile future<\/h2>\n\n\n\n<p>Meta\u2019s release intensifies a strategic battle among tech giants to control how AI runs on mobile devices. While <a href=\"https:\/\/blog.google\/products\/android\/google-ai-android-update-io-2024\/\" target=\"_blank\" rel=\"noreferrer noopener\">Google<\/a> and <a href=\"https:\/\/www.apple.com\/apple-intelligence\/\" target=\"_blank\" rel=\"noreferrer noopener\">Apple<\/a> take careful, controlled approaches to mobile AI \u2014 keeping it tightly integrated with their operating systems \u2014 Meta\u2019s strategy is markedly different.<\/p>\n\n\n\n<p>By open-sourcing these compressed models and partnering with chip makers <a href=\"https:\/\/www.qualcomm.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Qualcomm<\/a> and <a href=\"https:\/\/www.mediatek.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">MediaTek<\/a>, Meta bypasses traditional platform gatekeepers. Developers can build AI applications without waiting for Google\u2019s <a href=\"https:\/\/blog.google\/products\/android\/google-ai-android-update-io-2024\/\" target=\"_blank\" rel=\"noreferrer noopener\">Android updates<\/a> or Apple\u2019s <a href=\"https:\/\/www.apple.com\/apple-intelligence\/\" target=\"_blank\" rel=\"noreferrer noopener\">iOS features<\/a>. This move echoes the early days of mobile apps, when open platforms dramatically accelerated innovation.<\/p>\n\n\n\n<p>The partnerships with <a href=\"https:\/\/www.qualcomm.com\/news\/onq\/2024\/09\/qualcomm-partners-with-meta-to-support-llama-3-point-2-big-deal-for-on-device-ai\" target=\"_blank\" rel=\"noreferrer noopener\">Qualcomm<\/a> and <a href=\"https:\/\/www.theverge.com\/2023\/11\/16\/23964500\/meta-and-mediatek-are-teaming-up-to-develop-custom-silicon-for-ar-glasses\" target=\"_blank\" rel=\"noreferrer noopener\">MediaTek<\/a> are particularly significant. These companies power most of the world\u2019s Android phones, including devices in emerging markets where Meta sees growth potential. By optimizing its models for these widely-used processors, Meta ensures its AI can run efficiently on phones across different price points \u2014 not just premium devices.<\/p>\n\n\n\n<p>The decision to distribute through both <a href=\"https:\/\/www.llama.com\/\">Meta\u2019s Llama website<\/a> and <a href=\"https:\/\/huggingface.co\/meta-llama\">Hugging Face<\/a>, the increasingly influential AI model hub, shows Meta\u2019s commitment to reaching developers where they already work. This dual distribution strategy could help Meta\u2019s compressed models become the de facto standard for mobile AI development, much as <a href=\"https:\/\/www.tensorflow.org\/\">TensorFlow<\/a> and <a href=\"https:\/\/pytorch.org\/\">PyTorch<\/a> became standards for machine learning.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-the-future-of-ai-in-your-pocket\">The future of AI in your pocket<\/h2>\n\n\n\n<p>Meta\u2019s announcement today points to a larger shift in artificial intelligence: the move from centralized to personal computing. While cloud-based AI will continue to handle complex tasks, these new models suggest a future where phones can process sensitive information privately and quickly.<\/p>\n\n\n\n<p>The timing is significant. Tech companies face mounting pressure over data collection and AI transparency. Meta\u2019s approach \u2014 making these tools open and running them directly on phones \u2014 addresses both concerns. Your phone, not a distant server, could soon handle tasks like document summarization, text analysis, and creative writing.<\/p>\n\n\n\n<p>This mirrors other pivotal shifts in computing. Just as processing power moved from mainframes to personal computers, and computing moved from desktops to smartphones, AI appears ready for its own transition to personal devices. Meta\u2019s bet is that developers will embrace this change, creating applications that blend the convenience of mobile apps with the intelligence of AI.<\/p>\n\n\n\n<p>Success isn\u2019t guaranteed. These models still need powerful phones to run well. Developers must weigh the benefits of privacy against the raw power of cloud computing. And Meta\u2019s competitors, particularly Apple and Google, have their own visions for AI\u2019s future on phones.<\/p>\n\n\n\n<p>But one thing is clear: AI is breaking free from the data center, one phone at a time.<\/p>\n<div id=\"boilerplate_2660155\" class=\"post-boilerplate boilerplate-after\"><div class=\"Boilerplate__newsletter-container\">\n<div class=\"Boilerplate__newsletter-main\">\n<p><strong>VB Daily<\/strong><\/p>\n<p>Stay in the know! Get the latest news in your inbox daily<\/p>\n<p class=\"Form__newsletter-legal\">By subscribing, you agree to VentureBeat&#8217;s <a href=\"https:\/\/venturebeat.com\/terms-of-service\/\">Terms of Service.<\/a><\/p>\n<p class=\"Form__success\" id=\"boilerplateNewsletterConfirmation\">\n\t\t\t\t\tThanks for subscribing. Check out more <a href=\"https:\/\/venturebeat.com\/newsletters\/\">VB newsletters here<\/a>.\n\t\t\t\t<\/p>\n<p class=\"Form__error\">An error occured.<\/p>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\t\t\t<\/div>\r\n<br><script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-3711241968723425\"\r\n     crossorigin=\"anonymous\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-layout-key=\"-fb+5w+4e-db+86\"\r\n     data-ad-client=\"ca-pub-3711241968723425\"\r\n     data-ad-slot=\"7910942971\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script>\r\n<br><div data-type=\"_mgwidget\" data-widget-id=\"1660802\">\r\n<\/div>\r\n<script>(function(w,q){w[q]=w[q]||[];w[q].push([\"_mgc.load\"])})(window,\"_mgq\");\r\n<\/script>\r\n\r\n<br><a href=\"https:\/\/venturebeat.com\/ai\/meta-just-beat-google-and-apple-in-the-race-to-put-powerful-ai-on-phones\/\">Source link <\/a>\r\n","protected":false},"excerpt":{"rendered":"<p>Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Meta Platforms has created smaller versions of its Llama artificial intelligence &hellip; <a href=\"https:\/\/hotvideos24.online\/?p=118273\" class=\"more-link\">Read More<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8630],"tags":[],"class_list":["post-118273","post","type-post","status-publish","format-standard","hentry","category-technology","entry"],"_links":{"self":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts\/118273","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=118273"}],"version-history":[{"count":0,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts\/118273\/revisions"}],"wp:attachment":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=118273"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=118273"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=118273"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}