{"id":107720,"date":"2024-09-28T00:52:53","date_gmt":"2024-09-27T17:52:53","guid":{"rendered":"https:\/\/hotvideos24.online\/?p=107720"},"modified":"2024-09-28T00:52:53","modified_gmt":"2024-09-27T17:52:53","slug":"man-tricks-openais-voice-bot-into-duet-of-the-beatles-eleanor-rigby","status":"publish","type":"post","link":"https:\/\/hotvideos24.online\/?p=107720","title":{"rendered":"Man tricks OpenAI\u2019s voice bot into duet of The Beatles\u2019 \u201cEleanor Rigby\u201d"},"content":{"rendered":"<p> <script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-3711241968723425\"\r\n     crossorigin=\"anonymous\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-layout-key=\"-fb+5w+4e-db+86\"\r\n     data-ad-client=\"ca-pub-3711241968723425\"\r\n     data-ad-slot=\"7910942971\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script><br \/>\n<\/p>\n<div itemprop=\"articleBody\">\n<figure class=\"intro-image intro-left\">\n  <img decoding=\"async\" src=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2024\/09\/aj_smith_playing_header-800x450.jpg\" alt=\"A screen capture of AJ Smith doing his Eleanor Rigby duet with OpenAI's Advanced Voice Mode through the ChatGPT app.\"\/><figcaption class=\"caption\">\n<div class=\"caption-text\"><a href=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2024\/09\/aj_smith_playing_header.jpg\" class=\"enlarge-link\" data-height=\"675\" data-width=\"1200\">Enlarge<\/a> <span class=\"sep\">\/<\/span> A screen capture of AJ Smith doing his Eleanor Rigby duet with OpenAI&#8217;s Advanced Voice Mode through the ChatGPT app.<\/div>\n<\/figcaption><\/figure>\n<aside id=\"social-left\" class=\"social-left\" aria-label=\"Read the comments or share this article\">\n<\/aside>\n<p><!-- cache hit 31:single\/related:6cebd926f48b47509c32f834bda8eea4 --><!-- empty --><\/p>\n<p>OpenAI&#8217;s new <a href=\"https:\/\/arstechnica.com\/information-technology\/2024\/07\/when-counting-quickly-openais-new-voice-mode-stops-to-catch-its-breath\/\">Advanced Voice Mode<\/a> (AVM) of its ChatGPT AI assistant <a href=\"https:\/\/arstechnica.com\/ai\/2024\/09\/talking-to-chatgpt-for-the-first-time-is-a-surreal-experience\/\">rolled out<\/a> to subscribers on Tuesday, and people are already finding novel ways to use it, even against OpenAI&#8217;s wishes. On Thursday, a software architect named AJ Smith <a href=\"https:\/\/x.com\/aj_dev_smith\/status\/1839472954289131947\">tweeted a video<\/a> of himself playing a duet of The Beatles&#8217; 1966 song &#8220;Eleanor Rigby&#8221; with AVM. In the video, Smith plays the guitar and sings, with the AI voice interjecting and singing along sporadically, praising his rendition.<\/p>\n<p>&#8220;Honestly, it was mind-blowing. The first time I did it, I wasn\u2019t recording and literally got chills,&#8221; Smith told Ars Technica via text message. &#8220;I wasn\u2019t even asking it to sing along.&#8221;<\/p>\n<p>Smith is no stranger to AI topics. In his day job, he works as associate director of AI Engineering at S&amp;P Global. &#8220;I use [AI] all the time and lead a team that uses AI day to day,&#8221; he told us.<\/p>\n<p>In the video, AVM&#8217;s voice is a little quavery and not pitch-perfect, but it appears to know something about &#8220;Eleanor Rigby&#8217;s&#8221; melody when it first sings, &#8220;Ah, look at all the lonely people.&#8221; After that, it seems to be guessing at the melody and rhythm as it recites song lyrics. We have also convinced Advanced Voice Mode to sing, and it did a perfect melodic rendition of &#8220;Happy Birthday&#8221; after some coaxing.<\/p>\n<figure class=\"video ars-wp-video\">\n<p>\n        <video class=\"wp-video-shortcode\" id=\"video-2052995-1\" width=\"1280\" height=\"720\" preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2024\/09\/eleanor-rigby_8n6jq-ry6K8802HW.mp4?_=1\"\/>AJ Smith&#8217;s video of singing a duet with OpenAI&#8217;s Advanced Voice Mode.<\/video>    <\/p><figcaption class=\"caption\">\n<p>AJ Smith&#8217;s video of singing a duet with OpenAI&#8217;s Advanced Voice Mode. <\/p>\n<\/figcaption><\/figure>\n<p>Normally, when you ask AVM to sing, it will reply something like, &#8220;M<span class=\"css-1jxf684 r-bcqeeo r-1ttztb7 r-qvutc0 r-poiln3\">y guidelines won\u2019t let me talk about that.&#8221; That&#8217;s because in the chatbot&#8217;s initial instructions (called a &#8220;<a href=\"https:\/\/arstechnica.com\/information-technology\/2023\/02\/ai-powered-bing-chat-spills-its-secrets-via-prompt-injection-attack\/\">system prompt<\/a>&#8220;), OpenAI instructs the voice assistant not to sing or make sound effects (&#8220;Do not sing or hum,&#8221; according to one <a href=\"https:\/\/github.com\/elder-plinius\/L1B3RT45\/blob\/main\/SYSTEMPROMPTS.mkd\">system prompt leak<\/a>).<\/span><\/p>\n<p><span class=\"css-1jxf684 r-bcqeeo r-1ttztb7 r-qvutc0 r-poiln3\">OpenAI possibly added this restriction because AVM may otherwise reproduce copyrighted content, such as songs that were found in the training data used to create the AI model itself. That&#8217;s what is happening here to a limited extent, so in a sense, Smith has discovered a form of what researchers call a &#8220;<a href=\"https:\/\/arstechnica.com\/information-technology\/2022\/09\/twitter-pranksters-derail-gpt-3-bot-with-newly-discovered-prompt-injection-hack\/\">prompt injection<\/a>,&#8221; which is a way of convincing an AI model to produce outputs that go against its system instructions.<br \/><\/span><\/p>\n<p>How did Smith do it? He figured out a game that reveals AVM knows more about music than it may let on in conversation. &#8220;I just said we\u2019d play a game. I\u2019d play the four pop chords and it would shout out songs for me to sing along with those chords,&#8221; Smith told us. &#8220;Which did work pretty well! But after a couple songs it started to sing along. Already it was such a unique experience, but that really took it to the next level.&#8221;<\/p>\n<p>This is not the first time humans have played musical duets with computers. That type of research <a href=\"https:\/\/pitchfork.com\/features\/article\/9002-laurie-spiegel\/\">stretches back<\/a> to the 1970s, although it was typically limited to reproducing musical notes or instrumental sounds. But this is the first time we&#8217;ve seen anyone duet with an audio-synthesizing voice chatbot in real time.<\/p>\n<\/p><\/div>\n<p><script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-3711241968723425\"\r\n     crossorigin=\"anonymous\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-layout-key=\"-fb+5w+4e-db+86\"\r\n     data-ad-client=\"ca-pub-3711241968723425\"\r\n     data-ad-slot=\"7910942971\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script><br \/>\n<br \/><div data-type=\"_mgwidget\" data-widget-id=\"1660802\">\r\n<\/div>\r\n<script>(function(w,q){w[q]=w[q]||[];w[q].push([\"_mgc.load\"])})(window,\"_mgq\");\r\n<\/script>\r\n<br \/>\n<br \/><a href=\"https:\/\/arstechnica.com\/information-technology\/2024\/09\/man-tricks-openais-voice-bot-into-duet-of-the-beatles-eleanor-rigby\/\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Enlarge \/ A screen capture of AJ Smith doing his Eleanor Rigby duet with OpenAI&#8217;s Advanced Voice Mode through the ChatGPT app. OpenAI&#8217;s new Advanced Voice Mode (AVM) of its &hellip; <a href=\"https:\/\/hotvideos24.online\/?p=107720\" class=\"more-link\">Read More<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8630],"tags":[],"class_list":["post-107720","post","type-post","status-publish","format-standard","hentry","category-technology","entry"],"_links":{"self":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts\/107720","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=107720"}],"version-history":[{"count":0,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts\/107720\/revisions"}],"wp:attachment":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=107720"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=107720"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=107720"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}