If an LLM can’t be trusted with a fast food order, I can’t imagine what it is reliable enough for. I really was expecting this was the easy use case for the things.

It sounds like most orders still worked, so I guess we’ll see if other chains come to the same conclusion.

  • LemmyKnowsBest@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    ·
    20 hours ago

    One day in 2012 at McDonald’s drive thru, talking to a real human on site through the speaker just like the good old days, I ordered

    “A Filet o’ Fish.”

    Imagine my surprise at the dollar total and when they handed me a bag of

    EIGHT Filet o’ Fish.

    • CanadaPlus@lemmy.sdf.orgOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      5 hours ago

      Amazing level of critical thinking going on at the window when they didn’t double check that, lol.

      See, this is why I though AI drivethroughs would be fine. A certain number of mistakes are already made.

  • Etterra@discuss.online
    link
    fedilink
    English
    arrow-up
    9
    ·
    19 hours ago

    After hearing about this I now want to go up to AI menu board at my local Wendy’s and order 17x10³¹ triples burgers.

  • FosterMolasses@leminal.space
    link
    fedilink
    English
    arrow-up
    25
    arrow-down
    1
    ·
    2 days ago

    Hilarious, what a hero. Thank you king, this is the way to fight unsecure AI slop while they pretend its a legitimate reason to halve their workforce.

  • pruwyben@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    76
    arrow-down
    1
    ·
    2 days ago

    Since 2023, the fast-food chain has introduced the technology at over 500 locations in the US, with the aim of reducing mistakes and speeding up orders.

    Bullshit, they just want to save money by replacing employees with AI.

    • End-Stage-Ligma@lemmy.world
      link
      fedilink
      English
      arrow-up
      38
      ·
      2 days ago

      Step 1: replace all your workers with AI Step 2: set new record for unemployment Step 3: most people can’t afford your product Step 4: increase the price to compensate for decreasing sales Step 5: blame Obama

      • StinkyFingerItchyBum@lemmy.ca
        link
        fedilink
        English
        arrow-up
        8
        ·
        edit-2
        1 day ago

        Step 1: Replace your executive and board members with LLMs. Despite LLMs being increadibly unintelligent, there will be no loss of leadership IQ in the corporation because they were already unintelligent enough to put a LLM where it doesn’t belong because they don’t understand what it is and what it isn’t.

        Step 2: Enjoy the savings of those large useless eater salaries you no longer have to pay.

    • thebudman420@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      2 days ago

      They don’t even reduce cost from the savings. They charge the exact same amount until they want to increase prices.

  • SapphironZA@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    89
    arrow-down
    1
    ·
    2 days ago

    This is a problem that requires zero AI.

    A touchscreen kiosk is all you need to have the customer place their own order. You just need to have 2-3 ordering stations as they will be slower than trainer staff.

    But shareholders demand AI

      • Resonosity@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        5
        ·
        edit-2
        20 hours ago

        People use touchscreens for accessing ATMs in the States.

        Don’t see why this couldn’t be possible for fast food. There’s proven technology that already exists

        Edit: Just to add, fuck cars. And fuck anti-urban infrastructure. Maybe we should do away with touchscreens for fast food, as well as other pro car infrastructure. At least not incentivize it

        • grue@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          14 hours ago

          People use touchscreens for accessing ATMs in the States.

          Have you ever noticed how frequently they end up partially opening the car door and leaning out in order to reach (either because of a mismatch between screen height and car window height, or because they didn’t have the precision driving skills to pull in close to the machine without hitting it)? It’s pretty often, just sayin’. But yes, it could be done the same way for fast food.

          On a related note, I kinda miss the old pneumatic tube systems banks used to use, despite them being car-centric.

          • SaveTheTuaHawk@lemmy.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 hours ago

            Have you ever noticed how frequently they end up partially opening the car door and leaning out in order to reach (either because of a mismatch between screen height and car window height, or because they didn’t have the precision driving skills to pull in close to the machine without hitting it)?

            No, because I burn 6 calories and walk into the bank.

      • FoxyFerengi@startrek.website
        link
        fedilink
        English
        arrow-up
        17
        ·
        edit-2
        2 days ago

        Man, I never used fast food, or drive throughs as much as I have since I developed a mobility disorder. Last week I put a pickup order in at my local coffee shop out of habit, and couldn’t carry both my coffee and the breakfast sandwich to my car at the same time. Which sounds so stupid, but it took so much extra energy for both trips into the store that I was ready to go home and call it a day after that lol

        I know the answer is “don’t get fast food and just eat at home”, but I’ve also been so tired after work/school that I’m not eating, and I dunno what the answer to that is either. My state isn’t a place where people think about how to care for their communities, and most of it has hours of highway between “cities”

        • grue@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          1
          ·
          2 days ago

          I know the answer is “don’t get fast food and just eat at home”

          No it’s not. Well, at least not in terms of urbanism/mobility, anyway; YMMV on your household budgeting.

          The answer is that you shouldn’t have to get in a car at all between your home and your local coffee shop to begin with. It should be no more than a short walk (or wheelchair ride or whatever), door to door.

          • FoxyFerengi@startrek.website
            link
            fedilink
            English
            arrow-up
            5
            ·
            2 days ago

            It’s a mile, and across an interstate exit, to my nearest bus stop. And I live in the only city in the enormous state that takes public transportation seriously.

            I think I feel bad when I read articles like the ones you posted, before this I’d cross the distances and not think much of it because my last two cities didn’t have public transportation. Now I can’t cross fast enough to beat the crossing light, and it’s so incredibly unsafe if I fall. I feel like the problem, I guess

            • grue@lemmy.world
              link
              fedilink
              English
              arrow-up
              7
              arrow-down
              2
              ·
              2 days ago

              It’s a mile, and across an interstate exit, to my nearest bus stop. And I live in the only city in the enormous state that takes public transportation seriously.

              Your first sentence contradicts your second. Clearly, there are zero cities in your enormous state that take public transportation seriously.

              It’s crazy how most Americans have absolutely zero concept of just how bad even “good” infrastructure and city design in the US is, or how much better it could be.

              • FoxyFerengi@startrek.website
                link
                fedilink
                English
                arrow-up
                3
                ·
                2 days ago

                They do not contradict each other. I’m certain there will be more stops as the city grows, because they keep improving it. I used to live in a city, in another state, with one of the best public transportation systems in the country, and they also kept improving that system to include the surrounding cities in other counties. Just because something isn’t perfect already does not mean we can’t take it seriously and strive for perfection

      • Lost_My_Mind@lemmy.world
        link
        fedilink
        English
        arrow-up
        10
        ·
        2 days ago

        God damn. I was just about to invite you to the fuck cars community. In doing so, I needed the like with the !.

        In trying to find it on the sidebar, I see you’ve found that community. As a mod.

        Which means the whole basis for my comment is void before I even typed it!

        On a similiar note…can you put the ! link in the sidebar?

        • grue@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 day ago

          LOL, guilty as charged!

          On a similiar note…can you put the ! link in the sidebar?

          If it’s the best solution to your problem, sure! But is it?

          There’s nothing specific to !fuckcars about your request, so I’m not sure individual action by me is the right answer. Do you know of any examples of other communities that do the same? Have you made a thread somewhere like !lemmy_support@lemmy.ml or !fediverse@lemmy.world proposing it as a standard convention? Have you filed a feature request suggesting that the built-in community link at the top of the sidebar be changed to display the fully-qualified name with exclamation point, or that a button be added next to it to copy the correct text to your clipboard, or something like that?

        • betterdeadthanreddit@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          2 days ago

          I’m not sure which mobile clients have this feature but with a browser, you can just type ! and the first couple letters of the community name. It’ll start offering suggestions to choose from and narrow those down as you keep writing out the name. Making a selection fills in the rest of the link markdown for you.

      • theneverfox@pawb.social
        link
        fedilink
        English
        arrow-up
        5
        ·
        2 days ago

        You could basically get around this with 4 programmers and an expectation around word choice. Voice to text has improved massively, you could just require them to say menu items with modifiers

        Not that I disagree about drive throughs in concept, but this is just another problem easily solved by anything but raw LLMs

        • BenjiRenji@feddit.org
          link
          fedilink
          English
          arrow-up
          3
          ·
          2 days ago

          Completely right. People forget technology like Amazon’s Alexa (not an endorsenent) existed before LLMs. Speech recognotion just got better.

        • FuglyDuck@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          2 days ago

          yes… it’s improved dramatically.

          which is why 18,000 waters got ordered instead of 8 (or whatever.)

    • CanadaPlus@lemmy.sdf.orgOP
      link
      fedilink
      English
      arrow-up
      8
      ·
      edit-2
      2 days ago

      I actually don’t know why entering your own order hasn’t taken off more, come to think of it.

      • P00ptart@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        2 days ago

        Chick-fil-A even went the other way, putting 4 high schoolers out in the weather for it. Cold, hot, raining, doesn’t matter.

      • Waraugh@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        5
        ·
        2 days ago

        That’s how my local Taco Bell is. If you don’t use your phone to place the order when you walk in there’s four kiosks you walk up to for placing your order. None of the people working are working the counter.

      • FireRetardant@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 days ago

        Most people have a hard enough time getting their car close enough to the window to get the food or to handle the card reader. I doubt many people would enjoy the toucn screen ordering as the would struggle tk get close enough and may have to lean way out of their window to order. The touch screen would also have to work reliably while wet or freezing cold.

        Then you’ve got the issue of someone has to clean it and even with regular cleaning it has a huge potential to spread germs. Ultimately with all the disadvantages i think it would be too slow, too inconvenient, and add extra real estate to the drive thru.

        • CanadaPlus@lemmy.sdf.orgOP
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          edit-2
          2 days ago

          Yeah, I guess you’d need some kind of arm or something to put the screen across. And then I guess you’d have to worry about it being damaged. Meanwhile, hiccups aside, an LLM is pretty much a drop-in solution.

    • GenosseFlosse@feddit.org
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 days ago

      Also software voice recognition and using this for a shopping cart/order placement system (via phone line) has been a thing since the early 2000s, i know some mail order shops in Germany who used this.

  • yesman@lemmy.world
    link
    fedilink
    English
    arrow-up
    108
    arrow-down
    6
    ·
    2 days ago

    This is not AI failing to do an easy job. This is “unskilled” labor doing complex and demanding work that cannot be duplicated by trillion dollar software.

    • CanadaPlus@lemmy.sdf.orgOP
      link
      fedilink
      English
      arrow-up
      21
      arrow-down
      1
      ·
      2 days ago

      I mean, unskilled just means minimal extra training is needed, not that it’s not complicated. Actual non-complicated jobs were automated last century in the West.

    • Communist@lemmy.frozeninferno.xyz
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      12
      ·
      2 days ago

      Tbh this is an incredibly easy fix, either cap the number of waters someone can order in software or have an override where a human takes over if an order is suspicious, there’s not an infinite number of ways to fuck with this.

      • FauxLiving@lemmy.world
        link
        fedilink
        English
        arrow-up
        57
        arrow-down
        3
        ·
        2 days ago

        Capping waters fixes that one specific issue but not the problem.

        A suspicious order isn’t easy to define and no person who has ever participated in software development would underestimate the infinite ways a User can break software.

        • yetAnotherUser@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          2
          ·
          2 days ago

          There are machine learning algorithms for anomaly detection though. They actually work decently well because exploits like this do in fact differ significantly from regular orders. Because they assume all anomalies are attempted exploits, their false negative rate is rather low while their false positive rate can be a bit higher.

          Taco Bell has the capability to create a decently large training set from all recorded orders (which must all be valid and non-malicious) so they shouldn’t have too many issues developing this model.

          If an anomaly is detected, make a human verify it is indeed an irregular order.

          • hark@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            9 hours ago

            This is handwaving, which, to be fair, describes a lot of AI “solutions”. An anomaly could be as basic as a customer not wanting onions on their burger because the vast majority don’t make that modification.

            Now what do you do in that situation? Force orders to never have modifications? That customization is such an important feature to the point that burger king adopted it as a slogan with “have it your way”.

            • yetAnotherUser@discuss.tchncs.de
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              7 hours ago

              The idea of anomaly detection is to project some input onto a (high dimensional), numeric output. From the training data alone, you can then see where the projections are clustered and develop a high dimensional “boundary” where everything within is known and good and everything outside is unknown and possibly bad. Since orders come in relatively slow, a human would be able to check for false positives and overwrite the computer decision.

              By the way, an ideal training set is preprocessed and has duplicates removed and new orders added by recombining parts of individual orders.

              For example, if we have 3 orders:

              • (Hamburger, Fries)
              • (Hamburger, Fries)
              • (Cheeseburger, Sandwich)

              We could then create the following set:

              • (Hamburger)
              • (Cheeseburger)
              • (Fries)
              • (Sandwich)
              • (Hamburger, Fries)
              • (Hamburger, Cheeseburger)
              • (Hamburger, Sandwich)

              And so on, and so forth. A naive variant is just taking the power set of all valid orders.

        • Communist@lemmy.frozeninferno.xyz
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          8
          ·
          2 days ago

          there is an incredibly finite number of ways to mess with this, they just need a button to send a report to the engineers with how they got messed with and eventually they’ll have a complete list. I really doubt it’d take long to iron out the vast majority of ways that can be thought of.

          • leftzero@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            19
            ·
            2 days ago

            A QA engineer walks into a bar and orders a beer.

            She orders 2 beers.

            She orders 0 beers.

            She orders -1 beers.

            She orders a lizard.

            She orders a NULLPTR.

            She tries to leave without paying.

            Satisfied, she declares the bar ready for business. The first customer comes in an orders a beer. They finish their drink, and then ask where the bathroom is.

            The bar explodes.

            • Communist@lemmy.frozeninferno.xyz
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              6
              ·
              2 days ago

              This isn’t something you can input any text into, it’s fixed, that joke doesn’t apply, you can’t do an sql injection here.

              • hark@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                9 hours ago

                I don’t know how you can think voice input is less versatile than text input, especially when a lot of voice input systems transform voice to text before processing. At least with text you get well-defined characters with a lot less variability.

              • betterdeadthanreddit@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                ·
                2 days ago

                Close one, a joke was related to but not a perfect match for the present situation. Something terrible could have happened like… Uh…

                Let me get back to you on that.

        • Link@rentadrunk.org
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          3
          ·
          2 days ago

          Surely if the person making the order sees 18,000 waters they would think, hold on this doesn’t seem right maybe I should ask the customer if they really want 18,000 waters?

          The same applies for the ice cream with bacon on it which was mentioned in the article. I believe a lot of these could be resolved with a bit of common sense.

          • SaveTheTuaHawk@lemmy.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 hours ago

            The same applies for the ice cream with bacon on it

            Have you never seen what Americans eat? Bacon Creaminators are excellent.

          • Evkob (they/them)@lemmy.ca
            link
            fedilink
            English
            arrow-up
            4
            ·
            1 day ago

            If you think bacon on ice cream is weird enough to cancel an order, I can only imagine you’ve never worked a customer service job.

          • grue@lemmy.world
            link
            fedilink
            English
            arrow-up
            7
            ·
            2 days ago

            The same applies for the ice cream with bacon on it

            Does it, though? Unlike the 18,000 waters, if I were working a drive through I wouldn’t even blink at an order for bacon ice cream. Heck, I might make a little extra to try it for myself!

          • FauxLiving@lemmy.world
            link
            fedilink
            English
            arrow-up
            8
            arrow-down
            1
            ·
            2 days ago

            Sure, in the most extreme cases it would be obvious to the crew. But simply making mistakes at a higher rate than humans will result in a lot of unhappy customers.

          • Bronzebeard@lemmy.zip
            link
            fedilink
            English
            arrow-up
            2
            ·
            2 days ago

            Sure, but how do you distill this into a rule a computer can follow? “Suspicious” is not an objectively measurable thing that a program can just check against

            • TheRagingGeek@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              3
              ·
              2 days ago

              Think the easiest way would be to collect order data for at least a good number of months if not a couple years and feed it in and use that as a baseline of what a typical human order looks like, anything that deviates too far from that baseline needs to be handled by a human until someone can validate it as a good order, though I imagine you could get false positives for new menu items unless you set a reasonable instruction for items that have never appeared in the dataset before.

      • Brkdncr@lemmy.world
        link
        fedilink
        English
        arrow-up
        10
        arrow-down
        2
        ·
        2 days ago

        The point is that loopholes in software will always exist that lead to unexpected outcomes.

      • TriflingToad@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        4
        ·
        2 days ago

        that’s what happens 99% of the time. It’s kinda been a trend on the anti clanker side of TikTok, just order a large amount of stuff so a human takes over and actually helps you

      • Mac@mander.xyz
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 days ago

        Why can’t a trillion dollar AI say “Sir, that’s not reasonable”?

  • thebudman420@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    2 days ago

    Computer can’t understand voices good enough so they think you say something different. For example standard voice to text has failed me for years. Voice control for years and years has still failed me. Using gps? fail every time because the computer or phone in this case thinks i say other words that sound nowhere the same. This is before and after AI. The biggest problem is voice recognition of words. Humans can separate sound and frequency better. Ear drums are better than microphones. Even in quite environments i have a voice that doesn’t get translated properly and fails more often than it doesn’t. So AI is going to glitch on a lot of voices too because the voice recognition part still works the same flawed way with flawed microphone technology.

    • CanadaPlus@lemmy.sdf.orgOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 day ago

      Ear drums are better than microphones

      What do you mean about this part? A quality microphone is basically the same thing, although the impedance matching is achieved different ways.

      • thebudman420@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        1 day ago

        At least i want to believe ear drums being flesh vibrate differently than non organic materials, cells squeeze and contract. The shape of the ear drum is different and the electric signal in the human body is different than electronic devices. It’s just a tiny tiny amount in a human. higher voltages like outside the body change and shape the sound a bit or cause distortions of certain wavelengths of the sound. Just my general idea. I had an ex girlfriend who had a wind up shortwave radio and if using it wound up instead of plugged in to AC or battery she could hold a signal on to a weak station. And no matter the power of the other stations there was less static and distortions on easy to get broadcast or hard to get broadcast. This was just a pocket radio. The flow of electricity is different between those method ac vs dc. Was the kind that winded down as you use it. Power is more stable during wind up or something. I could be a little bit wrong on the radio part because i would have to have my ex girlfriend show me again and no way am i going to go talk to her after over 15 years.

  • Mk23simp@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    19
    ·
    2 days ago

    You know what would reduce mistakes and speed up orders? Replacing the god-awful audio equipment that every drive thru seems to use. It wouldn’t cost much to install good audio equipment and it would quickly pay for itself in time savings since people could hear each other more clearly.

    • PixelAlchemist@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      2 days ago

      Can’t find a source for this but I remember reading that the audio is intentionally bad because it subconsciously makes people more inclined/pressured to purchasing add-ons or upsells.

  • relativestranger@feddit.nl
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    8
    ·
    2 days ago

    it’s not ‘ai’, it’s just a poorly trained voice recognition system that’s trying to decipher any random person’s voice. voice rec has a difficult-enough time when trained on a single person in a professional setting (lawyer, doctor, etc)–which is work we used to do here. it’s going to absolutely fail in a ‘drive thru’ environment.

    • hedgehog@ttrpg.network
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      3
      ·
      2 days ago

      it’s not ‘ai’, it’s just a poorly trained voice recognition system that’s trying to decipher any random person’s voice.

      I’m baffled that you can say “It’s not ‘AI,’ it’s a machine learning powered speech to text system” with a straight face.

      Even if we were to agree that ML-powered speech to text isn’t AI (and I don’t agree to that premise, for the record), there’s still the matter of processing the transcription to transform it into something that can be understood by the point of sale system - aka natural language processing. And while that NLP could be implemented without use of an LLM, given LLM’s current level of hype and the ease with which they can be shoved into any given product, I wouldn’t bet on Taco Bell execs approving such an approach, much less asking for it.

      • Nalivai@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        edit-2
        8 hours ago

        And none of that is AI, if we use the term in a way that’s useful and stop speaking in salesspeak. Machine learning algorythms, LLMs, all of that isn’t AI in any meaningful sense of the word. It’s all semantics of course, but the more sam altmans of the world are trying to blurry the line between intelligence and an algorythm that can identify a picture of hotdog, the more we kinda need to be stickers for the proper terminology. It was kinda cute at the beginning of this crazy cycle, but now when megacorpos are demanding all your data and putting their half-baked chatbots into everything, it’s not cute anymore.

        • hedgehog@ttrpg.network
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 hours ago

          Please, enlighten me - how do you propose we use the term “AI” in a way that’s more useful than a definition that includes machine learning, large language models, and computer vision?

          I doubt I’ll agree with your definition, but I’m curious to see how you would exclude machine learning, computer vision, LLMs, etc., from your definition. My assumption is that your definition is going to be either a derivative of “AI is anything computers can’t do yet” or based on pop culture / sci fi, but maybe you’ll surprise me.

          To be clear, I’m a software engineer; I’m not speaking in sales speak. I’ve derived my understanding of the term from a combination of its historical context and how it’s used in both professional and academic contexts, not from marketing propaganda or from sci fi and pop culture. I’m certainly aware of the hype machine that’s ongoing, but there are also tons of fascinating advancements happening on a regular basis, and the term “AI” is at minimum a useful term to refer to technologies that leverage similar techniques.

    • JohnEdwa@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      3
      ·
      edit-2
      2 days ago

      “It’s not AI, it’s just <multiple things that all fall under the category of Artificial Intelligence>”.

      AI is a huge field of computer science. It’s not the one tiny narrow definition of artificial general intelligence like HAL 9000 or Skynet or Detroit Become Human.

      • lemming741@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 days ago

        It’s not AI unless it’s running on a cluster of H200s. Anything else is just sparkling text prediction.