• Pratai@piefed.ca
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    1
    ·
    8 hours ago

    Is unlimited tokens a big deal? I don’t really get what this means…

    • explodicle@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      9
      ·
      7 hours ago

      Yeah it means he’ll rack up a really high bill immediately on something stupid, and the board will pull the plug.

    • Jeffool @lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      7 hours ago

      Basically he’s saying they get a blank check for AI tools.

      My understanding is this: Tokens in AI wording are essentially measurements of computational time and power. You subscribe to ChatGPT for $X and you get #Y tokens. Each prompt costs a number of tokens depending on how long it takes and how much computational power it takes. The newer and more impressive models that use newer hardware (potentially more power) and expect better results also cost more tokens.

      Basically rent a basic sedan for travel for $50 a day or a new sports car that goes faster and burns more gas and looks cooler at $500 a day. Maybe a pickup with practical hauling space for $300 a day.

      That’s what people are paying for when they subscribe to ChatGPT or Anthropic. That’s how those companies make money, especially at scale for large companies.

        • historicaldocuments@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          5 hours ago

          Someone with no understanding of what quality software looks like who also doesn’t have to deal with the consequences of every Cisco switch and router on the planet either being old and unsupported, or new and absolutely full of security holes.