• Elvith Ma'for@feddit.org
      link
      fedilink
      English
      arrow-up
      4
      ·
      9 hours ago

      Delays - if you use the internet and request an answer from an LLM, you won’t notice if it’s 300-500ms slower than usual. But if you deploy and run a software stack, a delay of 5ms betweenntze app and the database can make the difference between a usable application and an inperfomant one.