• 0 Posts
  • 12 Comments
Joined 2 years ago
cake
Cake day: July 4th, 2023

help-circle
  • Humans are “trained” with maybe ten thousand “tokens” per day

    Uhhh… you may wanna rerun those numbers.

    It’s waaaaaaaay more than that lol.

    and take only a couple dozen watts for even the most complex thinking

    Mate’s literally got smoke coming out if his ears lol.

    A single Wh is 860 calories…

    I think you either have no idea wtf you are talking about, or your just made up a bunch of extremely wrong numbers to try and look smart.

    1. Humans will encounter hundreds of thousands of tokens per day, ramping up to millions in school.

    2. An human, by my estimate, has burned about 13,000 Wh by the time they reach adulthood. Maybe more depending in activity levels.

    3. While yes, an AI costs substantially more Wh, it also is done in weeks so it’s obviously going to be way less energy efficient due to the exponential laws of resistance. If we grew a functional human in like 2 months it’d prolly require way WAY more than 13,000 Wh during the process for similiar reasons.

    4. Once trained, a single model can be duplicated infinitely. So it’d be more fair to compare how much millions of people cost to raise, compared to a single model to be trained. Because once trained, you can now make millions of copies of it…

    5. Operating costs are continuing to go down and down and down. Diffusion based text generation just made another huge leap forward, reporting around a twenty times efficiency increase over traditional gpt style LLMs. Improvements like this are coming out every month.



  • Good, fire 2 devs out of 3.

    Companies that do this will fail.

    Successful companies respond to this by hiring more developers.

    Consider the taxi cab driver:

    With the invention if the automobile, cab drivers could do their job way faster and way cheaper.

    Did companies fire drivers in response? God no. They hired more

    Why?

    Because they became more affordable, less wealthy clients could now afford their services which means demand went way way up

    If you can do your work for half the cost, usually demand goes up by way more than x2 because as you go down in wealth levels of target demographics, your pool of clients exponentially grows

    If I go from “it costs me 100k to make you a website” to “it costs me 50k to make you a website” my pool of possible clients more than doubles

    Which means… you need to hire more devs asap to start matching this newfound level of demand

    If you fire devs when your demand is about to skyrocket, you fucked up bad lol




  • You skipped possibility 3, which is actively happening ing:

    Advancements in tech enable us to produce results at a much much cheaper cost

    Which us happening with diffusion style LLMs that simultaneously cost less to train, cost less to run, but also produce both faster abd better quality outputs.

    That’s a big part people forget about AI: it’s a feedback loop of improvement as soon as you can start using AI to develop AI

    And we are past that mark now, most developers have easy access to AI as a tool to improve their performance, and AI is made by… software developers

    So you get this loop where as we make better and better AIs, we get better and better at making AIs with the AIs…

    It’s incredibly likely the new diffusion AI systems were built with AI assisting in the process, enabling them to make a whole new tech innovation much faster and easier.

    We are now in the uptick of the singularity, and have been for about a year now.

    Same goes for hardware, it’s very likely now that mvidia has AI incorporating into their production process, using it for micro optimizations in its architectures and designs.

    And then those same optimized gpus turn around and get used to train and run even better AIs…

    In 5-10 years we will look back on 2024 as the start of a very wild ride.

    Remember we are just now in the “computers that take up entire warehouses” step of the tech.

    Remember that in the 80s, a “computer” cost a fortune, took tonnes of resources, multiple people to run it, took up an entire room, was slow as hell, and could only do basic stuff.

    But now 40 years later they fit in our pockets and are (non hyoerbole) billions of times faster.

    I think by 2035 we will be looking at AI as something mass produced for consumers to just go in their homes, you go to best buy and compare different AI boxes to pick which one you are gonna get for your home.

    We are still at the stage of people in the 80s looking at computers and pondering “why would someone even need to use this, why would someone put one in their house, let alone their pocket”




  • I am indeed getting more time off for PD

    We delivered on a project 2 weeks ahead of schedule so we were given raises, I got a promotion, and we were given 2 weeks to just do some chill PD at our own discretion as a reward. All paid on the clock.

    Some companies are indeed pretty cool about it.

    I was asked to give some demos and do some chats with folks to spread info on how we had such success, and they were pretty fond of my methodology.

    At its core delivering faster does translate to getting bigger bonuses and kickbacks at my company, so yeah there’s actual financial incentive for me to perform way better.

    You also are ignoring the stress thing. If I can work 3x better, I can also just deliver in almost the same time, but spend all that freed up time instead focusing on quality, polishing the product up, documentation, double checking my work, testing, etc.

    Instead of scraping past the deadline by the skin of our teeth, we hit the deadline with a week or 2 to spare and spent a buncha extra time going over everything with a fine tooth comb twice to make sure we didn’t miss anything.

    And instead of mad rushing 8 hours straight, it’s just generally more casual. I can take it slower and do the same work but just in a less stressed out way. So I’m literally just physically working less hard, I feel happier, and overall my mood is way better, and I have way more energy.


  • Meanwhile a huge chunk of the software industry is now heavily using this “dead end” technology 👀

    I work in a pretty massive tech company (think, the type that frequently acquires other smaller ones and absorbs them)

    Everyone I know here is using it. A lot.

    However my company also has tonnes of dedicated sessions and paid time to instruct it’s employees on how to use it well, and to get good value out of it, abd the pitfalls it can have

    So yeah turns out if you teach your employees how to use a tool, they start using it.

    I’d say LLMs have made me about 3x as efficient or so at my job.