Damn, I hope this is not goodbye to uncensored models 😢

  • melfie@lemmy.zip
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    11 hours ago

    Agreed, I was referring more to future updates. Obviously we’re good with what is available now.

    I can’t speak to pricing and availability outside the U.S., but it looks like the one I got went up $100:

    https://www.newegg.com/asrock-radeon-rx7900xtx-24g-radeon-rx-7900-xtx-24gb-graphics-card-triple-fans/p/N82E16814930084.

    I traded in my 3070 and my final price was in the 700s. Last I looked, used ones were going for $800 on eBay vs. $1200 for a used 3090.

    I run 3.8 27B at q4 with q4 context up to 200k. Decode is generally in the 30s and pp starts in the 700s and drops to the 400s as context approaches 200k. I use mostly Sonnet 5 at work and I would rate this setup with the OpenCode desktop app as pretty comparable overall for coding at least. Let’s just say I have no reason to use any cloud models, not that I would do that voluntarily outside of being compelled to at work.