Lol what? I just checked, on eBay I can find a lot of offers between 800 Euros and 1300 Euros for a used RTX 3090.
4-5k would get you a brand new RTX 5090.
Okay, not as bad as I thought, there’s a guy selling a 4090 for “only” 2k. There’s nobody selling a 3090 in the local hardware forum. I’m not going to buy off ebay because if someone on ebay sells a dud, I can’t go back to punch him in the face.
5090s start at about 5200, that’s true. To be fair, the “4-5k” for a used 3090 was a bit hyperbolic, I’m just mad that they’re so expensive that my last 2 cars cost less than a USED 4090.
Nah, 0731 weights were released. I’m running it locally right this second.
I don’t know about Deepseek API specifically, but there are tons of places to get it.
You are Mr. moneybags or you’re running 2 or 4bit quantized.
I have a 3090, 7800, and 128GB ram from pre-rampocalypse. It’s not nothing, but there are definitely crazier home labs.
Deepseek V4 is native 4 bit.
I am running this quant, but the quantization loss is measurably low: https://huggingface.co/Downtown-Case/DeepSeek-V4-Flash-0731-128GB-RAM-IK-GGUF
The native MXFP4 is only a bit bigger.
A used 3090 alone is like what, 4-5k now?
Your setup isn’t really achievable for most now.
The 3090 is from 2020. It’s under $1300 based on eBay prices I’m seeing (which is around what it launched at).
Crazy expensive, but not $5K.
The 128GB RAM is madly expensive now, though.
Lol what? I just checked, on eBay I can find a lot of offers between 800 Euros and 1300 Euros for a used RTX 3090. 4-5k would get you a brand new RTX 5090.
Okay, not as bad as I thought, there’s a guy selling a 4090 for “only” 2k. There’s nobody selling a 3090 in the local hardware forum. I’m not going to buy off ebay because if someone on ebay sells a dud, I can’t go back to punch him in the face.
5090s start at about 5200, that’s true. To be fair, the “4-5k” for a used 3090 was a bit hyperbolic, I’m just mad that they’re so expensive that my last 2 cars cost less than a USED 4090.