I'd really like to be a drop in that bucket, but as an nvidia owner it's rough. You take a sizable performance hit and general stability is awful. In Linux I can't turn off my monitor on nvidia, or there's a ~80% chance I'll never get it to come back on. If it does, I don't have sound 100% of the time. It's ridiculous.

My next GPU will be a Radeon, but they don't have anything to offer that can beat my 4080 from 2022...

I don't know if it's me, but right now nvidia on Linux is the least stable it's ever been. I have two desktops, one dedicated Linux box and one I dual boot. On the Linux only one I bought a dirt cheap ($30) Radeon Pro WX 3200 so my system won't crash constantly. I still have the nvidia card for CUDA stuff. It's working great for what I do.

I have a second used Radeon on the way for the other system. It's insane, but this is the only solution. If my monitor turns off or I switch inputs, I can't get it back when connected to the nvidia cards. I've done every troubleshooting step I can find, it's just a broken ecosystem.

I use a 1050Ti (needs the closed source driver) with a Debian 13. Rock solid and the older titles I play even run smooth in 1440p. Not a single crash -- just have to wait if a new kernel arrives and avoid backpirted kernels. shrug

My Moto Edge 2024 has "Ready For" which is basically this still today. I plug in the USB-C cable normally connected to my work MacBook and I instantly get a full desktop experience; mouse, keyboard and sound included.

It's how I play Minecraft with my kids when they get the itch. Sometimes if I know I'm only gonna be zoning out on Youtube at night I'll use to to save a few watts too.

It can do 1440p at 120hz, all on a really affordable phone. It's nice.

I would also love to hear any success stories here. I converted my wife's Macbook over to Linux Mint somewhat recently and the best I could do was setup a shortcut to the Web version of her iCloud.

Google Drive also does not have a Linux client, which is a little surprising. It looks like maybe Box.com supports WebDAV and Dropbox has a first-party Linux client. I haven't tried either and I haven't found anything else yet.

Thank you for your service. :D Windows 2000 will always be my favorite version. I got a free copy as a university student and it was just awesome. XP was the era where things changed for the sake of change. In Windows 2000 you could learn where absolutely everything was and it was always there for you.

I still have my install CD, though it has suffered from bit-rot and can't be read properly. :(

Ha! You're very welcome! Ah the good ol' days of CD install media, CD Keys and install times that took hours!

RIP to your install CD!

Nothing. This summer I set up a dual 16GB GPU / 64GB RAM system and nothing I could run was even remotely close. Big models that didn't fit on 32gb VRAM had marginally better results but were at least of magnitude slower than what you'd pay for and still much worse in quality.

I gave one of the GPUs to my kid to play games on.

Yup, even with 2x 24gb GPUs, it's impossible to get anywhere close to the big models in terms of quality and speed, for a fraction of the cost.

I'm running unsloth/GLM-4.7-Flash-GGUF:UD-Q8_K_XL via llama.cpp on 2x 24G 4090s which fits perfectly with 198k context at 120 tokens/s – the model itself is really good.

I can confirm, running glm-4.7-flash-7e-qx54g-hi-mlx here, a 22gb model @q5 on m4 max pro and 59 tokens/s.

I have 64gb in my linux machine and have managed to hardlock it a bunch of times exhausting the ram. Couldn't even REISUB a couple of times. The OOM killer stuff in Linux just doesn't work anymore by what I can gather.

Buying more ram is no longer an option, so I added a 128gb swap partition on nvme. I incorrectly assumed with 64gb I didn't even need swap. No crashes since.

If you don't want to move partitions around, you can add a swap file. ChatGPT or whatever can give instructions.

You're almost certainly on to something and I'll be doing something similar. That must be the crux. Thank you!

You should consider some sort of swap on ram like zswap rather than thrashing your nvme.

Thanks, yep I do have zram installed, but I'm working with mostly incompressible AI models so it really didn't help. I set it to cap at 8GB so random stuff can take advantage and I guess it helps a tiny bit, but not much.

I have a free m.2 slot and may get a cheap optane drive and use that as SWAP. I've read they're not as fast as marketed for this, but at least I wouldn't have to worry about about wearing out my SSD.

Not parent, but noted. Thanks!

:)

Absolutely.

I've declined the refresh I've overdue for. My 2021 model MBP has 32gb and a 1TB SSD. They're currently giving out the base model Air: 16gb and 256gb. No thanks.

We used to get whatever was most appropriate for our role, now we get whatever is cheapest.

I browsed thru my comment history to make sure I wasn't hallucinating. Just over a year ago I had priced out a used Xeon and 256GB kit on eBay for my old X99 board (DDR4) for under $300.

I did not pull the trigger. I did thankfully get it up to 64gb for ~ $50.

https://news.ycombinator.com/item?id=41100502

I double checked my RAM purchase from early September. $450 for 128GB of DDR5. That same RAM is now $1400.

I know it’s a bit naive to extrapolate from that, but something doesn’t smell right, the PC hardware market is clearly going through something, probably caused by the AI boom. I wonder what else is shifting that isn’t so apparent.

Everybody says this is because OpenAI bought up 40% of the world's supply of DRAM. Certainly that has hugely tilted the supply and demand teeter-totter, but to me this just feels like another "because we can" by the market.

When beef is expensive, you buy chicken. There's no alternative to RAM. If you need it, you've gotta pony up.

I threw together a utility for this with just the half character in 2018, I don't even remember why.

https://rubygems.org/gems/barf

The name does imply the image quality, fyi.

My solution is also multithreaded, in Ruby. :D