Its not an LLM as far as I can tell, just a standard machine learning model. They are using “AI” and “ChatGPT” as a marketing gimmick.

At the cost of a little disk space, you can install KDE,gnome,i3,etc, and they can try each.

Is this user far away, and will they need support?

Chill out. They’ve release debs and rpms for years as well, is that EEE?

I’ll have another go, but the install instructions didn’t work well on 2204.

The apt method doesnt work, they don’t seem to have a 2204 repo, and the snap method started to download gnome…

Is it gui only? I dont have a gui on this VM, and not much space for it either. I’ll give it a go when i get a dedicated box. Does seem to be a wrapper around llama.cpp, vLLM and others though.

llama.CPP version:

Lastest git, as of 24hrs ago

I did find that limiting context to 32k fixes it, 64k or larger doesnt work. But I’m also sure that it did work at 64k before it broke.

Current suspicion is that because I’m both passing through and using thunderbolt, the GPU isnt getting properly reset at reboot, and is getting to a broken state.

I’m gonna try removing the VM portion of the chain when I get a spare PC. And maybe if that doesnt work I’ll try drop the thunderbolt part as well, but that is a little harder to deal with.

Some GPU gore in the image:

Don’t clouds mostly just rely on replication across zones though?

I would have thought tapes were just too slow to be useful in that environment.

I’ll read up on the IBM deep archive.

Does make you wonder who does use tape? Id assume big businesses just use cloud, so who is left that uses tape?

I didn’t look tbh, I just assumed it would be 1-2k. 8-10 is crazy.

Does kinda backup my point though :/

https://www.unitex.co.jp/en/products/hardware/lto/lto-tapedrive/

Found from a google, no experience with it.

Tape is not a nice medium for the self-hoster, the drives are expensive, the tapes need to be carefully stored securely (temperature and humidity controled). Its a lot of hassle. That said, if you find something good, I’m interested as well, so report back.

Weird. I’m sure i have seen a popup saying “shutdown was inhibited” that let me force it. I’ll have a try later today

Edit: gnome gave me the prompt, and then silently failed to shutdown. So yeah, perfect for OP.

systemd-inhibit seems like the right place to look, but I have a vague feeling that gnome can override it.

https://www.freedesktop.org/software/systemd/man/latest/systemd-inhibit.html

Maybe with some tweaking itll be unoveridable except for root?

Oom killer is in the kernel, so that definitely would be exciting.

I believe, and I could be very wrong, that it kills the largest memory process. The problem is that it may not be the problematic process. You could have a well behaved DB that is using a stable 80%, and a runaway process that rapidly fills the remaining 20%, and OOM will kill the DB, and let the out of control process keep consuming memory until it becomes the largest. Then your DB is down and you don’t known why.

I like the idea of just killing processes at random though. Determinism is overrated.

Except that most likely, it kills something completely unrelated instead.

The casting in the ABC app was pretty broken for a while, but I believe they redid it a few years ago.

I’ve not experienced the stream ending, but there disconnect is definitely an issue. Might be app specific?

When I tested Chromecast with google TV (5 years ago to be fair, it might be fixed now), if I casted from my phone, I then had to use the remote to choose my Netflix account and choose the show again from scratch. So it was two steps on two devices, for no good reason. It also didn’t connect to WiFi properly and didnt have Ethernet, so that killed its functionality as well.

There were definitely some shitty Chromecast apps. ABC in Aus had a terrible one. There are also some pretty shitty TV apps as well :/

Ultra was good for connectivity, as it has an Ethernet port. Relying on wifi on a streaming stick behind a TV was tough. My TV behaves as a signal blocking wall, anything WiFi behind it is a dead zone.

I also haven’t tried the new Chromecast with google TV in a few years, but it was so terrible I returned it immediately and started scouring eBay for another Ultra. I am very sad Google killed the plain Chromecast line.

Chromecast doesnt use your phone for decoding. It just tells the stick to play the video, and it plays it directly. It shouldn’t drain your phone at all.

The remote is a personal preference, but I was happy for the phone to be the remote. Having a second remote didnt gain me anything.