Super awesome! I was looking at this, but don’t want a new phone right now
- 1 Post
- 4 Comments
beastlykings@sh.itjust.worksto
LocalLLaMA@sh.itjust.works•Jan: Open source ChatGPT-alternative that runs 100% offline - JanEnglish
1·1 year agoThanks for the write-up! Specifically I’m running a framework 13 7840U, so it’s ddr5, and that iGPU has no dedicated vram, it shares the main system ram.
I’m not looking for ridiculous performance, right now for small models I’m seeing probably 3 ish words per second. But when I put bigger models in, it starts to get ridiculously slow. I’m fine waiting around, really I’m just playing with it because I can. But that’s entering no fun territory haha
beastlykings@sh.itjust.worksto
LocalLLaMA@sh.itjust.works•Jan: Open source ChatGPT-alternative that runs 100% offline - JanEnglish
2·1 year agoIs this why I can’t get llama GPU acceleration on my 7840u with integrated 780m?
I’ve got 96gb of ram, I can share half of that as vram. I know the performance won’t be amazing, but it’s gotta be better than CPU only.
I looked into it once and saw a bunch of people complaining about lack of support, saying it’s an easy fix but had to happen upstream somewhere. I can’t remember what it was, just that I was annoyed 🤷♂️
Edit: accidentally a word

I think high end smasnugs do that. But yeah same, I have a Chromecast and I just sling stuff to the TV. Its tuner hasn’t been used in a decade.
Speaking of decade… I should probably upgrade that thing. But it’s big enough, dark enough (LDC, but at least not a crappy LCD), and high enough resolution for it’s size and distance from my couch (1080, 50 inches, 10 or 15 feet) that I just can’t justify replacing it. I wish it would die already lol.
Maybe if I move and get a big enough bedroom, I’ll put it in there, and upgrade to something with HDR. I really wanna get in on some good HDR. Seems like it’s getting really good and really affordable if you buy the right thing.