• 0 Posts
  • 12 Comments
Joined 1 year ago
cake
Cake day: June 5th, 2025

help-circle

  • I tried using LocalAI to get some kind of agent not being used to entrench fascism and destroy the environment and consume irreplaceable clean water and haven’t had much luck. Even on a beefy machine with a chonky graphics card, it’s slow. That was after trying it on my laptop and damn near burning my legs off with the graphics card going nuts and the fans spinning up like jet turbines.

    I did an experiment where I tried to get it to write some code that I had already written myself, just as a test case. Even when I found a model that worked more quickly, the code it produced didn’t do the thing I had told it to do. I had to tell the LLM that, contrary to its “thinking,” inline HTML does, in fact, make for valid Markdown, and that it could actually do the thing I had already explicitly told it to do.

    The second iteration worked, but the code was far from ideal. If I had been in a professional situation where i would have been putting that up for review, it would have taken me even longer to make the code presentable and up to my standard. In the end, the code I wrote was better by a mile and I wrote it maybe twice as fast as the LLM.

    I’m sure this is faster if I use Claude or something and engage the Torment Nexus, but that’s kind of my point. It takes so much juice to make these things viable, and the hardware you need at home to replicate that usefulness is expensive and becoming less available. And removing the energy cost from the user’s machine (where you can literally hear and feel the energy consumption) to some bank of servers you’ll never see in person does a lot to distance a user from the effects of their usage of the tool. Running a local agent only made my view on AI lower than it already was.

    I did not try the Qwen model, though I suppose I ought to since I’ve now seen you claim success with it a few times on here. Will I finally be impressed? Man, I doubt it, but I’ll give it a go.







  • I love the way the long, ultra-wide shots of empty landscape give you the sense of isolation, the notion that if that guy looking for that lost gold feels like he needs to shoot you dead in your own home, he probably can get away with it. Who’s coming to save you or seek your justice? There’s no one around for miles. There’s a mule outside grinding flour you could beckon, maybe.


  • These are all valid reasons. I’ll also add that I personally desire manual control over my computing experience. A huge part of the reason I run Linux is that it does exactly what I tell it to and nothing more. When you start introducing other agents to my user agent, it ceases to be a user agent. Something else is arranging my tabs. Something is popping info up into in my face that I didn’t ask to see (and which might be incorrect). I just want these things to go away so my browser can be my browser again and not be under the control of a random word guesser.

    Yes, I have turned these features off, but I don’t even want them installed. They’ve been force-installed onto my system through software that didn’t used to do that. If I lose my config, I have to go turn it all back off again. I’d rather just not have the feature anywhere in the software. I’d rather Firefox just not smuggle AI features onto my PC at all.




  • As it seems to be the case in all of these situations, AI fails hard at tasks when compared to tools specifically designed for that task. I use Ruff in all my Python projects because it formats my code and finds (and often fixes) the kind of low complexity/high probability problems that are likely to pop up as a result of human imperfection. It does it with great accuracy, incredible speed, using very little computing resources, and provides levels of safety in automating fixes. I can run it as an automation step when someone proposes code changes, adding all of 3 or 4 seconds to the runtime. I can run it on my local machine to instantly resolve my ID10T errors. If AI can’t solve these problems as quickly, and if it can’t solve anything more complicated reliably, I don’t understand why it would be a tool I would use.