• 11 Posts
  • 1.26K Comments
Joined 2 years ago
cake
Cake day: March 22nd, 2024

help-circle

  • Hear me out.

    This could actually be cool:

    • If I could, say, mash in “get rid of the junk in this page” or “turn the page this color” or “navigate this form for me”

    • If it could block SEO and AI slop from search/pages, including images.

    • If I can pick my own API (including local) and sampling parameters

    • If it doesn’t preload any model in RAM.

    …That’d be neat.

    What I don’t want is a chatbot or summarizer or deep researcher because there are 7000 bajillion of those, and there is literally no advantage to FF baking it in like every other service on the planet.


    And… Honestly, PCs are not ready for local LLMs. Not even the most exotic experimental quantization of Qwen3 30B is ‘good enough’ to be reliable for the average person, and it still takes too much CPU/RAM. And whatever Mozilla ships would be way worse.

    That could change with a good bitnet model, but no one with money has pursued it yet.





  • Fedora

    GTX 1660 Super

    freezing

    Almost certainly a Nvidia issue, and that’s such a deep rabbit hole, I don’t even know where to start.

    …It’s not a fun troubleshooting/learning process.

    The most expedient thing would be to try Bazzite or Nobara for a while. Both are Fedora based distros (so they’re familiar), but they have better support for older Nvidia cards out of the box.

    This would be a better long term solution anyway, as whatever’s going wrong, you wont have to maintain it yourself through updates.


  • I think it’s highly contextual.

    • Like, let’s take Lemmy posts. LLMs are useless because the whole point is to affect the people you chat with, right? LLMs have no memory. So there is a philosophical difference even if comments/posts are identical.

    • …Now let’s take game dev. I think if a system generates the creator’s intent… does it matter what the system is. Isn’t it better if the system is more frugal, so they can use precious resources for other components and not go in debt?

    • TV? Could inevitably lead to horrendous corporate slop, a “race to the bottom.” OR it could be a killer production tool for indie makers to break the shackles of their corporate master. Realistically, the former is more likely at the moment.

    • News? I mean… Accurate journalism needs a lot of human connection/trust, and LLM news is just asking to be abused. I think it’s academically interesting, but utterly catastrophic in the real world we live in, kinda like cryptocurrency.

    One can wobble about all sorts of content. Novels, fan fiction, help videos, school material, counseling, information reference, research, and advertising, the big one.

    …But I think it’s really hard to generalize.

    ‘AI’ has to be looked at a la carte, and engineered for very specific applications. Sometimes it is indistinguishable, or mind as well be. But trying to generalize it as a “magic lamp” like tech bros, or the bane of existence like their polar opposites, is what’s making it so gross and toxic now.


    And I am drawing a hard distinction with actual artificial intelligence. As a tinkerer who has done some work in the space too… Franky, current AI architectures have precisely nothing to do with AGI. Training transformers models with glorified linear regression is just not the path; Sam Altman is full of shit, and the whole research space knows it.




  • Devils advocate:

    …It’s kinda strategic for Apple to “stay.”

    Let’s say they say no, and get kicked out of China. You think the Chinese tech giants are going to put up a fight about dating apps?

    Seems better to Apple to keep a finger in the pie and do what they can get away with, if only for the LGBTQ folks.


    Another example I used to point to is Steam which got away with sneaking a lot of culture into China under the government’s nose. And it’s cause they didn’t make loud trouble.








  • I mean, we already have Gaming PC OEMs and mini PCs. It’d be awesome if they start shipping SteamOS, but they can’t sell hardware at a near loss + make up for it with Steam sales + guarantee hardware support in software like Valve can.

    And most don’t have the volume for “semi custom” AMD SKUs.


    EDIT: The only entity I could see doing this is Intel, selling an Arc Steam Machine. That would be awesome, actually.