I mean, you can run small models on mobile now, but they’re mostly good as a cog in an automation pipeline, not at (say) interpreting english instructions on how to alter a webpage.
…Honestly, open weight model APIs for single-off calls like this are not a bad stopgap. It costs basically nothing, you can use any provider you want, its power efficient, and if you’re on the web, you have internet.
That’s what I was thinking of, thanks.
I thought there was a cutoff for pascal cards too?
Hear me out.
This could actually be cool:
If I could, say, mash in “get rid of the junk in this page” or “turn the page this color” or “navigate this form for me”
If it could block SEO and AI slop from search/pages, including images.
If I can pick my own API (including local) and sampling parameters
If it doesn’t preload any model in RAM.
…That’d be neat.
What I don’t want is a chatbot or summarizer or deep researcher because there are 7000 bajillion of those, and there is literally no advantage to FF baking it in like every other service on the planet.
And… Honestly, PCs are not ready for local LLMs. Not even the most exotic experimental quantization of Qwen3 30B is ‘good enough’ to be reliable for the average person, and it still takes too much CPU/RAM. And whatever Mozilla ships would be way worse.
That could change with a good bitnet model, but no one with money has pursued it yet.
I mean, there aren’t a lot of Java games, and C# (especially with newer runtimes) isn’t that bad if that’s what you’re referencing.
The old Civ games were a lot of Python, which is perhaps the most atrocious of all, performance wise. But they worked okay.
Also, random thing, but I did not get a notification for your reply.
I don’t think that’s a piefed thing, as it happens a lot to me, even with other .world users.
Nuke everything and start over? I guess you could keep the home directoy, but TBH I’d back it up and nuke it too, just in case.
Or, as a shorter term solution, run it off a USB drive.
Fedora
GTX 1660 Super
freezing
Almost certainly a Nvidia issue, and that’s such a deep rabbit hole, I don’t even know where to start.
…It’s not a fun troubleshooting/learning process.
The most expedient thing would be to try Bazzite or Nobara for a while. Both are Fedora based distros (so they’re familiar), but they have better support for older Nvidia cards out of the box.
This would be a better long term solution anyway, as whatever’s going wrong, you wont have to maintain it yourself through updates.
I think it’s highly contextual.
Like, let’s take Lemmy posts. LLMs are useless because the whole point is to affect the people you chat with, right? LLMs have no memory. So there is a philosophical difference even if comments/posts are identical.
…Now let’s take game dev. I think if a system generates the creator’s intent… does it matter what the system is. Isn’t it better if the system is more frugal, so they can use precious resources for other components and not go in debt?
TV? Could inevitably lead to horrendous corporate slop, a “race to the bottom.” OR it could be a killer production tool for indie makers to break the shackles of their corporate master. Realistically, the former is more likely at the moment.
News? I mean… Accurate journalism needs a lot of human connection/trust, and LLM news is just asking to be abused. I think it’s academically interesting, but utterly catastrophic in the real world we live in, kinda like cryptocurrency.
One can wobble about all sorts of content. Novels, fan fiction, help videos, school material, counseling, information reference, research, and advertising, the big one.
…But I think it’s really hard to generalize.
‘AI’ has to be looked at a la carte, and engineered for very specific applications. Sometimes it is indistinguishable, or mind as well be. But trying to generalize it as a “magic lamp” like tech bros, or the bane of existence like their polar opposites, is what’s making it so gross and toxic now.
And I am drawing a hard distinction with actual artificial intelligence. As a tinkerer who has done some work in the space too… Franky, current AI architectures have precisely nothing to do with AGI. Training transformers models with glorified linear regression is just not the path; Sam Altman is full of shit, and the whole research space knows it.
What’s the content?
Like, TV?
News?
Math problems? Lemmy posts?
Elon is more aligned with Turkey’s politics though, right?
Tim Cook is gay. I don’t think there’s much pretense of him liking this one bit.
Devils advocate:
…It’s kinda strategic for Apple to “stay.”
Let’s say they say no, and get kicked out of China. You think the Chinese tech giants are going to put up a fight about dating apps?
Seems better to Apple to keep a finger in the pie and do what they can get away with, if only for the LGBTQ folks.
Another example I used to point to is Steam which got away with sneaking a lot of culture into China under the government’s nose. And it’s cause they didn’t make loud trouble.
…Okay.
Then why are these apps being removed?
To be fair, they are too big.
They just have too many employees and costs. The way they’re organized, they’re stuck with gigantic budget, milquetoast, broad appeal games just to attempt sales they need to break even, with all the inefficiency that comes at that team size… unless they fire a ton of people and split up the rest.
My observation over the past decade is that “medium size” is the game dev sweet spot. Think Coffee Stain, Obsidian, and so on.
I hate to break it to you, but people on Lemmy call for the death of politicians and their families all the tame.
It’s… icky.
It’s made me really close to leaving the whole platform, and the .world admin’s sentiment against it is about the only thing that stopped me (even if they don’t enforce it very strictly).
Playing devil’s advocate, I can kind of see the theory.
People will happily get slow boiled, like a lobster in a pot.
But if an explosion happens right in front of their face, it gets them to pay attention (and maybe react before they’re fully boiled).
It’s just the culture.
All my older relatives, all highly educated and secular/scientific, got like this watching Fox News. Any mention of climate change in a documentary or something triggers some really crude, dismissive joke because that’s the pattern.
The key being FSR 3.
If it was FSR 4, that’d much better looking at high res.
I mean, we already have Gaming PC OEMs and mini PCs. It’d be awesome if they start shipping SteamOS, but they can’t sell hardware at a near loss + make up for it with Steam sales + guarantee hardware support in software like Valve can.
And most don’t have the volume for “semi custom” AMD SKUs.
EDIT: The only entity I could see doing this is Intel, selling an Arc Steam Machine. That would be awesome, actually.
I mean, there are literally hundreds of API providers. I’d probably pick Cerebras, but you can take your pick from any jurisdiction and any privacy policy.
I guess you could rent an on-demand cloud instance yourself too, that spins down when you aren’t using it.