Onihikage

Unfortunately I can’t even test Llama 3.1 in Alpaca because it refuses to download, showing some error message with the important bits cut off.

That said, the Alpaca download interface seems much more robust, allowing me to select a model and then select any version of it for download, not just apparently picking whatever version it thinks I should use. That’s an improvement for sure. On GPT4All I basically have to download the model manually if I want one that’s not the default, and when I do that there’s a decent chance it doesn’t run on GPU.

However, GPT4All allows me to plainly see how I can edit the system prompt and many other parameters the model is run with, and even configure multiple sets of parameters for the same model. That allows me to effectively pre-configure a model in much more creative ways, such as programming it to be a specific character with a specific background and mindset. I can get the Mistral model from earlier to act like anything from a very curt and emotionally neutral virtual intelligence named Jarvis to a grumpy fantasy monster whose behavior is transcribed by a narrator. GPT4All can even present an API endpoint to localhost for other programs to use.

Alpaca seems to have some degree of model customization, but I can’t tell how well it compares, probably because I’m not familiar with using ollama and I don’t feel like tinkering with it since it doesn’t want to use my GPU. The one thing I can see that’s better in it is the use of multiple models at the same time; right now GPT4All will unload one model before it loads another.

I have a fairly substantial 16gb AMD GPU, and when I load in Llama 3.1 8B Instruct 128k (Q4_0), it gives me about 12 tokens per second. That’s reasonably fast enough for me, but only 50% faster than CPU (which I test by loading mlabonne’s abliterated Q4_K_M version, which runs on CPU in GPT4All, though I have no idea if that’s actually meant to be comparable in performance).

Then I load in Nous Hermes 2 Mistral 7B DPO (also Q4_0) and it blazes through at 50+ tokens per second. So I don’t really know what’s going on there. Seems like performance varies a lot from model to model, but I don’t know enough to speculate why. I can’t even try Gemma2 models, GPT4All just crashes with them. I should probably test Alpaca to see if these perform any different there…

I actually found GPT4ALL through looking into Kompute (Vulkan Compute), and it led me to question why anyone would bother with ROCm or OpenCL at all.

I mainly recommend Universal Blue distros to newbies, like Bazzite or Aurora. The immutable nature more or less means users don’t have to worry about performing maintenance of system apps like they might on some distros, mostly don’t have to worry about dependencies, and are less likely to irreversibly break the system themselves or in an update.

That said, these distros are Fedora-based, and I think that’s fine. No idea who out there is recommending Arch of all things.

He did at the beginning, but he helped them get what they wanted in the end, and I think that counts for something.

“We’re thankful that the Biden administration played the long game on sick days and stuck with us for months after Congress imposed our updated national agreement,” Russo said. “Without making a big show of it, Joe Biden and members of his administration in the Transportation and Labor departments have been working continuously to get guaranteed paid sick days for all railroad workers.

“We know that many of our members weren’t happy with our original agreement,” Russo said, “but through it all, we had faith that our friends in the White House and Congress would keep up the pressure on our railroad employers to get us the sick day benefits we deserve. Until we negotiated these new individual agreements with these carriers, an IBEW member who called out sick was not compensated.”

Counterpoint: Scumbag companies ninja-editing their timestamped warranty page such that the only way you know they edited it after you bought the product is because it was archived previously.

Archives are ideal for identifying sneaky behavior like that. You never know when an admin might have the ability to delete or edit something without anyone noticing.

Technically, any model trained on LAION-5B before December 2023 was trained on CSAM.

But yeah, I expect any porn model trained on a sufficient diversity of adult actors could be used to make convincing CP even without having it in the training data. AI image generation is basically the digital equivalent of a chainsaw - a tool for a particular messy job that can really hurt people if used incorrectly. You wouldn’t let a typical kid run around unattended with one, that’s for sure.

The ELI5 for Fedora’s atomic desktops is that if Windows had an Atomic Desktop version, Program Files and most of the Windows folder would be read only, and each program you installed yourself would go into its own folder in your user directory. That’s the basic idea. It’s harder to screw up an Atomic system as long as you stick to containerized app formats like flatpak/appimage whenever possible. It makes it easier for everyone to diagnose problems, and easier for users to roll back if an update has problems. Even if you were to install it right now, you could use one simple command to “roll back” to any image from the last three months.

The benefit of Bazzite is you have all of the above, plus a lot of gaming-related stuff preinstalled which, if you were to install them yourself in a normal Fedora environment, you’d likely have to spend a lot of time just learning how they’re supposed to be configured, how they interact, which versions have problems, and how to troubleshoot problems when an update to one app breaks a prerequisite for something else; eventually you end up in config hell instead of actually using your computer. With Bazzite, the image maintainers are the ones in config hell - they work out the kinks, app versioning, communicate with upstream to fix issues, all that, so your system should be in the most functional state that a Linux system can be, so you only have to think about using your apps.

tl;dr

• Atomic Desktops are more resilient to randomly breaking from updates or user error, and are easier to revert to a prior state if problems do arise
• Bazzite is a custom Atomic image with lots of gaming stuff preinstalled and preconfigured to work properly out of the box
• If you’re a gamer and wanting to try out Linux, Bazzite is going to be the least painful way to get your feet wet.
• Immutable distros are excellent for daily driving. I daily drive one myself!

MPV is a video player.

If “nearly every app” that people already use suddenly has a big warning on it, people will quickly decide the warnings are meaningless and start ignoring them, like Prop 65 warnings. Congratulations, we’ve moved the needle backwards.

You have to meet people where they’re at. I finally switched to Linux when MS introduced a feature I wanted no part in (Recall AI), but I would have given up within a day or two if the transition hadn’t been basically seamless. I was able to pick up right where I left off, using all the same apps I did on Windows except MusicBee RIP, but now I’m in a better position than before, on an open-source OS instead of closed-source. Now there’s a little less friction between me and better, freer software.

When I look at Firefox in Discover, it only shows the list of permissions the flatpak will be given out of the box, with no warning of it being “potentially unsafe.” This certainly does seem like the better way to handle it.

Also, the warning on the Flathub website is clickable - it expands into the full permissions list. Why it defaults to “no information except maybe dangerous” is beyond me.

I’d get premium if they weren’t so insistent on bundling in bullshit I don’t want or care about to justify the high price. I put up with enough of that from cable TV. I’ll pay when there’s an ad-free tier that doesn’t do anything else and is a reasonable price for “the service that’s free with ads, but without ads”. If there was a per-device premium tier that I could throw on my Roku, and all my family members could have premium when they stream from there, I’d pay for that. I’d pay for family tier if it didn’t have the dumb single-household rule which screws over truckers and those who travel for a living.

Google has options they could take to convince consumers to pay to not see ads, but there’s no creativity left there, no effort to court the market or adapt the service and prices to what potential customers need and are willing to pay. And it’s because they believe they are the market, and want to keep it that way.

It’s not gone, they didn’t even take down all of the Nintendo games, they took down specific games (reddit link), albeit a lot of them, but there’s still lots of stuff left.

Atomic means the core OS packages are in an immutable container such that none of its individual components can be updated separately; instead the entire container is replaced with a newer version when the system is updated. This makes it much less likely for something to break during normal use, and easier to rollback updates if something does happen to break. The ideal use case is a containerized environment where each app you use is installed in its own container, like Docker, or is otherwise self-contained such as flatpak installers, and doesn’t rely on any of the system’s packages.

his “solution” is some kind it proprietary video player that just plays Youtube videos.

It’s not proprietary, it’s source-available, and it plays a lot more than YouTube videos - in addition to YT, I use it to watch Nebula, Twitch, Odysee, and even Peertube on rare occasions. There are other plugins (that I don’t use) for BiliBili, Rumble, Patreon, Kick, and Soundcloud, and the way its plugin system works, there’s potential for many other paid subscription-based streaming services to be viewable through Grayjay. That is its real strength. If a creator uploads to a bunch of platforms, users can follow them on the platform they prefer, and get all their updates from one feed in one app, with added functionality that the official apps or sites simply might not have.

This is FUTO’s way of trying to make web video platforms more competitive, by creating an app that can interface with content from all of them and has all the popular features even if the sites themselves don’t. Grayjay has playlists, likes, dislikes, background playback, picture-in-picture, local history, the ability to block certain creators from the home feed, and the ability to hide individual videos from your feed. Furthermore, creators get a lot of ways they can monetize their content in Grayjay, like putting their merch store under the description of their videos, donation buttons, links to their Patreon or other subscription services, or general promotions, that would appear under all of their videos. Like… there are a lot of features here that really improve the experience with otherwise lackluster competitors. This tilts the market a tiny bit away from the established dominant players, and every new Grayjay user tilts it a little bit more.

Finally, it’s worth emphasizing that this is not Louis Rossmann’s personal pet project. His promotion of Grayjay, while it does align with his personal values, is paid work for a literal tech billionaire, Eron Wolf, who created and runs the FUTO organization. Neither of them need you to “take Louis Rossmann seriously.” They only want you to consider if the apps the company makes suit your needs and values.

I was in your shoes for ages, but HeliBoard has predictions and other languages out of the box. Voice transcription works if you have FUTO Voice Input. Gesture typing uses a swypelibs binary extracted from Gapps; you just have to download it manually since the app never requests network access (instructions are on the Github page). I started using it today and some of its features actually seem to work better for me than Gboard, like the swipe gestures on delete or space, and it has at least a few more features I’m pretty sure Gboard doesn’t. Give it a look at least.

Net Neutrality is about not policing content online. That’s kind of its whole thing:

These net neutrality policies ensured you can go where you want and do what you want online without your broadband provider making choices for you. They made clear your broadband provider should not have the right to block websites, slow services, or censor online content. These policies were court tested and approved. They were wildly popular. In fact, studies show that 80 percent of the public support the FCC’s net neutrality policies and opposed their repeal.

The closest we get to online censorship is obscenity laws, which one might think applies to porn, but obscenity is actually defined much more narrowly than just “content designed to arouse”. Obscenity is basically stuff that even Hugh Hefner would find offensive, stuff the average adult would find deeply repulsive and abhorrent (not just a little bit, the exact language is “patently offensive”). Adult content in general (obscenity & indecency) is banned from broadcast media during daytime hours to keep kids from seeing it; subscription-based services are exempt from such rules, which presumably means that the adults who pay for the subscription are supposed to be the ones preventing kids from using it to view adult material, if such is possible. I expect this is why anything which does manage to qualify as obscene is typically very hard to get to unless you really want to see it, so nobody who might report it ever actually finds it.

It’s worth mentioning that obscenity laws apply whether Net Neutrality is a thing or not, so having it will be a net reduction in the avenues through which content may be censored or policed. Now if only they’d ban ISPs from selling your data to brokers…

VPN subscriptions about to explode.

Naturally, they’ll try to ban VPNs next.

Grayjay still works? YT-DLP still works? I sleep.

It can, there’s an Open Subtitles plugin that can automatically download subtitles in specified languages that match (or don’t) the file hashes of your media. Being an open database of subtitles, though, YMMV. You configure it on a per-library basis.