• 5 Posts
  • 226 Comments
Joined 3 years ago
cake
Cake day: June 18th, 2023

help-circle





  • To be fair, I do think the average accepted stackoverflow answer displays far more competence than the average human.

    One of the few things I use LLM’s for is giving me overviews of best-practice in things I’m not familiar with (before reading the posts I find to get more in-depth understanding)



  • That isn’t what bothers me the most though. Earlier today I read a piece by a “tech journalist” in a paper I normally respect as doing proper work. The mentioned that one of the guys behind Claude says that Claude writes absolutely all their code now. They also said they did a test of one of the most recent models (released earlier this week), and that it wrote “A full Amazon-cloud based page that did various verification and authentication jobs, was about 67 000 lines of code, and was approved by the IT department in minutes in an afternoon”. The last part tells me they have no clue what they’re talking about. They just generated 67 000 lines of potential bugs that works, and which wasn’t reviewed by anyone competent. Nobody reviews 67 000 lines of code in a day, let alone minutes. Just the fact that they thought generating a shitload of boilerplate (most of the lines were likely that) impressive, says enough.

    It’s not your average Joe thinking this is cool that bothers me (it is cool). It’s when allegedly competent people start thinking the LLM actually has any idea what it’s doing.







  • I’m a researcher myself, so I feel like I can weigh in on the “reproducibility crisis”. There are several facets to it: One is of course money, but that’s not just related to corporately funded research. Good luck finding or building an independent lab capable of reproducing the results at CERN. It basically boils down to the fact that some (a lot of) research is insanely expensive to do. This primarily applies to experiments and to some degree to computationally expensive stuff.

    Another side is related to interest. Your average researcher is fired up by the thought of being the first person to discover and publish something no one has seen before. It’s just not as fun to reproduce something someone else has already done. Even if you do, you’re likely to try to improve on it somehow, which means the results may change without directly invalidating the old results. It can be hard work to write a good paper, so if you don’t feel your results are novel enough that they’re worth the effort (because they’re basically just equivalent to previously published values) you might not bother to put in the effort to publish them.

    Finally, even without direct reproduction of previously published results, science has a way asymptotically approaching some kind of truth. When I develop and publish something, I’m building on dozens of previously published works. If what they did was plain wrong, then my models would also be liable to fail. I’ve had cases where we’ve improved on previously published work, not because we tried to reproduce it, but because we tried to build on their results, and found out that their results didn’t make sense. That kind of thing is fairly common, but not reported as a “reproduction study”.

    There’s also review articles that, while they don’t do any reproduction themselves, collect and compare a bunch of comparable work. They usually have some conclusions regarding what results appear trustworthy, and what appear to be erroneous.


  • I think the point is that the military, I assume in most countries, can accept a completely different risk picture for soldiers that society at large can accept for civilians. Thus, the military can viably mandate a vaccine that causes severe side effects in e.g. 1/1000 cases, given that the alternative (a serious disease spreading in the ranks) is worse.

    Remember that by far most military casualties have historically been due to disease and other conditions not directly related to the enemies weapons. The militaries primary job is to remain combat effective, even if it means mandating a vaccine that is known to cause casualties. This kind of approach would never be acceptable for civilian society at large, where society is deemed responsible for protecting every individual. The military isn’t. It’s primarily responsible for protecting the civilian society, even at the cost of exposing soldiers to high risk scenarios.


  • I try to live by a similar “always try to interpret peoples actions in the most positive possible way”. This means that if someone says something hurtful, they probably didn’t mean it, either something came out wrong or you misinterpreted them. Spend a couple seconds thinking about what they could have meant, and suddenly you’re choosing to interpret them in a way that makes your day better instead of worse.

    Same goes for actions. If someone does something you don’t like, you can very often choose to figure out what a good reason for their actions are. Trying my best to think like this has made me a lot happier and more easy-going.


  • reject all forms of advertising

    Yes. If I need something, I’ll go looking for it. If your product is a decent solution to my problem, I’ll find it and buy it when I need it. If you want visibility and/or publicity, you can advertise on your own platform, or do reviews, beta-testing, or press-releases in relevant channels.

    There is literally no reason that you should ever shove your product in my face. The people whose job it is to do the shoving should be fired, and replaced by people that actually contribute to solving real problems. We have more than enough of those.