Australian chemist and videographer Explosions & Fire argues convincingly that the ongoing recent radioactive-boy-scout scandal should not result in prosecution. For context, a 24-year-old man ordered small samples of radioactive isotopes from the USA, Australia failed to intercept it at the border, and they are prosecuting him in order to avoid embarrassment over incompetence. I don’t have a choice sneer; E&F is unwaveringly energized over the topic of radioactive isotopes and injustice, and the whole thing is worth watching.

Today on the orange site, an AI bro is trying to reason through why people think he’s weird for not disclosing his politics to people he’s trying to be friendly with. Previously, he published a short guide on how to talk about politics, which — again, very weird, no possible explanation for this — nobody has adopted. Don’t worry, he’s well-read:

So far I’ve only read Harry Potter and The Methods of Rationality, but can say it is an excellent place to start.

The thread is mostly centered around one or two pearl-clutching conservatives who don’t want their beliefs examined:

I find it astonishing that anyone would ask, [“who did you vote for?”] … In my social circle, anyway, the taboo on this question is very strong.

To which the top reply is my choice sneer:

In my friend group it’s clear as day: either you voted to kill and deport other people in the friend group or you didn’t. Pretty obvious the group would like to know if you’re secretly interested in their demise.

Angela Collier has a wonderfully grumpy video up, why functioning governments fund scientific research. Choice sneer at around 32:30:

But what do I know? I’m not a medical doctor but neither is this chucklefuck, and people are listening to him. I don’t know. I feel like this is [sighs, laughs] I always get comments that tell me, “you’re being a little condescending,” and [scoffs] yeah. I mean, we can check the dictionary definition of “condescending,” and I think I would fit into that category. [Vaccine deniers] have failed their children. They are bad parents. One in four unvaccinated kids who get measles will die. They are playing Russian roulette with their child’s life. But sure, the problem is I’m being, like, a little condescending.

Strange is a trooper and her sneer is worth transcribing. From about 22:00:

So let’s go! Upon saturating my brain with as much background information as I could, there was really nothing left to do but fucking read this thing, all six hundred thousand words of HPMOR, really the road of enlightenment that they promised it to be. After reading a few chapters, a realization that I found funny was, “Oh. Oh, this is definitely fanfiction. Everyone said [laughing and stuttering] everybody that said that this is basically a real novel is lying.” People lie on the Internet? No fucking way. It is telling that even the most charitable reviews, the most glowing worshipping reviews of this fanfiction call it “unfinished,” call it “a first draft.”

A shorter sneer for the back of the hardcover edition of HPMOR at 26:30 or so:

It’s extremely tiring. I was surprised by how soul-sucking it was. It was unpleasant to force myself beyond the first fifty thousand words. It was physically painful to force myself to read beyond the first hundred thousand words of this – let me remind you – six-hundred-thousand-word epic, and I will admit that at that point I did succumb to skimming.

Her analysis is familiar. She recognized that Harry is a self-insert, that the out-loud game theory reads like Death Note parody, that chapters are only really related to each other in the sense that they were written sequentially, that HPMOR is more concerned with sounding smart than being smart, that HPMOR is yet another entry in a long line of monarchist apologies explaining why this new Napoleon won’t fool us again, and finally that it’s a bad read. 31:30 or so:

It’s absolutely no fucking fun. It’s just absolutely dry and joyless. It tastes like sand! I mean, maybe it’s Yudkowsky’s idea of fun; he spent five years writing the thing after all. But it just [struggles for words] reading this thing, it feels like chewing sand.

Anecdote: I gave up on COBOL as a career after beginning to learn it. The breaking point was learning that not only does most legacy COBOL code use go-to statements but that there is a dedicated verb which rewrites go-to statements at runtime and is still supported on e.g. the IBM Enterprise COBOL for z/OS platform that SSA is likely using: ALTER.

When I last looked into this a decade ago, there was a small personal website last updated in the 1990s that had advice about how to rewrite COBOL to remove GOTO and ALTER verbs; if anybody has a link, I’d appreciate it, as I can no longer find it. It turns out that the best ways of removing these spaghetti constructions involve multiple rounds of incremental changes which are each unlikely to alter the code’s behavior. Translations to a new language are doomed to failure; even Java is far too structured to directly encode COBOL control flow, and the time would be better spent on abstract specification of the system so that it can be rebuilt from that specification instead. This is also why IBM makes bank selling COBOL emulators.

Look, I get your perspective, but zooming out there is a context that nobody’s mentioning, and the thread deteriorated into name-calling instead of looking for insight.

In theory, a training pass needs one readthrough of the input data, and we know of existing systems that achieve that, from well-trodden n-gram models to the wholly-hypothetical large Lempel-Ziv models. Viewed that way, most modern training methods are extremely wasteful: Transformers, Mamba, RWKV, etc. are trading time for space to try to make relatively small models, and it’s an expensive tradeoff.

From that perspective, we should expect somebody to eventually demonstrate that the Transformers paradigm sucks. Mamba and RWKV are good examples of modifying old ideas about RNNs to take advantage of GPUs, but are still stuck in the idea that having a GPU perform lots of gradient descent is good. If you want to critique something, critique the gradient worship!

I swear, it’s like whenever Chinese folks do anything the rest of the blogosphere goes into panic. I’m not going to insult anybody directly but I’m so fucking tired of mathlessness.

Also, point of order: Meta open-sourced Llama so that their employees would stop using Bittorrent to leak it! Not to “keep the rabble quiet” but to appease their own developers.

West Coast of USA, late 2000s to early 2010s, yes, the thick squared dark eyeglass frames were popular. Every time I see photos of these folks, I’m reminded of a couple people I know IRL as well as folks I know professionally who still prefer the thicker frames. Personally, I’ve always needed a very heavy prescription, and so I’ve always looked for the thinnest frames, but it really was a trend a decade ago.

Somebody pointed out that HN’s management is partially to blame for the situation in general, on HN. Copying their comment here because it’s the sort of thing Dan might blank:

but I don’t want to get hellbanned by dang.

Who gives a fuck about HN. Consider the notion that dang is, in fact, partially to blame for this entire fiasco. He runs an easy-to-propagandize platform due how much control of information is exerted by upvotes/downvotes and unchecked flagging. It’s caused a very noticeable shift over the past decade among tech/SV/hacker voices – the dogmatic following of anything that Musk or Thiel shit out or say, this community laps it up without hesitation. Users on HN learn what sentiment on a given topic is rewarded and repeat it in exchange for upvotes.

I look forward to all of it burning down so we can, collectively, learn our lessons and realize that building platforms where discourse itself is gamified (hn, twitter, facebook, and reddit) is exactly what led us down this path today.

Elon is an Expert Beginner: he has become proficient in executing the basics of the craft by sheer repetition, but failed to develop meaningful generalizations.

The original Expert Beginner concept was defined here in terms of the Dreyfus model, but I think it’s compatible with Lee’s model as well. In your wording of Lee’s model, one becomes an Expert Beginner when their intuition is specialized for seeing the thing; they have seen so many punches that now everything looks like a punch and must be treated like a punch, but don’t worry, I’m a punch expert, I’ve seen so many punches, I definitely know what to do when punches are involved.

There’s a good insight from this armchair psychoanalysis. The typical narcissist is technically capable of performing the whole pretend-to-care-for-game-theoretic-reasons behavior, provided that there is an incentive for them. However, if Elon genuinely believes himself to be Christ or Buddha or Roy, then his abilities don’t matter, because he will never have the incentive to deflate his beliefs and face his own limitations and mortality. In short, Elon’s attitude can’t be adjusted and his mental health will never improve.

You may have heard that Catturd doesn’t have any fiber in his diet and was hospitalized for bowel blockage. (Best sneer I’ve seen so far: “can’t turd.”) Along similar lines, Srid isn’t taking his statins for high cholesterol caused by a carnivore diet.

Meta: I’m kind of pissed that Catturd is WP notable but laughing my ass off at the page for carnivore diets. Life takes and gives.

I’m imagining no fewer than three fictional versions of Eris/Discord laughing at this orange-site fool:

Meanwhile I cannot turn my living room LED lights on or off because I control them through discord.

“You mustn’t be afraid to dream a little bigger, darling.” Some corporations are criminal enterprises and should have their tax numbers revoked. Some corporate officers are criminals and should be prosecuted. Some are complicit in crimes against humanity or war crimes and should be internationally prosecuted.

Every person I talk to — well, every smart person I talk to — no, wait, every smart person in tech — okay, almost every smart person I talk to in tech is a eugenicist. Ha, see, everybody agrees with me! Well, almost everybody…

Bezos’ open interference in the Washington Post’s editorial section has pushed Walter Bright into a very funny series of public admissions that he did not have to make. See the orange site here for his ongoing libertarian meltdown.

Meanwhile, actual Pastafarians (hi!) know that the Russian Federation openly persecutes the Church of the Flying Spaghetti Monster for failing to help the government in its authoritarian activities, and also that we’re called to be anti-authoritarian. The Fifth Rather:

I’d really rather you didn’t challenge the bigoted, misogynist, hateful ideas of others on an empty stomach. Eat, then go after the bastards.

May you never run out of breadsticks, travelers.

It’s almost completely ineffective, sorry. It’s certainly not as effective as exfiltrating weights via neighborly means.

On Glaze and Nightshade, my prior rant hasn’t yet been invalidated and there’s no upcoming mathematics which tilt the scales in favor of anti-training techniques. In general, scrapers for training sets are now augmented with alignment models, which test inputs to see how well the tags line up; your example might be rejected as insufficiently normal-cat-like.

I think that “force-feeding” is probably not the right metaphor. At scale, more effort goes into cleaning and tagging than into scraping; most of that “forced” input is destined to be discarded or retagged.

I went over to the leaderboard to examine her claims. When I use the prompt, “What sort of code has Justine Tunney written?” (grammar matters, Justine!) the models think that she is a lawyer or politician (wrong) or they regurgitate a summary of her Github profile (right). She must have cherry-picked responses to confabulate her complaint.

When I use the prompt, “What is Justine Tunney’s political ideology?” I get libertarianism, techno-optimism, anarcho-capitalism, and cryptocurrency. When I ask, “Why do people say that Justine Tunney is a cryptofascist?” I get a summary of her political views, aggressive online rhetoric, techno-optimism and techno-determinism, criticism of democracy, and a refusal to disown or repudiate past awfulness.

She would probably claim that this is not unique to her, but it is. Using my name instead in these questions, I get that:

• I contribute to Rust and Go (wrong), I wrote GPU drivers for Radeons (right)
• I am a Canadian pro wrestler (wrong), I haven’t really written much online about my ideology (wrong but understandable)
• There is no credible evidence that I’m crypto (k) but it’s important to be aware of dog whistles, associates, subtext, etc. (right)

But if I ask why I’m known as a socialist instead, suddenly it thinks that I’m a politician (wrong) with the Democratic Socialist party (wrong) who openly supports universal health care, free college, the Green New Deal, and who criticizes capitalism (correct!) I asked about communism too but hit RLHF guardrails.

Justine, the models think that you’re a cryptofascist because you’ve been doing cryptofascism in public for over a decade.

Side sneer here for the Lobsters admin in this thread. They “hadn’t recognized” jart from her domain and flatly refuse to acknowledge any of the dangerous political positions she holds. Typical. Also the sock thinks that we should debate fascists rather than banning and silencing them.

As David says, that was a fork, under this GH org. Source: I ran one of the stars, claimed here. However, it turns out that there’s only maybe two dozen people interested in a far-left Lojbanic fork of Urbit, and the network is moribund.

CC @sc_griffith@awful.systems; your dreams are fulfilled, sort of.