For a long time I was wondering why worthless subjects get lots of attention, while something real stays in a shadow despite being visible. I miss the old internet with high rate of competent and motivated people. At some moment the whole internet thing just turned into a big mall, with playgrounds, shops, fastfood, and lots of ads — the marketing and self-promotion irreversibly passed some critical threshold a long time ago.

You can look at the problem from another angle. Thousand years ago you needed to travel to another country to get knowledge or some people from your tribe died showing you an example of wrong behavor. Genetically people are still functioning as if the information was scarce. Then we got magazines, radio, tv, internet, and now the man expects to be spoon-fed with information — a suggestion to perform an active information search seems almost like an insult today, at best he will prompt perplexity to perform the search, coz he’s busy watching tiktok to waste the precious time on the manual search.

It’s what I usually call “conspiracy of stupidity” — the people secretly conspired to act irrationally and pretend to be acting to their own detriment, supposedly chasing some secret profit goal (that’s was joke, but there’s some truth in it). I pay attention to the way I shit (in a toilet), but I don’t share any details of the process with broad public. If a single actor shouts in a concert hall — everybody hears him; but if every man in the hall shouts then nobody is able to hear anything but the noise.

There are so much noise about AI going on, and I would really like to clear out some confusion created by it. My original idea was to make a series of articles describing the mechanisms of Large Language Models (LLM) and particulary Transformer architecture to create a foundation of understanding of LLM-s for people without PhD in machine learning, because so many LLM-s are being packaged as black boxes while hiding their defficiencies, and barely anyone is taking their time to actually explain the areas where LLM fails, common mistakes it makes, why it’s absolutely not possible to fix them with the current tech, and why for some jobs you absolutely have to have an expert at least doing the final press of “accept solution” button.

However, I realized the amount of details I want to describe is just unacceptable, and most people don’t really care about it anyway. Good news is I can limit the description to mostly properties of the building parts of LLM/transformers rather than show how these parts work in details (the article is still huge though).

The key points of the article:

1. Transformer is a good translator;
2. Transformer has no model of world;
3. As a result, transformer is absolutely terrible at solving truly novel tasks;
4. Transformer is good at parroting i.e. reproducing similar known solutions;
5. But even basic math has too many solutions to memorize, so Transformer is unreliable at math;
6. Transformer is fundamentally unreliable, small fluctiations of input can lead to unpredictable results;
7. Transformer is good at pretending to be an expert without being an expert;
8. Chain of thoughts alleviate the problems, but eventually fail the same way.

My linkedin feed is full of posts like “we stopped hiring junior frontend devs”, “AI replaces juns”, “use AI smart”. I really want to answer, not from position of hirer or a worker, but as a user.

My smartphone app glitches, a website for online ticket sale gives multiple error messages in three (3) different language for the same eror (true story), small store website takes so many resources I almost feel like there is some hidden Figma aoo running inside.
And all Linkedin is arguing about is “We don’t want more junior devs — Yeah, but whom are you gonna hire in ten years”.…

I used to look at Web Components like “what is this? Is it some modern thing I don’t understand, am I supposed to employ it now?”. As people move away from bloated JS SPA, some of them turn their attention to Web Components.

To not keep the suspense: Web Components are useless in their current design. The original idea of progressive enhancement is hopelessly lost, “you don’t need the JS framework” turned into Lit, Polymer, Stencil effectively creating frameworks on top of Web Components.…

I was looking for some convenient solution for simple self-hosted commenting, but instead was welcomed with a mix of personal playgrounds and vibecoding stands which are called “full-stack development” nowadays. I spent several days playing with those 3 commenting systems, studying and modifying their code, so this is not going to be a set of one-paragraph LLM-generated reviews, however, I’m still not deeply familiar with their codebase, so you might call it a “superficial code review”. In order of the encounter, here it goes…

I used to particupate in many discussions about microservices, but over time I began to notice one strange phenomena: when 10 people are talking about microservices every one of them has slightly different meaning of the word. It goes like this:
— Of course we use microservices. Our authorization lives in a separate microservice, game logic and stats live in the second microservices, and our PostgreSQL DB is a third microservice.…

I used to call myself a Rust hater, but really I was doing it just to compensate for the perceivable fanboyism e.g. Rust tops on stackoverflow surveys as most-loved language. There are many reasons to hate C++, and I hate C++ too. Lots of people were waiting for a better programming language, but got Rust instead.

There are several core problems with Rust:

1. Its compilation is slow. I mean SLOW. Slower than C++.…

Pretty much every person today by the age of 25 year has several teeth with fillings. I actually knew few people who already lost a tooth by that time (i.e. depulped tooth, refused to put a crown, tooth cracked).
It’s astonishing that galley slaves and other malnutritioned people actually had no problem with teeth. Yeah, they did not live long, but what I want to emphasize is that there is nothing forcing you to have cavities in teeth. It is also well known that dental caries epidemic started approximately the same time as sedentary agriculture.

https://www.thelancet.com/journals/lancet/article/PIIS0140-6736(97)11096-0/fulltext — RETRACTED: Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children

Modern CPU-s suck horribly. All we were able to do in 30 years is to finally switch to a weak memory model and partially reduced instruction set…