“Have you ever noticed that anybody driving slower than you is an idiot, and anyone going faster than you is a maniac?” ― George Carlin I remember hearing this quote when I was first learning to drive. It works well, because we can all relate to it. And it gives us an easy out to get unstuck and realise that there is no objective truth. Everyone has their own speed which they think is responsible and reasonable given the conditions. ...
Perhaps I just feel this way because I worked for a number of years at an AI startup before LLMs existed. But I am quite sick of people meaning LLM when they say the word AI. I know I just need to adapt, and keep up with the times. But I still get confused when somebody uses the word AI to purely mean LLMs. Venn Diagrams AI is a field, the persuit of Artificial forms of Intelligence. ...
In an age of Genies magically whipping up thousands of lines of code based off of some context, your Engineering documentation matters more than ever. Is is more and more easy to do many things, to pump them out. But how do we know we are doing the right thing? The Document The Context Before any solution can be introduced, it’s problem must be introduced. But for a problem to make sense, we must have a shared understanding of the context surrounding the problem. ...
A part 2 to my post on How Does Search Work? Vector Search as a concept is nothing new. We have been projecting data onto planes and querying the distances and relationships in these vectors for decades. But cheap(er) accessability to LLMs has lead to the rapid rising popularity of Semantic Document Search with Vectors. Similar to how Lexucal BM25 search works, Vector Search is also surprisingly easy to grock. Embeddings The heart of leveraging Vector Search technologies for Semantic Search. The Embedding ...
There’s no better way to understand what is going on under the hood than getting in there and trying to build it yourself. So that’s what I’ve done with a Search Engine. This is intentionally simplified and omits many production concerns such as advanced tokenisation, query parsing, compression, and indexing optimisations. Just the core Information Retrieval logic. To get in there and understand what is really happening. Let me walk you through what I have found. ...
I first came across this metaphor on coding horror. The metaphor has stuck with me, and I find it applies widely. The core concept here is that if it’s easy to make mistakes, mistakes will happen. We are all human, and the “correct” thing to do is not always consistent or obvious. It might even seem to change depending on your context. This is connected to Hyrum’s law, if somebody can do something with your system with enough users they will. We cannot rely on people to magically read our minds about how we intended things to work. ...
When I was a younger man, I lived my life planning. Waiting for the right time to make my moves. And I did, but I didn’t always get it right. Sometimes my timing was wrong. What makes it the right time to do something? What does this mean? Well, at a basic level it can be about your ability to deal with the risk related to the opportunity in front of you. ...
For the past couple of years, a lot of us Software Engineers have spent a lot of our time trying to not get left behind. But where are we going? And what are we being left behind from? The token prediction genie Ever since ChatGPT was released to the world 3 years go, the core functionality behind Agentic coding and LLMs has remained the same. It is a machine learning model which tokenises input, and then produces what the next most likely token is to be. It has a “context window”, so the next token it predicts is within the context of the whole window. ...
We create applications, programs, and to do so we write code. Different programming languages work in quite different ways. But there are generally two ways to slice and abstract application code. You can organise it by grouping domain meanings and processes, or you can do it by grouping implementation details. Organising your code by implementation detail. The dotnet world is terrible for this. You will see namespaces like Your.App.Api.Services and Your.App.Api.Models. And they will be compiled as separate DLLs in this weird flat structure which actually isn’t flat, it’s just not represented in the file-structure in the same way it is in the dependency graph. ...
In a large organisation, it’s very easy to feel like a small cog in a big machine. But the truth is, the only thing keeping you in your corner is you. Engineers who really succeed in these large organisations know how and when to venture out from their little corner. Go and find the most successful, smartest Engineers in your organisation. I guarantee you not a single one of them stays in their lane, in their corner, or in their service in a larger system. ...