AI's unbelievable 437× memory shrinkage
In 2023, the word "Unbelievable" took over a million bytes of AI memory. DeepSeek's V4.1 Flash needs 2,670. What changed, and why it makes AI cheaper to run.
Read article
Insights / Notes from the work
AI and Large Language Models
Model capabilities, economics, verification and the realities of building AI products.
Articles
GPT-6 Astra: More Efficient Reasoning, Harder to Audit?
GPT-6 Astra can deliver better results with fewer tokens. What does its opaque reasoning mean for AI costs, auditability and trust in business applications?
Read article
/ Archive
How many words are 128k tokens?
128k tokens are 96k words in English for ChatGPT 3.5 and 4. The ratio is estimated to be 0.75 words per token. However, the answer is not...
Read article
/ Archive
How to Build Training Datasets and Fine-tune ChatGPT
Large-language models (LLMs) are great generalists, but modifications are required for optimisation or specialist tasks. The easiest choice is...
Read article
/ Archive
OpenAI GPT-4 Turbo's 128k token context has a 4k completion limit
Recently, OpenAI released GPT4 turbo preview with 128k at its DevDay. That addresses a serious limitation for Retrieval Augmented Generation (RAG)...
Read article
/ Archive
OpenAI Custom GPTs: A Content Backdoor to Omniscience?
Today, I received access to the new custom GPT feature on ChatGPT, and it appears to do what Sam Altman demonstrated. The implications are...
Read article
/ Archive
Is OpenAI killing Retrieval Augmented Generation?
OpenAI's DevDay announcement yesterday addresses issues I wrote about in the infeasibility of RAG after building Llamar.ai this summer. Did I get...
Read article
/ Archive
Llamar.ai: A deep dive into the (in)feasibility of RAG with LLMs
Over four months, I created a working retrieval-augmented generation (RAG) product prototype for a sizeable potential customer using a...
Read article
/ Archive
9 Proven Programming Productivity Prompt Tips for ChatGPT
Learn to harness the potential of ChatGPT4, your virtual programming partner, with nine prompting tips. Improve your programming skills by...
Read article
/ Archive
JavaScript TDD with ChatGPT
Test-driven development in JavaScript with ChatGPT-4 works. An example demonstrates it using a precise description and refined prompt engineering.
Read article
/ Archive
Deep Dive into Code with ChatGPT
Open Source libraries offer user documentation. But expert users and contributors have a deeper understanding of the inner workings stemming from...
Read article
/ Archive
Bing Chat argues and lies when it gets code wrong
Microsoft could follow Google's $100bn loss. I tried the new Bing Chat (ChatGPT) feature, which was great until it went disastrously wrong. It...
Read article
/ Archive
Google Unveils "Google Bard", its Answer to ChatGPT
The Battle of the AI Chatbots Begins: Google's Bard Takes on ChatGPT.
Read article
/ Archive
Understanding the Power of ChatGPT
ChatGPT is a state-of-the-art language model developed by OpenAI, utilising the Transformer model and fine-tuned through reinforcement learning to...
Read article
/ Archive
How to create a Data Dictionary using ChatGPT
ChatGPT can combine Data with natural language and has extensive information about most subjects. That lends itself to novel applications like...
Read article
/ Archive
Python TDD with ChatGPT
Programming with ChatGPT using an iterative approach is difficult, as I have demonstrated previously. Maybe ChatGPT can benefit from Test-driven...
Read article
/ Archive
How to code Python with ChatGPT
Can ChatGPT help you develop software in Python? Let us ask ChatGPT to write code to query AWS Athena to test if and how we can do it step-by-step.
Read article
/ Archive
No, ChatGPT is not 10x-ing developer performance
ChatGPT and similar language models have recently been gaining attention for their potential to revolutionise code generation and enhance...
Read article
/ Archive
OpenAI GPT-3: Content spam or more?
OpenAI's ChatGPT has made the news recently as a next-generation conversational agent. It has a surprising breadth which made me wonder, could...
Read article
/ Archive
Will Tesla's AI break the insurance market?
Insurance works because it shares costs in the face of uncertainty. What happens when Tesla removes uncertainty and distributes cost seemingly...
Read article