Machine Intelligence - 2024
A chronological archive of Machine Intelligence reading list posts.
2024
December 2024
🔗 OWASP Expands GenAI Security Guidance
🔗 Being Human in the Age of AI
🔗 Ask Ethan: Does quantum computation occur in parallel universes?
🔗 “AI Inside” Opens New Markets for Vertical SaaS
🔗 Building LLMs is probably not going to be a brilliant business
November 2024
🔗 We can all be AI engineers – and we can do it with open source models
🔗 Artificial Intelligence and the Future of Work
🔗 AI is the Future of Development, But Not as I Imagined
🔗 How AI-Powered Vertical SaaS Is Taking Over Traditional Enterprise SaaS
October 2024
🔗 LLMs, Theory of Mind, and Cheryl's Birthday
🔗 Apple study exposes deep cracks in LLMs’ “reasoning” capabilities
🔗 Headstart Accelerates Software Development by up to 100x with Claude
🔗 A return to hand-written notes by learning to read & write
🔗 Automate Your Job Applications with AIHawk's Auto_Jobs_Applier
September 2024
🔗 Building LLMs from the Ground Up: A 3-hour Coding Workshop
🔗 Generative AI: Revolutionising Business with Artificial Intelligence
🔗 Notes on OpenAI’s new o1 chain-of-thought models
🔗 Yuval Noah Harari on whether democracy and AI can coexist
🔗 A Firehose of LLM / AI Tidbits
🔗 AI OR DIE: The First 100% AI Sketch Comedy Show (EP01 - Flutes & Horses)
🔗 AI: A Means to an End or a Means to Our End?
🔗 Automating the Back Office: How AI is Transforming Professional Services
🔗 Introduction to Anthropic's Prompt Engineering Interactive Tutorial
🔗 AI and the Technological Richter Scale
🔗 OpenAI o1 VS Sonnet 3.5 in Coding Physics Games - AI Showdown
🔗 J.P. Morgan's Python Training
August 2024
🔗 Quantum Computing Advances: Simplifying Complex Principles
🔗 Diffusion Models Are Real-Time Game Engines
🔗 Embedding.io: Turn Websites into LLM Knowledge Bases
🔗 AI is helping to launch new businesses
🔗 Microsoft says OpenAI is now a competitor in AI and search
🔗 Anthropic Publishes the ‘System Prompts’ That Make Claude Tick
July 2024
🔗 Overcoming the limits of current LLM
🔗 AI achieves silver-medal standard solving International Mathematical Olympiad problems
🔗 Will We Run Out of Data? Limits of LLM Scaling Based on Human-Generated Data
🔗 LLM101n: Let's build a Storyteller
🔗 Gentleness and the artificial Other
🔗 Introducing RouteLLM: A Cost-Effective LLM Router Framework
🔗 Investors Are Suddenly Getting Very Concerned That AI Isn't Making Any Serious Money
🔗 Gen AI: too much spend, too little benefit?
🔗 SITUATIONAL AWARENESS - The Decade Ahead
🔗 Mapping the landscape of gen-AI product user experience
🔗 Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planning
🔗 Language models on the command-line
🔗 The Engineer’s Guide To Deep Learning
🔗 OpenAI working on new reasoning technology under code name ‘Strawberry’
🔗 Does Refusal Training in LLMs Generalize to the Past Tense?
🔗 Garandor Securing Digital Identity and Copyrights
🔗 Do the Returns to Software R&D Point Towards a Singularity?
🔗 Non-Obvious Prompt Engineering Guide
🔗 Yohana: The Ultimate Concierge for Busy Families
🔗 Purposefully Teaching Future Readiness with Alex Zarifeh
🔗 General Theory of Neural Networks
🔗 Who Wins the AI Value Chain?
June 2024
🔗 Introducing Generative Physical AI -- youtube.com
🔗 What We Learned from a Year of Building with LLMs (Part I) (oreilly.com)
🔗 Transforming Customer Support and Sales with Mendable's AI Solutions
🔗 Why Apple is Taking a Small-Model Approach to Generative AI
🔗 Achieving the Self-Thinking Business (linkedin.com)
🔗 Will We Run Out of Data? Limits of LLM Scaling Based on Human-Generated Data
🔗 The Next Great Scientific Theory is Hiding Inside a Neural Network
🔗 Why we no longer use LangChain for building our AI agents:
🔗 Here’s what’s really going on inside an LLM’s neural network (arstechnica.com)
🔗 My personal AI research agenda, mid 2024 (and a pitch for work)
🔗 What's the future for generative AI? The Turing Lectures with Mike Wooldridge (youtube.com)
🔗 Generative AI Handbook: A Roadmap for Learning Resources -- genai-handbook.github.io
🔗 What is the biggest challenge in our industry? (thrownewexception.com)
🔗 Grounding - Enhance GEN AI with YOUR DATA (youtube.com)
🔗 I Will Piledrive You If You Mention AI Again
🔗 If AI Can Do Your Job, Maybe It Can Also Replace Your CEO (nytimes.com)
🔗 Reverse Turing Test Experiment with AIs
🔗 Gen AI Testing and Evaluation with ARTKIT
🔗 Can LLMs invent better ways to train LLMs?
🔗 SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
May 2024
🔗 Diffusion Models | Paper Explanation | Math Explained (youtube.com)
🔗 How LLMs Work, Explained Without Math (miguelgrinberg.com)
🔗 Daniel Dennett 'Where Am I?' (thereader.mitpress.mit.edu)
🔗 Introduction to gpt-4o (openai.com)
🔗 OpenAI Releases Its First AI-Made Music Video (techchilli.com)
🔗 Anthropic - Prompt Engineering (thenameless.net)
🔗 5 Big Myths Of AI and Machine Learning Debunked (splunk.com)
🔗 Refusal in LLMs is mediated by a single direction (lesswrong.com)
🔗 I Want Flexible Queries, Not RAG (win-vector.com)
🔗 Diffusion Models - Paper Explanation - Math Explained (youtube.com)
🔗 alessiodm-drl-zh - Deep Reinforcement Learning - Zero to Hero (github.com)
🔗 Ways to think about AGI (ben-evans.com)
🔗 GenAI in 2024 - Another Decade in One Year? (medium.com)
🔗 I will never go back - Ontario family doctor says new AI notetaking saved her job (globalnews.ca)
🔗 AlphaFold 3 predicts the structure and interactions of all of life’s molecules (blog.google)
🔗 John Carmack's 'Different Path' to Artificial General Intelligence (dallasinnovates.com)
🔗 Apple to unveil AI-enabled Safari with iOS 18 & macOS 15 (appleinsider.com)
🔗 State-of-the-Art Exact Binary Vector Search for RAG in 100 lines of Julia (domluna.com)
🔗 AI and problems of scale (ben-evans.com)
🔗 Ilya 30u30 AI papers for John Carmack (arc.net)
🔗 OpenAI to Challenge Google with Its Own Search Engine in May (beebom.com)
April 2024
🔗 The Question No LLM Can Answer
🔗 Embeddings are a good starting point for the AI curious app developer
🔗 Generative AI is still a solution in search of a problem
🔗 Financial Market Applications of LLMs
🔗 What Computers Cannot Do: The Consequences of Turing-Completeness
🔗 Natural language instructions induce compositional generalization in networks of neurons
🔗 Adobe Is Buying Videos for $3 Per Minute to Build AI Model
🔗 How (Specifically) AI Will 100x Human Creativity and Output
🔗 GR00T: NVIDIA's moonshot to solve embedded AI
🔗 The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey
🔗 Outset.ai: Revolutionizing User Surveys with GPT-4
🔗 Dify
🔗 An Agentic Design for AI Consciousness
🔗 The Pipe
🔗 LLM in a flash: Efficient Large Language Model Inference with Limited Memory
🔗 CometLLM: Logging and Visualizing LLM Prompts
🔗 Making Deep Learning Go Brrrr From First Principles
🔗 RAFT: A new way to teach LLMs to be better at RAG
🔗 Anthropic's Prompt Engineering Interactive Tutorial
🔗 Thoughts on the Future of Software Development
🔗 The Death of the Big 4: AI-Enabled Services Are Opening a Whole New Market
🔗 Full Steam Ahead: The 2024 MAD (Machine Learning, AI & Data) Landscape
🔗 Comprehensive Guide to AI Tools and Resources
🔗 Accelerating AI Image Generation with MIT's Novel Framework
🔗 Here’s Proof You Can Train an AI Model Without Slurping Copyrighted Content
🔗 Cheat Sheet: 5 prompt frameworks to level up your prompts
🔗 3Blue1Brown: Neural Networks
🔗 How to unleash the power of AI, with Ethan Mollick
🔗 MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
🔗 What Is an AI Anyway? | Mustafa Suleyman | TED
🔗 LLM inference speed of light
🔗 This prompting technique is insanely useful
🔗 CoreNet: A Library for Training Deep Neural Networks
🔗 VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time
🔗 Stanford AI Index Report 2024: An In-depth Analysis of AI's Current State
🔗 Hello OLMo: A truly open LLM
🔗 Enhancing GPT's Response Accuracy Through Embeddings-Based Search
March 2024
🔗 The Problem of Human Specialness in the Age of AI
🔗 ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMs
🔗 Gold-Medalist Coders Build an AI That Can Do Their Job for Them
🔗 AI startups require new strategies: This time it’s actually different
🔗 Introducing TripoSR: Fast 3D Object Generation from Single Images
🔗 Stable Diffusion 3: Research Paper
🔗 The Era of Abstraction & New Creative Tensions
🔗 Autogenerating a Book Series From Three Years of iMessages
🔗 Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI | Lex Fridman Podcast #416
🔗 noi
🔗 Meta is building a giant AI model to power its ‘entire video ecosystem,’ exec says
🔗 pg_vectorize: a VectorDB for Postgres
🔗 The Expanding Dark Forest and Generative AI
🔗 You can now train a 70b language model at home
🔗 Building Meta’s GenAI Infrastructure
🔗 An Introduction to Knowledge Graphs
🔗 A generalist AI agent for 3D virtual environments
🔗 Large language models can do jaw-dropping things. But nobody knows exactly why
🔗 "AI, no ads please": 4 words to wipe out $1tn
🔗 Anthropic’s Claude 3 causes stir by seeming to realize when it was being tested
🔗 Defending LLMs against Jailbreaking Attacks via Backtranslation
February 2024
🔗 Klarna says its AI assistant does the work of 700 people after it laid off 700 people
🔗 Mamba Explained: The State Space Model taking on Transformers
🔗 AI Hallucinations : Fear Not — It’s A Solved Problem — Here’s How (With Examples!)
🔗 Romanes Lecture: ‘Godfather of AI’ speaks about the risks of artificial intelligence
🔗 OpenAI shocks the world yet again … Sora first look
🔗 Large Language Models: A Survey
🔗 Jeff Dean (Google): Exciting Trends in Machine Learning
🔗 GPT4's system prompt was leaked
🔗 GradSafe: Detecting Unsafe Prompts for LLMs via Safety-Critical Gradient Analysis
🔗 SORA Video To Video Is Literally Mind Blowing - 12 HD Demos - Changes Industry Forever For Real
🔗 OWASP LLM AI Security and Governance Checklist v1 (pdf)
🔗 Sam Altman Seeks Trillions of Dollars to Reshape Business of Chips and AI
🔗 Cory Doctorow: What Kind of Bubble is AI?
🔗 GeneGPT
🔗 I analysed 5M freelancing jobs to see what jobs are being replaced by AI
🔗 AI is the average of the Internet: WPP, Don't become an AI North Korea
🔗 Spreadsheets are all you need - Understanding GPT2 and Transformers with Spreadsheets
🔗 Deep Learning Discovers Antibiotics
🔗 Ancient Herculaneum scroll piece revealed by AI
🔗 GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting
🔗 Sora is a data-driven physics engine
🔗 Introduction to Matryoshka Embedding Models
🔗 AI assistance is leading to lower code quality, claim researchers
🔗 Chain-of-Thought Reasoning Without Prompting
🔗 Machine Learning Research at Apple
🔗 Beyond Self-Attention: How a Small Language Model Predicts the Next Token
🔗 How I'd Learn AI (If I Had to Start Over)
🔗 Demis Hassabis on Chatbots to AGI | Hard Fork EP 71
🔗 Is OpenAI the next challenger trying to take on Google Search?
🔗 FCC Makes AI-Generated Voices in Robocalls Illegal
🔗 SORA
🔗 Reduce AI Hallucinations with Retrieval Augmented Generation
🔗 EmoSpeaker: One-shot Fine-grained Emotion-Controlled Talking Face Generation
January 2024
🔗 The 6 Types of Conversations with Generative AI
🔗 RAG Using Unstructured Data & Role of Knowledge Graphs (part 2/2)
🔗 Attacks on machine learning models
🔗 State-of-the-art Code Generation with AlphaCodium – From Prompt Engineering to Flow Engineering
🔗 Self-Consuming Generative Models Go MAD
🔗 The chaos inside OpenAI – Sam Altman, Elon Musk, and existential risk explained | Karen Hao
🔗 Seven Failure Points When Engineering a Retrieval Augmented Generation System
🔗 crewAI
🔗 AI Won’t Kill Our Jobs, It Will Kill Our Job Descriptions—and Leave Us Better Off
🔗 GenAI could make KYC effectively useless
🔗 Torvalds Speaks: Impact of Artificial Intelligence on Programming
🔗 Machine Learning Engineering Open Book
🔗 The Random Transformer: Understand how transformers work by demystifying all the math behind them
🔗 Coca-Cola’s accidentally terrifying Christmas card AI image generator
🔗 State of AI & predictions for 2024
🔗 Machine Learning Video Library
🔗 Mathematical Introduction to Deep Learning (Arxiv, 2310.20360)
🔗 Centaurs and Cyborgs on the Jagged Frontier
🔗 Ten Noteworthy AI Research Papers of 2023
🔗 Pushing ChatGPT's Structured Data Support To Its Limits
🔗 The Impact of Reasoning Step Length on Large Language Models
🔗 Sean Moriarty - The Future of Large Language Models is Elixir
🔗 DocLLM: A layout-aware generative language model for multimodal document understanding
🔗 Direct Preference Optimisation: Your Language Model is Secretly a Reward Model
🔗 Stanford’s mobile ALOHA robot learns from humans to cook, clean, do laundry
🔗 Meta releases prompt engineering guide to help beginners and pros prompt like experts
Was this useful?