Vincent AbbottDeep learning, diagrams, and the mathematics underneath.https://vtabbott.io/enDeepSeek-V3: Diagrammedhttps://vtabbott.io/articles/deepseek-v3-diagrammed/https://vtabbott.io/articles/deepseek-v3-diagrammed/Multi-head latent attention and mixture of experts, made visible.Thu, 16 Jan 2025 04:45:58 GMTDiagrams Explained (Quickly)https://vtabbott.io/articles/diagrams-explained-quickly/https://vtabbott.io/articles/diagrams-explained-quickly/A short guide to reading the wires, operations, and structure of neural circuit diagrams.Thu, 21 Nov 2024 12:17:10 GMTWhat's so Hard About Representing Deep Learning Models?https://vtabbott.io/articles/basic-weaving/https://vtabbott.io/articles/basic-weaving/Making the axes, sizes, and broadcasting of deep learning operations explicit.Tue, 03 Sep 2024 03:57:05 GMTCase Study: Shortfalls of Attention is All You Needhttps://vtabbott.io/articles/case-study-shortfalls-of-attention-is-all-you-need/https://vtabbott.io/articles/case-study-shortfalls-of-attention-is-all-you-need/A closer look at what the original Transformer description leaves implicit.Tue, 03 Sep 2024 03:34:27 GMTPreprints for Applied Category Theory Conference 2024https://vtabbott.io/articles/act-2024-preprints/https://vtabbott.io/articles/act-2024-preprints/Functor string diagrams and diagrammatic negative information.Sat, 30 Mar 2024 06:22:10 GMTUnderstanding Mixtral-8x7bhttps://vtabbott.io/articles/mixtral/https://vtabbott.io/articles/mixtral/A diagrammatic tour of the Mixtral-8x7B mixture-of-experts architecture.Tue, 02 Jan 2024 01:57:52 GMTResidual Networks and Information Theoryhttps://vtabbott.io/articles/resnets/https://vtabbott.io/articles/resnets/Skip connections, memory, and an information-theoretic view of residual networks.Wed, 15 Nov 2023 22:08:45 GMTWasserstein GANs and the unexpected mathematics of a new fieldhttps://vtabbott.io/articles/wasserstein-gans/https://vtabbott.io/articles/wasserstein-gans/The unexpected mathematics behind a new approach to generative modelling.Wed, 08 Nov 2023 13:59:47 GMTEntropy and Thermodynamicshttps://vtabbott.io/articles/entropy/https://vtabbott.io/articles/entropy/An exploration of entropy, probability, and the foundations of statistical mechanics.Tue, 07 Nov 2023 13:23:57 GMTA Poster for Neural Circuit Diagramshttps://vtabbott.io/articles/ncd-poster/https://vtabbott.io/articles/ncd-poster/A visual introduction to neural circuit diagrams and the mathematics behind them.Fri, 20 Oct 2023 05:30:27 GMT