Current research

This page outlines some of my present research questions. Many of them are elaborated in more detail in the final chapter of my DPhil thesis (St Clere Smithe 2023a, chap. 8). They are held together by the common aim of seeking adequate mathematics for understanding life.

Please get in touch if anything here likewise interests you: I am looking for collaborators and students!

I am also interested in computer implementation, particularly in the context of Algebraic Julia, and particularly in relation to compositional approximate and active inference.

Spatial systems theory and ‘ergogenesis’

Categorical systems theory (Myers 2022) tells us how interacting systems come together and how they may influence and relate to each other, but it mostly lacks spatial content: in our world, systems have spatial extent and their interfaces typically have geometry; moreover, their internal structure may be spatial.

  • Can we profitably extend categorical systems theories from fibrations to stacks?
  • Can we use sheaf-theoretic tools such as cohomology to understand when spatial systems agree about their states or their environment?
  • Might this help us design intelligent systems which seek consensus?
    • Does the class of such systems include multi-agent active inference?
  • Might we hence obtain a compositional account of morphogenesis (perhaps extending K. Friston et al. 2015)?
    • More generally, we may thus seek an account not only of the emergence of form, but also of function: a process which one might call ergogenesis.

Compositional inference and Bayesian deep learning

Compositional approaches promise new machine learning tools that are at once more supple (with respect to ease-of-use) and more subtle (with respect to structures implicit in data). Here are some questions on my mind.

On factor graphs and message-passing:

On predictive coding and generalized deep learning:

  • Predictive coding is a scheme for inverting certain directed models that may be understood as deep learning in an information geometry.

On structure and learning:

  • Can we usefully formalize the notion of structure-learning using the idea of base change?
  • We distinguish structure-learning (learning structure) from structured learning (St Clere Smithe 2023a, sec. 8.1.2).
    • Does a stochastic or fuzzy generalization of functorial database theory (Spivak 2012) help us understand both, or either?
    • Can we understand generative models as stochastic database instances?

Dynamics and coalgebra

By definition, adaptive systems respond to change, which means we should have some idea of what ‘change’ means: this is the purview of dynamics. In computer science, coalgebra has emerged as a powerful formalism for studying computational dynamics (Jacobs 2017), and it seems there is much scope for cross-pollination between coalgebra and traditional approaches to dynamics, especially where the dynamical systems of interest have information content, as all living systems do.

Compositional active inference

It is natural to think of agent-environment interactions as constituted by two dual processes: one being perception; the other being action. Active inference explains both of these using approximate Bayesian inference: perception involves an agent changing its internal model, while action involves the agent changing its environment; in both cases, the aim is to minimize surprise or prediction error, given beliefs about how the world should be.

Compositional active inference (St Clere Smithe 2021b, 2022a) is a category-theoretic account of active inference and its compositional structure, which aims to expose the fundamental structures underlying multi-agent systems, from multicellular life to ecosystems and economies. It is a work in progress, grounded in my DPhil work and expected to fit into the frameworks of categorical cybernetics (Capucci et al. 2022; St Clere Smithe 2021a) and categorical systems theory. Since it touches on most of the topics on this page, there are many open questions; specific to active inference itself are the following.

  • Does multi-agent active inference yield a class of spatial systems theories?

    • Can we use it to study self-organizing or otherwise cooperative complex systems?
    • Can we see systems using action to reach consensus — can they persuade each other?
  • What is the type of a plan (Botvinick and Toussaint 2012)?

  • How does the systems theory of active inference relate to a putative systems theory of reinforcement learning?

  • More generally, can we express the claimed universality of active inference (Parr, Da Costa, and Friston 2019) as a universal property — perhaps using adjunctions of systems theories?

‘Géo-logie’: topos theory to map the universe

There is a profound relationship between topology and logic, exhibited in topos theory and yielding what Anel and Joyal (2020) have called ‘topo-logie’. By the Curry-Howard-Lambek correspondence, this relationship can be extended to computation, and the resulting trinity underlies homotopy type theory (Univalent Foundations Program 2013) and the dependently typed programming languages which instantiate it.

At the same time, there is evidence that the mammalian brain represents its environment with a cognitive map (Behrens et al. 2018), even when that environment is quite abstract (Garvert, Dolan, and Behrens 2017; Bernardi et al. 2018). Following the “logic of space” (Shulman 2017), every category can be seen as an abstract directed space (Grandis 2009). This suggests a formal approach to understanding the cognitive map and its apparent generality: the brain embodies a topos that represents its model of the world.

However, missing from such an account would be geometry. The ability to measure distances is important for inference and learning, just as it is for measuring the effort involved in moving. Extending topo-logie to a geometric context may yield géo-logie, and prompt such questions as follow.

  • What is the computational or type-theoretic content of geometric structure? Dually, what is the physical meaning of (stochastic) computation?
    • Ideas from information geometry may be relevant here — but perhaps we can follow the classical trinity and use Kolmogorov complexity to be more explicitly computational (Wolpert 2019).

In such a framework, it seems likely that we can understand (directed) generative models semantically as “stochastic sections”, and that this might supply a topos-theoretic account of agents’ internal models (their internal universes).

  • What is the syntax of stochastic sections, or of ‘metric’ topoi more generally? How is it related to linear type theory?
  • Can we express inference naturally in this type theory?
    • Does this yield connections to, or a suitable formal home for, the quantum free energy principle (Fields et al. 2022)?
  • Do the resulting model universes bear any relation to topos-theoretic models of (aspects of) the physical universe?

Given a topos-theoretic account of agents’ models, we may return to multi-agent systems and active inference.

  • Do spatial systems theory and quantitative type theory supply the formal tools for an abstract account of open Bayesian-mechanical systems, ‘particular’ physics (K. Friston 2019; K. Friston et al. 2022), and hence the physics of life?

  • Is ‘navigation’ a viable proof strategy? Do we find here an abstract cognitive map?

Biosemiotics, metaphysics, and life

Living systems are necessarily open systems, in interaction with their environments. Biosemiotics interprets every process of interaction of a living system as a process of communication (Barbieri 2007): a linguistic process. Pursuing this idea leads to a number of metaphysical-mathematical questions.

  • Can we understand message-passing for approximate inference semiotically?

  • Can we understand neural spiking activity (Doursat 2013) as (possibly higher-order) message-passing?

  • Can we give a ‘local’ compositional account of fundamental physics (or a toy model) via semiosis / message-passing?

    • Might the objective universe obtain as the colimit of observers’ internal universes? (Conflict occurs where no consensus may be reached.)
  • What is a ‘symbol’ or a ‘message’, mathematically? Both are observer-dependent. Does the concept of ‘thing’ admit a similar description?

    • Perhaps: observer-dependence comes from working relative to an object (e.g. the base of a topos, or the type-theoretic context); a message is a generalized state; an interpreter is a costate; a symbol is anything that may be substituted.
  • Can we think of computation as “the dynamics of semiosis(St Clere Smithe 2023a, sec. 8.4.3)? (The idea being that computation is a ‘meaningful’ dynamical process.)

Amongst open systems, living systems are characterized not only by their propensity to resist disorder (survival), but also by their propensity to remake their environment in their image (autopoiesis). Autopoiesis may be a strategy for survival, but together these properties produce ecosystems: fractal systems of systems, across spatiotemporal scales.

  • Do the mathematical tools discussed above allow us to characterize this process mathematically, perhaps following St Clere Smithe (2022b)?
  • Can we see messages themselves as ‘proto-living’ systems, like memes or viruses?
    • What structure must the substrate have for this to work?
    • Does answering these questions indicate how, by a process of consensus-seeking, living systems themselves form the substate for supervenient meta-systems such as societies or corporations?
      • (Presumably, natural selection and the resulting drive to survive pushes systems to self-organize in this way.)
  • Can we use this new understanding to design robust self-organizing systems, or to control biology? To guide “ecosystems of intelligence” (Karl J. Friston et al. 2022) to sustainability?

References

Anel, Mathieu, and André Joyal. 2020. “Topo-Logie.” http://mathieu.anel.free.fr/mat/doc/Anel-Joyal-Topo-logie.pdf.
Barbieri, Marcello, ed. 2007. Introduction to Biosemiotics: The New Biological Synthesis. Springer.
Behrens, Timothy EJ, Timothy H Muller, James CR Whittington, Shirley Mark, Alon B Baram, Kimberly L Stachenfeld, and Zeb Kurth-Nelson. 2018. “What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior.” Neuron 100 (2): 490–509.
Bernardi, Silvia, Marcus K. Benna, Mattia Rigotti, Jérôme Munuera, Stefano Fusi, and C. Daniel Salzman. 2018. “The Geometry of Abstraction in Hippocampus and Pre-Frontal Cortex,” September. https://doi.org/10.1101/408633.
Botvinick, Matthew, and Marc Toussaint. 2012. “Planning as Inference.” Trends in Cognitive Sciences 16 (10): 485–88. https://doi.org/10.1016/j.tics.2012.08.006.
Capucci, Matteo, Bruno Gavranović, Jules Hedges, and Eigil Fjeldgren Rischel. 2022. “Towards Foundations of Categorical Cybernetics.” In Electronic Proceedings in Theoretical Computer Science, 372:235–48. Cambridge, UK: Open Publishing Association. https://doi.org/10.4204/EPTCS.372.17.
Da Costa, Lancelot, Karl Friston, Conor Heins, and Grigorios A. Pavliotis. 2021. “Bayesian Mechanics for Stationary Processes.” Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 477 (2256): 20210518. https://doi.org/10.1098/rspa.2021.0518.
Doursat, René. 2013. “Bridging the Mind-Brain Gap by Morphogenetic Neuron Flocking: The Dynamic Self-Organization of Neural Activity into Mental Shapes.” In 2013 AAAI Fall Symposium Series. https://cdn.aaai.org/ocs/7499/7499-32554-1-PB.pdf.
Fields, Chris, Karl Friston, James F. Glazebrook, and Michael Levin. 2022. “A Free Energy Principle for Generic Quantum Systems.” Progress in Biophysics and Molecular Biology 173 (September): 36–59. https://doi.org/10.1016/j.pbiomolbio.2022.05.006.
Friston, K. J., N. Trujillo-Barreto, and J. Daunizeau. 2008. DEM: A Variational Treatment of Dynamic Systems.” Neuroimage 41 (3): 849–85. https://doi.org/10.1016/j.neuroimage.2008.02.054.
Friston, Karl. 2019. “A Free Energy Principle for a Particular Physics.” https://arxiv.org/abs/1906.10184v1.
Friston, Karl J., Maxwell J. D. Ramstead, Alex B. Kiefer, Alexander Tschantz, Christopher L. Buckley, Mahault Albarracin, Riddhi J. Pitliya, et al. 2022. “Designing Ecosystems of Intelligence from First Principles.” December 2, 2022. http://arxiv.org/abs/2212.01354.
Friston, Karl, Lancelot Da Costa, Dalton A. R. Sakthivadivel, Conor Heins, Grigorios A. Pavliotis, Maxwell Ramstead, and Thomas Parr. 2022. “Path Integrals, Particular Kinds, and Strange Things.” November 4, 2022. http://arxiv.org/abs/2210.12761.
Friston, Karl, Michael Levin, Biswa Sengupta, and Giovanni Pezzulo. 2015. “Knowing Ones Place: A Free-Energy Approach to Pattern Regulation.” Journal of The Royal Society Interface 12 (105): 20141383. https://doi.org/10.1098/rsif.2014.1383.
Fritz, Tobias. 2019. “A Synthetic Approach to Markov Kernels, Conditional Independence and Theorems on Sufficient Statistics.” Advances in Mathematics 370 (107239). https://doi.org/10.1016/j.aim.2020.107239.
Garvert, Mona M, Raymond J Dolan, and Timothy EJ Behrens. 2017. “A Map of Abstract Relational Knowledge in the Human Hippocampal–Entorhinal Cortex.” eLife 6 (April). https://doi.org/10.7554/elife.17086.
Grandis, Marco. 2009. Directed Algebraic Topology : Models of Non-Reversible Worlds. Cambridge, UK New York: Cambridge University Press.
Jacobs, Bart. 2017. Introduction to Coalgebra. Vol. 59. Cambridge University Press. https://www.cambridge.org/gb/academic/subjects/mathematics/logic-categories-and-sets/introduction-coalgebra-towards-mathematics-states-and-observation?format=HB&isbn=9781107177895.
Kurz, Alexander. 2006. “Logic Column 15: Coalgebras and Their Logics.” May 28, 2006. http://arxiv.org/abs/cs/0605128.
Lorenz, Robin, and Sean Tull. 2023. “Causal Models in String Diagrams.” April 15, 2023. http://arxiv.org/abs/2304.07638.
Meulen, Frank van der. 2022. “Introduction to Automatic Backward Filtering Forward Guiding.” October 31, 2022. http://arxiv.org/abs/2203.04155.
Myers, David Jaz. 2022. Categorical Systems Theory (Draft). http://davidjaz.com/Papers/DynamicalBook.pdf.
Parr, Thomas, Lancelot Da Costa, and Karl Friston. 2019. “Markov Blankets, Information Geometry and Stochastic Thermodynamics.” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 378 (2164): 20190159. https://doi.org/10.1098/rsta.2019.0159.
Peltre, Olivier. 2020. “Message-Passing Algorithms and Homology: From Thermodynamics to Statistical Learning.” PhD thesis, Paris: Université Paris Cité. https://opeltre.github.io/assets/bib/Peltre-Message_Passing_Algorithms_and_Homology.pdf.
Ramstead, Maxwell J D, Dalton A R Sakthivadivel, Conor Heins, Magnus Koudahl, Beren Millidge, Lancelot Da Costa, Brennan Klein, and Karl J Friston. 2022. “On Bayesian Mechanics: A Physics of and by Beliefs.” https://arxiv.org/abs/2205.11543.
Salvatori, Tommaso, Ankur Mali, Christopher L. Buckley, Thomas Lukasiewicz, Rajesh P. N. Rao, Karl Friston, and Alexander Ororbia. 2023. “Brain-Inspired Computational Intelligence via Predictive Coding.” August 15, 2023. http://arxiv.org/abs/2308.07870.
Schultz, Patrick, and David I. Spivak. 2019. Temporal Type Theory: A Topos-Theoretic Approach to Systems and Behavior. Springer, Berkhauser.
Schultz, Patrick, David I Spivak, and Christina Vasilakopoulou. 2020. “Dynamical Systems and Sheaves.” Applied Categorical Structures 28: 1–57. https://doi.org/10.1007/s10485-019-09565-x.
Şenöz, İsmail, Thijs Van De Laar, Dmitry Bagaev, and Bert De De Vries. 2021. “Variational Message Passing and Local Constraint Manipulation in Factor Graphs.” Entropy 23 (7): 807. https://doi.org/10.3390/e23070807.
Shapiro, Brandon T., and David I. Spivak. 2023. “Dynamic Operads, Dynamic Categories: From Deep Learning to Prediction Markets.” In Electronic Proceedings in Theoretical Computer Science, 380:183–202. Glasgow, UK: Open Publishing Association. https://doi.org/10.4204/EPTCS.380.11.
Shulman, Michael. 2017. “Homotopy Type Theory: The Logic of Space.” In New Spaces for Mathematics and Physics. http://arxiv.org/abs/1703.03007.
Spivak, David I. 2012. “Functorial Data Migration.” Information and Computation 217 (August): 31–51. https://doi.org/10.1016/j.ic.2012.05.001.
———. 2022. “Learners’ Languages.” In Electronic Proceedings in Theoretical Computer Science, 372:14–28. Cambridge, MA: Open Publishing Association. https://doi.org/10.4204/EPTCS.372.2.
St Clere Smithe, Toby. 2021a. “Cyber Kittens, or Some First Steps Towards Categorical Cybernetics.” In Electronic Proceedings in Theoretical Computer Science, 333:108–24. Cambridge, MA: Open Publishing Association. https://doi.org/10.4204/EPTCS.333.8.
———. 2021b. “Compositional Active Inference I: Bayesian Lenses. Statistical Games.” September 9, 2021. https://arxiv.org/abs/2109.04461.
———. 2022a. “Compositional Active Inference II: Polynomial Dynamics. Approximate Inference Doctrines.” https://arxiv.org/abs/2208.12173.
———. 2022b. “Polynomial Life: The Structure of Adaptive Systems.” In Electronic Proceedings in Theoretical Computer Science, 372:133–48. Cambridge, UK: Open Publishing Association. https://doi.org/10.4204/EPTCS.372.10.
———. 2023a. “Mathematical Foundations for a Compositional Account of the Bayesian Brain.” DPhil, University of Oxford. https://doi.org/10.5287/ora-kzjqyop2d.
———. 2023b. “Open Dynamical Systems as Coalgebras for Polynomial Functors, with Application to Predictive Processing.” In Electronic Proceedings in Theoretical Computer Science, 380:307–30. Glasgow, UK: Open Publishing Association. https://doi.org/10.4204/EPTCS.380.18.
Univalent Foundations Program, The. 2013. Homotopy Type Theory: Univalent Foundations of Mathematics. Institute for Advanced Study: https://homotopytypetheory.org/book. https://homotopytypetheory.org/book/.
Wainwright, Martin J., and Michael I. Jordan. 2007. “Graphical Models, Exponential Families, and Variational Inference.” Foundations and Trends® in Machine Learning 1 (1–2): 1–305. https://doi.org/10.1561/2200000001.
Wolpert, David H. 2019. “Stochastic Thermodynamics of Computation.” Journal of Physics A: Mathematical and Theoretical 52 (19): 193001. https://doi.org/10.1088/1751-8121/ab0850.
Yedidia, Jonathan S., William T. Freeman, and Yair Weiss. 2002. “Understanding Belief Propagation and Its Generalizations.” TR-2001-22. Mitsubishi Electric Research Laboratories.