if you find this interesting you'll also find the publications of J.P Cruthfield interesting, he seem to have worked in this same institute up to 2004 before moving to UC Davis. he has 20+ years worth of papers on the topic, I keep procrastinating reading them esp the ones about what he calls epsilon machines.

I don't really understand this topic, but find the premise interesting enough.

here's a paper about

the intrinsic cost of modularity https://journals.aps.org/prx/abstract/10.1103/PhysRevX.8.031...

Anatomy of a Bit: https://arxiv.org/abs/1105.2988

Modes of Information Flow https://arxiv.org/abs/1808.06723

stuff related to Landauer's bound https://arxiv.org/abs/1812.11241 https://arxiv.org/abs/1909.06650 https://www.researchgate.net/publication/350794561_Refining_...