Open
Description
Ruedi Stoop and co-workers have used excess entropy over several publications in the context of language. I believe a typical application discussing excess entropy is this letter:
https://journals.aps.org/prl/abstract/10.1103/PhysRevLett.127.148101
Biological neuronal networks excel over artificial ones in many ways, but the origin of this is still unknown. Our symbolic dynamics-based tool of excess entropies suggests that neuronal cultures naturally implement data structures of a higher level than what we expect from artificial neural networks, or from close-to-biology neural networks. This points to a new pathway for improving artificial neural networks towards a level demonstrated by biology.