The joy of cats in functional programming Tarmo Uustalu, Institute - PowerPoint PPT Presentation

The joy of cats in functional programming Tarmo Uustalu, Institute of Cybernetics joint with Varmo Vene, U of Tartu Thorsten Altenkirch, U of Nottingham Venanzio Capretta, Radboud U Nijmegen Robin Cockett, U of Calgary Neil Ghani, U of Nottingham Makoto Hamana, U of Tokyo Ichiro Hasuo, Bart Jacobs, Radboud U Nijmegen Alberto Pardo, U de la Rep´ ublica, Montevideo Final workshop of CDC, Tallinn, 21–22 Jan. 2008

What is this about? Functional programming (in cool languages like in Haskell, OCaml) is about programming with mathematical functions or almost so. We believe in mathematical structures in functional programming, both in data and control. We believe these structures are older than us, they are there to be discovered rather than invented. Moreover, it often amounts to rediscovering what was already known in category theory. Your program is not good until it is structured well. Especially if you want to reuse it, show it to a friend or reason about it. We believe in no less, believe it or not! So we need to care about the right structures.

Category theory This is mathematics about categories, functors, natural transformations and the like. Related to algebra, but far more general. Glasses to see ever-repeating structures clearly. You can think of your type and program denotations as living in categories, e.g., sets and functions, in the case of simply typed lambda calculus pers, in the case of parametric polymorphism cpos, in the case of nontermination from general recursion The fun is to see the same thing again and say, hey, I know how this works! (Do you see why?) In a slightly more syntax-driven mindmode, type theorists are often concerned about the same things as categorical program semanticists.

Haskell ”humor” The evolution of a Haskell programmer by Fritz Ruehr (http://www.willamette.edu/ ∼ fruehr/haskell/evolution.html) Freshman Haskell programmer fac n = if n == 0 then 1 else n * fac (n-1) Junior Haskell programmer (beginning Peano player) fac 0 = 1 fac (n+1) = (n+1) * fac n Senior Haskell programmer (voted for Nixon, Buchanan, Bush, “leans right”) fac n = foldr (*) 1 [1..n] Memoizing Haskell programmer (takes Ginkgo Biloba daily): facs = scanl (*) 1 [1..] fac n = facs !! n

Post-doc Haskell programmer (from Uustalu, Vene and Pardo’s Recursion Schemes from Comonads , NJC 2001) -- explicit type recursion with functors and catamorphisms newtype Mu f = In (f (Mu f)) unIn (In x) = x cata phi = phi . fmap (cata phi) . unIn -- base functor and data type for natural numbers data N c = Z | S c add m = cata phi where phi Z = m instance Functor N where phi (S f) = suck f fmap g Z = Z fmap g (S x) = S (g x) mult m = cata phi where phi Z = zero type Nat = Mu N phi (S f) = add m f zero = In Z suck n = In (S n)

-- explicit products and their functorial action data Prod e c = Pair c e fork f g x = Pair (f x) (g x) outl (Pair x y) = x instance Functor (Prod e) where outr (Pair x y) = y fmap g = fork (g . outl) outr -- comonads, the categorical "opposite" of monads class Functor n => Comonad n where instance Comonad (Prod e) where extr :: n a -> a extr = outl dupl :: n a -> n (n a) dupl = fork id outr -- generalized catamorphisms, zygomorphisms and paramorphisms gcata :: (Functor f, Comonad n) => (forall a. f (n a) -> n (f a)) -> (f (n c) -> c) -> Mu f -> c gcata dist phi = extr . cata (fmap phi . dist . fmap dupl) zygo chi = gcata (fork (fmap outl) (chi . fmap outr)) para :: Functor f => (f (Prod (Mu f) c) -> c) -> Mu f -> c para = zygo In

. . . and finally -- factorial, the *hard* way! fac = para phi where phi Z = suck zero phi (S (Pair f n)) = mult f (suck n) -- for convenience and testing int = cata phi where instance Show (Mu N) where phi Z = 0 show = show . int phi (S f) = 1 + f Tenured professor (teaching Haskell to freshmen) fac n = product [1..n]

Less ”humorous” For less sarkastic expressions of appreciation read, eg, http://www.haskell.org/haskellwiki/Research papers/ Monads and arrows http://www.haskell.org/haskellwiki/Lucid http://www.haskell.org/haskellwiki/Zipper or http://sigfpe.blogspot.com/2006/06/monads-kleisli- arrows-comonads-and.html and further entries on Dan Piponi (aka Sigfpe’s) blog or related entries on Lambda the Ultimate. (To disillusion you: You can’t really improve our citation records with TKN by visiting these pages. . . )

Rest of this talk Briefly about what we did 2002-07: Structured recursion: structured recursion schemes from comonads (ie postdoc programming), recursive coalgebras Mendler recursion, aka type-based termination, aka circular proofs foundations for shortcut deforestation Effects and context-dependence: combining monadic effects nontermination as a monadic effect context-dependence via comonads (CDC)

� � � Recursion schemes from comonads (U, Vene, Pardo) Recursion in total (terminating/productive) programming, as in sets and functions, is only possible in relation to inductive/coinductive types or families. Categorically, inductive types (such as the types of naturals, lists, trees of various flavors etc) are initial algebras of endofunctors (= initial algebras given by signatures in universal algebra). The most basic form of recursion (known as iteration in recursion theory, fold in FP) corresponds to the (defining) unique homomorphism property of initial algebras: For an endofunctor F with an initial algebra ( µ F , in F ), we have in F F ( µ F ) µ F fold( φ )= df ∃ ! f Ff ∀ φ � C FC

� � � We proved this powerful generic function definition scheme, a many-in-one recursion scheme parametrized by a recursive call pattern captured in a comonad and distributive law: Given an endofunctor F with an initial algebra ( µ F , in F ) and a D with a distributive law of F over D , we have in F � µ F F ι F ( D ( µ F )) F ( µ F ) F ( Df ) ∃ ! f ∀ φ � C F ( DC ) where ( µ F , ι ) is a specific E-M coalgebra of the comonad, induced by the distributive law. A comonad is an endofunctor with additional data and properties. Postdoc factorial is but one example . . . and slightly past the point. Beyond primitive recursion, it covers course-of-value recursion, recursion with subsidiary simultaneous recursions on structurally smaller arguments etc.

� � � Recursive coalgebras (Capretta, U, Vene) The algebra structure in F of an initial F -algebra is an isomorphism. In fact, recursion is more about its inverse, a coalgebra (a carrier with observations rather than operations)! Stepping back and following Osius ’70s, we defined any F -coalgebra ( A , α ) to be recursive (supporting recursion) if it satisfies α FA A ∃ ! f Ff ∀ φ � C FC We identified a number of ways for constructing recursive coalgebras out of coalgebras already known to be recursive. These included a construction based on comonads and distributive laws, generalizing ”recursion schemes from comonads” to coalgebras other than inverses of initial algebras.

Mendler-style recursion, aka type-based termination, aka circular proofs (U, Vene, Cockett) Programming with recursors defined by properties such as initiality, ”recursion schemes from comonads” is cumbersome. In actual FP, one wants to program with something closer to general recursion, even if it must be well-behaved. So our recursors need some fine-tuning to be usable. We explored the idea (proposed in type theory by Mendler ’87) to induce maps µ F → C not by maps φ : FC → C but by natural transformations Φ Y : C ( Y , C ) → C ( FY , C ), for fold. By Yoneda lemma, these are in natural bijection.

This gives indeed a program construct which behaves (seemingly) similarly to a general recursor. Checking conformance of what a priori is a general recursion to the fold scheme becomes type-checking. Instead of just admitting the general recursion typing C ( µ F , C ) → C ( F ( µ F ) , C ) we require the recursive definition body to admit the more general type C ( Y , C ) → C ( FY , C ). This extends to other recursion schemes. Ultimately, Mendler-style recursion from the cofree recursive comonad is equivalent to what are known as ”circular proofs”. Circular proofs is a codename for proof systems with a notion of proof that accepts progressive infinite paths in proof trees, studied eg by Santocanale, now promoted by Brotherston & Simpson.

Shortcut fusion: build and augment (U, Vene, Ghani) Something similar appears in shortcut deforestation, a program transformation for eliminating intermediate datastructures. Instead of taking in F : F ( µ F ) → µ F to be the basic means to construct data in µ F , one can take an operation known as build to be basic. Build is an operation taking a strongly dinatural transformation Θ X : C ( FX → X ) → C ( A → X ) to a map A → µ F . Shortcut fusion is based on this rule: fold( φ : FC → C ) ◦ build(Θ) = Θ C ( φ ). We gave a category-theoretic explanation of build and shortcut fusion in terms of limits of an algebra-structure forgetting functors. Moreover, we gave a general monad-based account of what had been ad hoc extension of build, called augment.