Information Dynamics Samson Abramsky Department of Computer - - PowerPoint PPT Presentation

information dynamics
SMART_READER_LITE
LIVE PREVIEW

Information Dynamics Samson Abramsky Department of Computer - - PowerPoint PPT Presentation

Information Dynamics Samson Abramsky Department of Computer Science, Oxford University Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 1 / 29 Information Dynamics: the very idea Robins lecture at


slide-1
SLIDE 1

Information Dynamics

Samson Abramsky

Department of Computer Science, Oxford University

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 1 / 29

slide-2
SLIDE 2

Information Dynamics: the very idea

Robin’s lecture at MFPS 2000.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 2 / 29

slide-3
SLIDE 3

Information Dynamics: the very idea

Robin’s lecture at MFPS 2000. From Information, Processes and Games, in Handbook of Philosophy of Information, ed. Johan van Benthem and Pieter Adriaans, Elsevier 2008: What, then, is this nascent field? We would like to use the term Information Dynamics, which was proposed some time ago by Robin Milner, to suggest how the area of Theoretical Computer Science usually known as “Semantics” might emancipate itself from its traditional focus

  • n interpreting the syntax of pre-existing programming languages, and

become a more autonomous study of the fundamental structures of Informatics.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 2 / 29

slide-4
SLIDE 4

Computing as a science

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 3 / 29

slide-5
SLIDE 5

Computing as a science

From Robin’s essay on Semantic Ideas in Computing, in Computing Tomorrow,

  • ed. Ian Wand and Robin Milner, Cambridge 1996:

Are there distinct principles and concepts which underlie computing, so that we are justified in calling it an independent science? . . . In this essay I argue that a rich conceptual development is in progress, to which we cannot predict limits, and whose outcome will be a distinct science. . . . In the previous section we found that the domain model can be understood in terms of amounts of information, and also that sequential computation corresponds to a special discipline imposed on the flow of

  • information. In the present section, we have found that a key to

understanding concurrent or interactive computation lies in the structure

  • f this information flow.

. . . Thus both applications and theories converge upon the phenomena

  • f information flow; in my view this indicates a new scientific identity.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 3 / 29

slide-6
SLIDE 6

Mathematical structures for information flow

From the preface to Robin’s book The space and motion of communicating agents: Large informatic systems are complex, and any rigorous model must control this complexity by means of adequate structure. After many years seeking such models, I am convinced that categories provide this structure most convincingly.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 4 / 29

slide-7
SLIDE 7

Mathematical structures for information flow

From the preface to Robin’s book The space and motion of communicating agents: Large informatic systems are complex, and any rigorous model must control this complexity by means of adequate structure. After many years seeking such models, I am convinced that categories provide this structure most convincingly. We shall use the setting of monoidal categories to trace a path through quantum information, topology, logic, computation and linguistics, showing how common structures arise in all of these, and give rise to some core mathematics of information flow.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 4 / 29

slide-8
SLIDE 8

Mathematical structures for information flow

From the preface to Robin’s book The space and motion of communicating agents: Large informatic systems are complex, and any rigorous model must control this complexity by means of adequate structure. After many years seeking such models, I am convinced that categories provide this structure most convincingly. We shall use the setting of monoidal categories to trace a path through quantum information, topology, logic, computation and linguistics, showing how common structures arise in all of these, and give rise to some core mathematics of information flow. Diagrammatic representations (‘string diagrams’) will play a key role. The same pictures and the same diagrammatic transformations show up in all these, apparently very different contexts.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 4 / 29

slide-9
SLIDE 9

A crash course in qubits

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 5 / 29

slide-10
SLIDE 10

A crash course in qubits

Classical bit register: state is 0 or 1.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 5 / 29

slide-11
SLIDE 11

A crash course in qubits

Classical bit register: state is 0 or 1. Qubit: complex linear combination α0|0 + α1|1, |α0|2 + |α1|2 = 1.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 5 / 29

slide-12
SLIDE 12

A crash course in qubits

Classical bit register: state is 0 or 1. Qubit: complex linear combination α0|0 + α1|1, |α0|2 + |α1|2 = 1. Measurement (in |0, |1 basis): get |i with probability |αi|2.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 5 / 29

slide-13
SLIDE 13

A crash course in qubits

Classical bit register: state is 0 or 1. Qubit: complex linear combination α0|0 + α1|1, |α0|2 + |α1|2 = 1. Measurement (in |0, |1 basis): get |i with probability |αi|2. Geometric picture: the Bloch sphere

  • 1

1

  • i

i

N S P x z (a) (b) y P’ θ ϕ

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 5 / 29

slide-14
SLIDE 14

A crash course in qubits

Classical bit register: state is 0 or 1. Qubit: complex linear combination α0|0 + α1|1, |α0|2 + |α1|2 = 1. Measurement (in |0, |1 basis): get |i with probability |αi|2. Geometric picture: the Bloch sphere

  • 1

1

  • i

i

N S P x z (a) (b) y P’ θ ϕ

Things get interesting with n-qubit registers

  • i

αi|i, i ∈ {0, 1}n.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 5 / 29

slide-15
SLIDE 15

Quantum Entanglement

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 6 / 29

slide-16
SLIDE 16

Quantum Entanglement

Bell state: |00 + |11 EPR state: |01 + |10

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 6 / 29

slide-17
SLIDE 17

Quantum Entanglement

Bell state: |00 + |11 EPR state: |01 + |10 Compound systems are represented by tensor product: H1 ⊗ H2. Typical element:

  • i

λi · φi ⊗ ψi Superposition encodes correlation.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 6 / 29

slide-18
SLIDE 18

Quantum Entanglement

Bell state: |00 + |11 EPR state: |01 + |10 Compound systems are represented by tensor product: H1 ⊗ H2. Typical element:

  • i

λi · φi ⊗ ψi Superposition encodes correlation. Einstein’s ‘spooky action at a distance’. Even if the particles are spatially separated, measuring one has an effect on the state of the other.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 6 / 29

slide-19
SLIDE 19

Quantum Entanglement

Bell state: |00 + |11 EPR state: |01 + |10 Compound systems are represented by tensor product: H1 ⊗ H2. Typical element:

  • i

λi · φi ⊗ ψi Superposition encodes correlation. Einstein’s ‘spooky action at a distance’. Even if the particles are spatially separated, measuring one has an effect on the state of the other. Bell’s theorem: QM is essentially non-local.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 6 / 29

slide-20
SLIDE 20

From ‘paradox’ to ‘feature’: Teleportation

MBell Ux |00 + |11 x ∈ B2 |φ |φ

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 7 / 29

slide-21
SLIDE 21

Entangled states as linear maps

H1 ⊗ H2 is spanned by |11 · · · |1m . . . ... . . . |n1 · · · |nm hence

  • i,j

αij|ij ← →    α11 · · · α1m . . . ... . . . αn1 · · · αnm    ← → |i →

  • j

αij|j Pairs |ψ1, ψ2 are a special case — |ij in a well-chosen basis. This is Map-State Duality: Hom(A, B) ∼ = A∗ ⊗ B.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 8 / 29

slide-22
SLIDE 22

Entangled states as linear maps

H1 ⊗ H2 is spanned by |11 · · · |1m . . . ... . . . |n1 · · · |nm hence

  • i,j

αij|ij ← →    α11 · · · α1m . . . ... . . . αn1 · · · αnm    ← → |i →

  • j

αij|j Pairs |ψ1, ψ2 are a special case — |ij in a well-chosen basis. This is Map-State Duality: Hom(A, B) ∼ = A∗ ⊗ B.

  • Notation. Given a linear map f : H → H, we write Pf for the projector on H ⊗ H

determined by the vector corresponding to f under Map-State duality:

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 8 / 29

slide-23
SLIDE 23

Entangled states as linear maps

H1 ⊗ H2 is spanned by |11 · · · |1m . . . ... . . . |n1 · · · |nm hence

  • i,j

αij|ij ← →    α11 · · · α1m . . . ... . . . αn1 · · · αnm    ← → |i →

  • j

αij|j Pairs |ψ1, ψ2 are a special case — |ij in a well-chosen basis. This is Map-State Duality: Hom(A, B) ∼ = A∗ ⊗ B.

  • Notation. Given a linear map f : H → H, we write Pf for the projector on H ⊗ H

determined by the vector corresponding to f under Map-State duality: Does this remind you of λ-calculus a little bit? . . .

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 8 / 29

slide-24
SLIDE 24

What is the output?

f1 f2 f3 f4 φin φout? (Pf4 ⊗ 1) ◦ (1 ⊗ Pf3) ◦ (Pf2 ⊗ 1) ◦ (1 ⊗ Pf1) : H1 ⊗ H2 ⊗ H3 − → H1 ⊗ H2 ⊗ H3

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 9 / 29

slide-25
SLIDE 25

What is the output?

f1 f2 f3 f4 φin φout? (Pf4 ⊗ 1) ◦ (1 ⊗ Pf3) ◦ (Pf2 ⊗ 1) ◦ (1 ⊗ Pf1) : H1 ⊗ H2 ⊗ H3 − → H1 ⊗ H2 ⊗ H3 φout = f3 ◦ f4 ◦ f †

2 ◦ f † 3 ◦ f1 ◦ f2(φin)

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 9 / 29

slide-26
SLIDE 26

Follow the line!

f1 f2 f3 f4 f3 ◦ f4 ◦ f †

2 ◦ f † 3 ◦ f1 ◦ f2

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 10 / 29

slide-27
SLIDE 27

Bipartite Projectors

Information flow in entangled states can be captured mathematically by the isomorphism Hom(A, B) ∼ = A∗ ⊗ B. This leads to a decomposition of bipartite projectors into “names” (preparations) and “conames” (measurements). In graphical notation: f f f † f †

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 11 / 29

slide-28
SLIDE 28

Graphical Calculus for Information Flow

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 12 / 29

slide-29
SLIDE 29

Graphical Calculus for Information Flow

Compact Closure: The basic algebraic laws for units and counits.

= =

(ǫA ⊗ 1A) ◦ (1A ⊗ ηA) = 1A (1A∗ ⊗ ǫA) ◦ (ηA ⊗ 1A∗) = 1A∗

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 12 / 29

slide-30
SLIDE 30

Compositionality

The key algebraic fact from which teleportation (and many other protocols) can be derived. f g

=

f g

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 13 / 29

slide-31
SLIDE 31

Compositionality ctd

f g

=

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 14 / 29

slide-32
SLIDE 32

Compositionality ctd

f g

=

g f

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 15 / 29

slide-33
SLIDE 33

Teleportation diagrammatically

βi β−1

i

=

βi β−1

i

=

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 16 / 29

slide-34
SLIDE 34

Categorical Quantum Mechanics

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 17 / 29

slide-35
SLIDE 35

Categorical Quantum Mechanics

Work of many people, both in the Quantum Group at Oxford CS Dept and elsewhere.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 17 / 29

slide-36
SLIDE 36

Categorical Quantum Mechanics

Work of many people, both in the Quantum Group at Oxford CS Dept and elsewhere. Underlying mathematics: monoidal dagger categories, dagger compact structure, Frobenius algebras, bialgebras . . .

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 17 / 29

slide-37
SLIDE 37

Categorical Quantum Mechanics

Work of many people, both in the Quantum Group at Oxford CS Dept and elsewhere. Underlying mathematics: monoidal dagger categories, dagger compact structure, Frobenius algebras, bialgebras . . . Diagrammatic representation. Connections to logic and category theory. Underpinning mathematics, effective visualization, making mathematical structures accessible.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 17 / 29

slide-38
SLIDE 38

Categorical Quantum Mechanics

Work of many people, both in the Quantum Group at Oxford CS Dept and elsewhere. Underlying mathematics: monoidal dagger categories, dagger compact structure, Frobenius algebras, bialgebras . . . Diagrammatic representation. Connections to logic and category theory. Underpinning mathematics, effective visualization, making mathematical structures accessible. Software tool support: Quantomatic. Tactics, graph rewriting, visual interface.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 17 / 29

slide-39
SLIDE 39

Categorical Quantum Mechanics

Work of many people, both in the Quantum Group at Oxford CS Dept and elsewhere. Underlying mathematics: monoidal dagger categories, dagger compact structure, Frobenius algebras, bialgebras . . . Diagrammatic representation. Connections to logic and category theory. Underpinning mathematics, effective visualization, making mathematical structures accessible. Software tool support: Quantomatic. Tactics, graph rewriting, visual interface.

  • Applications. Formalization of quantum protocols, QKD, measurement-based

quantum computation, etc. Analysis of determinism in MBQC, compositional structure of multipartite entanglement. Foundational topics: e.g. analysis of non-locality.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 17 / 29

slide-40
SLIDE 40

String Diagrams Are Everywhere

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 18 / 29

slide-41
SLIDE 41

String Diagrams Are Everywhere

This graphical formalism, with the underlying mathematics of monoidal categories, compact closure etc., turns up in (at least) the following places:

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 18 / 29

slide-42
SLIDE 42

String Diagrams Are Everywhere

This graphical formalism, with the underlying mathematics of monoidal categories, compact closure etc., turns up in (at least) the following places: Quantum mechanics, quantum information.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 18 / 29

slide-43
SLIDE 43

String Diagrams Are Everywhere

This graphical formalism, with the underlying mathematics of monoidal categories, compact closure etc., turns up in (at least) the following places: Quantum mechanics, quantum information. Logic: (linear version of) cut-elimination

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 18 / 29

slide-44
SLIDE 44

String Diagrams Are Everywhere

This graphical formalism, with the underlying mathematics of monoidal categories, compact closure etc., turns up in (at least) the following places: Quantum mechanics, quantum information. Logic: (linear version of) cut-elimination Computation: (linear version of) λ-calculus, feedback, processes, game semantics.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 18 / 29

slide-45
SLIDE 45

String Diagrams Are Everywhere

This graphical formalism, with the underlying mathematics of monoidal categories, compact closure etc., turns up in (at least) the following places: Quantum mechanics, quantum information. Logic: (linear version of) cut-elimination Computation: (linear version of) λ-calculus, feedback, processes, game semantics. Linguistics: Lambek pregroup grammars, lifting vector space models of word meaning

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 18 / 29

slide-46
SLIDE 46

String Diagrams Are Everywhere

This graphical formalism, with the underlying mathematics of monoidal categories, compact closure etc., turns up in (at least) the following places: Quantum mechanics, quantum information. Logic: (linear version of) cut-elimination Computation: (linear version of) λ-calculus, feedback, processes, game semantics. Linguistics: Lambek pregroup grammars, lifting vector space models of word meaning Topology, knot theory: Temperley-Lieb algebra, braided, pivotal and ribbon categories.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 18 / 29

slide-47
SLIDE 47

String Diagrams Are Everywhere

This graphical formalism, with the underlying mathematics of monoidal categories, compact closure etc., turns up in (at least) the following places: Quantum mechanics, quantum information. Logic: (linear version of) cut-elimination Computation: (linear version of) λ-calculus, feedback, processes, game semantics. Linguistics: Lambek pregroup grammars, lifting vector space models of word meaning Topology, knot theory: Temperley-Lieb algebra, braided, pivotal and ribbon categories. We will trace a path through some of these . . .

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 18 / 29

slide-48
SLIDE 48

The Temperley-Lieb Algebra

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 19 / 29

slide-49
SLIDE 49

The Temperley-Lieb Algebra

Generators: · · · · · · 1 2 3 n 1′ 2′ 3′ n′ U1 · · · · · · · · · 1 n 1′ n′ Un−1

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 19 / 29

slide-50
SLIDE 50

The Temperley-Lieb Algebra

Generators: · · · · · · 1 2 3 n 1′ 2′ 3′ n′ U1 · · · · · · · · · 1 n 1′ n′ Un−1 Relations: = U1U2U1 = U1 = U2

1 = δU1

= U1U3 = U3U1

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 19 / 29

slide-51
SLIDE 51

Structure of Temperley-Lieb category

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 20 / 29

slide-52
SLIDE 52

Structure of Temperley-Lieb category

General form of composition: · · ·

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 20 / 29

slide-53
SLIDE 53

Structure of Temperley-Lieb category

General form of composition: · · · Compact closure/rigidity: = =

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 20 / 29

slide-54
SLIDE 54

Structure of Temperley-Lieb category

General form of composition: · · · Compact closure/rigidity: = = The same structure which accounts for teleportation:

Alice Bob

=

ψ ψ

Alice Bob Alice Bob

=

ψ

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 20 / 29

slide-55
SLIDE 55

Temperley-Lieb: expressiveness of the generators

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 21 / 29

slide-56
SLIDE 56

Temperley-Lieb: expressiveness of the generators

All planar diagrams can be expressed as products of generators.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 21 / 29

slide-57
SLIDE 57

Temperley-Lieb: expressiveness of the generators

All planar diagrams can be expressed as products of generators. E.g. the ‘left wave’ can be expressed as the product U2U1:

=

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 21 / 29

slide-58
SLIDE 58

Temperley-Lieb: expressiveness of the generators

All planar diagrams can be expressed as products of generators. E.g. the ‘left wave’ can be expressed as the product U2U1:

=

Diagrammatic trace:

=

The Ear is a Circle

=

Trace of Identity is the Dimension

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 21 / 29

slide-59
SLIDE 59

The Connection to Knots

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 22 / 29

slide-60
SLIDE 60

The Connection to Knots

How does this connect to knots? A key conceptual insight is due to Kauffman, who saw how to recast the Jones polynomial in elementary combinatorial form in terms of his bracket polynomial.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 22 / 29

slide-61
SLIDE 61

The Connection to Knots

How does this connect to knots? A key conceptual insight is due to Kauffman, who saw how to recast the Jones polynomial in elementary combinatorial form in terms of his bracket polynomial. The basic idea of the bracket polynomial is expressed by the following equation: = + A B

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 22 / 29

slide-62
SLIDE 62

The Connection to Knots

How does this connect to knots? A key conceptual insight is due to Kauffman, who saw how to recast the Jones polynomial in elementary combinatorial form in terms of his bracket polynomial. The basic idea of the bracket polynomial is expressed by the following equation: = + A B Each over-crossing in a knot or link is evaluated to a weighted sum of the two possible planar smoothings in the Temperley-Lieb algebra. With suitable choices for the coefficients A and B (as Laurent polynomials), this is invariant under the second and third Reidemeister moves. With an ingenious choice of normalizing factor, it becomes invariant under the first Reidemeister move — and yields the Jones polynomial!

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 22 / 29

slide-63
SLIDE 63

Computation: back to the λ-calculus

We shall consider the bracketing combinator B ≡ λx.λy.λz. x(yz) : (B → C) → (A → B) → (A → C). This is characterized by the equation Babc = a(bc).

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 23 / 29

slide-64
SLIDE 64

Computation: back to the λ-calculus

We shall consider the bracketing combinator B ≡ λx.λy.λz. x(yz) : (B → C) → (A → B) → (A → C). This is characterized by the equation Babc = a(bc). We take A = B = C = 1 in TL. The interpretation of the open term x : B → C, y : A → B, z : A ⊢ x(yz) : C is as follows: x+ x− y + y − z+

  • Samson Abramsky (Department of Computer Science, Oxford University)

Information Dynamics 23 / 29

slide-65
SLIDE 65

Computation: back to the λ-calculus

We shall consider the bracketing combinator B ≡ λx.λy.λz. x(yz) : (B → C) → (A → B) → (A → C). This is characterized by the equation Babc = a(bc). We take A = B = C = 1 in TL. The interpretation of the open term x : B → C, y : A → B, z : A ⊢ x(yz) : C is as follows: x+ x− y + y − z+

  • Here x+ is the output of x, and x− the input, and similarly for y. The output of

the whole expression is o.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 23 / 29

slide-66
SLIDE 66

Diagrammatic Simplification as β-Reduction

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 24 / 29

slide-67
SLIDE 67

Diagrammatic Simplification as β-Reduction

When we abstract the variables, we obtain the following caps-only diagram: x+ x− y + y − z+

  • Samson Abramsky (Department of Computer Science, Oxford University)

Information Dynamics 24 / 29

slide-68
SLIDE 68

Diagrammatic Simplification as β-Reduction

When we abstract the variables, we obtain the following caps-only diagram: x+ x− y + y − z+

  • Now we consider an application Babc (where application is represented by cups):

x+ x− y + y − z+

  • a

b c a b c

  • =

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 24 / 29

slide-69
SLIDE 69

A Non-Planar Example

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 25 / 29

slide-70
SLIDE 70

A Non-Planar Example

We shall consider the commuting combinator C ≡ λx.λy.λz. xzy : (A → B → C) → B → A → C.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 25 / 29

slide-71
SLIDE 71

A Non-Planar Example

We shall consider the commuting combinator C ≡ λx.λy.λz. xzy : (A → B → C) → B → A → C. This is characterized by the equation Cabc = acb.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 25 / 29

slide-72
SLIDE 72

A Non-Planar Example

We shall consider the commuting combinator C ≡ λx.λy.λz. xzy : (A → B → C) → B → A → C. This is characterized by the equation Cabc = acb. The interpretation of the open term x : A → B → C, y : B, z : A ⊢ xzy : C is as follows: x+ x1 x2 y z

  • Samson Abramsky (Department of Computer Science, Oxford University)

Information Dynamics 25 / 29

slide-73
SLIDE 73

A Non-Planar Example

We shall consider the commuting combinator C ≡ λx.λy.λz. xzy : (A → B → C) → B → A → C. This is characterized by the equation Cabc = acb. The interpretation of the open term x : A → B → C, y : B, z : A ⊢ xzy : C is as follows: x+ x1 x2 y z

  • Here x+ is the output of x, x1 the first input, and x2 the second input. The
  • utput of the whole expression is o.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 25 / 29

slide-74
SLIDE 74

Diagrammatic Simplification as β-Reduction

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 26 / 29

slide-75
SLIDE 75

Diagrammatic Simplification as β-Reduction

When we abstract the variables, we obtain the following caps-only diagram: x+ x1 x2 y z

  • Samson Abramsky (Department of Computer Science, Oxford University)

Information Dynamics 26 / 29

slide-76
SLIDE 76

Diagrammatic Simplification as β-Reduction

When we abstract the variables, we obtain the following caps-only diagram: x+ x1 x2 y z

  • Now we consider an application Cabc:

x+ x1 x2 y z

  • a

b c a b c

  • =

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 26 / 29

slide-77
SLIDE 77

Diagrammatic Simplification as β-Reduction

When we abstract the variables, we obtain the following caps-only diagram: x+ x1 x2 y z

  • Now we consider an application Cabc:

x+ x1 x2 y z

  • a

b c a b c

  • =

With BCI combinators one can interpret Linear λ-calculus. With just BI one has planar λ-calculus.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 26 / 29

slide-78
SLIDE 78

Linguistics

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 27 / 29

slide-79
SLIDE 79

Linguistics

Clark, Coecke and Sadrzadeh: Compositional Distributional Models of Meaning.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 27 / 29

slide-80
SLIDE 80

Linguistics

Clark, Coecke and Sadrzadeh: Compositional Distributional Models of Meaning. Lambek grammars: π pronoun, i infinitive, o direct object, . . .

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 27 / 29

slide-81
SLIDE 81

Linguistics

Clark, Coecke and Sadrzadeh: Compositional Distributional Models of Meaning. Lambek grammars: π pronoun, i infinitive, o direct object, . . . s ilπl π i ol

s

Does he like her? question

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 27 / 29

slide-82
SLIDE 82

Linguistics

Clark, Coecke and Sadrzadeh: Compositional Distributional Models of Meaning. Lambek grammars: π pronoun, i infinitive, o direct object, . . . s ilπl π i ol

s

Does he like her? question

Distributional models: words interpreted as vectors of frequency counts of co-occurrences of a set of reference words (the basis) within a fixed (small) word radius in a large text corpus. Widely used in information retrieval.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 27 / 29

slide-83
SLIDE 83

Linguistics

Clark, Coecke and Sadrzadeh: Compositional Distributional Models of Meaning. Lambek grammars: π pronoun, i infinitive, o direct object, . . . s ilπl π i ol

s

Does he like her? question

Distributional models: words interpreted as vectors of frequency counts of co-occurrences of a set of reference words (the basis) within a fixed (small) word radius in a large text corpus. Widely used in information retrieval. These seem very different: but they have the same categorical/diagrammatic structure — vector spaces treated as in the quantum information setting!

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 27 / 29

slide-84
SLIDE 84

Linguistics

Clark, Coecke and Sadrzadeh: Compositional Distributional Models of Meaning. Lambek grammars: π pronoun, i infinitive, o direct object, . . . s ilπl π i ol

s

Does he like her? question

Distributional models: words interpreted as vectors of frequency counts of co-occurrences of a set of reference words (the basis) within a fixed (small) word radius in a large text corpus. Widely used in information retrieval. These seem very different: but they have the same categorical/diagrammatic structure — vector spaces treated as in the quantum information setting! So we can functorially map Lambek pregroup parses into vector spaces to lift the distributional word meanings compositionally to meanings for phrases and sentences.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 27 / 29

slide-85
SLIDE 85

Linguistics

Clark, Coecke and Sadrzadeh: Compositional Distributional Models of Meaning. Lambek grammars: π pronoun, i infinitive, o direct object, . . . s ilπl π i ol

s

Does he like her? question

Distributional models: words interpreted as vectors of frequency counts of co-occurrences of a set of reference words (the basis) within a fixed (small) word radius in a large text corpus. Widely used in information retrieval. These seem very different: but they have the same categorical/diagrammatic structure — vector spaces treated as in the quantum information setting! So we can functorially map Lambek pregroup parses into vector spaces to lift the distributional word meanings compositionally to meanings for phrases and sentences. Implementations and benchmarks look promising: see recent work by Sadrzadeh and Graefenstette.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 27 / 29

slide-86
SLIDE 86

Final Remarks

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 28 / 29

slide-87
SLIDE 87

Final Remarks

Structures in monoidal categories, involving compact structure, trace etc., which support the diagrammatic calculus we have illustrated seem to provide a canonical setting for discussing processes. Have been widely used as such, implicitly or explicitly, in Computer Science. Recent work has emphasized their relevance in quantum information and quantum foundations.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 28 / 29

slide-88
SLIDE 88

Final Remarks

Structures in monoidal categories, involving compact structure, trace etc., which support the diagrammatic calculus we have illustrated seem to provide a canonical setting for discussing processes. Have been widely used as such, implicitly or explicitly, in Computer Science. Recent work has emphasized their relevance in quantum information and quantum foundations. As we have seen, the same structures reach into a wide range of other disciplines.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 28 / 29

slide-89
SLIDE 89

Final Remarks

Structures in monoidal categories, involving compact structure, trace etc., which support the diagrammatic calculus we have illustrated seem to provide a canonical setting for discussing processes. Have been widely used as such, implicitly or explicitly, in Computer Science. Recent work has emphasized their relevance in quantum information and quantum foundations. As we have seen, the same structures reach into a wide range of other disciplines. There are other promising ingredients for a general theory of information

  • flow. In particular, sheaves as a general ‘logic of contextuality’. See my paper

with Adam Brandenburger in New Journal of Physics (2011).

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 28 / 29

slide-90
SLIDE 90

Some lessons we can learn from Robin

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-91
SLIDE 91

Some lessons we can learn from Robin

No Stone Tablets!

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-92
SLIDE 92

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-93
SLIDE 93

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level. Follow through!

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-94
SLIDE 94

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level. Follow through! Four major books on concurrency: 1980, 1989, 1999, 2009. Led, inspired and encouraged a broad body of work, from theory to tool support and applications.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-95
SLIDE 95

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level. Follow through! Four major books on concurrency: 1980, 1989, 1999, 2009. Led, inspired and encouraged a broad body of work, from theory to tool support and applications. Be open to the work of others, and learn from them. (Although in Robin’s hands, the ideas were usually transformed in some way!)

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-96
SLIDE 96

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level. Follow through! Four major books on concurrency: 1980, 1989, 1999, 2009. Led, inspired and encouraged a broad body of work, from theory to tool support and applications. Be open to the work of others, and learn from them. (Although in Robin’s hands, the ideas were usually transformed in some way!) SOS (Plotkin), bisimulation (Park), structural congruence (Berry and Boudol), monoidal categories (Meseguer and Montanari), . . .

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-97
SLIDE 97

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level. Follow through! Four major books on concurrency: 1980, 1989, 1999, 2009. Led, inspired and encouraged a broad body of work, from theory to tool support and applications. Be open to the work of others, and learn from them. (Although in Robin’s hands, the ideas were usually transformed in some way!) SOS (Plotkin), bisimulation (Park), structural congruence (Berry and Boudol), monoidal categories (Meseguer and Montanari), . . . Use the right mathematics to realize your scientific vision; don’t tailor your aproach to suit some preconceived mathematics you happen to like.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-98
SLIDE 98

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level. Follow through! Four major books on concurrency: 1980, 1989, 1999, 2009. Led, inspired and encouraged a broad body of work, from theory to tool support and applications. Be open to the work of others, and learn from them. (Although in Robin’s hands, the ideas were usually transformed in some way!) SOS (Plotkin), bisimulation (Park), structural congruence (Berry and Boudol), monoidal categories (Meseguer and Montanari), . . . Use the right mathematics to realize your scientific vision; don’t tailor your aproach to suit some preconceived mathematics you happen to like. Domains, labelled transition systems and SOS, categories, . . .

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-99
SLIDE 99

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level. Follow through! Four major books on concurrency: 1980, 1989, 1999, 2009. Led, inspired and encouraged a broad body of work, from theory to tool support and applications. Be open to the work of others, and learn from them. (Although in Robin’s hands, the ideas were usually transformed in some way!) SOS (Plotkin), bisimulation (Park), structural congruence (Berry and Boudol), monoidal categories (Meseguer and Montanari), . . . Use the right mathematics to realize your scientific vision; don’t tailor your aproach to suit some preconceived mathematics you happen to like. Domains, labelled transition systems and SOS, categories, . . . Think it through.

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-100
SLIDE 100

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level. Follow through! Four major books on concurrency: 1980, 1989, 1999, 2009. Led, inspired and encouraged a broad body of work, from theory to tool support and applications. Be open to the work of others, and learn from them. (Although in Robin’s hands, the ideas were usually transformed in some way!) SOS (Plotkin), bisimulation (Park), structural congruence (Berry and Boudol), monoidal categories (Meseguer and Montanari), . . . Use the right mathematics to realize your scientific vision; don’t tailor your aproach to suit some preconceived mathematics you happen to like. Domains, labelled transition systems and SOS, categories, . . . Think it through. The speed of the long-distance runner . . .

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29

slide-101
SLIDE 101

Some lessons we can learn from Robin

No Stone Tablets! Having created a paradigm, he recast it and made it new, not once, but in three major phases. Always with a purpose, moving the subject to a higher level. Follow through! Four major books on concurrency: 1980, 1989, 1999, 2009. Led, inspired and encouraged a broad body of work, from theory to tool support and applications. Be open to the work of others, and learn from them. (Although in Robin’s hands, the ideas were usually transformed in some way!) SOS (Plotkin), bisimulation (Park), structural congruence (Berry and Boudol), monoidal categories (Meseguer and Montanari), . . . Use the right mathematics to realize your scientific vision; don’t tailor your aproach to suit some preconceived mathematics you happen to like. Domains, labelled transition systems and SOS, categories, . . . Think it through. The speed of the long-distance runner . . . There are many more . . .

Samson Abramsky (Department of Computer Science, Oxford University) Information Dynamics 29 / 29