Pure Inductive Logic Jeff Paris School of Mathematics, University - - PowerPoint PPT Presentation

pure inductive logic
SMART_READER_LITE
LIVE PREVIEW

Pure Inductive Logic Jeff Paris School of Mathematics, University - - PowerPoint PPT Presentation

Pure Inductive Logic Jeff Paris School of Mathematics, University of Manchester in collaboration with J urgen Landes, Chris Nix, Alena Vencovsk a Jeff Paris Pure Inductive Logic Page 1 of 1 Jeff Paris Pure Inductive Logic et-


slide-1
SLIDE 1

Pure Inductive Logic

Jeff Paris

School of Mathematics, University of Manchester

– in collaboration with J¨ urgen Landes, Chris Nix, Alena Vencovsk´ a

Jeff Paris Pure Inductive Logic

slide-2
SLIDE 2

Page 1 of 1 et- 3... Jeff Paris Pure Inductive Logic

slide-3
SLIDE 3

Pure Inductive Logic Framework

Imagine an agent inhabiting a structure M for a first order language L with just finitely many relation symbols P(x), P1(x), P2(x), R(x, y) . . . etc. and countably constant symbols a1, a2, a3, . . . which name every individual in the universe, and no function symbols nor equality. This agent is assumed to have no further knowledge about M Let SL denote the set of first order sentences of L.

Jeff Paris Pure Inductive Logic

slide-4
SLIDE 4

Pure Inductive Logic Framework

Imagine an agent inhabiting a structure M for a first order language L with just finitely many relation symbols P(x), P1(x), P2(x), R(x, y) . . . etc. and countably constant symbols a1, a2, a3, . . . which name every individual in the universe, and no function symbols nor equality. This agent is assumed to have no further knowledge about M Let SL denote the set of first order sentences of L.

Jeff Paris Pure Inductive Logic

slide-5
SLIDE 5

Pure Inductive Logic Framework

Imagine an agent inhabiting a structure M for a first order language L with just finitely many relation symbols P(x), P1(x), P2(x), R(x, y) . . . etc. and countably constant symbols a1, a2, a3, . . . which name every individual in the universe, and no function symbols nor equality. This agent is assumed to have no further knowledge about M Let SL denote the set of first order sentences of L.

Jeff Paris Pure Inductive Logic

slide-6
SLIDE 6

Pure Inductive Logic Framework

Imagine an agent inhabiting a structure M for a first order language L with just finitely many relation symbols P(x), P1(x), P2(x), R(x, y) . . . etc. and countably constant symbols a1, a2, a3, . . . which name every individual in the universe, and no function symbols nor equality. This agent is assumed to have no further knowledge about M Let SL denote the set of first order sentences of L.

Jeff Paris Pure Inductive Logic

slide-7
SLIDE 7

We ask our agent to ‘rationally’ assign a probability w(θ) to θ ∈ SL being true in this ambient structure M. Equivalently we’re asking the agent to pick a ‘rational’ probability function w, where w : SL → [0, 1] is a probability function on L if it satisfies (P1) | = θ ⇒ w(θ) = 1 (P2) θ | = ¬φ ⇒ w(θ ∨ φ) = w(θ) + w(φ) (P3) w(∃x ψ(x)) = limn→∞ w (n

i=1 ψ(ai))

Jeff Paris Pure Inductive Logic

slide-8
SLIDE 8

We ask our agent to ‘rationally’ assign a probability w(θ) to θ ∈ SL being true in this ambient structure M. Equivalently we’re asking the agent to pick a ‘rational’ probability function w, where w : SL → [0, 1] is a probability function on L if it satisfies (P1) | = θ ⇒ w(θ) = 1 (P2) θ | = ¬φ ⇒ w(θ ∨ φ) = w(θ) + w(φ) (P3) w(∃x ψ(x)) = limn→∞ w (n

i=1 ψ(ai))

Jeff Paris Pure Inductive Logic

slide-9
SLIDE 9

We ask our agent to ‘rationally’ assign a probability w(θ) to θ ∈ SL being true in this ambient structure M. Equivalently we’re asking the agent to pick a ‘rational’ probability function w, where w : SL → [0, 1] is a probability function on L if it satisfies (P1) | = θ ⇒ w(θ) = 1 (P2) θ | = ¬φ ⇒ w(θ ∨ φ) = w(θ) + w(φ) (P3) w(∃x ψ(x)) = limn→∞ w (n

i=1 ψ(ai))

Jeff Paris Pure Inductive Logic

slide-10
SLIDE 10

How should shehe do it?

By the application of ‘rational principles’ . . . . . . based on Symmetry, Relevance, Irrelevance, Analogy, . . . Example Constant Exchangeability Principle, Ex For θ(x1, x2, . . . , xn) a formula of L not mentioning any constants w(θ(ai1, ai2, . . . , ain)) = w(θ(aj1, aj2, . . . , ajn)) Similarly replacing a relation symbol R everywhere in φ ∈ SL by ¬R should not change the probability (as in the coin toss example) – the Strong Negation Principle

Jeff Paris Pure Inductive Logic

slide-11
SLIDE 11

How should shehe do it?

By the application of ‘rational principles’ . . . . . . based on Symmetry, Relevance, Irrelevance, Analogy, . . . Example Constant Exchangeability Principle, Ex For θ(x1, x2, . . . , xn) a formula of L not mentioning any constants w(θ(ai1, ai2, . . . , ain)) = w(θ(aj1, aj2, . . . , ajn)) Similarly replacing a relation symbol R everywhere in φ ∈ SL by ¬R should not change the probability (as in the coin toss example) – the Strong Negation Principle

Jeff Paris Pure Inductive Logic

slide-12
SLIDE 12

How should shehe do it?

By the application of ‘rational principles’ . . . . . . based on Symmetry, Relevance, Irrelevance, Analogy, . . . Example Constant Exchangeability Principle, Ex For θ(x1, x2, . . . , xn) a formula of L not mentioning any constants w(θ(ai1, ai2, . . . , ain)) = w(θ(aj1, aj2, . . . , ajn)) Similarly replacing a relation symbol R everywhere in φ ∈ SL by ¬R should not change the probability (as in the coin toss example) – the Strong Negation Principle

Jeff Paris Pure Inductive Logic

slide-13
SLIDE 13

How should shehe do it?

By the application of ‘rational principles’ . . . . . . based on Symmetry, Relevance, Irrelevance, Analogy, . . . Example Constant Exchangeability Principle, Ex For θ(x1, x2, . . . , xn) a formula of L not mentioning any constants w(θ(ai1, ai2, . . . , ain)) = w(θ(aj1, aj2, . . . , ajn)) Similarly replacing a relation symbol R everywhere in φ ∈ SL by ¬R should not change the probability (as in the coin toss example) – the Strong Negation Principle

Jeff Paris Pure Inductive Logic

slide-14
SLIDE 14

How should shehe do it?

By the application of ‘rational principles’ . . . . . . based on Symmetry, Relevance, Irrelevance, Analogy, . . . Example Constant Exchangeability Principle, Ex For θ(x1, x2, . . . , xn) a formula of L not mentioning any constants w(θ(ai1, ai2, . . . , ain)) = w(θ(aj1, aj2, . . . , ajn)) Similarly replacing a relation symbol R everywhere in φ ∈ SL by ¬R should not change the probability (as in the coin toss example) – the Strong Negation Principle

Jeff Paris Pure Inductive Logic

slide-15
SLIDE 15

Jeff Paris Pure Inductive Logic

slide-16
SLIDE 16

Jeff Paris Pure Inductive Logic

slide-17
SLIDE 17

Such intuitions however are easily challenged, e.g. Given R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3) which of R(a3, a1), ¬R(a3, a1) would you think the more likely?

Jeff Paris Pure Inductive Logic

slide-18
SLIDE 18

Such intuitions however are easily challenged, e.g. Given R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3) which of R(a3, a1), ¬R(a3, a1) would you think the more likely?

Jeff Paris Pure Inductive Logic

slide-19
SLIDE 19

Such intuitions however are easily challenged, e.g. Given R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3) which of R(a3, a1), ¬R(a3, a1) would you think the more likely?

Jeff Paris Pure Inductive Logic

slide-20
SLIDE 20

Into the Polyadic

For simplicity assume that L has just a single binary relation symbol R. A state description for a1, a2, . . . , an is a quantifier free sentence of the form n

i,j=1 ±R(ai, aj)

State descriptions are where it all happens in this subject because:- Gaifman’s Theorem w is completely determined by its values on state descriptions.

Jeff Paris Pure Inductive Logic

slide-21
SLIDE 21

Into the Polyadic

For simplicity assume that L has just a single binary relation symbol R. A state description for a1, a2, . . . , an is a quantifier free sentence of the form n

i,j=1 ±R(ai, aj)

State descriptions are where it all happens in this subject because:- Gaifman’s Theorem w is completely determined by its values on state descriptions.

Jeff Paris Pure Inductive Logic

slide-22
SLIDE 22

Into the Polyadic

For simplicity assume that L has just a single binary relation symbol R. A state description for a1, a2, . . . , an is a quantifier free sentence of the form n

i,j=1 ±R(ai, aj)

State descriptions are where it all happens in this subject because:- Gaifman’s Theorem w is completely determined by its values on state descriptions.

Jeff Paris Pure Inductive Logic

slide-23
SLIDE 23

Into the Polyadic

For simplicity assume that L has just a single binary relation symbol R. A state description for a1, a2, . . . , an is a quantifier free sentence of the form n

i,j=1 ±R(ai, aj)

State descriptions are where it all happens in this subject because:- Gaifman’s Theorem w is completely determined by its values on state descriptions.

Jeff Paris Pure Inductive Logic

slide-24
SLIDE 24

Into the Polyadic

For simplicity assume that L has just a single binary relation symbol R. A state description for a1, a2, . . . , an is a quantifier free sentence of the form n

i,j=1 ±R(ai, aj)

State descriptions are where it all happens in this subject because:- Gaifman’s Theorem w is completely determined by its values on state descriptions.

Jeff Paris Pure Inductive Logic

slide-25
SLIDE 25

The Completely Independent Probability Function

The Completely Independent Probability Function w0 gives each of the ±R(ai, aj) probability 1/2 and treats them all as stochastically independent E.g. w0(R(a1, a2)∧R(a2, a1)∧¬R(a1, a3)) = (1/2)×(1/2)×(1/2) = 1/8 Trouble is, to our earlier question w0(R(a3, a1) | R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3)) = 1/2 = w0(¬R(a3, a1) | R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3))

Jeff Paris Pure Inductive Logic

slide-26
SLIDE 26

The Completely Independent Probability Function

The Completely Independent Probability Function w0 gives each of the ±R(ai, aj) probability 1/2 and treats them all as stochastically independent E.g. w0(R(a1, a2)∧R(a2, a1)∧¬R(a1, a3)) = (1/2)×(1/2)×(1/2) = 1/8 Trouble is, to our earlier question w0(R(a3, a1) | R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3)) = 1/2 = w0(¬R(a3, a1) | R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3))

Jeff Paris Pure Inductive Logic

slide-27
SLIDE 27

The Completely Independent Probability Function

The Completely Independent Probability Function w0 gives each of the ±R(ai, aj) probability 1/2 and treats them all as stochastically independent E.g. w0(R(a1, a2)∧R(a2, a1)∧¬R(a1, a3)) = (1/2)×(1/2)×(1/2) = 1/8 Trouble is, to our earlier question w0(R(a3, a1) | R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3)) = 1/2 = w0(¬R(a3, a1) | R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3))

Jeff Paris Pure Inductive Logic

slide-28
SLIDE 28

The Completely Independent Probability Function

The Completely Independent Probability Function w0 gives each of the ±R(ai, aj) probability 1/2 and treats them all as stochastically independent E.g. w0(R(a1, a2)∧R(a2, a1)∧¬R(a1, a3)) = (1/2)×(1/2)×(1/2) = 1/8 Trouble is, to our earlier question w0(R(a3, a1) | R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3)) = 1/2 = w0(¬R(a3, a1) | R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3))

Jeff Paris Pure Inductive Logic

slide-29
SLIDE 29

Spectrum Exchangeability

Given a state description Θ(a1, a2, . . . , an) define the equivalence relation ∼Θ on {a1, . . . , an} by ai ∼Θ aj ⇐ ⇒ Θ(a1, a2, . . . , an) ∧ ai = aj is consistent equivalently iff ai, aj are indistinguishable on the basis of Θ(a1, . . . , an). The spectrum of Θ(a1, . . . , an) is the multiset of sizes of the equivalence classes according to ∼Θ.

Jeff Paris Pure Inductive Logic

slide-30
SLIDE 30

Spectrum Exchangeability

Given a state description Θ(a1, a2, . . . , an) define the equivalence relation ∼Θ on {a1, . . . , an} by ai ∼Θ aj ⇐ ⇒ Θ(a1, a2, . . . , an) ∧ ai = aj is consistent equivalently iff ai, aj are indistinguishable on the basis of Θ(a1, . . . , an). The spectrum of Θ(a1, . . . , an) is the multiset of sizes of the equivalence classes according to ∼Θ.

Jeff Paris Pure Inductive Logic

slide-31
SLIDE 31

Spectrum Exchangeability

Given a state description Θ(a1, a2, . . . , an) define the equivalence relation ∼Θ on {a1, . . . , an} by ai ∼Θ aj ⇐ ⇒ Θ(a1, a2, . . . , an) ∧ ai = aj is consistent equivalently iff ai, aj are indistinguishable on the basis of Θ(a1, . . . , an). The spectrum of Θ(a1, . . . , an) is the multiset of sizes of the equivalence classes according to ∼Θ.

Jeff Paris Pure Inductive Logic

slide-32
SLIDE 32

Spectrum Exchangeability

Given a state description Θ(a1, a2, . . . , an) define the equivalence relation ∼Θ on {a1, . . . , an} by ai ∼Θ aj ⇐ ⇒ Θ(a1, a2, . . . , an) ∧ ai = aj is consistent equivalently iff ai, aj are indistinguishable on the basis of Θ(a1, . . . , an). The spectrum of Θ(a1, . . . , an) is the multiset of sizes of the equivalence classes according to ∼Θ.

Jeff Paris Pure Inductive Logic

slide-33
SLIDE 33

Example

Suppose Θ(a1, a2, a3, a4) is the conjunction of R(a1, a1) ¬R(a1, a2) R(a1, a3) R(a1, a4) R(a2, a1) ¬R(a2, a2) R(a2, a3) ¬R(a2, a4) R(a3, a1) ¬R(a3, a2) R(a3, a3) R(a3, a4) R(a4, a1) R(a4, a2) R(a4, a3) R(a4, a4) Then the equivalence classes are {a1, a3}, {a2}, {a4} and the spectrum is {2, 1, 1}

Jeff Paris Pure Inductive Logic

slide-34
SLIDE 34

Spectrum Exchangeability

Spectrum Exchangeability, Sx If the state descriptions Θ(a1, . . . , an), Φ(a1, . . . , an) have the same spectrum then w(Θ(a1, . . . , an)) = w(Φ(a1, . . . , an))

Jeff Paris Pure Inductive Logic

slide-35
SLIDE 35

Spectrum Exchangeability

Spectrum Exchangeability, Sx If the state descriptions Θ(a1, . . . , an), Φ(a1, . . . , an) have the same spectrum then w(Θ(a1, . . . , an)) = w(Φ(a1, . . . , an))

Jeff Paris Pure Inductive Logic

slide-36
SLIDE 36

So the conjunctions of R(a1, a1) ¬R(a1, a2) R(a1, a3) R(a2, a1) ¬R(a2, a2) R(a2, a3) R(a3, a1) ¬R(a3, a2) R(a3, a3) and ¬R(a1, a1) ¬R(a1, a2) R(a1, a3) ¬R(a2, a1) ¬R(a2, a2) R(a2, a3) R(a3, a1) R(a3, a2) R(a3, a3) get the same probability as both have spectrum {2, 1}

Jeff Paris Pure Inductive Logic

slide-37
SLIDE 37

The Promised Land (?)

Given R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3) which of R(a3, a1), ¬R(a3, a1) would you think the more likely? Sx implies that the ¬R(a3, a1) is at least as likely as R(a3, a1) (so ‘analogy’ wins out)

Jeff Paris Pure Inductive Logic

slide-38
SLIDE 38

The Promised Land (?)

Given R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3) which of R(a3, a1), ¬R(a3, a1) would you think the more likely? Sx implies that the ¬R(a3, a1) is at least as likely as R(a3, a1) (so ‘analogy’ wins out)

Jeff Paris Pure Inductive Logic

slide-39
SLIDE 39

The Promised Land (?)

Given R(a1, a2) ∧ R(a2, a1) ∧ ¬R(a1, a3) which of R(a3, a1), ¬R(a3, a1) would you think the more likely? Sx implies that the ¬R(a3, a1) is at least as likely as R(a3, a1) (so ‘analogy’ wins out)

Jeff Paris Pure Inductive Logic

slide-40
SLIDE 40

Conformity

Consider the two ‘unary relations’ R(a1, x) and R(x, x) of L. Which of the two ‘state descriptions’ R(a1, a1) ∧ R(a1, a2) ∧ ¬R(a1, a3) ∧ R(a1, a4) R(a1, a1) ∧ R(a2, a2) ∧ ¬R(a3, a3) ∧ R(a4, a4) should we think the more likely? The intuition is that there is no rational reason why R(a1, x) and R(x, x) should, in isolation, differ Hence the above ‘state descriptions’ should get the same probability. Assuming Sx they do!

Jeff Paris Pure Inductive Logic

slide-41
SLIDE 41

Conformity

Consider the two ‘unary relations’ R(a1, x) and R(x, x) of L. Which of the two ‘state descriptions’ R(a1, a1) ∧ R(a1, a2) ∧ ¬R(a1, a3) ∧ R(a1, a4) R(a1, a1) ∧ R(a2, a2) ∧ ¬R(a3, a3) ∧ R(a4, a4) should we think the more likely? The intuition is that there is no rational reason why R(a1, x) and R(x, x) should, in isolation, differ Hence the above ‘state descriptions’ should get the same probability. Assuming Sx they do!

Jeff Paris Pure Inductive Logic

slide-42
SLIDE 42

Conformity

Consider the two ‘unary relations’ R(a1, x) and R(x, x) of L. Which of the two ‘state descriptions’ R(a1, a1) ∧ R(a1, a2) ∧ ¬R(a1, a3) ∧ R(a1, a4) R(a1, a1) ∧ R(a2, a2) ∧ ¬R(a3, a3) ∧ R(a4, a4) should we think the more likely? The intuition is that there is no rational reason why R(a1, x) and R(x, x) should, in isolation, differ Hence the above ‘state descriptions’ should get the same probability. Assuming Sx they do!

Jeff Paris Pure Inductive Logic

slide-43
SLIDE 43

Conformity

Consider the two ‘unary relations’ R(a1, x) and R(x, x) of L. Which of the two ‘state descriptions’ R(a1, a1) ∧ R(a1, a2) ∧ ¬R(a1, a3) ∧ R(a1, a4) R(a1, a1) ∧ R(a2, a2) ∧ ¬R(a3, a3) ∧ R(a4, a4) should we think the more likely? The intuition is that there is no rational reason why R(a1, x) and R(x, x) should, in isolation, differ Hence the above ‘state descriptions’ should get the same probability. Assuming Sx they do!

Jeff Paris Pure Inductive Logic

slide-44
SLIDE 44

Conformity

Consider the two ‘unary relations’ R(a1, x) and R(x, x) of L. Which of the two ‘state descriptions’ R(a1, a1) ∧ R(a1, a2) ∧ ¬R(a1, a3) ∧ R(a1, a4) R(a1, a1) ∧ R(a2, a2) ∧ ¬R(a3, a3) ∧ R(a4, a4) should we think the more likely? The intuition is that there is no rational reason why R(a1, x) and R(x, x) should, in isolation, differ Hence the above ‘state descriptions’ should get the same probability. Assuming Sx they do!

Jeff Paris Pure Inductive Logic

slide-45
SLIDE 45

Inseparability

Suppose that w satisfies Sx and is not equal to w0. Then, given a state description Θ(a1, a2, . . . , an) in which a1, a2 are indistinguishable (i.e. a1 ∼Θ a2) there is a non-zero probability according to w that they will remain forever indistinguishable. BUT the probability according to w that a1, a2 will be forever indistinguishable but be distinguishable from each of a3, a4, a5, . . . is zero

Jeff Paris Pure Inductive Logic

slide-46
SLIDE 46

Inseparability

Suppose that w satisfies Sx and is not equal to w0. Then, given a state description Θ(a1, a2, . . . , an) in which a1, a2 are indistinguishable (i.e. a1 ∼Θ a2) there is a non-zero probability according to w that they will remain forever indistinguishable. BUT the probability according to w that a1, a2 will be forever indistinguishable but be distinguishable from each of a3, a4, a5, . . . is zero

Jeff Paris Pure Inductive Logic

slide-47
SLIDE 47

Inseparability

Suppose that w satisfies Sx and is not equal to w0. Then, given a state description Θ(a1, a2, . . . , an) in which a1, a2 are indistinguishable (i.e. a1 ∼Θ a2) there is a non-zero probability according to w that they will remain forever indistinguishable. BUT the probability according to w that a1, a2 will be forever indistinguishable but be distinguishable from each of a3, a4, a5, . . . is zero

Jeff Paris Pure Inductive Logic

slide-48
SLIDE 48

Inseparability

Suppose that w satisfies Sx and is not equal to w0. Then, given a state description Θ(a1, a2, . . . , an) in which a1, a2 are indistinguishable (i.e. a1 ∼Θ a2) there is a non-zero probability according to w that they will remain forever indistinguishable. BUT the probability according to w that a1, a2 will be forever indistinguishable but be distinguishable from each of a3, a4, a5, . . . is zero

Jeff Paris Pure Inductive Logic

slide-49
SLIDE 49

Carnap & Stegm¨ uller’s Analogieschluss

Suppose that w satisfies Sx and Θ( a) is the state description of L′ ⊂ L satisfied by

  • a. Then according

to w the most probable state description(s) of L satisfied by a have the same spectrum as Θ( a).

Jeff Paris Pure Inductive Logic

slide-50
SLIDE 50

Sx looks the business . . . but . . .

What is the rational justification for Sx ? Restricted to unary languages Sx can be justified by ‘symmetry’ But can Sx be justified by ‘symmetry’ in the polyadic?

Jeff Paris Pure Inductive Logic

slide-51
SLIDE 51

Sx looks the business . . . but . . .

What is the rational justification for Sx ? Restricted to unary languages Sx can be justified by ‘symmetry’ But can Sx be justified by ‘symmetry’ in the polyadic?

Jeff Paris Pure Inductive Logic

slide-52
SLIDE 52

Sx looks the business . . . but . . .

What is the rational justification for Sx ? Restricted to unary languages Sx can be justified by ‘symmetry’ But can Sx be justified by ‘symmetry’ in the polyadic?

Jeff Paris Pure Inductive Logic

slide-53
SLIDE 53

Sx looks the business . . . but . . .

What is the rational justification for Sx ? Restricted to unary languages Sx can be justified by ‘symmetry’ But can Sx be justified by ‘symmetry’ in the polyadic?

Jeff Paris Pure Inductive Logic