Learning Dynamics with Synchronous, Asynchronous and General - - PowerPoint PPT Presentation

learning dynamics with synchronous asynchronous and
SMART_READER_LITE
LIVE PREVIEW

Learning Dynamics with Synchronous, Asynchronous and General - - PowerPoint PPT Presentation

Learning Dynamics with Synchronous, Asynchronous and General Semantics Tony Ribeiro 1 , Maxime Folschette 2 , Morgan Magnin 1 , Olivier Roux 1 , Katsumi Inoue 3 1. Laboratoire des Sciences du Num erique de Nantes, France 2. Univ Rennes, Inria,


slide-1
SLIDE 1

Learning Dynamics with Synchronous, Asynchronous and General Semantics

Tony Ribeiro1, Maxime Folschette2, Morgan Magnin1, Olivier Roux1, Katsumi Inoue3

  • 1. Laboratoire des Sciences du Num´

erique de Nantes, France

  • 2. Univ Rennes, Inria, CNRS, IRISA, IRSET, F-35000 Rennes, France
  • 3. National Institute of Informatics, Tokyo, Japan

4th September 2018, ILP, Ferarra

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 1 / 33

slide-2
SLIDE 2

Outline

1

Motivations

2

Formalization

3

Learning Process

4

Semantics

5

Evaluation

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 2 / 33

slide-3
SLIDE 3

Motivations

Outline

1

Motivations

2

Formalization

3

Learning Process

4

Semantics

5

Evaluation

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 3 / 33

slide-4
SLIDE 4

Motivations

Research area

Idea: given a set of input/output states of a black-box system, learn its internal mechanics.

Input Output

?

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 4 / 33

slide-5
SLIDE 5

Motivations

Research area

Discrete system: input/output are vectors of same size which contain discrete values.

100 011

?

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 4 / 33

slide-6
SLIDE 6

Motivations

Research area

Dynamic system: input/output are state of the system and output becomes the next input.

Discrete State Discrete State

Dynamic System

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 4 / 33

slide-7
SLIDE 7

Motivations

Research area

Goal: produce an artificial system with the same behavior as the one

  • bserved, i.e. a digital twin.

Digital Twin Real System

00 10 01 11 20 22 12 21 02 00 10 01 11 20 22 12 21 02

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 4 / 33

slide-8
SLIDE 8

Motivations

Research area

Representation: propositional logic programs with annotated atoms encoding multi-valued variables.

Logic Program Real System

00 10 01 11 20 22 12 21 02 00 10 01 11 20 22 12 21 02

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 4 / 33

slide-9
SLIDE 9

Motivations

Research area

Method: learn the dynamics of systems from the observations of some of its state transitions.

?

00 10 01 11 20 22 12 21 02 00 10 01 11 20 22 12 21 02

a(0,T) :- a(2,T-1) a(1,T) :- a(0,T-1), b(0,T-1). a(2,T) :- a(1,T-1) a(2,T) :- a(0,T-1), b(2,T-1). b(0,T) :- a(1,T-1). b(1,T) :- b(0,T-1). b(2,T):- b(2,T-1).

DATA RESULTS

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 4 / 33

slide-10
SLIDE 10

Motivations

Motivation

Data: time series of genes expression levels in a organic cell. Goal: model genes interactions to understand their influences.

000 010

?

Example (Possible Applications)

Bioinformatics: Construct gene regulatory networks. Robotics: Learn action models from robot observations.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 5 / 33

slide-11
SLIDE 11

Motivations

Motivation

Data: time series of genes expression levels in a organic cell. Goal: model genes interactions to understand their influences.

000 010

?

a b c

Example (Possible Applications)

Bioinformatics: Construct gene regulatory networks. Robotics: Learn action models from robot observations.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 5 / 33

slide-12
SLIDE 12

Motivations

Motivation

Data: time series of genes expression levels in a organic cell. Goal: model genes interactions to understand their influences.

100 011

?

a b c

Example (Possible Applications)

Bioinformatics: Construct gene regulatory networks. Robotics: Learn action models from robot observations.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 5 / 33

slide-13
SLIDE 13

Motivations

Motivation

Data: time series of genes expression levels in a organic cell. Goal: model genes interactions to understand their influences.

111 001

?

a b c

Example (Possible Applications)

Bioinformatics: Construct gene regulatory networks. Robotics: Learn action models from robot observations.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 5 / 33

slide-14
SLIDE 14

Motivations

Motivation

Data: observations of environment evolution according to a robot actions. Goal: produce a predictive model of the environment for action planning.

000 010

?

Example (Possible Applications)

Bioinformatics: Construct gene regulatory networks. Robotics: Learn action models from robot observations.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 5 / 33

slide-15
SLIDE 15

Motivations

Semantics

Boolean network transitions differ according to the update semantics used.

a b

f(a) := not b. f(b) := not a. Asynchronous General

00 01 10 11 00 01 10 11

Synchronous

00 01 10 11

Synchronous: all variable are updated Asynchronous: only one variable is updated General: any number of variable can be updated

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 6 / 33

slide-16
SLIDE 16

Motivations

Semantics

Boolean network transitions differ according to the update semantics used.

a b

f(a) := not b. f(b) := not a. Asynchronous General

00 01 10 11 00 01 10 11

Synchronous

00 01 10 11

Synchronous: all variable are updated Asynchronous: only one variable is updated General: any number of variable can be updated

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 6 / 33

slide-17
SLIDE 17

Motivations

What is a semantics?

For those three semantics atleast its about computing the next state by selecting among applicable local rules the ones that will be applied.

000 010

Applicable Rules

Applied Rules

Semantics: what is an applicable rule and what is a valid set of applied rule.

The three semantics differ on the selection but share the same definition of what is an applicable rule.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 7 / 33

slide-18
SLIDE 18

Motivations

What is a semantics?

For those three semantics atleast its about computing the next state by selecting among applicable local rules the ones that will be applied.

000 010

Applicable Rules

Applied Rules

Semantics: what is an applicable rule and what is a valid set of applied rule.

The three semantics differ on the selection but share the same definition of what is an applicable rule.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 7 / 33

slide-19
SLIDE 19

Motivations

Learning algorithm intuition: classification problem

What is an applicable rule?

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 8 / 33

slide-20
SLIDE 20

Motivations

Learning algorithm intuition: classification problem

What is an applicable rule? The conditions so that a variable can take a certain value in next state.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 8 / 33

slide-21
SLIDE 21

Motivations

Learning algorithm intuition: classification problem

What is an applicable rule? The conditions so that a variable can take a certain value in next state.

00 01 00 10 01 01 10 10 00 11 Positive example Negative example

a=0

00 11 01 11 10 11 00 01 10 11

Observations

Positive example Negative example

a=1

00 01 10 11

Equivalent to a classification problem: for each variable value, what is a typical state where the variable can takes this value in the next state ?

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 8 / 33

slide-22
SLIDE 22

Motivations

Learning algorithm intuition: classification problem

What is an applicable rule? The conditions so that a variable can take a certain value in next state.

00 01 00 10 01 01 10 10 00 11 Positive example Negative example

a=0

00 11 01 11 10 11 00 01 10 11

Observations

Positive example Negative example

a=1

00 01 10 11

Equivalent to a classification problem: for each variable value, what is a typical state where the variable can takes this value in the next state ?

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 8 / 33

slide-23
SLIDE 23

Motivations

Learning algorithm intuition: classification problem

What is an applicable rule? The conditions so that a variable can take a certain value in next state.

00 01 00 10 01 01 10 10 00 11 Positive example Negative example

a=0

00 11 01 11 10 11 00 01 10 11

Observations

Positive example Negative example

a=1

00 01 10 11

Equivalent to a classification problem: for each variable value, what is a typical state where the variable can takes this value in the next state ?

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 8 / 33

slide-24
SLIDE 24

Formalization

Outline

1

Motivations

2

Formalization

3

Learning Process

4

Semantics

5

Evaluation

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 9 / 33

slide-25
SLIDE 25

Formalization

Multi-valued Logic (MVL)

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 10 / 33

slide-26
SLIDE 26

Formalization

Multi-valued Logic (MVL)

Definition (Atoms)

Let V = {v1, . . . , vn} be a finite set of n ∈ N variables, and dom : V → N The atoms of MVL are of the form vval where v ∈ V and val ∈ 0; dom(v). The set of such atoms is denoted by AV

dom or simply A.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 10 / 33

slide-27
SLIDE 27

Formalization

Multi-valued Logic (MVL)

Definition (Atoms)

Let V = {v1, . . . , vn} be a finite set of n ∈ N variables, and dom : V → N The atoms of MVL are of the form vval where v ∈ V and val ∈ 0; dom(v). The set of such atoms is denoted by AV

dom or simply A.

Definition (Rules)

A MVL rule R is defined by: R = vval0 ← vval1

1

∧ · · · ∧ vvalm

m

(1) where ∀i ∈ 0; m, vvali

i

∈ A are atoms in MVL.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 10 / 33

slide-28
SLIDE 28

Formalization

Multi-valued Logic (MVL)

Definition (Atoms)

Let V = {v1, . . . , vn} be a finite set of n ∈ N variables, and dom : V → N The atoms of MVL are of the form vval where v ∈ V and val ∈ 0; dom(v). The set of such atoms is denoted by AV

dom or simply A.

Definition (Rules)

A MVL rule R is defined by: R = vval0 ← vval1

1

∧ · · · ∧ vvalm

m

(1) where ∀i ∈ 0; m, vvali

i

∈ A are atoms in MVL. Left-hand side is called the head of R and is denoted h(R) := vval0 .

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 10 / 33

slide-29
SLIDE 29

Formalization

Multi-valued Logic (MVL)

Definition (Atoms)

Let V = {v1, . . . , vn} be a finite set of n ∈ N variables, and dom : V → N The atoms of MVL are of the form vval where v ∈ V and val ∈ 0; dom(v). The set of such atoms is denoted by AV

dom or simply A.

Definition (Rules)

A MVL rule R is defined by: R = vval0 ← vval1

1

∧ · · · ∧ vvalm

m

(1) where ∀i ∈ 0; m, vvali

i

∈ A are atoms in MVL. var(h(R)) := v0 denotes the variable that occurs in h(R).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 10 / 33

slide-30
SLIDE 30

Formalization

Multi-valued Logic (MVL)

Definition (Atoms)

Let V = {v1, . . . , vn} be a finite set of n ∈ N variables, and dom : V → N The atoms of MVL are of the form vval where v ∈ V and val ∈ 0; dom(v). The set of such atoms is denoted by AV

dom or simply A.

Definition (Rules)

A MVL rule R is defined by: R = vval0 ← vval1

1

∧ · · · ∧ vvalm

m

(1) where ∀i ∈ 0; m, vvali

i

∈ A are atoms in MVL. Right-hand side is called the body of R, written b(R) := {vval1

1

, . . . , vvalm

m

}

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 10 / 33

slide-31
SLIDE 31

Formalization

Multi-valued Logic (MVL)

Definition (Atoms)

Let V = {v1, . . . , vn} be a finite set of n ∈ N variables, and dom : V → N The atoms of MVL are of the form vval where v ∈ V and val ∈ 0; dom(v). The set of such atoms is denoted by AV

dom or simply A.

Definition (Rules)

A MVL rule R is defined by: R = vval0 ← vval1

1

∧ · · · ∧ vvalm

m

(1) where ∀i ∈ 0; m, vvali

i

∈ A are atoms in MVL. A multi-valued logic program (MVLP) is a set of MVL rules.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 10 / 33

slide-32
SLIDE 32

Formalization

Rules Properties

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 11 / 33

slide-33
SLIDE 33

Formalization

Rules Properties

Definition (Rule Domination)

Let R1, R2 be two MVL rules. R1 dominates R2, written R2 ≤ R1 if h(R1) = h(R2) and b(R1) ⊆ b(R2).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 11 / 33

slide-34
SLIDE 34

Formalization

Rules Properties

Definition (Rule Domination)

Let R1, R2 be two MVL rules. R1 dominates R2, written R2 ≤ R1 if h(R1) = h(R2) and b(R1) ⊆ b(R2).

Proposition (Double domination is equality)

If R1 ≤ R2 and R2 ≤ R1 then R1 = R2. Rules with the most general bodies dominate the other rules. These are the rules we want since they cover the most general cases.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 11 / 33

slide-35
SLIDE 35

Formalization

Dynamical System Modeling

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 12 / 33

slide-36
SLIDE 36

Formalization

Dynamical System Modeling

Definition (Discrete State)

A discrete state s is a function from V to N, i.e., it associates an integer value to each variable in V.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 12 / 33

slide-37
SLIDE 37

Formalization

Dynamical System Modeling

Definition (Discrete State)

A discrete state s is a function from V to N, i.e., it associates an integer value to each variable in V. It can be equivalently represented by the set of atoms {vs(v) | v ∈ V} and thus we can use classical set operations on it.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 12 / 33

slide-38
SLIDE 38

Formalization

Dynamical System Modeling

Definition (Discrete State)

A discrete state s is a function from V to N, i.e., it associates an integer value to each variable in V. It can be equivalently represented by the set of atoms {vs(v) | v ∈ V} and thus we can use classical set operations on it.

Definition (Transitions)

We write S to denote the set of all discrete states, and a couple of states (s, s′) ∈ S2 is called a transition.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 12 / 33

slide-39
SLIDE 39

Formalization

Dynamical System Modeling

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 13 / 33

slide-40
SLIDE 40

Formalization

Dynamical System Modeling

Definition (Rule-state matching)

Let s ∈ S. The MVL rule R matches s, written R ⊓ s, if b(R) ⊆ s. When matching a state, a rule can be used to realize a transition.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 13 / 33

slide-41
SLIDE 41

Formalization

Dynamical System Modeling

Definition (Rule-state matching)

Let s ∈ S. The MVL rule R matches s, written R ⊓ s, if b(R) ⊆ s. When matching a state, a rule can be used to realize a transition.

Definition (Rule realization)

A rule R realizes the transition (s, s′), written s

R

− → s′, if R ⊓ s, h(R) ∈ s′.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 13 / 33

slide-42
SLIDE 42

Formalization

Dynamical System Modeling

Definition (Rule-state matching)

Let s ∈ S. The MVL rule R matches s, written R ⊓ s, if b(R) ⊆ s. When matching a state, a rule can be used to realize a transition.

Definition (Rule realization)

A rule R realizes the transition (s, s′), written s

R

− → s′, if R ⊓ s, h(R) ∈ s′.

Definition (Program realization)

A MVLP P realizes (s, s′), written s

P

− → s′, if ∀v ∈ V, ∃R ∈ P, var(h(R)) = v ∧ s

R

− → s′. It realizes T ⊆ S2, written

P

֒ − → T, if ∀(s, s′) ∈ T, s

P

− → s′.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 13 / 33

slide-43
SLIDE 43

Formalization

Desired Properties

In the following, for all sets of transitions T ⊆ S2, we denote: fst(T) := {s ∈ S | ∃(s1, s2) ∈ T, s1 = s}.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 14 / 33

slide-44
SLIDE 44

Formalization

Desired Properties

In the following, for all sets of transitions T ⊆ S2, we denote: fst(T) := {s ∈ S | ∃(s1, s2) ∈ T, s1 = s}.

Definition (Conflicts)

A MVL rule R conflicts with a set of transitions T ⊆ S2 when ∃s ∈ fst(T),

  • R ⊓ s ∧ ∀(s, s′) ∈ T, h(R) /

∈ s′ .

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 14 / 33

slide-45
SLIDE 45

Formalization

Desired Properties

In the following, for all sets of transitions T ⊆ S2, we denote: fst(T) := {s ∈ S | ∃(s1, s2) ∈ T, s1 = s}.

Definition (Conflicts)

A MVL rule R conflicts with a set of transitions T ⊆ S2 when ∃s ∈ fst(T),

  • R ⊓ s ∧ ∀(s, s′) ∈ T, h(R) /

∈ s′ .

Definition (Concurrent rules)

Two MVL rules R and R′ are concurrent when R ⊓ R′ ∧ var(h(R))=var(h(R′)) ∧ h(R)=h(R′).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 14 / 33

slide-46
SLIDE 46

Formalization

Definition (Complete program)

A MVLP P is complete if ∀s ∈ S, ∀v ∈ V, ∃R ∈ P, R ⊓s ∧var(h(R)) = v.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 15 / 33

slide-47
SLIDE 47

Formalization

Definition (Complete program)

A MVLP P is complete if ∀s ∈ S, ∀v ∈ V, ∃R ∈ P, R ⊓s ∧var(h(R)) = v. A complete program realize atleast one transition for each state s ∈ S.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 15 / 33

slide-48
SLIDE 48

Formalization

Definition (Complete program)

A MVLP P is complete if ∀s ∈ S, ∀v ∈ V, ∃R ∈ P, R ⊓s ∧var(h(R)) = v. A complete program realize atleast one transition for each state s ∈ S.

Definition (Consistent program)

A MVLP P is consistent with a set of transitions T if P does not contains any rule R conflicting with T.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 15 / 33

slide-49
SLIDE 49

Formalization

Definition (Complete program)

A MVLP P is complete if ∀s ∈ S, ∀v ∈ V, ∃R ∈ P, R ⊓s ∧var(h(R)) = v. A complete program realize atleast one transition for each state s ∈ S.

Definition (Consistent program)

A MVLP P is consistent with a set of transitions T if P does not contains any rule R conflicting with T. Let s ∈ fst(T), a program consistent with T will only realize the transitions (s, s′) ∈ T.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 15 / 33

slide-50
SLIDE 50

Formalization

Optimal MVLP

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 16 / 33

slide-51
SLIDE 51

Formalization

Optimal MVLP

Definition (Suitable program)

Let T ⊆ S2. A MVLP P is suitable for T when: P is consistent with T, Cover no negative example P realizes T, Cover all positive example P is complete Cover all state space ∀R not conflicting with T, ∃R′ ∈ P s.t. R ≤ R′. Cover all hypotheses

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 16 / 33

slide-52
SLIDE 52

Formalization

Optimal MVLP

Definition (Suitable program)

Let T ⊆ S2. A MVLP P is suitable for T when: P is consistent with T, Cover no negative example P realizes T, Cover all positive example P is complete Cover all state space ∀R not conflicting with T, ∃R′ ∈ P s.t. R ≤ R′. Cover all hypotheses

Definition (Optimal program)

If in addition, ∀R ∈ P, all the rules R′ belonging to a MVLP suitable for T are such that R ≤ R′ implies R′ ≤ R then P is called optimal. An optimal program is the set of all rules that are not dominated by any consistent rules. Contains all minimal hypotheses

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 16 / 33

slide-53
SLIDE 53

Formalization

Optimal MVLP

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 17 / 33

slide-54
SLIDE 54

Formalization

Optimal MVLP

Proposition

Let T ⊆ S2. The MVLP optimal for T is unique and denoted PO(T).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 17 / 33

slide-55
SLIDE 55

Formalization

Optimal MVLP

Proposition

Let T ⊆ S2. The MVLP optimal for T is unique and denoted PO(T). Troll mode on: does it works if it is the empty set? :p

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 17 / 33

slide-56
SLIDE 56

Formalization

Optimal MVLP

Proposition

Let T ⊆ S2. The MVLP optimal for T is unique and denoted PO(T). Troll mode on: does it works if it is the empty set? :p

Proposition

PO(∅) = {vval ← ∅ | vval ∈ A}.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 17 / 33

slide-57
SLIDE 57

Formalization

Optimal MVLP

Proposition

Let T ⊆ S2. The MVLP optimal for T is unique and denoted PO(T). Troll mode on: does it works if it is the empty set? :p

Proposition

PO(∅) = {vval ← ∅ | vval ∈ A}. Yeah ! And this property is the starting point of the learning algorithm.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 17 / 33

slide-58
SLIDE 58

Formalization

Optimal MVLP

Proposition

Let T ⊆ S2. The MVLP optimal for T is unique and denoted PO(T). Troll mode on: does it works if it is the empty set? :p

Proposition

PO(∅) = {vval ← ∅ | vval ∈ A}. Yeah ! And this property is the starting point of the learning algorithm.

Proposition

Let T ⊆ S2. If P is a MVLP suitable for T, then PO(T) = {R ∈ P | ∀R′ ∈ P, R ≤ R′ = ⇒ R′ ≤ R}

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 17 / 33

slide-59
SLIDE 59

Formalization

Optimal MVLP

Proposition

Let T ⊆ S2. The MVLP optimal for T is unique and denoted PO(T). Troll mode on: does it works if it is the empty set? :p

Proposition

PO(∅) = {vval ← ∅ | vval ∈ A}. Yeah ! And this property is the starting point of the learning algorithm.

Proposition

Let T ⊆ S2. If P is a MVLP suitable for T, then PO(T) = {R ∈ P | ∀R′ ∈ P, R ≤ R′ = ⇒ R′ ≤ R} We can obtain the optimal program from any suitable program by simply removing the dominated rules.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 17 / 33

slide-60
SLIDE 60

Learning Process

Outline

1

Motivations

2

Formalization

3

Learning Process

4

Semantics

5

Evaluation

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 18 / 33

slide-61
SLIDE 61

Learning Process

Learning Process

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 19 / 33

slide-62
SLIDE 62

Learning Process

Learning Process

How to make a minimal modifications of a MVLP in order to be suitable with a new set of transitions?

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 19 / 33

slide-63
SLIDE 63

Learning Process

Learning Process

How to make a minimal modifications of a MVLP in order to be suitable with a new set of transitions?

Definition (Rule least specialization)

Let R be a MVL rule and s ∈ S such that R ⊓ s. The least specialization

  • f R by s is:

Lspe(R, s) := {h(R) ← b(R) ∪ {vval} | vval ∈ A ∧ vval ∈ s ∧ ∀val′ ∈ N, vval′ ∈ b(R)}.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 19 / 33

slide-64
SLIDE 64

Learning Process

Learning Process

How to make a minimal modifications of a MVLP in order to be suitable with a new set of transitions?

Definition (Rule least specialization)

Let R be a MVL rule and s ∈ S such that R ⊓ s. The least specialization

  • f R by s is:

Lspe(R, s) := {h(R) ← b(R) ∪ {vval} | vval ∈ A ∧ vval ∈ s ∧ ∀val′ ∈ N, vval′ ∈ b(R)}.

Thus, a MVLP can be revised to only realizes given transitions from s.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 19 / 33

slide-65
SLIDE 65

Learning Process

Learning Process

How to make a minimal modifications of a MVLP in order to be suitable with a new set of transitions?

Definition (Rule least specialization)

Let R be a MVL rule and s ∈ S such that R ⊓ s. The least specialization

  • f R by s is:

Lspe(R, s) := {h(R) ← b(R) ∪ {vval} | vval ∈ A ∧ vval ∈ s ∧ ∀val′ ∈ N, vval′ ∈ b(R)}.

Thus, a MVLP can be revised to only realizes given transitions from s.

Definition (Program least revision)

Let P be a MVLP, s ∈ S and T ⊆ S2 such that fst(T) = {s}. Let RP := {R ∈ P | R conflicts with T}. The least revision of P by T is Lrev(P, T) := (P \ RP) ∪

R∈RP

Lspe(R, s).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 19 / 33

slide-66
SLIDE 66

Learning Process

Learning Process

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 20 / 33

slide-67
SLIDE 67

Learning Process

Learning Process

Guess what? Least revision can conserves suitability :)

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 20 / 33

slide-68
SLIDE 68

Learning Process

Learning Process

Guess what? Least revision can conserves suitability :)

Theorem

Let s ∈ S and T, T ′ ⊆ S2 such that |fst(T ′)| = 1 ∧ fst(T) ∩ fst(T ′) = ∅. Lrev(PO(T), T ′) is a MVLP suitable for T ∪ T ′.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 20 / 33

slide-69
SLIDE 69

Learning Process

Learning Process

Guess what? Least revision can conserves suitability :)

Theorem

Let s ∈ S and T, T ′ ⊆ S2 such that |fst(T ′)| = 1 ∧ fst(T) ∩ fst(T ′) = ∅. Lrev(PO(T), T ′) is a MVLP suitable for T ∪ T ′. In association with previous results it gives a method to iteratively compute PO(T) for any T ⊆ S2, starting from PO(∅).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 20 / 33

slide-70
SLIDE 70

Learning Process

GULA: General Usage LFIT Algorithm

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 21 / 33

slide-71
SLIDE 71

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 21 / 33

slide-72
SLIDE 72

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 21 / 33

slide-73
SLIDE 73

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′}

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 21 / 33

slide-74
SLIDE 74

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′}

00 01 00 10 01 01 10 10 00 11 Positive example Negative example

a=0

00 11 01 11 10 11 00 01 10 11

Observations

Positive example Negative example

a=1

00 01 10 11

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 21 / 33

slide-75
SLIDE 75

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′}

00 01 00 10 01 01 10 10 00 11 Positive example Negative example

a=0

00 11 01 11 10 11 00 01 10 11

Observations

Positive example Negative example

a=1

00 01 10 11

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 21 / 33

slide-76
SLIDE 76

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅}

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-77
SLIDE 77

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅} For each state s ∈ Negvval

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-78
SLIDE 78

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅} For each state s ∈ Negvval

◮ Extract each rule R of Pvval that matches s:

Mvval := {R ∈ P | b(R) ⊆ s}, Pvval := Pvval \ Mvval.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-79
SLIDE 79

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅} For each state s ∈ Negvval

◮ Extract each rule R of Pvval that matches s:

Mvval := {R ∈ P | b(R) ⊆ s}, Pvval := Pvval \ Mvval.

◮ For each rule R ∈ Mvval Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-80
SLIDE 80

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅} For each state s ∈ Negvval

◮ Extract each rule R of Pvval that matches s:

Mvval := {R ∈ P | b(R) ⊆ s}, Pvval := Pvval \ Mvval.

◮ For each rule R ∈ Mvval ⋆ Compute its least specialization P′ = Lspe(R, s). Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-81
SLIDE 81

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅} For each state s ∈ Negvval

◮ Extract each rule R of Pvval that matches s:

Mvval := {R ∈ P | b(R) ⊆ s}, Pvval := Pvval \ Mvval.

◮ For each rule R ∈ Mvval ⋆ Compute its least specialization P′ = Lspe(R, s). ⋆ Remove all the rules in P′ dominated by a rule in Pvval . Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-82
SLIDE 82

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅} For each state s ∈ Negvval

◮ Extract each rule R of Pvval that matches s:

Mvval := {R ∈ P | b(R) ⊆ s}, Pvval := Pvval \ Mvval.

◮ For each rule R ∈ Mvval ⋆ Compute its least specialization P′ = Lspe(R, s). ⋆ Remove all the rules in P′ dominated by a rule in Pvval . ⋆ Remove all the rules in Pvval dominated by a rule in P′. Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-83
SLIDE 83

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅} For each state s ∈ Negvval

◮ Extract each rule R of Pvval that matches s:

Mvval := {R ∈ P | b(R) ⊆ s}, Pvval := Pvval \ Mvval.

◮ For each rule R ∈ Mvval ⋆ Compute its least specialization P′ = Lspe(R, s). ⋆ Remove all the rules in P′ dominated by a rule in Pvval . ⋆ Remove all the rules in Pvval dominated by a rule in P′. ⋆ Add all remaining rules in P′ to Pvval . Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-84
SLIDE 84

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅} For each state s ∈ Negvval

◮ Extract each rule R of Pvval that matches s:

Mvval := {R ∈ P | b(R) ⊆ s}, Pvval := Pvval \ Mvval.

◮ For each rule R ∈ Mvval ⋆ Compute its least specialization P′ = Lspe(R, s). ⋆ Remove all the rules in P′ dominated by a rule in Pvval . ⋆ Remove all the rules in Pvval dominated by a rule in P′. ⋆ Add all remaining rules in P′ to Pvval .

P := P ∪ Pvval

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-85
SLIDE 85

Learning Process

GULA: General Usage LFIT Algorithm

GULA: INPUT: a set of atoms A and a set of transitions T ⊆ S2. For each atom vval ∈ A Extract all states from which no transition to vval exist: Negvval := {s | ∄(s, s′) ∈ T, vval ∈ s′} Initialize Pvval := {vval ← ∅} For each state s ∈ Negvval

◮ Extract each rule R of Pvval that matches s:

Mvval := {R ∈ P | b(R) ⊆ s}, Pvval := Pvval \ Mvval.

◮ For each rule R ∈ Mvval ⋆ Compute its least specialization P′ = Lspe(R, s). ⋆ Remove all the rules in P′ dominated by a rule in Pvval . ⋆ Remove all the rules in Pvval dominated by a rule in P′. ⋆ Add all remaining rules in P′ to Pvval .

P := P ∪ Pvval OUTPUT: PO(T) := P.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 22 / 33

slide-86
SLIDE 86

Semantics

Outline

1

Motivations

2

Formalization

3

Learning Process

4

Semantics

5

Evaluation

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 23 / 33

slide-87
SLIDE 87

Semantics

Where is the semantics gone?

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 24 / 33

slide-88
SLIDE 88

Semantics

Where is the semantics gone?

The formalization of MVLP is independant of the semantics that produced its transitions.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 24 / 33

slide-89
SLIDE 89

Semantics

Where is the semantics gone?

The formalization of MVLP is independant of the semantics that produced its transitions.

Definition (Semantics)

Let AV

dom be a set of atoms and S the corresponding set of states. A

semantics (on AV

dom) is a function that associates, to each complete

MVLP P, a set of transitions T ⊆ S2 so that: fst(T) = S. Equivalently, a semantics can be seen as a function of

  • c-MVLP → (S → ℘(S) \ ∅)
  • where c-MVLP is the set of complete MVLPs and ℘ is the power set
  • perator.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 24 / 33

slide-90
SLIDE 90

Semantics

Definition (Synchronous semantics)

The synchronous semantics Tsyn is defined by: Tsyn : P → {(s, s′) ∈ S2 | s′ ⊆ {h(R) ∈ A | R ∈ P, R ⊓ s}}

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 25 / 33

slide-91
SLIDE 91

Semantics

Definition (Synchronous semantics)

The synchronous semantics Tsyn is defined by: Tsyn : P → {(s, s′) ∈ S2 | s′ ⊆ {h(R) ∈ A | R ∈ P, R ⊓ s}}

Definition (Asynchronous semantics)

The asynchronous semantics Tasyn is defined by: Tasyn : P → {(s, s\ \{h(R)}) ∈ S2 | R ∈ P ∧ R ⊓ s ∧ h(R) / ∈ s} ∪ {(s, s) ∈ S2 | ∀R ∈ P, R ⊓ s = ⇒ h(R) ∈ s}.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 25 / 33

slide-92
SLIDE 92

Semantics

Definition (Synchronous semantics)

The synchronous semantics Tsyn is defined by: Tsyn : P → {(s, s′) ∈ S2 | s′ ⊆ {h(R) ∈ A | R ∈ P, R ⊓ s}}

Definition (Asynchronous semantics)

The asynchronous semantics Tasyn is defined by: Tasyn : P → {(s, s\ \{h(R)}) ∈ S2 | R ∈ P ∧ R ⊓ s ∧ h(R) / ∈ s} ∪ {(s, s) ∈ S2 | ∀R ∈ P, R ⊓ s = ⇒ h(R) ∈ s}.

Definition (General semantics)

The general semantics Tgen is defined by: Tgen : P → {(s, s\ \r) ∈ S2 | r ⊆ {h(R) ∈ A | R ∈ P ∧ R ⊓ s} ∧ ∀vval1

1

, vval2

2

∈ r, v1 = v2 = ⇒ val1 = val2}.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 25 / 33

slide-93
SLIDE 93

Semantics

Definition (Synchronous semantics)

The synchronous semantics Tsyn is defined by: Tsyn : P → {(s, s′) ∈ S2 | s′ ⊆ {h(R) ∈ A | R ∈ P, R ⊓ s}}

Definition (Asynchronous semantics)

The asynchronous semantics Tasyn is defined by: Tasyn : P → {(s, s\ \{h(R)}) ∈ S2 | R ∈ P ∧ R ⊓ s ∧ h(R) / ∈ s} ∪ {(s, s) ∈ S2 | ∀R ∈ P, R ⊓ s = ⇒ h(R) ∈ s}.

Definition (General semantics)

The general semantics Tgen is defined by: Tgen : P → {(s, s\ \r) ∈ S2 | r ⊆ {h(R) ∈ A | R ∈ P ∧ R ⊓ s} ∧ ∀vval1

1

, vval2

2

∈ r, v1 = v2 = ⇒ val1 = val2}.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 25 / 33

slide-94
SLIDE 94

Semantics

Semantic free modeling

Finally, we can state that the definitions and method developed in the previous section are independent of those three semantics.

Theorem (Semantics-free correctness)

Let P be a MVLP such that P is complete. Tsyn(P) = Tsyn(PO(Tsyn(P))), Tasyn(P) = Tasyn(PO(Tasyn(P))), Tgen(P) = Tgen(PO(Tgen(P))).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 26 / 33

slide-95
SLIDE 95

Semantics

Semantic free modeling

Finally, we can state that the definitions and method developed in the previous section are independent of those three semantics.

Theorem (Semantics-free correctness)

Let P be a MVLP such that P is complete. Tsyn(P) = Tsyn(PO(Tsyn(P))), Tasyn(P) = Tasyn(PO(Tasyn(P))), Tgen(P) = Tgen(PO(Tgen(P))). Whatever the semantic which produced T, given the optimal MVLP of T we can reproduce exactly T with the same semantic.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 26 / 33

slide-96
SLIDE 96

Semantics

GULA: General Usage LFIT Algorithm

And GULA can learn such an optimal MVLP from T.

Theorem (GULA Termination, soundness, completeness, optimality)

Let T ⊆ S2. The call GULA(A, T) terminates and GULA(A, T) = PO(T).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 27 / 33

slide-97
SLIDE 97

Semantics

GULA: General Usage LFIT Algorithm

And GULA can learn such an optimal MVLP from T.

Theorem (GULA Termination, soundness, completeness, optimality)

Let T ⊆ S2. The call GULA(A, T) terminates and GULA(A, T) = PO(T). Making the algorithm semantic-free atleast for those three semantics.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 27 / 33

slide-98
SLIDE 98

Semantics

GULA: General Usage LFIT Algorithm

And GULA can learn such an optimal MVLP from T.

Theorem (GULA Termination, soundness, completeness, optimality)

Let T ⊆ S2. The call GULA(A, T) terminates and GULA(A, T) = PO(T). Making the algorithm semantic-free atleast for those three semantics.

Theorem (Semantic-freeness)

Let P be a MVLP such that P is complete. GULA(A, Tsyn(P)) = PO(Tsyn(P)) GULA(A, Tasyn(P)) = PO(Tasyn(P)) GULA(A, Tgen(P)) = PO(Tgen(P))

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 27 / 33

slide-99
SLIDE 99

Semantics

GULA: General Usage LFIT Algorithm

And GULA can learn such an optimal MVLP from T.

Theorem (GULA Termination, soundness, completeness, optimality)

Let T ⊆ S2. The call GULA(A, T) terminates and GULA(A, T) = PO(T). Making the algorithm semantic-free atleast for those three semantics.

Theorem (Semantic-freeness)

Let P be a MVLP such that P is complete. GULA(A, Tsyn(P)) = PO(Tsyn(P)) GULA(A, Tasyn(P)) = PO(Tasyn(P)) GULA(A, Tgen(P)) = PO(Tgen(P)) Victory! In theory, but how does it scale in practice?

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 27 / 33

slide-100
SLIDE 100

Evaluation

Outline

1

Motivations

2

Formalization

3

Learning Process

4

Semantics

5

Evaluation

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 28 / 33

slide-101
SLIDE 101

Evaluation

Evaluation

Theorem (GULA Complexity)

Let T ⊆ S2 be a set of transitions, n := |V| be the number of variables of the system and d := max(dom(V)) be the maximal number of values of its

  • variables. The worst-case time complexity of GULA when learning from T

belongs to O(|T|2 + 2n3d2n+1 + 2n2dn) and its worst-case memory use belongs to O(d2n + 2dn + ndn+2).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 29 / 33

slide-102
SLIDE 102

Evaluation

Evaluation

1 2 3 4 5 6 7 8 0,01 0,1 1 10 100 1000 10000 Synchronous Asynchronous General Number of Variables Run time in seconds 2 3 4 5 6 7 8 9 10 11 12 13 14 0,01 0,1 1 10 100 1000 10000 Synchronous Asynchronous General Number of variables values Run time in seconds 5000 10000 15000 20000 25000 30000 35000 40000 45000 500 1000 1500 2000 2500 3000 3500 Synchronous Asynchronous General Number of transitions Run time in seconds

Evaluation of GULA’s scalability w.r.t. number of variables (top left), number of variables values (top right) and number of input transitions (bottom).

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 30 / 33

slide-103
SLIDE 103

Evaluation

Evaluation

Semantics Mammalian (10) Fission (10) Budding (12) Arabidopsis (15) Synchronous 1.84s / 1, 024 1.55s / 1, 024 34.48s / 4, 096 2, 066s / 32, 768 Asynchronous 19.88s / 4, 273 19.18s / 4, 217 523s / 19, 876 T.O. / 213, 127 General 928s / 34, 487 1, 220s / 29, 753 T.O. / 261, 366 T.O. / > 500, 000

Run time of GULA (run time in seconds / number of transitions as input) for Boolean network benchmarks up to 15 nodes for the three semantics.

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 31 / 33

slide-104
SLIDE 104

Evaluation

Conclusion

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-105
SLIDE 105

Evaluation

Conclusion

Previous works

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-106
SLIDE 106

Evaluation

Conclusion

Previous works Synchronous deterministic

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-107
SLIDE 107

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-108
SLIDE 108

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality)

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-109
SLIDE 109

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-110
SLIDE 110

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems New contribution

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-111
SLIDE 111

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems New contribution Synchronous non-deterministic

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-112
SLIDE 112

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems New contribution Synchronous non-deterministic Asynchronous

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-113
SLIDE 113

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems New contribution Synchronous non-deterministic Asynchronous generalized

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-114
SLIDE 114

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems New contribution Synchronous non-deterministic Asynchronous generalized Ongoing

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-115
SLIDE 115

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems New contribution Synchronous non-deterministic Asynchronous generalized Ongoing Improve implementation + approximation

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-116
SLIDE 116

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems New contribution Synchronous non-deterministic Asynchronous generalized Ongoing Improve implementation + approximation Apply to learn construction network

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-117
SLIDE 117

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems New contribution Synchronous non-deterministic Asynchronous generalized Ongoing Improve implementation + approximation Apply to learn construction network Interface with MetaGol for learning semantics too

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-118
SLIDE 118

Evaluation

Conclusion

Previous works Synchronous deterministic Markov(k) systems Synchronous non-deterministic (no minimality) continuous valued systems New contribution Synchronous non-deterministic Asynchronous generalized Ongoing Improve implementation + approximation Apply to learn construction network Interface with MetaGol for learning semantics too One algorithm to learn them all

Ribeiro et al (LS2N, IRISA, NII) GULA: semantic free dynamics learning 4th September 2018, ILP 32 / 33

slide-119
SLIDE 119

000 111 222 100 010 001 110 101 220 202 333 300 003 330 033 311 131 113 331 133 313 322 232 223 312 132 321 123 013 012 102 201 021 120 210 032 320 310