probabilistic cellular automaton and markov chains
play

Probabilistic Cellular Automaton and Markov Chains Matthias Schulz - PowerPoint PPT Presentation

Probabilistic Cellular Automaton and Markov Chains Matthias Schulz University of Karlsruhe 1 Contents: - Introduction - PCAs with 2 states, M 1 -Neighbourhood - PCAs with k states, M 1 -Neighbourhood - PCAs with 2 states, M m -Neighbourhood -


  1. Probabilistic Cellular Automaton and Markov Chains Matthias Schulz University of Karlsruhe 1

  2. Contents: - Introduction - PCAs with 2 states, M 1 -Neighbourhood - PCAs with k states, M 1 -Neighbourhood - PCAs with 2 states, M m -Neighbourhood - Conclusion 2

  3. Probabilistic Cellular Automaton: - Space R, e.g. Z n (Rings) - Neighbourhood N, e.g. (-1, 0, 1) - Set of states S, e.g. { 0 , 1 } - Local transition rule δ , e.g. δ (012)(0) = 0 . 4 δ (012)(1) = 0 . 2 δ (012)(2) = 0 . 4 In each step, for every cell p in a configuration c = ( c 1 , ..., c n ) the probability to go into state i is δ ( c ( p + N ))( i ) . 3

  4. Markov Chain: - Set of states S - Matrix P of transition probabilities: P ij contains the probability for state i changing to state j . Each Markov Chain induces a directed graph whose nodes are the states; there exists an edge beginning in i and ending in j , iff P ij > 0 . 4

  5. Example: The matrix   0 0 . 5 0 . 5 0 0 1   0 1 0 induces the graph 5

  6. A subset M in S is closed , iff P ij = 0 for i ∈ M, j / ∈ M. A closed subset M in S is irreducible , iff there is no nontrivial closed subset in M: Here the set { B, C } is closed and irreducible. 6

  7. Let M v ⊆ N be the set of all lengths of paths beginning and ending in v ∈ S. v is aperiodic , iff gcd ( M v ) = 1 : There is the path ABCA of length 3 beginning and ending in A, and the path ACA of length 2 beginning and ending in A; since the gcd of 3 and 2 is 1, A is aperiodic. 7

  8. A Markov Chain is irreducible , iff S is irreducible: 8

  9. A Markov Chain is aperiodic , iff each state in S is aperiodic: 9

  10. A Markov Chain is ergodic , iff it is irreducible and aperiodic: 10

  11. Observation: PCAs can be interpreted as Markov Chains. Question: How hard is it determining whether a given PCA is ergodic? 11

  12. - Introduction - PCAs with 2 states, M 1 -Neighbourhood -PCAs with k states, M 1 -Neighbourhood - PCAs with 2 states, M m -Neighbourhood - Conclusion 12

  13. Definitions: A string ( c 1 , ..., c k ) ∈ { 0 , 1 , X } k is a structure , iff - none of the c i equals X or - k ≥ 3 and not all c i are X . A configuration d is an instance of a structure c , if it differs from c only where c i = X , e.g. 101 and 100 are instances of 10X. 13

  14. A transition rule δ is homogenous , iff δ (000)(1) = 1 and δ (111)(0) = 1 . A transition rule δ is structure-invariant , iff - δ is not homogenous and - there exists a structure d = ( d 1 , ..., d k ) , such that each successor of an instance of d is an instance of d (possibly shifted), eg. for each δ satisfying δ (101)(1) = 1 , δ (010)(0) = 1 , the structure 10 is left invariant, since 10 has 01 as successor, which is 10 shifted to the right. 14

  15. A transition rule δ is inhomogenous , iff - δ is neither homogenous nor structure-invariant, and - for odd n the set of inhomogenous configurations is closed. A transition rule is ergodic , iff each PCA with this transition rule and n ≥ 4 is ergodic. 15

  16. Theorem 1: A transition rule is ergodic, iff it is neither homogenous, structure-invariant nor inhomogenous. This can be shown by analysis of 21 different cases. 16

  17. - Introduction - PCAs with 2 states, M 1 -Neighbourhood - PCAs with k states, M 1 -Neighbourhood - PCAs with 2 states, M m -Neighbourhood - Conclusion 17

  18. Theorem 2: The problem to decide whether or not a given PCA with k states is ergodic is PSPACE-complete in ( n + k ) . Theorem 3: The problem to determine for a given transition rule δ whether or not there exists n ∈ N so that the PCA defined by δ and n is ergodic is undecidable . 18

  19. Proof of Theorem 2: The problem is in PSPACE: Irreducibility and aperiodicity can be checked nondeterminitically with algorithms needing polynomial space in ( n + k ) . With Savitch’s Theorem, it follows that there exists a deterministic algorithm needing poly- nomial space in ( n + k ) . 19

  20. The problem is PSPACE-hard: There is a nondeterministic LBA so that it is PSPACE-hard in n to decide whether or not a given word of length n can be accepted by the LBA. Idea: For each n there is a PCA P constructed with O ( n ) states and a length in O ( n ) , such that P is ergodic ⇔ a given word w of length n is accepted by a fixed LBA A . 20

  21. Construction: 0. The length of P shall be odd and ≥ n + 2 . 21

  22. 1. There is a state X which can change into each state and can spread over the PCA; all other states shall consist of several registers: � � � � ... X ... 22

  23. 1. There is a state X which can change into each state and can spread over the PCA; all other states shall consist of several registers: � � � � ... XXX ... 23

  24. 1. There is a state X which can change into each state and can spread over the PCA; all other states shall consist of several registers: � � � � ... XXXXX ... It follows that P is ergodic iff from every possible configuration there is a configuration containing X reachable. 24

  25. 2. Exactly one cell is marked with START, or there is a configuration reachable containing X (this can be achieved for any odd length): � START �� �� � � � ... So if there are configurations from which no configurations containing X can be reached, these contain exactly one START-cell. 25

  26. 3. With a probability > 0, the START-cell sends an INIT-signal to the right, which writes the word START w END into the first register and returns to the START-cell: � START �� �� � � � ... INIT 1 26

  27. 3. With a probability > 0, the START-cell sends an INIT-signal to the right, which writes the word START w END into the first register and returns to the START-cell: � START �� �� � � � w 1 ... INIT 2 27

  28. 3. With a probability > 0, the START-cell sends an INIT-signal to the right, which writes the word START w END into the first register and returns to the START-cell: � START �� w 1 �� � � � w 2 ... INIT 3 28

  29. 3. With a probability > 0, the START-cell sends an INIT-signal to the right, which writes the word START w END into the first register and returns to the START-cell: � START �� w 1 �� w 2 � � � END ... INIT n +2 29

  30. 4. When the INIT-signal reaches again the START-cell, a HEAD-signal is started in the START-cell simulating the head of the LBA A : corresponds to �� w 1 �� w 2 � w n � START � � END � � ... s 0 30

  31. 4. When the INIT -signal reaches again the START-cell, a HEAD-signal is started in the START-cell simulating the head of the LBA A : corresponds to � START �� v 1 �� v 2 � v n � � END � � ... s So from each configuration from which no configuration containing an X is reachable, a configuration containing the word START w END and a HEAD-signal in the START-cell can be reached. 31

  32. 5. If the HEAD-signal goes into an accepting state, the cell containing the signal changes to X: � START �� v 1 �� v 2 � v n � � END � � ... f + 32

  33. 5. If the HEAD-signal goes into an accepting state, the cell containing the signal changes to X: � START �� v 1 � v n � � END � � X ... So if there is a configuration from which no configuration containing an X is reachable, the HEAD-signal cannot go into an accepting state. If there is none, then the only way to reach a configuration containing X from a configuration containing exactly one START-cell and no signals, is by the HEAD-signal going into an accepting state. 33

  34. It follows that there can only be configurations from which no configuration containing X can be reached, iff the HEAD-signal cannot go into an accepting state ⇔ P is ergodic iff w can be accepted by the LBA A , which proves Theorem 2. 34

  35. Proof of Theorem 3: With a similar construction a Turing machine T with input w can be simulated, so that a PCA with odd length m is ergodic iff T stops for input w on a tape of length m − 2 ; therefore it is undecidable whether there exists m such that the PCA with length m and given transition rule is ergodic, which proves Theorem 3. 35

  36. - Introduction - PCAs with 2 states, M 1 -Neighbourhood - PCAs with k states, M 1 -Neighbourhood - PCAs with 2 states, M m -Neighbourhood - Conclusion 36

  37. Simulation of a PCA with k states by a PCA P’ with 3 states: P has states { 0 , ..., k − 1 } , P’ has states { 0 , 1 , 2 } i �→ 20 i 1 { 0 , 1 } k − 2 − i if i < k − 1 , k − 1 �→ 20 k − 1 ; e.g. 20011 and 20010 are both coding the state 2 in P. Section of the configuration each cell has to know: ... 200101 200010 211101... 37

  38. If in P a cell changes with probability p j to j , then the corresponding block shall change with the same probability to a block coding the state j . Let ˜ p i be the probability for the i th cell in the block to go into state 1; if the ˜ p i solve the following equations (and solutions always exist), then P’ shows the wanted behaviour: � j i =1 (1 − ˜ p i ) · ˜ p j +1 = p j for j < k − 1 � k − 1 i =1 (1 − ˜ p i ) = p k − 1 Then P’ simulates P. 38

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend