descriptive complexity linear algebra
play

Descriptive complexity linear algebra of Bjarki Holm Logical - PowerPoint PPT Presentation

Descriptive complexity linear algebra of Bjarki Holm Logical Approaches to Barriers in Computing & Complexity II Isaac Newton Institute Overview Study definability of natural problems in linear algebra and expressiveness


  1. Non-definability result for FPC There is a polynomial-time decidable property of finite graphs that is not definable in FPC. “CFI property” Cai, Fürer and Immerman (1992)

  2. Non-definability result for FPC There is a polynomial-time decidable property of finite graphs that is not definable in FPC. “CFI property” Cai, Fürer and Immerman (1992) Corollary FPC does not capture PTIME on

  3. Non-definability result for FPC There is a polynomial-time decidable property of finite graphs that is not definable in FPC. “CFI property” Cai, Fürer and Immerman (1992) Corollary FPC does not capture PTIME on • graphs of bounded degree

  4. Non-definability result for FPC There is a polynomial-time decidable property of finite graphs that is not definable in FPC. “CFI property” Cai, Fürer and Immerman (1992) Corollary FPC does not capture PTIME on • graphs of bounded degree (not even degree 3)

  5. Non-definability result for FPC There is a polynomial-time decidable property of finite graphs that is not definable in FPC. “CFI property” Cai, Fürer and Immerman (1992) Corollary FPC does not capture PTIME on • graphs of bounded degree (not even degree 3) • graphs of bounded colour-class size

  6. Non-definability result for FPC There is a polynomial-time decidable property of finite graphs that is not definable in FPC. “CFI property” Cai, Fürer and Immerman (1992) Corollary FPC does not capture PTIME on • graphs of bounded degree (not even degree 3) • graphs of bounded colour-class size (not even size 4)

  7. Non-definability result for FPC There is a polynomial-time decidable property of finite graphs that is not definable in FPC. “CFI property” Cai, Fürer and Immerman (1992) Corollary FPC does not capture PTIME on • graphs of bounded degree (not even degree 3) • graphs of bounded colour-class size (not even size 4) Still, the CFI query is hardly a natural graph property...

  8. Non-definability result for FPC There is a polynomial-time decidable property of finite graphs that is not definable in FPC. “CFI property” Cai, Fürer and Immerman (1992) Corollary FPC does not capture PTIME on • graphs of bounded degree (not even degree 3) • graphs of bounded colour-class size (not even size 4) Still, the CFI query is hardly a natural graph property... More recently: See which problems in linear algebra can be expressed in FPC

  9. Descriptive complexity of problems in linear algebra

  10. The usual notion of a matrix — an m -by- n rectangular array of elements A = ( a ij ) 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10

  11. The usual notion of a matrix — an m -by- n rectangular array of elements A = ( a ij ) Recall: Over ordered structures FP (and hence FPC) can define all 1 2 3 4 5 6 7 8 9 10 1 2 polynomial-time properties. 3 4 5 6 7 8 9 10

  12. The usual notion of a matrix — an m -by- n rectangular array of elements A = ( a ij ) Recall: Over ordered structures FP (and hence FPC) can define all 1 2 3 4 5 6 7 8 9 10 1 2 polynomial-time properties. 3 4 5 rows and all PTIME matrix 6 7 columns properties can be 8 9 ordered defined in FP 10

  13. The usual notion of a matrix — an m -by- n rectangular array of elements A = ( a ij ) Recall: Over ordered structures FP (and hence FPC) can define all 1 2 3 4 5 6 7 8 9 10 1 2 polynomial-time properties. 3 4 5 rows and all PTIME matrix 6 7 columns properties can be 8 9 ordered defined in FP 10 Many natural matrix properties invariant under permutation of rows and columns

  14. The usual notion of a matrix — an m -by- n rectangular array of elements A = ( a ij ) Recall: Over ordered structures FP (and hence FPC) can define all 1 2 3 4 5 6 7 8 9 10 1 2 polynomial-time properties. 3 4 5 rows and all PTIME matrix 6 7 columns properties can be 8 9 ordered defined in FP 10 Many natural matrix properties invariant under permutation of rows and columns

  15. The usual notion of a matrix — an m -by- n rectangular array of elements A = ( a ij ) Recall: Over ordered structures FP (and hence FPC) can define all 1 2 3 4 5 6 7 8 9 10 1 2 polynomial-time properties. 3 4 5 rows and all PTIME matrix 6 7 columns properties can be 8 9 ordered defined in FP 10 Many natural matrix properties invariant under permutation of rows and columns

  16. The usual notion of a matrix — an m -by- n rectangular array of elements A = ( a ij ) Recall: Over ordered structures FP (and hence FPC) can define all 1 2 3 4 5 6 7 8 9 10 1 2 polynomial-time properties. 3 4 5 rows and all PTIME matrix 6 7 columns properties can be 8 9 ordered defined in FP 10 Many natural matrix properties invariant under permutation of rows and columns (rank, determinant, etc.)

  17. Unordered matrices I , J — finite and non-empty sets D — a group, a ring or a field

  18. Unordered matrices I , J — finite and non-empty sets D — a group, a ring or a field I A : I ⇥ J ! D J

  19. Unordered matrices I , J — finite and non-empty sets D — a group, a ring or a field I “an I -by- J matrix over D ” A : I ⇥ J ! D J

  20. Unordered systems of linear equations I , J — finite and non-empty sets D — a group, a ring or a field t I = J I J

  21. Unordered systems of linear equations I , J — finite and non-empty sets D — a group, a ring or a field t I = J I J = A x b

  22. Unordered systems of linear equations t I = J I J = A x b

  23. Unordered systems of linear equations As a relational structure over a fixed domain D : t I = J I J = A x b

  24. Unordered systems of linear equations As a relational structure over a fixed domain D : ⇥ ! where and S = ( I, J ; ( A d ) d ∈ D , ( b d ) d ∈ D ) ) A d ✓ I ⇥ J d b d ✓ I t I = J I J = A x b

  25. Unordered systems of linear equations As a relational structure over a fixed domain D : ⇥ ! where and S = ( I, J ; ( A d ) d ∈ D , ( b d ) d ∈ D ) ) A d ✓ I ⇥ J d b d ✓ I A 0 t I = J I J = A x b

  26. Unordered systems of linear equations As a relational structure over a fixed domain D : ⇥ ! where and S = ( I, J ; ( A d ) d ∈ D , ( b d ) d ∈ D ) ) A d ✓ I ⇥ J d b d ✓ I A 0 t 0 0 0 0 0 0 0 0 I 0 0 0 = J I 0 0 0 0 0 0 J = A x b

  27. Unordered systems of linear equations As a relational structure over a fixed domain D : ⇥ ! where and S = ( I, J ; ( A d ) d ∈ D , ( b d ) d ∈ D ) ) A d ✓ I ⇥ J d b d ✓ I A 1 t 0 0 0 0 0 0 0 0 I 0 0 0 = J I 0 0 0 0 0 0 J = A x b

  28. Unordered systems of linear equations As a relational structure over a fixed domain D : ⇥ ! where and S = ( I, J ; ( A d ) d ∈ D , ( b d ) d ∈ D ) ) A d ✓ I ⇥ J d b d ✓ I A 1 t 0 0 1 1 0 1 0 0 1 0 1 1 0 0 I 0 0 0 = J I 1 1 0 1 0 1 1 0 0 1 1 0 0 J = A x b

  29. Unordered systems of linear equations As a relational structure over a fixed domain D : ⇥ ! where and S = ( I, J ; ( A d ) d ∈ D , ( b d ) d ∈ D ) ) A d ✓ I ⇥ J d b d ✓ I A 1 t 0 0 1 1 0 1 0 0 1 0 1 1 0 0 I 0 0 0 = J I 1 1 0 1 0 1 1 0 0 1 1 0 0 J = A x b In this talk: Focus on I = J

  30. FPC — more non-definability results Solvability of systems of linear equations over any fixed finite Abelian group is not definable in FPC. Atserias, Bulatov and Dawar (2007)

  31. FPC — more non-definability results Corollary Solvability of systems of linear equations over any fixed finite field is not definable in FPC. Atserias, Bulatov and Dawar (2007)

  32. FPC — more non-definability results Corollary Solvability of systems of linear equations over any fixed finite field is not definable in FPC. Atserias, Bulatov and Dawar (2007) Recall: A linear system A x = b over a field k is solvable if and only if the matrices A and ( A | b ) have the same rank over k

  33. FPC — more non-definability results Corollary Solvability of systems of linear equations over any fixed finite field is not definable in FPC. Atserias, Bulatov and Dawar (2007) Recall: A linear system A x = b over a field k is solvable if and only if the matrices A and ( A | b ) have the same rank over k Corollary Matrix rank over finite fields is not definable in FPC.

  34. Which matrix properties can be defined in FPC?

  35. Which matrix properties can be defined in FPC? 1. Characteristic polynomial and determinant of a square matrix over Z , Q and any finite field. Dawar, H., Grohe, Laubner (2009)

  36. Which matrix properties can be defined in FPC? 1. Characteristic polynomial and determinant of a square matrix over Z , Q and any finite field. 2. The inverse to any invertible square matrix over Z , Q and any finite field. Dawar, H., Grohe, Laubner (2009)

  37. Which matrix properties can be defined in FPC? 1. Characteristic polynomial and determinant of a square matrix over Z , Q and any finite field. 2. The inverse to any invertible square matrix over Z , Q and any finite field. 3. Rank of a matrix over Q . Dawar, H., Grohe, Laubner (2009)

  38. Which matrix properties can be defined in FPC? 1. Characteristic polynomial and determinant of a square matrix over Z , Q and any finite field. 2. The inverse to any invertible square matrix over Z , Q and any finite field. 3. Rank of a matrix over Q . Dawar, H., Grohe, Laubner (2009) 4. Minimal polynomial of a square matrix over Q and any finite field. H.-Pakusa (2010)

  39. Which matrix properties can be defined in FPC? 1. Characteristic polynomial and determinant of a square matrix over Z , Q and any finite field. 2. The inverse to any invertible square matrix over Z , Q and any finite field. 3. Rank of a matrix over Q . Dawar, H., Grohe, Laubner (2009) 4. Minimal polynomial of a square matrix over Q and any finite field. H.-Pakusa (2010) Fundamental linear-algebraic property over fields that separates FPC from PTIME: rank over finite fields

  40. Which matrix properties can be defined in FPC? 1. Characteristic polynomial and determinant of a square matrix over Z , Q and any finite field. 2. The inverse to any invertible square matrix over Z , Q and any finite field. 3. Rank of a matrix over Q . Dawar, H., Grohe, Laubner (2009) 4. Minimal polynomial of a square matrix over Q and any finite field. H.-Pakusa (2010) Fundamental linear-algebraic property over fields that separates FPC from PTIME: rank over finite fields (Next talk: solvability problems over groups and rings)

  41. Next step: extend fixed-point logic with ability to define matrix rank

  42. Definable matrix relations Recall: View any A in I x I as a matrix over GF(2). ) A ✓ I ⇥ I

  43. Definable matrix relations Recall: View any A in I x I as a matrix over GF(2). ) A ✓ I ⇥ I ϕ ( x, y ) formula graph G = ( V , E )

  44. Definable matrix relations Recall: View any A in I x I as a matrix over GF(2). ) A ✓ I ⇥ I ϕ ( x, y ) formula ) M G ϕ : V graph G = ( V , E ) (over GF(2)) V

  45. Definable matrix relations Recall: View any A in I x I as a matrix over GF(2). ) A ✓ I ⇥ I v u ϕ ( x, y ) formula ) M G ϕ : V graph G = ( V , E ) (over GF(2)) V

  46. Definable matrix relations Recall: View any A in I x I as a matrix over GF(2). ) A ✓ I ⇥ I ( 1 if G | = ϕ [ u, v ] , ( u, v ) 7! 0 otherwise. v u ϕ ( x, y ) formula ) M G ϕ : V graph G = ( V , E ) (over GF(2)) V

  47. Definable matrix relations Recall: View any A in I x I as a matrix over GF(2). ) A ✓ I ⇥ I ( 1 if G | = ϕ [ u, v ] , ( u, v ) 7! 0 otherwise. v u ϕ ( x, y ) formula ) M G ϕ : V graph G = ( V , E ) (over GF(2)) V ϕ = adjacency matrix of G Example: ) M G I ϕ ( x, y ) := E ( x, y )

  48. Definable matrix relations Recall: View any A in I x I as a matrix over GF(2). ) A ✓ I ⇥ I ( 1 if G | = ϕ [ u, v ] , ( u, v ) 7! 0 otherwise. v u ϕ ( x, y ) formula ) M G ϕ : V graph G = ( V , E ) (over GF(2)) V ϕ = adjacency matrix of G Example: ) M G I ϕ ( x, y ) := E ( x, y ) More generally: formalise matrices over GF( p ), p prime

  49. Fixed-point logic with rank operators Variables are typed: G = ( V , E ) N 0 1 2 3 4 5 6 7 ...

  50. Fixed-point logic with rank operators Variables are typed: G = ( V , E ) N 0 1 2 3 4 5 6 7 ... vertex variables: range over the vertices V

  51. Fixed-point logic with rank operators Variables are typed: G = ( V , E ) N 0 1 2 3 4 5 6 7 ... number variables: vertex variables: range range over N over the vertices V

  52. Fixed-point logic with rank operators Variables are typed: G = ( V , E ) N 0 1 2 3 4 5 6 7 ... number variables: vertex variables: range range over N over the vertices V - Bounded quantification over number sort

  53. Fixed-point logic with rank operators Variables are typed: G = ( V , E ) N 0 1 2 3 4 5 6 7 ... number variables: vertex variables: range range over N over the vertices V - Bounded quantification over number sort - Extend FP with rules for rank terms: rk p ( x, y ) . ϕ ( p prime)

  54. Fixed-point logic with rank operators Variables are typed: G = ( V , E ) N 0 1 2 3 4 5 6 7 ... number variables: vertex variables: range range over N over the vertices V - Bounded quantification over number sort - Extend FP with rules for rank terms: rk p ( x, y ) . ϕ ( p prime) ( rk p ( x, y ) . ϕ ) G := rank( M G ϕ ) Semantics: over GF( p )

  55. Fixed-point logic with rank operators Variables are typed: G = ( V , E ) N 0 1 2 3 4 5 6 7 ... number variables: vertex variables: range range over N over the vertices V - Bounded quantification over number sort - Extend FP with rules for rank terms: rk p ( x, y ) . ϕ ( p prime) ( rk p ( x, y ) . ϕ ) G := rank( M G ϕ ) Semantics: over GF( p ) Logics FPR p , FPR and similarly FOR p , FOR

  56. Expressive power of rank logics For any prime p , FPR p can express solvability of linear equations over GF( p ). Dawar, Grohe, H., Laubner (2009)

  57. Expressive power of rank logics For any prime p , FPR p can express solvability of linear equations over GF( p m ) for any m . H. (2010)

  58. Expressive power of rank logics For any prime p , FPR p can express solvability of linear equations over GF( p m ) for any m . H. (2010) t = over GF( p m )

  59. Expressive power of rank logics For any prime p , FPR p can express solvability of linear equations over GF( p m ) for any m . H. (2010) t = over GF( p m ) Represent each element of GF( p m ) as an m -by- m matrix over GF(p)

  60. Expressive power of rank logics For any prime p , FPR p can express solvability of linear equations over GF( p m ) for any m . H. (2010) t t = = over GF( p m ) equivalent system over GF( p ) Represent each element of GF( p m ) as an m -by- m matrix over GF(p)

  61. Expressive power of rank logics For any prime p , FPR p can express solvability of linear equations over GF( p m ) for any m . H. (2010) t t = = over GF( p m ) equivalent system over GF( p ) Represent each element of GF( p m ) as an m -by- m matrix over GF(p) Corollary For any prime p , FPC ⊊ FPR p ⊆ PTIME.

  62. Expressive power of rank logics For any prime p , FPR p can express solvability of linear equations over GF( p m ) for any m . H. (2010) t t = = over GF( p m ) equivalent system over GF( p ) Represent each element of GF( p m ) as an m -by- m matrix over GF(p) (we can simulate counting by expressing rank of diagonal matrices) Corollary For any prime p , FPC ⊊ FPR p ⊆ PTIME.

  63. CFI graphs revisited Non-isomorphic CFI graphs can be distinguished by a sentence of FOR 2 . Dawar, Grohe, H., Laubner (2009)

  64. CFI graphs revisited Non-isomorphic CFI graphs can be distinguished by a sentence of FOR 2 . Dawar, Grohe, H., Laubner (2009) Recall: FPC does not capture PTIME on graphs of bounded colour-class size not even size 4

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend