tweast a simple and effective technique to implement
play

TWEAST: A Simple and Effective Technique to Implement - PowerPoint PPT Presentation

Sep 02, 2023 •20 likes •760 views

TWEAST: A Simple and Effective Technique to Implement Concrete-Syntax AST Rewriting Using Partial Parsing Akim Demaille Roland Levillain Beno t Sigoure EPITA Research and Development Laboratory (LRDE), Paris, France 24th Annual ACM

  1. TWEAST: A Simple and Effective Technique to Implement Concrete-Syntax AST Rewriting Using Partial Parsing Akim Demaille Roland Levillain Benoˆ ıt Sigoure EPITA Research and Development Laboratory (LRDE), Paris, France 24th Annual ACM Symposium on Applied Computing (SAC) Waikiki Beach, Honolulu, Hawaii, USA – March 9 - 11, 2009 A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 1

  2. Intent Context and Scope Implementation of front ends of compilers, interpreters and other language processing tools. Scope restricted to the front end of these tools. Facts Program transformation based on rewriting rules is a useful paradigm for the implementation of the aforementioned tools. Rewriting rules are often expressed using the abstract syntax of the processed language, by manipulating Abstract Syntax Trees (ASTs). . . . . . But concrete syntax is much more legible! Compare ‘ Op (Int (1), Plus, Int (2)) ’ with ‘ 1 + 2 ’. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 2

  3. Intent Context and Scope Implementation of front ends of compilers, interpreters and other language processing tools. Scope restricted to the front end of these tools. Facts Program transformation based on rewriting rules is a useful paradigm for the implementation of the aforementioned tools. Rewriting rules are often expressed using the abstract syntax of the processed language, by manipulating Abstract Syntax Trees (ASTs). . . . . . But concrete syntax is much more legible! Compare ‘ Op (Int (1), Plus, Int (2)) ’ with ‘ 1 + 2 ’. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 2

  4. Intent Context and Scope Implementation of front ends of compilers, interpreters and other language processing tools. Scope restricted to the front end of these tools. Facts Program transformation based on rewriting rules is a useful paradigm for the implementation of the aforementioned tools. Rewriting rules are often expressed using the abstract syntax of the processed language, by manipulating Abstract Syntax Trees (ASTs). . . . . . But concrete syntax is much more legible! Compare ‘ Op (Int (1), Plus, Int (2)) ’ with ‘ 1 + 2 ’. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 2

  5. Intent Context and Scope Implementation of front ends of compilers, interpreters and other language processing tools. Scope restricted to the front end of these tools. Facts Program transformation based on rewriting rules is a useful paradigm for the implementation of the aforementioned tools. Rewriting rules are often expressed using the abstract syntax of the processed language, by manipulating Abstract Syntax Trees (ASTs). . . . . . But concrete syntax is much more legible! Compare ‘ Op (Int (1), Plus, Int (2)) ’ with ‘ 1 + 2 ’. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 2

  6. Intent Context and Scope Implementation of front ends of compilers, interpreters and other language processing tools. Scope restricted to the front end of these tools. Facts Program transformation based on rewriting rules is a useful paradigm for the implementation of the aforementioned tools. Rewriting rules are often expressed using the abstract syntax of the processed language, by manipulating Abstract Syntax Trees (ASTs). . . . . . But concrete syntax is much more legible! Compare ‘ Op (Int (1), Plus, Int (2)) ’ with ‘ 1 + 2 ’. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 2

  7. Intent (cont.) More Facts There are several tools to implement concrete-syntax AST rewriting (ASF+SDF [van den Brand et al., 1995], Stratego/XT [Bravenboer et al., 2006], TXL [Cordy, 2006]). . . . . . but then you have to depend on an extra language/tool/framework. Goal Design a simple and adaptable framework to generate and rewrite ASTs using the concrete syntax of the processed language. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 3

  8. Intent (cont.) More Facts There are several tools to implement concrete-syntax AST rewriting (ASF+SDF [van den Brand et al., 1995], Stratego/XT [Bravenboer et al., 2006], TXL [Cordy, 2006]). . . . . . but then you have to depend on an extra language/tool/framework. Goal Design a simple and adaptable framework to generate and rewrite ASTs using the concrete syntax of the processed language. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 3

  9. Intent (cont.) More Facts There are several tools to implement concrete-syntax AST rewriting (ASF+SDF [van den Brand et al., 1995], Stratego/XT [Bravenboer et al., 2006], TXL [Cordy, 2006]). . . . . . but then you have to depend on an extra language/tool/framework. Goal Design a simple and adaptable framework to generate and rewrite ASTs using the concrete syntax of the processed language. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 3

  10. Intent (cont.) More Facts There are several tools to implement concrete-syntax AST rewriting (ASF+SDF [van den Brand et al., 1995], Stratego/XT [Bravenboer et al., 2006], TXL [Cordy, 2006]). . . . . . but then you have to depend on an extra language/tool/framework. Goal Design a simple and adaptable framework to generate and rewrite ASTs using the concrete syntax of the processed language. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 3

  11. Foreword Examples use C ++ , but the approach is applicable to any general purpose language. No specific tool is required. Illustrations make use of the GNU Bison parser generator [Corbett et al., 2003], but this is not a requirement. Applications: program transformation within a small compiler for a simple language, Tiger [Appel, 1998]. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 4

  12. TWEAST: A Simple and Effective Technique to Implement Concrete-Syntax AST Rewriting Using Partial Parsing Concrete-Syntax Manipulation 1 Examples 2 Implementing TWEASTs 3 Conclusions 4 A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 5

  13. Concrete-Syntax Manipulation Concrete-Syntax Manipulation Concrete-Syntax Manipulation 1 Examples 2 Implementing TWEASTs 3 Conclusions 4 A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 6

  14. Concrete-Syntax Manipulation Front End & Tasks A front end can be decomposed as a sequence of tasks. Tasks communicate by exchanging Abstract Syntax Trees (ASTs). In our Tiger compiler, we found it convenient to order tasks (solid arrows) according to their dependencies (dashed arrows). A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 7

  15. Concrete-Syntax Manipulation Front End & Tasks A front end can be decomposed as a sequence of tasks. Tasks communicate by exchanging Abstract Syntax Trees (ASTs). In our Tiger compiler, we found it convenient to order tasks (solid arrows) according to their dependencies (dashed arrows). Program Parse Bind Type Rename Bounds IR Translate Desugar Inline Checking A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 7

  16. Concrete-Syntax Manipulation Front End & Tasks A front end can be decomposed as a sequence of tasks. Tasks communicate by exchanging Abstract Syntax Trees (ASTs). In our Tiger compiler, we found it convenient to order tasks (solid arrows) according to their dependencies (dashed arrows). Program Parse Bind Type Rename Bounds IR Translate Desugar Inline Checking A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 7

  17. Concrete-Syntax Manipulation Abstract Syntax Manipulation Each task manipulates an AST (traversal, generation, rewriting) Usually done using the abstract notation of the tree. The abstract syntax directly maps a tree to a textual, linear form. op + int int 1 + 2 Op (Int (1), Plus, Int (2)) 1 2 A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 8

  18. Concrete-Syntax Manipulation Abstract Syntax Manipulation Example Parsing a Boolean “and” operator as an if-then-else construct: A & B if A then B <> 0 else 0 → exp : exp "&" exp { $$ = new If( $1 , new Op( $3 , Op :: NotEqual , new Int(0)), new Int(0)); }; ‘ & ’ can be considered syntactic sugar in Tiger. We desugar it as a core language construct. Understandable, yet not very concise nor really scalable. A. Demaille, R. Levillain, B. Sigoure (LRDE) A Simple Technique to Implement Concrete-Syntax AST Rewriting SAC’09 9

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

FUNDATORY EXPERIMENTS MADE RELEVANT: HOW TO IMPLEMENT A SIMPLE BUT EFFECTIVE LEARNING STRATEGY

FUNDATORY EXPERIMENTS MADE RELEVANT: HOW TO IMPLEMENT A SIMPLE BUT EFFECTIVE LEARNING STRATEGY

FUNDATORY EXPERIMENTS MADE RELEVANT: HOW TO IMPLEMENT A SIMPLE BUT EFFECTIVE LEARNING STRATEGY IN THE CHEMISTRY CLASSROOM Brigid Corrigan Mount Sackville Secondary School, Dublin, Ireland The Idea At present the Irish second level

551 views • 38 slides
Q&amp;A 1 19/12/2013 9 Simple Steps To an Effective and (Profitable) Website TWITTER Use tag:

Q&amp;A 1 19/12/2013 9 Simple Steps To an Effective and (Profitable) Website TWITTER Use tag:

19/12/2013 9 Simple Steps to an Effective (and Profitable) Website 9 Simple Steps To an Effective and (Profitable) Website Suzi Dafnis Australian Businesswomen s Network 9 Simple Steps To an Effective and (Profitable) Website Q&amp;A 1

198 views • 15 slides
Welcomes Anglo American plc SAFE, SIMPLE AND EFFECTIVE! Venetia Mine Vision Our Venetia an

Welcomes Anglo American plc SAFE, SIMPLE AND EFFECTIVE! Venetia Mine Vision Our Venetia an

De Beers Venetia Mine Welcomes Anglo American plc SAFE, SIMPLE AND EFFECTIVE! Venetia Mine Vision Our Venetia an efficient and cost-effective diamond operation responsibly securing our prosperity SAFE, SIMPLE AND EFFECTIVE! SAFE, SIMPLE AND

609 views • 23 slides
Binary Tree Iterators After today, you should be able to implement a simple iterator for

Binary Tree Iterators After today, you should be able to implement a simple iterator for

1 Binary Tree Iterators After today, you should be able to implement a simple iterator for trees implement _lazy_ iterators for trees } Exam Thu night: check room! } No class Friday } Still due on Friday: Stacks &amp; Queues

287 views • 13 slides
empower. NDIS made simple and easy for everyone. simple. effective. NDIS Management About Us.

empower. NDIS made simple and easy for everyone. simple. effective. NDIS Management About Us.

empower. NDIS made simple and easy for everyone. simple. effective. NDIS Management About Us. People and their advocates need more assistance with implementing plans. A role more akin to a case manager, who does much of the thinking and

379 views • 14 slides
MQ Day 1 implement simple devices and topologies learn what send is learn about

MQ Day 1 implement simple devices and topologies learn what send is learn about

MQ Day 1 implement simple devices and topologies learn what send is learn about OnData difference between bind and connect shell script to start multiple devices? introduce proxy? /// kind of extended

970 views • 18 slides
Security Management and Engineering Is this product/technique/service secure? Simple Yes/No

Security Management and Engineering Is this product/technique/service secure? Simple Yes/No

Security Management and Engineering Is this product/technique/service secure? Simple Yes/No answers are often wanted, but typically inappropriate. Security of an item depends much on the context in which it is used. Complex

770 views • 57 slides
Portrait of a Graduate Engage, Challenge and Prepare Every Student Implement Effective Support

Portrait of a Graduate Engage, Challenge and Prepare Every Student Implement Effective Support

Portrait of a Graduate Engage, Challenge and Prepare Every Student Implement Effective Support Class Sizes Equity and Course Parity Offerings Current Status of Middle Grades Educator Reading and Collaboration Math Needs Core

603 views • 29 slides
HOW TO IMPLEMENT EFFECTIVE CORRECTIVE ACTION PRESENTED BY: Ronni M. Travers, SPHR, President

HOW TO IMPLEMENT EFFECTIVE CORRECTIVE ACTION PRESENTED BY: Ronni M. Travers, SPHR, President

HOW TO IMPLEMENT EFFECTIVE CORRECTIVE ACTION PRESENTED BY: Ronni M. Travers, SPHR, President Public Sector Human Resource Consultants LLC E-Mail: rtravers@publicsectorhr.org Phone: (518) 399-4512 How Does the Pareto Principle (80/20 Rule)

370 views • 32 slides
RCGC can be more attractive Advantages of RCGC simple to implement Identify garbage as

RCGC can be more attractive Advantages of RCGC simple to implement Identify garbage as

RCGC can be more attractive Advantages of RCGC simple to implement Identify garbage as object dies Immediate reuse of storage Good spatial locality of reference Only objects in pointer reference need to be accessed Does not

249 views • 24 slides
ROF Programme Objectives Develop and implement a new sustainable approach to regulation that

ROF Programme Objectives Develop and implement a new sustainable approach to regulation that

ROF Programme Objectives Develop and implement a new sustainable approach to regulation that leverages business behaviour change to deliver benefits for consumers. Design and implement a regulatory delivery model that ensures an effective

567 views • 14 slides
WHAT IS SIT? Todays most simple and cost-effective self inflating tire system. WHAT IS SIT?

WHAT IS SIT? Todays most simple and cost-effective self inflating tire system. WHAT IS SIT?

WHAT IS SIT? Todays most simple and cost-effective self inflating tire system. WHAT IS SIT? Key principles of SIT design: SIMPLE Tire-integrated feature uses the motion of the vehicle to re- inflate the tire with atmospheric air

373 views • 10 slides
Exercise 1 - Association How would you implement in Java these two simple examples of a normal

Exercise 1 - Association How would you implement in Java these two simple examples of a normal

Exercise 1 - Association How would you implement in Java these two simple examples of a normal association and a composition (I will go around picking some of your work) university students University Student * 1 +name: String +id:

309 views • 10 slides
Establish an Online Presence Paul Huckett Learning Objectives Implement effective

Establish an Online Presence Paul Huckett Learning Objectives Implement effective

Online Teaching Strategies Module 2 Establish an Online Presence Paul Huckett Learning Objectives Implement effective strategies to establish an online presence. Assess tools that can help facilitate effective techniques of

299 views • 14 slides
Effective autocomplete Patrik Ackland The problem Autocomplete today is very simple

Effective autocomplete Patrik Ackland The problem Autocomplete today is very simple

Effective autocomplete Patrik Ackland The problem Autocomplete today is very simple Gives method name based on return type/letters typed Examples Return type Name Problem Works for simple cases of depth 1 for right-hand side.

131 views • 10 slides
Simple but Effective Tree Structures for Dynamic Programming-Based Stereo Matching Michael Bleyer

Simple but Effective Tree Structures for Dynamic Programming-Based Stereo Matching Michael Bleyer

Simple but Effective Tree Structures for Dynamic Programming-Based Stereo Matching Michael Bleyer and Margrit Gelautz Vienna University of Technology Dense Stereo Matching (Left Image) (Right Image) SIMPLE BUT EFFECTIVE TREE STRUCTURES FOR

726 views • 71 slides
Intermediate Representation Abstract syntax tree, control- flow graph, three-address code

Intermediate Representation Abstract syntax tree, control- flow graph, three-address code

Intermediate Representation Abstract syntax tree, control- flow graph, three-address code cs5363 1 Intermediate Code Generation Intermediate language between source and target Multiple machines can be targeted Attaching a

400 views • 19 slides
ASTs AST node classes The parsers output is an abstract syntax tree (AST) Each node in an AST

ASTs AST node classes The parsers output is an abstract syntax tree (AST) Each node in an AST

ASTs AST node classes The parsers output is an abstract syntax tree (AST) Each node in an AST is an instance of an AST class representing the grammatical structure of the parsed input IfStmt , AssignStmt , AddExpr , VarDecl , etc. ASTs

442 views • 3 slides
Syntax-Directed Translation 1 CFGs so Far CFGs for Language Definition The CFGs weve

Syntax-Directed Translation 1 CFGs so Far CFGs for Language Definition The CFGs weve

Syntax-Directed Translation 1 CFGs so Far CFGs for Language Definition The CFGs weve discussed can generate/define languages of valid strings start by building a parse tree and en end with So far, we st some valid string Generally an

655 views • 21 slides
Performing Source-to-Source T ransformations with Clang European LLVM Conference Paris, 2013

Performing Source-to-Source T ransformations with Clang European LLVM Conference Paris, 2013

Center for Information Services and High Performance Computing (ZIH) Performing Source-to-Source T ransformations with Clang European LLVM Conference Paris, 2013 Zellescher Weg 12 Willers-Bau A 105 T el. +49 351 - 463 - 32442 Olaf Krzikalla

575 views • 34 slides
Compiling Techniques Lecture 7: Abstract Syntax Christophe Dubach 3 October 2017 Christophe

Compiling Techniques Lecture 7: Abstract Syntax Christophe Dubach 3 October 2017 Christophe

Syntax Tree Abstract Syntax Tree AST Processing Compiling Techniques Lecture 7: Abstract Syntax Christophe Dubach 3 October 2017 Christophe Dubach Compiling Techniques Syntax Tree Abstract Syntax Tree AST Processing Table of contents 1

642 views • 33 slides
Deep Learning on Code with an Unbounded Vocabulary ML4P, July 2018 Milan Cvitkovic , Badal Singh,

Deep Learning on Code with an Unbounded Vocabulary ML4P, July 2018 Milan Cvitkovic , Badal Singh,

Deep Learning on Code with an Unbounded Vocabulary ML4P, July 2018 Milan Cvitkovic , Badal Singh, Anima Anandkumar In a nutshell If youre familiar with the following three ideas: Abstract Syntax Tree (AST) Graph Neural Network (GNN)

359 views • 24 slides
Structure/Structured/ Projectional Editors CS294-184: Building User-Centered Programming Tools UC

Structure/Structured/ Projectional Editors CS294-184: Building User-Centered Programming Tools UC

Structure/Structured/ Projectional Editors CS294-184: Building User-Centered Programming Tools UC Berkeley Sarah E. Chasins 10/8/20 Reading Reflection Discuss in groups What do you think is the difference between a visual editor and a

518 views • 26 slides
Event Type Polymorphism Rex D. Fernando Robert Dyer Hridesh Rajan Department of Computer

Event Type Polymorphism Rex D. Fernando Robert Dyer Hridesh Rajan Department of Computer

Event Type Polymorphism Rex D. Fernando Robert Dyer Hridesh Rajan Department of Computer Science Iowa State University { fernanre,rdyer,hridesh } @iastate.edu This work was supported in part by NSF grant CCF-10-17334. Overview Motivation

833 views • 50 slides

More recommend