Neural Program Synthesis Rishabh Singh, Google Brain Great - PowerPoint PPT Presentation

Sep 13, 2022 •19 likes •1.44k views

Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and Evolutionary Progression Vision Speech Language Deep Learning and Evolutionary Progression Vision Speech Language Programming Deep Learning

Reverse-Recursive Input: root representation from recursive pass
Reverse-Recursive Input: root representation from recursive pass
Reverse-Recursive Input: root representation from recursive pass Output: Global leaf representations.
Reverse-Recursive Input: root representation from recursive pass Output: Global leaf representations.
Reverse-Recursive Input: root representation from recursive pass Output: Global leaf representations.
Cross-Correlation I/O Encoder
Cross-Correlation I/O Encoder
Cross-Correlation I/O Encoder
Synthetic Data Results (< 13 AST)
FlashFill Benchmarks
FlashFill Benchmarks Batching Trees for larger programs
FlashFill Benchmarks Batching Trees for larger programs R3NN for contextual program embeddings
RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli
RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli
RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli
RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli
Multiple I/O Examples
Multiple I/O Examples
Multiple I/O Examples
Extended DSL
92% Generalization Accuracy
Robustness with Noise
Incorrect Generalization

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Neural Program Synthesis with Priority Queue Training Daniel A. Abolafia, Mohammad Norouzi,

Neural Program Synthesis with Priority Queue Training Daniel A. Abolafia, Mohammad Norouzi, Jonathan Shen, Rui Zhao, Quoc V. Le https://arxiv.org/abs/1801.03526 Why Program Synthesis? One of the hard AI reasoning domains A tool for

819 views • 27 slides

Improving Neural Program Synthesis with Inferred Execution Traces Richard Shin 1 Illia Polosukhin

Improving Neural Program Synthesis with Inferred Execution Traces Richard Shin 1 Illia Polosukhin 2 Dawn Song 1 1 UC Berkeley 2 NEAR Protocol Poster: Room 210 & 230 AB #31 Background For program synthesis from input-output examples ,

393 views • 16 slides

Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and

Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and Evolutionary Progression Vision Perceptual Tasks Speech Language Algorithmic Tasks Programming Neural Program Learning M ore Complex Tasks G

3.34k views • 52 slides

Neural Program Synthesis from Diverse Demonstration Videos Sriram Shao-Hua Sun* 1 Hyeonwoo Noh* 2

Neural Program Synthesis from Diverse Demonstration Videos Sriram Shao-Hua Sun* 1 Hyeonwoo Noh* 2 Joseph J. Lim 1 Somasundaram 1 1 University of Southern California 2 Pohang University of Science and Technology *Equal contribution A program is an

977 views • 63 slides

From Program Synthesis to Optimal Program . . . Optimal Program Synthesis Logical Interpretation

Need for Data . . . Program Synthesis Wave Algorithm for . . . Boolean Logic . . . From Program Synthesis to Optimal Program . . . Optimal Program Synthesis Logical Interpretation . . . A Seemingly Natural . . . Counter-Example to . . .

725 views • 24 slides

Synthesis of Ranking Functions and Synthesis of Inductive Invariants and Synthesis of

Synthesis of Ranking Functions and Synthesis of Inductive Invariants and Synthesis of Recurrence Sets via Constraint Solving Andreas Podelski January 17, 2012 1 Program Verification and Constraints Reasoning about program

422 views • 28 slides

Guarantees in in Program Synthesis Qinheping Hu , Jason Breck , John Cyphert , Loris D'Antoni ,

Guarantees in in Program Synthesis Qinheping Hu , Jason Breck , John Cyphert , Loris D'Antoni , Thomas Reps Program Synthesis Specification Solution Program Synthesizer Search space Program Synthesis is Un Unpredicta edictable ble

1.05k views • 41 slides

Parallel and cascaded deep neural networks for text-to-speech synthesis M. Sam Ribeiro, Oliver

Parallel and cascaded deep neural networks for text-to-speech synthesis M. Sam Ribeiro, Oliver Watts, Junichi Yamagishi School Of Informatics The University of Edinburgh m.f.s.ribeiro@sms.ed.ac.uk 14 September 2016 Speech Synthesis Workshop 9

854 views • 36 slides

From Program Verification to Program Synthesis Overview Jaak Ristioja March 30, 2010 1 / 91

From Program Verification to Program Synthesis Overview Jaak Ristioja March 30, 2010 1 / 91 Reference From Program Verification to Program Synthesis. @ POPL10; January 17-23, 2010 Saurabh Srivastava , University of Maryland, College Park

1.21k views • 91 slides

LPCNet: Improving Neural Speech Synthesis Through Linear Prediction Jean-Marc Valin* (Amazon Web

LPCNet: Improving Neural Speech Synthesis Through Linear Prediction Jean-Marc Valin* (Amazon Web Services) Jan Skoglund (Google LLC) May 2019 *work performed while with Mozilla Approaches to Speech Synthesis Old DSP approach

172 views • 13 slides

Conditional Program Generation for Bimodal Program Synthesis Swarat Chaudhuri Rice University

Conditional Program Generation for Bimodal Program Synthesis Swarat Chaudhuri Rice University www.cs.rice.edu/~swarat (Joint work with Chris Jermaine, Vijay Murali, and Letao Qi) Program synthesis [Simon 1963, Summers 1977, Manna-Waldinger

411 views • 22 slides

Recursive Program Synthesis Aws Albarghouthi (UToronto), Sumit Gulwani (MSR), and Zachary

Recursive Program Synthesis Aws Albarghouthi (UToronto), Sumit Gulwani (MSR), and Zachary Kincaid (UToronto) CAV 2013 Saint Petersburg, Russia Program Synthesis Magic Specification Program 2 Program Synthesis Magic Specification

753 views • 74 slides

Syntax-Guided Synthesis Rajeev Alur University of Pennsylvania 1 Program Verification Program

Syntax-Guided Synthesis Rajeev Alur University of Pennsylvania 1 Program Verification Program P Specification S Verifier Proof of correctness or Witness of a bug 2 Classical Program Synthesis Specification S High Level WHAT

1.28k views • 59 slides

Deep Learning over Big Code for Program Analysis and Synthesis Swarat Chaudhuri, Vijay

Deep Learning over Big Code for Program Analysis and Synthesis Swarat Chaudhuri, Vijay Murali, Chris Jermaine Programming is hard Program synthesis, debugging, verification, repair Can we automate these processes? Decades of prior

1.59k views • 143 slides

Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural

Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural networks Interspeech 2019, Graz, Austria Ryan Eloff, Andr e Nortje, Benjamin van Niekerk, Avashna Govender, Leanne Nortje, Arnu Pretorius, Elan

744 views • 38 slides

Adaptive)Concretization)for) Parallel)Program)Synthesis) Jinseong(Jeon 1 ,)Xiaokang)Qiu 2 ,)

Adaptive)Concretization)for) Parallel)Program)Synthesis) Jinseong(Jeon 1 ,)Xiaokang)Qiu 2 ,) Armando)Solar@Lezama 2 ,)and)Jeffrey)S.)Foster 1) ) 1.)University)of)Maryland,)College)Park) 2.)MIT)CSAIL ) Syntax@guided)Synthesis) bit[32]

579 views • 57 slides

Invertebrate Learning Computational Models of Neural Systems Lecture 3.3 David S. Touretzky

Invertebrate Learning Computational Models of Neural Systems Lecture 3.3 David S. Touretzky October, 2007 Eric Kandel Nobel Prize in Physiology or Medicine, 2000 10/10/07 Computational Models of Neural Systems 2 Aplysia Californica

776 views • 55 slides

The influence of forward model conductivities on EEG/MEG source reconstruction Jens Haueisen

The influence of forward model conductivities on EEG/MEG source reconstruction Jens Haueisen Institut fr Biomedizinische Technik und Informatik Technische Universitt Ilmenau Introduction How does volume conduction influence source

686 views • 23 slides

Overview of the NSF-CDI project (Year-3) and Research Progress Ming-Hsiang (Ming) Tsou

Mapping Ideas from Cyberspace to Realspace. Funded by NSF Cyber- Enabled Discovery and Innovation ( CDI ) program. Award # 1028177. (2010-2014) http://mappingideas.sdsu.edu/ Overview of the NSF-CDI project (Year-3) and Research Progress

446 views • 30 slides

THIRD QUARTER 2017 EARNINGS CALL November 21, 2017 Disclosures regarding Forward Looking

Q1 2017 EARNINGS CALL THIRD QUARTER 2017 EARNINGS CALL November 21, 2017 Disclosures regarding Forward Looking Statements & Non-GAAP Financial Measures (pages 13-23) Q3 2017 EARNINGS CALL THIRD QUARTER HIGHLIGHTS Comp Sales +5.7% Gross

769 views • 24 slides

A Blueprint of Standardized and Composable ML Eric Xing and Zhiting Hu Petuum & Carnegie

A Blueprint of Standardized and Composable ML Eric Xing and Zhiting Hu Petuum & Carnegie Mellon 1 The universe of problems ML/AI is trying to solve 2 2 Data and experiences of all kinds Type-2 diabetes is 90% more common than type-1

906 views • 65 slides

2015 Stroke Advances: Case 1 A Chance to Cut is a Chance to. A 75 year old man presents

2/13/2015 2015 Stroke Advances: Case 1 A Chance to Cut is a Chance to. A 75 year old man presents with a 10 minute episode of R hand weakness that has since completely resolved He takes only ASA as an outpatient S. Andrew

805 views • 10 slides

Abduction Abduction is an assumption-based reasoning strategy where H is a set of assumptions

Abduction Abduction is an assumption-based reasoning strategy where H is a set of assumptions about what could be happening in a system F axiomatizes how a system works g to be explained is an observation or a design goal Example: in

647 views • 20 slides

Enumerating coherent configurations of small order Matan Ziv-Av Ben Gurion University of the

Enumerating coherent configurations of small order Matan Ziv-Av Ben Gurion University of the Negev MTAGT, Villanova, June 2-5 2014 Coherent configurations A partition of 2 , M = R 1 , . . . , R r is a coherent configuration if CC1 i

309 views • 20 slides