TOWARDS AN OPERATIONAL MODEL OF SCHEDULES IN TENSOR EXPRESSION Yuan - - PowerPoint PPT Presentation

towards an operational model of
SMART_READER_LITE
LIVE PREVIEW

TOWARDS AN OPERATIONAL MODEL OF SCHEDULES IN TENSOR EXPRESSION Yuan - - PowerPoint PPT Presentation

TOWARDS AN OPERATIONAL MODEL OF SCHEDULES IN TENSOR EXPRESSION Yuan Lin and Yongfeng Gu 2019-12-05 Q Question: is this a legal schedule? Q Illegal, but why? TVMError: Check failed: found_attach || stage_attach.size() == 0: Invalid


slide-1
SLIDE 1

Yuan Lin and Yongfeng Gu

TOWARDS AN OPERATIONAL MODEL OF SCHEDULES IN TENSOR EXPRESSION

2019-12-05

slide-2
SLIDE 2

Q

Question: is this a legal schedule?

slide-3
SLIDE 3

Q

Illegal, but why?

TVMError: Check failed: found_attach || stage_attach.size() == 0: Invalid Schedule, cannot find the producer compute(B, 0x2851e60) along the loop nest specified by compute_at of consumer compute(B.local, 0x2b83b00)

slide-4
SLIDE 4

Show the Schedule Tree

slide-5
SLIDE 5

LCA(B, C) LCA(BL, C)

Illegal

Violation of Legality

slide-6
SLIDE 6

LCA(B, C) LCA(BL, C)

Legal

A Possible Fix

slide-7
SLIDE 7

Background

  • Describe schedule primitives and transformations in a more elaborate way
  • Provide guidance to new TE users
  • Help debugging tricky TE programs
  • Provide a framework to discuss bugs (is this a bug or feature?)
  • Ensure conherent development of new features

Motivations

slide-8
SLIDE 8

Dataflow Graph

The Operational Model

IterVar-relation DAG Tensor Expression Schedule Tree

slide-9
SLIDE 9

The Document

slide-10
SLIDE 10

Example pages

slide-11
SLIDE 11
  • We would like to contribute the document to the TVM community.
  • We are also working on a visualization tool, Tensor Expression Debug Display (TEDD).
  • Questions/Survey:
  • Is this model helpful?
  • Is this or similar model well understood?
  • Will you use it for future discussion?
  • Let's work together to
  • improve the model
  • complete the document

Help Needed!

slide-12
SLIDE 12

Thank you