About Who is talking to you? Christian SoundFlow founder workflow - - PowerPoint PPT Presentation

www.soundflow.org

About

Who is talking to you?

2

Christian SoundFlow

founder sound designer developer film composer entrepreneur workflow platform shortcuts automation be more creative be more productive

Overview

About me, SoundFlow Challenges with AI + Sound today A case study: From idea to platform, AI as an automation component Takeaways

www.soundflow.org

Challenges with AI + Sound

4

Acquiring data => Cloud solutions favored ML API’s & SDK’s are bundled in cloud solutions Black box algorithms are not disruptive in and of themselves AI needs proper integration into workflows What should the product be?

AI in linear, destructive Black Box Algorithms (noise reduction, dialogue processing)

vs

human/machine interaction NLP, speech recognition/synthesis (Siri, Cortana, Echo)

vs

non-linear, non-destructive metadata processing/automation (SoundFlow)

Coming up with the idea

The question: Why does using computer systems involve huge amounts of manual, repetitive work?

www.soundflow.org

Itch to pitch

8

The Itch

Start with something that’s broken, annoying, stupid, unnecessary.

Experimenting

Play around. Have fun.

Development

More goal-oriented. This could be something.

Product Strategy

SoundFlow

Private alpha

Start using it yourself

www.soundflow.org

Itch to pitch

9

The Itch

Start with something that’s broken, annoying, stupid, unnecessary.

Experimenting

Play around. Have fun.

Development

More goal-oriented. This could be something.

Product Strategy

SoundFlow

Private alpha

Start using it yourself Sound Designer: eyes

• ff screen

Musician: new sounds Origin, Library, Sound Designer, iPad Designer SoundFlow Shortcuts

www.soundflow.org

From itch to product

10

2017 2015 2013

2011

2016 2014 2012

Extending

• techniques. Full

internal product. iPad integration, creative uses, new ideas. Continued use and development. Researching making into a product. Rewrite begins. Danish Sound Day First launch of SoundFlow First implementations Early start

Thin, UI-layer positioned, hackable, pluggable, shareable, metadata consuming, AI-enhanced, user mimicking automation Think Abstract...

www.soundflow.org

User vs Many systems

Users need to manually interact with all the different apps

12

Final Cut Pro X VST plugins Pro Tools Avid MC iZotope RX User

Pros:

Each app is best at what it does

Cons:

Many interfaces to interact with Many manual steps to implement simple actions No automated cross communication Difficult to get an overview

www.soundflow.org

User vs Smart connected apps

Apps talk with each other, but user still needs to perform many manual tasks in different GUIs

13

User

Pros:

Each app is best at what it does The apps talk together

Cons:

Many interfaces to interact with Still many steps to implement simple actions Final Cut Pro X VST plugins Pro Tools Avid MC iZotope RX

www.soundflow.org

User vs Monolith

User is interacting with a giant monolithic software system, but it doesn’t cover everything. Many surprises.

14

Final Cut Pro X VST plugins Pro Tools Avid MC iZotope RX User

Monolithic software

Pros:

One interface (hopefully)

Cons:

Quick obsolescence Slow development One vendor needs to be best at everything Features + corner cases are dropped

www.soundflow.org

Cons:

Only SoundFlow enabled workflows are supported

User vs SoundFlow

User is interacting with systems through SoundFlow. Feels like one app, but they can independently grow.

15

Final Cut Pro X VST plugins Pro Tools Avid MC iZotope RX SoundFlow User

Pros:

Each app is best at what it does The apps talk together Use whatever interface you prefer Only 1 user action per decision Feels like 1 app/vendor

www.soundflow.org

User vs SoundFlow + native

User is interacting with systems through SoundFlow and directly

16

Final Cut Pro X VST plugins Pro Tools Avid MC iZotope RX SoundFlow User

Pros:

Each app is best at what it does The apps talk together Use whatever interface you prefer Only 1 user action per decision Access both to accelerated workflows and direct manipulation of underlying software

Cons:

www.soundflow.org

1 user decision = 1 user interaction

17

Interaction Output Decision Input

www.soundflow.org

All industries: Disruption

Spreading our wings

18

System A System E System C System B System D SoundFlow User / AI

People work differently 1 user decision = 1 user interaction That is only possible with custom tailored, dynamic user interfaces

Drag + drop your own user interface

Build your own hardware interface

www.soundflow.org

AI vs SoundFlow

User is interacting with systems through SoundFlow

21

Final Cut Pro X VST plugins Pro Tools Avid MC iZotope RX SoundFlow User

Pros:

Each app is best at what it does The apps talk together Use whatever interface you prefer Only 1 user action per decision The AI knows what the user knows (eyes+ears) while SF executes the actions (hands)

Cons:

AI

www.soundflow.org

AI Data strategy

How will you acquire and store the data necessary to feed the machine learning algorithms?

22

User Data Metadata Analyzed data Actions taken Manual insights ML Training

SF Cloud

www.soundflow.org

Hackable + pluggable

23

Final Cut Pro X VST plugins Pro Tools Avid MC iZotope RX User AI SoundFlow UI PTX EDL Audio Analysis Keyboard User Macros User Logic MIDI Cloud UI Wizards iPad Files Mouse Algorithms

www.soundflow.org

SoundFlow Platform

24

Final Cut Pro X VST plugins Pro Tools Avid MC iZotope RX User AI SoundFlow UI PTX EDL Audio Analysis Keyboard User Macros User Logic MIDI Cloud Wizards UI iPad Files Mouse Algorithms

Thin, UI-layer positioned, hackable, pluggable, shareable, metadata consuming, AI-enhanced, user mimicking automation

www.soundflow.org

What can we learn from this?

26

• Don’t reinvent the wheel - someone else does this
• better. Make glue
• Have a strategy for acquiring data (MVP product first)
• Insist on cloud to collect data
• Be lazy when you can. Use open source as much as

possible + makes bleeding edge easier.

• Quick iterations
• Choose the right strategy for implementation, right

technology, right data storage, right architecture (both quick prototyping/iteration, and scaling)

• Employ external testers extensively - make others do

the testing for you

• Platform - make others do the work for you
• Get out of the basement (Martin Thorborg)