Cortana / Speech Platform 2 Cortana truly uly person sonal - - PowerPoint PPT Presentation

▶
cortana speech platform
SMART_READER_LITE
LIVE PREVIEW

Cortana / Speech Platform 2 Cortana truly uly person sonal - - PowerPoint PPT Presentation

Mar 25, 2023 396 likes •643 views

Cortana / Speech Platform 2 Cortana truly uly person sonal acros oss s all your r device ces s get t things ngs done. e. Cortana Across your Devices Cortana Usage is Growing In 9 months since Windows 10 launched Over 270 milli

slide-1
SLIDE 1
slide-2
SLIDE 2

Cortana / Speech Platform

2

slide-3
SLIDE 3

Cortana

truly uly person sonal acros

  • ss

s all your r device ces s get t things ngs done. e.

slide-4
SLIDE 4

Cortana Across your Devices

slide-5
SLIDE 5

Cortana Usage is Growing

In 9 months since Windows 10 launched

  • Over 270 milli

lion

  • n active Windows 10 devices
  • Over 5 b

billion ion questions asked of Cortana

  • One millio

ion n voice questions are directed towards Cortana on a daily basis Of these, 15% use the keyword to initiate On any given day, 25% of Cortana PC users use speech

&

Hey Cortana tana

slide-6
SLIDE 6

Cortana Drives Customer Satisfaction

inten ent t to reco commend mmend improve

  • ve

customer tomer satis isfac faction tion increase “re-purchase” intent

slide-7
SLIDE 7

With Windows 10 Anniversary Update

slide-8
SLIDE 8

Nearly 1,000 Apps with Voice Commands

slide-9
SLIDE 9

Cortana functionality for Windows 10 is available in the following languages and countries English-US English-UK Chinese-China German-Germany French-France Italian-Italy Spanish-Spain

Geographies

Japanese-Japan English-India English-Canada English-Australia Portuguese-Brazil French-Canada Spanish-Mexico In plan for Windows 10 Anniversary Update

slide-10
SLIDE 10

Cortana with Voice (CwV) Marketing Assets

Icons only Icons + Titles Titles and descriptions

T echnical Requirements to market Cortana with Voice (CwV)

*The “Cortana with Voice” title, icon, description, and associated assets such as messaging can only be used if all following criteria are met:

  • 1. The device is tested using Microsoft’s “Speech platform tools”
  • 2. The device’s test results meet or exceed the Standard spec

Cortana with Voice Your truly personal digital assistant who helps you get things done, even hands-free - just say “Hey Cortana” to get started.

Cortana with Voice

slide-11
SLIDE 11

Standard vs. Premium Spec

Windows 10 Anniversary Update & Beyond Standard

  • Normal ambient noise level
  • 0.5m
  • Standard experience
  • Cortana with voice (CwV)
  • Normal ambient noise level
  • 0.5m
  • Standard experience
  • Cortana with Voice (CwV)
  • Additional tests for Voice Activation

(optional) Premium

  • More challenging conditions
  • <1m
  • Talk level: 89 dBA
  • Premium experience
  • More challenging conditions
  • 4m
  • Talk level: 99 dBA
  • Far-field experience
  • Additional tests for Voice Activation

*Early draft, subject to change

slide-12
SLIDE 12

Cortana with Voice Testing Scenarios

slide-13
SLIDE 13

Run the OEM Verifier tool and ensure the driver settings aligns with the design

  • Utility - OEMVerificationx86.exe
  • Driver reports these key elements correctly

 Number of microphones  Microphone geometry  Driver mode supported Follow the test guidance to validate Cortana with Voice performance

  • Validate in 3 scenarios: Quite, Ambient Noise (café and pub), Echo

Parse data and ensure the test result are at or above the provided benchmark

  • Utility - OEMScoreUtilityFarAndNearx64.exe
  • Calculate the speech accuracy score & troubleshoot the issues

Cortana with Voice Validation Process

 Audio effects supported  Exposes Audio Pipeline being used  Default microphone gain

slide-14
SLIDE 14

Examples of Test Result

OEM Pipeline Microsoft Pipeline Speech Accuracy Score

slide-15
SLIDE 15

Future Planning for CwV Requirements

*Early draft, subject to change

slide-16
SLIDE 16

Platform Experience

  • Platform providers test voice

activation false accepts (FA) and correct accepts (CA) for every supported locale

  • These two tests are not needed

to be run by OEMs

Release People Scenario Near-field Far-field degrees 50 degrees degrees 50 degrees 2016 Male Quiet (Private Office, Living Room) 90% 90% Medium (Coffee Shop, Kitchen) Music listening in Quiet Female Quiet (Private Office, Living Room) 90% 90% Medium (Coffee Shop, Kitchen) Music listening in Quiet Future Male Quiet (Private Office, Living Room) 92% 92% 90% 90% Music listening in Quiet Medium (Coffee Shop, Kitchen) Music listening in Medium Ambient Female Quiet (Private Office, Living Room) 92% 92% 90% 90% Music listening in Quiet Medium (Coffee Shop, Kitchen) Music listening in Medium Ambient Children (5-12) Quiet (Private Office, Living Room) 92% 92% 90% 90% Music listening in Quiet Medium (Coffee Shop, Kitchen) Music listening in Medium Ambient

slide-17
SLIDE 17

OEM Experience

OEMs test specific devices for good voice activation accuracy on EN-US and JA-JP. These tests will become quality gates beyond 2016. OEMs test specific devices for good speech recognition on EN-US only.

slide-18
SLIDE 18

When the Microsoft far-field processing is used the recommendation is to use the microphone array geometry shown above For 360 degree operation an 8-mic circular array is recommended For 3rd party solutions use their spec recommendations for microphone array and geometry

Recommended Array for Far-Field

slide-19
SLIDE 19

Technical Requirement References

Requirement Detail Reference / Spec Speech Platform test tools Application and content guidance for testing

Microsoft Speech Platform Test Tools http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=59735 Speech Platform Audio Calibration files http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=57500

v1.1 “Standard” benchmark Quiet, Ambient, Echo scores

Speech Platform Input Device Recommendations v1.2 (§2 – Device.SpeechRecognition recommendations) http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=58099 https://msdn.microsoft.com/en-us/library/windows/hardware/dn915051(v=vs.85).aspx

v1.1 Test setup Measurement setup

Speech Platform Input Device Test Setup v1.1 http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=58099 https://msdn.microsoft.com/en-us/library/windows/hardware/dn915051(v=vs.85).aspx

Test setup for accessories Measurement setup

Speech Platform Input Device Recommendations – Accessories Support v1.0 http://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=59861

v2.0pre3 Specs Benchmarks and measurement setup

Speech Platform Input Device Recommendations v2.0pre3 Speech Platform Input Device Test Setup v2.0pre3 https://connect.microsoft.com/site1304/Downloads/DownloadDetails.aspx?DownloadID=60086

slide-20
SLIDE 20
  • Ensure your drivers have the correct settings (mic

geometry, mic gain, number of mics, expose audio pipeline being used)

  • Download and test the latest specs and tools
  • Provide feedback on Speech Platform v2.0pre3 specs

Call to Action

slide-21
SLIDE 21

Online Survey Form http://aka.ms/winhecfeedback Join WinHEC LINE Community @winhec

Download WinHEC presentations here: https://channel9.msdn.com/Blogs/WinHEC * G Gifts s are limit ited.

  • ed. They

y will be offered ed at “a first come, first serve” basis.

slide-22
SLIDE 22

Please provide feedback on this session:

http://aka.ms/winhecfeedback

slide-23
SLIDE 23