Multimedia Communications @CS.NCTU Lecture 15: Wireless Streaming - - PowerPoint PPT Presentation

multimedia communications
SMART_READER_LITE
LIVE PREVIEW

Multimedia Communications @CS.NCTU Lecture 15: Wireless Streaming - - PowerPoint PPT Presentation

Multimedia Communications @CS.NCTU Lecture 15: Wireless Streaming Instructor: Kate Ching-Ju Lin ( ) 1 Unequal Protection Wireless channels are noisy Channel coding is required to reduce the number of errors Modulation


slide-1
SLIDE 1

Lecture 15: Wireless Streaming

Instructor: Kate Ching-Ju Lin (林靖茹)

1

Multimedia Communications

@CS.NCTU

slide-2
SLIDE 2

Unequal Protection

  • Wireless channels are noisy
  • Channel coding is required to reduce the number
  • f errors
  • Modulation should be selected properly
  • Video compression algorithms
  • leverage layer coding, in which each layer is not

equally important

  • are effective against a certain level of errors
  • What’s unequal protection (UEP)
  • Bits that are required (referred) by others

à more important à more protection

  • Bits that are NOT required (referred) by others

à less important à less protection

2

slide-3
SLIDE 3

Technologies for Improving Reliability

3

modulation FEC ARQ MAC transmission

(Automatic Repeat reQuest) Retransmit erroneous/lost packets Determine modulation order Add additional redundancy

slide-4
SLIDE 4

Content-Aware FEC

  • N/R FEC
  • For every N bits of data, add redundancy and send
  • ut R bits (R-N bits are for error correction)
  • Smaller N/R à more reliable
  • Three classes
  • High priority: header and stuffing bits
  • Median priority: motion bits
  • Low priority: texture bits
  • UEP FEC
  • For example, (3/5, 2/3, 3/4) for (high, med, low)

priority

  • 3/5 < 2/3 < 3/4 ç give more bits to important info

4

  • M. G. Martini and M. Chiani, "Proportional unequal error protection for MPEG-4 video

transmission," ICC 2001

slide-5
SLIDE 5

BER of EEP and UEP

  • Given channel with 10% BER, FEC effectively

reduces BER

  • EEP and UEP experience similar effective BER

5

then channel coded using convolutional encoding of the data with either equal error protection using a fixed rate-& code or unequal error protection using a rate-

:

code for the header and stuffing segments, a rate-$ code for the motion segment, and a rate-: code for the texture segment. These EEP and UEP rates, cho- sen because they both give approximately the same amount of FEC overhead, were obtained by punctur- ing the output of a rate-$ code that was produced by the two polynomials [4]:

g1(X)

=

x6 + x 5 + x 3 + x 2

+

1

g2(X) = x6

+x3

+

x2

+

x

+

1 (1) (2)

The FEC-coded sequences were sent through a MUX, and the output packets from the MUX were sent through a GSM channel simulator. This simulator is based on a complex model of a GSM channel that has been fitted with data taken from a real GSM channel to get an accurate account of the errors found on this channel. The channel is not a binary channel, so bits are sent with a given "power" level. The received power is at- tenuated from the effects of transmission through the channel. Each FEC coded bitstream was subjected to 6 dif- ferent GSM channel conditions ranging from 0.3% to

12% BER (corresponding to a carrier-to-interference

ratio of between 19 dB and 4 dB) in 50 different trials per channel condition. For each of these trials, the fist frame was transmitted without corruption. The cor- rupted bitstreams were channel decoded and the error- corrected bitstreams were source decoded to find the quality (average PSNR) of the reconstructed video.

  • 6. Results

In order to compare the different methods of adding channel coding to the compressed video, the results from the 50 trials at a given GSM channel error rate were averaged for both sequences. Figure 3 shows the average BER that remains after channel decoding for each of the GSM channel BER

  • conditions. Channel coding reduces the effective BER

seen by the video decoder by over an order of magni- tude for most of the raw channel conditions. However, the convolutional codes break down when the chan- nel error rate is too high. Thus for the GSM channels with a BER around lo%, the channel coding actually increases the effective BER seen by the decoder. Under such harsh conditions, the channel coder would need to use more powerful codes to reduce the BER. However, for the remainder of the GSM channel conditions, the FEC codes reduce the effective BER. This brings the

I

10.'

Unmd.d

BER

1 6 16.1 '

' ' '

Figure 3: Effective BER for EEP and UEP. number of bit errors remaining in the bitstream that is sent to the MPEG-4 decoder to a level at which the error resilience tools can work. Figure 4 shows a comparison of the average PSNR values obtained for fixed coding and unequal error pro-

  • tection. These plots show that unequal error protec-

tion produces the highest average PSNR for the recon- structed video for both CIF and QCIF images at high channel error rates. Since both coding methods require the same amount of FEC overhead, this improvement

(as

much as 1 dB) does not require additional band-

  • width. In addition, for the error conditions shown here,

the fixed rate-& coder actually produces fewer errors in the channel decoded bitstream than the UEP coder

(as

shown in Figure 3), yet it still produces lower qual- ity reconstructed video. This is because the errors are spread evenly throughout the different portions of the video packet. Conversely, the unequal error protection coder may leave more errors in the channel decoded bitstream, but these errors are in less important por- tions of the video packet. Figure 5 shows a reconstructed frame of "Akiyo" when there are no channel errors and when the GSM channel error rate is 4% and the video is protected using EEP with a rate-& coder and UEP with a rate-

( ; ,

$ . , :

)

  • coder. These images also show the advantage
  • f using unequal error protection.

Rather than using the extra bandwidth for channel coding, it might be beneficial to spend these bits on forced intra-MB updates. These intra-MBs would stop error propagation and hence improve reconstructed video

  • quality. In order to test the effectiveness
  • f using intra-

MBs, the video sequences were compressed with enough forced intra-MBs each frame to increase the source- coded bitrate to equal that of the FEC-coded bitstream when no intra-MBs are used. The results of this exper-

532

EEP 7/10-code vs. UEP (3/5, 2/3, 3/4) code

similar amount

  • f data
slide-6
SLIDE 6

PSNR of EEP and UEP

  • Though EEP and UEP result in similar

effectively BER, UEP achieves a higher PSNR

6

  • - - - -
  • - -

E r

Figure 4: .Average PSNR for EEP and UEP channel coding o

f MPEG-4 video compressed with the all the

MPEG-4 error resilience tools. (a) CIF images. (b)

QCIF

images. iment are shown in Figure 4, labeled “No coding (Intra refresh only)”. These plots show that it is much bet- ter to use the overhead for channel coding than forced intra-MBs at these high channel error rates. Using the overhead for intra-MB refresh increases the num- ber of source bits that are corrupted due to channel errors, causing the reconstructed quality to be poor. As the channel error rates decrease below the levels tested here, it would probably be advantageous to re- duce the number of bits spent on channel coding and increase the number of forced intra-MBs per frame to get the optimal reconstructed video quality. Figure 5: Comparison of a frame of “Akiyo”. (a) shows the reconstructed frame with no channel errors, and (b) and (c) show the reconstructed frame after transmis- sion through a simulated GSM channel with 4% BER using (b) EEP coding and (c) UEP coding.

533

slide-7
SLIDE 7
  • I-frame is the reference of P-frames
  • Importance: I > P1 > P2 > P3
  • Redundancy: I > P1 > P2 > P3

UEP for Scalable Coding

7

I P1 P2 P3 I P1 P2 P3 I

I I’ P1 P’1 P2 P’2 P3 P’3

slide-8
SLIDE 8

Outline

  • Unequal error protection
  • FEC-based solution
  • Modulation-based solution
  • Retransmission-based solution

8

slide-9
SLIDE 9

Modulation-Assisted UEP

  • Exploit nonuniform QPSK to achieve UEP

9

  • M. Sajadieh, et. al., "Modulation-assisted unequal error protection over the fading channel," in IEEE

Transactions on Vehicular Technology, vol. 47, no. 3, pp. 900-908, Aug 1998

I Q

‘00’ ‘01’ ‘10’ ‘11’

Uniform QPSK

I Q

‘00’ ‘01’ ‘10’ ‘11’

Nonuniform QPSK

slide-10
SLIDE 10

Nonuniform QPSK

10

I Q

‘00’ ‘01’ ‘10’ ‘11’

Nonuniform QPSK d1 d2

  • d2 > d1 as φ < π/4
  • BER(1st bit) < BER(2nd bit)

φ

slide-11
SLIDE 11

UEP using Nonuniform QPSK

  • Partition bits into class 1 (more important) and

class 2 (less important)

11

class 1: 0 0 1 1 0 0 1 0 1 0 1 0 …. class 2: 1 0 0 1 1 1 0 1 1 0 0 0 …. Send ‘01’ ‘00’ ‘10’ ’11’ ‘01’ ‘01’ ‘10’ ‘01’ ‘11’ ’00’ ‘10’ …. lower error probability I Q

‘00’ ‘01’ ‘10’ ‘11’

Nonuniform QPSK

higher error probability

slide-12
SLIDE 12

Outline

  • Unequal error protection
  • FEC-based solution
  • Modulation-based solution
  • Retransmission-based solution

12

slide-13
SLIDE 13

Recap

  • Tx retransmits the frame when it does not receive ACK
  • Retransmit the frame until the retry limit is reached

12

pkt1 pkt2 pkt5 pkt1 pkt1 retry 1 pkt6 pkt6 retry 2 retry 1 time pkt7 pkt10

slide-14
SLIDE 14

Retry Limit Adaptation

  • Increase the retry limit à enhance reliability
  • Frame may still be lost if all reTx fail but the retry

limit has been reached

  • High priority bits à with a larger retry limit

low priority bits à with a smaller retry limit

  • Challenges:
  • A large retry limit might lead to buffer overflow à lose

more frames

  • Tradeoff between delivery probability and buffer
  • verflow rate

Qiong Li et. al., "Providing adaptive QoS to layered video over wireless local area networks through real-time retry limit adaptation," in IEEE Transactions on Multimedia, vol. 6, no. 2, pp. 278-290, Apr. 2004

pkt1 pkt5 pkt1 pkt1 retry 1 pkt6 pkt6 retry 2 retry 1 time pkt7 pkt10 pkt1 retry 3

slide-15
SLIDE 15

Outline

  • Unequal error protection
  • FEC-based solution
  • Modulation-based solution
  • Retransmission-based solution
  • Wireless Video Multicasting

15

slide-16
SLIDE 16

Wireless Video Multicast

16

Internet video server wireless router

request the same video clip wireless multicast streaming

slide-17
SLIDE 17

Heterogeneous Channel Conditions

Higher rates provide a higher throughput, but a shorter coverage range

Use a high rate? Use a low rate?

2 4 6 8 10 12 1 6 11 16 21 Throughput (Mbps) SNR (dB) 1Mbps 2Mbps 5.5Mbps 11Mbps

11Mb/s 0Mb/s 1Mb/s 1Mb/s 1Mb/s 1Mb/s

17

4 rates in 802.11b

BER~=1

20dB

slide-18
SLIDE 18

Multicast Rate Adaptation

Adapt transmission bit-rates to dynamic channel conditions

  • Leader-based scheme
  • Collision due to concurrent

feedback

  • For reliable transmission

1Mb/s

  • Y. Park, Y. Seok, N. Choi, Y. Choi, and J.-M. Bonnin, “Rate-Adaptive Multimedia Multicasting over

IEEE 802.11 Wireless LANs,” in Consumer Communications and Networking Conference, 2006

SNR throughput

11Mbps

1Mbps

18

slide-19
SLIDE 19

For Multicast Streaming?

Layered video coding Playback deadline

Differentiated video qualities GOP1 GOP2 GOP3

……

Discarding frames after deadline

19

slide-20
SLIDE 20

Differentiated-Quality Multicast

Goal:

  • Differentiated quality

matching their channel conditions Challenges:

  • Limited channel time
  • Multiple bit-rates

TGOP TGOP

1Mb/s 11Mb/s x 7 clients x 2 clients

20

Trade-off

slide-21
SLIDE 21

Rate Scheduling Problem

Objective: Maximize video quality Subject to

21

Min-quality guarantee Deadline x x x x GOP1 t TGOP1(1-αbg) r1 r2 r3 r4 r5 … rk

slide-22
SLIDE 22

Clustering-based Rate Adaptation

22

  • Cluster users according heterogeneous channel

conditions

  • 1. Cluster Construction
  • Real-time sample channel quality
  • 2. Sample-based Rate Selection
  • Adapt rates to network dynamics
  • 3. Rate Adaptation
slide-23
SLIDE 23
  • 1. Cluster Construction

Cluster clients with similar link quality

  • Provide similar visual quality

Select cluster head

  • Report channel visual quality
  • Reduce feedback overhead

Estimate the overall visual quality

23

1Mbps 11Mbps 5.5Mbps PSNR1 * 2 PSNR3 * 2 PSNR2 * 4

slide-24
SLIDE 24
  • 2. Sample-based Rate Selection
  • Base frames
  • Fixed rate, dynamic size (nb)
  • Enhancement frames
  • Dynamic rate(re), best-effort size

24

Enhancement Frames (Fe) Discarded Frames (Fd)

Sent at Rb Sent at re Discarded nb frames

Base Frames (Fb)

t TGOP1(1-αbg) x x x GOP1 t TGOP1(1-αbg) r1 r2 r3 r4 r5 … rk

slide-25
SLIDE 25
  • 2. Sample-based Rate Selection
  • Sample 3 different rates

(re) for enhancement frames

  • Cluster heads report a

mask of reception

  • Sender computes visual

qualities

25

Fd Fd Fb Fe Fd nbcurrent rate re GOP1 Fb Fe nbhigher rate re’ Fb Fe nblower rate re’’ GOP3

sampling interval GOP2

GOP1: 1111001 GOP2: 1101000 GOP3: 1111011

slide-26
SLIDE 26
  • 3. Rate Adaptation

Rate should be updated periodically

  • Dynamic channel conditions
  • Variable video bit-rates

26

  • 5

5 15 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 ne time

Required elementary frames : Let PSNR>30

1 2 3 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 modulation mode time

Best enhancement rate

* stationary clients

slide-27
SLIDE 27
  • 3. Rate Adaptation

27

active state static state Sample rates periodically Stop sampling; use the current selected rate Detect the duplicated rate re for k continuous sampling intervals Any of CHs reports that PSNRstatic(CHi)<PSNRactive(CHi)-Δ

1. Adaptive state Rather sample periodically than keep using a wrong rate 2. Adaptive state -> Stable state Find duplicate samples 3. Stable state § Keep using the current rate § Track video quality by feedback 4. Stable state -> Adaptive state Detect that visual quality degrades by ΔPSNR

slide-28
SLIDE 28
  • 3. Rate Adaptation
  • Make a trade-off between sampling
  • verhead and feedback overhead
  • Sampling overhead: transmit video frame at a

unsuitable rate

  • Feedback overhead: transmit masks of reception

28

Two-state Periodical sampling Sampling overhead 607(kb) 6.9% 1.43(mb) 16.21% Feedback overhead 2.7(kb) 0.03(%) 1.8(kb) 0.02%

slide-29
SLIDE 29

CDF of Visual Quality

29

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 20 25 30 35 40 45 CDF PSNR (dB) Base-Rate Leader-Based Two-Leader QDM

  • 1. Clients perceive heterogeneous qualities
  • 2. Most of clients obtain the minimum quality

PSNRmin

slide-30
SLIDE 30

Impact of Node Distribution

30

25 27 29 31 33 35 37 39 41 43 20 40 60 80 100 120 140 160 PSNR(dB) Topology Size (Radius: m) Base-Rate Leader-Based Two-Leader QDM

Adapt rate based on node distribution

starvation