Conference on Seasonality, Seasonal Adjustment and their - - PowerPoint PPT Presentation

conference on seasonality seasonal adjustment and their
SMART_READER_LITE
LIVE PREVIEW

Conference on Seasonality, Seasonal Adjustment and their - - PowerPoint PPT Presentation

Conference on Seasonality, Seasonal Adjustment and their implications for Short-Term Analysis and Forecasting 10-12 May 2006 Comparison of Methods Accounting for Outliers during Seasonal Adjustment J. Aston Outliers SA Outliers Simulations


slide-1
SLIDE 1

10-12 May 2006

Comparison of Methods Accounting for Outliers during Seasonal Adjustment

  • J. Aston

Conference on Seasonality, Seasonal Adjustment and their implications for Short-Term Analysis and Forecasting

slide-2
SLIDE 2

Outliers SA Outliers Simulations Real Data Summary References

Comparison of Methods Accounting for Outliers during Seasonal Adjustment

  • J. Aston

Institute of Statistical Science Academia Sinica

Eurostat Seasonal Adjustment Conference 2006

1

slide-3
SLIDE 3

Outliers SA Outliers Simulations Real Data Summary References

Outline

Outliers Seasonal Adjustment Structural Component Models ARIMA models Outliers Gaussian Methods Non-Gaussian Methods Simulations Real Data UK Housing Transactions US Automobile Retail Series US Material Handling Equipment Manufacturing Series Summary

2

slide-4
SLIDE 4

Outliers SA Outliers Simulations Real Data Summary References

1 2 3 4 5 6 7 8 5 10 15 20 25 30 Data

3

slide-5
SLIDE 5

Outliers SA Outliers Simulations Real Data Summary References

1 2 3 4 5 6 7 8 5 10 15 20 25 30 Data Gauss Seasonal Adjustment

4

slide-6
SLIDE 6

Outliers SA Outliers Simulations Real Data Summary References

Model Based Seasonal Adjustment

Use a component model to define a seasonal component and then remove this estimated component from the data. ysa

t

= yt − St St can be defined in many ways and is also dependent on all the other components in the model. The Unobserved Component models often define St is terms of trigonometric functions, while ARIMA decomposition models give constrained ARIMA model representations.

5

slide-7
SLIDE 7

Outliers SA Outliers Simulations Real Data Summary References

Structural Component Models

The Trig-1 seasonal model, with seasonal period s, is defined as St =

[s/2]

  • j=1

Sj,t Sj,t = Sj,t−1 cos λj + S∗

j,t−1 sin λj + ωj,t

S∗

j,t

= −Sj,t−1 sin λj + S∗

j,t−1 cos λj + ω∗ j,t

and ωj,t, ω∗

j,t ∼ N(0, σ2 ω) and λj = 2πj s . In addition, the local level

model, Tt = Tt−1 + ηt where ηt ∼ N(0, σ2

η), for the Trend specification, and a white

noise Gaussian irregular component (with variance σ2

ξ).

6

slide-8
SLIDE 8

Outliers SA Outliers Simulations Real Data Summary References

ARIMA models

Airline Model Basics

(1 − B)(1 − Bs)yt = (1 − θB)(1 − ΘBs)ξt Using the Hillmer-Tiao decomposition we can find (for suitable parameters) (1 − B)2Tt = θT(B)ωt U(B)St = θS(B)ηt It = εt

where U(B) = (1 + B + . . . + Bs−1) and ωt, ηt, ǫt are white noise processes

then yt = St + Tt + It

7

slide-9
SLIDE 9

Outliers SA Outliers Simulations Real Data Summary References

Gaussian Outlier Adjustment - Simple Procedure

  • 1. Set Outlier Threshold
  • 2. Check Residuals - perform t-test
  • 3. Include most significant term in model
  • 4. Repeat 2. and 3. until no further significant terms
  • 5. Check current outliers are still applicable

8

slide-10
SLIDE 10

Outliers SA Outliers Simulations Real Data Summary References

Gaussian Outlier Identification Simulation

Variance Estimation for the differenced process

1 2 3 4 5 0.85 0.90 0.95 1.00 1.05 1.10 1.15 1.20

100 Simulated series (143 observations of monthly data) with 3 outliers. Histogram of estimated variance parameters (true value is 1.0) based on number of outliers detected by automatic Gaussian procedure (threshold value is 3.0) 9

slide-11
SLIDE 11

Outliers SA Outliers Simulations Real Data Summary References

Non Gaussian Components

I∗

t ∼ t(0, σ2 ξ, ν),

t = 1, . . . , n, where ν > 2 is the number of degrees of freedom and σ2

ξ is the

variance, which is constant for any ν. The decomposition model with a t-distributed irregular term can be expressed in its canonical form by yt = St + Tt + I∗

t ,

I∗

t ∼ t(0, σ2 ξ, ν),

t = 1, . . . , n. where t(0, σ2

ξ, ν) refers to the t density.

Structural Component Model: Estimate σξ, ν AMB Component Model: Estimate ν. Overall model gives σξ

10

slide-12
SLIDE 12

Outliers SA Outliers Simulations Real Data Summary References

Simulation Setup

  • 144/156 Series for both SC and AMB models
  • Three outliers at 5 times sd of Irr / No outliers added
  • Gaussian / Non-Gaussian Model Estimation
  • Mean Squared Seasonal Difference between 144/156 data

lengths measured for 144 coincident points.

11

slide-13
SLIDE 13

Outliers SA Outliers Simulations Real Data Summary References

Comparison Histograms

  • 10
  • 5
5 10 15 20 25 30 2.5 5.0 7.5 10.0 12.5 15.0 Seasonal Stability
  • 5.0
  • 2.5
0.0 2.5 5.0 7.5 10.0 12.5 15.0 17.5 5 10 15 20 25 30 35 40 45 Seasonal Stability

Trig-1 Three Outliers Trig-1 No Outliers

  • 2.5
  • 2.0
  • 1.5
  • 1.0
  • 0.5
0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0 5.5 2.5 5.0 7.5 10.0 12.5 15.0 Seasonal Stability
  • 0.25
0.00 0.25 0.50 0.75 1.00 1.25 1.50 1.75 2.00 5 10 15 20 25 Seasonal Stability

AMB Three Outliers AMB No Outliers

12

slide-14
SLIDE 14

Outliers SA Outliers Simulations Real Data Summary References

England and Wales Housing Transactions Series

1995 2000 2005 80 90 100 110 120 130 140 150 160 170 180 UK Housing Transactions Series

13

slide-15
SLIDE 15

Outliers SA Outliers Simulations Real Data Summary References

Trig-1 Model

50 100 150

  • 0.2

0.0 0.2

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.10
  • 0.05

0.00 0.05

Difference between Seasonals

50 100 150

  • 0.2

0.0 0.2

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.10
  • 0.05

0.00 0.05

Difference between Seasonals

14

slide-16
SLIDE 16

Outliers SA Outliers Simulations Real Data Summary References

AMB Model

50 100 150

  • 0.1

0.0 0.1

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.05

0.00 0.05

Difference between Seasonals

50 100 150

  • 0.1

0.0 0.1

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.05

0.00 0.05

Difference between Seasonals

15

slide-17
SLIDE 17

Outliers SA Outliers Simulations Real Data Summary References

US Automobile Retail Series

1995 2000 2005 40000 50000 60000 70000 80000 US Automobile Retail Series

16

slide-18
SLIDE 18

Outliers SA Outliers Simulations Real Data Summary References

Trig-1 Model

50 100 150

  • 0.10
  • 0.05

0.00 0.05 0.10

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.01

0.00 0.01

Difference between Seasonals

50 100 150

  • 0.10
  • 0.05

0.00 0.05 0.10

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.01

0.00 0.01

Difference between Seasonals

17

slide-19
SLIDE 19

Outliers SA Outliers Simulations Real Data Summary References

AMB Model

50 100 150

  • 0.10
  • 0.05

0.00 0.05 0.10

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.002
  • 0.001

0.000 0.001 0.002 0.003

Difference between Seasonals

50 100 150

  • 0.10
  • 0.05

0.00 0.05 0.10

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.002
  • 0.001

0.000 0.001 0.002 0.003

Difference between Seasonals

18

slide-20
SLIDE 20

Outliers SA Outliers Simulations Real Data Summary References

US Material Handling Equipment Manufacturing Series

1995 2000 2005 1000 1250 1500 1750 2000 2250 2500 US Material Handling Equipment Manufacturing Series

19

slide-21
SLIDE 21

Outliers SA Outliers Simulations Real Data Summary References

Trig-1 Model

50 100 150

  • 0.1

0.0 0.1 0.2

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.025

0.000 0.025 0.050

Difference between Seasonals

50 100 150

  • 0.1

0.0 0.1 0.2

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.025

0.000 0.025 0.050

Difference between Seasonals

20

slide-22
SLIDE 22

Outliers SA Outliers Simulations Real Data Summary References

AMB Model

50 100 150

  • 0.1

0.0 0.1 0.2

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.002
  • 0.001

0.000 0.001 0.002

Difference between Seasonals

50 100 150

  • 0.1

0.0 0.1 0.2

Seasonal - Orig + 12months Seasonal - Orig

50 100 150

  • 0.002
  • 0.001

0.000 0.001 0.002

Difference between Seasonals

21

slide-23
SLIDE 23

Outliers SA Outliers Simulations Real Data Summary References

Summary

  • Critical values can lead to unstable seasonals
  • Non-Gaussian models give reasonable seasonals when no
  • utliers present
  • Non-Gaussian models reduce instability when outliers

present

  • Caveats:
  • More Parameters needed
  • Computationally more intensive

22

slide-24
SLIDE 24

Outliers SA Outliers Simulations Real Data Summary References

References I

Aston, J. A. D. and S. J. Koopman (2006). A non-gaussian generalisation of the airline model for robust seasonal adjustment. Journal of Forecasting, in press. Bruce, A. G. and S. R. Jurke (1996). Non-Gaussian seasonal adjustment: X-12-ARIMA versus robust structural models. Journal of Forecasting 15, 305–328. Gómez, V. and A. Maravall (2001a). Automatic modeling methods for univariate series. In D. Peña, G. C. Tiao, and R. S. Tsay (Eds.), A Course in Time

  • Series. New York, NY: J. Wiley and Sons.

Chapter 7.

23

slide-25
SLIDE 25

Outliers SA Outliers Simulations Real Data Summary References

References II

Gómez, V. and A. Maravall (2001b). Seasonal adjustment and signal extraction in economic time series. In D. Peña, G. C. Tiao, and R. S. Tsay (Eds.), A Course in Time

  • Series. New York, NY: J. Wiley and Sons.

Chapter 8. Harvey, A. C. (1989). Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge: Cambridge University Press. Hillmer, S. C. and G. C. Tiao (1982). An ARIMA-model-based approach to seasonal adjustment. Journal of the American Statistical Association 77, 63–70.

24