The Implications of Sample-Based Vs. Self- Reported Measures of - - PowerPoint PPT Presentation

The Implications of Sample-Based Vs. Self- Reported Measures of Urbanicity

Alexandra Castillo, Ph.D.

Research Associate, Global Attitudes

Kat Devlin & Janell Fetterolf

Research Associates, Global Attitudes

Presenter: Co-authors:

Courtney Johnson

Research Associate, Science and Society

2

Pew Research Center

• Established 1996
• Funded by The Pew Charitable Trusts, foundations
• Non-profit, non-partisan fact tank in Washington
• Since 2001, we have surveyed in 108 countries
• www.pewresearch.org
• @pewresearch

3

Spring 2018 Global Attitudes Survey

• 30,133 interviews conducted from May 14 to August 12, 2018 in 41 languages
• Based on telephone and face-to-face interviews with nationally representative

samples of adults 18 and older

• In four European countries (Greece, Hungary, Italy and Poland), both sample-

based and self-reported urbanity were available

• 4,100 face-to-face interviews conducted from May 25 to July 12, 2018
• The margin of sampling error for the subset of weighted data is ±4.6% - ±4.8%
• Samples were stratified by urbanity – classified from Eurostat’s DEGURBA

4

The Importance of Urbanity

• Urban-rural divides are growing
• Macroeconomic trends have led to divided economic opportunities
• Choice of living location is tied to political preferences
• In Europe, supporters of right-wing populist parties tend to live in rural areas
• Practical data collection implications in phone surveys

Comparing Sample-Based Versus Self-Reported Urbanicity

5

Recoding Self-Reported Urbanity

% who say __ best describes the area where they live 34% 11 28 25 2 A farm or home in the countryside A big city The suburbs or

• utskirts of a big city

A town or small city A country village Collapsing self-reported urbanity into three categories

6

34% 40 27 Urban Suburban Rural

Correspondence of Sample-Based And Self-Reported Urbanity

7

35% 34 35% 40 30% 27 Sample-Based Self-Reported Urban Suburban Rural

Correspondence of Sample-Based And Self-Reported Urbanity by Country

8

39% 54 31 30 35 17 34 34 25% 14 37 41 48 72 29 31 36% 32 32 29 17 11 37 34

Urban Suburban Rural Greece Hungary Italy Poland

Sample-based Self-reported

• 15%

+11% +18%

• 24%

Discontinuity Between Self-Reported And Sample-Based Urbanity

9

10

Strong Demographic Similarities between Self-Reported Urbanity Matches And Mismatches

• Matches = Those whose self-reported urbanity corresponds with the sample-

based measure; Mismatches = Those whose self-reported urbanity diverges from the sample-based measure

• Around 30% or fewer cases are mismatches in Greece, Hungary and Poland;

44% of cases are mismatches in Italy

• Similar demographic composition of matches and mismatches for self-reported

urbanity

• Gender
• Age
• Education
• Ideology

36% 17 24 6 14 3 28 7 7% 7 27 14 39 33 15 16 29% 4 25 4 4 7 27 7 72% 28 76 24 57 44 71 30

Urban Suburban Rural TOTAL Greece Hungary Italy Poland

Discontinuity between Sample-Based and Self-Reported Urbanity

% of __ for each level of urbanization

11

Match Mismatch

Sub Suburb urban an Ru Rural ral Total Total urb urban an mismatches ismatches % % % n Greece 86 14 17 188 Hungary 100 6 63 Italy 100 3 33 Poland 100 7 61

How Urban Mismatches Were Classified by the Sample-Based Measure

Mismatches who self-identified as urban were classified by the sample-based measure of urbanity as …

12

Ur Urba ban Ru Rural ral Total Total subu suburb rban an mismatches ismatches % % % n Greece 35 65 7 85 Hungary 47 53 14 181 Italy 61 39 33 322 Poland 40 60 16 191

How Suburban Mismatches Were Classified by the Sample-Based Measure

Mismatches who self-identified as suburban were classified by the sample-based measure of urbanity as …

13

Ur Urba ban Sub Suburb urban an Total Total rura rural l mismatches ismatches % % % n Greece 13 87 4 53 Hungary 100 4 35 Italy 6 94 7 67 Poland 4 96 7 57

How Rural Mismatches Were Classified by the Sample-Based Measure

Mismatches who self-identified as rural were classified by the sample-based measure of urbanity as …

14

48% 51 47 44 42 49 46 49 52% 49 53 56 58 51 54 51

Male Female

No Gender Differences between Self-Reported Urbanity Matches and Mismatches

% of __ by gender

15

Match Mismatch

Greece Hungary Italy Poland

Match Mismatch Match Mismatch Match Mismatch

16% 16 18 15 16 16 17 17 32% 37 37 34 32 34 35 37 52% 48 45 51 51 50 48 47

18-29 30-49 50+

Match Mismatch Match Mismatch Match Mismatch Match Mismatch

Similar Age Breakdown between Self-Reported Urbanity Matches and Mismatches

% of __ by age

16

Greece Hungary Italy Poland

75% 66 77 78 85 88 74 77 25% 34 23 22 15 12 26 23

Lower education Higher education

Same Educational Profile between Self-Reported Urbanity Matches and Mismatches

% of __ by education

17

Greece Hungary Italy Poland

Match Mismatch Match Mismatch Match Mismatch Match Mismatch

Demographic Comparisons between Self-Reported And Sample-Based Urbanity

18

19

Similar Demographic Characteristics between Self-Reported And Sample-Based Measures of Urbanity

• The demographic profiles of the self-reported and sampled-based measures of

urbanity are very similar across urban, suburban and rural areas

• Internet usage
• Gender
• Age
• Education
• Ideology

80% 78 85 82 85 88 75 72 74% 77 75 75 67 72 74 78 57% 55 62 63 69 62 72 71

Proportionate Internet Usage across The Sample-Based And Self- Reported Measures of Urbanity

% who use the internet in __ areas by measures of urbanity

20

Greece Hungary Italy Poland

Sample-based Self-reported Urban Suburban Rural

87% 90 88 87 92 84 82 86 13% 10 12 13 8 16 18 14 Lower education Higher education

Comparable Educational Composition across The Sample-Based And Self-Reported Measures of Urbanity

% of rural respondents by levels of education for the __ measure of urbanity

21

Greece Hungary Italy Poland

Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported

Substantive Patterns Of Public Opinion by Self-Reported And Sample-Based Urbanity

22

92% 94 51 52 83 84 22 21 98% 97 47 49 85 82 25 28 98% 99 49 45 80 92 31 29

Strong Correspondence with Views of The Current Economic Situation across Both Measures of Urbanity

% who say the current economic situation is bad in __ areas by measures of urbanity

23

Greece Hungary Italy Poland

Sample-based Self-reported Urban Suburban Rural +12%

18% 14 38 35 32 20 37 40 13% 20 32 32 22 28 42 37 19% 20 33 37 33 34 37 39

Similar Levels of Confidence in Trump across The Sample-Based And Self-Reported Measures of Urbanity

% who have confidence in Trump in __ areas by measures of urbanity

24

Greece Hungary Italy Poland

Sample-based Self-reported Urban Suburban Rural

• 12%

25

Concluding Remarks

• Strong relationship between sample-based and self-reported measure of

urbanicity, except Italy

• The demographic profiles for both measures and mismatches are very similar
• There are some notable differences across countries on substantive variables
• The self-reported measure warrants further exploration on key variables, such as

partisanship

26

Alexandra Castillo, Ph.D.

Research Associate, Global Attitudes acastillo@pewresearch.org

52% 51 46 46 48 49 47 46 48% 49 54 54 52 51 53 54

Male Female

Roughly Equal Gender Distributions across The Sample-Based And Self- Reported Measures of Urbanity

% of rural respondents by gender for the __ measure of urbanity

27

Greece Hungary Italy Poland

Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported

22% 19 21 20 19 16 21 19 36% 38 38 37 34 40 38 37 43% 43 42 43 47 43 42 44

18-29 30-49 50+

Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported

Similar Age Profiles for Respondents across The Sample-Based And Self-Reported Measures of Urbanity

% of urban respondents by age group for the __ measure of urbanity

28

Greece Hungary Italy Poland

24% 23 17 15 23 25 25 27 38% 40 26 23 45 45 33 35 38% 37 56 62 32 30 42 39

Left Center Right

Ideological Similarities between Sample-Based And Self-Reported Measures of Urbanity

% of urban respondents by ideology for the __ measure of urbanity

29

Greece Hungary Italy Poland

Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported

21% 17 15 10 24 24 19 18 43% 46 26 29 38 36 31 36 37% 37 59 61 39 40 50 46

Left Center Right

Distribution of Ideological Affiliation Is the Same Across Matches and Mismatches of Self-Reported Urbanity

% of __ by ideology

30

Greece Hungary Italy Poland

Match Mismatch Match Mismatch Match Mismatch Match Mismatch

Generally Similar Educational Distributions across Sample-Based and Self-Reported Levels of Urbanity

% of respondents with __ for each level of urbanicity

31

75% 62 68 74 83 79 67 68 25% 38 32 35 17 21 33 32 71% 73 75 72 87 89 74 70 29% 27 25 28 13 11 26 30 87% 90 88 87 92 84 82 86 10 12 13 8 16 18 14

Urban Suburban Rural Lower education Higher education

13% Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported

Greece Hungary Italy Poland

Bad Bad Go Good

• d

Greece Sample-Based 94% 6% Self-Reported 92 7 Diff +2

• 1

Hungary Sample-Based 52 47 Self-Reported 51 48 Diff +1

• 1

Italy Sample-Based 84 12 Self-Reported 83 15 Diff +1

• 3

Poland Sample-Based 74 21 Self-Reported 73 22 Diff +1

• 1

Similar Substantive Patterns on Views of the Economy

% of urban respondents who say the current economic situation is __ by measures of urbanity

32

Similar Substantive Patterns on Views of the Economy

% of urban respondents who say the current economic situation in their country is __ by measure of urbanity

33

94% 92 52 51 84 83 74 73 6% 7 47 48 12 15 21 22

Bad Good Greece Hungary Italy Poland

Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported Sample-Based Self-Reported