A Framework for Thinking about Technology Adoption Eric Verhoogen - - PowerPoint PPT Presentation

a framework for thinking about technology adoption
SMART_READER_LITE
LIVE PREVIEW

A Framework for Thinking about Technology Adoption Eric Verhoogen - - PowerPoint PPT Presentation

A Framework for Thinking about Technology Adoption Eric Verhoogen Sept. 10, 2019 Introduction Framework Recent Research Conclusion Introduction There is wide agreement that adoption of new and better technologies is central to the


slide-1
SLIDE 1
slide-2
SLIDE 2

A Framework for Thinking about Technology Adoption

Eric Verhoogen

  • Sept. 10, 2019
slide-3
SLIDE 3

Introduction Framework Recent Research Conclusion

Introduction

◮ There is wide agreement that adoption of new and better technologies is central to the process of development.

slide-4
SLIDE 4

Introduction Framework Recent Research Conclusion

Introduction

◮ There is wide agreement that adoption of new and better technologies is central to the process of development. ◮ Many technologies have already been developed in richer countries.

◮ Gerschenkron (1962): “advantages of backwardness.”

slide-5
SLIDE 5

Introduction Framework Recent Research Conclusion

Introduction

◮ There is wide agreement that adoption of new and better technologies is central to the process of development. ◮ Many technologies have already been developed in richer countries.

◮ Gerschenkron (1962): “advantages of backwardness.”

◮ But for many countries, these advantages have remained elusive.

slide-6
SLIDE 6

Introduction Framework Recent Research Conclusion

Introduction

◮ There is wide agreement that adoption of new and better technologies is central to the process of development. ◮ Many technologies have already been developed in richer countries.

◮ Gerschenkron (1962): “advantages of backwardness.”

◮ But for many countries, these advantages have remained elusive. ◮ What is getting in the way? A first-order question for development.

slide-7
SLIDE 7

Introduction Framework Recent Research Conclusion

Introduction (cont.)

◮ In this talk I’ll present a framework for thinking about research on technology adoption by firms, aiming to provide:

◮ A way of interpreting existing studies. ◮ Suggestions for interesting directions for future research.

slide-8
SLIDE 8

Introduction Framework Recent Research Conclusion

Introduction (cont.)

◮ In this talk I’ll present a framework for thinking about research on technology adoption by firms, aiming to provide:

◮ A way of interpreting existing studies. ◮ Suggestions for interesting directions for future research.

◮ I’m focusing on the determinants of technology adoption, not the consquences of technology adoption for other outcomes.

slide-9
SLIDE 9

Introduction Framework Recent Research Conclusion

Introduction (cont.)

◮ In this talk I’ll present a framework for thinking about research on technology adoption by firms, aiming to provide:

◮ A way of interpreting existing studies. ◮ Suggestions for interesting directions for future research.

◮ I’m focusing on the determinants of technology adoption, not the consquences of technology adoption for other outcomes. ◮ Apology in advance to the non-economists for some mathematical notation. I’ll also try to explain in words.

slide-10
SLIDE 10

Introduction Framework Recent Research Conclusion

A Framework

◮ Suppose products can be produced by various techniques, each characterized by a production function: Yijkt = Fijk(

Mijkt, λijkt)

◮ i = firm ◮ j = product ◮ k = “technique”. Think: machine + set of inputs. ◮

Mijkt = vector of amounts of inputs

◮ λijkt = “capability” in product-technique jk. Think:

entrepreneurial ability or know-how.

slide-11
SLIDE 11

Introduction Framework Recent Research Conclusion

A Framework

◮ Suppose products can be produced by various techniques, each characterized by a production function: Yijkt = Fijk(

Mijkt, λijkt)

◮ i = firm ◮ j = product ◮ k = “technique”. Think: machine + set of inputs. ◮

Mijkt = vector of amounts of inputs

◮ λijkt = “capability” in product-technique jk. Think:

entrepreneurial ability or know-how.

◮ Firms face demand functions for products and supply functions for inputs: Pijt = Dijt(Yijt,

Yi,−jt, Zyt)

Wijkt = W (

Mijkt,

Mi,−jkt, Zmt)

slide-12
SLIDE 12

Introduction Framework Recent Research Conclusion

A Framework (cont.)

◮ The firm’s present discounted value of profits is:

Πit =

  • t=0

δt   

  • j∈J∗

it

  • PijtFijk∗(

Mijk∗t, λijk∗t) −

W ′

ijk∗t

Mijk∗t − fijk∗t − fijt

  • − fit

  

where δ is a discount factor and fijkt, fijt, fit are fixed costs.

slide-13
SLIDE 13

Introduction Framework Recent Research Conclusion

A Framework (cont.)

◮ The firm’s present discounted value of profits is:

Πit =

  • t=0

δt   

  • j∈J∗

it

  • PijtFijk∗(

Mijk∗t, λijk∗t) −

W ′

ijk∗t

Mijk∗t − fijk∗t − fijt

  • − fit

  

where δ is a discount factor and fijkt, fijt, fit are fixed costs. ◮ The firm’s problem is to choose the set of products to produce, J∗

it, the technique for each product, k∗ j , and amounts

  • f inputs,

Mijkt, to maximize Πit.

slide-14
SLIDE 14

Introduction Framework Recent Research Conclusion

A Framework (cont.)

◮ The firm’s present discounted value of profits is:

Πit =

  • t=0

δt   

  • j∈J∗

it

  • PijtFijk∗(

Mijk∗t, λijk∗t) −

W ′

ijk∗t

Mijk∗t − fijk∗t − fijt

  • − fit

  

where δ is a discount factor and fijkt, fijt, fit are fixed costs. ◮ The firm’s problem is to choose the set of products to produce, J∗

it, the technique for each product, k∗ j , and amounts

  • f inputs,

Mijkt, to maximize Πit. ◮ (Could incorporate investments in capabilities, knowledge: IitΛ, IitJ, IitK.)

slide-15
SLIDE 15

Introduction Framework Recent Research Conclusion

Reasons for Non-Adoption

◮ Suppose that two techniques, kL and kH, use the same set of inputs and kH is “better” than kL for firms in developed countries, in the sense that: Πit(kH; {λijkt}, {Pijt}, {

Wijkt}) > Πit(kL; {λijkt}, {Pijt}, {

Wijkt}) assuming other choices are made optimally.

slide-16
SLIDE 16

Introduction Framework Recent Research Conclusion

Reasons for Non-Adoption

◮ Suppose that two techniques, kL and kH, use the same set of inputs and kH is “better” than kL for firms in developed countries, in the sense that: Πit(kH; {λijkt}, {Pijt}, {

Wijkt}) > Πit(kL; {λijkt}, {Pijt}, {

Wijkt}) assuming other choices are made optimally. ◮ Caveat: This does not necessarily mean that kH is more technically efficient, in the sense of getting more physical

  • utput from the same physical inputs.
slide-17
SLIDE 17

Introduction Framework Recent Research Conclusion

Reasons for Non-Adoption

◮ Suppose that two techniques, kL and kH, use the same set of inputs and kH is “better” than kL for firms in developed countries, in the sense that: Πit(kH; {λijkt}, {Pijt}, {

Wijkt}) > Πit(kL; {λijkt}, {Pijt}, {

Wijkt}) assuming other choices are made optimally. ◮ Caveat: This does not necessarily mean that kH is more technically efficient, in the sense of getting more physical

  • utput from the same physical inputs.

◮ kH, kL may be used for different products (e.g. quality

varieties), hence physical output not directly comparable.

slide-18
SLIDE 18

Introduction Framework Recent Research Conclusion

Reasons for Non-Adoption

◮ Suppose that two techniques, kL and kH, use the same set of inputs and kH is “better” than kL for firms in developed countries, in the sense that: Πit(kH; {λijkt}, {Pijt}, {

Wijkt}) > Πit(kL; {λijkt}, {Pijt}, {

Wijkt}) assuming other choices are made optimally. ◮ Caveat: This does not necessarily mean that kH is more technically efficient, in the sense of getting more physical

  • utput from the same physical inputs.

◮ kH, kL may be used for different products (e.g. quality

varieties), hence physical output not directly comparable.

◮ kH, kL may entail different labor costs. A technically efficient

technology may increase workers’ bargaining power, not be the more profitable (Stole and Zwiebel, 1996)).

slide-19
SLIDE 19

Introduction Framework Recent Research Conclusion

Reasons for Non-Adoption (cont.)

◮ Key question: Why might a firm in a developing country not adopt kH?

slide-20
SLIDE 20

Introduction Framework Recent Research Conclusion

Reasons for Non-Adoption (cont.)

◮ Key question: Why might a firm in a developing country not adopt kH? ◮ I’m going to classify reasons in three broad categories:

  • 1. Internal-to-the-firm
  • 2. Input-side
  • 3. Output-side
slide-21
SLIDE 21

Introduction Framework Recent Research Conclusion

Reasons for Non-Adoption (cont.)

◮ Key question: Why might a firm in a developing country not adopt kH? ◮ I’m going to classify reasons in three broad categories:

  • 1. Internal-to-the-firm
  • 2. Input-side
  • 3. Output-side

◮ The reasons in turn point to factors that might promote adoption.

slide-22
SLIDE 22

Introduction Framework Recent Research Conclusion

Reasons for Non-Adoption (cont.)

◮ Key question: Why might a firm in a developing country not adopt kH? ◮ I’m going to classify reasons in three broad categories:

  • 1. Internal-to-the-firm
  • 2. Input-side
  • 3. Output-side

◮ The reasons in turn point to factors that might promote adoption. ◮ Then I’ll come back and discuss two studies in more detail.

slide-23
SLIDE 23

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons

◮ The firm is not profit-maximizing.

slide-24
SLIDE 24

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons

◮ The firm is not profit-maximizing.

◮ Leibenstein (1966): “X-inefficiency.”

slide-25
SLIDE 25

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons

◮ The firm is not profit-maximizing.

◮ Leibenstein (1966): “X-inefficiency.” ◮ May be true, but we should be very careful about jumping to

this conclusion.

slide-26
SLIDE 26

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons

◮ The firm is not profit-maximizing.

◮ Leibenstein (1966): “X-inefficiency.” ◮ May be true, but we should be very careful about jumping to

this conclusion.

◮ If firms appear not to be optimizing, perhaps we have not fully

understood the problem they are solving.

slide-27
SLIDE 27

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons

◮ The firm is not profit-maximizing.

◮ Leibenstein (1966): “X-inefficiency.” ◮ May be true, but we should be very careful about jumping to

this conclusion.

◮ If firms appear not to be optimizing, perhaps we have not fully

understood the problem they are solving.

◮ The firm does not know about kH.

◮ Even in the age of Google, firms are sometimes simply unaware

  • f existing technologies.

◮ A firm may have uncertainty about how well a technology

works, even if operated correctly.

slide-28
SLIDE 28

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons

◮ The firm is not profit-maximizing.

◮ Leibenstein (1966): “X-inefficiency.” ◮ May be true, but we should be very careful about jumping to

this conclusion.

◮ If firms appear not to be optimizing, perhaps we have not fully

understood the problem they are solving.

◮ The firm does not know about kH.

◮ Even in the age of Google, firms are sometimes simply unaware

  • f existing technologies.

◮ A firm may have uncertainty about how well a technology

works, even if operated correctly.

◮ The firm lacks capability for implementing kH.

◮ It appears in many cases that capabilities have to be

“home-grown”, and at a cost (Gibbons, 2010).

◮ If a firm lacks the required capabilities for technique kH, it may

not be profitable to adopt it.

slide-29
SLIDE 29

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons (cont.)

◮ First reason (X-inefficiency) points to increasing competition as a factor driving adoption.

◮ In some cases, it seems clear that competition raised

productivity (Schmitz, 2005; Das et al., 2013).

◮ Little work on competition and technology adoption per se.

slide-30
SLIDE 30

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons (cont.)

◮ First reason (X-inefficiency) points to increasing competition as a factor driving adoption.

◮ In some cases, it seems clear that competition raised

productivity (Schmitz, 2005; Das et al., 2013).

◮ Little work on competition and technology adoption per se.

◮ Second and third reasons (lack of knowledge, capabilities) point to learning as a driver of adoption.

slide-31
SLIDE 31

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons (cont.)

◮ First reason (X-inefficiency) points to increasing competition as a factor driving adoption.

◮ In some cases, it seems clear that competition raised

productivity (Schmitz, 2005; Das et al., 2013).

◮ Little work on competition and technology adoption per se.

◮ Second and third reasons (lack of knowledge, capabilities) point to learning as a driver of adoption.

◮ Learning can take various forms:

◮ An increase in capabilities, {λijkt} ◮ An enlargement of set of techniques a firm knows about, Kijt. ◮ An enlargement of set of products a firm knows about, Jit.

slide-32
SLIDE 32

Introduction Framework Recent Research Conclusion

Internal-to-the-Firm Reasons (cont.)

◮ First reason (X-inefficiency) points to increasing competition as a factor driving adoption.

◮ In some cases, it seems clear that competition raised

productivity (Schmitz, 2005; Das et al., 2013).

◮ Little work on competition and technology adoption per se.

◮ Second and third reasons (lack of knowledge, capabilities) point to learning as a driver of adoption.

◮ Learning can take various forms:

◮ An increase in capabilities, {λijkt} ◮ An enlargement of set of techniques a firm knows about, Kijt. ◮ An enlargement of set of products a firm knows about, Jit.

◮ And can happen through various channels:

◮ From peers (Cai and Szeidl, 2017; Hardy and McCasland,

2016)

◮ From customers or suppliers. ◮ Through worker flows. ◮ Consulting (Bloom et al., 2013; Bruhn et al., 2018) ◮ ...

slide-33
SLIDE 33

Introduction Framework Recent Research Conclusion

Input-Side Reasons

◮ Developing-country firms face different input-supply functions, {

Wijkt}.

◮ Newer, more advanced techniques often require highly skilled

workers, high-quality inputs.

◮ These may be expensive, or unavailable.

slide-34
SLIDE 34

Introduction Framework Recent Research Conclusion

Input-Side Reasons

◮ Developing-country firms face different input-supply functions, {

Wijkt}.

◮ Newer, more advanced techniques often require highly skilled

workers, high-quality inputs.

◮ These may be expensive, or unavailable.

◮ Points to changes in input prices/availability as a driver of adoption.

slide-35
SLIDE 35

Introduction Framework Recent Research Conclusion

Input-Side Reasons

◮ Developing-country firms face different input-supply functions, {

Wijkt}.

◮ Newer, more advanced techniques often require highly skilled

workers, high-quality inputs.

◮ These may be expensive, or unavailable.

◮ Points to changes in input prices/availability as a driver of adoption.

◮ A number of studies show that reduction of import tariffs leads

to product upgrading (Bas and Strauss-Kahn, 2015).

slide-36
SLIDE 36

Introduction Framework Recent Research Conclusion

Input-Side Reasons

◮ Developing-country firms face different input-supply functions, {

Wijkt}.

◮ Newer, more advanced techniques often require highly skilled

workers, high-quality inputs.

◮ These may be expensive, or unavailable.

◮ Points to changes in input prices/availability as a driver of adoption.

◮ A number of studies show that reduction of import tariffs leads

to product upgrading (Bas and Strauss-Kahn, 2015).

◮ Some work on labor supply and mechanization in agriculture

(Hornbeck and Naidu, 2014).

slide-37
SLIDE 37

Introduction Framework Recent Research Conclusion

Input-Side Reasons

◮ Developing-country firms face different input-supply functions, {

Wijkt}.

◮ Newer, more advanced techniques often require highly skilled

workers, high-quality inputs.

◮ These may be expensive, or unavailable.

◮ Points to changes in input prices/availability as a driver of adoption.

◮ A number of studies show that reduction of import tariffs leads

to product upgrading (Bas and Strauss-Kahn, 2015).

◮ Some work on labor supply and mechanization in agriculture

(Hornbeck and Naidu, 2014).

◮ Little evidence on input supply and technology adoption per se

in LDC firms.

slide-38
SLIDE 38

Introduction Framework Recent Research Conclusion

Output-Side Reasons

◮ Developing-country firms face different product-demand functions, {Pijt}.

slide-39
SLIDE 39

Introduction Framework Recent Research Conclusion

Output-Side Reasons

◮ Developing-country firms face different product-demand functions, {Pijt}.

◮ Different techniques, e.g. kH and kL, may be applicable in the

production of different (but possibly similar) products.

◮ e.g. different quality varieties.

slide-40
SLIDE 40

Introduction Framework Recent Research Conclusion

Output-Side Reasons

◮ Developing-country firms face different product-demand functions, {Pijt}.

◮ Different techniques, e.g. kH and kL, may be applicable in the

production of different (but possibly similar) products.

◮ e.g. different quality varieties.

◮ Customer demand for different products may differ between

developed/developing countries.

◮ e.g. Willingness to pay for quality greater in developed

countries.

◮ Customers may have preferences over techniques used in

production as well as product characteristics.

slide-41
SLIDE 41

Introduction Framework Recent Research Conclusion

Output-Side Reasons

◮ Developing-country firms face different product-demand functions, {Pijt}.

◮ Different techniques, e.g. kH and kL, may be applicable in the

production of different (but possibly similar) products.

◮ e.g. different quality varieties.

◮ Customer demand for different products may differ between

developed/developing countries.

◮ e.g. Willingness to pay for quality greater in developed

countries.

◮ Customers may have preferences over techniques used in

production as well as product characteristics. ◮ Market-size often smaller in developing countries.

◮ May be difficult to achieve scale to pay for fixed costs.

slide-42
SLIDE 42

Introduction Framework Recent Research Conclusion

Output-Side Reasons (cont.)

◮ Potential drivers:

slide-43
SLIDE 43

Introduction Framework Recent Research Conclusion

Output-Side Reasons (cont.)

◮ Potential drivers:

◮ Exports ↑ ⇒ quality ↑ (Verhoogen, 2008; Atkin et al., 2017a).

slide-44
SLIDE 44

Introduction Framework Recent Research Conclusion

Output-Side Reasons (cont.)

◮ Potential drivers:

◮ Exports ↑ ⇒ quality ↑ (Verhoogen, 2008; Atkin et al., 2017a). ◮ Selling to local MNCs ↑ ⇒ quality ↑ (Alfaro-Urena et al., 2019)

slide-45
SLIDE 45

Introduction Framework Recent Research Conclusion

Output-Side Reasons (cont.)

◮ Potential drivers:

◮ Exports ↑ ⇒ quality ↑ (Verhoogen, 2008; Atkin et al., 2017a). ◮ Selling to local MNCs ↑ ⇒ quality ↑ (Alfaro-Urena et al., 2019) ◮ Exports, selling to local MNCs ↑ ⇒ working conditions ↑

(Tanaka, forthcoming; Boudreau, 2019).

slide-46
SLIDE 46

Introduction Framework Recent Research Conclusion

Output-Side Reasons (cont.)

◮ Potential drivers:

◮ Exports ↑ ⇒ quality ↑ (Verhoogen, 2008; Atkin et al., 2017a). ◮ Selling to local MNCs ↑ ⇒ quality ↑ (Alfaro-Urena et al., 2019) ◮ Exports, selling to local MNCs ↑ ⇒ working conditions ↑

(Tanaka, forthcoming; Boudreau, 2019).

◮ Exports ↑ ⇒ scale ↑ (Bustos, 2011; Lileeva and Trefler, 2010).

slide-47
SLIDE 47

Introduction Framework Recent Research Conclusion

Output-Side Reasons (cont.)

◮ Potential drivers:

◮ Exports ↑ ⇒ quality ↑ (Verhoogen, 2008; Atkin et al., 2017a). ◮ Selling to local MNCs ↑ ⇒ quality ↑ (Alfaro-Urena et al., 2019) ◮ Exports, selling to local MNCs ↑ ⇒ working conditions ↑

(Tanaka, forthcoming; Boudreau, 2019).

◮ Exports ↑ ⇒ scale ↑ (Bustos, 2011; Lileeva and Trefler, 2010). ◮ Competition ↑ ⇒ X-inefficiency ↓

slide-48
SLIDE 48

Introduction Framework Recent Research Conclusion

Output-Side Reasons (cont.)

◮ Potential drivers:

◮ Exports ↑ ⇒ quality ↑ (Verhoogen, 2008; Atkin et al., 2017a). ◮ Selling to local MNCs ↑ ⇒ quality ↑ (Alfaro-Urena et al., 2019) ◮ Exports, selling to local MNCs ↑ ⇒ working conditions ↑

(Tanaka, forthcoming; Boudreau, 2019).

◮ Exports ↑ ⇒ scale ↑ (Bustos, 2011; Lileeva and Trefler, 2010). ◮ Competition ↑ ⇒ X-inefficiency ↓ ◮ Again, not much direct evidence on technology adoption.

slide-49
SLIDE 49

Introduction Framework Recent Research Conclusion

Consulting Experiment

◮ Bloom, Eifert, Mahajan, McKenzie and Roberts (2013) ◮ Management practices can be thought of as a technology.

◮ “Modern management is a technology that diffuses slowly

between firms.” (Bloom et al., 2011)

slide-50
SLIDE 50

Introduction Framework Recent Research Conclusion

Consulting Experiment

◮ Bloom, Eifert, Mahajan, McKenzie and Roberts (2013) ◮ Management practices can be thought of as a technology.

◮ “Modern management is a technology that diffuses slowly

between firms.” (Bloom et al., 2011)

◮ Useful to study not only because they seem to matter a lot, but also because practices are used across a wide range of firms.

◮ Many other technologies need to be studied within narrow

industries.

slide-51
SLIDE 51

Introduction Framework Recent Research Conclusion

Consulting Experiment

◮ Bloom, Eifert, Mahajan, McKenzie and Roberts (2013) ◮ Management practices can be thought of as a technology.

◮ “Modern management is a technology that diffuses slowly

between firms.” (Bloom et al., 2011)

◮ Useful to study not only because they seem to matter a lot, but also because practices are used across a wide range of firms.

◮ Many other technologies need to be studied within narrow

industries.

◮ This study randomly allocated intensive Accenture consulting services over 17 Indian textile firms.

◮ One-month diagnostic phase (all firms) ◮ Four-month implementation phase (treatment only) ◮ Market value of services ∼ $250k. ◮ Tracked 38 management practices (regular maintenance,

tracking inventory, performance-based pay systems).

slide-52
SLIDE 52

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ Firms had not implemented basic management practices (e.g. labelling inventory).

slide-53
SLIDE 53

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

FIGURE V The Adoption of Key Textile Management Practices over Time

◮ Consulting was successful in getting firms to adopt management practices.

slide-54
SLIDE 54

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ Quality defects declined sharply.

slide-55
SLIDE 55

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

TABLE II THE IMPACT OF MODERN MANAGEMENT PRACTICES ON PLANT PERFORMANCE

(1) (2) (3) (4) (5) (6) (7) (8) Dependent variable Quality defects Inventory Output TFP Quality defects Inventory Output TFP Specification ITT ITT ITT ITT Weeks of treatment Weeks of treatment Weeks of treatment Weeks of treatment Interventioni,t 0.564** 0.245** 0.090** 0.154* (0.235) (0.117) (0.037) (0.084) During implementationi,t 0.293** 0.070 0.015 0.048 (0.137) (0.093) (0.031) (0.056) Cumulative treatmenti,t 0.032** 0.015** 0.006*** 0.009** (0.013) (0.005) (0.002) (0.004) Small sample robustness Ibragimov-Mueller (95% CI) [1.65,0.44] [0.83,-0.02] [0.05,0.38] [0.014,0.79] Permutation test (p-value) .001 .060 .026 .061 Time FEs 127 127 127 127 127 127 127 127 Plant FEs 20 18 20 18 20 18 20 18 Observations 1,807 2,052 2,393 1,831 1,807 2,052 2,393 1,831
  • Notes. All regressions use a full set of plant and calendar week dummies. Standard errors are bootstrap clustered at the firm level. Intervention is a plant level dummy equal to
1 after the implementation phase at treatment plants and 0 otherwise. During implementation is a dummy variable equal to 1 from the beginning of the diagnostic phase to the end
  • f the implementation phase for all treatment plants. Cumulative treatment is the cumulative weeks of treatment since the beginning of the implementation phase in each plant (0
in both the control group and prior to the implementation phase in the treatment group). Quality defects is the log of the quality defects index (QDI), which is a weighted average score of quality defects, so higher numbers imply worse quality products (more quality defects). Inventory is the log of the tons of yarn inventory in the plant. Output is the log of the weaving production picks. TFP is plant-level total factor productivity defined as log(output) measured in production picks less log(capital) times capital share of 0.42 less log(labor) times labor costs share of 0.58. ITT reports the intention to treat results from regressing the dependent variable directly on the intervention dummy. Time FEs report the number of calendar week time fixed effects. Plant FEs reports the number of plant-level fixed effects. Two plants do not have any inventory on site, so no inventory data are
  • available. Small sample robustness implements two different procedures (described in greater detail in the Appendix and Online Appendix B) to address issues of plant hetero-
geneity, within plant (and firm) correlation, and small sample concerns. Ibragimov-Mueller (95% CI) report 95% confidence interval estimates from firm-by-firm parameter estimates treating the estimates as draws from independent (but not identically distributed) normal distributions and conducts a two-sample t-test. Permutation test reports the p-values for testing the null hypothesis that the treatment has no effect for the ITT parameter by constructing a permutation distribution of the ITT estimate using the 12,376 possible permutations of treatment assignment. These tests have exact finite sample size. *** denotes 1%, ** denotes 5%, * denotes 10% significance.
slide-56
SLIDE 56

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ Study shows convincingly that management consulting can raise firm performance.

◮ That’s already a significant achievement, rightfully influential.

slide-57
SLIDE 57

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ Study shows convincingly that management consulting can raise firm performance.

◮ That’s already a significant achievement, rightfully influential.

◮ Study has been interpreted as showing:

◮ Firms are systematically making mistakes by not adopting the

38 practices.

◮ The 38 practices themselves unambiguously raise firm

performance.

slide-58
SLIDE 58

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ Study shows convincingly that management consulting can raise firm performance.

◮ That’s already a significant achievement, rightfully influential.

◮ Study has been interpreted as showing:

◮ Firms are systematically making mistakes by not adopting the

38 practices.

◮ The 38 practices themselves unambiguously raise firm

performance.

◮ Some words of caution:

slide-59
SLIDE 59

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ Study shows convincingly that management consulting can raise firm performance.

◮ That’s already a significant achievement, rightfully influential.

◮ Study has been interpreted as showing:

◮ Firms are systematically making mistakes by not adopting the

38 practices.

◮ The 38 practices themselves unambiguously raise firm

performance.

◮ Some words of caution:

◮ Adoption of modern management may require capabilities that

firms did not have and that are costly to acquire.

◮ $250k market value in consulting yielded about $300k increase

in profit per year, noisily measured.

◮ Experiment paid cost for firms, but not clear they were

making a mistake by not paying it on their own.

slide-60
SLIDE 60

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ Study shows convincingly that management consulting can raise firm performance.

◮ That’s already a significant achievement, rightfully influential.

◮ Study has been interpreted as showing:

◮ Firms are systematically making mistakes by not adopting the

38 practices.

◮ The 38 practices themselves unambiguously raise firm

performance.

◮ Some words of caution:

◮ Adoption of modern management may require capabilities that

firms did not have and that are costly to acquire.

◮ $250k market value in consulting yielded about $300k increase

in profit per year, noisily measured.

◮ Experiment paid cost for firms, but not clear they were

making a mistake by not paying it on their own. ◮ Question: Are effects due to 38 management practices

themselves or to other effects of consulting?

slide-61
SLIDE 61

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ My interpretation:

slide-62
SLIDE 62

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ My interpretation:

◮ Experiment raised capabilities of firms, which allowed them to

implement modern management practices.

slide-63
SLIDE 63

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ My interpretation:

◮ Experiment raised capabilities of firms, which allowed them to

implement modern management practices.

◮ Some of the practices do seem like “no-brainers” that would

be advantageous for all firms in all contexts (e.g. tracking inventories). But others are less obvious (e.g. performance pay).

slide-64
SLIDE 64

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ My interpretation:

◮ Experiment raised capabilities of firms, which allowed them to

implement modern management practices.

◮ Some of the practices do seem like “no-brainers” that would

be advantageous for all firms in all contexts (e.g. tracking inventories). But others are less obvious (e.g. performance pay).

◮ We need to evaluate setting by setting whether particular

practices are indeed advantageous, worth promoting.

slide-65
SLIDE 65

Introduction Framework Recent Research Conclusion

Consulting Experiment (cont.)

◮ My interpretation:

◮ Experiment raised capabilities of firms, which allowed them to

implement modern management practices.

◮ Some of the practices do seem like “no-brainers” that would

be advantageous for all firms in all contexts (e.g. tracking inventories). But others are less obvious (e.g. performance pay).

◮ We need to evaluate setting by setting whether particular

practices are indeed advantageous, worth promoting.

◮ The fundamental problem seems to be that firms lack

capabilities, not that they have failed to adopt a particular set

  • f practices.
slide-66
SLIDE 66

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment

◮ Atkin, Chaudhry, Chaudry, Khandelwal and Verhoogen (2017b). ◮ Through a series of fortuitous events, we came up with a technology that seemed to be as close to a no-brainer as one could hope for.

slide-67
SLIDE 67

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment

◮ Atkin, Chaudhry, Chaudry, Khandelwal and Verhoogen (2017b). ◮ Through a series of fortuitous events, we came up with a technology that seemed to be as close to a no-brainer as one could hope for. ◮ Randomly allocated it to 35 of 135 soccer-ball producers in Sialkot, Pakistan.

slide-68
SLIDE 68

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment

◮ Material (rexine) is by far the most expensive input.

slide-69
SLIDE 69

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

Standard “buckyball” design: 20 hexagons, 12 pentagons. For standard ball, almost all firms use 2-hexagon and 2- pentagon “flush” dies.

slide-70
SLIDE 70

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

Hexagons tessellate. ∼ 8% of rexine wasted.

slide-71
SLIDE 71

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

Pentagons don’t. ∼ 20-24% of rexine wasted.

slide-72
SLIDE 72

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

In a YouTube video of a Chinese factory producing the Adidas Jabulani ball, I noticed a different layout of pentagons.

slide-73
SLIDE 73

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

I could also have gone to: G. Kuperberg and W. Kuperberg, “Double-Lattice Packings of Convex Bodies in the Plane,” Discrete & Computational Geometry, 5: 389-397, 1990.

Double-Lattice Packings

  • f Convex Bodies

in the Plane 393 inscribed in Ko, and the proof is complete. However, it can be noticed now that the minimality of the area of q implies that the length of one of the sides of q actually equals one-half of the length of Ko in the direction of that side. Therefore Ko actually touches a translate of itself, and Case II is not possible at all. [] Remark 1. If K is not strictly convex, the conclusion of the above theorem does not necessarily hold. However, in this case there exists a double-lattice packing with maximum density which is generated by a minimum-area extensive parallelogram inscribed in K. This can be obtained by approximating K with a sequence of strictly convex bodies K, and then selecting a convergent subsequence

  • f double-lattice packings.

Remark 2. Theorem 1 and the above remark yield an algorithm for finding a maximum density double-lattice packing with copies of K which goes as follows. For any diameter d of K, find a pair of chords parallel to d, each of length equal to one-half of the length of d. These two chords define a parallelogram q(d) inscribed in K, which turns out to be extensive (see Lemma 1 of the following section). Now vary d and find a critical position of d = do such that q(do) is of minimum area. This minimum-area extensive parallelogram generates a maximum density double-lattice packing with copies of K. In general, locating the critical diameter do may be a problem, but in many special cases, as in the following examples, the diameter do is easy to find. Examples. An application of the algorithm described in Remark 2 to the case when K is a regular pentagon results in a double-lattice packing of density (5-x/5)/3 =0.92131..., shown in Fig. 7. This packing may have the maximum

  • Fig. 7. Maximum

density double-lattice packing with regular pentagons.

slide-74
SLIDE 74

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

Or the Wikipedia Pentagons page:

slide-75
SLIDE 75

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

Annalisa Guzzini (an architect, my wife) and I developed a blueprint based on optimal packing.

  • ◮ 44mm-edge pentagons: ∼250 with old die vs. 272 with ours.

◮ 43.5mm-edge pentagons: ∼258 vs. 280.

slide-76
SLIDE 76

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

slide-77
SLIDE 77

Introduction Framework Recent Research Conclusion

Net Benefits of Adoption

10th 25th 50th 75th 90th mean net variable cost reduction (%) 0.42 0.61 0.82 1.09 1.47 0.89 (0.11) (0.10) (0.09) (0.19) (0.27) (0.11) % net variable cost/avg % profit rate 4.55 6.82 10.63 16.56 24.42 13.07 (1.05) (1.13) (1.60) (2.35) (4.15) (1.79) total cost savings per month (Rs 000s) 3.66 9.82 41.35 135.92 397.95 137.77 (0.99) (2.33) (9.43) (36.39) (130.62) (31.68) total cost savings per cutter per month (Rs 000s) 2.75 6.47 14.91 33.83 63.61 27.31 (0.83) (1.33) (2.43) (6.28) (14.02) (5.04) days to recover fixed costs 10.28 19.11 43.03 100.86 247.53 168.80 (2.23) (3.66) (7.37) (21.74) (76.42) (84.72) days to recover fixed costs (no die) 5.34 9.92 22.34 52.37 128.53 87.64 (1.16) (1.90) (3.83) (11.29) (39.68) (43.99)

◮ We estimate that 50% of tech drop firms would recover fixed costs in 23 days or less, 75% in 53 days or less.

Full table Pentagons per sheet
slide-78
SLIDE 78

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

slide-79
SLIDE 79

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms.

slide-80
SLIDE 80

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not.

slide-81
SLIDE 81

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not. ◮ Cutters didn’t like the die.

slide-82
SLIDE 82

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not. ◮ Cutters didn’t like the die.

◮ They are paid piece rates, with no incentive to reduce waste,

and the new die was slowing them down.

slide-83
SLIDE 83

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not. ◮ Cutters didn’t like the die.

◮ They are paid piece rates, with no incentive to reduce waste,

and the new die was slowing them down.

◮ They told owners it didn’t work.

slide-84
SLIDE 84

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not. ◮ Cutters didn’t like the die.

◮ They are paid piece rates, with no incentive to reduce waste,

and the new die was slowing them down.

◮ They told owners it didn’t work.

◮ We did a second experiment.

slide-85
SLIDE 85

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not. ◮ Cutters didn’t like the die.

◮ They are paid piece rates, with no incentive to reduce waste,

and the new die was slowing them down.

◮ They told owners it didn’t work.

◮ We did a second experiment.

◮ Offered bonus of one month’s pay to show owners that dies

work.

slide-86
SLIDE 86

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not. ◮ Cutters didn’t like the die.

◮ They are paid piece rates, with no incentive to reduce waste,

and the new die was slowing them down.

◮ They told owners it didn’t work.

◮ We did a second experiment.

◮ Offered bonus of one month’s pay to show owners that dies

work.

◮ Workers accepted and about 50% of affected firms adopted.

slide-87
SLIDE 87

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not. ◮ Cutters didn’t like the die.

◮ They are paid piece rates, with no incentive to reduce waste,

and the new die was slowing them down.

◮ They told owners it didn’t work.

◮ We did a second experiment.

◮ Offered bonus of one month’s pay to show owners that dies

work.

◮ Workers accepted and about 50% of affected firms adopted.

◮ We argue that the results are not due simply to us subsidizing the fixed costs of adoption.

slide-88
SLIDE 88

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not. ◮ Cutters didn’t like the die.

◮ They are paid piece rates, with no incentive to reduce waste,

and the new die was slowing them down.

◮ They told owners it didn’t work.

◮ We did a second experiment.

◮ Offered bonus of one month’s pay to show owners that dies

work.

◮ Workers accepted and about 50% of affected firms adopted.

◮ We argue that the results are not due simply to us subsidizing the fixed costs of adoption.

◮ Hard to reconcile with both initial non-adoption and adoption

in response to small incentives.

slide-89
SLIDE 89

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Quick summary:

◮ We gave out the new dies to a random subset of firms. ◮ A few adopted, most did not. ◮ Cutters didn’t like the die.

◮ They are paid piece rates, with no incentive to reduce waste,

and the new die was slowing them down.

◮ They told owners it didn’t work.

◮ We did a second experiment.

◮ Offered bonus of one month’s pay to show owners that dies

work.

◮ Workers accepted and about 50% of affected firms adopted.

◮ We argue that the results are not due simply to us subsidizing the fixed costs of adoption.

◮ Hard to reconcile with both initial non-adoption and adoption

in response to small incentives.

◮ It appears that second experiment induced information flow in

firm.

slide-90
SLIDE 90

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Interpretation:

slide-91
SLIDE 91

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Interpretation:

◮ Conflict of interest within the firm can prevent adoption of a

“no-brainer” technology.

slide-92
SLIDE 92

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Interpretation:

◮ Conflict of interest within the firm can prevent adoption of a

“no-brainer” technology.

◮ The conflict of interest can be thought of as a lack of

  • rganizational capability.
slide-93
SLIDE 93

Introduction Framework Recent Research Conclusion

Soccer-ball Experiment (cont.)

◮ Interpretation:

◮ Conflict of interest within the firm can prevent adoption of a

“no-brainer” technology.

◮ The conflict of interest can be thought of as a lack of

  • rganizational capability.

◮ Reinforces view of Bloom et al. (2013) that “information

failures” explain lack of adoption.

slide-94
SLIDE 94

Introduction Framework Recent Research Conclusion

Conclusion

◮ The mere fact that Πit(kH) > Πit(kL) in developed countries does not imply that Πit(kH) > Πit(kL) in developing countries.

slide-95
SLIDE 95

Introduction Framework Recent Research Conclusion

Conclusion

◮ The mere fact that Πit(kH) > Πit(kL) in developed countries does not imply that Πit(kH) > Πit(kL) in developing countries.

◮ Developing-country firms have different capabilities, {λijkt},

and face different product-demand and input-supply functions {Pijt}, {

Wijkt}.

slide-96
SLIDE 96

Introduction Framework Recent Research Conclusion

Conclusion

◮ The mere fact that Πit(kH) > Πit(kL) in developed countries does not imply that Πit(kH) > Πit(kL) in developing countries.

◮ Developing-country firms have different capabilities, {λijkt},

and face different product-demand and input-supply functions {Pijt}, {

Wijkt}.

◮ Statement applies to management practices as well as to

machines.

slide-97
SLIDE 97

Introduction Framework Recent Research Conclusion

Conclusion

◮ The mere fact that Πit(kH) > Πit(kL) in developed countries does not imply that Πit(kH) > Πit(kL) in developing countries.

◮ Developing-country firms have different capabilities, {λijkt},

and face different product-demand and input-supply functions {Pijt}, {

Wijkt}.

◮ Statement applies to management practices as well as to

machines.

◮ That said, it does appear that there are cases where more technically efficient technologies are not adopted, e.g.:

◮ Keeping track of inventories. ◮ Offset die.

slide-98
SLIDE 98

Introduction Framework Recent Research Conclusion

Conclusion

◮ The mere fact that Πit(kH) > Πit(kL) in developed countries does not imply that Πit(kH) > Πit(kL) in developing countries.

◮ Developing-country firms have different capabilities, {λijkt},

and face different product-demand and input-supply functions {Pijt}, {

Wijkt}.

◮ Statement applies to management practices as well as to

machines.

◮ That said, it does appear that there are cases where more technically efficient technologies are not adopted, e.g.:

◮ Keeping track of inventories. ◮ Offset die.

◮ We have some results on what is getting in the way, e.g.:

◮ Lack of manager know-how. ◮ Organizational barriers to information flows.

slide-99
SLIDE 99

Introduction Framework Recent Research Conclusion

Conclusion (cont.)

◮ But the literature on technology adoption in non-agricultural firms in developing countries (with direct observation of adoption) is still pretty wide open.

◮ Little evidence on input-side drivers of adoption. ◮ Little evidence on output-side drivers of adoption. ◮ More to do on learning, capabilities, internal-to-the-firm

drivers.

slide-100
SLIDE 100

Introduction Framework Recent Research Conclusion

Conclusion (cont.)

◮ But the literature on technology adoption in non-agricultural firms in developing countries (with direct observation of adoption) is still pretty wide open.

◮ Little evidence on input-side drivers of adoption. ◮ Little evidence on output-side drivers of adoption. ◮ More to do on learning, capabilities, internal-to-the-firm

drivers.

◮ We’ve got out work cut out for us!

slide-101
SLIDE 101

Introduction Framework Recent Research Conclusion

References I

Alfaro-Urena, Alfonso, Isabela Manelici, and Jose P. Vasquez, “The Effects of Joining Multinational Supply Chains: New Evidence from Firm-to-Firm Linkages,” 2019. Unpub. paper. Atkin, David, Amit K. Khandelwal, and Adam Osman, “Exporting and Firm Performance: Evidence from a Randomized Trial,” Quarterly Journal of Economics, 2017, 132 (2), 551–615. , Azam Chaudhry, Shamyla Chaudry, Amit K. Khandelwal, and Eric Verhoogen, “Organizational Barriers to Technology Adoption: Evidence from Soccer-Ball Producers in Pakistan,” Quarterly Journal of Economics, 2017, 132 (3), 1101–1164. Bas, Maria and Vanessa Strauss-Kahn, “Input-Trade Liberalization, Export Prices and Quality Upgrading,” Journal

  • f International Economics, 2015, 95 (2), 250–262.

Bloom, Nicholas, Benn Eifert, Aprajit Mahajan, David McKenzie, and John Roberts, “Does Management Matter? Evidence from India,” 2011. NBER Working Paper No. 16658. , , , , and , “Does Management Matter? Evidence from India,” Quarterly Journal of Economics, February 2013, 128 (1), 1–51. Boudreau, Laura, “Multinational Enforcement of Labor Law: Experimental Evidence from Bangladesh’s Apparel Sector,” 2019. Unpub. paper. Bruhn, Miriam, Dean Karlan, and Antoinette Schoar, “The Impact of Consulting Services on Small and Medium Enterprises: Evidence from a Randomized Trial in Mexico,” Journal of Political Economy, 2018, 126 (2), 635–687. Bustos, Paula, “Trade Liberalization, Exports and Technology Upgrading: Evidence on the Impact of MERCOSUR

  • n Argentinian Firms,” American Economic Review, 2011, 101 (1), 304–340.

Cai, Jing and Adam Szeidl, “Interfirm Relationships and Business Performance,” The Quarterly journal of economics, 2017, 133 (3), 1229–1282.

slide-102
SLIDE 102

Introduction Framework Recent Research Conclusion

References II

Das, Sanghamitra, Kala Krishna, Sergey Lychagin, and Rohini Somanathan, “Back on the rails: competition and productivity in state-owned industry,” American Economic Journal: Applied Economics, 2013, 5 (1), 136–162. Gerschenkron, Alexander, Economic Backwardness in Historical Perspective: A Book of Essays, Harvard University Press, 1962. Gibbons, Robert, “Inside Organizations: Pricing, Politics, and Path Dependence,” Annual Review of Economics, 2010, 2 (1), 337–365. Hardy, Morgan and Jamie McCasland, “It Takes Two: Experimental Evidence on the Determinants of Technology Diffusion,” 2016. Unpub. paper, University of British Columbia. Hornbeck, R. and S. Naidu, “When the Levee Breaks: Black Migration and Economic Development in the American South,” American Economic Review, 2014, 104 (3), 963–990. Kuperberg, G. and W. Kuperberg, “Double-Lattice Packings of Convex Bodies in the Plane,” Discrete & Computational Geometry, 1990, 5, 389–397. Leibenstein, Harvey, “Allocative Efficiency vs. X-efficiency,” American Economic Review, 1966, 56, 24–31. Lileeva, Alla and Daniel Trefler, “Improved Access to Foreign Markets Raises Plant-Level Productivity ... For Some Plants,” Quarterly Journal of Economics, August 2010, 125 (3), 1051–1099. Schmitz, James A., “What Determines Productivity? Lessons from the Dramatic Recovery of the U.S. and Canadian Iron Ore Industries Following Their Early 1980s Crisis,” Journal of Political Economy, 2005, 113 (3),

  • pp. 582–625.

Stole, Lars A. and Jeffrey Zwiebel, “Intra-Firm Bargaining under Non-Binding Contracts,” The Review of Economic Studies, 1996, 63 (3), pp. 375–410.

slide-103
SLIDE 103

Introduction Framework Recent Research Conclusion

References III

Tanaka, Mari, “Exporting Sweatshops? Evidence from Myanmar,” Review of Economics and Statistics, forthcoming. Verhoogen, Eric, “Trade, Quality Upgrading, and Wage Inequality in the Mexican Manufacturing Sector,” Quarterly Journal of Economics, 2008, 123 (2), 489–530.

slide-104
SLIDE 104

Thank you!