Can there be a metrology Can there be a metrology for - - PowerPoint PPT Presentation

can there be a metrology can there be a metrology for
SMART_READER_LITE
LIVE PREVIEW

Can there be a metrology Can there be a metrology for - - PowerPoint PPT Presentation

Can there be a metrology Can there be a metrology for psychometricians? for psychometricians? Luca Mari Luca Mari Universit Cattaneo LIUC, Italy Universit Cattaneo LIUC, Italy BEAR Seminar, University of California, Berkeley


slide-1
SLIDE 1

Can there be a metrology Can there be a metrology for psychometricians? for psychometricians?

Luca Mari Luca Mari

Università Cattaneo – LIUC, Italy Università Cattaneo – LIUC, Italy BEAR Seminar, University of California, Berkeley BEAR Seminar, University of California, Berkeley Tuesday, January 31, 2017 Tuesday, January 31, 2017

slide-2
SLIDE 2

Abstract Abstract

Metrology -- the “science of measurement and its application” according to Metrology -- the “science of measurement and its application” according to the the International Vocabulary of Metrology International Vocabulary of Metrology (VIM) -- is a body of knowledge (VIM) -- is a body of knowledge traditionally bound to the measurement of physical quantities, sometimes traditionally bound to the measurement of physical quantities, sometimes with the further specification that only high quality (in some sense to be with the further specification that only high quality (in some sense to be agreed) measurement-related activities constitute actual metrology, as agreed) measurement-related activities constitute actual metrology, as those performed in the US by the NIST. those performed in the US by the NIST. Given the social reputation of measurement, it is not amazing that there is a Given the social reputation of measurement, it is not amazing that there is a tension to continue the historical process of expanding such a still strict tension to continue the historical process of expanding such a still strict scope, where in particular under scrutiny is the necessity that the object of scope, where in particular under scrutiny is the necessity that the object of measurement is a physical quantity. measurement is a physical quantity. Arguing about metrology is then a good opportunity to discuss of the very Arguing about metrology is then a good opportunity to discuss of the very nature of measurement and its limits, between science, technology, nature of measurement and its limits, between science, technology, mathematics, and society. mathematics, and society.

slide-3
SLIDE 3

Luca Mari (MS in physics, University of Milano, Italy, 1987; Ph.D. in Luca Mari (MS in physics, University of Milano, Italy, 1987; Ph.D. in measurement science, Polytechnic of Torino, Italy, 1994) since 2006 measurement science, Polytechnic of Torino, Italy, 1994) since 2006 has been a full professor of measurement science with Università has been a full professor of measurement science with Università Cattaneo - LIUC, Castellanza, Italy, where he teaches courses on Cattaneo - LIUC, Castellanza, Italy, where he teaches courses on measurement science, statistical data analysis, and system theory. measurement science, statistical data analysis, and system theory. He is currently the chairman of the TC1 (Terminology) and the secretary He is currently the chairman of the TC1 (Terminology) and the secretary

  • f the TC25 (Quantities and units) of the International Electrotechnical
  • f the TC25 (Quantities and units) of the International Electrotechnical

Commission (IEC), and an IEC expert in the WG2 (VIM) of the Joint Commission (IEC), and an IEC expert in the WG2 (VIM) of the Joint Committee for Guides in Metrology (JCGM). He has been the chairman Committee for Guides in Metrology (JCGM). He has been the chairman

  • f the TC7 (Measurement Science) of the International Measurement
  • f the TC7 (Measurement Science) of the International Measurement

Confederation (IMEKO). Confederation (IMEKO).

My profile My profile

slide-4
SLIDE 4

LM, P.Blattner, F.Pavese, LM, P.Blattner, F.Pavese, Improving the understandability of the next edition of the International System Improving the understandability of the next edition of the International System

  • f Units (SI) by focusing on its conceptual structure
  • f Units (SI) by focusing on its conceptual structure,

, Measurement Measurement, 2017 , 2017 LM, A.Maul, D.Torres Irribarra, M.Wilson, LM, A.Maul, D.Torres Irribarra, M.Wilson, Quantities, quantification, and the necessary and sufficient Quantities, quantification, and the necessary and sufficient conditions for measurement conditions for measurement, , Measurement Measurement, 2017 , 2017 D.Petri, LM, P.Carbone, D.Petri, LM, P.Carbone, A structured methodology for measurement development A structured methodology for measurement development, , IEEE Trans. Instr. IEEE Trans. Instr. Meas. Meas., 2015 , 2015 A.Mencattini, LM, A.Mencattini, LM, A conceptual framework for concept definition in measurement: the case of A conceptual framework for concept definition in measurement: the case of 'sensitivity' 'sensitivity', , Measurement Measurement, 2015 , 2015 LM, LM, Evolution of 30 years of the International Vocabulary of Metrology (VIM) Evolution of 30 years of the International Vocabulary of Metrology (VIM), , Metrologia Metrologia, 2015 , 2015 LM, D.Petri, LM, D.Petri, Measurement science: constructing bridges between reality and knowledge Measurement science: constructing bridges between reality and knowledge, , IEEE Inst. IEEE Inst.

  • Meas. Mag.
  • Meas. Mag., 2014

, 2014 P.Micheli, LM, P.Micheli, LM, The theory and practice of performance measurement The theory and practice of performance measurement, , Management Accounting Research Management Accounting Research, , 2014 2014 LM, M.Wilson, LM, M.Wilson, An introduction to the Rasch measurement approach for metrologists An introduction to the Rasch measurement approach for metrologists, , Measurement Measurement, , 2014 2014 A.Frigerio, A.Giordani, LM, A.Frigerio, A.Giordani, LM, On representing information: a characterization of the analog/digital On representing information: a characterization of the analog/digital distinction distinction, , Dialectica Dialectica, 2013 , 2013 LM, LM, A quest for the definition of measurement A quest for the definition of measurement, , Measurement Measurement, 2013 , 2013 LM, A.Giordani, LM, A.Giordani, Quantity and quantity value Quantity and quantity value, , Metrologia Metrologia, 2012 , 2012 LM, P.Carbone, D.Petri, LM, P.Carbone, D.Petri, Measurement fundamentals: a pragmatic view Measurement fundamentals: a pragmatic view, , IEEE Trans. Instr. Meas. IEEE Trans. Instr. Meas., 2012 , 2012 A.Giordani, LM, A.Giordani, LM, Measurement, models, uncertainty Measurement, models, uncertainty, , IEEE Trans. Instr. Meas. IEEE Trans. Instr. Meas., 2012 , 2012 A.Giordani, LM, A.Giordani, LM, Property evaluation types Property evaluation types, , Measurement Measurement, 2012 , 2012

Some of my recent publications Some of my recent publications

slide-5
SLIDE 5
slide-6
SLIDE 6

The (meta-)message: metrology is less monolithic The (meta-)message: metrology is less monolithic than possibly supposed “from the outside” than possibly supposed “from the outside” Taking a look at the ways it is differently interpreted Taking a look at the ways it is differently interpreted may suggest some hypotheses on how may suggest some hypotheses on how the sciences of physical and non-physical measurement the sciences of physical and non-physical measurement could learn from each other could learn from each other The proposal: The proposal: a short discussion on four interpretations a short discussion on four interpretations

  • f what metrology is,
  • f what metrology is,

each from a strict, traditional standpoint each from a strict, traditional standpoint toward a broader, encompassing view toward a broader, encompassing view

slide-7
SLIDE 7

… … with a premise, with a premise, aimed at providing a context for the discussion aimed at providing a context for the discussion and hopefully at sharing some basic concepts and terms and hopefully at sharing some basic concepts and terms

slide-8
SLIDE 8

Joint Committee Joint Committee for Guides in Metrology for Guides in Metrology

(JCGM) (JCGM)

BIPM BIPM Int.l Bureau of Weights and Measures Int.l Bureau of Weights and Measures OIML OIML Int.l Organization of Legal Metrology Int.l Organization of Legal Metrology ISO ISO Int.l Organization for Standardization Int.l Organization for Standardization IEC IEC Int.l Electrotechnical Commission Int.l Electrotechnical Commission ILAC ILAC Int.l Laboratory Accreditation Cooperation Int.l Laboratory Accreditation Cooperation IUPAP IUPAP Int.l Union of Pure and Applied Physics Int.l Union of Pure and Applied Physics IUPAC IUPAC Int.l Union of Pure and Applied Chemistry Int.l Union of Pure and Applied Chemistry IFCC IFCC Int.l Federation of Clinical Chemistry and Lab. Medicine Int.l Federation of Clinical Chemistry and Lab. Medicine

(established in 1997)

slide-9
SLIDE 9

Joint Committee Joint Committee for Guides in Metrology for Guides in Metrology

(JCGM) (JCGM)

Metrology Metrology :

: BIPM BIPM

Legal metrology Legal metrology : OIML

: OIML

Standardization Standardization : ISO

: ISO IEC IEC

Accreditation Accreditation : ILAC

: ILAC

Domain-related Domain-related :

: IUPAP (physics) IUPAC (chemistry) IUPAP (physics) IUPAC (chemistry) IFCC (clinical chemistry and lab medicine) IFCC (clinical chemistry and lab medicine)

(established in 1997)

slide-10
SLIDE 10

http://www.bipm.org/en/publications/guides/ vim.html gum.html

the VIM the GUM

JCGM “guidance docs” JCGM “guidance docs”

slide-11
SLIDE 11

The scope of JCGM The scope of JCGM

metrology metrology: «science of measurement and its application» : «science of measurement and its application» [VIM, def. 2.2] [VIM, def. 2.2]

«In this Vocabulary [the VIM], it is taken for granted that «In this Vocabulary [the VIM], it is taken for granted that there is no fundamental difference in the basic principles of measurement there is no fundamental difference in the basic principles of measurement in physics, chemistry, laboratory medicine, biology, or engineering. in physics, chemistry, laboratory medicine, biology, or engineering. Furthermore, an attempt has been made Furthermore, an attempt has been made to meet conceptual needs of measurement in fields such as to meet conceptual needs of measurement in fields such as biochemistry, food science, forensic science, and molecular biology.» biochemistry, food science, forensic science, and molecular biology.»

slide-12
SLIDE 12

A terminological premise A terminological premise

According to the VIM According to the VIM: : measurement measurement: the process of measuring : the process of measuring measurand measurand: the quantity intended to be measured : the quantity intended to be measured measurement result measurement result: the outcome of measurement, : the outcome of measurement, in the form of a in the form of a quantity value quantity value (or an interval of quantity values, a pdf on a set of quantity values, etc) (or an interval of quantity values, a pdf on a set of quantity values, etc)

(the VIM avoids the noun “measure” because too ambiguous) (the VIM avoids the noun “measure” because too ambiguous)

slide-13
SLIDE 13

A conceptual premise A conceptual premise

quantities quantities are are specific specific properties properties: : {quantities} {quantities}   {properties} {properties}

properties quantities

measurements measurements are are specific specific evaluations evaluations: : {measurements} {measurements}   {evaluations} {evaluations}

evaluations measurements

slide-14
SLIDE 14

Why could the question “ Why could the question “what is metrology? what is metrology?” ” be interesting to psychometricians? be interesting to psychometricians?

  • 1. Metrology is a socially acknowledged context of measurement
  • 1. Metrology is a socially acknowledged context of measurement
  • 2. T
  • 2. The public trust attributed to measurement results

he public trust attributed to measurement results is not attributed to the outcomes of other forms of evaluation is not attributed to the outcomes of other forms of evaluation

Hence claims such as “this information comes from a measurement”, Hence claims such as “this information comes from a measurement”, and “this information is provided by a metrological institution”, and “this information is provided by a metrological institution”, have a societal significance have a societal significance ( (and in a situation of post-truth and alternative facts... and in a situation of post-truth and alternative facts...) )

slide-15
SLIDE 15

Four interpretations: Four interpretations:

metrology is... metrology is...

  • 1. the body of knowledge
  • 1. the body of knowledge

about evaluations of physical properties about evaluations of physical properties 2.

  • 2. the body of knowledge about measures

the body of knowledge about measures 3.

  • 3. what National Metrology Institutes do

what National Metrology Institutes do

  • 4. the body of knowledge
  • 4. the body of knowledge

about evaluations of sufficiently high quality about evaluations of sufficiently high quality

slide-16
SLIDE 16

These interpretations are not alternative… These interpretations are not alternative… … … and in fact a (very conservative) position might consider metrology as and in fact a (very conservative) position might consider metrology as what National Metrology Institutes do relating to sufficiently high quality what National Metrology Institutes do relating to sufficiently high quality evaluations of physical quantities evaluations of physical quantities

More explicitly: More explicitly: «Metrology is the science of measurement. It covers three main activities: «Metrology is the science of measurement. It covers three main activities:

  • 1. the definition of internationally accepted units of measurement, e.g. the metre;
  • 1. the definition of internationally accepted units of measurement, e.g. the metre;
  • 2. the realization of units of measurement by scientific methods,
  • 2. the realization of units of measurement by scientific methods,

e.g. the realization of a metre through the use of lasers; e.g. the realization of a metre through the use of lasers;

  • 3. the establishment of traceability chains by determining and documenting
  • 3. the establishment of traceability chains by determining and documenting

the value and accuracy of a measurement and disseminating that knowledge, the value and accuracy of a measurement and disseminating that knowledge, e.g. the documented relationship between the micrometer screw in a precision e.g. the documented relationship between the micrometer screw in a precision engineering workshop and a primary laboratory for optical length metrology.» engineering workshop and a primary laboratory for optical length metrology.»

[Metrology in short, 3rd edition, EURAMET project 1011, 2008, [Metrology in short, 3rd edition, EURAMET project 1011, 2008, http://www.euramet.org/publications-media-centre/documents/metrology-in-short] http://www.euramet.org/publications-media-centre/documents/metrology-in-short]

slide-17
SLIDE 17

A mini-tutorial on metrology... A mini-tutorial on metrology...

quantities quantities

  • bjects
  • bjects
  • 1. an individual quantity is defined
  • 1. an individual quantity is defined

(kilogram, i.e., the mass of the object…): (kilogram, i.e., the mass of the object…):

quantity unit quantity unit

for each general quantity for each general quantity (e.g., mass)

(e.g., mass)

  • 2. the unit is realized into an object
  • 2. the unit is realized into an object

(IPK, the Int.l Prototype of the Kilogram): (IPK, the Int.l Prototype of the Kilogram):

primary measurement standard primary measurement standard (simplified version) (simplified version)

  • 3. other compatible standards
  • 3. other compatible standards

are realized and disseminated: are realized and disseminated: national / working standards national / working standards 3’. measuring instruments 3’. measuring instruments are calibrated against are calibrated against working standards working standards 4.

  • 4. measurement results

measurement results realization realization dissemination dissemination calibration calibration measurement measurement traceability of traceability of measurement results measurement results to the unit to the unit

slide-18
SLIDE 18

( (such a strict standpoint such a strict standpoint is plausibly not so interesting is plausibly not so interesting to psychometricians... to psychometricians...) )

slide-19
SLIDE 19

“ “Strict” metrology Strict” metrology

is about is about

with high quality with high quality instruments instruments and results and results quantities quantities evaluated evaluated intersubjectively intersubjectively via universal units via universal units physical physical

1 1 2 2 3 3 4 4

slide-20
SLIDE 20

with high quality with high quality instruments instruments and results and results quantities quantities evaluated evaluated intersubjectively intersubjectively via universal units via universal units physical physical

“ “Broad” metrology Broad” metrology

could be about could be about

? ? ? ? ? ? ? ?

slide-21
SLIDE 21

Interpretation 1 ( Interpretation 1 (disciplinary disciplinary characterization) characterization)

metrology is the body of knowledge metrology is the body of knowledge about evaluations of about evaluations of physical physical properties properties

Rationale Rationale: : measurement historically developed measurement historically developed relating to geometrical quantities relating to geometrical quantities

slide-22
SLIDE 22

Broadening interpretation 1... Broadening interpretation 1...

The concept ‘measurable property’ has widened its scope in history The concept ‘measurable property’ has widened its scope in history (the term “weights and measures” is the trace of a not so far past (the term “weights and measures” is the trace of a not so far past in which weights were not considered measures...) in which weights were not considered measures...) Q: can non-physical properties be measured? Q: can non-physical properties be measured? physical physical properties properties not only physical not only physical properties properties

slide-23
SLIDE 23

Interpretation 2 ( Interpretation 2 (semantic semantic characterization) characterization)

metrology is the body of knowledge about metrology is the body of knowledge about quantities quantities, , i.e., “measures” i.e., “measures”

Rationale Rationale: : ‘measurement’ and ‘measure’ belong to ‘measurement’ and ‘measure’ belong to the same concept system the same concept system

slide-24
SLIDE 24

Broadening interpretation 2... Broadening interpretation 2...

Despite they seem to be coextensive, Despite they seem to be coextensive, the concepts ‘measurement’ and ‘measure’ are different, the concepts ‘measurement’ and ‘measure’ are different, and measure theory is a mathematical theory about additive properties and measure theory is a mathematical theory about additive properties (i.e., Euclidean quantities and their generalizations) (i.e., Euclidean quantities and their generalizations) Q: can non-Euclidean / non-additive / non-ratio properties be measured? Q: can non-Euclidean / non-additive / non-ratio properties be measured? quantities quantities not only additive not only additive properties properties

slide-25
SLIDE 25

Interpretation 3 ( Interpretation 3 (organizational

  • rganizational characterization)

characterization)

metrology is what National Metrology Institutes (NMIs) do metrology is what National Metrology Institutes (NMIs) do to guarantee to guarantee intersubjectivity of evaluations intersubjectivity of evaluations via universal units via universal units

Rationale Rationale: : NMI activity is the foundation of the metrological system NMI activity is the foundation of the metrological system

slide-26
SLIDE 26

Broadening interpretation 3... Broadening interpretation 3...

NMIs develop and disseminate measurement standards NMIs develop and disseminate measurement standards as tools for making intersubjectivity in measurement possible as tools for making intersubjectivity in measurement possible Q: can intersubjectivity of information on empirical properties Q: can intersubjectivity of information on empirical properties be guaranteed without universal units? be guaranteed without universal units? intersubjectivity intersubjectivity by universal units by universal units intersubjectivity intersubjectivity by some general strategies by some general strategies

slide-27
SLIDE 27

Interpretation 4 ( Interpretation 4 (axiological axiological characterization) characterization)

metrology is the body of knowledge metrology is the body of knowledge about evaluations of about evaluations of sufficiently high quality sufficiently high quality

Rationale Rationale: : measurement is widespread measurement is widespread and not any measurement is a metrological activity and not any measurement is a metrological activity

slide-28
SLIDE 28

Broadening interpretation 4... Broadening interpretation 4...

Metrology is sometimes intended (particularly by NMIs) as only covering Metrology is sometimes intended (particularly by NMIs) as only covering “scientific” measurement, with “small” measurement uncertainty “scientific” measurement, with “small” measurement uncertainty What is important here is that measurement results convey information What is important here is that measurement results convey information as both quantity / property values and quality of such values as both quantity / property values and quality of such values evaluations evaluations

  • f high quality
  • f high quality

evaluations evaluations

  • f stated quality
  • f stated quality
slide-29
SLIDE 29

Synthesis Synthesis

slide-30
SLIDE 30

with high quality with high quality instruments instruments and results and results quantities quantities evaluated evaluated intersubjectively intersubjectively via universal units via universal units physical physical

From “strict” to “broad” metrology From “strict” to “broad” metrology

1 1 2 2 3 3 3 3

slide-31
SLIDE 31

with high quality with high quality instruments instruments and results and results quantities quantities evaluated evaluated intersubjectively intersubjectively via universal units via universal units physical physical

“ “Broad” metrology Broad” metrology

could be about could be about

not only physical not only physical properties properties not only additive not only additive properties properties evaluated intersubjectively evaluated intersubjectively via some general strategies via some general strategies with quality stated with quality stated according to well defined procedures according to well defined procedures

slide-32
SLIDE 32

( (such a “broad” metrology seems to be a context such a “broad” metrology seems to be a context where psychometricians and engineers where psychometricians and engineers can productively work together... can productively work together...) )

slide-33
SLIDE 33

THANK YOU THANK YOU FOR YOUR KIND ATTENTION FOR YOUR KIND ATTENTION

Luca Mari Luca Mari

lmari@liuc.it lmari@liuc.it http://research.liuc.it/luca.mari http://research.liuc.it/luca.mari

Can there be a metrology Can there be a metrology for psychometricians? for psychometricians?