Contrasting approaches A Critical Analysis of US standards effort is older the Council of Europe Rec- CoE doc. is now two years old ommendations First FEC standards were produced in 1990 on e-voting Margaret Result – wider use McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Contrasting approaches A Critical Analysis of US standards effort is older the Council of Europe Rec- CoE doc. is now two years old ommendations First FEC standards were produced in 1990 on e-voting Margaret Result – wider use McGaley and J. Paul Gibson US standards nominally voluntary, legally required in many states Introduction Standards Examples Conclusion
Contrasting approaches A Critical Analysis of US standards effort is older the Council of Europe Rec- CoE doc. is now two years old ommendations First FEC standards were produced in 1990 on e-voting Margaret Result – wider use McGaley and J. Paul Gibson US standards nominally voluntary, legally required in many states Introduction To my knowledge only Belgium is using CoE doc Standards Examples Conclusion
Contrasting approaches A Critical Analysis of US standards effort is older the Council of Europe Rec- CoE doc. is now two years old ommendations First FEC standards were produced in 1990 on e-voting Margaret Result – wider use McGaley and J. Paul Gibson US standards nominally voluntary, legally required in many states Introduction To my knowledge only Belgium is using CoE doc Standards Size Examples Conclusion
Contrasting approaches A Critical Analysis of US standards effort is older the Council of Europe Rec- CoE doc. is now two years old ommendations First FEC standards were produced in 1990 on e-voting Margaret Result – wider use McGaley and J. Paul Gibson US standards nominally voluntary, legally required in many states Introduction To my knowledge only Belgium is using CoE doc Standards Size Examples US standards – 2 volumes = 22 documents = almost 300 Conclusion pages
Contrasting approaches A Critical Analysis of US standards effort is older the Council of Europe Rec- CoE doc. is now two years old ommendations First FEC standards were produced in 1990 on e-voting Margaret Result – wider use McGaley and J. Paul Gibson US standards nominally voluntary, legally required in many states Introduction To my knowledge only Belgium is using CoE doc Standards Size Examples US standards – 2 volumes = 22 documents = almost 300 Conclusion pages CoE doc 21 pages (explanatory memorandum 67 pages)
Contrasting approaches A Critical Analysis of US standards effort is older the Council of Europe Rec- CoE doc. is now two years old ommendations First FEC standards were produced in 1990 on e-voting Margaret Result – wider use McGaley and J. Paul Gibson US standards nominally voluntary, legally required in many states Introduction To my knowledge only Belgium is using CoE doc Standards Size Examples US standards – 2 volumes = 22 documents = almost 300 Conclusion pages CoE doc 21 pages (explanatory memorandum 67 pages) EAC doc. has much finer granularity
Contrasting approaches A Critical Analysis of US standards effort is older the Council of Europe Rec- CoE doc. is now two years old ommendations First FEC standards were produced in 1990 on e-voting Margaret Result – wider use McGaley and J. Paul Gibson US standards nominally voluntary, legally required in many states Introduction To my knowledge only Belgium is using CoE doc Standards Size Examples US standards – 2 volumes = 22 documents = almost 300 Conclusion pages CoE doc 21 pages (explanatory memorandum 67 pages) EAC doc. has much finer granularity eg CoE doc. passing reference to testing (standard 111)
Contrasting approaches A Critical Analysis of US standards effort is older the Council of Europe Rec- CoE doc. is now two years old ommendations First FEC standards were produced in 1990 on e-voting Margaret Result – wider use McGaley and J. Paul Gibson US standards nominally voluntary, legally required in many states Introduction To my knowledge only Belgium is using CoE doc Standards Size Examples US standards – 2 volumes = 22 documents = almost 300 Conclusion pages CoE doc 21 pages (explanatory memorandum 67 pages) EAC doc. has much finer granularity eg CoE doc. passing reference to testing (standard 111) EAC standards list and elaborate on 5 categories of testing
Standards, analysis, requirements capture A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret Analysis - maximising problem domain understanding McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Standards, analysis, requirements capture A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret Analysis - maximising problem domain understanding McGaley and J. Paul Gibson Interaction w/customer, potential users Introduction Standards Examples Conclusion
Standards, analysis, requirements capture A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret Analysis - maximising problem domain understanding McGaley and J. Paul Gibson Interaction w/customer, potential users Introduction General analysis makes specific analysis easier Standards Examples Conclusion
Standards, analysis, requirements capture A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret Analysis - maximising problem domain understanding McGaley and J. Paul Gibson Interaction w/customer, potential users Introduction General analysis makes specific analysis easier Standards Standards doc in general problem domain Examples useful in requirements capture for a specific system Conclusion
Standards and the public A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and Standards could increase trust J. Paul Gibson Introduction Standards Examples Conclusion
Standards and the public A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and Standards could increase trust J. Paul Gibson Associations with CoE alone could increase trust (rightly or Introduction wrongly) Standards Examples Conclusion
Standards and the public A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and Standards could increase trust J. Paul Gibson Associations with CoE alone could increase trust (rightly or Introduction wrongly) Standards If written to address specific concerns ... Examples Conclusion
Standards and the public A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and Standards could increase trust J. Paul Gibson Associations with CoE alone could increase trust (rightly or Introduction wrongly) Standards If written to address specific concerns ... Examples Standards used to reject inadequate systems Conclusion
Standards and government A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and J. Paul Gibson Govs need expert advise Introduction Standards Examples Conclusion
Standards and government A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and J. Paul Gibson Govs need expert advise Introduction Standards are reusable expertise Standards Examples Conclusion
Standards and government A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and J. Paul Gibson Govs need expert advise Introduction Standards are reusable expertise Standards Should help procure better systems Examples Conclusion
Standards and manufacturers A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and Improve quality of product J. Paul Gibson Introduction Standards Examples Conclusion
Standards and manufacturers A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and Improve quality of product J. Paul Gibson Maintain, identify customer base Introduction Standards Examples Conclusion
Standards and manufacturers A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and Improve quality of product J. Paul Gibson Maintain, identify customer base Introduction Aid design decisions - by making priorities clear Standards Examples Conclusion
Standards and manufacturers A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and Improve quality of product J. Paul Gibson Maintain, identify customer base Introduction Aid design decisions - by making priorities clear Standards Examples Feedback to improve standards Conclusion
Original Standards Themselves A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and J. Paul Gibson First glance Introduction Standards Examples Conclusion
Original Standards Themselves A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and J. Paul Gibson First glance Introduction Clearly written by committee Standards Examples Conclusion
Original Standards Themselves A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and J. Paul Gibson First glance Introduction Clearly written by committee Standards Vague and ill-defined, or overly technical, or nonsensical Examples Conclusion
Soft/eng view of original standards A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Consistency Margaret McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Soft/eng view of original standards A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Consistency Margaret McGaley and Completeness, scope J. Paul Gibson Introduction Standards Examples Conclusion
Soft/eng view of original standards A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Consistency Margaret McGaley and Completeness, scope J. Paul Gibson Over specification Introduction Standards Examples Conclusion
Soft/eng view of original standards A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Consistency Margaret McGaley and Completeness, scope J. Paul Gibson Over specification Introduction Standards Underspecification Examples Conclusion
Soft/eng view of original standards A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Consistency Margaret McGaley and Completeness, scope J. Paul Gibson Over specification Introduction Standards Underspecification Examples Redundancy, repetition Conclusion
Soft/eng view of original standards A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Consistency Margaret McGaley and Completeness, scope J. Paul Gibson Over specification Introduction Standards Underspecification Examples Redundancy, repetition Conclusion Maintainability, extensibility
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations on e-voting Margaret McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Margaret McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Original began like this, but didn’t follow it through Margaret McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Original began like this, but didn’t follow it through Margaret McGaley and Direct suffrage J. Paul Gibson Introduction Standards Examples Conclusion
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Original began like this, but didn’t follow it through Margaret McGaley and Direct suffrage J. Paul Gibson “the ballots cast by the voters directly determine the Introduction person(s) elected” Standards Examples Conclusion
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Original began like this, but didn’t follow it through Margaret McGaley and Direct suffrage J. Paul Gibson “the ballots cast by the voters directly determine the Introduction person(s) elected” Standards any measure used to protect the votes from tampering Examples Conclusion
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Original began like this, but didn’t follow it through Margaret McGaley and Direct suffrage J. Paul Gibson “the ballots cast by the voters directly determine the Introduction person(s) elected” Standards any measure used to protect the votes from tampering Examples any measure to ensure that the results are tabulated Conclusion correctly.
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Original began like this, but didn’t follow it through Margaret McGaley and Direct suffrage J. Paul Gibson “the ballots cast by the voters directly determine the Introduction person(s) elected” Standards any measure used to protect the votes from tampering Examples any measure to ensure that the results are tabulated Conclusion correctly. Organising reqs like this helps
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Original began like this, but didn’t follow it through Margaret McGaley and Direct suffrage J. Paul Gibson “the ballots cast by the voters directly determine the Introduction person(s) elected” Standards any measure used to protect the votes from tampering Examples any measure to ensure that the results are tabulated Conclusion correctly. Organising reqs like this helps prevent inconsistency and redundancy
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Original began like this, but didn’t follow it through Margaret McGaley and Direct suffrage J. Paul Gibson “the ballots cast by the voters directly determine the Introduction person(s) elected” Standards any measure used to protect the votes from tampering Examples any measure to ensure that the results are tabulated Conclusion correctly. Organising reqs like this helps prevent inconsistency and redundancy maximise cover - prevent underspecification
Proposal: reverse engineering, restructuring A Critical Analysis of Categorised according to five rights the Council of Europe Rec- ommendations Universal, equal, free, secret, direct suffrage on e-voting Original began like this, but didn’t follow it through Margaret McGaley and Direct suffrage J. Paul Gibson “the ballots cast by the voters directly determine the Introduction person(s) elected” Standards any measure used to protect the votes from tampering Examples any measure to ensure that the results are tabulated Conclusion correctly. Organising reqs like this helps prevent inconsistency and redundancy maximise cover - prevent underspecification easier to understand and use
New structured reqs A Critical Analysis of the Council of Europe Rec- ommendations About 80 on e-voting Margaret McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
New structured reqs A Critical Analysis of the Council of Europe Rec- ommendations About 80 on e-voting Margaret Most needed rewording McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
New structured reqs A Critical Analysis of the Council of Europe Rec- ommendations About 80 on e-voting Margaret Most needed rewording McGaley and J. Paul Gibson Many covered more than one idea Introduction Divided with letters (a, b, ...) Standards Examples Conclusion
New structured reqs A Critical Analysis of the Council of Europe Rec- ommendations About 80 on e-voting Margaret Most needed rewording McGaley and J. Paul Gibson Many covered more than one idea Introduction Divided with letters (a, b, ...) Standards Many could be grouped together Examples Conclusion
New structured reqs A Critical Analysis of the Council of Europe Rec- ommendations About 80 on e-voting Margaret Most needed rewording McGaley and J. Paul Gibson Many covered more than one idea Introduction Divided with letters (a, b, ...) Standards Many could be grouped together Examples 15 left out Conclusion Irrelevant, inadvisable, undecipherable, unjustifiable
New structured reqs A Critical Analysis of the Council of Europe Rec- ommendations About 80 on e-voting Margaret Most needed rewording McGaley and J. Paul Gibson Many covered more than one idea Introduction Divided with letters (a, b, ...) Standards Many could be grouped together Examples 15 left out Conclusion Irrelevant, inadvisable, undecipherable, unjustifiable Phrase “competent electoral authorities”
Requirements added A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret 19 (3d) McGaley and J. Paul Gibson There shall be a bug-tracking system. Introduction Standards Examples Conclusion
Requirements added A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret 19 (3d) McGaley and J. Paul Gibson There shall be a bug-tracking system. 20 (4) Introduction Standards Security arrangements shall ensure that, for the duration of Examples operation, each component is the version tested and Conclusion approved for use.
Requirements rephrased A Critical Analysis of the Council of Europe Rec- (original) ommendations on e-voting 76. Where incidents that could threaten the integrity of Margaret the system occur, those responsible for operating the McGaley and J. Paul Gibson equipment shall immediately inform the competent electoral authorities , who will take the necessary steps to Introduction mitigate the effects of the incident. The level of incident Standards which shall be reported shall be specified in advance by the Examples electoral authorities. Conclusion
Requirements rephrased A Critical Analysis of the Council of Europe Rec- (original) ommendations on e-voting 76. Where incidents that could threaten the integrity of Margaret the system occur, those responsible for operating the McGaley and J. Paul Gibson equipment shall immediately inform the competent electoral authorities , who will take the necessary steps to Introduction mitigate the effects of the incident. The level of incident Standards which shall be reported shall be specified in advance by the Examples electoral authorities. Conclusion (our revision) 20 (5). Incident levels shall be defined and appropriate responses identified.
Requirements rephrased A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret (original) McGaley and J. Paul Gibson 74b. Any substantial changes to key equipment shall be notified . Introduction Standards Examples Conclusion
Requirements rephrased A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret (original) McGaley and J. Paul Gibson 74b. Any substantial changes to key equipment shall be notified . Introduction (our revision) Standards Examples 20 (6f). Any changes to key equipment shall be notified to Conclusion the authorities identified in the control procedure.
Requirements merged A Critical (original) Analysis of the Council of Europe Rec- ommendations on e-voting Margaret McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Requirements merged A Critical (original) Analysis of the Council of 25. Before any e-voting system is introduced, and at Europe Rec- ommendations appropriate intervals thereafter, and in particular after any on e-voting changes are made to the system, an independent body, Margaret appointed by the electoral authorities , shall verify that the McGaley and J. Paul Gibson e-voting system is working correctly and that all the necessary security measures have been taken. Introduction Standards Examples Conclusion
Requirements merged A Critical (original) Analysis of the Council of 25. Before any e-voting system is introduced, and at Europe Rec- ommendations appropriate intervals thereafter, and in particular after any on e-voting changes are made to the system, an independent body, Margaret appointed by the electoral authorities , shall verify that the McGaley and J. Paul Gibson e-voting system is working correctly and that all the necessary security measures have been taken. Introduction 31. Before any e-election or e-referendum takes place, the Standards competent electoral authority shall satisfy itself that the Examples e-voting system is genuine and operates correctly . Conclusion
Requirements merged A Critical (original) Analysis of the Council of 25. Before any e-voting system is introduced, and at Europe Rec- ommendations appropriate intervals thereafter, and in particular after any on e-voting changes are made to the system, an independent body, Margaret appointed by the electoral authorities , shall verify that the McGaley and J. Paul Gibson e-voting system is working correctly and that all the necessary security measures have been taken. Introduction 31. Before any e-election or e-referendum takes place, the Standards competent electoral authority shall satisfy itself that the Examples e-voting system is genuine and operates correctly . Conclusion 73. Before each election or referendum, the equipment shall be checked and approved in accordance with a protocol drawn up by the competent electoral authorities. The equipment shall be checked to ensure that it complies with technical specifications . The findings shall be submitted to the competent electoral authorities .
Requirements merged A Critical Analysis of the Council of Europe Rec- ommendations on e-voting Margaret (our revision) McGaley and J. Paul Gibson 19 (6). The certification authority shall develop a test plan which covers testing to be carried out: before the system is Introduction introduced, at regular intervals, and triggered by specific Standards events (for example software updates, upcoming elections) Examples as well as the timing of such tests. Conclusion
Requirements merged A Critical Analysis of the Council of Europe Rec- ommendations (original) on e-voting Margaret McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Requirements merged A Critical Analysis of the Council of Europe Rec- ommendations (original) on e-voting 72a. Those responsible for the equipment shall use special Margaret McGaley and procedures to ensure that during the polling period the J. Paul Gibson voting equipment and its use satisfy requirements. Introduction Standards Examples Conclusion
Requirements merged A Critical Analysis of the Council of Europe Rec- ommendations (original) on e-voting 72a. Those responsible for the equipment shall use special Margaret McGaley and procedures to ensure that during the polling period the J. Paul Gibson voting equipment and its use satisfy requirements. Introduction 79a. The e-voting system shall perform regular checks to Standards ensure that its components operate in accordance with its Examples technical specifications. Conclusion
Requirements merged A Critical Analysis of the Council of Europe Rec- ommendations (original) on e-voting 72a. Those responsible for the equipment shall use special Margaret McGaley and procedures to ensure that during the polling period the J. Paul Gibson voting equipment and its use satisfy requirements. Introduction 79a. The e-voting system shall perform regular checks to Standards ensure that its components operate in accordance with its Examples technical specifications. Conclusion (our revision) 20 (3). The system shall be monitored during operation for compliance with requirements.
Requirements contradicted A Critical Analysis of the Council of Europe Rec- ommendations (original) on e-voting 84. The e-voting system shall maintain reliable Margaret McGaley and synchronised time sources . The accuracy of the time J. Paul Gibson source shall be sufficient to maintain time marks for audit Introduction trails and observations data, as well as for maintaining the Standards time limits for registration, nomination, voting, or Examples counting. Conclusion
Requirements contradicted A Critical Analysis of the Council of Europe Rec- ommendations (original) on e-voting 84. The e-voting system shall maintain reliable Margaret McGaley and synchronised time sources . The accuracy of the time J. Paul Gibson source shall be sufficient to maintain time marks for audit Introduction trails and observations data, as well as for maintaining the Standards time limits for registration, nomination, voting, or Examples counting. Conclusion (our revision) 19(2). Components’ access to time sources shall be strictly limited on a “need to know” basis.
Requirements contradicted A Critical Analysis of (original) the Council of Europe Rec- ommendations on e-voting Margaret McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Requirements contradicted A Critical Analysis of (original) the Council of Europe Rec- 24. The components of the e-voting system shall be ommendations on e-voting disclosed, at least to the competent electoral authorities, as required for verification and certification purposes. Margaret McGaley and J. Paul Gibson Introduction Standards Examples Conclusion
Recommend
More recommend
