Designing Data-informed Intelligent Systems to Create Positive Impact: Design Methods, Questions and Recommendations

J.D. Lomas; Nirmal Patel; Jodi L. Forlizzi

Designing Data-informed Intelligent Systems to Create Positive Impact: Design Methods, Questions and Recommendations

J.D. Lomas, Nirmal Patel, Jodi L. Forlizzi

Design Aesthetics

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

21 Downloads (Pure)

Abstract

This paper explores several approaches for designing data-informed intelligent systems to create a positive impact. Two contrasting case studies in K12 education are used to illustrate design methods, questions and recommendations. The first case study addresses the poverty achievement gap in America and shows how product data can be used to identify areas of inequity in digital education. The second case study looks at the unintended consequences of automating data-driven optimization in the context of a digital math game. Together, the two case studies reveal generalizable knowledge that supports the design of intelligent feedback loops to create a positive impact. Further, this paper considers both the benefits and limitations of data feedback in complex social-technical systems.

Original language	English
Title of host publication	Proceedings of Relating Systems Thinking and Design (RSD10) Symposium
Editors	Mieke van der Bijl--Brouwer
Pages	154-170
Number of pages	16
ISBN (Electronic)	978-94-6366-507-0
Publication status	Published - 2021
Event	Relating Systems Thinking and Design 2021 Symposium (RSD10) - Faculty of Industrial Design Engineering, TU Delft, Delft, Netherlands Duration: 2 Nov 2021 → 6 Nov 2021 Conference number: 10 https://rsdsymposium.org https://rsdsymposium.org/off-to-new-shores-sailing-towards-common-ground/

Conference

Conference	Relating Systems Thinking and Design 2021 Symposium (RSD10)
Abbreviated title	RSD
Country/Territory	Netherlands
City	Delft
Period	2/11/21 → 6/11/21
Internet address	https://rsdsymposium.org https://rsdsymposium.org/off-to-new-shores-sailing-towards-common-ground/

Keywords

Smart Systems
Learning Organizations
Cybernetics
Poverty
Education
Artificial Intelligence
Goodhart’s Law

Access to Document

Pagina's van RSD10_Proceedings_Playing_with_tensions_TU_DelftFinal published version, 1 MBLicence: CC BY-NC-ND

https://rsdsymposium.org/towards-data-informed-system-design-for-good-methods-questions-and-recommendations-for-designers/

Cite this

Lomas, J. D., Patel, N., & Forlizzi, J. L. (2021). Designing Data-informed Intelligent Systems to Create Positive Impact: Design Methods, Questions and Recommendations. In M. van der Bijl--Brouwer (Ed.), Proceedings of Relating Systems Thinking and Design (RSD10) Symposium (pp. 154-170) https://rsdsymposium.org/towards-data-informed-system-design-for-good-methods-questions-and-recommendations-for-designers/

@inproceedings{cccf716e35f4400f871cffa2b932c4d8,

title = "Designing Data-informed Intelligent Systems to Create Positive Impact: Design Methods, Questions and Recommendations",

abstract = "This paper explores several approaches for designing data-informed intelligent systems to create a positive impact. Two contrasting case studies in K12 education are used to illustrate design methods, questions and recommendations. The first case study addresses the poverty achievement gap in America and shows how product data can be used to identify areas of inequity in digital education. The second case study looks at the unintended consequences of automating data-driven optimization in the context of a digital math game. Together, the two case studies reveal generalizable knowledge that supports the design of intelligent feedback loops to create a positive impact. Further, this paper considers both the benefits and limitations of data feedback in complex social-technical systems.",

keywords = "Smart Systems, Learning Organizations, Cybernetics, Poverty, Education, Artificial Intelligence, Goodhart{\textquoteright}s Law",

author = "J.D. Lomas and Nirmal Patel and Forlizzi, {Jodi L.}",

year = "2021",

language = "English",

pages = "154--170",

editor = "{van der Bijl--Brouwer}, Mieke",

booktitle = "Proceedings of Relating Systems Thinking and Design (RSD10) Symposium",

note = "Relating Systems Thinking and Design 2021 Symposium (RSD10), RSD ; Conference date: 02-11-2021 Through 06-11-2021",

url = "https://rsdsymposium.org, https://rsdsymposium.org/off-to-new-shores-sailing-towards-common-ground/ ",

}

Lomas, JD, Patel, N & Forlizzi, JL 2021, Designing Data-informed Intelligent Systems to Create Positive Impact: Design Methods, Questions and Recommendations. in M van der Bijl--Brouwer (ed.), Proceedings of Relating Systems Thinking and Design (RSD10) Symposium. pp. 154-170, Relating Systems Thinking and Design 2021 Symposium (RSD10), Delft, Netherlands, 2/11/21. <https://rsdsymposium.org/towards-data-informed-system-design-for-good-methods-questions-and-recommendations-for-designers/>

Designing Data-informed Intelligent Systems to Create Positive Impact: Design Methods, Questions and Recommendations. / Lomas, J.D.; Patel, Nirmal; Forlizzi, Jodi L.
Proceedings of Relating Systems Thinking and Design (RSD10) Symposium. ed. / Mieke van der Bijl--Brouwer. 2021. p. 154-170.

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Designing Data-informed Intelligent Systems to Create Positive Impact

T2 - Relating Systems Thinking and Design 2021 Symposium (RSD10)

AU - Lomas, J.D.

AU - Patel, Nirmal

AU - Forlizzi, Jodi L.

N1 - Conference code: 10

PY - 2021

Y1 - 2021

N2 - This paper explores several approaches for designing data-informed intelligent systems to create a positive impact. Two contrasting case studies in K12 education are used to illustrate design methods, questions and recommendations. The first case study addresses the poverty achievement gap in America and shows how product data can be used to identify areas of inequity in digital education. The second case study looks at the unintended consequences of automating data-driven optimization in the context of a digital math game. Together, the two case studies reveal generalizable knowledge that supports the design of intelligent feedback loops to create a positive impact. Further, this paper considers both the benefits and limitations of data feedback in complex social-technical systems.

AB - This paper explores several approaches for designing data-informed intelligent systems to create a positive impact. Two contrasting case studies in K12 education are used to illustrate design methods, questions and recommendations. The first case study addresses the poverty achievement gap in America and shows how product data can be used to identify areas of inequity in digital education. The second case study looks at the unintended consequences of automating data-driven optimization in the context of a digital math game. Together, the two case studies reveal generalizable knowledge that supports the design of intelligent feedback loops to create a positive impact. Further, this paper considers both the benefits and limitations of data feedback in complex social-technical systems.

KW - Smart Systems

KW - Learning Organizations

KW - Cybernetics

KW - Poverty

KW - Education

KW - Artificial Intelligence

KW - Goodhart’s Law

M3 - Conference contribution

SP - 154

EP - 170

BT - Proceedings of Relating Systems Thinking and Design (RSD10) Symposium

A2 - van der Bijl--Brouwer, Mieke

Y2 - 2 November 2021 through 6 November 2021

ER -

Designing Data-informed Intelligent Systems to Create Positive Impact: Design Methods, Questions and Recommendations

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this