Publikationen - Psychologische Ergonomie

Hiring an AI: Incorporating Personnel Selection Methods in User-Centered Design to Design AI Agents for Safety-Critical Domains. Huber, Stephan; Papenfu\ss{}, Nathalie Bettina Elisabetha; Weppert, Lea; Wohlfart, Valentina; Basch, Johannes; Happel, Oliver; Grundgeiger, Tobias. In Adjunct Proceedings of the 2024 Nordic Conference on Human-Computer Interaction, of NordiCHI ’24 Adjunct. Association for Computing Machinery, Uppsala, Sweden, 2024.

[ Abstract ]
[ BibTeX ]
[ EndNote ]
[ URL ]
[ DOI ]

Enhancing human teams with AI is currently aspired across application domains. However, the prospective team role of high-performing AI-agents is rarely considered. In this paper, we propose a new method complementing existing user-centered design processes to define an AI-agent personality that suits the team. Inspired by personnel selection methods, the hiring an AI workshop prompts teams from safety-critical domains to 1) remember past incidents, 2) envision the personality and competence of their desired teammate, and 3) validate how the teammate would act in described incidents. Clustering and modeling the data made it accessible to interdisciplinary teams. Incorporating the models into the ideation process and revisiting the data for a personality drill-down exceeded insights from contextual inquiries and had a measurable impact (i.e., downstream utility) on the visions. Participants’ humanizing descriptions of a knowing and competent, yet modest teammate raise challenges for technical implementation and questions on future team-collaboration in safety-critical domains.

@inproceedings{10.1145/3677045.3685418,
  abstract = {Enhancing human teams with AI is currently aspired across application domains. However, the prospective team role of high-performing AI-agents is rarely considered. In this paper, we propose a new method complementing existing user-centered design processes to define an AI-agent personality that suits the team. Inspired by personnel selection methods, the hiring an AI workshop prompts teams from safety-critical domains to 1) remember past incidents, 2) envision the personality and competence of their desired teammate, and 3) validate how the teammate would act in described incidents. Clustering and modeling the data made it accessible to interdisciplinary teams. Incorporating the models into the ideation process and revisiting the data for a personality drill-down exceeded insights from contextual inquiries and had a measurable impact (i.e., downstream utility) on the visions. Participants’ humanizing descriptions of a knowing and competent, yet modest teammate raise challenges for technical implementation and questions on future team-collaboration in safety-critical domains.},
  address = {New York, NY, USA},
  author = {Huber, Stephan and Papenfu\ss{}, Nathalie Bettina Elisabetha and Weppert, Lea and Wohlfart, Valentina and Basch, Johannes and Happel, Oliver and Grundgeiger, Tobias},
  booktitle = {Adjunct Proceedings of the 2024 Nordic Conference on Human-Computer Interaction},
  keywords = {grundgeiger},
  publisher = {Association for Computing Machinery},
  series = {NordiCHI '24 Adjunct},
  title = {Hiring an AI: Incorporating Personnel Selection Methods in User-Centered Design to Design AI Agents for Safety-Critical Domains},
  year = 2024
}

%0 Conference Paper
%1 10.1145/3677045.3685418
%A Huber, Stephan
%A Papenfu\ss{}, Nathalie Bettina Elisabetha
%A Weppert, Lea
%A Wohlfart, Valentina
%A Basch, Johannes
%A Happel, Oliver
%A Grundgeiger, Tobias
%B Adjunct Proceedings of the 2024 Nordic Conference on Human-Computer Interaction
%C New York, NY, USA
%D 2024
%I Association for Computing Machinery
%R 10.1145/3677045.3685418
%T Hiring an AI: Incorporating Personnel Selection Methods in User-Centered Design to Design AI Agents for Safety-Critical Domains
%U https://doi.org/10.1145/3677045.3685418
%X Enhancing human teams with AI is currently aspired across application domains. However, the prospective team role of high-performing AI-agents is rarely considered. In this paper, we propose a new method complementing existing user-centered design processes to define an AI-agent personality that suits the team. Inspired by personnel selection methods, the hiring an AI workshop prompts teams from safety-critical domains to 1) remember past incidents, 2) envision the personality and competence of their desired teammate, and 3) validate how the teammate would act in described incidents. Clustering and modeling the data made it accessible to interdisciplinary teams. Incorporating the models into the ideation process and revisiting the data for a personality drill-down exceeded insights from contextual inquiries and had a measurable impact (i.e., downstream utility) on the visions. Participants’ humanizing descriptions of a knowing and competent, yet modest teammate raise challenges for technical implementation and questions on future team-collaboration in safety-critical domains.
%@ 9798400709654

The Potential of Using Generative AI/NLP to Identify and Analyse Critical Incidents in a Critical Incident Reporting System (CIRS): A Feasibility Case–Control Study. Hölzing, Carlos Ramon; Rumpf, Sebastian; Huber, Stephan; Papenfuß, Nathalie; Meybohm, Patrick; Happel, Oliver. In Healthcare, 12(19), p. 1964. 2024.

[ BibTeX ]
[ EndNote ]
[ URL ]

@article{RN1850,
  author = {Hölzing, Carlos Ramon and Rumpf, Sebastian and Huber, Stephan and Papenfuß, Nathalie and Meybohm, Patrick and Happel, Oliver},
  journal = {Healthcare},
  keywords = {papenfuß},
  number = 19,
  pages = 1964,
  title = {The Potential of Using Generative AI/NLP to Identify and Analyse Critical Incidents in a Critical Incident Reporting System (CIRS): A Feasibility Case–Control Study},
  type = {Journal Article},
  volume = 12,
  year = 2024
}

%0 Journal Article
%1 RN1850
%A Hölzing, Carlos Ramon
%A Rumpf, Sebastian
%A Huber, Stephan
%A Papenfuß, Nathalie
%A Meybohm, Patrick
%A Happel, Oliver
%D 2024
%J Healthcare
%N 19
%P 1964
%T The Potential of Using Generative AI/NLP to Identify and Analyse Critical Incidents in a Critical Incident Reporting System (CIRS): A Feasibility Case–Control Study
%U https://www.mdpi.com/2227-9032/12/19/1964
%V 12

Hiring an AI: The Design of an Artificial Team-Member for Anesthesiology. Huber, Stephan; Papenfuß, Nathalie; Grundgeiger, Tobias; Basch, Johannes; Happel, Oliver. In CHI’23 workshop on Intelligent Data-Driven Health Interfaces. 2023.

[ BibTeX ]
[ EndNote ]
[ URL ]

@inproceedings{RN1473,
  author = {Huber, Stephan and Papenfuß, Nathalie and Grundgeiger, Tobias and Basch, Johannes and Happel, Oliver},
  booktitle = {CHI’23 workshop on Intelligent Data-Driven Health Interfaces},
  keywords = {grundgeiger},
  title = {Hiring an AI: The Design of an Artificial Team-Member for Anesthesiology},
  type = {Conference Proceedings},
  year = 2023
}

%0 Conference Paper
%1 RN1473
%A Huber, Stephan
%A Papenfuß, Nathalie
%A Grundgeiger, Tobias
%A Basch, Johannes
%A Happel, Oliver
%B CHI’23 workshop on Intelligent Data-Driven Health Interfaces
%D 2023
%T Hiring an AI: The Design of an Artificial Team-Member for Anesthesiology
%U https://iddhi2022.create.aau.dk/?page_id=53

Side Effects of Increasing Participation in a Contextual Design Process: A Knowledge Management Case Study. Papenfuß, Nathalie; Spangenberger, Carina; Huber, Stephan. In Mensch und Computer 2022, of MuC ’22, M. Mühlhäuser, C. Reuter, B. Pfleging, T. Kosch, A. Matviienko, K. Gerling, S. Mayer, W. Heuten, T. Döring, F. Müller, M. Schmitz (eds.), pp. 333–337. ACM, New York, NY, USA, 2022.

[ Abstract ]
[ BibTeX ]
[ EndNote ]
[ URL ]
[ DOI ]

In a previous case study, we carried out the Contextual Design Process, a user-centred design process, with additional elements of Participatory Design in cooperation with a microenterprise facing the challenge of knowledge management. By involving the users in the ideation phase, we noticed several side effects on the company and its members. Using Reflexive Thematic Analysis, we identified patterns revealing these observed effects of our work. The Contextual Design Process promoted the awareness of the company’s internal status focusing problems and the independent addressing of them. In particular the participatory Wall Walk with the company members served as a key event for changes in the company. Furthermore, we discuss our findings on the challenges and implications of a small and consistent user group throughout the user-centred and participatory process.

@inproceedings{Papenfu__2022,
  abstract = {In a previous case study, we carried out the Contextual Design Process, a user-centred design process, with additional elements of Participatory Design in cooperation with a microenterprise facing the challenge of knowledge management. By involving the users in the ideation phase, we noticed several side effects on the company and its members. Using Reflexive Thematic Analysis, we identified patterns revealing these observed effects of our work. The Contextual Design Process promoted the awareness of the company’s internal status focusing problems and the independent addressing of them. In particular the participatory Wall Walk with the company members served as a key event for changes in the company. Furthermore, we discuss our findings on the challenges and implications of a small and consistent user group throughout the user-centred and participatory process.},
  address = {New York, NY, USA},
  author = {Papenfuß, Nathalie and Spangenberger, Carina and Huber, Stephan},
  booktitle = {Mensch und Computer 2022},
  editor = {Mühlhäuser, Max and Reuter, Christian and Pfleging, Bastian and Kosch, Thomas and Matviienko, Andrii and Gerling, Kathrin and Mayer, Sven and Heuten, Wilko and Döring, Tanja and Müller, Florian and Schmitz, Martin},
  keywords = {spangenberger},
  month = {09},
  pages = {333–337},
  publisher = {ACM},
  series = {MuC ’22},
  title = {Side Effects of Increasing Participation in a Contextual Design Process: A Knowledge Management Case Study},
  year = 2022
}

%0 Conference Paper
%1 Papenfu__2022
%A Papenfuß, Nathalie
%A Spangenberger, Carina
%A Huber, Stephan
%B Mensch und Computer 2022
%C New York, NY, USA
%D 2022
%E Mühlhäuser, Max
%E Reuter, Christian
%E Pfleging, Bastian
%E Kosch, Thomas
%E Matviienko, Andrii
%E Gerling, Kathrin
%E Mayer, Sven
%E Heuten, Wilko
%E Döring, Tanja
%E Müller, Florian
%E Schmitz, Martin
%I ACM
%P 333–337
%R 10.1145/3543758.3547535
%T Side Effects of Increasing Participation in a Contextual Design Process: A Knowledge Management Case Study
%U http://dx.doi.org/10.1145/3543758.3547535
%X In a previous case study, we carried out the Contextual Design Process, a user-centred design process, with additional elements of Participatory Design in cooperation with a microenterprise facing the challenge of knowledge management. By involving the users in the ideation phase, we noticed several side effects on the company and its members. Using Reflexive Thematic Analysis, we identified patterns revealing these observed effects of our work. The Contextual Design Process promoted the awareness of the company’s internal status focusing problems and the independent addressing of them. In particular the participatory Wall Walk with the company members served as a key event for changes in the company. Furthermore, we discuss our findings on the challenges and implications of a small and consistent user group throughout the user-centred and participatory process.

Bildnachweise