Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Informations
Type:
article
Auteurs:
Singh, Nikhil and Bernal, Guillermo and Savchenko, Daria and Glassman, Elena L.
Pertinence:
Haute
Référence:
yang2022ai
Doi:
10.1145/3511599
Mots-clés:
multimodal, audio, interface, images, Human-AI Interaction, writing, AI, story, audiovisual, creativ...
Url:
https://doi.org/10.1145/3511599
Date de publication:
02/2022
Résumé:
Éditeur de text avec recommandations du llm. "Stimuli" (fond d'écran et sons) basés sur le texte et récupérés depuis des banques d'images et sons.
Abstract:
While developing a story, novices and published writers alike have had to look outside themselves for inspiration. Language models have recently been able to generate text fluently, producing new stochastic narratives upon request. However, effectively integrating such capabilities with human cognitive faculties and creative processes remains challenging. We propose to investigate this integration with a multimodal writing support interface that offers writing suggestions textually, visually, and aurally. We conduct an extensive study that combines elicitation of prior expectations before writing, observation and semi-structured interviews during writing, and outcome evaluations after writing. Our results illustrate individual and situational variation in machine-in-the-loop writing approaches, suggestion acceptance, and ways the system is helpful. Centrally, we report how participants perform integrative leaps, by which they do cognitive work to integrate suggestions of varying semantic relevance into their developing stories. We interpret these findings, offering modeling and design recommendations for future creative writing support technologies.
Pdf:
Lien pdf
Références
0 articles
Titre Type Pertinence Auteurs Date Publication Références Citations Actions
Pas encore d'article
Citations
4 articles
Titre Type Pertinence Auteurs Date Publication Références Citations Actions
Co-Writing with Opinionated Language Models Affects Users’ Views inproceedings Haute Jakesch, Maurice and Bhat, Advait and Buschek, Daniel and Zalmanson, Lior and Naaman, Mor 04/2023 4 0
Parachute: Evaluating Interactive Human-LM Co-writing Systems misc Haute Hua Shen and Tongshuang Wu 03/2023 1 0
What Can’t Large Language Models Do? The Future of AI-Assisted Academic Writing inproceedings Haute Fok, Raymond and Weld, Daniel S 12/2022 1 0
Loose Ends: A Mixed-Initiative Creative Interface for Playful Storytelling inproceedings Haute Kreminski, Max and Dickinson, Melanie and Wardrip-Fruin, Noah and Mateas, Michael 12/2021 1 0
Mots-clés
10 mots-clés
Nom Nombre d'articles Actions
Human-AI Interaction 3
multimodal 2
writing 2
audio 1
audiovisual 1
story 1
images 1
AI 1
interface 1
creativity support 1
Auteurs
5 auteurs
Nom Nombre d'articles Actions
Elena L. 2
Nikhil and Bernal 1
Singh 1
Daria and Glassman 1
Guillermo and Savchenko 1