Integrating Generative Artificial Intelligence and Human Design: The Impact of Automation Level on Human Creative Experience and Efficiency

Abstract Generative artificial intelligence (GAI) has emerged as an indispensable tool across various design disciplines, increasingly integrated into different stages of the design process. However, research on the effectiveness of human-AI collaboration in design remains limited, and the role of AI in the creative process is still underexplored. This study presents a single-factor between-subjects experiment involving 79 participants to evaluate the impact of varying degrees of automation in generative design tools on user experience and design efficiency. The independent variable is the degree of automation of the GAI tool, categorized into three levels: low, moderate, and high. The dependent variables include time, creative experience, and creative quality. Creative experience encompasses task load, perception, and creativity support, while creative quality pertains to aesthetic and usability outcomes. The results indicate that increasing the level of automation significantly reduces design time. Moderate levels of automation are most effective in lowering task load and balancing human-machine collaboration, whereas extreme levels of automation may be counterproductive. Although highly automated GAI can rapidly enhance visual aesthetics, its impact on stimulating designers’ creativity and critical thinking is limited. This research contributes to evaluating the effectiveness of human interaction with AI in the design process and offers insights for optimizing the application of AI in design.