Calm me down: the impact of AI-generated review summarization on the sentiment intensity of consumer reviews

AI-generated review summarization (AIGRS), a form of AI-generated content extracted from User-Generated Content (UGC) and presented in the same format at the top of review sections, have been adopted by major e-commerce platforms. This feature exhibits key characteristics of AI-generated content, including low emotional intensity and information neutrality. Does the presence of AIGRS influence subsequent user reviews? Will the review sentiment intensity align with that of AI-generated content ?

We collected two datasets from the online platform: store information and review data. By linking these datasets via store IDs, we aggregated them into a store-week level dataset (N = 19,526). To preprocess the review content, we used the Jieba library for Chinese word segmentation and part-of-speech tagging in the review content. To robustly establish the causal effect of AIGRS, we combined propensity score matching with a difference-in-differences (DID) framework to rigorously establish the causal effect of AIGRS.

The findings indicate that introducing AIGRS creates a sentiment convergence effect on subsequent reviews, which is moderated by store rating distribution type and product type.

The conclusions highlight the systemic impact of AI technology on interactive marketing, enrich research on AIGC and UGC, and offer strategic insights for better AI technology utilization for platforms.