Buying a travel pillow: do our experiences make our expectations come true?
During a long flight, it is often tempting to take a nap in the airplane seat. Which travel pillow offers you the most comfort for this?
Read More arrow_forwardEveryone wants to know if people are truly engaged with their content. But how do we accurately measure engagement? Learn more in this blog post.
In this blog post, Tess den Uyl, PhD from VicarVision shows how to measure engagement in different ways.
Everyone wants to create engaging content and learn if people are truly engaged. But how do we accurately measure engagement? Nicholas Keatch's research project, part of his academic focus on social psychology, aimed to explore the intricate nature of engagement.
In his study, he examined how people interact with movie trailers—emotionally, cognitively, and behaviorally. Importantly, this study included both self-reported and implicit measures.
Engagement refers to an active involvement and emotional connection with a product, brand, or experience. It goes beyond attention—it's about how someone is interacting with a brand.
Engagement plays a vital role in how people interact with different types of content, whether it's advertisements, movie trailers, or educational videos. By studying engagement, marketers and UX researchers have an indication of how much someone is interested in their content. In fact, for most video marketers, engagement is the most important metric.
In this study, Keatch examined how engaged people were with different movie trailers. To study engagement, he used a model based on Ben-Eliyahu's (2018) framework and previous work by Noldus intern Dayenne Sarkol. This model divides engagement into three key dimensions:
In Sarkol's work on engagement, she found that a real-time expression of engagement was too complex to capture all three aspects at once. Therefore, the current project focused on measuring the separate components of engagement.
Keatch recruited 75 participants for this study, through platform Prolific and personal invitations. Participants watched three movie trailers from different genres: My Spy: The Eternal City (action-comedy), Fly Me to the Moon (romantic-drama), and Paddington in Peru (family-comedy).
Each trailer was divided into two parts. Participants had the option to either continue watching or switch to another trailer after the first part. Their decisions provided an implicit measure of behavioral engagement.
Additionally, we used FaceReader Online to measure implicit cognitive and affective engagement. We did so by detecting facial expressions like happiness, sadness, and attention. We also measured explicit cognitive, affective, and behavioral engagement through self-reports.
By using both implicit and explicit measures, we aimed to understand engagement more completely.
As expected, self-reported engagement was higher for participants who chose to continue watching rather than switch trailers. Decisions to switch were roughly around 50%.
Specifically, behavioral and affective engagement were significantly higher in those who continued watching the trailers. However, the cognitive component (e.g., concentration) showed only marginal significance.
Interestingly, this pattern was not consistent across all trailers.
Facial expression analysis provides an implicit way to measure reactions that are automatic and beyond conscious control.
Using FaceReader Online, we analyzed happiness, which is indicated by smiling and laughter. Both of these behaviors are important to measure affective engagement. In addition, we used FaceReader Online to measure cognitive engagement, by estimating the visible attention participants gave to the screen.
The implicit responses showed interesting differences between trailers.
One advantage of facial expression analysis is its ability to capture immediate, real-time responses. That's how we learned that across all trailers, larger peaks in happiness were observed for those who decided to continue watching.
You may also like to read about how perception of brand authenticity affects brand performance or how to increase attention in commercials for Gen-Z.
Engagement is a complex, multidimensional construct. The varied responses to each trailer highlight the difficulty of measuring engagement and the importance of understanding the context.
Using both implicit and explicit responses allows for a more accurate and nuanced understanding of engagement. This dual approach makes it possible to predict viewer behavior more effectively. As a result, professionals in fields like entertainment, advertising, and education can improve their content creation strategies.
By employing tools like FaceReader Online, content creators can test the effectiveness of videos with implicit and explicit measures to measure engagement comprehensively.
During a long flight, it is often tempting to take a nap in the airplane seat. Which travel pillow offers you the most comfort for this?
Read More arrow_forward
Planning and conducting user experience tests can be time-consuming. With these UX research tools you can take your user research to a higher level and save valuable time!
Read More arrow_forward
Tube feeding has had a fascinating history, but there is still scope for innovation. Noldus will develop a system to measure its users' experience in the FoodFriend project.
Read More arrow_forwardWe'll get back to you shortly.
Please correct the following errors:
We look forward to seeing you at the NoldusViso launch event.
Please correct the following errors: