Why Digital Wellbeing Research Needs Broader Studies

Why broader digital wellbeing research matters

Why are broader studies needed for digital wellbeing interventions? You may have noticed short education pilots that show promising signs, yet the evidence behind them often comes from small, narrowly drawn groups. That makes it hard to judge whether the same results would hold for you, your family, or anyone outside the original sample. A recent pilot tested an immersive online program with 120 adolescents over 2 weeks and found gains in confidence but no measurable shift in attitudes or intentions after just 2 sessions. Short experiences can spark peer discussion and personal reflection. They do not always change deeply held views in a matter of days. This is exactly why digital wellbeing research needs broader, more robust studies to confirm what early signals suggest.¹

What one pilot study revealed

Researchers built a program called Meta Nodam on the Roblox platform. It aimed to help adolescents resist e-cigarette use through interactive, self-guided learning. The study included 120 participants who joined 2 sessions over 2 weeks, each lasting 45 minutes. Before and after the sessions, the team measured changes in intentions, attitudes, social norms, self-efficacy, and interest in learning more.¹

• Self-efficacy rose in a statistically meaningful way after the 2 sessions, with a reported significance level of P = .002.¹
• Attitudes toward e-cigarette use showed no measurable pre-to-post change.¹
• Intentions to use e-cigarettes also showed no statistically significant shift after the program.¹
• Participants described the metaverse experience as engaging and said it made health risks feel more real and easier to discuss with peers.¹
• Several participants expressed interest in learning more about the health risks linked to e-cigarettes after the sessions ended.¹

How immersive digital spaces build engagement

One clear takeaway from this pilot is that interactive digital spaces can hold attention. The Roblox-based program used game-like features to let participants explore health information on their own terms. Young people in the study said the experience felt real enough to spark conversations with friends. That kind of voluntary engagement is hard to achieve in a lecture or a printed handout. When people can interact with content rather than passively receive it, they may be more likely to reflect on their own choices.

The self-efficacy finding matters here. Self-efficacy means believing you can make a specific choice and follow through. In this case, participants felt more confident about resisting e-cigarette use after the program. That is a real shift, even if it is not the whole picture. Feeling capable is often a first step toward acting differently. But confidence alone does not guarantee a change in what someone intends to do or how they think about a behaviour overall.¹

Why brief sessions have limits

Two sessions over 2 weeks is a very short window. The pilot team noted that this limited timeframe likely explains why attitudes and intentions did not shift in a statistically meaningful way. Beliefs and personal intentions tend to form over months or years, not over 90 minutes of total screen time. It would be surprising if 2 short visits to a digital world could undo patterns built through daily life and social influences. This does not mean the approach failed. It means the study was not long enough to detect deeper change.¹

For anyone hoping to use digital tools for education, this distinction is important. A tool that boosts confidence quickly may still need repeated use or follow-up activities before it can shift how someone thinks or acts in the long run. Expecting a single short experience to do everything is a lot to ask. Digital wellbeing research shows that early wins in engagement and self-belief are valuable. They are just not the same as proven, lasting behaviour change.¹

Why digital wellbeing research needs wider samples

The Meta Nodam pilot studied 120 adolescents in a single setting. That is a useful starting point, but it leaves many questions open. Would the same experience work for younger children, adults, or older adults? Would participants from different regions, language backgrounds, or levels of digital comfort respond the same way? A study that tests one narrow group cannot answer these questions. The researchers themselves called for broader participant demographics and stronger study designs in future work.¹

1. Include participants from a wider range of ages, backgrounds, and levels of experience with digital platforms.¹
2. Use study designs that compare the digital program against a control group or alternative approach.¹
3. Extend the number and frequency of sessions so researchers can measure whether effects last beyond the first few weeks.¹
4. Follow up with participants over months to check whether early boosts in confidence lead to real changes in behaviour or attitudes.¹

What this means for everyday life

If you come across a digital education tool that claims to change behaviour, it is worth asking a few questions. Who was it tested on? How many sessions did they use? Did it change what people do, or only how confident they felt? Early findings from small pilots are not useless. They point toward ideas worth exploring. But they do not yet prove that the same tool will work for you or for people whose lives look different from those in the study.

Digital wellbeing research is still growing. The evidence so far suggests that immersive, interactive experiences can make health topics feel more real and personal. That is a promising foundation. But building on it requires testing these tools with larger and more diverse groups, over longer periods, and with study designs that can separate real effects from coincidence. Until then, the most honest answer is that early signs are encouraging but incomplete.¹

Steps you can try

• When you see a digital wellbeing tool, look for published studies that describe who tested it and what changed.
• Give any new digital education resource at least several sessions before judging whether it helps you reflect or learn.
• Talk with friends or family about what you encounter in digital spaces. Peer discussion is one of the strongest ways to process new information.
• Treat early confidence boosts as a good sign, but keep exploring and questioning rather than expecting a single tool to solve everything.
• Seek out programs that combine interactive features with follow-up activities, since brief one-off sessions may not be enough to shift habits.

What does digital wellbeing research mean?

Digital wellbeing research

Studies that examine how digital tools, apps, and online spaces affect how people feel, think, and make choices about their daily habits and health.

Self-efficacy

A person's belief that they can take a specific action and stick with it, such as choosing to avoid a particular habit even when it feels tempting.

Immersive experience

A digital environment designed to feel engaging and interactive, where users explore information through activities rather than just reading or watching.

Pilot study

A small, early-stage test of a new program or tool. Its purpose is to see whether the idea shows promise before investing in a larger study.

About the evidence

This article draws on 1 published pilot study that tested a metaverse-based program with 120 adolescents. The sample came from a single group and the intervention lasted just 2 sessions over 2 weeks. These design choices mean the findings are early and limited in scope. The researchers noted that wider and more diverse samples, along with stronger study designs, are needed before drawing firm conclusions about how well such programs work across different populations.¹