Newsletter

Adventures in Research: Issue 8

We know it’s a chaotic season for everyone, so we’ll keep this note short and sweet…

It seems obvious that research constantly prompts me to think about how we, as a society, can better support children and families. However, just as often, children and families prompt me to think about how we, as a research agency, can do better.

This quarter, the realities of life collided with how I think about the work that LRA does on multiple occasions, and I’m dedicating this newsletter to those beautiful moments.

—Alicia

Minimize sample bias and increase participation by simplifying informed consent.

One of my kids was invited to participate in a research study. For this minimal-risk study, the research team emailed parents a five-page PDF consent form. Parents were asked to print the form, sign it, and send it back to school with their children.

If there’s one thing we’ve learned in our 15+ years of conducting research, it’s this: You have to make participation AS SIMPLE AS POSSIBLE with MINIMAL BURDEN to participants.

I’m not being overly dramatic when I say the research team will likely lose half of its potential sample because they’ve made the consenting process unnecessarily complicated. I’m also not being overly dramatic when I say that this approach will generate meaningful bias in their sample.

A colleague introduced me to the term “soft excluding,” which occurs when the barriers to research participation disproportionately impact children and families with fewer resources.

I can’t think of a better real-life example of “soft excluding” than making informed consent overly burdensome.

Here’s how we ease barriers to participation by making the informed consent process as simple as possible:

  1. Use electronic consent for minimal-risk studies. Participants can provide consent with just a few clicks, and they won’t even be annoyed.
  2. Streamline the consent form. Work with your Institutional Review Board (IRB) to determine which consent language is absolutely necessary. In our experience, we’ve reduced consent forms to a few short, accessible paragraphs.

When you honor participants’ time and effort from your very first interaction and treat it with genuine gratitude, you’ll get better participation and higher-quality data.

A different way for parents to think about teens and social media

Over the past decade, we’ve all heard a LOT about teens, phones, and social media. But honestly, at this point, books and articles about the evils of social media are so abundant that they’ve almost become white noise.

That’s why it was an incredible breath of fresh air to hear Dr. Jill Walsh speak about evidence-based, practical advice for helping teens manage their digital spaces.

For example, Dr. Walsh recommends that parents stop focusing on the quantity of screen time and instead consider the quality of screen time.

In all, the audience’s reaction (and my own) suggested that her specific, actionable recommendations were exactly what parents are looking for in this moment.

I will stop gushing now, but I really can’t say enough about Dr. Jill Walsh. Learn more about her and her work at digitalaged.com.

What coaching soccer has taught me about true indicators of successful programming.

One of my favorite pastimes (outside of evaluating youth development programming) is coaching youth soccer. This past October, the third-grade RedHawks played their last game of the season.

Overall, we lost 80% of our games. That’s a lousy record. I wasn’t conducting a true evaluation of our season, but if someone asked me how we would measure impact, here are the indicators I would highlight:

  • 100: Percent of players returning next season
  • 100: Percent of games the whole team ran on the field to thank their goalie when the final whistle blew
  • 15+: Number of team hugs that collapsed into pig piles
  • 2: Number of games we lost by five goals, yet the RedHawks skipped off the field, arm-in-arm at the end of the game
  • 3: Number of times a dog ran onto the practice field, and we had to stop practice to rub its belly

This is the tricky part of evaluation. Sometimes, impact is not about achievement or growth. Sometimes, impact is about smiles, giggles, joy, and belonging. (I already can’t wait for soccer to start again in April!)

I’m taking this lesson with me into 2025 as we embark on new evaluation projects with beloved forever clients and soon-to-be beloved new clients.

Speaking of 2025, let’s start talking about your research and evaluation goals for next year.

Are you thinking about a research or evaluation project in 2025? Get a jump start on your research projects for next year (and beyond) and book a call with us in the new year.

Regardless of where you are in your project (even if it’s just an idea about an idea!), we’re always happy to talk.

We wish you a joyful holiday season and a happy and healthy 2025.

Best,
The Team at Lynch Research Associates

Email us or just put a time on our calendar to talk more: