How do I turn a mountain of grantee reports into insight for my board?

Direct Answer

To turn a mountain of grantee reports into insight for your board, start with what your board needs to understand or decide about the portfolio, and read the reports against those few questions instead of trying to summarize everything in them. Sort what the reports say into themes that appear across grantees, threads you can compare because several grantees measured the same thing in similar ways, and differences between grantees that need explaining. Then write one account of the portfolio: what it's accomplishing, where results vary and what seems to explain the variation, what the evidence does and doesn't support, and what your foundation or network plans to do next. A few grantee examples, shared with the organizations' permission, can illustrate what the themes look like in practice. Cross-site synthesis is specialized work, and an evaluator experienced in portfolio learning can design and carry it out with you, including checking the interpretation with grantees and returning the results to them.

Lauren McClain, Ph.D.

Lauren McClain, Ph.D.

Co-founder and workforce development consultant, Grantibly

Best Move

Write down the two or three questions your board needs answered, then read every report against those questions and nothing else.

Why It Works

The board's questions tell you what to pull from each report and what to leave, so you end with a short, honest account of the portfolio rather than a summary of every grant.

Next Step

Build a simple grid with grantees down one side and your board's questions across the top, and fill in what each report says.

What you need to know

Where do we start when every grantee report looks different?

When every grantee report looks different, start with your board's questions, then make an inventory of what each report can tell you about them. A simple grid helps: grantees down one side, the board's questions across the top, and in each cell what that report says, with a note on what kind of evidence it is (a count, a survey result, participant comments, a staff observation). The completed grid identifies which questions most reports can answer, which only a few can address, and where the information is missing entirely.

Expect the grid to be uneven, because reports written to different templates, at different times, and for different purposes won't line up neatly. An uneven grid still tells you a great deal about the portfolio, and it also helps you determine what to ask grantees for next time. Should all our grantees report on the same outcomes? covers that decision.

How do we combine reports that measure different things?

You combine reports that measure different things by combining what they find, and by keeping the numbers themselves apart unless they were measured the same way. Numbers measured in different ways, with different definitions or over different periods, can't be added or averaged without producing a figure that misrepresents every organization included in it. Instead, identify the themes that appear across reports, such as a common barrier participants face or a type of support several grantees found effective, and note how many grantees report each one and what evidence they offer.

Where several grantees measured the same outcome in similar ways, you can bring those results together, as long as you're explicit about which organizations they represent. Numbers and participants' own descriptions of their experiences tell different parts of the story. A result that shows up in several grantees' data is stronger when their participants' comments help explain it, and a theme in participants' comments is easier to act on when the numbers show how widespread it is.

What does the board need to see about the portfolio?

The board needs to see what the portfolio is accomplishing, where results vary, and what the foundation or network will do with what it has learned. In practice, that's usually a short account built around the board's questions:

  • What's happening across the portfolio, in a few themes, with the evidence for each.
  • Where results differ, and what seems to explain the difference: who is served, how the work is carried out, or local conditions.
  • What the evidence supports and what it doesn't, so the board doesn't read more into the results than they can carry.
  • What comes next, such as support grantees have asked for, a question worth looking into, or a change in what you ask grantees to report.

A board that responds mostly to numbers may need the same account told differently. How do I explain our results to a board that just wants numbers? covers that audience.

How do we involve grantees without asking them for more?

You involve grantees without asking them for more by working from what they've already reported and asking them only to check what you've concluded. Before the account goes to your board, share the themes with grantees, in a short meeting or a written summary, and ask whether the interpretation fits their experience and what it misses. That step often corrects a misinterpretation before it reaches your board, and it demonstrates to grantees that their reports are being read and used.

Then send the finished synthesis back to them, because grantees rarely have an opportunity to see patterns across a portfolio or to learn how their work relates to that of other organizations doing similar work. How do I ask grantees for data without overwhelming them? covers keeping future reporting manageable.

The Grantibly perspective

Lauren's perspective

Data don't make decisions. People do. Our job is to help clients turn information into understanding and action.

A percentage in a table may be technically accurate but still leave a team asking, "So what?" We want to go further. What does the finding mean? Why might we be seeing it? Does it confirm what the team expected or challenge an assumption? Is there an important difference between groups? Does it suggest something that should change?

More questions about this topic

How long does it take to synthesize a portfolio's reports?

How long it takes to synthesize a portfolio's reports depends on how many grantees you fund, how different their reports are, and how many questions the board needs answered. Focusing the work on the board's questions, instead of summarizing every report in full, is the most effective way to keep it manageable.

Should I name individual grantees in the board report?

Whether to name individual grantees in the board report depends on what you've told them about how their reports will be used. If you name a grantee or share its results, ask first, and describe any comparison in a way that doesn't rank organizations without context.

What if the reports don't answer the board's questions?

If the reports don't answer the board's questions, tell the board what they can answer, what they can't, and what you'd need to answer the rest. That gap is useful information in its own right, because it identifies what your foundation or network should consider asking grantees to report in the future.

Can an evaluator do this synthesis for us?

An evaluator can do this synthesis for you, and it's a central part of portfolio learning work: designing the questions, reading across reports, checking the interpretation with grantees, and preparing the account for your board.

Related pages

Lauren McClain, Ph.D.

Lauren McClain, Ph.D.

Lauren McClain, Ph.D. is a co-founder of Grantibly and a workforce development consultant who develops the workforce through evaluation, training, facilitation, and strategic planning. A sociologist and former faculty member at Savannah State University and Western Kentucky University, she taught more than 50 social research methods courses, mentored more than 21 thesis and dissertation committees, and served on three Institutional Review Boards. Her work helps organizations use evidence to understand what is happening, decide what to do next, and do MORE good.

grantibly.com

Tell us what you're trying to understand

Schedule a consult Meet Lauren and Angelika