RISE for Boys and Men of Color 13
• Make the case for CRE and diverse staffing and their value in rigorous
research. The “real fight,” explained one field leader, is to explain to
evaluation firms the “added value, methodologically, of diversity to their
research projects.” Further, although progress has been made at building
buy-in for CRE and participatory evaluation, there has also been something
of a regression in the field particularly given the funding climate and a shift
in emphasis toward increased accountability and experimental evaluations
(particularly at the federal level). This field leader argues, “If you have a more
diverse staff . . . you’re more likely to get at solutions that will address social
inequities, systemic racism and the rest of it.”
• Be cautious about connecting pipeline programs for evaluators of color
too tightly to particular methodological approaches. In the current
funding climate, there is an increasing emphasis on “rigorous” experimental
evaluation designs, and it is important that evaluators who come out of
pipeline programs be versed in the principles of many different types of
evaluation designs. Exposing evaluators to these different types of designs
will help to make it easier for them to find work in the field. It is also important
that CRE not be positioned as incompatible with more experimental
approaches, but rather as an essential tool in the evaluation toolbox. One
field leader explained, “You can be culturally responsive and do an evaluation
for the federal government. . . . We should be saying to people, these things
can happen side by side, they can be integrated.”
• Integrate CRE evaluation knowledge and expertise into graduate
school programs. Several of the field leaders emphasized that the majority
of graduate school programs in public health, education, and social work
continue to lack a strong focus on evaluation and its role in helping to promote
program improvement. Graduates of these programs, particularly those from
nontraditional backgrounds, often do not know that the field of evaluation
exists, and they do not build the skills and knowledge to do evaluation
within their programs. A critical step in strengthening the pipeline for diverse
evaluators is to make knowledge of and exposure to evaluation a key part of
graduate school education in social science fields.
In conclusion, the convergence of interest in AEA’s, RISE’s, and many public and
private funders’ focus on stimulating high-quality culturally responsive evaluation
creates an important time for evaluators, researchers, and practitioners working
with boys and men of color and other diverse populations to closely examine the
extent to which the knowledge generated are authentic, rigorous, and useful.
Ensuring that appropriate principles, frameworks, methodologies, and staffing are
brought to bear on the evaluations of prevention and intervention efforts will be
an important way to advance our collective knowledge for the advancement of
the well-being of boys and men of color.
RECOMMENDATIONS FOR ADVANCING CRE AND THE EVALUATION FIELD
Experience in diverse communities. While
an evaluator may not necessarily be of the
same cultural background as the communities
they are evaluating, cultural competence
involves a broader world perspective, often
gained from experience living or working with
different cultural groups.
Openness to learning about cultural
complexities. Culturally competent
evaluators exhibit humility about what they
think they already know and are open to
in-depth understanding of the nuances
and complexities of inter- and intra-cultural
influences and variations.
Flexibility in evaluation design and
practice. Rather than coming in with
prescriptive evaluation strategies, culturally
competent evaluators realize limitations to
established approaches and are willing to
adapt to honor different cultural contexts.
Rapport and trust with diverse
communities. Culturally competent
evaluators prioritize relationship building with
diverse communities, rather than viewing
them solely as data sources. Relationships are
viewed as mutually beneficial.
Acknowledgment of power differentials.
Culturally competent evaluators acknowledge
the various power differentials possible in
an evaluation, including those between the
evaluator and those being evaluated, or
between the commissioning entity (often a
foundation) and those being evaluated.
Self-reflection for recognizing cultural
biases. Culturally competent evaluators take
the time to become mindful of potential
biases and prejudices and how they might be
incorporated into their research.
Translation and mediation across diverse
groups. Culturally competent evaluators are
skilled in translating jargon-laden evaluation
findings to those who may not be trained in
evaluation, or have high levels of education,
literacy, or English-language fluency.
Likewise, evaluators must also be adept
in communicating cultural paradigms and
community voice back to funders.
Comprehension of historical and
institutional oppression. This knowledge
is critical for designing evaluations that
integrate how historical and current social
systems, institutions, and societal norms
contribute to disparities among different
communities.
FIGURE 3. Characteristics of Culturally
Responsive/Competent Evaluators