- Home
- About AALHE
- Board of Directors
- Committees
- Guiding Documents
- Legal Information
- Our Institutional Partners
- Membership Benefits
- Contact Us
- Member Home
- Annual Conference
- Resources
- Publications
- Social Media
- Donate
EMERGING DIALOGUES IN ASSESSMENTPromoting Equity and Empowering Faculty with Data Coaching September 28, 2023 Reem Jaafar, PhD, and Milena Cuellar, PhD, LaGuardia Community College In recent years, the recognition of data disaggregation as a crucial step in addressing equity gaps in higher education has grown significantly. Numerous studies have focused on this approach alongside culturally responsive assessment methods (Henning et al., 2022a; Henning et al., 2022b; Montenegro & Jankowski, 2020; Witham et al., 2015). However, faculty often face challenges in accessing and analyzing their student data due to a multitude of responsibilities and resource constraints. To bridge this gap, the authors, two faculty members have embarked on a data coaching initiative supported by a grant. The primary goal of this initiative is to promote a cycle of continuous improvement and support colleagues in designing equity-minded actions at the classroom and, potentially, program levels. This paper will discuss the measures we have undertaken, the alignment of our efforts with best practices, and explore strategies for scaling and sustaining this data coaching initiative (Carlson, 2022). Why Data Coaching? LaGuardia Community College, an open-access Hispanic Serving Community College, is recognized for its general education assessment (Boehman et al., 2021; Lehman & Rogers-Cooper, 2021). With a diverse student body representing over 150 countries, the institution has doubled its 3-year graduation rate over the past decade. However, in pursuit of continuous improvement, we started discussing with our colleagues the need for data disaggregation and its implications for student success. Data disaggregation refers to the process of breaking down collected data into smaller subgroups, often based on demographic factors, to reveal patterns or disparities that might be masked in aggregated data. Through these conversations, it became evident that navigating the complexities of data disaggregation requires support. Thus, data coaching emerged as a practical approach to assist our colleagues in interpreting data through an equity lens. We believe it plays a vital role in our collective efforts to promote equity in student success. The goals of our data coaching include:
How We Started We initiated this project with a grant1, with additional support from the Office of the Provost. Faculty Cohort We recruited three faculty and a data coach from STEM fields. All faculty previously knew each other. Our reasons were two-fold. First, we wanted to build a cohort that could become coaches to the second cohort. Second, our institution has quantified equity gaps in outcomes in STEM courses. Faculty committed to participating in a year-long seminar that included coaching. The two co-PIs liaised between faculty and Institutional Research (IR) and guided the seminar with appropriate resources and materials. Data Coach The data coach, a key player in the success of our program, embodied several important characteristics (Carlson, 2022; Glover, 2017; Hasbrouck, 2017). These sources converge on certain ideal qualities in studies analyzing coach characteristics for faculty development. Coaches should:
Our coach, a colleague with a strong teaching background and comprehensive institutional knowledge, had prior collaborations with the authors and faculty in the cohort. This insider's view enabled the coach to customize guidance in alignment with our institution's values and needs. Faculty collaboratively work with the coach to analyze and interpret data from Institutional Research related to course and program outcomes, identifying any additional data needs. Together, they concentrate on examining disaggregated data to identify underlying patterns. In our case, the coach was our colleague with a successful teaching background and institutional knowledge and had prior collaborations with the authors and faculty in the cohort. This internal perspective allows the coach to tailor the guidance to align best with our institution's needs and values. Crucial to the model is the approach of one-on-one coaching. This enables meaningful connections, deep discussions, and personalized guidance. Periodic follow-ups are conducted to maintain momentum and ensure continuity in learning about and questioning the data. This consistent interaction forms the backbone of our approach, supporting faculty in understanding and addressing equity gaps in student learning outcomes.
Highlights and Timeline The cohort participated in a year-long professional development seminar, meeting several times per semester as a group and having regular check-ins with the data coach in between sessions. Fall Semester First, we introduced the concepts of embedding equity in assessment, culturally responsive pedagogies, and equity index (see, for example, Bensimon et al., 2003; Montenegro & Jankowski, 2020). Next, we devoted time to a thorough analysis of our institutional contexts. This involved understanding our College's unique demographics, strengths, and challenges. We explored the student data dashboard that IR provided. One of our major achievements during this period was the collaborative effort to frame a research question. Each faculty member worked hand-in-hand with the data coach to develop a pertinent question based on their experience. They also provided each other feedback. Lastly, we approached our IR with carefully framed research questions to request the necessary data. Upon receiving the data, we revisited and supported the faculty in reframing the questions as needed. This iterative process ensured that our research was grounded in available and appropriate data given our institutional contexts. Outlined below are the themes of the faculty projects:
Details about each project will be the subject of a future publication. Winter Semester During the winter session, a reflection session was conducted, where each faculty undertook a syllabus revision for their Spring courses as an equity-minded action. As part of this process, inclusive language was incorporated into the syllabi emphasizing how students could be encouraged to utilize available resources and attend office hours. Additionally, faculty members dedicated time to analyzing the data received from IR and requested any necessary supplementary data. They also developed other equity-minded actions to implement throughout the Spring semester. Spring Semester Faculty implemented and assessed the impact of their equity-minded actions. They also created a data story based on their work. The goal was to present a comprehensive narrative that uses both quantitative and qualitative data to investigate the performance of students in a certain program and with certain characteristics. Occasionally, the analysis entails comparison to students in other programs. For example, the data story of faculty #1 examines the performance of students with disabilities in College Algebra by providing context on why this group and subject are essential, then presents data comparing pass rates between students registered with disabilities and those not. Outcome gaps emerged from the analysis. The story acknowledges potential data limitations and shares personal observations and anecdotes about student engagement and help-seeking behaviors. To disseminate the findings, we organized a college-wide showcase, allowing our cohort to present their data story and emphasize the positive outcomes of these equity-minded actions to the entire College.
Sustainability Data coaching leveraging course-level, program-level, and institutional data presents a promising strategy for promoting faculty engagement with assessment and equity-focused action in higher education. By empowering faculty to seek and interpret data related to students in the course, major and in the College, this model fosters a culture of inquiry and continuous improvement, driving efforts to ensure that higher education is a space where all students can thrive. To replicate the success of the data coaching initiative, institutions should follow key steps while embracing the right mindset. Fostering institutional buy-in with faculty in leadership roles and IR's support is crucial. Identifying an effective data coach for the first cohort will ensure success. Through mentoring, the coach can empower faculty from the initial cohort to become coaches for subsequent cohorts. Institutions can integrate data coaching into ongoing professional development programs, benefiting faculty and staff. This could help institutions establish a culture of data-informed decision-making. Data coaching may prompt actions at different levels, not just in the classroom. Leveraging faculty development opportunities can be an effective means for institutions to scale and sustain these practices systematically. Acknowledgments The authors extend their heartfelt gratitude for the funding provided by the PSC-CUNY Enhanced Award Cycle 53 and the Academic Affairs Division at LaGuardia. Special thanks are also due to the Office of Institutional Research and Assessment, especially Mr. Jeff Weintraub and Dean Nava Lerer.
References Bensimon, E. M., Hao, L., & Bustillos, L. T. (2003). Measuring the state of equity in public higher education. Paper presented at the Harvard Civil Rights and U.C. Conference on Expanding Opportunity in Higher Education, California and the Nation, Sacramento. Boehman, J., B. Eynon, M. de Goeas-Malone, E. Goodman, and J. Rogers-Cooper. (2021). Making Learning Matter: Building Guided Learning Pathways at LaGuardia Community College. International Journal of Teaching & Learning in Higher Education 33 (1), 89-99 Carlson, E. R. (2022). Fundamental components of personalized coaching models for faculty: Addressing inequities in Learning Outcomes Data. Journal of Assessment in Higher Education, 3(1), 1–20. https://doi.org/10.32473/jahe.v3i1.129170 Glover, T. A. (2017). A data-driven coaching model used to promote students' response to early reading intervention. Theory Into Practice, 56(1), 13–20. https://doi.org/10.1080/00405841.2016.1260401 Hasbrouck, J. (2017). Student-focused coaching. Theory Into Practice, 56(1), 21–28. https://doi.org/10.1080/00405841.2016.1252219 Henning, G., Baker, G. R., Jankowski, N. A., Lundquist, A. E., & Montenegro, E. (2022a). Reframing assessment to center equity: Theories, models, and practices. V.A. Stylus Publishing, LLC. Henning, G. W., Baker, G. R., Jankowski, N. A., Lundquist, A. E., Montenegro, E., Dyer-Barr, R., Baxter, K., & Zamani-Gallaher, E. M. (2022b). Equitable Assessment in Community Colleges. In Reframing Assessment to Center Equity: Theories, models, and practices (pp. 250–263). essay, Stylus Publishing, LLC. Kelderman, E. (2023, April 3). The new accountability. The Chronicle of Higher Education. https://www.chronicle.com/article/the-new-accountability Lehman, R. M., & Rogers-Cooper, J. (2021). Evolving the loop: The role of eportfolio in building 21st-century student learning outcomes. (Occasional Paper No. 55). National Institute for Learning Outcomes Assessment. McNair, T. B., Bensimon, E. M., & Malcom-Piqueux, L. E. (2020). From equity talk to EquityWalk: Expanding practitioner knowledge for racial justice in higher education. Jossey-Bass. Montenegro, E., & Jankowski, N. A. (2020). A new decade for assessment: Embedding equity into assessment praxis. (Occasional Paper No. 42). University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment. https://www.learningoutcomesassessment.org/wp-content/uploads/2020/01/A-New-Decade-for-Assessment.pdf Witham, K., Malcom-Piqueux, L. E., Dowd, A. C., & Bensimon, E. M. (2015). America’s unmet promise: The imperative for equity in higher education. Association of American Colleges and Universities. |