What is program assessment?
Program assessment is a process undertaken by program faculty to determine whether students are meeting the degree program’s student learning outcomes. In learning outcomes assessment, the goal is to look beyond an individual course to examine what students are learning through the curriculum and their overall experience in the program. In the same way that faculty members individually engage in a cycle of teaching and learning in their own courses, so also faculty members as a group can engage in this process collectively to reflect on and review their curriculum as a whole. In addition, program assessment may examine other issues to support and enhance program effectiveness. More information is available at About Assessment.
Who is responsible for program assessment at WSU?
- Chair/Director: Chairs are responsible for providing leadership and oversight for assessment of each degree program. Among other responsibilities, the chair/director should develop and resource a sustainable assessment plan; involve faculty and a committee structure appropriate to their department; use results in decision-making; and communicate with other campuses. The chair/director also ensures infrastructure so assessment data and documents are regularly archived, with appropriate data stewardship and access to appropriate department members on all campuses. The chair/ director reports annually on assessment to ATL for undergraduate programs and to the Graduate School for graduate programs.
- Faculty Assessment Coordinator: Each program has an assessment coordinator (typically a faculty member appointed by the chair/director) who implements the program’s assessment plan, coordinates assessment efforts with broad faculty participation, and prepares the annual assessment report.
- Faculty: Faculty who teach participate in assessment activities, which may include collecting or scoring student work for program learning outcomes, norming on a rubric, interpreting assessment results, and participating in committee or faculty meetings about assessment.
- Dean/Associate Dean: Provide overall leadership and oversight of program assessment in the college.
- Office of Assessment of Teaching and Learning (ATL): Consult and support undergraduate programs, colleges, and campuses to implement assessment of student learning.
- Graduate School: Manage assessment reporting and review for graduate programs and provide information and data for program review. See Graduate Program Review and Assessment.
What resources are available at WSU to support undergraduate program assessment?
The Office of Assessment of Teaching and Learning (ATL) consults and supports undergraduate programs, colleges, and campuses to implement assessment of student learning. ATL assessment specialists work directly with program faculty and college/school leadership to support program assessment. ATL provides various resources including workshops, student focus groups, mini-grants, and good practice resources and guides. ATL also helps programs plan assessment, design surveys, implement measures, and analyze data. Most colleges also have assessment committees that provide support for program and college-level assessment efforts.
Where do I go to get support for assessment of graduate programs?
For support or information about assessing your graduate program, contact the Graduate School.
I’m a new chair or school director. How can I get up to speed on program assessment requirements and expectations at WSU?
Contact the ATL assessment specialist assigned to programs in your college or school who will be glad to provide a brief orientation. Your program’s annual assessment reports should be a good source of information, as well. Reports are stored by the program and ATL also has a copy. See ATL website sections: Assessment and Accreditation, About Assessment, Program Assessment Reporting, and WSU-Wide Program Assessment Summaries.
I’ve been assigned by my chair to work on assessment in my department. Where can I go for support?
Your department should have records of assessment that has been completed, and ATL is available to support programs in assessment work. You can contact ATL (and find out which assessment specialist is assigned to work with your program) by visiting our Contact Us webpage. ATL provides consultation and workshops on a variety of assessment topics, including capstone assessment, senior exit surveys, analyzing data, and interpreting assessment results. See Assessment Resources.
Where is my department’s assessment information stored?
Each program and/or college is responsible for maintaining an archive for their annual assessment reports, plans, and other assessment materials. Programs are responsible for acting as data stewards for assessment data, results and documents. ATL keeps copies of annual assessment reports for all programs but generally does not store other assessment documents or programs’ assessment results. See ATL guidelines for Assessment Archives and Assessment Data Stewardship.
Are good practice samples or guidelines available for particular assessment activities that my program is considering? What are other WSU programs doing?
See ATL’s Assessment Resources for guides and tips, and ATL’s news blog for spotlights on what WSU programs are doing. ATL assessment specialists are also available to discuss your assessment goals and help find resources and samples specific to your needs.
What is the approach to program assessment at WSU, since programs and disciplines are so different?
The Office of Assessment of Teaching and Learning (ATL) works with the Liaison Council, the Graduate School, and WSU leadership to establish requirements and criteria for undergraduate degree assessment that are based on good practices but are also flexible enough to adapt to the needs of different disciplines. ATL assessment specialists work directly with faculty to help make assessment useful to the particular needs of different programs.
Student learning in my program can’t be reduced to numbers, so how can we do assessment?
Program assessment does not require numerical ratings. Assessment measures can be either quantitative or qualitative. To be effective, program assessment should reflect the discipline and context of the program and its students, so that assessment for Fine Arts or Philosophy might look different than assessment in Electrical Engineering, but both can provide useful information about student learning. An ATL assessment specialist can help you determine which methods are likely to work best for your program.
What is the connection between assessment and accreditation?
Assessment of student learning and accreditation are often seen as closely linked—perhaps because assessment receives so much attention during accreditation reviews. Assessment is an ongoing process, though which departments and faculty gather information to support evidence-based decision-making about curriculum, instruction, and student experience. Using assessment results, faculty collaboratively develop, maintain and improve an effective curriculum that promotes student learning.
Accreditation involves a periodic review process from an external body (either academic or professional, or for the university as a whole) that, in part, determines whether systematic assessment processes are occurring with results contributing to decision-making. At WSU, program assessment activities are critical to meeting specific standards for university accreditation; see WSU-Wide Program Assessment Summaries and Selected Accreditation Standards for Academic Degree Programs.
How are grades related to assessment?
Course grades give faculty information about how individual students are doing overall in a course in relation to course content, attendance, improvement and other issues. Grades can also serve as a dashboard to monitor patterns and changes in student success over time. However, course grades can differ from program assessment in several important ways, including:
- A composite course grade does not differentiate achievement by learning outcome.
- Faculty members teaching the same course may teach different material and use different grading criteria.
- Factors such as participation and attendance contribute to grades but are not direct indicators of student achievement of learning outcomes.
Assignment grades can be used as program assessment under certain conditions. If an assignment’s learning outcomes are aligned with the program’s learning outcomes and the assignment product from a representative sample of students is evaluated using a rubric or other tool that differentiates by learning outcome, then these ratings can serve as program assessment evidence. Program assessment focuses on a group or cohort of students and how well their work meets the outcomes and benchmarks set by a collective group of faculty. Please contact ATL if you would like assistance using assignment grades for program assessment.
What is the difference between assessment and research?
Research is a formalized process that gathers, analyzes and uses data to make generalizable or suggestive conclusions with broad implications. Because of its broad use, research seeks to control for as many variables as possible.
Assessment’s main purpose is to guide curriculum decisions and good teaching and learning practices in a local context. Like research, assessment involves asking questions, gathering evidence, and using the findings. Unlike formal research, assessment often includes many variables that cannot be controlled. Because of this, assessment is not generalizable but provides insights into student achievement within the department or program. Additionally, assessment projects may have time and resources limitations; and, despite flaws in design or implementation, data must be salvaged to inform decisions in an academic program. When presenting assessment results, good practices include clearly identifying limitations of the data, judging the value of results on a case-by-case basis, and involving faculty and administrators in discussion of the results—sometimes the greatest value of assessment is the discussion it yields.
For more information, see Assessment and Research.
Does program assessment require IRB approval?
Usually, no. Program assessment, like classroom assessment, is excluded from Institutional Review Board (IRB) review because it does not meet the definition of research. The Code of Federal Regulations found at 45 CFR 46.102(d) defines research in part as, “a systematic investigation, including research development, testing and evaluation, designed to develop or contribute to generalizable knowledge.” Assessment for use by instructors and programs for the purpose of improvement does not meet this definition.
Provided all personally identifiable information is removed and the results are used for internal university purposes, programs that collect student work for the purpose of program assessment do not need student consent. Note, however, if a person or program plans to disseminate or publish data beyond program improvement or accreditation purposes, then IRB review may be required. Please contact IRB if you have questions.