About

This is a blog of the Center of Inquiry in the Liberal Arts at Wabash College and the Higher Education Data Sharing Consortium, by Charles Blaich, director, and Kathleen Wise, associate director.

 

Directors' Blog

Friday
Aug082014

Weird Al's "Mission Statement"

A present for those of you writing strategic plans, mission statements, or business plans for your institutions. "Weird Al" Yankovic's new video, "Mission Statement," skewers mission statement jargon like synergy, monetize, and core competencies to the tune of Crosby, Stills, and Nash's "Suite: Judy Blue Eyes."

Whether this video shows that Weird Al has still "got it" depends on whether you thought he "had it" to begin with. In either case, enjoy. 

Tuesday
Apr152014

Clear and organized teaching

An April 14, 2014 article in the Chronicle of Higher Education referenced data on teaching clarity and organization that we presented first at an AAC&U meeting in January and then at a Teagle Foundation meeting last week. 

Some background — Much of the talk about improving college impact focuses on "big changes" and "reforms," such as increasing the number of high-impact practices that students experience or revising curricula to make them more interdisciplinary. We think that such changes are great. But it is important to be realistic about the fact that they will require considerable effort, can be expensive, and may take years to accomplish. While we work toward these larger changes, it's important to remember that another way of improving student learning at our institutions would be to improve the quality of teaching within the courses, programs, and curricula that we currently have.

People might argue, "This is what we're doing every day!" And we know they are. But focused efforts to improve the basic teaching skills of all of our faculty, ranging from our most senior colleagues to adjunct faculty, have the potential to create immediate benefits for our students. 

One seemingly simple aspect of teaching is "clarity and organization." Our data on clarity and organization come from ten questions that we used in the Wabash National Study. We asked students these questions at the end of their first year of college —

Taking into consideration all of the faculty with whom you’ve interacted at this institution, how often have you experienced faculty who

  1. Gave clear explanations?
  2. Made good use of examples and illustrations to explain difficult points?
  3. Effectively reviewed and summarized the material?
  4. Interpreted abstract ideas and theories clearly?
  5. Gave assignments that helped in learning the course material?
  6. Presented material in a well-organized way? 
  7. Came to class well prepared?
  8. Used class time effectively?
  9. Clearly explained course goals and requirements?
  10. Had a good command of what they were teaching?

Students could respond "very often," "often," "sometimes," "rarely," or "never" to each of these questions. What proportion of the roughly 8,200 first-year students who responded to this question did not answer "very often" or "often" on average?

  • 48% of all first-year students
  • 63% of African-American first-year students
  • 58% of the first-year students at larger institutions
  • 41% of the first-year students at smaller institutions
  • 25% of first-year students at the institution with the highest average score on teaching clarity and organization
  • 77% of first-year students at the institution with the lowest average score on teaching clarity and organization

Clarity and organization, and the lack thereof, has serious consequences for students. Taking into account their major, gender, type of institution, race, parental education, high school involvement, a host of other good practices, and students' performance on our outcomes measures when they first entered college, clarity and organization has a positive significant relationship with students' —

  • Critical thinking
  • Interest in political and civic involvement
  • Interest in socially responsible, collaborative leadership
  • Academic motivation
  • Psychological well-being
  • Interest in reading and writing as a means of learning
  • Interest in engaging new ideas
  • Moral reasoning 
  • Interest in engaging difficult intellectual problems
  • Interest in interacting with diverse people
  • GPA
  • Likelihood of persisting and graduating

College faculty should aim for creating high levels of clarity and organization in the classroom. This does not mean "dumbing down" the class. It means giving clear explanations and instructions, using good examples, being prepared, using time with our students well, and other basic elements of good teaching. It also means remembering that our students are not the disciplinary experts that we are, and that in order to explain even sometimes seemingly basic concepts to them, we must find ways to engage our students where they are, using language and frameworks of knowledge that make sense to them.

We do not claim that this is an easy task. We both have experience teaching, and with the varied backgrounds of our students and the complexities of our ever advancing disciplines and professions, we know that this is challenging work. We also understand that clarity and organization is not independent of the disciplinary and professional ideas we want to teach. The challenge of being clear about Plato's ideas is different from the challenge of clearly explaining cognitive dissonance or the concept of confidence intervals. The preparation and organization required to engage students in a discovery learning laboratory in biology is different from having students practice focus group interviews for their sociology class. Clarity and organization only seems "mundane" if we think about this aspect of teaching apart from the difficult ideas and methods in which we are trying to engage our students.

Teaching well requires a life-long commitment to developing our craft; we don't master a set of skills and move on. Developing this craft requires us not only to consider innovative pedagogies, high-impact practices, and engaging the latest work in our fields, but also to refine the basic tools we use in our work—just as athletes, dancers, woodworkers, musicians, and other artisans do throughout their careers. In our view, in order to improve student learning, it is important that our institutions devote the time, facilities, structures, and other resources so that all of the faculty who teach our students can develop their teaching skills. Such efforts need not replace the larger scale improvements that we described above, but neither should they be supplanted by these fancier, higher profile efforts.

Monday
Mar102014

Assessing Student Learning - Useful guidelines

Useful – Guidelines for Judging the Effectiveness of Assessing Student Learning, by Larry Braskamp and Mark Enberg

Friday
Feb142014

Do we need a culture of evidence or a culture of better? The Wabash Study of Institutional Change

In their 2014 report, Knowing What Students Know and Can Do: The Current State of Student Learning Outcomes Assessment in US Colleges and Universities, Kuh, Jankowski, Ikenberry, and Kinzie conclude by stating:

"Higher education may be on the verge of an inflection point where what follows is a more purposeful use of evidence of student learning outcomes in decision making which, in turn, has the potential to enhance academic quality and institutional effectiveness. To realize this promise sooner than later, colleges and universities must complete the transition from a culture of compliance to a culture of evidence based decision-making in which key decisions and policies are informed and evaluated by the ultimate yardstick: a measurable, positive impact on student learning and success."

We have heard the phrase "culture of evidence" for many years, and while we agree with the idea, we wonder whether the phrase makes evidence an end, rather than a means to an end. Our goal is to get better for students, and evidence is a key, but not the sole, means by which to achieve this goal.

In a recent review of our work with liberal arts colleges we noted that the colleges that made gains in improving student learning have "fostered a culture that supports the ongoing development and honest evaluation of educational experiments by students, staff, and faculty to improve teaching and learning" and that this culture is built on "a willingness to question the impact of courses, majors, and programs; . . . a sense of trust, respect, and collegiality among faculty, staff, administrators, and students; and an emphasis on small-scale, evidence-based improvement efforts that do not require additional resources." [See our report: Improving the Educational Quality of Liberal Arts Colleges]

So the cultures that "close the loop" not only have to collect evidence, but also must have other qualities that give evidence traction. Lots of schools have evidence—only a few schools put that evidence to use. Our long-term interest in learning more about the factors that give evidence actionable weight in some contexts but not in others has led us to begin a new national research project: the Wabash Study of Institutional Change (WSIC). We are kicking off that study today and hope that you will consider participating. For more information about the WSIC and your opportunity to contribute to the study, see the Call for Participation.