Grazing - a personal blog from Steve Ehrmann

Steve Ehrmann is an author, speaker, and consultant.
Showing posts with label assessment. Show all posts
Showing posts with label assessment. Show all posts

Thursday, December 18, 2014

Interesting opening at LaGuardia CC

Bret Eynon and his colleagues at LaGuardia are highly respected for their work on integrative learning and ePortfolios.  Bret asks for help in spreading the word about an exciting new position now open at the College:

"LaGuardia Community College was recently awarded a prestigious $2.9
million US ED "First in the World" grant. “Project COMPLETA:
Comprehensive Support for Student Success” links digital technology
with exciting pedagogical and co-curricular innovations to build success
for more than 25,000 of LaGuardia’s diverse, low-income students.
COMPLETA links a range of High Impact Practices, including the First
Year Experience, into a transformative, college-wide, integrative
design.   We're inviting applications for a Project Coordinator who will
play a critical role in helping to lead this showcase project.

"We're looking for candidates who have experience with higher education
innovation and project management.  COMPLETA links pedagogy, assessment,
professional development, and technology, including ePortfolio and
learning analytics.  We're seeking a smart, energetic innovator who will
be committed to our students, someone who can learn and grow as an
educational leader as they help to advance our nationally-recognized
change initiatives.  Detailed position description and application
information are both available at
https://www.rfcuny.org/hr/pvn/cgi-bin/show_job.asp?pvn=RMP-1141

"Please share this announcement with anyone you know who you might be
interested and appropriate.  The position is open till filled; resume
review will begin on January 27th.  We will circulate this announcement
now and again after the holidays.   Thanks for any assistance you can
provide.
"

Thursday, May 8, 2014

An Incremental Approach to Improving Learning Outcomes (Better than "Flipping")

Arguably the most important facing higher education is that, for a variety of reasons, the ways students aren't mastering higher order skills (ability to use knowledge to analyze, create, innovate, act wisely and ethically, etc.) nearly as much as needed nor as much as they once did.  Arum and Roksa's Academically Adrift is one persuasive source of empirical evidence on that point.  Just one of many important reasons for declining student achievement: full-time students are investing only about half the time in academic work than they did thirty years ago.

Against this backdrop comes a rush of discussion and confusion about 'flipping courses,' a notion that is sometimes justified as a strategy for improving higher order learning.  I think the term 'flipping' is being used to point to some good changes but, as a label, it's more misleading than helpful.

For example, a recipe for improving learning needs to include more than one way to assure that students learn from their assignments, including doing the kind of work, and enough work, to reorganize their minds.

I recently gave a featured address at the International Conference on College Teaching and Learning on this set of questions, entitled "Bit by Bit: An Incremental Approach to Improving Learning."

Briefly, many elements are needed for a successful, sustainable approach to teaching what is actually college-level learning, including:

  1. Reconsidering the course (and academic program) in light of what graduates need to be able to do with the content they've learned, in later courses and after graduation ("backward design");
  2. Stealing the students' beer time - assignments and other academic work that are so engaging that students will choose to spend more time studying (this is necessary but not sufficient for students to study more);
  3. Leveraging face-to-face opportunities for what can be done best face-to-face;
  4. At least four kinds of feedback (what Schön and Argyris called 'learning loops'), including:
    • Feedback that keeps students going (farther and deeper), helping them see progress, helping them get unstuck;
    • Feedback from that student work going to faculty, to help plan the next class session;
    • Feedback to faculty that helps them tweak the design of the course;
    • Feedback to faculty that helps all this work seem more rewarding, encouraging those faculty to keep on improving their courses.
I called the talk 'Bit by Bit' because these kinds of improvements don't all need to be done simultaneously or only in this order.  In fact there are even smaller chunks of improvement that can be tried (and supported by the institution), one at a time.

The long term goal, however, is cumulative, major changes in how we teach, how students invest in their own learning, and what our graduates are able to do.

I've recorded a version of the address on YouTube, in two installments. The whole talk is about 50 minutes long:






Wednesday, October 30, 2013

One way for faculty to save time while improving student learning

My friend Ann Ferren  told me this story about a science faculty member who was continually frustrated with how badly his students wrote lab reports.  Each week a new crop of poor writing would be handed in, and he would spend way too much time writing his comments in red ink all over them. But the writing failed to improve.

Inspiration struck.

He then tried the following:
a) He told them he really cared about their writing
b) He distributed the criteria he was using in grading (this is sometimes called a 'rubric')
c) He told them that as soon as their writing earned an "A", they would no longer be required to turn in lab reports.

The results were wonderful.

One quarter of the students got "A"s on their first report. Another quarter of his students got an "A" on their second report. Pretty soon he was saving time and only coaching students who genuinely had problems with writing.

PS.  Quite a few students continued to write the reports without handing them in; by writing a genuinely good report, those students has seen how writing a good report could help them learn from the lab work.


Sunday, September 22, 2013

What Kinds of Teaching Improvement are Most Important?

Which kinds of teaching improvement are most important for the Teaching & Learning Collaborative (TLC) to support over the coming years?  To advance that discussion, I'll suggest three interdependent goals now, and a couple more in an upcoming post:

1. Support learning-centered teaching.  There's a lovely cartoon showing a boy with his dog. The boy is talking to his friend, and boasting that he's taught Spot to whistle.  The friend responds dubiously, "I don't hear him whistling."  The first boy retorts, "I said I taught him. I didn't say he learned it!"

I hope we can help an increasing number of faculty teach in a way that's guided by the actual learning that occurs in their academic programs.  Faculty who understand teaching in this way ('the learning paradigm') believe that virtually every student is capable of excellence, if teaching can guide and stimulate them appropriately.  Because it's not obvious at the start what needs to be done to help students achieve excellence, there's a certain amount of trial and error every term - the instructor tries something and, if it works for some students, do more of it. If it doesn't work for some students, try something else.

  • The alternative view of teaching, sometimes called the 'instruction paradigm', is reflected in the comments of Spot's owner.  Teaching and learning are independent activities.  If you organize and present the content clearly, then you've taught it.  If the students learn it, that's entirely to their credit. If they don't, that's on them, too.  
Of course, it's not simple for faculty (or students) to see whether and how the student is learning, which leads to a second goal for TLC and units like it.

2. Support evidence-guided teaching. Because teaching needs to be guided by actual learning, then the faculty need to gather evidence of how the learning process is going.

More easily said than done.  For example, if the faculty member assesses the wrong thing --  testing whether the student can remember an expert's analysis when the real goal is to help students learn to analyze for themselves -- then scores or grades will mislead both the instructor and the student.

Testing what students have learned is necessary but not sufficient.  Analogy: people learning to bat in the game of baseball. Measuring their batting average, no matter how precisely, won't help them learn to hit better.  A very different kind of feedback is needed for that, e.g., slow motion video of how they swing at a pitch.  Faculty need to learn both how to provide two very different kinds of feedback for themselves and for their students: what the student has learned and how the student is learning.  Few faculty have received any training in the many ways in which these things have been done.  We can help with that.

3. Support faculty collaboration to improve learning.   I mean "faculty collaboration" in two different ways.

The first is illustrated by a research finding about composition courses.  In many evaluations of learning in composition, students are asked to write a composition at the beginning of the term and a second composition on a similar topic at the end of the term.  External graders then assess each paper without knowing when it was written.  The papers written at the beginning and at the end of the writing course often get similar grades. This does not mean that the students learned nothing about writing: over two or more courses, the essays do measurably improve.  The important lesson: the kinds of capabilities useful in life are often so complex and personal that one course often can't do not enough to create improvements large enough to measure.  As a senior once told me about something he'd learned, "I don't think I could have learned how to think that way in any one course, but, over the years, it gradually sank in."

That's why capstone courses and major projects in upper division courses can be so important: as sources of insight for faculty teaching lower division courses on where they're succeeding and where they need to improve.  

The second important kind of collaboration is between faculty and others, e.g.,  instructional designers, assessment experts, publishers and other materials developers outside the university.  I'll choose just one example: instructional designers in a number of departments at GW are currently testing ePortfolio products that faculty can use, individually and as teams, to gather and analyze evidence of student learning.

So those are my first three suggestions for where we should focus our support: learning-centered teaching, evidence-guided teaching, and collaboration to improve learning.

Over the next 5-10 years, what (additional) kinds of teaching improvement do you think that units like TLC should support?