Thoughts on Assessment

My presentation at EduCon 2.1 helped me conceptualize some of my thoughts and research efforts on assessment in the 21st-century classroom. My interest in assessment emerged out of my research on blogging communities and adolescent literacy. The student participants in my study engaged in writing and reading through a variety of complex and rich interactions. They posted their own work on their blogs, commented on the work of their peers, linked to each other’s work, and initiated numerous conversations in the class blogosphere. My biggest challenge as a teacher-researcher was to figure out what kind of role I should play in the community. The traditional role of the teacher seemed inadequate. I knew that, as active bloggers and communicators, the students would not respond well to a teacher who enters the class blogosphere only to assign work or to evaluate their writing. Then another issue arose quite quickly - assessment. Once I started responding to student work in a readerly fashion and participating as a contributor, reader, and not just an evaluator, I realized that it would be unfair to the students to reduce all their rich interactions and complex online presence to a B+ or a 13/15. I realized that I needed to develop an assessment strategy that would take into account the complexity of student interactions online and recognize the process as much as the final product.

The students themselves helped me arrive at this realization. Only two days after I asked the students to compose a written response to the work we had covered, they began to use their blogs not only to brainstorm but also to request feedback from their peers and engage them in discussions about the work they were doing for this assignment. The assignment itself gave my students a lot of freedom - they could compose a personal reflection, an essay, a narrative account of their engagement with the material, or even a creative response in the form of a short story or a collection of poems. Two days after we discussed this task in class, I noticed that they turned to the class community for help. What follows is a list of individual blog entry titles that I found in the class community two days after the task was assigned:

Here's my plan - could you comment?

Work in progress. Please comment everyone.

Rough draft. Comments would be greatly appreciated.

My essay unfolds ... any thoughts?

Thesis improved (again). Tell me what you think.

Essay ... it's coming along. Pls post ideas and suggestions.

Improved introduction (after some comments and suggestions)

New and much improved planning post - expecting comments. Thanks.

I was very impressed - the students had turned to the community of their peers to request feedback. Then, I realized that none of the children asked me for feedback. It didn’t take long to realize that, a) they didn’t see me as a contributor in the community, and b) they associated me with corrections and grades. At this stage, they were not ready for corrections yet - they were simply interested in having conversations about their ideas. They needed somebody to talk to and, as their teacher, I was not at the top of their list.

Hardly surprising, I know. But this experience helped me realize that we don’t spend enough time providing feedback for our students and that most of what teachers consider teaching and assessment consists of marking and correcting student work. This kind of practice does not engage our students in those rich interactive processes of talking about their work and their ideas.

Initially, my role as a teacher was limited to first presenting the material (and engaging the students by initiating conversations) and then marking their work. I was absent from that rich part that happened in the middle where the students continued our classroom conversations online by brainstorming on their blogs, requesting and providing feedback, and engaging in conversations about some of the key ideas in the course. Instead of engaging with them, I just waited for them to submit their work.

Teacher and a class blogosphere

As my research continued, however, I realized that I needed to spend more time with them in the community that we had created together. I needed to not only give them the freedom to interact online but also support them as they engaged in virtual conversations about their work and posted planning/brainstorming entries. That complex and interactive process of knowledge building (represented by the middle square in the diagram above) required more of my involvement. It offered a great opportunity to support student learning and to learn more about the students as learners and individuals.

Unfortunately, teachers often don't know how to participate in that process and tend to focus on assessing the finished product. They tend to concentrate on the two areas in the diagram above where their roles are clearly defined. They focus on presenting content and then evaluating the quality of student responses to assigned tasks. These roles represent familiar territory, but they fail to take into account that teaching, learning, and assessment are interrelated. The problem with limiting ourselves to teaching and evaluating is that these roles alone ignore the potential to initiate and sustain rich interactions with knowledge. They ignore the opportunity to support our students as learners.

These traditional roles of provider and evaluator also reinforce the hierarchical relationship between teacher and student. However, a teacher who enters a community of independent learners/writers/researchers to support and encourage student learning removes that hierarchical structure and encourages students to become more involved in the assessment process. Assessment in this situation can become more collaborative because the teacher and the student have opportunities to discuss/co-construct the task itself, the criteria, the process of learning.

The Virtual Classroom Project Continues

I am delighted to report that the Virtual Classroom Project that I started last year on the island of jokaydia in Second Life is back in full swing. An Australian educator, Annabel Astbury, has been selected to be Educator-in-Residence on jokaydia until the end of February. Her residency was launched on February 1st at the jokaydia mini Unconference (you can download the audio recording of the sessions here).

The Virtual Classroom Project space on the island of jokaydia

Annabel (SL: Annabel Recreant) has been busy creating a very unique project. As a teacher of history, she is interested in creating a virtual learning space where visitors can learn about "settlement / colonisation in the south east of Australia." Specifically, she is interested in creating a space where students can explore and experience "the impact that colonisation had upon indigenous communities in Australia."

Annabel wants to create a space where the students can interact with the virtual land, where they experience the life of early settlers:

My idea is that when someone first visited the site they would be faced with a simulation of the Australian bush as it appeared pre settlement. Uncleared. Perhaps with evidence of Indigenous inhabitants. Features of the natural landscape.

Visitors may have read documents in class (hence the working with not around) or read some of the documents provided in another part of the space regarding elements of Frontier life such as the process of settling on a new land, difficulties faced, the ways these were solved (if at all) etc.

Once armed with some of this foreknowledge, visitors would be invited to clear the land themselves taking into account the topography, geography and physical elements of the landscape. Provided with a ‘box’ visitors would be invited to build their own hut, or settlement.

What I like about her project is that Annabel wants her virtual learning space to be a place where the visitors can build and create, not just view, watch, or listen to whatever has been prepared for them. She wants the visitors to not just read about early settlers in Australia but also to interact with the virtual landscape, to make it their own and, in the process, learn about issues faced by settlers. This idea emerged from some very critical questions about the educational potential of Second Life:

[...] I think I became a little disengaged at the end of last year with Second Life ... because I had reached a ‘now what?’ stage. Having been part of the community of learners on the Islands of Jokaydia was great, but personally I felt I had plateaued in what I could offer or do. More than that I think I started to find it difficult to see the other uses of Second Life other than that main one of being connected to a network of great teachers.

[...] what I began to obsess over was this: if anyone came to my plot .. why would they? Why would they come into Second Life merely to click on a few urls that would take them to the internet? To me, that wasn;t a good use of the platform.

To me, the problem Annabel describes here has always been a major weakness of how Second Life is used in education. It is often a place where artifacts are built for visitors and where mere reproductions of real-life lecture halls are quite common. Annabel wants to use Second Life as a place where students can build their own understanding while (virtually) building a homestead and clearing the land. She wants to engage visitors by providing them with primary and secondary sources that will then enable them to make well-informed decisions as virtual settlers. Her virtual classroom will never really be finished - it will be more of an empty canvas where visitors can construct their vision of early settler life.

Virtual Classrom Project - Annabel Recreant

Annabel envisions this project as an opportunity to show other educators how students can be encouraged to use virtual environments such as Second Life to build their own understanding of history so that it becomes visible to anyone who visits the virtual space. This is not going to be just about building a virtual space where students can click on some URLs and read secondary sources. Annabel wants to develop a virtual resource to engage students in Historical Thinking by providing them with resources they can consult and artifacts they can use to build their own understanding of history. It’s almost like creating a virtual world wiki where instead of being confronted with a carefully designed space, a student is given access to a variety of resources and tools to build that space and, in the process, demonstrate his or her understanding of the material. The wonderful part about this is that this process will make learning visible in 3D. A student who builds with the resources provided in this virtual space and by using her own understanding of the time period will create an artifact that other learners can explore, interact with, and also rebuild or redesign.

Virtual Classrom Project - Annabel Recreant

I hope that you will follow Annabel's work by reading her blog, checking out the Virtual Classroom Project Flickr group, and exploring her work inworld.

Imagining Better Conversations

A few days ago Will Richardson shared on his blog a conversation that he'd had with his daughter. I found his post to be very discouraging and, unfortunately, indicative of what often masquerades as education in many classrooms. I thought about this conversation for a long time and then decided to try to re-write it based on my ideas of what young people in 2009 should be doing in English class. The part in blue is the original conversation from Will's blog. The remaining part is my idealized view of what should have happened:

Heard while driving home from Tess’s basketball game earlier.

“But Dad, I’m the only one in my class who doesn’t have a cell phone.”

“I know Sweetie, but that’s not a great reason for getting one.”

“But Dad, it’s like embarassing.”

“I’m sorry Tess, really. Mom and I will talk about it again, but for now…”

“Ugh.”

Silence for a few minutes.

“So, anything happen at school today?”

“No.”

“Nothing?”

“Ugh. We got a writing assignment.”

“A writing assignment? What kind?”

“We’re learning persuasive essays.”

“Persuasive essays? Well that’s kind of appropriate.”

“Like, what do you mean?”

“Well, don’t you have something you want to persuade me to do?”

She looks at me and smiles. “Cell phone!” Pause. “Ugh.”

“What?”

“I can’t do it on cell phones.”

“Why not?”

“Because our teacher said we should focus on things we’re really interested in.”

“Aren’t you interested in getting a cell phone?”

“No. Well, yes … but this is … different. I wanna write about sharks.”

“Makes sense. You know a lot about them. But how would you make your essay persuasive?”

“People are prejudiced against sharks. Everyone thinks sharks are bloodthirsty, violent creatures. It’s not true. Not all of them are ... and they can work together, too. I wanna write about that.”

“And your teacher said yes?”

“She did, and … get this, she said I could interview this expert on sharks from the University of …  uhm, I forget. But she is a researcher and an expert on sharks.”

“Is ... she coming to do a talk at school?”

“No, dad. I will be meeting with her online, and with some other researchers that work with her.”

“Online? Just you? What about other kids?”

“They have other topics, so they’re working with other people.”

“Online?”

“Yes, online.”

“So, you’re going to find out more about sharks from this researcher in … where is she again?”

“Somewhere in California, I think … yes, she has a blog and some of her research is also online. She posted movies from her previous research trips on YouTube … we’re chatting tomorrow during class.”

“That’s soon!”

“We have to meet this week. She’s leaving for a research expedition, for two months …”

“… so you won’t be able to get in touch with her after she leaves.”

“Well, she’ll be sending updates to her lab from her cell phone … I guess her assistant could email them to me.”

“… or you could get your own cell phone.”

“Exactly!”

Paulo Freire always claimed that we should use our imagination to reframe our reality - to see beyond that which we find oppressing. This re-working of Will's conversation is my attempt to imagine a better classroom and to emphasize that what teachers need today - and more today than at any time in the past - is imagination.