Off to Scotland

Helen Barefoot and I were invited by the HEA to talk run a workshop on assessment and feedback at an all day Assessment event at the Robert Gordon University. What follows is a collection of (very quick) thoughts on the day …

Helen and I have run a few workshops together (inside UH) and so it was just great to take our work (much of which is guided by our ESCAPE activity) to colleagues outside UH. For various reasons the workshop did not run :-(. Despite our disappointment we did get to hear some great assessment related presentations.

Dai Hounsell presented a really grounded key-note and, in fact covered, much of what we were covering too. That assessment is not a new challenge, that good assessment is planned activity and that good assessment stimulates learning. We did not need the NSS to get us thinking that assessment is important. Some really useful slides from Dai that I will explore and come back to in a later post. Great start to the day.

A couple of student perspective presentations followed.
A student led campaign that successful introduced a turn-around-time policy for coursework and interestingly a policy to provide feedback on examination scripts. The learning gains to be had from providing feedback on examination scripts seems rather limited to me. I’m always banging-on about feedback creating consequences, and I’m just not convinced I know what consequences flow, or are able to flow, from feedback on end-of-process, high stakes assessment tasks. That’s a post for another day. But just to say, I’m off the fence on this one. I just don’t get it. Another delegate did note they had a similar policy at his institution and only 15% of the scripts (with feedback) were picked up. Surely we would be better placed putting our feedback on work that will be picked up and more importantly attended to, by the students. And relax!

Steve Draper, engaging as ever, had a couple of threads running through his presentation. First, was the interesting anomaly that overall a department was rated 5th against other departments (107 in total) for the NSS question overall, I am satisfied with the quality of the course and yet questions relating to feedback were ranked much lower. Feedback on my work has been prompt (ranked 54/107), Feedback on my work has helped me clarify things I did not understand (ranked 79/107) have received detailed comments on my work (ranked 101/107). Steve asked us to explore what might be going on. Was there a complex weighting algorithm for all the items on the NSS? Should the individual items of the NSS not sum to the overall score? If not, what was missing, what was the missing ingredient? Second, Steve separated declarative and procedural learning and pondered as to where our efforts on providing feedback might prove most effective. i.e. might we get more learning from less or (better targeted) feedback?

Off to Wales

I was invited to present some work on Blended Learning (which included assessment activity) to Glamorgan University. Rather than just present ‘stuff’ I tried to engage those that gave up their lunchtime by asking them to consider their own challenges and also ask what they thought supports learning. Clearly, technology enhanced learning is about learning, not technology, and so I wanted to help surface their own values and pedagogic perspectives. I presented the UH context and gave some examples of Blended Learning in practice.

Following the session I was whisked away to share some of our ESCAPE activity. Glamorgan have a Change Academy project which focuses on assessment . I tried to outline some of the ways in which we (the ESCAPE team)( were working and also highlight some of things worth considering.

I tried to emphasise

* That whilst assessment was the focus of our attention, our project was about change management too.

* the importance of, and benefits to be gained, by considering an Appreciative Inquiry approach to evaluation

* The importance of trying to understand the culture and constraints and of the Schools we were working with

* The importance of working with a principled approach to curriculum design and that we (the project lead) need to bring the principles to the Schools.

* That innovation and change is stimulated by many things and that we need to be alert to the different stimuli and create situations where they can flourish

* That developing educationally effective assessments alone might not stimulate all colleagues. Many staff are experiencing numerous time pressures and so consideration of resource efficiency along with educational effectiveness is important too.

It’s a real shame that I didn’t get more / any time to hear about their work but having established contact I will follow things up to see how they are working and how we might benefit from their insights too.

Module Coordinator Experiences

This week we held a lunch time seminar to give staff a chance to learn about the project and to hear from two of the module co-ordinators that we have been working with. James Johnstone is module coordinator for a second year module - Principles and Practice of Sports Science and Hazel Wagner is module coordinator for Advanced Corporate Reporting a third year module. Hazel and James spoke about the issues with the modules prior to the ESCAPE project and took us through the process of re engineering that they went through in order to increase the amount of engagement that the students had with their assessments. We had alluded to this at the Ulster conference ( see previous blog entry) but it was really exciting to hear the people responsible for managing and applying the changes speak with passion about their modules. The presentations gave an indication of what was possible if to quote James " .......we leave the Rolls Royce in the garage" This is a reference to the work done by Win Hornby, of Robert Gorden University on efficiency and effectiveness in assessment .

The assessments developed by Hazel and James were effectively multi component designed to engage students on a regular basis over the whole semester. They have multiple opportunities for feedback to students and for students to engage with the feedback,using it to inform their application to the next component of their assessment.

One of the themes of the assessments is that it gives the chance for the lecturers to understand where the students are at each part of the module - to really get a feel for the students grasp of topics or issues. This reminded me of the example of when I walk Holly, my Springer Spaniel, we are only together at the start and the end of the process - where she goes in the middle bit I am not too sure - we meet again at the end. This is all to often what happens with our students -we know what they are thinking at the start of the lecture and we know where they are at the end - but they probably have not been following us all the way through.

The seminar finished with question and answer session with the audience keen to quiz James and Hazel on their experience of applying the new assessment.

Belfast Bound!

Last week Mark and I presented some of our observations from the ESCAPE Project at the University of Ulster eighth annual eLearning Conference. I had never been to Northern Ireland before and was excited by what I saw - it certainly challenged my preconceptions . Belfast is a vibrant town, new buildings and infra- structure projects were springing up everywhere - and there was a real energy to the city. The venue for the conference was the School of Art and Design. The campus consists of two buildings, one a turn of the century the other a much more modern one. The buildings are connected by a new covered walkway. They were really excellent learning spaces, well designed and resourced.

Our presentation, which we gave twice, looked at the background to the ESCAPE project and the wider assessment landscape. Mark spoke about the challenges of the project and how the extensive literature on learning and assessment should be informing teachers practice. I spoke about working with module teams and discussed some of the changes that teams had put in place as a consequence of working with ESCAPE. We also discussed the role Appreciative Inquiry played in the project .

On the way back to the airport the taxi driver took us to see the Thompson Graving Dock. This is where the Titanic, which was built at Harland and Wolf in Belfast, was brought and fitted out after she was launched.

I contrasted this with the the keynote address at the conference, where professor Paul Moore spoke about the changing technologies that we use and how they have influenced us, using an in car record player from his father ford Anglia to illustrate his point. He spoke passionately about the iPhone and contrasted this with his blackberry which he referred to as a " wheelbarrow for emails". His perspective was an interesting one and his excitement about the impending launch of the iPad was infectious. Paul felt that this device would have a huge influence on learning over the coming years - interesting times!

For those of you that have not realised - the flag at the top of the blog is that of the White Star Line, the shipping line that operated the Titanic.

A Brand New Year

It's been quite a snowy start to the New Year here at the University of Hertfordshire with the University being effectively closed for two days. The snow has started to clear and things are now getting back to normal. Christmas seems to be a fast fading memory.

There are four modules that the ESCAPE team are working with, that finish in semester A - which is in two weeks time. We will be capturing the module team experiences through interviews and running the student online assessment survey again to capture the student view.

Conditioning and Exercise in Sport is a level 3 module due to start in semester B. We are working with them - looking to use students to produce a series of conditioning and exercise techniques as part of the formative assessment process. It will be interesting to see how the students get on .We will be issuing students with flipcams to record their sessions.

eBiolabs University of Bristol

We have been really impressed by the eBiolabs project at the University of Bristol - one of the three other project in our cluster. The project has many resonances with the work we are doing with one of our 9 modules -" Introduction to Biochemistry, Microbiology and Pharmacology". The module contains a large element of practical work and the eBiolabs approach of preparing students before they undertake the practicals by taking them through a series of online tasks. This element of engagement prior to the practical work itself and the corresponding post practical online tasks would be something that we would like to incorporate in the module.

We have spoken with Gus Cameron - the eBiolabs project manager and we are hoping to be able to use some of the stand-alone resources that his team have produced. This is an exciting opportunity for projects to start to disseminate the products that they have developed. We In turn anticipate that the case studies that we are developing along with our change management model - incorporating the AI approach will become widely available to others. The use of the JISC Design Studio is the ideal forum for such dissemination of project deliverables

Collateral Effects

The ESCAPE project is at its most critical and interesting stage - we have launched the new assessments with 8 of the 9 modules we are working with ( one is starting in semester b) and we are closely monitoring the results. Each of the modules has a different approach with some changing things drastically other less so. It is interesting to see the role that technology is playing with the use of virtual groups, wikis and flipcams in some modules - while others rely on a total realignment of the pedagogy and eschewing a technological aspect to the re-enginerring and concentrating on the pedagogical delivery in a traditional way - albeit constructively realigned.

We have been trying to capture the collateral effects that the project has had on teaching and learning across the schools. Examples include people trying approaches new to assessment that have spilled over from the project into other modules that they teach on. We are seeing things such as a sports coaching module using wikis as a collaborative vehicle with groups of students. A second year accounting module using virtual group work. The most interesting and unexpected secondary effect was a colleague taking a ESCAPE flipcam to the arctic with master's students and recording a not been recorded before ice flow phenomenon. It is this kind of unplanned but hoped for secondary effect that underpins our hopes for the sustainability of the project.

We are looking to post the video of the phenomenon on our University of Hertfordshire iTunesU channel.

Continuing with the video theme, we are looking a producing a series of quick instructional videos with Bio Science students for use in their laboratory sessions - demonstrating practical techniques. looking for inspiration and to show the team what was already available I looked on YouTube and was amazed at the number of instructional videos that are already available online. Clearly this is a popular subject and one where there are already off the shelve resources available.