Measures of quality

I spent a day in London this week at the British Academy Offices of the Quality Assurance Association (QAA). I was invited to attend as our University is part of the Futurelearn consortium and they wanted to bring the partners together with their QA people to discuss how involved or what place the QAA has/should have with monitoring quality of the courses that are on offer. There were representatives of about 10 of the partners, including Leeds, Cardiff, Exeter and Edinburgh. Mark Lester (Futurelearn) was our Chair and it was a nice informal (and open) discussion with Stephen Jackson of the QAA.

There were three questions that were put to us:

1. As corporates and others consider entering HE territory with their own MOOCs, is academic credit the key differentiator of MOOCs for the HE sector?
2. Given criticism of the varied quality of MOOCs, is their a role for any agency in helping to make the quality of MOOCs second to none?
3. How should one measure or evaluate the quality of a MOOC?

This was an interesting meeting for me because I haven’t been involved in many Futurelearn meetings (no time!) but I’ve kept my eyes on what’s been happening at my own institution and at others. I’ve watched the development of MOOCs from the sidelines and have noted various degrees of quality assurance processes being applied usually in accordance with current in house procedures. Which has worked fine and the results have been pretty good. This is only natural, as you would apply what you know. I had it in my head that maybe, just maybe we need to be thinking differently. I don’t have all the answers but I’m not sure using models of design and therefore QA created for a different time and system and squeezing then to fit, may not be the best approach.

What was also interesting for me was the conversations that purely focused on Futurelearn. I know it was a Futurelearn meeting and many of my colleagues are involved in the development of courses using their platform. However, the QAA were concerned with ALL UK MOOCs, not just those via a platform provider.

Being concerned with digital literacies, and the development of innovative and engaging learning, I see that MOOCs, in all their guises (cMOOC or otherwise) could be an effective tool for creating a wonderful, rich learning environment for many on campus students. I also know that in the UK we are very lucky and admired for, our quality of education provision, so the role of the QAA as a vehicle for quality enhancement and consistency is where I hope we can be headed.

Stephen Jackson mentioned that the QAA were going to develop their own MOOC with a set of toolkit like resources to offer guidance. I hope this works. That seems to be the best approach, ‘the guide on the side’.

One last comment, I felt that the last question on measures was a bit ‘old news’. One of the first articles I ever read about the MOOCs in the US was about how the learners provided the measures for success of MOOCs. The market via the tools at their disposal would speak, publicly, about successes and failures. Institutions wouldn’t have the control that they have over survey data, the learners would speak for themselves. Losing control is not comfortable for many institutions, but if you put yourself out there, be prepared for the fallout. Good or bad, we are always encouraging feedback from our students. It’s time we practice what we preached.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s