Mobile Learning Assessment – same…different then other course assessment?

The back drop of the question…(warning: this is a thinking post)
I am preparing for a panel discussion at the 25th Anniversary: Conference on Distance Teaching and Learning at the University of Wisconsin – Madison. Part of my responsibility is to cover the topic of mobile learning effectiveness (a.k.a. assessment). I would summarize my interpretation of that request to be “is mobile learning as effective as or more effective than other delivery systems (specifically, traditional which is still the most common).”
Assessment is never one of the most popular teaching activities and although quality improvement programs and accreditation have placed an emphasis on assessment. It is still a topic that is more often than not treated as an afterthought rather than a priority. In the case of new technology, it is easy to become focused on getting the technology to work and not as interested in incorporated a formal assessment. Usually, the faculty member will create an end of course professional assessment on whether the new technology worked or not. Typically, is ends up being and evaluation of the class technology and whether it should be scrapped or more likely modified to make sure the technology works better next time. An attempt to prove its validity against other delivery mechanisms is not usually part of the plan. For me, my assessment is an assessment of learning objectives and if they were met. The delivery mechanism is not important unless it causes learning objectives not to be met. I currently teacher in a traditional, hybrid/blended and online format. Mobile devices/learning supplements all my classes (this is another subject in itself).
Mobile Learning Assessment
I would argue that assessment is assessment. When a teacher evaluates their learning objectives whether through testing, survey and observations, the process supports defect prevention and continuous quality improvement. This is good. Standardized assessment may be very difficult to achieve. Even if it was standardized, to what extent is it important? Even if a standard is created; Not all teachers are the same; Not all subject can be viewed the same; Not all technology is same; Technology changes and it can affect classes from semester to semester. The nature of mobile learning can be very diverse. One teacher may leave students mostly on their own and another may have close supervisor of student learning on mobile devices. A standardized assessment maybe “a tough nut to crack.”
I vote, any assessment is good…
I think a discussion on discussing the merits of any delivery system is helpful to the extent it can make the delivery mechanism better through improvement. Whether mobile learning is better or worse than traditional delivery is the same argument that has been going on with on-line versus traditional. I think the most important thing to consider is that learning has become and is becoming even more personalized. The class is designed in a way to cater to each student. This is good because it allows students who are many times 20 years younger than their instructor the ability to learn in a format that works best for them (i.e. multi-tasking, technology, audio/video based, etc.). Personalization of instruction may remove age, learning preferences and cultural biases that all teachers may innocently include in their course delivery and approach. Because of this personalization, I think the teacher needs to choose the assessment process that is the most helpful to the instructor. Teachers are as different as students.
What changes with mobile learning…
There is no doubt that there are new pedagogies with mobile learning that do not exist in traditional delivery. We may want to consider these approaches when we are specifically evaluating a class that uses mobile learning. Mobile learning does some things that traditional did not and visa versa. However, we may want to look at mobile learning from these different perspectives and incorporate this in our assessments.
Mobile learning might additionally want to evaluate:
- Was the technology available (especially in regards to network connectivity)?
- Was the performance of the technology acceptable?
- Does it work on a variety of hardware platforms?
- Was the class truly mobile and did the mobility factor meet the course learning objectives?
- Did the mobile technology support mobile learning elements (video, phone, audio, GPS, etc.)?
- Many more could be added here….
So what?
What do you think? Do you have some thoughts on mobile learning effectiveness and assessment?
Send a comment.



on August 9, 2009 at 3:45 am
· Permalink
Can i get a one small picture from your blog?
on August 15, 2009 at 10:59 am
· Permalink
Which one are you interested in?