Do you remember this blogpost from March 2011? Probably not. It contains a mindmap on open science in technology enhanced learning. I mentioned back then that we will use it as an input for a publication. Almost two years later, I am very happy to announce that this paper is now published in IJTEL. The postprint of the article is open access and can be found on Mendeley.
An intense process
In September 2010, Günter Beham and I came up with the idea for a visionary article on open science in technology enhanced learning. Flying back from EC-TEL in Barcelona, we discussed our growing concern with the irreproducibility and incomparability of TEL research. A lot has happened since then. In November, I posted a note on TELpedia looking for further collaborators. Soon thereafter, an enthusiastic Derick Leony joined us, and we started working on an abstract. We submitted this abstract in January 2011 and received encouraging feedback and important hints from two anonymous reviewers. After that we created the mindmap, and I wrote the aforementioned blogpost to include more people in the spirit of Open Science. Wolfgang Reinhardt read the post and was immediately interested; thus, he became the last member of the author collective. We intensified our research and produced several drafts accompanied by regular Skype calls and flashmeetings. We submitted a first version of our article to Inderscience in May 2011. The manuscript was reviewed by three anonymous referees. The reviewers had various requests for revisions, but we were accepted for publication on the constraint of a successful re-review. We started incorporating the changes, broadening our initial focus on reproducibility and comparability to further benefits of Open Science. A final re-review in November 2011 gave green light to publication eventually.
It was interesting to see, how the open process drew people in and how that helped to grow and refine the article. In retrospect, I think that we could have been even more open, discussing our ideas beyond the mindmap in social networks and on Twitter. That might have helped to include people other than the original authors. Well, there is always a next time! Thanks to my co-authors for an awesome collaboration, and to the anonymous reviewers for their helpful comments. We do not see the publication as the end of the process; it is merely the start of a conversation. We want to invite you to download the paper, and tell us what you think.
Abstract: In this paper, we make the case for an Open Science in Technology Enhanced Learning (TEL). Open Science means opening up the research process by making all of its outcomes, and the way in which these outcomes were achieved, publicly available on the World Wide Web. In our vision, the adoption of Open Science instruments provides a set of solid and sustainable ways to connect the disjoint communities in TEL. Furthermore, we envision that researchers in TEL would be able to reproduce the results from any paper using the instruments of Open Science. Therefore, we introduce the concept of Open Methodology, which stands for sharing the methodological details of the evaluation provided, and the tools used for data collection and analysis. We discuss the potential benefits, but also the issues of an Open Science, and conclude with a set of recommendations for implementing Open Science in TEL.
Update: Below is a presentation of the paper that I held at the Opencamp in Graz.
Kraker, P., Leony, D., Reinhardt, W., & Beham, G. (2011). The case for an open science in technology enhanced learning International Journal of Technology Enhanced Learning, 3 (6) DOI: 10.1504/IJTEL.2011.045454