Editing Wikipedia as part of teaching public health?

By Felix Stein

When the 2014 Ebola epidemic in West Africa struck, millions of concerned citizens from around the world wanted to read up on the disease. While many of them turned to the CDC Ebola portal and the WHO Ebola fact sheet, a staggering 17m readers a month consulted the Ebola page on Wikipedia[i]. Confronted with this sudden rise in its readership, Wikipedia editors made a concerted effort to improve their Ebola articles and to translate them into over 100 languages. The entries ended up being viewed more than 89m times in 2014 alone[ii].

This is only one of the examples that may convince academics and activists in public health to re-consider their engagement with Wikipedia. This post will argue that the website has become such an important source of medical information that it should no longer be ignored by the public health community. It then asks how best to incorporate Wikipedia editing into public health teaching, by drawing on recent experiences in the Masters of Public Health at the University of Edinburgh. We certainly have not found the perfect way of teaching with Wikipedia yet, and are still waiting for student feedback. However, we hope that a brief description of this year’s teaching efforts will already be useful for teachers and activists who find Wikipedia intriguing and consider incorporating it into their own courses. 

Too big to ignore

Wikipedia is the world’s largest freely accessible encyclopedia. Run out of “Wikimedia”, a comparatively small non-profit, headquartered in San Francisco, the site features over 49m articles and is visited over 15bn times a month[iii]. This kind of online traffic means that it consistently ranks among the top ten most visited websites on the planet[iv]. With over 10m monthly edits, Wikipedia’s overall growth remains staggering[v]. You can see and hear (!) some of these edits in real time by clicking on this link. While articles in the English language dominate Wikipedia’s content (there are over 5.7m of them and they are viewed over 7bn times a month[vi]), the site now features entries in over 300 different languages.

Wikipedia’s role for public health should not be underestimated. With over 164k medical articles in over 255 languages, its medical content is read more than 10m times a day[vii]. If the general public frequently resorts to it for healthcare information, so do over 90% of medical students as well as most physicians[viii]. As a free resource, Wikipedia’s medical content has become particularly important in low- and middle-income countries, especially for health issues such as stillbirths, which affect their populations disproportionately[ix]. To bypass persisting problems of slow and expensive internet access, several offline versions of the site have been developed, including a Wikipedia based medical app. Like it or not, Wikipedia’s size and growth have established it as one of the most used sources of medical information in the world[x].

A first port of call

While the website’s importance for public health is hard to contest, concerns about the quality of its entries persist, particularly in medical circles. For authoring and editing Wikipedia’s entries, the site mostly relies on volunteers from around the world, who can remain anonymous, with only their IP address being recorded. Without a single responsible author or editor and without formal peer review by experts, responsibility for published information is often hard to pin down. Attempts at personal and corporate self-promotion as well as “vandalism” i.e. deliberately deleting or deteriorating articles, are recurring problems[xi], as are unresolved editorial disputes[xii]. In addition, the constantly changing nature of Wikipedia entries and its multitude of authors and editors make it hard to reference the site for academic purposes[xiii].

In response to these problems, Wikipedia has gradually put in place a series of safeguards that ensure some editorial oversight, whilst still attempting to harness the power of world-wide volunteer editing. It has established referencing standards that determine whether or not an edit is acceptable (notoriously, the Daily Mail does not count as a legitimate source of information). An internal classification system ranks articles according to their quality and importance as well as authors in terms of the frequency and quality of past edits. Articles of great social importance can no longer be directly edited by just anyone. Instead, their edits require special approval from experienced editors. Hundreds of teams of regular contributors, known as “WikiProjects” work together as groups to improve specific sets of content, while computer programmes known as “bots” automatically pick up inappropriate edits and revert poorly edited pages back to their previous state. 

In the field of medicine and public health, editorial oversight is particularly stringent. Medical articles have higher referencing requirements than average entries, meaning that authors cannot simply cite newspapers or research articles if they want to make their edits stick. Instead, they need to reference review articles published in reputable medical journals, textbooks by established publishers and guidelines from respected international medical bodies. Moreover, entries that describe health conditions of global significance, such as the page on Ebola for example, cannot directly be edited by newcomers or unregistered users. Instead, new authors will find that all their proposed edits will have to pass review by more experienced editors before they are made public. In the field of health, reviewing editors will often come from a group of contributors known as “WikiProject Medicine”, dedicated to improving Wikipedia’s medical content. Their team currently counts over 80 active members. An independent non-profit organisation based in New York called “WikiProject Med” further expands Wikipedia’s medical content. Past and present institutional collaborations, for example with Cancer Research UK and with the British medical charity Cochrane have also made it possible to develop the site’s medical information in a more systematic fashion.

These editorial advances seem to bear fruit: Wikipedia’s better medical articles often feature over a hundred references[xiv]. Its entries on pharmacology and mental health mostly match those of standard pharmacology textbooks[xv] and of centrally edited online resources[xvi], while its entry on Dengue Fever has famously passed peer review in a major medical journal[xvii]. Wikipedia still lacks the consistency and clarity in authorship that peer-reviewed academic journals provide[xviii]. However, the structures that are currently in place mean that it can be trusted enough to serve as a first port of call for basic medical information. This may convince public health scholars and activists that if they were to edit Wikipedia, such edits would not be offset by potentially false or incomplete articles elsewhere on the site.

Should public health students edit Wikipedia?

If Wikipedia is now too big to ignore, and if its medical content is good enough to engage with, then how exactly can public health scholars work with the site? Apart from editing it themselves, they may want to ask their students to do the same as part of coursework. 

Including Wikipedia into teaching in this way promises a series of immediate pedagogical and wider social benefits. The exercise familiarises students with existing publishing standards in the online world. It forces them to think about what does and does not make for a reliable source, who qualifies as an expert on a subject, and how medical knowledge should or should not be created and disseminated[xix]. Writing on Wikipedia requires students to adopt a sober and fact-oriented tone, which stands in contrast to the argumentative style of essays or policy papers that they otherwise compose. It allows them to develop a new way of writing, one in which they are forced to communicate complex and highly specialised knowledge in an accessible manner. At the same time, editing Wikipedia enables students to improve the health literacy of the general public[xx]. They can thereby make pay-walled knowledge available to a much wider audience and combat the rise of purposefully misleading online information (viz. “fake news”). If edits are structured in the right way, they can even remedy existing biases in public knowledge by adding more information on under-represented groups or topics

Using Wikipedia edits as a tool for teaching can also be challenging: It takes expertise and time to teach students what Wikipedia is, why it matters, what its editorial guidelines are and how to open an editor’s account. Writing is likely going to be marked by trial and error, an exercise that can be frustrating if edits don’t stick. Moreover, the site’s user interface continues to be somewhat clunky and unintuitive, which means that students are initially going to need help on how to use it. Lastly, learning to edit Wikipedia as a group takes a bit of hardware, from functioning computers and a fast internet connection to working projectors, which makes this exercise difficult in some developing country settings. 

An overview of possible Wikipedia assignments:

Our experience of editing Wikipedia as part of teaching

This year, as part of our Masters of Public Health, we scheduled two one-hour sessions with a small cohort of students, in order to familiarise them with Wikipedia. Since the site only allows a restricted number of new editor accounts to be opened from the same IP address within a 24-hour period, the students were advised to prepare this session beforehand, by opening editor accounts on their own (following the steps outlined here). They were also asked to bring their own laptops to class if possible. 

During the first session, Ewan McAndrew, the University of Edinburgh’s Wikimedian in Residence[xxi], explained to the students what Wikipedia is, why it is relevant, and what its basic editorial guidelines are. He then showed them how to edit the site, and helped those students who had not yet opened an account to do just that. At the end of this first class, we asked students to identify a public health topic of their choice that they would edit during the next session, as well as some potential sources to reference.

During the second class, Ewan explained Wikipedia further, helped a few more students open editor accounts and we asked everyone to list the topic that they would edit on a flipchart, so as to avoid overlap with the work of others (as that may result in editing conflicts when saving one’s work). We then required students to add a minimum of 180 words to the health related page they had chosen. Students were allowed to work in pairs (yet most of them decided to work alone), and were given a few days after the session to complete their edits. To assess these edits, we asked the students to take before-and-after screenshots or pictures of the entry in question and to email those to usWe also tracked their edits online through a web-based tracking tool known as “dashboard” (more on this below).

We do not yet have student feedback on this exercise, so any conclusive assessment of it would be premature. Yet, what can be said already is that the students had visibly little trouble with the technicalities of editing Wikipedia. They managed to open editor accounts, improve existing entries and create new entry sections without needing a lot of help. They also chose interesting and highly relevant topics to work on, which ranged from “obesity” and “smoking” to “chronic respiratory diseases” and “ageing”. Lastly, their edits were of very good quality, explaining for example what kind of progress has been made by the Global Strategy for Women’s and Children’s Health or how best to adhere to treatment as part of managing Tuberculosis.

At the same time, there are aspects of this exercise that we would change for next year. First and foremost, two one-hour sessions were not enough to enable all first-time authors to learn how to edit an entry and to make their edits stick. While the technical aspects of this kind of work can be understood during this time, learning how to write and cite in the style that Wikipedia requires takes some getting used to. Finding the right tone and the right kinds of references is especially important for editing the more highly regulated medical pages. We are currently working on providing students with the kind of feedback that will allow all of them to have their changes accepted. Yet rather than doing this online, after concluding the exercise, it would be easier to spread teaching and face-to-face support over a total of four hours, so as to solve problems in the classroom, rather than via email. 

Secondly, it may make for an easier start to provide students with a curated selection of topics to edit, rather than letting them choose at will. This pre-selection allows students to get started by working on easy-to-edit short articles (known as “stubs”) where expansion is sorely needed, rather than the high quality and high-traffic entries, like Ebola where proposed edits often have to pass review before being added to a page. That said, once students have gained confidence from getting their first edits completed correctly there is nothing to stop them from contributing to such high profile pages as well. 

Lastly, the most efficient way of tracking student work is to simply sign all of them up to the online tracking tool known as the “Programs & Events Dashboard” beforehand, and to keep a list that matches their real names to their Wikipedia alias. That way, teachers can omit emailed screenshot confirmations altogether, keep a single record of student edits, and use the authorship highlighting tool to identify exactly which part of an article was edited, when and by whom. 

We hope that this first account of teaching with Wikipedia may be useful for other educators, and that this year’s short editing exercise has provided our students an initial idea of how medical information is created, circulated and supervised online. We look forward to repeating the Wikipedia editing exercise in the future.

 Further Resources:

References

[i] Cohen, N. (2014). Wikipedia Emerges as Trusted Internet Source for Ebola Information. NewYorkTimes. Online at: https://www.nytimes.com/2014/10/27/business/media/wikipedia-is-emerging-as-trusted-internet-source-for-information-on-ebola-.html

[ii] Masukume, G., L. Kipersztok, T. Shafee, D. Das and J. Heilman (2017). Updating Wikipedia should be part of all doctors’ jobs. Stat. Online at: https://www.statnews.com/2017/10/10/updating-wikipedia-part-doctors-jobs/

[iii] Wikimedia Foundation (2018). Wikipedia Report Card: summaries for 50 most visited languages. Online at: https://en.wikipedia.org/wiki/Wikimedia_Foundation

See also https://en.wikipedia.org/wiki/List_of_Wikipedias

[iv] See https://www.alexa.com/topsites

[v] Wikimedia Foundation (2018). English Wikipedia. Online at: https://stats.wikimedia.org/EN/ReportCardTopWikis.htm#lang_en

[vi] Ibid

[vii] Shafee, T., G. Masukume, L. Kipersztok, D. Das, M. Häggströmand J. Heilman (2017). "Evolution of Wikipedia’s medical content: past, present and future." Journal of Epidemiology and Community Health 71(11): 1122.

Also Heilman, J. M. and A. G. West (2015). "Wikipedia and Medicine: Quantifying Readership, Editors, and theSignificanceofNaturalLanguage." J MedInternetRes 17(3): e62.

[viii] Allahwala, U. K., A. Nadkarni and D. F. Sebaratnam (2013). "Wikipedia use amongst medical students – New insights into the digital revolution." Medical Teacher 35(4): 337-337.

Also, Hughes, B., I. Joshi, H. Lemonde and J. Wareham (2009). "Junior physician's use of Web 2.0 for information seeking and medical education: A qualitative study." International Journal of Medical Informatics 78(10): 645-655.

[ix] Masukume, G., L. Kipersztok, D. Das, T. Shafeeand M. Laurent (2016). "Medical journals and Wikipedia: a global health matter." TheLancetGlobalHealth.

[x] See also Laurent, M. R. and T. J. Vickers (2009). "Seeking Health Information Online: Does Wikipedia Matter?" Journal of the American Medical Informatics Association 16(4): 471-479. 

[xi] See https://en.wikipedia.org/wiki/Vandalism_on_Wikipedia and https://en.wikipedia.org/wiki/Wikipedia:Identifying_blatant_advertising

[xii] Massachusetts Institute of Technology (2018). Why some Wikipedia disputes go unresolved. International Journal of Science and Research (IJSR). Online at: https://www.sciencedaily.com/releases/2018/11/181106171816.htm

[xiii] Maskalyk, J. (2014). "Modern medicine comes online." Open Medicine 8(4): e-116-e119.

[xiv] Shafee, T., G. Masukume, L. Kipersztok, D. Das, M. Häggströmand J. Heilman (2017). "EvolutionofWikipedia’smedicalcontent: past, presentandfuture." JournalofEpidemiologyandCommunityHealth 71(11): 1122.

[xv] Kräenbring, J., T. Monzon Penza, J. Gutmann, S. Muehlich, O. Zolk, L. Wojnowski, R. Maas, S. Engelhardt and A. Sarikas (2014). "Accuracy and Completeness of Drug Information in Wikipedia: A Comparison with Standard Textbooks of Pharmacology." PloS One 9(9): 1-7.

[xvi] Reavley, N. J., A. J. Mackinnon, A. J. Morgan, M. Alvarez-Jimenez, S. E. Hetrick, E. Killackey, B. Nelson, R. Purcell, M. B. Yap and A. F. Jorm (2012). "Quality of information sources about mental disorders: a comparison of Wikipedia with centrally controlled web and printed sources." Psychological Medicine 42(8): 1753-1762.

[xvii] Maskalyk, J. (2014). "Modern medicine comes online." Open Medicine 8(4): e-116-e119.

[xviii] Ibid.

[xix] Azzam, A., D. Bresler, A. Leon, L. Maggio, E. Whitaker, J. Heilman, J. Orlowitz, V. Swisher, L. Rasberry, K. Otoide, F. Trotter, W. Ross and J. D. McCue (2017). "Why Medical Schools Should Embrace Wikipedia: Final-Year Medical Student Contributions to Wikipedia Articles for Academic Credit at One School." Academic medicine : journal of the Association of American Medical Colleges 92(2): 194-200.

[xx] C.f. Azzam, A. (2017). Embracing Wikipedia as a teaching and learning tool benefits health professional schools and the populations they serve. Innovations in Global Health Professions Education. Online at: https://journal.innohealthed.com/index.php/ighpe/article/view/57/63

[xxi] “Wikimedians in Residence” help promote the use and expansion of Wikipedia through training workshops. 

Special thanks to our Wikimedian in Residence Ewan McAndrew for commenting on an earlier draft of this text.