Wikipedia:Wikipedia Signpost/2015-03-25/Recent research: Difference between revisions
Tbayer (WMF) (talk | contribs) |
Tbayer (WMF) (talk | contribs) headline, ref, copyedits |
||
Line 10: | Line 10: | ||
The authors attempt to answer the question "Who are the most important people of all times?" Their findings clearly show that different Wikipedias give different prominence to different individuals (the most prominent people, for the four Wikipedias, appear to be [[George W. Bush]], [[Mao Zedong]], [[Ikuhiko Hata]] and [[Adolf Hitler]], respectively). The Eastern cultures seem to prioritize warriors and politicians; Western ones include more cultural (including religious) figures. Interesting findings concern globalization: "While the English Wikipedia includes 80% non-English leaders among the top 50, just two non-Chinese made it into the top 50 of the Chinese Wikipedia... "Japanese Wikipedia is slightly more balanced, with almost 40 percent non-Japanese leaders". Findings for the German Wikipedia are not presented. Through the authors don't make that point, it seems that no women appear in the Top 10 lists presented. Overall, this seems like an interesting paper (it also received a [http://www.technologyreview.com/view/535356/computational-anthropology-reveals-how-the-most-important-people-in-history-vary-by/ writeup] in [[Technology Review]]), through the brief form (two pages) means that many questions about methodology remain unanswered, and the presentation of findings, and analysis, are very curt. On a side note, one can wonder whether this paper is truly related to [[anthropology]]; given that the only time this field is referred to in this work is when the authors mention that they are "replacing anthropological fieldwork with statistical analysis of the treatment given by native speakers of a culture to different subjects in Wikipedia." |
The authors attempt to answer the question "Who are the most important people of all times?" Their findings clearly show that different Wikipedias give different prominence to different individuals (the most prominent people, for the four Wikipedias, appear to be [[George W. Bush]], [[Mao Zedong]], [[Ikuhiko Hata]] and [[Adolf Hitler]], respectively). The Eastern cultures seem to prioritize warriors and politicians; Western ones include more cultural (including religious) figures. Interesting findings concern globalization: "While the English Wikipedia includes 80% non-English leaders among the top 50, just two non-Chinese made it into the top 50 of the Chinese Wikipedia... "Japanese Wikipedia is slightly more balanced, with almost 40 percent non-Japanese leaders". Findings for the German Wikipedia are not presented. Through the authors don't make that point, it seems that no women appear in the Top 10 lists presented. Overall, this seems like an interesting paper (it also received a [http://www.technologyreview.com/view/535356/computational-anthropology-reveals-how-the-most-important-people-in-history-vary-by/ writeup] in [[Technology Review]]), through the brief form (two pages) means that many questions about methodology remain unanswered, and the presentation of findings, and analysis, are very curt. On a side note, one can wonder whether this paper is truly related to [[anthropology]]; given that the only time this field is referred to in this work is when the authors mention that they are "replacing anthropological fieldwork with statistical analysis of the treatment given by native speakers of a culture to different subjects in Wikipedia." |
||
==="Wikipedia a reliable learning resource for medical students? Evaluating respiratory topics"=== |
|||
A paper in ''Advances in Physiology Education'' claims to assess the suitability of Wikipedia's respiratory articles for medical student learning. Forty Wikipedia articles on respiratory topics were sampled on 27 April 2014. These articles were assessed by three researchers with a modified version of the DISCERN tool. Article references were checked for accuracy and typography. Readability was assessed with the Flesch–Kincaid and Coleman–Liau tools. |
A paper in ''Advances in Physiology Education''<ref>{{Cite journal| doi = 10.1152/advan.00110.2014| issn = 1043-4046, 1522-1229| volume = 39| issue = 1| pages = 5-14| last = Azer| first = Samy A.| title = Is Wikipedia a reliable learning resource for medical students? Evaluating respiratory topics| journal = Advances in Physiology Education| date = 2015-03-01| url = http://advan.physiology.org/content/39/1/5| pmid = 25727464}}</ref> claims to assess the suitability of Wikipedia's respiratory articles for medical student learning. Forty Wikipedia articles on respiratory topics were sampled on 27 April 2014. These articles were assessed by three researchers with a modified version of the [http://www.discern.org.uk/discern_instrument.php DISCERN tool]. Article references were checked for accuracy and typography. Readability was assessed with the [[Flesch–Kincaid readability tests|Flesch–Kincaid]] and [[Coleman–Liau index|Coleman–Liau]] tools. |
||
The paper found a wide range of accuracy scores using the modified DISCERN tool, from 14.67 for "[Nail] clubbing" to 38.33 for "Tuberculosis". Incorrect, incomplete or inconsistent formatting of references were commonly found, although these were not quantified in the paper. Readability of the articles was typically at a college level. On the basis of these findings, the paper declares Wikipedia's respiratory articles as unsuitable for medical students. |
The paper found a wide range of accuracy scores using the modified DISCERN tool, from 14.67 for "[Nail] clubbing" to 38.33 for "Tuberculosis". Incorrect, incomplete or inconsistent formatting of references were commonly found, although these were not quantified in the paper. Readability of the articles was typically at a college level. On the basis of these findings, the paper declares Wikipedia's respiratory articles as unsuitable for medical students. |
||
Line 21: | Line 21: | ||
The paper's author fails to acknowledge that Wikipedia is an encyclopedia. Several of the DISCERN tool's questions are unsuitable for an encyclopedia. DISCERN questions such as "Does it describe how each treatment works?" and "Does it describe the risks of each treatment?" would be answered on other Wikipedia pages, not on the disease article's page. The paper's author makes an ''a priori'' assumption that the medical textbooks used for comparison are perfect sources. The author does not assess those textbooks with the DISCERN tool. |
The paper's author fails to acknowledge that Wikipedia is an encyclopedia. Several of the DISCERN tool's questions are unsuitable for an encyclopedia. DISCERN questions such as "Does it describe how each treatment works?" and "Does it describe the risks of each treatment?" would be answered on other Wikipedia pages, not on the disease article's page. The paper's author makes an ''a priori'' assumption that the medical textbooks used for comparison are perfect sources. The author does not assess those textbooks with the DISCERN tool. |
||
The paper states "[t]he number of citations from peer-reviewed journals published in the last 5 yr was only 312 (19%)." However this is far superior to the number of citations in the textbooks listed. The chapter on "Neoplasms of the lung" in Harrison's Principles of Internal Medicine (18th edition) contains no citations at all. Seven sources are listed in its "Further readings" section, of which only one is from the last five years. |
The paper states "[t]he number of citations from peer-reviewed journals published in the last 5 yr was only 312 (19%)." However this is far superior to the number of citations in the textbooks listed. The chapter on "Neoplasms of the lung" in [[Harrison's Principles of Internal Medicine]] (18th edition) contains no citations at all. Seven sources are listed in its "Further readings" section, of which only one is from the last five years. |
||
The paper states that the article on "clubbing... had no references or external links." This is incorrect. On 27 April 2014, Wikipedia's article on "Nail clubbing" had ten references. |
The paper states that the article on "clubbing... had no references or external links." This is incorrect. On 27 April 2014, Wikipedia's article on "[[Nail clubbing]]" had ten references. |
||
Several of the articles are at a rudimentary stage, containing limited information and lacking appropriate references. However two articles, "Lung cancer" and "Diffuse panbronchiolitis", were assessed by Wikipedia's editors at the highest standard and awarded "Featured article" status. Five more articles, "Asthma", "Chronic obstructive pulmonary disease", "Pneumonia", "Pneumothorax" and "Tuberculosis", reached "Good article" standard. These articles are exceptionally detailed, accurate, and well-referenced. Azer's paper makes no mention of the high quality of these articles. |
Several of the articles are at a rudimentary stage, containing limited information and lacking appropriate references. However two articles, "[[Lung cancer]]" and "[[Diffuse panbronchiolitis]]", were assessed by Wikipedia's editors at the highest standard and awarded "Featured article" status. Five more articles, "[[Asthma]]", "[[Chronic obstructive pulmonary disease]]", "[[Pneumonia]]", "[[Pneumothorax]]" and "[[Tuberculosis]]", reached "Good article" standard. These articles are exceptionally detailed, accurate, and well-referenced. Azer's paper makes no mention of the high quality of these articles. |
||
The paper uses an unvalidated tool for an inappropriate purpose without applying a suitable comparator, and inevitably draws incorrect conclusions. |
The paper uses an unvalidated tool for an inappropriate purpose without applying a suitable comparator, and inevitably draws incorrect conclusions. |
||
Line 31: | Line 31: | ||
Wikipedia is an encyclopedia. It is not a medical textbook, nor is it intended to replace medical textbooks. Rather, it should be used as a starting point by medical students. The quality of an individual article should be quickly assessed by the reader, and information can be confirmed in the references provided. Missing information should be sought from other sources such as textbooks. Students should be encouraged to use Wikipedia alongside medical textbooks to assist their learning. |
Wikipedia is an encyclopedia. It is not a medical textbook, nor is it intended to replace medical textbooks. Rather, it should be used as a starting point by medical students. The quality of an individual article should be quickly assessed by the reader, and information can be confirmed in the references provided. Missing information should be sought from other sources such as textbooks. Students should be encouraged to use Wikipedia alongside medical textbooks to assist their learning. |
||
Disclosure: I (Axl) am a Wikipedia editor, a pulmonologist, the main author of Wikipedia's "Lung cancer" article, and a major contributor to other respiratory articles. |
:''Disclosure: I ([[User:Axl|Axl]]) am a Wikipedia editor, a pulmonologist, the main author of Wikipedia's "Lung cancer" article, and a major contributor to other respiratory articles.'' |
||
Revision as of 15:30, 25 March 2015
This is a draft of a potential Signpost article, and should not be interpreted as a finished piece. Its content is subject to review by the editorial team and ultimately by JPxG, the editor in chief. Please do not link to this draft as it is unfinished and the URL will change upon publication. If you would like to contribute and are familiar with the requirements of a Signpost article, feel free to be bold in making improvements!
|
A monthly overview of recent academic research about Wikipedia and other Wikimedia projects, also published as the Wikimedia Research Newsletter.
Most important people of all times, according to four Wikipedia
This social network analysis[1] looks at the entire corpus of Wikipedia biographies (with data from English, Chinese, Japanese and German Wikipedias). The authors created several thousand networks (unfortunately, this short conference paper does not discuss precisely how) and used the PageRank algorithm to identify key individuals.
The authors attempt to answer the question "Who are the most important people of all times?" Their findings clearly show that different Wikipedias give different prominence to different individuals (the most prominent people, for the four Wikipedias, appear to be George W. Bush, Mao Zedong, Ikuhiko Hata and Adolf Hitler, respectively). The Eastern cultures seem to prioritize warriors and politicians; Western ones include more cultural (including religious) figures. Interesting findings concern globalization: "While the English Wikipedia includes 80% non-English leaders among the top 50, just two non-Chinese made it into the top 50 of the Chinese Wikipedia... "Japanese Wikipedia is slightly more balanced, with almost 40 percent non-Japanese leaders". Findings for the German Wikipedia are not presented. Through the authors don't make that point, it seems that no women appear in the Top 10 lists presented. Overall, this seems like an interesting paper (it also received a writeup in Technology Review), through the brief form (two pages) means that many questions about methodology remain unanswered, and the presentation of findings, and analysis, are very curt. On a side note, one can wonder whether this paper is truly related to anthropology; given that the only time this field is referred to in this work is when the authors mention that they are "replacing anthropological fieldwork with statistical analysis of the treatment given by native speakers of a culture to different subjects in Wikipedia."
"Wikipedia a reliable learning resource for medical students? Evaluating respiratory topics"
A paper in Advances in Physiology Education[2] claims to assess the suitability of Wikipedia's respiratory articles for medical student learning. Forty Wikipedia articles on respiratory topics were sampled on 27 April 2014. These articles were assessed by three researchers with a modified version of the DISCERN tool. Article references were checked for accuracy and typography. Readability was assessed with the Flesch–Kincaid and Coleman–Liau tools.
The paper found a wide range of accuracy scores using the modified DISCERN tool, from 14.67 for "[Nail] clubbing" to 38.33 for "Tuberculosis". Incorrect, incomplete or inconsistent formatting of references were commonly found, although these were not quantified in the paper. Readability of the articles was typically at a college level. On the basis of these findings, the paper declares Wikipedia's respiratory articles as unsuitable for medical students.
The paper's author apparently uses an arbitrary unvalidated modification of the DISCERN tool to assess the accuracy of articles. The nature of this modification is not specified, nor is it available at the journal's website as claimed by the paper.
The DISCERN tool does not assess accuracy. Rather, it is designed to assess "information about treatment choices specifically for health consumers". As such, the use of this tool is inappropriate to assess suitability for medical students.
The paper's author fails to acknowledge that Wikipedia is an encyclopedia. Several of the DISCERN tool's questions are unsuitable for an encyclopedia. DISCERN questions such as "Does it describe how each treatment works?" and "Does it describe the risks of each treatment?" would be answered on other Wikipedia pages, not on the disease article's page. The paper's author makes an a priori assumption that the medical textbooks used for comparison are perfect sources. The author does not assess those textbooks with the DISCERN tool.
The paper states "[t]he number of citations from peer-reviewed journals published in the last 5 yr was only 312 (19%)." However this is far superior to the number of citations in the textbooks listed. The chapter on "Neoplasms of the lung" in Harrison's Principles of Internal Medicine (18th edition) contains no citations at all. Seven sources are listed in its "Further readings" section, of which only one is from the last five years.
The paper states that the article on "clubbing... had no references or external links." This is incorrect. On 27 April 2014, Wikipedia's article on "Nail clubbing" had ten references.
Several of the articles are at a rudimentary stage, containing limited information and lacking appropriate references. However two articles, "Lung cancer" and "Diffuse panbronchiolitis", were assessed by Wikipedia's editors at the highest standard and awarded "Featured article" status. Five more articles, "Asthma", "Chronic obstructive pulmonary disease", "Pneumonia", "Pneumothorax" and "Tuberculosis", reached "Good article" standard. These articles are exceptionally detailed, accurate, and well-referenced. Azer's paper makes no mention of the high quality of these articles.
The paper uses an unvalidated tool for an inappropriate purpose without applying a suitable comparator, and inevitably draws incorrect conclusions.
Wikipedia is an encyclopedia. It is not a medical textbook, nor is it intended to replace medical textbooks. Rather, it should be used as a starting point by medical students. The quality of an individual article should be quickly assessed by the reader, and information can be confirmed in the references provided. Missing information should be sought from other sources such as textbooks. Students should be encouraged to use Wikipedia alongside medical textbooks to assist their learning.
- Disclosure: I (Axl) am a Wikipedia editor, a pulmonologist, the main author of Wikipedia's "Lung cancer" article, and a major contributor to other respiratory articles.
Most academics are not concerned about Wikipedia's quality - but many think their colleagues are
This recent study[3] is a valuable contribution to the small body of work on academics attitudes towards Wikipedia, and is the largest-scale survey in that field so far, with nearly a 1000 valid responses from the faculty at two Spanish universities. The authors find that Wikipedia is generally held in a positive regard (nearly half of the respondents think it is useful for teaching, while less than 20% disagree; similar numbers use it for general information gathering, through the numbers are split at about 35% on whether they use it for research within their own discipline). Almost 10% of the respondents say that they use it frequently for some teaching purposes. The numbers of those who discourage students from using it and those who encourage student to consult the site are nearly equal, at approximately quarter of the sample each. Almost a half have no strong feelings on this, and less than 15% strongly disagrees with students' use of Wikipedia - a finding that certainly suggests that the past few years have witnessed a major shift in academia (less than a decade ago, the stories of professors banning Wikipedia were quite common). Unsurprisingly, the faculty is much less likely to cite Wikipedia, with only about 10% admitting they do so. Almost 90% of the academics think Wikipedia is easy to use, but only about 15% think editing is easy - with over 40% disagreeing with that statement. About 2% of respondents describe themselves as very frequent contributors to the side, and 6% as frequent. Over 40% have no thoughts on Wikipedia editing and reviewing system, which leads the authors to suggest that "that most faculty do not actually know Wikipedia‘s specific editing system very well nor the way the [site's] peer-review process works". Asked about Wikipedia's quality, those who think Wikipedia articles are reliable outnumber those who disagree 2:1 (at 40% to 20%), with an even higher ratio (over 3:1) of those who agree that Wikipedia articles are up to date. The respondents are equally divided, however, on whether the articles are comprehensive or not. The authors thus conclude that the impression that most academics are concerned about Wikipedia's quality is not proven by their data. Nonetheless, the artifacts of Wikipedia early poor reception within academia linger: more than half of the respondents think that use of Wikipedia is frowned up by most academics, even through only 14% do so.
The study goes beyond presenting simple descriptive statistics, and gives us a number of interesting findings based on correlations: strongest correlation for teaching use is related to making edits (r=.59), followed by opinions that it improves students learning (r=.47), perception of and use by colleagues (r=.41), Wikipedia's perceived quality (r=.4) and its passive use (r=.3). The authors also find that views of and use of Wikipedia's is higher among the STEM fields than in the "soft", social sciences. This also explains the Wikipedia's higher popularity among male instructors (which disappears when controlled for discipline and the corresponding much lower population of women teaching in the STEM fields). Interestingly, the influence of age was not found to be significant, which the authors concluding that "that faculty’s decision to use Wikipedia in learning processes does not follow the usual pattern of other Web 2.0 tools where young people tend to be more frequent users."
Of immediate practical value to the Wikipedia community are the findings on what would help the respondents design educational activities using Wikipedia: 64% would like to see a "catalog presenting best practices", with similar numbers (about 50%) pointing to "getting greater institutional recognition", "having colleagues explaining their own experiences", and "receiving specific training".
Wikipedia assignments at Finnish secondary schools
A conference paper titled "Guiding Students in Collaborative Writing of Wikipedia Articles – How to Get Beyond the Black Box Practice in Information Literacy Instruction"'[4] (already briefly mentioned in our October issue) reports on the use of a Wikipedia student assignments in a somewhat different environment than the usual American undergraduates - instead, this one deals with Finish secondary school students. The authors use the guided inquiry framework, one that postulates that "information literacies are best learned by training appropriate information practices in a genuine collaborative process of inquiry", and that asks how collaborative Wikipedia writing assignments fit into this approach. The authors findings tie with the prior research on this subject: students are found to be more motivated than in traditional writing assignments, they develop skills in understanding wikis and Wikipedia (jncluding its reliablity) and in encyclopedic writing. They are however less likely to develop skills such as identifying reliable sources without additional instructions on this. The authors also note that "the limitation of encyclopaedic writing is that it is not intended to generate new knowledge but to synthesize knowledge from existing sources(i.e., a type of literature review)"; hence teachers who aim to develop skills in generating new knowledge have to consider alternative assignments. The author also stress the need to tailor the Wikipedia assignment (or any other) to the specific class.
Briefly
- ...:
Other recent publications
A list of other recent publications that could not be covered in time for this issue – contributions are always welcome for reviewing or summarizing newly published research.
- "..."
References
- ^ Gloor, Peter; De Boer, Patrick; Lo, Wei; Wagner, Stefan; Nemoto, Keiichi; Fuehres, Hauke (2015-02-18). "Cultural Anthropology Through the Lens of Wikipedia - A Comparison of Historical Leadership Networks in the English, Chinese, Japanese and German Wikipedia". arXiv:1502.05256 [cs].
- ^ Azer, Samy A. (2015-03-01). "Is Wikipedia a reliable learning resource for medical students? Evaluating respiratory topics". Advances in Physiology Education. 39 (1): 5–14. doi:10.1152/advan.00110.2014. ISSN 1522-1229 1043-4046, 1522-1229. PMID 25727464.
{{cite journal}}
: Check|issn=
value (help) - ^ Meseguer Artola, Antoni; Aibar Puentes, Eduard; Lladós Masllorens, Josep; Minguillón Alfonso, Julià; Lerga Felip, Maura (2014-12-11). "Factors that influence the teaching use of Wikipedia in Higher Education" (Article).
- ^ Sormunen, E. & Alamettälä, T. (2014). Guiding Students in Collaborative Writing of Wikipedia Articles – How to Get Beyond the Black Box Practice in Information Literacy Instruction. In: EdMedia 2014 – World Conference on Educational Media and Technology. Tampere, Finland: June 23-26, 2014
- Supplementary references and notes:
Discuss this story