Sunday 4 January 2015

How to Read Scientific Research Articles:

Source: http://www.istl.org/09-fall/article4.html

Previous	Contents		Next
Issues in Science and Technology Librarianship		Fall 2009
DOI:10.5062/F4S180FF

URLs in this
document have been updated. Links enclosed in {curly
brackets} have been changed. If a replacement link was located,
the new URL was added and the link is active; if a new site could not be
identified, the broken link was removed.

How to Read Scientific Research Articles: A Hands-On Classroom Exercise

Roxanne Bogucka

Science Instruction Librarian

University of Texas

Austin, Texas

roxanne.bogucka@austin.utexas.edu

Emily Wood

Reference/Instruction Librarian

Pierce College Fort Steilacoom

Lakewood, Washington

ewood@pierce.ctc.edu

Abstract

Undergraduate students are generally unfamiliar with
scientific literature. Further, students experience frustration when
they read research articles the way they read textbooks, from beginning
to end. Using a team-based active learning exercise, an instruction
librarian and colleagues at University of Texas at Austin introduce
nutritional sciences students to a method for reading research papers.
Librarians provide student-pairs with one section (introduction,
methods, results, or discussion) of a scientific research article.
Student-pairs read, discuss, and take notes, then join with pairs
assigned the other sections of the article to compare their
understanding of the research presented. The exercise reinforces
students' critical evaluation skills by providing a productive reading
strategy based on the purpose of each section of the research article.
This paper describes the active learning exercise and discusses its
implementation and evolution.

Introduction

In the fall semester of 2007, Roxanne started teaching three library
instruction sessions for an upper-division nutritional sciences course
with a significant writing component. The class typically has between 20
and 30 students. Students in the course identify, read, analyze, write
about, and present scientific research on selected topics in nutrition
and human health. The class is structured as a journal club, with two
major assignments -- a favorite paper presentation and a literature
review presentation. For the favorite paper assignment, students send a
research article of their choice to their classmates, who prepare two
questions for the presenter to address on the day he or she discusses
the selected article. Students similarly receive and submit questions on
classmates' literature reviews, which student reviewers address during
their scheduled presentations.

The instructor wanted students to learn how to search PubMed, how to
read and evaluate the articles they found in their searches, and how to
cite these articles, preferably via hands-on exercises.

The sessions incorporated active learning. Active learning is a
method of teaching that brings students into the process of their own
education through discovery and participation (Lorenzen 2001; Grassian & Kaplowitz 2001), and often involves a social aspect, such as collaboration among peers (McGill 2004).
Active learning methods have been used for some time in library
instruction, especially in health sciences library instruction (Francis & Kelly 1997; Fosmire & Macklin 2002)
but can be challenging for librarians to practice when their exposure
to students is limited to one session and they have much material to
cover (Drueke 1992).
Since Roxanne was meeting with the class for three instruction
sessions, we could build upon what students had learned during and in
between the earlier instruction sessions and devote more time to active
learning exercises.

It was easy enough to conceive what a hands-on session on PubMed or EndNote^TM
would look like, but creating a how-to-read exercise took more
investigation. Searches on reading scientific articles uncovered several
works that describe the typical sections of a research article and
their contents, plus a few recommended reading methods. Leedy (1981)
advises tackling an article straight through, but re-reading the
problem statement immediately after finishing the discussion section to
see whether the conclusions are congruent with the question posed. Polit
(2010) recommends skimming and a close re-read, followed by writing a synopsis. Gehlbach (1993)
advises busy clinicians to save time by reading an article's Methods
section first, since any Discussion or Conclusions arising from unsound
methodology would be of dubious value. While he has a point, a
Methods-first approach is too challenging for our population -- novice
users of scientific research.

Greenhalgh (2003)
notes two challenges novice users face in understanding scientific
literature -- inability to select the right types of articles for an
information need and a lack of strategy for effectively reading the
articles. These two skills -- evaluation and critical reading --
informed the learning outcomes for our information literacy session.

Searching for tutorials led to an excellent Flash animation from the Purdue University Libraries, "How to Read a Scientific Paper,"
and a useful note-taking form for reading scientific articles
(Purugganan & Hewitt 2004), which was adapted for use in the
nutritional sciences class. Repeat viewings of the Purdue tutorial led
Roxanne to wonder what readers would learn about an article if they had
only one section of it. Once that question arose, the article-reading
exercise practically planned itself. In the spring of 2009, the authors
co-taught the how-to-read session.

Materials Needed

For the main portion of this exercise, we selected three or four
research articles, to produce 12 or16 article sections. We generated the
article sections (Figure 1) by:

locating a PDF of the article
concealing or effacing the article title and journal title from every page
masking off sections of text so that the only text, figures, and
tables visible are those that belong in a particular section
(introduction, materials and methods, data/results,
discussion/conclusions) of the paper. (You can do this rather tediously,
using paper and a photocopier, or rather easily using Adobe Acrobat's
Redaction feature if you have access to it)
labeling each article section with the name of the first author
printing out each complete article, plus each article's four masked sections

Figure 1. Sections of Cheung et al. 2008: a) introduction b) methods c) results d) discussionIn addition, we created a folder in Academic Search Complete that contained:

a link to full-text of a research article with IMRaD (Introduction, Methods, Results, and Discussion) (Polit 2010) structure
a link to full text of a review article
database records with abstracts for at least three research articles and an equal number of review articles

We supplied note-taking forms for the students. It helped that chairs
and desks could be shifted around into small discussion groupings in
the classrooms used, but the exercise can be managed in rooms with
static furniture.

Description

The instruction session included several strategically placed active
learning exercises designed to replicate the research process for the
class's journal club assignment. At the end of the session we wanted
students to

analyze an article's structure and content in order to distinguish research articles from review articles
analyze elements of a database record in search results in order to classify an article as research or review
understand what information can be found in sections of a typical research article in order to read more efficiently
apply knowledge of reference tools in order to increase comprehension of research articles

We began by having students talk about their previous experiences
with scientific articles. Students were asked to describe common
elements in the structure of the articles they'd seen. We showed
students an IMRaD-format research article and a review article and drew
them into a discussion of the structural differences between research
articles and review articles. To check understanding, we displayed the
full text of other research articles and review articles and had
students distinguish between the two based on their structure.

Once students were able to distinguish between research and review
articles, we moved on to the abstract. For this assignment, students
needed to find and present on research articles. We wanted students to
be able to determine quickly whether search results in a database were
research or review articles, and to be able to decide whether a given
research article was worth their time based on the information conveyed
in the abstract.

From the folder we set up in Academic Search Complete, we displayed
database records with abstracts for several scientific articles. Working
as a class, students analyzed the language used in the abstract and/or
title, to determine whether an article presented original research or
reviewed the current state of research. From this activity the students
identified textual cues to help them learn to recognize abstracts for
research articles.

With this basic understanding established, we moved to the research
article reading exercise. We asked students to work in pairs but
depending on the size of the class and the day's attendance, some
students occasionally had to work as solos or in threes. Each pair
received an article section and a note-taking form (Figure 2).We took
care to avoid giving adjacent pairs sections from the same article.
Student pairs were allowed 10 minutes to read their sections and take
notes. Since we needed to re-use the article sections in a later class,
we asked students not to highlight their article section or write on it,
but to use the note-taking form instead.

Figure 2. Note-taking form (adapted from Purugganan & Hewitt 2004)We circulated through the classroom during this time, listening to
students' discussions of their article sections. When the 10 minutes
were up, we asked for a show of hands for all pairs that read sections
labeled Author A, Author B, Author C, etc., and had pairs move to sit
with the others who had read sections of the same article. Student pairs
were then given eight minutes to report out within their groups, in
this order: 1st, Methods pair; 2nd, Results pair; 3rd, Introduction
pair; 4th, Discussion pair. During the reporting phase we circulated
throughout the classroom, listening to the reports, glancing at
note-taking forms, and asking questions as needed to elicit students'
comments on the relative comprehensibility of their particular article
sections.

Though there was of course some variation, in most groups the pair
who read the Discussion section was most able to answer questions on the
note-taking form. Typically Discussion and Introduction pairs knew the
most about the research presented, while Methods pairs and Results pairs
had the least understanding of what their article was about. By having
students share their differences in information and understanding, based
on which section of the article they read, this exercise demonstrates
the value of the reading method we recommend for them, ADIR(M) --
Abstract, Discussion, Introduction, Results, (Methods).

Step 1: Abstract. Although it is not part of the reading exercise, we
tell students to start here and ask, "Is this article relevant enough to
proceed to the full text, or should I move on to another article?"

Step 2: Discussion. Ask "What are the researchers' findings?"

Step 3: Introduction. Ask "Why did the researchers do this study?" and
"Does the research question match up with the conclusions I read in Step
2?"

Step 4: Results. Ask "Are the data collected appropriate to answer the
research question?" and "Do the data support the conclusions?"

Step 5: Methods (optional). Ask "How can I repeat this study?" and "Are these methods suitable to gather the results reported?"

To close the instruction session we encouraged students to use online
reference sources as they read articles, to look up unfamiliar terms,
concepts, and methods. We modeled this process by taking a term from a
research article we had used earlier in the session and searching for it
in Gale Virtual Reference Library. The students also were shown how to
find e-book dictionaries in the library catalog and where to access
additional tips on research articles on the library web site.

Assessment

Our assessment of the effectiveness of these instruction sessions has
been strictly informal, through discussions with the course instructor
and a teaching assistant, and through comments from students. The course
instructor appreciated that this instruction session mirrored, on small
scale, tasks required for the course's major assignments, the favorite
paper presentation and the literature review presentation. The
instructor also reported that students show a better grasp of the
material, which she attributes to their ability to search for and
efficiently read scientific articles. She observed that the session
significantly reduced students' apprehension surrounding the scientific
literature research process and said that after this session students
reported that they felt more confident about their research abilities.
In recent course evaluations the instructor has scored highly when
students are asked if the "Instructor has increased my knowledge and
competence in this course." She attributes this response to this
collaboration with librarians for information literacy instruction.

Conclusion

Overall, students respond positively to the how-to-read exercise
because it quickly shows them that some scientific article sections
reveal more than others. After the active learning exercise students
seem more receptive to the reading method we suggest. This hands-on
exercise will continue to evolve, based on feedback from course
instructors and teaching assistants, as well as from students.

Acknowledgements

The authors wish to thank Michele Ostrow and Robyn Rosenberg for their comments on this article.

References

Badke, W.B. 2000. Research Strategies: Finding Your Way through the Information Fog. San Jose, Calif.: Writers Club Press.

Cheung, A.M., et al. 2008. Vitamin K supplementation in postmenopausal women with osteopenia (ECKO Trial): a randomized controlled trial. PLoS Medicine 5(10):1461-1472. [Online]. Available: http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fjournal.pmed.0050196 [Accessed: December 2, 2009].

Davies, B. & Logan, J. 2008. Reading Research: A User-Friendly Guide for Nurses and Other Health Professionals. Toronto: Mosby Elsevier.

Drueke, J. 1992. Active learning in the university library instruction classroom. Research Strategies 10(2):77-83.

Fosmire, M. and Macklin A. 2002.
Riding the active learning wave: problem-based learning as a catalyst
for creating faculty-librarian instructional partnerships. Issues in Science and Technology Librarianship. [Online]. Available: http://www.istl.org/02-spring/article2.html [Accessed: June 12, 2009].

Francis, B. & Kelly, J. 1997. Active learning: its role in health sciences libraries. Medical Reference Services Quarterly 16(1):25-37.

Gehlbach, S.H. 1993. Interpreting the Medical Literature. New York: McGraw-Hill.

Grassian E.S. & Kaplowitz, J.R. 2001. Information Literacy Instruction. New York: Neal Schuman.

Greenhalgh T. 2001. How to Read a Paper: The Basics of Evidence Based Medicine. London: BMJ Books.

How to read a scientific paper. West Lafayette (IN): Purdue University Libraries. [Online]. Available: {http://oldsite.lib.purdue.edu/phys/assets/SciPaperTutorial.swf} [Accessed: June 30, 2009].

Leedy, P.D. 1981. How to Read Research and Understand It. New York: Macmillan.

Lorenzen, M. 2001. Active learning and library instruction. Illinois Libraries 83(2):19-24

McGill, I. 2004. The Action Learning Handbook. New York: Routledge Falmer.

Machi, L.A. & McEvoy, B.T. 2009. The Literature Review. Thousand Oaks, CA: Corwin Press.

Polit, D.F. & Beck, C.T. 2010. Essentials of Nursing Research: Methods, Appraisal, and Utilization. Philadelphia: Lippincott Williams & Wilkins.

Puruggannan, M. & Hewitt, J.
2004. How to Read a Scientific Article. Houston (TX): Rice University.
Cain Project for Engineering and Professional Communication. [Online].
Available: http://www.owlnet.rice.edu/~cainproj/courses/HowToReadSciArticle.pdf [Accessed: June 30, 2009].

Contents