Critical Evaluation of Resources
Suitability
Authority
Other Indicators
Reference Sources
Links
In the research process you will encounter many types of resources including books, articles and websites.
But not everything you find on your topic will be suitable. How do you make sense
of what is out there and evaluate its authority and
appropriateness for your research?
Scope. What is the breadth of the article, book, website or other
material? Is is a general work that provides an overview of the topic
or is it specifically focused on only one aspect of your topic. Does the
breadth of the work match your own expectations? Does the resource cover
the right time period that you are interested in?
Audience. Who is the intended audience for this source? Is
the material too technical or too clinical? Is it too elementary or
basic? You are more likely to retrieve articles written for the appropriate
audience if you start off in the right index. For instance, to find
resources listing the latest statistics on heart disease you may want
to avoid the Medline database which will bring up articles designed
for practicing clinicians rather than social science researchers.
Timeliness. When was the source published? If it is a website,
when was it last updated? Avoid using undated websites. Library catalogs
and periodical indexes always indicate the publication date in the bibliograhic
citation.
| Scholarly vs. Popular
A scholarly journal is generally one that is published
by and for experts. In order to be published in a scholarly journal,
an article must first go through the peer review process
in which a group of widely acknowledged experts in a field reviews
it for content, scholarly soundness and academic value. In most
cases, articles in scholarly journals present new, previously un-published
research. Scholarly sources will almost always include:
- Bibliography and footnotes
- Author's name and academic credentials
As a general rule, scholarly journals are not printed on glossy paper,
do not contain advertisements for popular consumer items and do not
have colorful graphics and illustrations (there are, of course, exceptions).
Popular magazines range from highly respected publications
such as Scientific American and The Atlantic Monthly to general interest newsmagazines like Newsweek and US
News & World Report. Articles in these publications tend to
be written by staff writers or freelance journalists and are geared
towards a general audience. Articles in popular magazines are more
likely to be shorter than those in academic journals. While most
magazines adhere to editorial standards, articles do not go through
a peer review process and rarely contain bibliographic citations.
A good resource that provides background information to help you
evaluate periodicals is:
Magazines for Libraries (Doe Reference AP1.21.K3 Directories).
Tip: When searching a journal index
such as Expanded
Academic ASAP, try narrowing your search by limiting to refereed
publications. This will retrieve only scholarly journals matching
your search terms. Some other journal indexes offer this or a similar
option.
If you do your searches in Web
of Science, you will retrieve only scholarly articles since
only academic journals are indexed in this database.
|
Who is the author? What are his or her academic credentials? What
else has this author written? Sometimes information about the author
is listed somewhere in the article. Other times, you may need to
consult another resource to get background information on the author.
Sometimes it helps to search the author's name in a general web
search engine like Google.
Among the reference sources available that list biographical information
about authors and scholars are:
American Men & Women of Science (Doe/Biographies,
Biosciences, and some other Reference sections at Q141.C312). Ask at
reference desks about specialized versions for Economics, Medical, Social
& Behavioral, and other disciplines.
Contemporary Authors (Doe Reference CT214.A12.C592 Biographies).
Primarily literary and other writers. Partially online in Literature
Resource Center UCB only
Documentation. A bibliography, along with footnotes, indicate
that the author has consulted other sources and serves to authenticate
the information that he or she is presenting. In websites, expect
links or footnotes documenting sources, and referring to additional
resources and other viewpoints.
Objectivity. What point of view does the author represent?
Is the article an editorial that is trying to argue a position?
Is the website sponsored by a company or organization that advocates
a certain philosophy? Is the article published in a magazine that
has a particular editorial position? Consult these resources which
indicate whether a publication is known to be conservative or
progressive, or is affiliated with a particular advocacy group:
Magazines for Libraries (Doe Reference AP1.21.K3 Directories)
Left Guide (Doe Reference HS2321.L44.R54 Directories)
Right Guide (Doe Reference HS2321.L44.R54 Directories)
In the appendices to these volumes,
consult the lists of Periodicals; then look up the names of
sponsoring organization.
Primary vs. secondary research. In determining the appropriateness
of a resource, it may be helpful to determine whether it is primary
research or secondary research.
Primary research presents original research methods or
findings for the first time. Examples include:
- A journal article, book, or other publication that presents
new findings and new theories, usually with the data
- A newspaper account written by a journalist who was present
at the event he or she is describing is a primary
source (an eye-witness, first-hand account), and may also
be primary "research"
A secondary research does not present new research
but rather provides a compilation or evaluation of previously
presented material. Examples include:
- A scientific article summarizing research or data, such
as in Scientific American, Discover, Annual
Review of Genetics, or Bioglogical Reviews
- An encyclopedia entry and entries in most other Reference
books
- A textbook
Take an article in a popular magazine such as Mother Jones about the public health aspects of handgun control -- if it
relies on interviews with experts and does not present any new
research in the area, this article would be considered secondary
research. If one of the experts interviewed in the Mother
Jones article published a study in JAMA (The Journal
of the American Medical Association) documenting for the
first time the effect that handguns have on youth mortality
rates, only the JAMA article would be considered primary
research.
Websites. While most of the strategies listed
above for evaluating information can be applied to any type
of resource (books, articles or websites), the unfiltered, free-form
nature of the Web provides unique challenges in determining
a website's appropriateness as an information source. In evaluating
a website, these are some questions that you can ask yourself:
- Is there an author of the document? Can you determine
the producer's credentials? If you cannot determine the
author of the site, then think twice about using it as a
resource.
- Is the site sponsored by a group or organization? If it
is sponsored by a group or company, does the group advocate
a certain philosophy? Try to find and read "About Us"
or similar information.
- Is there any bias evident in the site? Is the site trying
to sell you a product? Ask why the page was put on the web?
- Is there a date on the website? Is it sufficiently up-to-date?
If there is no date, again, think twice about using it. Undated
factual or statistical information should never be used.
- How credible and authentic are the links to other resources?
Are the links evaluated or annotated in any way?
For a more detailed checklist of what to look for in a website and
how to do it, see Evaluating Web Pages: How and Why. |
Book reviews. A book review -- which can appear in a journal,
magazine or newspaper -- provides a descriptive, evaluative discussion
of a recently published book. Reading how others have evaluated
a book may help you decide whether to use that book in your research.
There are a number of indexes you can consult that provide references
to book reviews:
Book Review Digest (1905-current ) (Doe Reference Z1219.B8 Indexes). Online: 1905-1982 and 1983-current. UCB only
Book Review Index (1965- ) (Doe Reference Z1035.A1.B6 Indexes)
New York Review of
Books (1963-current).
Journal Indexes. You may also find reviews of books in many
journal indexes by searching on the title and/or author of the book.
Select a general
journal index or an index
for the subject area of the book.
Citation indexes. To see the impact a particular source
has had on scholarship, you may want to consult a citation index.
A citation index lists when and where a work has been cited. In
other words, you could consult a Citation Index to see
all the articles that have cited David Ho's research on HIV. The
citation indexes are all available in the following database:
Web of Science: http://isiknowledge.com/wos
Science Citation Index (1945-present)
Social Sciences Citation Index (1970-present)
Arts & Humanities Citation Index (1975-present)
The citation indexes are also available in print.
The
Good, The Bad & The Ugly: Or, Why It's a Good Idea to Evaluate
Web Sources. From New Mexico State University, this guide
includes links to examples of both "good" and "bad" websites.
How to Critically Analyze Information Sources. A quick guide
to help you determine the relevance and authority of a resource.
A useful companion guide is one titled Distinguishing
Scholarly Journals from Other Periodicals. Both from Cornell
University.
Evaluating
Information Found on the Internet. A thoughtful guide to evaluating
web and other Internet resources for scholarly purposes, from
John Hopkins University Library.
Evaluation of Information Sources is an extensive list of
links to the many other sites available on evaluating information.
Copyright © 2008
The Regents of the University of California. All rights reserved.
Last updated 11/09. Server manager: contact
|