Revision as of 01:17, 23 June 2006 view sourceSlimVirgin (talk | contribs)172,064 edits →Check multiple independent sources: they needn't be independent, and it's not clear what independent even means← Previous edit | Revision as of 01:21, 23 June 2006 view source SlimVirgin (talk | contribs)172,064 edits copy edit, fixed headerNext edit → | ||
Line 68: | Line 68: | ||
However, bear in mind that we only report what reliable publications publish, although of course editors should seek to use the most authoritative sources. In accordance with Misplaced Pages's ] policy, we do not add our own opinion. | However, bear in mind that we only report what reliable publications publish, although of course editors should seek to use the most authoritative sources. In accordance with Misplaced Pages's ] policy, we do not add our own opinion. | ||
===Issues to look out for=== | |||
== Evaluating secondary sources == | |||
* Have |
* Have the secondary sources used multiple independent primary sources? | ||
* Do they have an agenda or conflict of interest, strong views, or other bias which may color their report? Remember that conflicts of interest are not always explicitly exposed and bias is not always self-evident. However, that a source has strong views is not necessarily a reason not to use it, although editors should avoid using political groups with widely acknowledged extremist views, like ] or the British ]. Groups like these may be used as primary sources only i.e. as sources about themselves |
* Do they have an agenda or conflict of interest, strong views, or other bias which may color their report? Remember that conflicts of interest are not always explicitly exposed and bias is not always self-evident. However, that a source has strong views is not necessarily a reason not to use it, although editors should avoid using political groups with widely acknowledged extremist views, like ] or the British ]. Groups like these may be used as primary sources only i.e. as sources about themselves and their own activities, although editors should proceed with caution. Extremist groups should not be used as secondary sources. | ||
* Find out what other people say about your sources. | * Find out what other people say about your sources. | ||
* Have |
* Have the sources reported other facts reliably, including on different subjects? Cross-check with what you already know. | ||
* Are they available to other editors to check? If not, inclusion is probably not appropriate. Note, however, that they need not be online; availability through a library is sufficient. | * Are they available to other editors to check? If not, inclusion is probably not appropriate. Note, however, that they need not be online; availability through a library is sufficient. | ||
=== What is an independent secondary source? === | === What is an independent secondary source? === | ||
⚫ | Even given the same primary sources, different analysts may come to different conclusions about the facts being reported. In practice, many secondary sources find and use different primary sources in the course of their research. Conscious biases, unconscious biases, and errors are not always self-evident. The best way to expose them is to cross-check with another secondary source. | ||
Independent secondary sources: | Independent secondary sources: | ||
* Have separate editorial oversight and fact-checking processes; | * Have separate editorial oversight and fact-checking processes; | ||
* Have not collaborated; | * Have not collaborated; | ||
* May have taken their own look at the available primary sources and used their own judgment in evaluating them. | * May have taken their own look at the available primary sources and used their own judgment in evaluating them. | ||
⚫ | Even given the same primary sources, different analysts may come to different conclusions about the facts being reported. In practice, many secondary sources find and use different primary sources in the course of their research. Conscious biases, unconscious biases, and errors are not always self-evident. The best way to expose them is to cross-check with another secondary source. | ||
== Using online and self-published sources == | == Using online and self-published sources == |
Revision as of 01:21, 23 June 2006
This page documents an English Misplaced Pages ]. Editors should generally follow it, though exceptions may apply. Substantive edits to this page should reflect consensus. When in doubt, discuss first on this guideline's talk page. |
]
Misplaced Pages articles should use reliable published sources. This page is an attempt to provide guidance about how to identify these. The two policy pages that discuss the need to use sources are Misplaced Pages:No original research and Misplaced Pages:Verifiability.
If you can provide useful information to Misplaced Pages, please do so, but bear in mind that edits for which no reliable references are provided may be removed by any editor.
What follows is a description of Misplaced Pages's best practices. Many articles may fall short of this standard until one or more editors devote time and effort to fact-checking and reference-running. (See efforts to identify reliable sources.) In the meantime, readers can still benefit from your contributions, bearing in mind that unsourced edits, or edits relying on inappropriate sources, may be challenged at any time.
There are many ways in which factual errors can be introduced into reports. Keep in mind that many articles are about characterizing the various factions in a dispute. This means that you will be looking for reliable published reports of people's opinions.
Some definitions
Please note the following terms:
- A fact is an actual state of affairs, which can be an historical event, or a social or natural phenomenon. To say of a sentence or proposition that it is true is to say that it refers to a fact.
- An opinion is a view that someone holds, the content of which may or may not be verifiable. However, that a certain person or group holds a certain opinion is a fact, and it may be included in Misplaced Pages if it can be verified; that is, if you can cite a good source showing that the person or group holds the opinion.
- A primary source is a document or person providing direct evidence of a certain state of affairs; in other words, a source very close to the situation you are writing about. The term most often refers to a document produced by a participant in an event or an observer of that event. It could be an official report, an original letter, a media account by a journalist who actually observed the event, or an autobiography. Statistics compiled by an authoritative agency are considered primary sources. In general, Misplaced Pages articles should not depend on primary sources but rather on reliable secondary sources who have made careful use of the primary-source material. Most primary-source material requires training to use correctly, especially on historical topics. Misplaced Pages articles may use primary sources only if have been published by a reliable publisher e.g. trial transcripts published by a court stenographer, or historic documents that appear in edited collections. We may not use primary sources whose information has not been made available by a reliable publisher. See Misplaced Pages:No original research and Misplaced Pages:Verifiability
- A secondary source summarizes one or more primary or secondary sources. Secondary sources produced by scholars and published by scholarly presses are carefully vetted for quality control and can be considered authoritative. A tertiary source usually summarizes secondary sources. Misplaced Pages is a tertiary source.
When reporting facts, Misplaced Pages articles should cite sources. There is a wealth of reliable information in tertiary sources such as the Encyclopædia Britannica. Note that unsigned Encyclopedia Britannica, World Book and Encarta articles are written by staff, not by experts, and do not have the same level of credibility. In recent years there has been a proliferation of specialized encyclopedias some in one volume and others multi-volume such as the New Grove and the Dictionary of American Biography. They can be considered authoritative. Older editions such as the 1911 Encyclopædia Britannica often have fuller articles than current editions on some subjects, though there is always the danger that the information is outdated.
When reporting that an opinion is held by a particular individual or group, the best citation will be to a direct quote, citing the source of the quote in full after the sentence (see Harvard referencing) or using a footnote or embedded link if the source is online. See WP:CITE for more details. If there is text, audio, or video available of someone expressing the opinion directly, you may include or transcribe an excerpt, which is allowed under fair use.
Unattributed material
Wikipedians often report as facts things they remember hearing about or reading somewhere, but they don't remember where, and they have no corroborating evidence. It is important to seek reliable sources to verify these types of reports, and if they cannot be verified, any editor may delete or challenge them.
It is always appropriate to ask other editors to produce their sources. The burden of evidence lies with the editor who has made the edit in question, and any unsourced material may be removed by any editor. However, some editors may object if you remove material without giving people a chance to find a source, particularly when the material is not obviously wrong, absurd, or harmful. Instead of removing such material immediately, editors are encouraged to move it to the talk page, or to place the {{fact}} template after the disputed word or sentence, or to tag the article by adding {{not verified}} or {{unsourced}} at the top of the page. See Misplaced Pages:Verifiability and Misplaced Pages:No original research, which are policy, and Misplaced Pages:Avoid weasel words.
In biographies of living persons
Unverified material that could be construed as critical, negative or harmful in articles about living persons should be removed immediately, and should not be moved to the talk page. The same applies to sections dealing with living persons in other articles. See Misplaced Pages:Biographies of living persons and Misplaced Pages:Libel.
Beware false authority
Look out for false claims of authority. Advanced degrees give authority in the topic of the degree. Web sites that have numerous footnotes may be entirely unreliable. The first question to ask yourself is, "What are the credentials and expertise of the people taking responsibility for a website?" Anyone can post anything on the web.
Use sources who have postgraduate degrees or demonstrable published expertise in the field they are discussing. The more reputable ones are affiliated with academic institutions. The most reputable have written textbooks in their field: these authors can be expected to have a broad, authoritative grasp of their subject. In general, college textbooks are frequently revised and try to be authoritative. High school and middle school textbooks, however, do not try to be authoritative and they are subject to political approval.
Exceptional claims require exceptional evidence
Certain red flags should prompt editors to closely and skeptically examine the sources for a given claim.
- Surprising or apparently important claims that are not widely known.
- Surprising or apparently important reports of recent events not covered by reputable news media.
- Reports of a statement by someone that seems out of character, embarrassing, controversial, or against an interest they had previously defended.
- Claims not supported or claims that are contradicted by the prevailing view in the relevant academic community. Be particularly careful when proponents say there is a conspiracy to silence them.
Evaluating sources
Editors have to evaluate sources and decide which are the most reliable and authoritative. For academic topics, every field has an established system of reviews and evaluations that can be found in scholarly journals associated with that field. In history, for example, the American Historical Review reviews around 1,000 books each year. The American Historical Association's Guide to Historical Literature (1995) summarizes the evaluations of 27,000 books and articles in all fields of history. Editors should seek out and take advantage of these publications to help find authoritative sources. Disagreements between the authoritative sources should be indicated in the article.
Also ask yourself:
- Do the sources have an agenda or conflict of interest, strong views, or other bias which may color their report? Remember that conflicts of interest are not always explicitly exposed and bias is not always self-evident. However, that a source has strong views is not necessarily a reason not to use it, although editors should avoid using political groups with widely acknowledged extremist views, like Stormfront.org or Al-Qaeda. Groups like these may be used as primary sources only as sources about themselves or about their viewpoints, and even then with caution and sparingly.
- Were they actually there? Be careful to distinguish between descriptions of events by eyewitnesses and by commentators. The former are primary sources; the latter secondary. Both can be reliable.
- Find out what other people say about your sources.
- Have they reported other facts reliably, including on different subjects? Cross-check with what you already know.
- Are the publications available for other editors to check? We provide sources for our readers, so they must be accessible in principle, although not necessarily online.
See Misplaced Pages:No original research and Misplaced Pages:Verifiability for more information.
Check multiple sources
Psychological experiments have shown that memory and perception are not as reliable as we would like them to be. In one experiment, subjects were shown playing cards with some anomalies. Subjects could usually identify normal cards correctly even if they were displayed for a very short amount of time. But when briefly flashed a black four of hearts, for example, most subjects would, without apparent hesitation or puzzlement, incorrectly identify it as either the four of hearts or the four of spades. Subjects only became aware of the anomalous cards with longer exposures. Subjects who were aware that these strange cards were mixed in with normal cards were also much better at identifying them.
Recent scientific experiments have begun to explain how the brain can remember imagined events as if they were real. Police, judges, and trial lawyers are familiar with the phenomenon that several different people witnessing the same event remember it and sometimes its crucial details differently. A common classroom exercise is to stage a sudden interruption of the class, then ask each student to write an account of what he or she saw. Most people also know that the older a memory is, the less reliable it may be. Recent studies have shown that this may be because memories are overwritten each time we access them.
Because conscious and unconscious biases are not always self-evident, you shouldn't necessarily be satisfied with a single source. Find another one and cross-check. If multiple independent sources agree and they have either no strong reason to be biased, or their biases are at cross purposes, then you may have a reliable account.
However, bear in mind that we only report what reliable publications publish, although of course editors should seek to use the most authoritative sources. In accordance with Misplaced Pages's No original research policy, we do not add our own opinion.
Issues to look out for
- Have the secondary sources used multiple independent primary sources?
- Do they have an agenda or conflict of interest, strong views, or other bias which may color their report? Remember that conflicts of interest are not always explicitly exposed and bias is not always self-evident. However, that a source has strong views is not necessarily a reason not to use it, although editors should avoid using political groups with widely acknowledged extremist views, like Stormfront.org or the British Socialist Workers Party. Groups like these may be used as primary sources only i.e. as sources about themselves and their own activities, although editors should proceed with caution. Extremist groups should not be used as secondary sources.
- Find out what other people say about your sources.
- Have the sources reported other facts reliably, including on different subjects? Cross-check with what you already know.
- Are they available to other editors to check? If not, inclusion is probably not appropriate. Note, however, that they need not be online; availability through a library is sufficient.
What is an independent secondary source?
Independent secondary sources:
- Have separate editorial oversight and fact-checking processes;
- Have not collaborated;
- May have taken their own look at the available primary sources and used their own judgment in evaluating them.
Even given the same primary sources, different analysts may come to different conclusions about the facts being reported. In practice, many secondary sources find and use different primary sources in the course of their research. Conscious biases, unconscious biases, and errors are not always self-evident. The best way to expose them is to cross-check with another secondary source.
Using online and self-published sources
Anyone can create a website or pay to have a book published, and then claim to be an expert in a certain field. For that reason, self-published books, personal websites, and blogs are largely not acceptable as sources. Exceptions may be when a well-known, professional researcher in his field of expertise, or a well-known professional journalist, has produced self-published material. In some cases, these may be acceptable as sources, so long as their work has been previously published by credible, third-party publications. However, exercise caution: if the information on the professional researcher's blog is really worth reporting, someone else will have done so.
Reliability
Evaluate the reliability of online sources just as you would print or other more traditional sources. Neither online nor print sources deserve an automatic assumption of reliability by virtue of the medium they are printed in. All reports must be evaluated according to the processes and people that created them.
Publications with teams of fact-checkers, reporters, editors, lawyers, and managers — like the New York Times or The Times of London — are likely to be reliable, and are regarded as reputable sources for the purposes of Misplaced Pages.
At the other end of the reliability scale lie personal websites, weblogs (blogs), bulletin boards, and Usenet posts, which are not acceptable as sources. Rare exceptions may be when a well-known professional person or acknowledged expert in a relevant field has set up a personal website using his or her real name. Even then, we should proceed with caution, because the information has been self-published, which means it has not been subject to any independent form of fact-checking.
The policy page that governs the use of sources is Misplaced Pages:Verifiability. Of self-published sources, it says: "Sources of dubious reliability are sources with a poor reputation for fact-checking, or with no fact-checking facilities or editorial oversight... Anyone can create a website or pay to have a book published. For that reason, self-published books, personal websites, and blogs are largely not acceptable as sources. Exceptions may be when a well-known, professional researcher in a relevant field, or a well-known professional journalist, has produced self-published material. In some cases, these may be acceptable as sources, so long as their work has been previously published by credible, third-party publications."
Note that Misplaced Pages itself does not currently meet the reliability guidelines; however, nothing in this guideline is meant to contravene the associated guideline: Misplaced Pages:Build the web. Wikilink freely.
Bulletin boards, wikis and posts to Usenet
Posts to bulletin boards and Usenet, wikis or messages left on blogs, are never acceptable as primary or secondary sources.
This is because we have no way of knowing who has written or posted them. In the case of wikis, the current content of an article is not guaranteed, being freely editable.
Personal websites as primary sources
A personal website (either operated by one individual or a group of individuals) or blog may be used only as a primary source, i.e., when we are writing about the owner of the website or the website itself. But even then we should proceed with great caution and should avoid relying on information from the website as a sole source. This is particularly true when the subject is controversial, and the self-publisher has no professional or academic standing.
Personal websites as secondary sources
Personal websites and blogs should not be used as secondary sources.
That is, they should not be used as sources of information about a person or topic other than the owner of the website. The reason personal websites are not used as secondary sources — and as primary sources only with great caution and not as a sole source if the subject is controversial — is that they are usually created by unknown individuals who have no one checking their work. They may be uninformed, misled, pushing an agenda, sloppy, relying on rumor and suspicion, or even insane; or they may be intelligent, careful people sharing their knowledge with the world. It is impossible to know which is the case. Visiting a stranger's personal website is often the online equivalent of reading an unattributed flyer on a lamp post, and should be treated accordingly.
Partisan websites
Partisan political and religious (or anti-religious) sources should be treated with caution, although political bias is not in itself a reason not to use a source. Widely acknowledged extremist political, religious, anti-religious and other websites — for example, those belonging to Stormfront, Hamas, the Aryan Nations website or the Socialist Workers Party — should never be used as sources for Misplaced Pages, except as primary sources, that is, in articles discussing the opinions of that organization or the opinions of a larger like-minded group, but even then should be used with great caution, and should not be relied upon as a sole source.
Great for easy access
Full-text online sources are preferable to offline sources if they are of similar quality and reliability, because they are easily accessed by other editors who want to check references, and by readers who simply want more information.
If you find a print source that is out of copyright or that is available on compatible licensing terms, add it to Wikisource and link to it there (in addition to the normal scholarly citation). Many significant out-of-copyright books have already been put online by other projects.
Self-published sources in articles about themselves
Material from self-published sources, whether published online or as a book or pamphlet, may be used as sources of information about themselves in articles about themselves, so long as there is no reasonable doubt about who wrote it, and where the material is:
- relevant to the person's notability, or, if the material is self-published by a group or organisation: relevant to the notability of that group or organisation;
- not contentious;
- not unduly self-serving or self-aggrandizing;
- about the subject, and does not involve claims about third parties, or about events not directly related to the subject.
Finding a good source may require some effort
Until more authors publish online, and more material is uploaded, some of the most reliable and informative sources are still available only in printed form. If you can't find a good source on the web, try a local library or bookstore. Major university libraries usually have larger collections than do municipal libraries.
Fact checking and reference-running can be time consuming. Your local public or academic library may not have the work cited by an article on its shelves. Often you can ask for a book through interlibrary loan, but this can sometimes take several weeks to do. Fortunately, new tools are now available online to make this work easier. Services such as Google Books, Amazon.com’s “search inside!” , the Internet Archive’s Million Book Project and the University of Michigan's Making of America allow you to search the full text of thousands of books. In addition, many similar subscription-based services may be available to though your public, college, university or graduate school libraries.
To check on facts and citations in Misplaced Pages, these databases are powerful tools. You can search them the same way that you do in an internet search. Enter the author in quotation marks and the title in quotation marks. If the book is in the database already, the search engine will find it. If it isn’t, you may discover another work that discusses the book you seek. For subjects, enter as many terms as you can recall. The engines will display a list of pages that contain these terms. Often you will be able to verify the fact you are checking or discover a significant point of view not represented in the Misplaced Pages article.
When you use one of these services, be sure to gather all the information you can find by selecting links such as “About the Book.” You should be able to assemble a citation in exactly the same way you do with a print publication. If there is an ISBN for the book, be sure to include it. Use the ISBN to link to the book, since several of these sites display only selected materials from the books they have online.
Sources in languages other than English
Because this is the English Misplaced Pages, for the convenience of our readers, English-language sources should be provided whenever possible, and should always be used in preference to foreign-language sources (assuming equal quality and reliability). For example, do not use a foreign-language newspaper as a source unless there is no equivalent article in an English-language newspaper. However, foreign-language sources are acceptable in terms of verifiability, subject to the same criteria as English-language sources.
Keep in mind that translations are subject to error, whether performed by a Misplaced Pages editor or a professional, published translator. In principle, readers should have the opportunity to verify for themselves what the original material actually said, that it was published by a credible source, and that it was translated correctly.
Therefore, when the original material is in a language other than English:
- Where sources are directly quoted, published translations are generally preferred over editors performing their own translations directly.
- Where editors use their own English translation of a non-English source as a quote in an article, there should be clear citation of the foreign-language original, so that readers can check what the original source said and the accuracy of the translation.
Advice specific to subject area
History
Historical research involves the collection of original or “primary” documents (the job of libraries and archives), the close reading of the documents, and their interpretation in terms of larger historical issues. To be verifiable, research must be based on the primary documents. In recent decades, many more primary documents (such as letters and papers of historical figures) have been made easily available in bound volumes or online. For instance, the Jefferson Papers project at Princeton begun in 1950 has just published volume 30, reaching February 1801. More recently, primary sources have been put online, such as the complete run of the London Times, the New York Times and other major newspapers. Some of these are proprietary and must be accessed through libraries; others such as “Making of America”, publishing of 19th century magazines, are open to the public.
Scholars doing research publish their results in books and journal articles. The books are usually published by university presses or by commercial houses like W.W. Norton and Greenwood which emulate the university press standards. Reputable history books and journal articles always include footnotes and bibliographies giving the sources used in great detail. Most journals contain book reviews by scholars that evaluate the quality of new books, and usually summarize some of their new ideas. The American Historical Review (all fields of history) and Journal of American History (US history) each publish 1000 or more full-length reviews a year. Many of the major journals are online, as far back as 1885, especially through JSTOR.org. A good book or article will spell out the historiographical debates that are ongoing, and alert readers to other major studies.
On many topics, there are different interpretive schools which use the same documents and facts but use different frameworks and come to different conclusions. Useful access points include: scholar.google.com and books.google.com, and (through libraries) ABC-CLIO’s two abstract services, American: History and Life (for journal articles and book reviews dealing with the US and Canada), and Historical Abstracts (for the rest of the world.) Research libraries will hold paper guides to authoritative sources. The most useful is The American Historical Association's Guide to Historical Literature, edited by Mary Beth Norton and Pamela Gerardi 2 vol (1995), which is an annotated bibliography of authoritative sources in all fields of history.
There are many other sources of historical information, but their authority varies. A recent trend is a proliferation of specialized encyclopedias on historical topics. These are edited by experts who commission scholars to write the articles, and then review each article for quality control. They can be considered authoritative for Misplaced Pages. General encyclopedias, like the Encyclopedia Britannica or Encarta, sometimes have authoritative signed articles written by specialists and including references. However, unsigned entries are written in batches by freelancers and must be used with caution.
College textbooks are updated every few years, are evaluated by many specialists, and usually try to keep abreast of the scholarship, but they are often without footnotes and usually do not spell out the historiographical debates. Textbooks at the K-12 level do not try to be authoritative and should be avoided by Misplaced Pages editors. Every place has guide books, which usually contain a capsule history of the area, but the great majority do not pretend to be authoritative. On many historical topics there are memoirs and oral histories that specialists consult with caution, for they are filled with stories that people wish to remember — and usually recall without going back to the original documentation. Editors should use them with caution.
The general public mostly gets its history from novels, films, TV shows, or tour guides at various sites. These sources are full of rumor and gossip and false or exaggerated tales. They tend to present rosy-colored histories in which the well-known names are portrayed heroically. Almost always editors can find much more authoritative sources.
- See also Historiography
Physical sciences, mathematics and medicine
Cite peer-reviewed scientific publications and check community consensus
Scientific journals are the best place to find primary source articles about scientific experiments, including medical studies. Any scientific journal that insists on being taken seriously is peer-reviewed, which means that independent experts in the field are asked to (usually anonymously) comment on articles before they are published. This usually results in corrections and improvement, sometimes substantial. Many articles are excluded from peer-reviewed journals because they report unimportant or questionable research, in the opinion of the editors.
In particular be careful of material in a journal that is not peer-reviewed reporting material in a different field. In the Marty Rimm affair a law journal edited by students accepted a paper making claims on Internet pornography which were in effect social science experiments. See Sokal affair for a hoax played on a journal of literary criticism which inadvisedly accepted a nonsense paper bristling with physics jargon.
- The fact that a statement is published in a refereed journal does not make it true.
Even a well-designed experiment or study can produce flawed results. (For example, see the Retracted article on neurotoxicity of ecstasy published in the very prestigious journal Science). Also, peer review is poor at uncovering deliberate fraud. The Schön affair bears witness to that.
A second, informal part of peer review occurs after publication. Colleagues in the field will read the journal article and discuss it in various forums, including other journals in the same field and often later articles in the same journal. They may find evident flaws in the procedure used just by reading the article and applying their experience, or it may take a long process of trying to reproduce the results by similar or completely different means for the scientific community to determine that the original results were corrupted by some undetermined methodological problem, or to rigorously confirm the original result. The most reliable source for scientific information is the prevailing "scientific consensus".
Short of polling a group of experts in the field, determining the scientific consensus can be accomplished by following what is accepted as the state of knowledge in review articles.
There is sometimes no one prevailing view because the available evidence does not yet point to a single answer. Because Misplaced Pages not only aims to be accurate, but also useful, it generally tries to explain the theories and empirical justification for each school of thought, with reference to published sources. Editors should not, however, create arguments themselves in favor of, or against, any particular theory or position. See Misplaced Pages:No original research, which is policy.
- Just because something is not an accepted scientific fact, as determined by the prevailing scientific consensus, does not mean that it should not be reported and referenced in Misplaced Pages.
However, although significant-minority views are welcome in Misplaced Pages, the views of tiny minorities need not be reported. See Misplaced Pages:Neutral Point of View. Significant-minority views should be reported as that, and should not be given the same amount of space in an article as the majority view.
Simply make readers aware of any uncertainty or controversy. A well-referenced article will point to specific journal articles or specific theories proposed by specific researchers, rather than: "Some say that... (vague, unattributed theory), but others believe... (vague, unattributed theory)."
Avoid citing the popular press
The popular press generally does not cover science well. Articles in newspapers and popular magazines generally lack the context to judge experimental results. They tend to overemphasize the certainty of any result, for instance presenting a new experimental medicine as the "discovery of the cure" of a disease. Also, newspapers and magazines frequently publish articles about scientific results before those results have been peer-reviewed or reproduced by other experimenters. They also tend not to report adequately on the methodology of scientific work, or the degree of experimental error. Thus, popular newspaper and magazine sources are generally not reliable sources for science and medicine articles.
What can a popular-press article provide? Often, the most useful thing is the name of the head researcher involved in a project, and the name of his or her institution. For instance, a newspaper article quoting Joe Smith of the Woods Hole Oceanographic Institution regarding whales' response to sonar gives you a strong suggestion of where to go to find more: look up his work on the subject. Rather than citing the newspaper article, cite his published papers.
Which science journals are reputable?
A good way to determine which journals are held in high esteem without polling a bunch of scientists is to look at Impact Factor ratings, which track how many times a given journal is cited by articles in other publications. Be aware, however, that these impact factors are not necessarily valid for all academic fields and specialties.
As a rule of thumb, journals published by scientific societies are of higher quality than those published by commercial publishers, Nature and the offerings of Cell Press being a notable exception.
Keep in mind that even a reputable journal may occasionally post a retraction of an experimental result. Articles may be selected on the grounds that they are interesting or highly promising, not merely because they seem reliable.
arXiv preprints and conference abstracts
There are a growing number of sources on the web that archive the full text of articles before they have been formally published in a journal, and publish abstracts of papers to be presented at conferences. Editors should be aware that preprints in such collections, like those in the arXiv collection, may or may not be accepted by the journal for which they were written — in some cases they are written solely for the arXiv and are never submitted for publication. Similarly, papers presented at conferences may not merit publication after presentation at the conference.
For this reason, arXiv (or similar) preprints and conference abstracts should be considered to be self-published, as they have not been published by a third-party source, and should be treated in the same way as other self-published material. See the section above on self-published sources. Most of them are also primary sources, to be treated with the caution as described in various sections of this guideline.
Evaluating experiments and studies
There are certain techniques that scientists use to prevent results from being contaminated by certain kinds of common errors, and to help others replicate results.
- Experimental control
- Placebo controls
- Ensuring demographic information aligns with the general population to check that the sample is sufficiently random
- Double-blind medical studies
- Present a high degree of detail about the design and implementation of the experiment; don't just present the results.
- Make raw data available; don't just present conclusions.
Statistics
Statistical information is easily and often misinterpreted by the public, by journalists, and by scientists. It should be checked and explained with the utmost care, with reference to published sources.
See Misuse of statistics, Opinion poll, and Statistical survey for common errors and abuses.
Law
First of all, remember there are several legal traditions and that laws are only valid in their own jurisdiction. An expert on Californian and U.S. federal law is not qualified to comment on French or German law. The opinion of local experts is therefore preferred, in general, to that of outside commentators.
Some of the commentary on laws and court decisions is heavily slanted for political purposes, with ample use of hyperbole, which should not be taken at face value. For instance, people opposing certain criminal procedure laws may claim that they "suppress the presumption of innocence" or "suspend the rule of law". Such comments, while they can be reported as opinion, should not be represented as fact.
When discussing legal texts, it is in general better to quote from the text, or quote from reputable jurists, than to quote from newspaper reports, although newspaper reports in good newspapers are acceptable too. The journalist who wrote the paper may not be trained as a lawyer, although s/he may have access to a wider variety of legal experts than many lawyers do, so judge the quality of the report according to how well that journalist, or that newspaper, has covered legal issues in the past.
Popular culture and fiction
Articles related to popular culture and fiction must be backed up by reliable sources like all other articles. However, due to the subject matter, many may not be discussed in the same academic contexts as science, law, philosophy and so on. Therefore, the most reliable material available is expected, but sources for these topics should not be held to as strict a standard. See Misplaced Pages:Requests_for_arbitration/Wilkes,_Wyss_and_Onefortyone#Sources_for_popular_culture.
However, keep in mind that personal websites, wikis, and posts on bulletin boards, Usenet and blogs should still not be used as secondary sources.
See also
- Misplaced Pages:Neutral Point of View, policy
- Misplaced Pages:No original research, policy
- Misplaced Pages:Verifiability, policy
- Misplaced Pages:Cite sources, style guide
- Misplaced Pages:Check your facts, style guide
- Misplaced Pages:Common knowledge, guideline
References
- The playing card experiment is described by Thomas Kuhn in The Structure of Scientific Revolutions (1962), p. 62-64. He cites the following article: J.S. Bruner and Leo Postman, "On the Perception of Incongruity: A Paradigm," Journal of Personality, XVIII (1949), 206-23. Following the advice of this page, the original source should be checked to see if the summary of Kuhn's summary is accurate.
- False memories based on imagined events: "Biological Basis for False Memories Revealed" by Michelle Trudeau. All Things Considered 23 Oct 2004.
- "Making False Memories." Talk of the Nation Science Friday. 4 Feb 2005.
- On overwriting memories each time we access them:
- (Currently locating sources.)
External links
- How to Read a Primary Source, Reading, Writing, and Researching for History: A Guide for College Students, Patrick Rael, 2004.
- How to Read a Secondary Source, Reading, Writing, and Researching for History: A Guide for College Students, Patrick Rael, 2004.