For Engineering and Science
Truth or Consequences
Parent Collection
Contributors
Editor(s)
Year
1999
Discipline(s)
Topics
Description
This case discusses issues such as including proper data management and the responsibilities of authors, collaborating researchers and faculty research advisers as well as trust and honesty.
Body
Part 1
Peter Hogan and Sally Wheeler are both graduate students in Dr. Larson's laboratory. Although both are in their fourth year of graduate study, neither has published a manuscript, and both are beginning to worry that if they do not publish soon, they will be unable to get first-rate postdoctoral positions.
Finally, Peter's project begins to look promising. Through the use of genetic engineering, Peter has succeeded in generating a few knockout mice. These mice no longer have any working copies of the gene SLAM; the gene SLAM is completely "knocked out." Now Peter can move on to analyses of cellular function and development in the knockout mice to try to determine what role SLAM usually plays in a normal mouse.
Peter completes a preliminary examination of one knockout mouse. He is excited to find that several important cell types appear to have abnormal function. Dr. Larson is also excited by the data. He tells Peter that he has heard of several other laboratories that are competing to produce and analyze the same type of SLAM knockout mice. "Peter," Dr. Larson says, "we must confirm your initial findings as quickly as possible. If these results are correct, and we get our data written up first, we could get into a big journal like Nature."
Although only a few mice are available to study at this point, Peter and Dr. Larson agree that they must push ahead and work quickly but carefully. There will only be enough mice for two sets of experiments. In order to study as many cell types as possible, Dr. Larson decides to move Sally onto the project to assist Peter. Her research was still not progressing, and Dr. Larson believed that even a second author status on a big paper would help her career. Peter does not think much of Sally's work habits, but he agrees with Dr. Larson that it would benefit them both if she investigated one aspect of cellular function that Peter had not yet examined. Dr. Larson tells Sally that if her data are informative, she will be included as the second author on their manuscript.
Sally's project involves harvesting blood samples from the mice and carrying samples to a nearby building that houses the equipment needed to perform her cell function tests. During this time, Peter sacrifices the mice and conducts experiments on the tissues of interest. Because the mice have been sacrificed, there is no way for Sally to collect more cells from the mice.
Sally completes the first set of experiments and is thrilled by what she sees. She creates a graph of her data and shows it to Peter and Dr. Larson. It appears that SLAM has an unsuspected critical role in blood cell function, supporting their hypothesis that SLAM is required for the normal function of many cell types.
On the day that the experiments are being repeated, Sally calls Peter from the other building. "Peter," she says frantically, "are you sure that you didn't mix up the mice before I collected the blood? "Yes, I'm sure," Peter cries. "But why?" "I'm not seeing the same trend as last time," Sally answered. "I think you must have mixed up the mice!" Peter thinks quickly about what to do. "Sally, just bring back any remaining blood this time, and I can do additional genetic tests to determine which sample is which."
However, when Sally returns to the lab several hours later, she does not have the leftover blood. She tells Peter that she had figured out her mistake and knew which sample was which, so she had thrown out any cells that remained. There is no way for Peter to verify her results without obtaining more mice, which they currently do not have. Sally tries to calm Peter and shows him a graph she had made, which clearly shows the same cell function trend as her first experiment.
Dr. Larson is ecstatic about the new data and tells Peter to begin writing up the manuscript. Although Peter does not want to accuse Sally of lying, he is no longer sure of the validity of her data. Later that day, he flips through Sally's notebook, trying to determine how she had done the experiment, but all he can find is the finished graph. In contrast, the entry for the first experiment has procedural notes and computer printouts from the equipment Sally had used to analyze her samples. Is it possible that Sally has purposefully altered her data to reflect the trend she wanted to see? If she had done nothing wrong, why had she thrown out the remaining cells, and why is the computer printout missing from her notebook? Peter is unsure of what to do.
Discussion Questions
1. Should Peter ignore his misgivings and write up the manuscript incorporating Sally's graph? Why? What are his other options?
2. What are Peter's responsibilities as the first author of the manuscript?
3. What are Sally's responsibilities as a contributing author?
4. How, if at all, did Dr. Larson's actions contribute to this problem?
Part 2
Now assume that in order to avoid creating conflict in the lab, Peter wrote up the manuscript using Sally's graph. The manuscript was published in Nature, and created quite a stir in the scientific community. However, in the next six months, Peter was dismayed to read several publications by competing labs that contradicted Sally's data. It had even been suggested at a national conference that Dr. Larson's lab had performed their experiments poorly or had misrepresented their data. Peter now felt certain that Sally had falsified her data.
Discussion Questions
5. Have Peter's options changed significantly from those open to him in Part 1? Why?
6. Now that the paper has been published, are the decision-making criteria different? What are some of these criteria?
Notes
Brian Schrag, ed., Research Ethics: Cases and Commentaries, Volume 3, Bloomington, Indiana: Association for Practical and Professional Ethics, 1999.
Citation
. . Truth or Consequences. Online Ethics Center. DOI:. https://onlineethics.org/cases/graduate-research-ethics-cases-and-commentaries-volume-3-1999/truth-or-consequences.
As one can quickly see from scanning this case, the central issues are trust and honesty. However, the case also raises several more peripheral yet important issues, including proper data management and the responsibilities of authors, collaborating researchers and faculty research advisers.
Trust is essential for science, particularly in collaborative research settings. In fact, in 1995 an entire issue of Science and Engineering Ethics was devoted to consideration of "Trustworthy Research." (Vol.1, No. 4, 1995) Trust, in turn, depends on honesty, the value listed first among the core values of science. (National Academy of Sciences et al., 1995, p. 21) If someone is seen as dishonest, we do not trust him and avoid him as a collaborator. In Part 1 of this case, we are asked to consider what can happen within a research group when trust is weakened; in Part 2 we look outward to consider the possible effects within the larger scientific community.
There is no glaring instance of misconduct in this case. At most, Peter can point to a lack of primary data in Sally's notebook for the second set of mice and report that she didn't save any of the cells for reanalysis. The failure to preserve relevant data has been termed a questionable research practice, something that may be detrimental to the research process, but is not misconduct. (National Academy of Sciences et al., 1992, Vol. 1, p. 28) However, when he considers the sum of Sally's actions, Peter comes to wonder if she might have falsified or even fabricated her results from the second group of mice so that they would be consistent with those of the first. If so, her action would be misconduct. Peter must decide whether and how to act on his misgivings. Exploring his options and identifying the factors he must weigh in making his decisions are the most obvious foci for discussion of this case.
The case also could be used to trigger a discussion of best practices for the conduct of collaborative laboratory research. The discussion group could identify what types of standard operating procedures for the laboratory could have been put into place before this incident so that the problem Peter faces would never have arisen. What if the lab agreed on norms for the number of subjects tested and/or replications to be done before publication of the results? What if there were a clearly articulated expectation that primary data will always be kept and preserved in a bound notebook? What if it were a standard part of preparing a manuscript to have all the authors sit down together to review the primary data, not just the graphs and tables generated from the data? That is exactly what some laboratories have done, but often only after a crisis. After two independent but concurrent incidents of misconduct in his laboratory, Lee Hood is reported to have "formalized the review process, so that each paper is now reviewed by three people inside the lab." In addition, "[t]here is considerably more emphasis on dealing with raw data, not merely a synopsis of the findings. And Hood now also requires everyone to keep a bound lab notebook." (Roberts, 1991, 1347)
Discussion Questions
Question 1
This question challenges us to consider what options are open to Peter, and how he might decide among them. Some possible options are 1) going ahead with the writing as if he had no misgivings,2) confronting Sally, or 3) telling Larson that he will not prepare the manuscript until the data can be verified. Surely discussion will generate other possibilities, such as Peter loudly and without warning declaring at a laboratory group meeting that he's certain Sally has fudged her data, that he's never going to work with her again, and that others had better watch out for her. Such a course of action is clearly inappropriate because it fails to show respect for the people involved, and it could have some very serious negative consequences for a number of people, including Peter. However, brainstorming that includes such inappropriate options can help us exercise our imaginations and improve our creativity in devising innovative appropriate solutions.
Next, one must evaluate the many possible courses of action and select among them. This process involves looking at the possibilities from a number of perspectives, considering ethical principles and obligations, predicting possible consequences and making reasoned judgments that take account of conflicting interests, principles and obligations. During this part of the discussion, it is important for participants to justify their positions, rather than falling back on "I think" or "I feel" statements. Discussants must be able to explain their reasoning so that the group can work toward a consensus on which possible courses of action are ethically acceptable, which are not, and why. Then the relative merits of the acceptable options can be evaluated to determine the best course of action. In the end, participants may differ on the best option because they will give different weights to conflicting obligations or principles.
In this scenario, Peter would need to consider the interests of such people as Sally, Larson, the rest of the lab members, and other scientists working in this field, in addition to his own. He needs to examine his obligations to these and other people, as well as the ethical principles on which these obligations are based. For instance, he has a basic obligation as a member of the human community to treat other people respectfully, as he would like to be treated. But he also has a responsibility to the scientific community in particular to honestly report the results of his research because of his respect for them, their time and their ability to draw their own conclusions from the data. These and other obligations may appear to be in conflict. Then Peter needs to examine the possible courses of action open to him to determine the possible consequences of each alternative, and evaluate how well each option fulfills his obligations and takes into account others' reasonable interests.
Discussion Questions
Questions 2 and 3
These questions focus the discussion on the responsibilities of the authors of scientific papers. For instance, how sure of your results do you need to be before you publish? In discussions of research ethics, we often focus on appropriate authorship and investigate criteria for determining who has the right to be listed as an author. The responsibilities of authorship, the flip side of this coin, often are not considered as thoroughly, probably because of the large variation in expectations.
Generally, an author is expected to take responsibility for the validity of the data presented in a paper, but there is some question as to whether one is responsible for all of the data presented, or only for the data one actually collected. In "Responsible Science," the NAS committee seems to argue for collective responsibility, saying that "the privilege of authorship should be based on a significant contribution . . . as well as a willingness to take responsibility for the defense of the study should the need arise." (National Academy of Sciences et al., 1992, Vol. 1, p.140) The American Society for Microbiology also comes down on the side of collective responsibility, stating that when publishing in its journals, "All authors of a manuscript must have agreed to its submission and are responsible for its content . . . ASM considers all authors responsible for the entire paper." (Journal of Bacteriology, 1998, Vol. , p. I-ii) In contrast, the Journal of the American Medical Association indicates that "[a]uthors may include explanation of each author's contribution and add a publishable footnote explaining specific contributions," presumably to indicate who is taking responsibility for what parts of the study (JAMA, Jan. 7, 1998, Vol. 279, p. 67). As the International Committee of Medical Journal Editors has asserted, "[a]ny part of an article critical to its main conclusions must be the responsibility of at least one author" (JAMA, 1997, p. 928), but, one infers, not necessarily all. Nature, where the characters in this scenario plan to publish, has not published its expectations concerning the criteria for and responsibilities of authors in its "Notes to Contributors" (Nature, 1997, p. 702), and we do not know the conventions in the characters' field, professional organization(s) or laboratory. Similarly, the conventions for the meaning of and responsibilities of first vs. last vs. internal authors vary considerably from discipline to discipline, and even from laboratory to laboratory.
Thus, even though he is the first author, Peter may be able to indicate via a footnote in the manuscript that he accepts responsibility only for the data he collected and not for the data from the cell function assays that Sally ran. Is that course of action ethically tenable? One's answer will vary depending on one's view of the responsibilities of authorship.
This case may trigger a discussion exploring the range of variation in the criteria for and responsibilities of authors that would inform students of the very real variation and point out the benefits of discovering the local conventions before they become authors.
Discussion Questions
Question 4
Now we pause to look at the actions of Larson, the faculty member who directs the laboratory in which Peter and Sally work, and who is the principal investigator on the grants that support the lab. In these roles, he is the person ultimately held responsible for the validity of the work done within the laboratory, and therefore is responsible for quality control. However, he is more than just the lab director: He is also the faculty adviser for Peter and Sally, two fourth-year graduate students working toward the Ph.D. As such, he is responsible for training them and helping them to develop the skills they will need to become independent investigators. Two of the ways in which he should do this are to model best practices in laboratory management, and to be explicit about how and why things are done.
One can argue that Larson acted properly when he told Sally that she would appear as the second author on Peter's manuscript if her data were informative, because he was providing explicit information as to what Sally might expect from the work she is being asked to do for Peter's project. He is also being consistent with the expectation that one is an author only if one has significantly contributed to the information presented in a paper. However, one could also argue that he is putting Sally in a difficult position, tempting her to fudge results so that her data will be seen as "informative."
That is particularly true when one notices indications that best practices are not the rule in this lab, so that tainted data may not be caught. This lab seems to have no standard procedures for recording and preserving primary data, or for storing samples for possible confirmatory analyses. Similarly, there are no routine mechanisms by which other members of the lab discuss primary data or review manuscripts. For instance, note that Larson never asks to see the raw data from Sally's analyses; he only looks at her graphical interpretations of the data. Peter didn't feel he could ask directly about the data, but instead went to look at Sally's notebook on the sly. He now seems to feel that publicly asking about the data will depart from routine lab practice sufficiently to stigmatize Sally. If a set of laboratory procedures had been in place and were routinely followed, Peter would not be in the quandary in which he now finds himself, and Larson would be publishing papers of higher quality.
Of course, this discussion does not address the very real problem of survival in the competitive atmosphere of contemporary scientific research. Many people use the time pressure as a justification for sloppy record keeping, lax laboratory oversight and over-interpretation of marginal data. However, consider all the time that the Hood lab spent sorting through the mess left after misconduct was discovered in their lab, and how much time and energy Peter is spending worrying about Sally's data rather than writing the manuscript and doing further experiments. Best practices include not falling prey to short-term expediency.
Discussion Questions
Questions 5 and 6
Now that the paper has been published and presumably discussed at scientific meetings, any actions Peter might take will occur in a far more public context. The basic ethical considerations are the same as they were when he wrote the paper, but now some of the possible consequences are different, and an additional course of action is now possible: retracting the paper.
If this were the only paper on the function of this gene and if understanding the gene had become important for human health between Part 1 and Part 2, then one might argue that Peter's obligation to investigate Sally's analyses had increased. However, other groups have already cast doubt on the Larson lab results so that Peter's failure to act will not endanger human lives or health. This is an example of the self-correcting nature of science to which many have referred. However, it is not without cost.
Note that it is possible that Sally really did get the sample labels correct, and the first two sets of analyses were a fluke. Alternatively, the assay conditions, mice or knockout alleles studied by the Larson lab may differ from those used by other labs in some way that affects the cell function analyses. Discrepancies between labs do not always indicate fraud, and Peter needs to be careful. Until the situation is clarified, however, the Larson lab will be perceived as either sloppy or dishonest.
References
Author: Karen Muskavitch, Indiana University.
The main goal of this case is to stimulate discussion of activities that fall into the category of questionable research practices. The National Academy of Sciences states:
While questionable research practices do not endanger the research process as critically as outright scientific misconduct, they do erode the integrity of the scientific institution as a whole.
Part 1 of this case attempts to present a scenario that is difficult to interpret definitively as a questionable research practice. Rather than a blatant statement of scientific misconduct, the reader is presented with a suspicion of inappropriate behavior. The intent is to mimic potential real-life situations where, quite frequently, there is no initial concrete evidence to support the decisions that must be made by the parties involved. Additionally, this case attempts to establish an environment where there is intense pressure on graduate students to produce publishable results quickly. This type of pressure is often encountered in labs conducting biomedical research, and it arises not only from the principal investigator, but from the graduate students themselves.
In this case, several factors contribute to the stressful environment in Dr. Larson's lab. For example, it is stated that neither Peter nor Sally had managed to publish a paper, which caused them both to worry about obtaining postdoctoral positions. It is also stated that other labs were attempting to develop the same knockout mouse. Dr. Larson's assertion that Peter and Sally have the chance to publish in Nature only adds to the pressure. In such an environment, even normally careful researchers can be tempted to cut corners, and thus engage in inappropriate scientific conduct.
Questions 1-3
These questions focus on the decisions Peter must make. Although he has no solid evidence that Sally has done anything inappropriate, his suspicions are aroused by their phone conversation in which Sally states that her data deviate from the previous trend observed, the fact that she disposed of remaining cells so that their identity could not be determined in an unbiased manner, and the absence of sufficient documentation in her lab notebook. There is no evidence that Sally has falsified data, which would constitute scientific misconduct. However, Sally's work behavior does fall into the category of questionable research practice.
Peter should first attempt to initiate better communication with his potential co-author by asking her to review her data with him, not accusing her of wrongdoing. If this conversation does not alleviate his suspicions, he should approach Dr. Larson with his concerns. As first author of the manuscript, Peter is ultimately responsible for its entire content. It is imperative that he feel confident in the data. The scientific process relies upon the publication of unbiased data generated via sound experimental designs.
Question 4
As a contributing author, Sally has a responsibility to maintain her lab notebook in such a way that her experimental procedures and raw data are easily located and identified. She is responsible for retaining any raw data or samples until the lab is reasonably confident that they are no longer needed. She also has a responsibility to honestly communicate any procedural problems to her co-authors. In situations where multiple researchers contribute to a final manuscript, each must be able to assume the honesty of the others and the unbiased nature of their results. There are many situations in which it is almost impossible to identify data that have been obtained in error or altered on purpose. In Sally's defense, she could well have the raw data in another notebook, and she may have thrown out the remaining cells by mistake, but her behavior raises suspicions about her scientific conduct.
Question 5
Dr. Larson's actions contributed to the problem in several ways. First, although it may be a reality that other labs are competing to produce the same results, he should attempt to set an example as a mentor in which strict adherence to careful lab practices is of utmost importance. His statement that Peter and Sally may be able to publish in Nature if they beat the competition went a long way toward establishing a stressful working environment, where inappropriate conduct is more likely to occur. Secondly, he tells Sally that she will be included on Peter's paper only if her results are informative. That may well encourage Sally to falsify data to produce the desired results. A better approach would have been to tell Sally that her efforts would be rewarded with a second author status, even if the results were not what was predicted. As Sally's research adviser, Dr. Larson should be stressing that honesty in science is required and expected of his students. After all, "Graduate school is the place to learn that one does not publish research results and conclusions until one is certain of their accuracy." (Sigma Xi, 1994, 6)
Thus, even Dr. Larson's behavior could be classified as a questionable research practice in that his supervision of his students was inadequate. He appeared more interested in the results than in the methods used to obtain them.
Part 2 introduces more evidence that Sally had actually engaged in scientific misconduct. Although Peter does not find concrete evidence that her graphed data was falsified, circumstantial evidence is gained from the results of the competing labs. At this point, after his paper has already been published, the best course of action would be first to discuss his concerns with Dr. Larson (whose reputation is also at stake). After that, it may be possible for Peter to repeat key experiments done by Sally. If that indicates that the initial published results were in error, the best course of action would be for Dr. Larson and Peter to notify Sally and then submit a retraction or correction to the journal.
References