HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:
Guest Access | Sign In via User Name/Password

This Article Abstract Full Text (PDF) Free Submit a response Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Similar articles in PubMed Alert me to new issues of the journal Add to My Personal Article Archive Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via ISI Web of Science (9) Citing Articles via Google Scholar Google Scholar Articles by Payne, T. H. Search for Related Content PubMed PubMed Citation Articles by Payne, T. H.

Computer Decision Support Systems^*

^* From the VA Puget Sound Health Care System, University of Washington, Seattle, WA.

Correspondence to: Thomas H. Payne, MD, VA Puget Sound Health Care System, 1660 South Columbian Way, Mail Stop S-007-CIM, Seattle, WA 98108; e-mail: tpayne{at}u.washington.edu

	Abstract

TOP Abstract Introduction How Can Computers Aid... Characteristics of Successful... Examples of Successful Computer... The Veterans Affairs... Requirements for Implementing... Summary References

 
Computer decision support systems are computer applications designed to aid clinicians in making diagnostic and therapeutic decisions in patient care. They can simplify access to data needed to make decisions, provide reminders and prompts at the time of a patient encounter, assist in establishing a diagnosis and in entering appropriate orders, and alert clinicians when new patterns in patient data are recognized. Decision support systems that present patient-specific recommendations in a form that can save clinicians time have been shown to be highly effective, sustainable tools for changing clinician behavior. Designing and implementing such systems is challenging because of the computing infrastructure required, the need for patient data in a machine-processible form, and the changes to existing workflow that may result. Despite these difficulties, there is substantial evidence from trials in a wide range of clinical settings that computer decision support systems help clinicians do a better job caring for patients. As computer-based records and order-entry systems become more common, automated decision support systems will be used more broadly.

Key Words: decision support systems, clinical • drug therapy, computer-assisted • hospital information systems • medical informatics • medical records systems, computerized • practice guidelines • therapy, computer-assisted

	Introduction

TOP Abstract Introduction How Can Computers Aid... Characteristics of Successful... Examples of Successful Computer... The Veterans Affairs... Requirements for Implementing... Summary References

 
Over the last 20 years, computing systems have become increasingly common in health-care settings. Initially they were used for administrative and financial purposes—a role that continues today—but the use of computer systems to aid clinical decision making is growing. Computer decision support systems are computer applications designed to aid clinicians in making diagnostic and therapeutic decisions in patient care. There is substantial evidence from trials in a wide range of clinical settings that computer decision support systems help clinicians do a better job caring for patients.

Computers are designed to follow predefined instructions provided to them. In health-care decision support systems, these instructions range from simple statements of the form IF this has occurred, THEN do the following pertaining to a specific laboratory result, to highly complex clinical guidelines that include hundreds of interconnected rules. The early use of computers in clinical decision making—and one of the most successful uses today—involved use of simple rules governing the myriad of small decisions clinicians make every day. For example, IF the patient has the diagnosis of obstructive lung disease, THEN an influenza vaccine should be given annually. As one of the pioneers in computing decision support systems has stated, "Careful attention to mundane and tedious detail can be more important than brilliance in the day-to-day care of patients . . . the kind of work that humans neither relish nor reliably perform."¹

	How Can Computers Aid Decision Making?

TOP Abstract Introduction How Can Computers Aid... Characteristics of Successful... Examples of Successful Computer... The Veterans Affairs... Requirements for Implementing... Summary References

 
There are several ways that computers can help clinicians make better decisions.

Simplify Access to Data Needed To Make Decisions
Most practitioners use computing systems, either directly or indirectly, to gather laboratory results, radiology reports, or the narrative text of notes or consultations. This is because laboratories and transcription services have long used computing systems to report these data. Reporting of results and the creation of a customized report or graph can make patterns more apparent, leading to faster decision making. The value of flow sheets for following chronic conditions has long been recognized.² Graphic display of laboratory data can make patterns rapidly apparent; if combined with display of medications or other interventions, a better understanding of the course of disease may result.³ This is one of the simplest forms of decision support, and it is highly popular with clinicians because it does not require data entry and saves time.

Provide Reminders and Prompts
One of the most powerful tools in the field of clinical computing is the capability to generate reminders and prompts to clinicians. As several reviews have shown, reminders change clinician behavior to improve delivery of chronic, acute, and preventive medical care.^{4 5 6} Reminders can be brought to the attention of clinicians in a variety of ways: printed sheets can be affixed to a chart before a visit,⁷ windows can appear on a screen, or a list of reminders can appear on an electronic "cover sheet." Usually, reminders include a short message recommending some action be taken along with the rationale for the reminder appearing on that particular patient (Fig 1 ). Methods of creating, editing, and using rules to trigger reminders vary greatly among computer decision support systems.⁸

View larger version (81K): [in this window] [in a new window] [Download PPT slide]   Figure 1. Reminder from the cover sheet of the VA CPRS.

Assist in Diagnosis
An early goal of computing systems used in clinical care was to help the physician establish a diagnosis. Programs such as Internist 1, Quick Medical Reference (First Data Bank; San Bruno, CA), DXplain (Laboratory of Computer Science; Boston, MA), and Iliad (Applied Medical Informatics; Salt Lake City, UT) were designed to consider historical and physical examination findings, laboratory and test results, and create a list of diagnoses to explain those findings.^{12 13} These systems were based on large collection of rules and tables that related the presence or absence of findings with diseases and other conditions. Though they performed remarkably well, the requirement that large amounts of data be entered limited their broad use in clinical care. Freestanding applications are now less common than applications that are tightly integrated with patient data in a repository or computer-based medical record system.¹⁴ Moreover, much of the information needed to use these applications—for example the presence or absence of symptoms or physical examination findings—is not routinely captured in computing systems in a form that can be processed by decision support systems.

Review New Clinical Data; Alert When Important Patterns Are Recognized
Reminders and order checks are useful methods for drawing clinicians’ attention to important occurrences when the clinician is viewing a computer screen or paper chart, or is in the process of ordering. However, in some cases, there is a need to bring clinical events such as a new or changed laboratory result, hospital discharge, or combination of events to the attention of the clinician at the moment the event occurs. Event monitors are applications that can "eavesdrop" on newly available data or the occurrence of events (hospital admission, discharge, etc) by receiving electronic messages from computing systems when specified events occur.¹⁵ When an electronic message is received, a specified rule can then be run to determine if there is a need to notify the clinician or take other action. An example of the use of an event monitor is in the handling of culture and sensitivity results. An event monitor can notify the clinician when there is a mismatch between newly available sensitivity results and antimicrobials being given to the patient.

	Characteristics of Successful Computer Decision Support Systems

TOP Abstract Introduction How Can Computers Aid... Characteristics of Successful... Examples of Successful Computer... The Veterans Affairs... Requirements for Implementing... Summary References

 
There is now substantial literature describing the design, implementation, and evaluation of computer decision support systems. From this literature, and from our own experience, we can describe several characteristics of successful computer decision support systems.

They Give Patient-Specific Recommendations
When a computing system provides advice based on a guideline, it is most useful if the recommendation is based on that patient’s data. Of course, this requires that data needed to make the recommendation be available to the decision support system in machine-processible form. Collecting these data from their source (laboratory, pharmacy, and other systems) is preferable to requiring data entry by the clinician.¹⁶

Passive display of guideline documents in the literature, on the World Wide Web, or in other electronic media is not a reliable method for improving compliance or changing practitioner behavior.¹⁷ There are several reasons for this. First, there are myriad guidelines available on the World Wide Web, and finding credible guideline documents quickly can take substantial time.¹⁸ Second, no matter how convenient access to the documents becomes, simply viewing a document describing a guideline will be less effective than making it easy to follow that guideline.

They Save Time
Most clinicians note that they have less time available than in the past, because of increased patient volumes, greater demands for documentation,¹⁹ and the complexity of modern practice. An extremely effective method for changing clinician behavior is to make it as fast or faster to comply with a recommendation or guideline than not to comply. There are many strategies for helping clinicians save time in the process of complying with a guideline.

One approach is to save the time required for visit documentation. If applications can guide clinicians through a guideline and at the same time speed documentation of the visit, then there is an additional incentive to use the application, thereby increasing compliance with the guideline.²⁰ If the same application allows simple and fast ordering of services, there is yet another incentive to use the application.

Some guidelines can be implemented in part or in full by creating collections of orders that can be selected in particular clinical situations. For example, when patients are admitted to the hospital for treatment of community-acquired pneumonia, guidelines cover the ordering of cultures and other diagnostic tests, and empirical selection of antibiotics. Collections of orders—often referred to as order sets or order templates—can be created and offered to the clinician either in paper form or in an order-entry application. Since the orders are conveniently grouped to save time during the ordering process, this is a potentially useful method of implementing some types of guidelines.

They Are Incorporated Into Workflow of Clinic, Office, or Hospital
Health-care delivery is a complex effort with labor divided among many professions: physicians, nurses, pharmacists, other professionals, and support staff. Computing systems should be designed to fit into this workflow as smoothly as possible, because changing the workflow of large numbers of professionals is difficult. A successfully designed computer decision support system must either fit in well with this workflow, or those implementing it must be prepared to change the workflow.

	Examples of Successful Computer Decision Support Systems

TOP Abstract Introduction How Can Computers Aid... Characteristics of Successful... Examples of Successful Computer... The Veterans Affairs... Requirements for Implementing... Summary References

 
There are numerous examples of highly successful computer decision support systems in use today. Though these systems are rarely broadly exported beyond the organization in which they were developed, they serve as examples of what is possible with the technology of today, in real-world settings.

HIV Guidelines at Boston Beth Israel
Management of HIV infection is a complex, rapidly evolving field with a large number of guidelines available to practitioners. Safran and colleagues²¹ hypothesized that compliance with HIV care guidelines would be greater if the guidelines were incorporated into the clinical computing applications in use at Boston Beth Israel Hospital. They demonstrated that clinicians who received alerts and reminders containing patient-specific recommendations instituted appropriate treatment far more rapidly than clinicians who did not. One of the most dramatic effects was in the time between the availability of confirmed T-cell counts < 200 cells per mL³ and institution of prophylaxis against Pneumocystis carinii pneumonia. In the control group, the average elapsed time was 122 days, while in patients treated by physicians who received prompts to prescribe prophylaxis, the average elapsed time was 11 days. An important reason for this success was the provision of screens that both notified the clinician of the need for prophylaxis and greatly simplified the process of ordering it.

Antimicrobial Use in the ICU
In a trial conducted in the critical care unit, researchers at the LDS Hospital in Salt Lake City, Utah, studied outcomes for patients for whom antimicrobials were ordered using a computer decision support system.²² This application considers patient allergies, likely pathogens, local patterns of antimicrobial resistance, antimicrobials on the formulary, hepatic and renal function, the results of cultures, and other factors when recommending therapy. The authors also noted that manually gathering data needed to prescribe antimicrobials would take up to 25 min. Patients treated using this computer-assisted management program for antimicrobials received fewer doses of antimicrobials, had fewer days of excessive drug dosage, fewer prescriptions for drugs to which the patient was allergic, shorter length of hospital stay, and lower hospital costs, compared to patients treated without this program. There were several other improvements beyond these, leaving little question of the advantage of such an application over the traditional methods for ordering antimicrobials.

	The Veterans Affairs Computerized Patient Record System

TOP Abstract Introduction How Can Computers Aid... Characteristics of Successful... Examples of Successful Computer... The Veterans Affairs... Requirements for Implementing... Summary References

 
Much of the evidence that computer decision support systems are effective derives from studies performed in institutions that have had clinical computing systems in use for a decade or more. These studies have been a model for organizations that are considering implementing systems of their own. The Veterans Health Administration has recently embarked on the development and large-scale implementation of the Computerized Patient Record System (CPRS) in all Veterans Affairs (VA) medical centers, including VA Puget Sound in Washington State. The CPRS is a package developed by the VA to allow clinician order entry, note entry, and to provide results reporting and order checks.²³

CPRS includes numerous decision support features: on-screen reminders for a wide variety of acute, chronic, and preventive care topics; order checks for drug-drug, drug-food, drug-allergy interactions, and for duplicate laboratory testing; order sets; graphic display of laboratory results; and templates to guide and simplify document creation. Since all orders entered on hospital wards using CPRS are entered directly by practitioners in our hospital, there is great potential to influence compliance with organizational guidelines and recommendations for management of patients with specific clinical conditions. The following section describes our early efforts to take advantage of one of these decision support features: order sets.

The choice of diagnostic tests and antimicrobial selection can influence the effectiveness and costs of therapy. Our Pulmonary and Infectious Diseases sections have developed collections of orders for practitioners to consider when writing hospital admission orders for patients with community-acquired pneumonia. These orders are easily selectable from hospital admission order screens used whenever patients are hospitalized on the Medical Service. Additions or changes to these screens are immediately available on the > 2,000 workstations used by physicians, nurses, and other staff at VA Puget Sound.

The content of order screens for community-acquired pneumonia—and for hundreds of screens containing other orders—is completely within the control of the staff of our organization. This is both a great advantage and a challenge, since these orders must be regularly reviewed to remain current, and there are inevitably debates on what form the orders should take. Our solution is to document both the content and review process for these order screens on our internal Web site, using a format inspired by pioneering work at LDS Hospital. Each order collection has a primary author, a primary reviewing group, and is reviewed by other organizational groups such as nursing and pharmacy. The rationale for the orders and references supporting them are also included.

We are only 8 months into our use of the CPRS on our busiest wards, and we have not yet studied the effect of these decision support features on practitioner behavior or on clinical or financial outcomes. However, we have established the foundation on which our organization can implement computer-based decision support. The components of that foundation are described in the next section.

	Requirements for Implementing Computer Decision Support Systems

TOP Abstract Introduction How Can Computers Aid... Characteristics of Successful... Examples of Successful Computer... The Veterans Affairs... Requirements for Implementing... Summary References

 
Implementing computer decision support systems, particularly order-entry systems, is a difficult undertaking that requires an organizational will to change, and to be patient with the process of change. It requires substantial financial and human resources to introduce computing systems into hospitals and clinics. Even when there is organizational commitment to implement computing systems, it may take months or more for physicians and other staff to feel the change was worth it.²⁴

Next, there must be a computing infrastructure in place: databases containing patient data, workstations near or at the point of care, and reliable networks to connect them. Printed reports can be used for many purposes, and to reduce the need for workstations in examination rooms, but order-entry applications with immediate feedback depend on the direct use of mobile or desktop workstations by clinicians.

There must be guidelines or algorithms incorporated into the clinical computing system, and there must be patient data in processible form. The latter requirement is difficult to achieve quickly, and represents one of the greatest hurdles for the broader use of computer decision support systems. Much of the content of the patient record is in narrative text form, though there has been recent progress in unlocking this information using natural language processing techniques.²⁵

Clinical guidelines vary greatly in their level of precision. Some contain clear descriptions that can be readily interpreted and acted on by the physician, while others include more general statements of the approach to a particular problem. In order for computer decision support systems to be effective, there must be a trusted, tested, precise rule or guideline to be implemented in the automated system.^{26 27} There is no substitute for testing of decision support systems in real-world settings, with serial editing and improvement of the rule until it performs as expected.

A commonly voiced concern of physicians about computer systems in clinical care is whether using them will take more time, which may be the case, at least initially.^{28 29} There is also concern both among health-care providers and the public that health information remains confidential. If computer decision support systems use identified patient data, they must be designed to protect the confidentiality of those data. Combinations of policies and technical approaches can greatly reduce the risk that confidential information will be inappropriately disclosed.³⁰

Exchange of Rules Used by Computer Decision Support Systems
Some organizations have created large collections of rules that could potentially be exported to other settings where the computing infrastructure necessary to use them is in place. Exchanging rules would allow the organization to benefit from the iterative refinement of rules achieved in the site where they were developed, and allow organizations to concentrate their effort on developing rules in other areas.

There have been several efforts to allow exchange of decision support rules: (1) The Arden Syntax, a standard language for expressing rules used to generate alerts and reminders,³¹ has been used in some organizations to encode rules, and to exchange them with other organizations. (2) More recently, the GuideLine Interchange Format has been proposed to allow exchange clinical practice guidelines among institutions and computer-based applications.³² (3) There is a utility within the VA CPRS to allow exchange of the code required to trigger reminders between the > 100 sites using CPRS. Today, these tools for exchange of decision support rules are used by only a small number of organizations, but as the number of organizations utilizing computer decision support systems rises, these tools could increase sharing of automated clinical rules.

	Summary

TOP Abstract Introduction How Can Computers Aid... Characteristics of Successful... Examples of Successful Computer... The Veterans Affairs... Requirements for Implementing... Summary References

 
Computer decision support systems that present patient-specific recommendations in a form that can save clinicians time have been shown to be highly effective, sustainable tools for changing clinician behavior. Designing and implementing such systems is challenging because of the computing infrastructure required, the need for patient data in a machine-processible form, and the changes to existing workflow that may result. As computer-based records and order-entry systems become more common, automated decision support systems will be used more broadly.

	Footnotes

 
Abbreviations: CPRS = Computerized Patient Record System; VA = Veterans Affairs

	References

TOP Abstract Introduction How Can Computers Aid... Characteristics of Successful... Examples of Successful Computer... The Veterans Affairs... Requirements for Implementing... Summary References

 

1. McDonald, CJ, Tierney, WM (1988) Computer-stored medical records: their future role in medical practice. JAMA 259,3433-3440[Abstract]
2. Whiting-O’Keefe, QE, Simborg, DW, Epstein, WV, et al (1985) A computerized summary medical record system can provide more information than the standard medical record. JAMA 254,1185-1192[Abstract]
3. Powsner, SM, Tufte, ER (1994) Graphical summary of patient status. Lancet 344,386-389[CrossRef][ISI][Medline]
4. Hunt, DL, Haynes, RB, Hanna, SE, et al (1998) Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA 280,1339-1346[Abstract/Free Full Text]
5. Johnston, ME, Langton, KB, Haynes, RB, et al (1994) Effects of computer-based clinical decision support systems on clinician performance and patient outcome: a critical appraisal of research. Ann Intern Med 120,135-142[Abstract/Free Full Text]
6. Shea, S, DuMouchel, W, Bahamonde, L (1996) A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. J Am Med Inform Assoc 3,399-409[Abstract/Free Full Text]
7. McDonald, CJ, Hui, SL, Smith, DM, et al (1984) Reminders to physicians from an introspective computer medical record: a two-year randomized trial. Ann Intern Med 100,130-138
8. Reggia, JA, Tuhrim, S (1985) An overview of methods for computer-assisted medical decision making. Reggia, JA Tuhrim, S eds. Computer-assisted medical decision making ,3-45 Springer-Verlag New York, NY.
9. Overhage, JM, Tierney, WM, Zhou, XH, et al (1997) A randomized trial of "corollary orders" to prevent errors of omission. J Am Med Inform Assoc 4,364-375[Abstract/Free Full Text]
10. Tierney, WM, McDonald, CJ, Martin, DK, et al (1987) Computerized display of past test results: effect on outpatient testing. Ann Intern Med 107,569-574
11. Bates, DW, Leape, LL, Cullen, DJ, et al (1998) Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA 280,1311-1316[Abstract/Free Full Text]
12. Berner, ES, Webster, GD, Shugerman, AA, et al (1994) Performance of four computer-based diagnostic systems. N Engl J Med 330,1792-1796[Abstract/Free Full Text]
13. Berner, ES, Jackson, JR, Algina, J (1996) Relationships among performance scores of four diagnostic decision support systems. J Am Med Inform Assoc 3,208-215[Abstract/Free Full Text]
14. Miller, RA, Masarie, FE, Jr (1990) The demise of the "Greek Oracle" model for medical diagnostic systems. Methods Inf Med 291,1-2
15. Hripcsak, G, Cimino, JJ, Johnson, SB, et al (1991) The Columbia-Presbyterian Medical Center decision-support system as a model for implementing the Arden Syntax. Proc Annu Symp Comput Appl Med Care 1,248-252
16. Payne, TH, Sengupta, S, Sittig, DF (1999) Electronic exchange of patient information in health care organizations: the infrastructure for electronic health records. Murphy, G Hanken, M Waters, K eds. Electronic health records: changing the vision ,129-142 WB Saunders Philadelphia, PA.
17. US Congress, Office of Technology Assessment. Identifying health technologies that work: searching for evidence. Washington, DC: US Government Printing Office; September 1997; OTA-H-608
18. Owens, DK (1998) Use of medical informatics to implement and develop clinical practice guidelines. West J Med 168,166-175[ISI][Medline]
19. Iezzoni, LI (1999) The demand for documentation for Medicare payment. N Engl J Med 341,365-367[Free Full Text]
20. Schriger, DL, Baraff, LJ, Rogers, WH, et al (1997) Implementation of clinical guidelines using a computer charting system: effect on the initial care of health care workers exposed to body fluids. JAMA 278,1585-1590[Abstract]
21. Safran, C, Rind, DM, Davis, RB, et al (1995) Guidelines for management of HIV infection with computer-based patient’s record. Lancet 346,341-346[CrossRef][ISI][Medline]
22. Evans, RS, Pestotnik, SL, Classen, DC, et al (1998) A computer-assisted management program for antibiotics and other antiinfective agents. N Engl J Med 338,232-238[Abstract/Free Full Text]
23. Payne TH. The transition to automated practitioner order entry in a teaching hospital: the VA Puget Sound experience. Proc AMIA Annu Fall Symp 1999; 589–593
24. Chin, HL, McClure, P (1995) Evaluating a comprehensive outpatient clinical information system: a case study and model for system evaluation. Proc Annu Symp Comput Appl Med Care 1,717-721
25. Hripcsak, G, Kuperman, GJ, Friedman, C, et al (1999) A reliability study for evaluating information extraction from radiology reports. J Am Med Inform Assoc 6,143-150[Abstract/Free Full Text]
26. East, TD, Bohm, SH, Wallace, CJ, et al (1992) A successful computerized protocol for clinical management of pressure control inverse ratio ventilation in ARDS patients. Chest 101,697-710[Abstract/Free Full Text]
27. McDonald, CJ, Overhage, JM (1994) Guidelines you can follow and trust: an ideal and an example. JAMA 271,872-873[CrossRef][ISI][Medline]
28. Bates, DW, Boyle, DL, Teich, JM (1994) Impact of computerized physician order entry on physician time. Proc Annu Symp Comput Appl Med Care 1,996
29. Sittig, DF, Stead, WW (1994) Computer-based physician order entry: the state of the art. J Am Med Inform Assoc 1,108-123[Abstract/Free Full Text]
30. Committee on Maintaining Privacy and Security in Health Care. Applications of the national information infrastructure. For the record. Washington, DC: National Academy Press, 1997
31. Hripcsak, G, Cimino, JJ, Johnson, SB, et al (1991) The Columbia-Presbyterian Medical Center decision-support system as a model for implementing the Arden Syntax. Proc Annu Symp Comput Appl Med Care 1,248-252
32. Ohno-Machado, L, Gennari, JH, Murphy, SN, et al (1998) The guideline interchange format: a model for representing guidelines. J Am Med Inform Assoc 5,357-372[Abstract/Free Full Text]

This article has been cited by other articles:

				A. X. Garg, N. K. J. Adhikari, H. McDonald, M. P. Rosas-Arellano, P. J. Devereaux, J. Beyene, J. Sam, and R. B. Haynes Effects of Computerized Clinical Decision Support Systems on Practitioner Performance and Patient Outcomes: A Systematic Review JAMA, March 9, 2005; 293(10): 1223 - 1238. [Abstract] [Full Text] [PDF]

				E. Rood, R. J. Bosman, J. I. van der Spoel, P. Taylor, and D. F. Zandstra Use of a Computerized Guideline for Glucose Regulation in the Intensive Care Unit Improved Both Guideline Adherence and Glucose Regulation J. Am. Med. Inform. Assoc., March 1, 2005; 12(2): 172 - 180. [Abstract] [Full Text] [PDF]

This Article Abstract Full Text (PDF) Free Submit a response Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Similar articles in PubMed Alert me to new issues of the journal Add to My Personal Article Archive Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via ISI Web of Science (9) Citing Articles via Google Scholar Google Scholar Articles by Payne, T. H. Search for Related Content PubMed PubMed Citation Articles by Payne, T. H.