BMJ Intended for Health Professionals
Home Help Search/Archive Feedback Table of Contents

Email this article to a friend
Respond to this article
PubMed citation
Related articles in PubMed
Download to Citation Manager
This article has been cited by other articles
Search Medline for articles by:
Smith, R.
Alert me when:
New articles cite this article
BMJ 1996;313:1062-1068 (26 October)

Information in practice

This is the first article in a new section on managing clinical infor mation that will appear regularly in the journal. This week, Richard Smith considers the information needs of doctors. He reviews existing research and draws conclusions about what information doctors need, what they think they need, how they try to find it, and how they determine its value

The aims of this section are:

* To help doctors understand that better management of clinical information will improve their treatment of patients and the management of their practices
* To encourage rigorous evaluation of information management systems, particularly with respect to patient care
* To empower doctors to shape the development of information management projects so that clinical needs are put before financial and administrative needs
* To generate enthusiasm among doctors by demystifying clinical infor mation management
* To help doctors understand the information demands that will be made of them
* To consider how information management can enhance doctors' relationships with patients and the public


What clinical information do doctors need?

Richard Smith, editor 100336.3120@ compuserve.com a

a BMJ, London WC1H 9JR


Summary points

  • Doctors use some two million pieces of information to manage patients, but little research has been done on the information needs that arise while treating patients

  • Textbooks, journals, and other existing information tools are not adequate for answering the questions that arise: textbooks are out of date, and "the signal to noise" ratio of journals is too low for them to be useful in daily practice

  • Computer systems that have been developed to help doctors are not widely used--perhaps because they have not been developed to meet doctors' information needs

  • When doctors see patients they usually generate at least one question; more questions arise than the doctors seem to recognise

  • Most of the questions concern treatment

  • Many of the questions are highly complex, simultaneously asking about individual patients and particular areas of medical knowledge

  • Often doctors are asking not simply for information but for support, guidance, affirmation, and feedback

  • Many of the questions go unanswered, but most could be answered; it is, however, time consuming and expensive to answer them

  • Doctors are most likely to seek answers to these questions from other doctors

  • The best information sources provide relevant, valid material that can be accessed quickly and with minimal effort

  • New information tools are needed: they are likely to be electronic, portable, fast, easy to use, connected to both a large valid database of medical knowledge and the patient record, and a servant of patients as well as doctors

The central job of doctors is to meet the needs of patients by drawing on the knowledge accumulated by medicine over 5000 years. Medicine, in modern jargon, is a knowledge based business, and experienced doctors use about two million pieces of information to manage their patients.1 2 Clinical information can be defined as "the commodity used to help make patient care decisions."3 About a third of doctors' time is spent recording and synthesising information,4 and a third of the costs of a hospital are spent on personal and professional communication.4 Yet most of the information doctors use when seeing patients they keep in their heads in what has been called "a constantly expanding and reinterpreted database."5

Unfortunately, some of the information in doctors' heads is out of date and wrong, new information may not have penetrated, and the information may not be there to deal with patients with uncommon problems. These deficiencies have become more serious as the rate of change in medical knowledge has accelerated: the doubling time of the biomedical knowledge base is currently about 19 years,2 meaning that medical knowledge will increase fourfold during a professional lifetime. Inevitably, doctors cannot practise high quality medicine without constantly updating the information within their heads and finding information to help them with particular patients. This realisation has led to the development of medical informatics, which can be defined "as the development, use, and evaluation of information technology in health care."4

Those interested in medical informatics have tried to develop systems that will help doctors in their daily clinical practice by providing them with information. Very few of these systems have, however, been adopted, and most doctors continue to practise without them. One reason why these systems have failed to penetrate routine practice may be that they have been designed without any close study of the information needs of doctors. Medical informatics has been dominated by concern with the technology and has developed solutions that have to search for problems. Now the time has come to understand the needs that the technology must meet, but there have been few studies of the information needs of doctors.

This paper examines studies of the needs and wants of doctors for medical knowledge; I pay less attention to the other information needs and wants of doctors. Wants and needs for information are of course different, but a good information system should provide for both. Most studies are of wants rather than needs because they are easier to identify, but some have touched on needs.

The primary focus of this review is on how to connect the rapidly expanding knowledge base of medicine with the doctor treating an individual patient. The review is aimed at ordinary doctors, not at informatics experts, but attempts to review comprehensively and critically what we know about doctors' information needs. A secondary objective is to identify where further research is required.

Categorising information needs

One of the problems with the few studies that have looked at the information needs of doctors is that they have not defined or categorised the needs.6 The studies look at different needs, giving one explanation of why they reach such different results. Gorman has proposed a classification of doctors' information needs, using work that went before and his own research among primary care doctors.6 I have extended the classification a little (see table 1). Those who want to meet the information needs of doctors should consider all these categories, but the emphasis of this review is on how doctors connect their daily practice to the rapidly changing knowledge base of medicine.


Table 1--Categories of information needed by doctors
-----------------------------------------------------------------------------------------------------------
Type of information                                   Source                   Comments
-----------------------------------------------------------------------------------------------------------
On particular patients                                Patient                  Much of the art of
                                                      Patient's family           medicine lies in
                                                      Referring doctor           gathering this
                                                      Rest of health team        information
                                                      Patient record
                                                      Laboratory data
Data on health and sickness within local population   Public health            Often not available on a
                                                        departments              sufficiently local scale
                                                                               Time sensitive
Medical knowledge                                     Textbooks                Problem is to match the
                                                      Journals                   knowledge to the
                                                      Electronic databases       individual patient
                                                      Many sources
Local information on doctors available for            Local sources            Rapidly changing
  referral, etc
Information on local social influences and            Local sources            Often not made explicit
  expectations
Information on scientific, political, legal, social,  Diverse sources--local,  Information is diffuse,
  management, and ethical changes that will affect      national, and            often comes from
  both how medicine is practised in a society and       international            non-medical
  how doctors will interact with individual patients                             disciplines, and is often
                                                                                 jargon ridden

Methods

This is not a systematic review, but I have gathered papers on the information needs of doctors by searching Medline, using a database of 406 references on the information of doctors compiled by Margaret Thompson from Allegheny University of the Health Sciences Library, asking for references from people I know to be interested in the subject, and following up the references from papers I have found. A particularly useful source of information is the December 1995 issue of Journal of the American Society for Information Science, which is devoted to medical informatics.7 It includes a review by Paul Gorman, an assistant professor of medicine and medical informatics from Oregon, on the information needs of physicians.6

I identified 13 studies that collected original data on the information needs and wants of doctors. Table 2 summarises the studies in chronological order.8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 Many of the studies are of only moderate quality, and all but one is American. The studies use different methods, and most are on small populations of doctors. It would not be sensible to try to combine the studies' results, but I have used all of them to try to identify what we do and do not know. I have summarised in the text studies that illustrate how the study of doctors' information needs has developed.


Table 2--Summary of studies that have investigated the information needs of doctors
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
                                                                                                  Question rate
                                                                                                  per patient   Percentage    Type of information
Study                       Method                   Subjects                Setting              encounter     answered      needed                   Source of answers
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Strasser 19788         Questionnaire            258 Practising          Upstate New York     NA            NA            New developments in      Papers in journals 1st
                                                       doctors                                                                  specialty 1st          Colleagues 2nd
                                                                                                                              Drug information 2nd     Books 3rd
                                                                                                                              Cancer 3rd
Stinson et al 19809    Administered             402 Health              Alabama              NA            NA            NA                       Medical literature
                              questionnaire            professionals                                                                                     regularly or often
                                                       (309 physicians)                                                                                  93%
                                                                                                                                                       Colleagues regularly
                                                                                                                                                         or often 77%
Northup et al 198310   Critical incident        293 Medical students    New Mexico           NA            NA            Disease related 49%      Book 36%
                              technique                and doctors                                                            Drug related 23%         Colleagues 33%
                                                                                                                              Procedure related
                                                                                                                                19%
Covell et al 198511    After visit interview    47 Primary care         Office               0.66          NA            Treatment 31%            Another doctor 29%
                                                       doctors                                                                Diagnosis 25%            Other health
                                                                                                                              Drug related 14%           professionals 24%
Timpka et al 198912    Questionnaire,           84 General              Sweden               NA            51%           General medicine         Colleagues 38%
                              including critical       practitioners                                                            48%                    Textbooks 37%
                              incident question                                                                               Dermatology 11%          Library 12%
Williamson et al            Telephone survey         492 Primary care        United States        NA            NA            Drug related 38%         NA
 198913                                           doctors, 90 opinion                                                    Laboratory tests 25%
                                                       leaders
Woolf et al 198914     Administered             42 Professors,          Academic centre,     NA            NA            Treatment 77%            Textbooks 64%
                              questionnaire            25 house staff          paediatrics and                                Differential diagnosis   Colleagues 60%
                                                                               internal medicine                                75%
                                                                                                                              Drug related 64%
Timpka et al 199015    Video recordings of      12 General              Four Swedish         1.85          NA            Diagnosis 55%            NA
                              consultations            practitioners           health centres                                 Treatment 33%
                                                                                                                              Orthopaedics 29%
                                                                                                                              Internal medicine 26%
Osheroff et al 199116  Anthropological          24 Doctors and          University based     5.77          NA            Specific patient 61%     Patient record 42%
                              observation              medical students        internal medicine                              Treatment 25%            Hospital information
                                                                                                                                                       system 39%
Ely et al 199218       Observation              34 Family physicians    Accessible to        0.07          All, implied  Treatment 73%            Colleagues 29%
                                                                               Columbia,                                      Drug related 49%         Physicians' desk
                                                                               Missouri                                       Diagnosis 27%              reference 27%
Gorman et al 199419    Interview after patient  49 Doctors              Office               0.57          80%           NA                       Colleagues 46%
                              visit                                                                                                                    Textbooks 41%
Bowden et al 199421    Questionnaire            442 Doctors             Five Texas           NA            NA            Treatment 34%            Books and journals
                                                                               counties                                       Diagnosis 28%              85%
                                                                                                                              Drug related 18%         Colleagues 75%
Guise et al 199422     Record review            7 Health professionals  AIDS outpatient      2.22          NA            Treatment 24%            Electronic online 87%
                                                                               clinic                                           Drug related 18%         Paper sources 13%
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
NA = Not available.

Survey of the information problems of American primary care physicians

Concerns about the failures of doctors to keep up with medical knowledge go back a long way. In 1983 the Massachusetts Medical Society, the publishers of the New England Journal of Medicine, became concerned with how doctors identified their needs for scientific information, how they found the information, and how they decided its value. The society commissioned research to try to answer those questions. Williamson and others surveyed a stratified random sample of 625 office based primary care physicians and 100 physician opinion leaders in the United States to identify self perceived problems in managing scientific information.13 The researchers used a telephone survey and reached 79% of the practising doctors and 90% of the opinion leaders.

Nearly two thirds of the respondents from both samples said that the current volume of scientific information was unmanageable, and more than a third said that "most physicians find the effort to get information from the literature to be a major problem." The researchers asked about "markers" of knowledge selected by a consensus of advisory panels and found severe deficiencies: half the respondents did not know that digoxin should be withdrawn in elderly patients with uncomplicated congestive heart failure (interestingly, later papers have disputed this medical "fact"23); more than a third of all doctors (and two thirds of those in general practice) did not know that glycated haemoglobin was a good measure of diabetic control; and more than a third of obstetricians did not know that experts advised a trial of labour in patients who had undergone previous caesarean sections.

The biggest problem with this study is that it reports self perceived estimates and opinions, but doctors are perhaps unlikely to be biased to reporting the picture as even worse than it is--and it seems bad. Doctors face a serious problem in keeping up to date. They do not know about important advances, feel overwhelmed by new scientific information, are not good at finding new information, and do not know how to evaluate it when it is found. "Science information management," conclude the authors, "is a critical professional skill that is not adequately taught in undergraduate medical education." Too often practitioners "don't know what they don't know."13

Information needs arising in the consultation

A questionnaire survey is a blunt instrument, and a better method for identifying doctors' information needs is to ask about them as doctors are seeing patients. This is what David Covell and others did in the most widely quoted study of information needs of doctors.11 They looked at the information needs of 47 physicians practising internal medicine in "office practice" in Los Angeles county during a half day: 12 of the physicians were generalists, and 35 were subspecialists. The physicians saw one to 16 patients during the half day. The authors identified the physicians' self perceived needs through a closed questionnaire completed before the office interviews, an interview after each patient was seen, and an interview at the end of the office visit.

The physicians answered the questionnaire by saying that they needed information about once a week, but 269 questions were raised during the interviews after 409 patient visits--about two questions for every three patients seen. Of these questions, 107 (40%) were questions of fact ("What are the side effects of bromocriptine?"), 120 (45%) were questions of medical opinion ("How do you manage a patient with labile hypertension?"), and 42 (16%) were questions of non-medical information ("How do you arrange home care for a patient?"). About a third of the questions were about treatment of specific conditions, a quarter about diagnosis, and 14% about drugs. For the subspecialists, about a third of their questions related to their own specialties and about two thirds to other subspecialties.

One important finding was that the questions were asked in a "non-generalised but practice related fashion" that would make it hard to find the answers. Thus doctors would ask "Should I test the serum procainamide level in this patient?" rather than "What are the indications for measuring serum procainamide?"

Table 3 shows the sources of information that the doctors claimed they used on the questionnaire and those that they reported using when interviewed immediately after the patients' visits. The doctors believed that they used print sources a lot, but in fact they were most likely to consult other doctors. Most of the doctors thought that they could find answers to their questions, more often from books than from journals. Although the doctors thought that they could answer their questions, only a third were answered while the interviewer was present. Each doctor had an average--from one half day--of four questions that were not answered immediately. Lack of time, cost, poor organisation and non-availability of sources, and "a glut of sources of differing reliability" were seen as the barriers to finding information.11


Table 3--Reported and observed use of information
sources (from Covell et al11)
------------------------------------------------------
                                     Percentage use
------------------------------------------------------
Information                        Reported   Observed
source                             (n = 182)  (n = 80)
------------------------------------------------------
Print sources:                        62         27
  General and specialty textbooks     25          3
  Pharmaceutical textbooks            14          9
  Journals                            18          7
  Drug company information             1          1
  Self made compendia                  4          7
Human sources:                        33         53
  Specialist doctors                  18         24
  Generalist doctors                   1          1
  Office partner                       3          4
  Pharmacist                           6          3
  Other                                5         21

This study generally produces a bleak picture: all but one of the 47 doctors had a question relating to a patient during the half day, and on average doctors had four; most of the questions were not answered, but the doctors thought that they were able to answer their questions. "In a typical half day of office practice," conclude Covell et al, "four management decisions might have been altered if needed information had been available at the time of the patient visit."11 We do not, of course, know how important the questions were or whether the patients would have done any better if these questions had been answered. The interviewers may also have prompted doctors to ask questions that they would not normally have asked.

Observing doctors' information needs

The next methodological step was to observe doctors' information needs directly. Jerry Osheroff and colleagues studied 24 doctors and medical students in a university based general medical service in Pittsburgh.16 An anthropologist, Diana Forsythe, observed the needs of the doctors and students, and internal medicine physicians then identified information requests by reviewing texts prepared from field notes. Generalisability is a big problem with this study, as many of the questions may have been generated because teaching was as important as patient care. Forsythe identified 519 information requests during 17 hours of observing inpatient and outpatient activity. During this time the 24 doctors and students cared for about 90 patients. A total of 454 information requests were "strictly clinical," an average of five for each patient. Three quarters of the questions were related to patient care, and three fifths were about specific patients. A quarter of the questions were about treatment, and 16% were specifically about drug treatment.

The doctors conducting the study anticipated that 42% of the questions would be answered by patients' records, 39% by a hospital information system, and a quarter by the library. About a quarter of the 337 questions asked about patient care that the doctors anticipated could be answered via a library, a textbook, a journal, or Medline. A quarter of the questions required a synthesis of patient data and medical knowledge--for example, "Why do you think this patient has had three deep vein thromboses?" The researchers did not investigate how many of the questions could actually be answered.

A second paper from the same study--this time on 35 hours of observation--produced a more complicated picture of doctors' information needs.17 Firstly, Forsythe and others observed that many information needs were not expressed as grammatical questions: indeed, they might not even be verbalised. Secondly, information needs might be hard to identify, and "the information seeking messages" might be interpretable only within the particular context. Thirdly, the needs might be for much more than specific clinical information. Doctors and students might be asking for support, guidance, and approval of what they are doing. Thus, one doctor asked "What do you do for the treatment of breast cancer?" about a patient who had exhausted all known treatments. The doctor was asking how she as a doctor could cope with being able to offer no further treatment to a woman dying of breast cancer. Such "information needs" are never likely to be met by a computer--or by books or journals--and may be one explanation why doctors tend to turn first to colleagues for information.

The Oregon studies: when are questions pursued and can they be answered?

Gorman and others have extended the work on doctors' information needs by identifying which questions doctors pursue and why and by measuring the amount of effort needed to answer the questions.6 19 20 They used methods modified from those of Covell et al to study the information needs of 50 non-academic "physicians providing ambulatory care in a primary care specialty" in Oregon (25 rural and 25 non-rural doctors). Participation and response rates were disappointingly low.

The doctors were interviewed immediately after each patient for half a day of practice and asked "Do you have any questions about the diagnosis or management of this patient's problems?" The researchers asked doctors to state "all the questions which occur to you during patient care, no matter whether you would pursue them or not, nor what source you might consult for an answer." At the end of the half day doctors were asked about 12 factors that might motivate them to seek answers to the questions (see table 4), and two to five days after the interview they were phoned to ask if they had pursued the questions. In addition, seven medical librarians conducted online searches to try to answer a random sample of 60 of the questions. The librarians then selected the "best" evidence they had found (such as meta-analyses and randomised controlled trials) and sent it back to the doctors, who were asked about the usefulness and relevance of the material. Sadly, there was a 6-12 month delay.


 Examples of unanswered questions of
 primary care doctors (from Gorman6)

 * "How best to sort out diabetic neuropathy, vas-
 cular pain, discogenic pain, and musculoskeletal
 causes of back and leg pain in a 70 year old woman
 (without testing for all of them)?"

 * "For diagnosis of deep vein thrombosis, how
 good is ultrasound? Does it obviate the need for a
 venogram? Can it exclude the diagnosis?"

 * "Is there a connection between asthma and
 migraines?"

 * "Can isosorbide dinitrate and/or Lopresor be
 responsible for itching and rash?"

 * "In an 88 year old woman with dysphagia due to
 past laryngeal cancer, now in respiratory failure
 due to aspiration, what is the physician's role in
 aggressiveness of care decisions when the patient's
 family has unrealistic expectations?"

 * "In an 60 year old woman with an elevated sed
 rate, guiaic-positive stool attributed to haemor-
 rhoids, and 35 pound weight loss, what work up is
 appropriate, taking cost and potential benefit into
 account?"


Table 4--Usefulness of information sources commonly used by doctors
-----------------------------------------------------------------------------------------------------------------
Information source                              Relevance        Validity         Work               Usefulness
-----------------------------------------------------------------------------------------------------------------
Evidence based, regularly updated textbook        High            High            Low                  High
Systematic journal review                         High            High            Low                  High
Portable summary of systematic reviews            High            High            Low                  High
Internet in 10 years' time                        High            High            Low                  High

Drug reference book                               High           Moderate         Low            High or moderate
ACP Journal Club, Evidence-Based
  Medicine--forerunners of systematic
  abstract journals                              Moderate         High            Low            High or moderate
Colleagues                                        High           Moderate         Low            High or moderate

Standard textbook                                 High            Low             Low                 Moderate
Standard journal review                           High           Moderate         Low                 Moderate
Collections of systematic reviews--such as  Moderate but rising   High     High but should fall       Moderate
  Cochrane library                               rapidly
Free medical newspapers                           High            Low             Low                 Moderate
Continuing medical education--lectures           Moderate        Moderate         Low                 Moderate
Continuing medical education--small groups        High           Moderate        Moderate             Moderate
Consensus statements                             Moderate        Moderate         Low                 Moderate
Clinical guidelines                              Moderate        Moderate         Low                 Moderate
Online searching                                 Moderate         High            High                Moderate

Journal articles                                  Low             High            High                 Low
Drug advertising                                 Moderate         Low             Low                  Low
Drug company representatives                      High            Low             Low                  Low
Mass media                                        Low             Low             Low                  Low
Internet now                                      Low             Low             High                 Low

Complete data were gathered for 49 doctors, who had cared for 514 patients and asked 295 questions about diagnosis or management. The doctors had pursued less than a third of the questions and found answers for less than a quarter. A multiple logistic regression model showed that, of the 12 factors that might prompt doctors to pursue questions, only two were statistically significant predictors--the doctor's belief that a definitive answer existed and the urgency of the patient's problem. Doctors most commonly used colleagues to answer the questions. The librarians succeeded in answering most questions, but the mean cost for each question was $27 and the mean time taken was 43 minutes. The doctors thought that the information retrieved was would have had an impact on the patient in 40% of cases and on them in about half.

The limitations of this study are that it was small, had low participation and response rates, used volunteers, and depended on self reporting. Nevertheless, it shows yet again that many questions are generated during consultations, many remain unanswered that could be answered, the answers that are generated seem relevant and important for patient care, and the ones most likely to be answered are those which the doctors think they will find an answer to and when the patient's needs are urgent. The unanswered questions are an important missed opportunity to educate doctors and improve medical practice. But, conclude Gorman and Helfand, "reducing the cost of using medical information systems is, by itself, insufficient to increase their use by practising physicians. New medical information systems, no matter how fast, inexpensive, and easy to use, will not be used more widely until it has been demonstrated to practitioners that these systems provide answers that help solve the problems of patient care."20

AIDS: information needs when knowledge is growing fast

The last study that I have summarised in full concerns the information needs of doctors (and other health professionals) treating patients infected with HIV. I included this study because it is one of the most recently published; it uses yet another method; it finds which questions can be answered; and it concerns a part of medicine where information is growing faster than in almost any other, where electronic databases are growing fast, and where some of the patients are as smart as the doctors--and possibly more adept at using modern information technology. The body of information on HIV doubles every 22 months,24 and, although half of that information is concentrated in 30 journals, the other half is spread through 593.25

Guise and others asked seven health professionals to look through the medical records of 10 patients who had died of AIDS to "Identify questions (for example, points you would like more information about) that you think could be answered through information sources in printed or electronic form, such as journal articles, medical textbooks, printed abstracts, treatment protocols, etc."22 The health professionals collected their questions, and then two of the paper's authors trained in library and information science tried to answer them. In the first phase of their search they searched standard textbooks and then four electronic databases. In the second phase they tried to answer questions that remained unanswered by reading printed material specifically related to AIDS and conducting additional online searches. The authors stopped their search as soon as they found an answer.

The 10 medical records covered 120 patient encounters. The health professionals identified 266 questions, an average of 38 each or 3.8 per patient. A quarter of the questions were about treatment. The authors were able to answer three quarters of the questions in phase one in an average time of 10 minutes and 18% in phase two in an average time of 22 minutes; 8% of questions could not be answered. Of the questions answered in phase one, 87% were answered from online sources.

Again this was a small study, and the questions were not generated by actual consultations of health professionals with patients. The health professionals were not invited to judge the correctness or the usefulness of the "answers," and the results cannot be generalised to other health care settings. However, the results show--as in most of the other studies--that large numbers of questions are generated by caring for this set of patients. Most of the questions can be answered, but it is time consuming and expensive to do so. Something better than present information systems is needed.

What do we know about doctors' information needs?

Despite the many deficiencies of these studies of the information needs, I feel able to draw some tentative conclusions.

Firstly, all the studies show that information needs do arise regularly when doctors see patients. The doctors are generally aware of the needs themselves, but questioning the doctors immediately after they have seen patients shows that these needs are greater than doctors admit to in general surveys. Observing the doctors suggests that the needs are still greater. Only one of the studies considered information needs that the doctors themselves did not identify,16 17 and it found a much higher rate of questions for each patient encounter than any other study. There is an urgent need to repeat a study along these lines in other settings. I think that it is conservative to conclude that every interaction between a patient and a doctor is likely on average to generate at least one question. The real need is likely to be higher.


 Studies of information needs that still
 need to be done

 * Studies that use an expanded view of the type of
 information need--to include the psychological
 component

 * Studies that use common definitions so as to
 allow better comparisons

 * Studies of what motivates doctors to seek to
 answer questions

 * Intervention studies that try to meet the
 information needs of doctors

 * Studies that use patient outcome as the endpoint

 * Studies in different contexts and health systems,
 including the British NHS

Secondly, these questions are most likely to be about treatment, and many of these are likely to be about drugs.

Thirdly, the questions are often complex and multidimensional. They are often questions about both particular patients and different areas of medical knowledge--for example, "In an octogenarian with anaemia, angina, and a history of transient ischaemic attacks, with a normal creatinine, iron, and mean corpuscular volume, who refuses a bone marrow exam, what diagnostic and therapeutic options are there?"

Fourthly, the need for information is often much more than a question about medical knowledge. Doctors are looking for guidance, psychological support, affirmation, commiseration, sympathy, judgment, and feedback. This "information need" is particularly poorly explored, and yet it may well be the most important need and the biggest stumbling block to a technical solution.

Fifthly, most of the questions generated in consultations go unanswered. We do not know from any of these studies whether answering the questions would lead to better patient outcomes or better doctors, but surely it would. We do know that many surveys of how much doctors know about important developments show severe deficiencies.2 13

Sixthly, doctors are most likely to seek answers to their questions from other doctors. Weinberg et al found that 81 American doctors in a discrete geographical area consulted 23 experts, logging 11 calls to experts each month. Six experts received over 90% of the calls, about 90 each a month.26 Doctors consult experts presumably because it is a quick, cheap, and easy method and because other doctors can also provide the psychological benefits that are not available from books, journals, and computers. One problem is that the doctors "answering" the questions may sometimes not be much more knowledgeable than the doctors seeking answers.

Seventhly, most of the questions generated by doctors can be answered, usually from electronic sources, but it is time consuming and expensive to do so--and demands information skills that many doctors do not have.

Eighthly, doctors in developed countries seem to be overwhelmed by the information provided for them. The amount of information is enormous and disorganised, and it is hard to find the answers to questions that arise in consultations.

Providing for doctors' information needs

I have not attempted in this paper to provide an answer to doctors' information needs, but I want to make a few observations about existing and future methods of supplying information. The "answer" to the problem can be considered by using a formula described by Shaughnessy et al.27

Usefulness of medical information = relevance x validity/work to access

The relevance of any information is based on the frequency of your exposure to the problem being addressed and the type of evidence being presented. Validity is the likelihood of the information being true, and the work to access the information is the time and effort that must be spent extracting the information. The ideal information source will be directly relevant, contain valid information, and be accessed with a minimal amount of work. Table 4 shows my judgment of how existing information sources score against these criteria. Seven sources score highly: colleagues and drug reference books, both of which are widely used; journals like ACP Journal Club or Evidence-Based Medicine, which scan medical journals and select abstracts of those that are clinically relevant and scientifically sound; evidence based, regularly updated textbooks, which are not yet available; systematic journal reviews, which are only just becoming available; a portable and comprehensive summary of systematic reviews, which is planned but does not yet exist; and the Internet in 10 years' time, which is pure speculation.

The deficiencies in current information sources make it clear that something more is required, and new sources are beginning to emerge. Nobody knows the form of the information tool that may transform medicine, but we can begin to discern some of its characteristics. The tool must be able to answer highly complex questions and so will have to be connected to a large valid database. Inevitably, it will be electronic, but it must be portable, fast, and easy to use. Almost certainly the tool will have to prompt doctors rather than simply answer questions, but it will have to do so in ways that doctors find helpful rather than demeaning. It will probably be connected to the patient record, and perhaps it will be as much a servant of patients as doctors, possibly changing fundamentally the doctorpatient relationship. A successful information tool will also meet the information needs of doctors that go beyond the need for answers to questions and begin to be a need for psychological support and affirmation.

"The big challenge for the next decade," writes Nicholas Negroponte, guru of the information age, "is to make computers that know you, learn about your needs, and understand verbal and non-verbal languages...[We need computers that] exhibit intelligence to such a degree that the physical interface almost goes away. Therein lies the secret to interface design: make it go away."28 The doctor's information tool of the future might be some sort of combination between the patient record and the Internet, with the doctor and the patient positioned together at the intersection but not having to pay attention to the technology. Probably there will be no single tool but a family of tools, and I suspect that, whatever sophisticated tools may be developed, the major source of information will remain colleagues.

I thank Brian Haynes, Jerry Osheroff, John Roberts, Jane Smith, Alison Tonks, and Jeremy Wyatt for reading this paper and making many suggestions for improvement. I also thank Margaret Thompson for supplying references.

  1. Pauker SD, Gorry G, Kassirer J, Schwartz W. Towards the simulation of clinical cognition: taking a present illness by computer. Am J Med 1976;65:981-96.
  2. Wyatt J. Uses and sources of medical knowledge. Lancet 1991;338:1368-72. [Medline]
  3. Wyatt JC. Medical informatics: artefacts or science? Methods Inf Med 1996;35:314-7.
  4. Hersch WR, Lunin LF. Perspectives on medical informatics: information technology in health care. Introduction and overview. J Am Soc Inf Sci 1995;46:726-7.
  5. Tannenbaum SJ. Knowing and acting in medical practice: the epistemiological politics of outcomes research. J Health Polit 1994;19:27-44.
  6. Gorman PN. Information needs of physicians. J Am Soc Inf Sci 1995;46:729-36.
  7. Hersch WR, Lunin LF. Perspectives on medical informatics: information technology in health care. J Am Soc Inf Sci 1995;46:726-90.
  8. Strasser TC. The information needs of practising physicians in Northeastern New York State. Bull Med Libr Assoc 1978;66:200-9. [Medline]
  9. Stinson ER, Mueller DA. Survey of health professionals' information habits and needs. JAMA 1980;243:140-3. [Abstract]
  10. Northup DE, Moore-West M, Skipper B, Teaf SR. Characteristics of clinical information searching: investigation using critical incident technique. J Med Educ 1983;58:873-81. [Medline]
  11. Covell DG, Uman GC, Manning PR. Information needs in office practice: are they being met? Ann Intern Med 1985;103:596-9.
  12. Timpka T, Ekstrom M, Bjurulf P. Information needs and information seeking behaviour in primary health care. Scand J Prim Health Care 1989;7:105-9. [Medline]
  13. Williamson JW, German PS, Weiss R, Skinner EA, Bowes F. Health science information management and continuing education of physicians. A survey of US primary care practitioners and their opinion leaders. Ann Intern Med 1989;110:151-60. [Medline]
  14. Woolf SH, Benson DA. The medical information needs of internists and paediatricians at an academic medical centre. Bull Med Libr Assoc 1989;77:372-80. [Medline]
  15. Timpka T, Arborelius E. The GP's dilemmas: a study of knowledge need and use during health care consultations. Methods Inf Med 1990;29:23-9. [Medline]
  16. Osheroff JA, Forsythe DE, Buchanan BG, Bankowitz RA, Blumenfeld BH, Miller RA. Physicians' information needs: analysis of questions asked during clinical teaching. Ann Intern Med 1991;114:576-81. [Medline]
  17. Forsythe DE, Buchanan BG, Osheroff JA, Miller RA. Expanding the concept of medical information: an observational study of physicians' information needs. Comput Biomed Res 1992;25:181-200. [Medline]
  18. Ely JW, Burch RJ, Vinson DC. The information needs of family physicians: case specific clinical questions. J Fam Pract 1992;35:265-9. [Medline]
  19. Gorman PN, Ash J, Wykoff L. Can primary care physicians' questions be answered using the medical journal literature? Bull Med Libr Assoc 1994;82:140-6.
  20. Gorman PN, Helfand M. Information seeking in primary care: How physicians choose which clinical questions to pursue and which to leave unanswered. Med Decis Making 1995;15:113-9. [Medline]
  21. Bowden VM, Kromer ME, Tobia RC. Assessment of physicians' information needs in five Texas counties. Bull Med Libr Assoc 1994;82:189-96. [Medline]
  22. Guise NB, Huber JT, Giuse DA, Brown CW, Bankowitz RA, Hunt S. Information needs of health care professionals in an AIDS outpatient clinic as determined by chart review. J Am Med Inf Assoc 1994;1:395-403. [Abstract]
  23. Packer M, Gheorghiade M, Young JB, Constantine PJ, Adams KS, Codey RJ, et al. Withdrawal of digoxin from patients with chronic heart failure treated with angiotensin converting enzyme inhibitors. N Engl J Med 1993;329:1-7. [Abstract/Free Full Text]
  24. Self PC, Filardo TW, Lancaster FW. Acquired immunodeficiency syndrome (AIDS) and the epidemic growth of its literature. Scientometrics 1989;17:49-60.
  25. Sengupta IN, Kumari L. Bibliometric analysis of AIDS literature. Scientometrics 1991;20:297-315.
  26. Weinberg AD, Ullian L, Richards WD, Cooper C. Informal advice and information seeking between physicians. J Med Educ 1981;56:174-80. [Medline]
  27. Shaughnessy AF, Slawson DC, Bennett JH. Becoming an information master: a guidebook to the medical information jungle. J Fam Pract 1994;39:489-99. [Medline]
  28. Negroponte N. Being digital. London: Hodder and Stoughton, 1995:92-3.

This article has been cited by other articles:


Home page
JAMAHome page
P. R. Hubbs, T. C. Rindfleisch, P. Godin, and K. L. Melmon
Medical Information on the Internet
JAMA, October 21, 1998; 280(15): 1363 - 1363.
[Full Text] [PDF]


Home page
JAMAHome page
D. L. Sackett, S. E. Straus, and for Firm A of the Nuffield Department of Medicine
Finding and Applying Evidence During Clinical Rounds: The "Evidence Cart"
JAMA, October 21, 1998; 280(15): 1336 - 1338.
[Abstract] [Full Text] [PDF]


Home page
JAMAHome page
R. H. Siegel
Contempo New and Now: Updates Linking Evidence and Experience
JAMA, May 6, 1998; 279(17): 1395 - 1396.
[Full Text] [PDF]


Home page
Arch Fam MedHome page
G. R. Bergus, C. S. Randall, S. D. Sinift, and D. M. Rosenthal
Does the Structure of Clinical Questions Affect the Outcome of Curbside Consultations With Specialty Colleagues?
Arch Fam Med, June 1, 2000; 9(6): 541 - 547.
[Abstract] [Full Text] [PDF]


Home page
Fam. Pract.Home page
S. J Andersson, G. Lindberg, and M. Troein
What shapes GPs' work with depressed patients? A qualitative interview study
Fam. Pract., December 1, 2002; 19(6): 623 - 631.
[Abstract] [Full Text] [PDF]


Home page
BMJHome page
R. Smith
A POEM a week for the BMJ
BMJ, November 2, 2002; 325(7371): 983 - 983.
[Full Text] [PDF]


Home page
Arch Intern MedHome page
G. Formoso, A. Liberati, and N. Magrini
Practice Guidelines: Useful and "Participative" Method?: Survey of Italian Physicians by Professional Setting
Archives of Internal Medicine, September 10, 2001; 161(16): 2037 - 2042.
[Abstract] [Full Text] [PDF]


Home page
PediatricsHome page
T. C. Sectish, V. Floriani, M. C. Badat, R. Perelman, and H. H. Bernstein
Continuous Professional Development: Raising the Bar for Pediatricians
Pediatrics, July 1, 2002; 110(1): 152 - 156.
[Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
J. M. Rothschild, T. H. Lee, T. Bae, and D. W. Bates
Clinician Use of a Palmtop Drug Reference Guide
J. Am. Med. Inform. Assoc., May 1, 2002; 9(3): 223 - 229.
[Abstract] [Full Text] [PDF]


Home page
J Bone Joint SurgHome page
A. Sarmiento
Thoughts on the Role of Orthopaedics in Basic Research
J. Bone Joint Surg. Am., December 1, 2001; 83(12): 1902 - 1904.
[Full Text] [PDF]


Home page
Fam. Pract.Home page
A. A. Verhoeven, E. J Boerma, and B. Meyboom-de Jong
Which literature retrieval method is most effective for GPs?
Fam. Pract., February 1, 2000; 17(1): 30 - 35.
[Abstract] [Full Text] [PDF]


Home page
Fam. Pract.Home page
J. Mayer and L. Piterman
The attitudes of Australian GPs to evidence-based medicine: a focus group study
Fam. Pract., December 1, 1999; 16(6): 627 - 632.
[Abstract] [Full Text] [PDF]


Home page
Fam. Pract.Home page
D. Macauley and E. Mccrum
Critical appraisal using the READER method: a workshop-based controlled trial
Fam. Pract., February 1, 1999; 16(1): 90 - 93.
[Abstract] [Full Text] [PDF]


Home page
Evid Based Ment HealthHome page
J. Geddes, S. Reynolds, D. Streiner, P. Szatmari, and B. Haynes
Evidence-based practice in mental health
Evid. Based Ment. Health, February 1, 1998; 1(1): 4 - 5.
[Full Text]


Home page
J Bone Joint SurgHome page
S. R. Hurwitz, D. Slawson, and A. Shaunessy
Orthopaedic Information Mastery: Applying Evidence-Based Information Tools to Improve Patient Outcomes While Saving Orthopaedists' Time
J. Bone Joint Surg. Am., June 1, 2000; 82(6): 888 - 888.
[Full Text]


Home page
Evid Based Ment HealthHome page
J. Geddes
Asking structured and focused clinical questions: essential first step of evidence-based practice
Evid. Based Ment. Health, May 1, 1999; 2(2): 35 - 36.
[Full Text]


Home page
BMJHome page
J. Brassey, G. Elwyn, C. Price, and P. Kinnersley
Just in time information for clinicians: a questionnaire evaluation of the ATTRACT project
BMJ, March 3, 2001; 322(7285): 529 - 530.
[Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
R. B. Elson, J. G. Faughnan, and D. P. Connelly
An Industrial Process View of Information Delivery to Support Clinical Decision Making: Implications for Systems Design and Process Measures
J. Am. Med. Inform. Assoc., July 1, 1997; 4(4): 266 - 278.
[Abstract] [Full Text]


Home page
Qual Saf Health CareHome page
S Marriott, C Palmer, and P Lelliott
Disseminating healthcare information: getting the message across
Qual. Saf. Health Care, March 1, 2000; 9(1): 58 - 62.
[Full Text]


Home page
eWJMHome page
J. W Ely, J. A Osheroff, M. H Ebell, G. R Bergus, B. T Levy, M L. Chambliss, and E. R Evans
Analysis of questions asked by family physicians regarding patient care
West J Med, May 1, 2000; 172(5): 315 - 319.
[Abstract] [Full Text]


Home page
eWJMHome page
A. F Shaughnessy and D. Slawson
Are we providing doctors with the training and tools for lifelong learning?
West J Med, November 1, 1999; 171(5): 325 - 328.
[Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
M. P. D'Alessandro, J. R. Galvin, S. I. Colbert, D. M. D'Alessandro, T. A. Choi, B. D. Aker, W. S. Carlson, and G. D. Pelzer
Solutions to Challenges Facing a University Digital Library and Press
J. Am. Med. Inform. Assoc., May 1, 2000; 7(3): 246 - 253.
[Abstract] [Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
E. E. Westberg and R. A. Miller
The Basis for Using the Internet to Support the Information Needs of Primary Care
J. Am. Med. Inform. Assoc., January 1, 1999; 6(1): 6 - 25.
[Abstract] [Full Text]


Home page
BMJHome page
J. Lyons and A. Khot
Infopoints: Managing information overload: developing an electronic directory
BMJ, January 15, 2000; 320(7228): 160 - 160.
[Full Text]


Home page
BMJHome page
A. F Shaughnessy and D. C Slawson
Are we providing doctors with the training and tools for lifelong learning?
BMJ, November 13, 1999; 319(7220): 1280 - 1280.
[Full Text]


Home page
BMJHome page
J. W Ely, J. A Osheroff, M. H Ebell, G. R Bergus, B. T Levy, M L. Chambliss, and E. R Evans
Analysis of questions asked by family doctors regarding patient care
BMJ, August 7, 1999; 319(7206): 358 - 361.
[Abstract] [Full Text]


Home page
BMJHome page
T. Lipman
Discrepancies exist between general practitioners' clinical work and a guidelines implementation programme
BMJ, August 29, 1998; 317(7158): 604 - 604.
[Full Text]


Home page
BMJHome page
T. Kennedy, S Magennis, C. Harris, K. W Moody, G. Brooks, A. Nobili, G. Macario, G. Frewini, A V E Rossetti, V. O Acik, D. C Slawson, A. F Shaughnessy, B. M Doran, and A. Verhoeven
What clinical information do doctors need?
BMJ, March 22, 1997; 314(7084): 903 - 903.
[Full Text]


Home page
BMJHome page
D. C Slawson and A. F Shaughnessy
Obtaining useful information from expert based sources
BMJ, March 29, 1997; 314(7085): 947 - 947.
[Abstract] [Full Text]


Home page
BMJHome page
H. S F Fraser, I. S Kohane, and W. J Long
Using the technology of the world wide web to manage clinical information
BMJ, May 31, 1997; 314(7094): 1600 - 1600.
[Full Text]


Home page
BMJHome page
D. MacAuley, E. McCrum, and C. Brown
Randomised controlled trial of the READER method of critical appraisal in general practice
BMJ, April 11, 1998; 316(7138): 1134 - 1137.
[Abstract] [Full Text]


Home page
BMJHome page
J. Geddes, S. Reynolds, D. Streiner, and P. Szatmari
Evidence based practice in mental health
BMJ, December 6, 1997; 315(7121): 1483 - 1484.
[Full Text]


Home page
BMJHome page
A R. Barrie and A. M Ward
Questioning behaviour in general practice: a pragmatic study
BMJ, December 6, 1997; 315(7121): 1512 - 1515.
[Abstract] [Full Text]


Home page
BMJHome page
R. Smith
Why the BMJ needs your data
BMJ, September 6, 1997; 315(7108): 558 - 559.
[Full Text]



Email this article to a friend
Respond to this article
PubMed citation
Related articles in PubMed
Download to Citation Manager
Search Medline for articles by:
Smith, R.
Alert me when:
New articles cite this article


Home Help Search/Archive Feedback Table of Contents
BMJ Intended for Health Professionals - Click here for further information
© 2003 BMJ Publishing Group Ltd