Published on 14.08.12 in Vol 1, No 2 (2012): Jul-Dec
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/1741, first published Jan 25, 2011.
Web-Based Interventions for Behavior Change and Self-Management: Potential, Pitfalls, and Progress
The potential advantages of using the Internet to deliver self-care and behavior-change programs are well recognized. An aging population combined with the increasing prevalence of long-term conditions and more effective medical interventions place financial strain on all health care systems. Web-based interventions have the potential to combine the tailored approach of face-to-face interventions with the scalability of public health interventions that have low marginal costs per additional user. From a patient perspective, Web-based interventions can be highly attractive because they are convenient, easily accessible, and can maintain anonymity/privacy. Recognition of this potential has led to research in developing and evaluating Web-based interventions for self-management of long-term conditions and behavior change. Numerous systematic reviews have confirmed the effectiveness of some Web-based interventions, but a number of unanswered questions still remain. This paper reviews the progress made in developing and evaluating Web-based interventions and considers three challenging areas: equity, effectiveness, and implementation. The impact of Web-based interventions on health inequalities remains unclear. Although some have argued that such interventions can increase access to underserved communities, there is evidence to suggest that reliance on Web-based interventions may exacerbate health inequalities by excluding those on the “wrong” side of the digital divide. Although most systematic reviews have found a positive effect on outcomes of interest, effect sizes tend to be small and not all interventions are successful. Further work is needed to determine why some interventions work and others do not. This includes considering the “active ingredients” or mechanism of action of these complex interventions and the context in which they are used. Are there certain demographic, psychological, or clinical factors that promote or inhibit success? Are some behaviors or some clinical problems more amenable to change by computer-based interventions? Equally problematic is the issue of implementation and integration of such programs into routine clinical practice. Many eHealth projects end when the research is concluded and fail to become part of mainstream clinical care. One way of addressing these challenges is to apply the Medical Research Council framework for developing, evaluating, and implementing complex interventions. This includes having a strong theoretical foundation, developing a proposed mechanism or pathway of action, ensuring that the evaluation adequately reflects this proposed pathway, and considering implementation from the beginning of the development process.
Med 2.0 2012;1(2):e3
The challenges facing health care systems in the 21st century include an aging population, increasing prevalence of long-term conditions, improved survival rates because of new health technologies, and rising consumer expectations of health care. All of these combine to put ever-increasing pressure on available health care resources . Although each country is pursuing individual solutions to these challenges, some common approaches are apparent, such as the use of information and communication technology (ICT) or eHealth. The use of ICT is expected to lead to improvements in health care quality (eg, through better communication) and efficiency (eg, through reduced duplication of investigations) [ , ]. Similarly, there is an increasing emphasis on promoting self-care or self-management by patients, both for patients with long-term conditions and a more general promotion of healthy behaviors [ ].
The importance of encouraging healthy behaviors is clear. Five behaviors—poor diet, lack of exercise, smoking, excessive alcohol consumption, and unprotected sex—account for approximately 39% of deaths in the United States . There would be a substantial improvement in public health if large numbers of people were to stop (or not start) smoking, drink in moderation, practice safer sex, eat healthily, and increase their level of physical activity [ , , ]. There is also a need to promote self-management for patients with long-term conditions, such as diabetes, heart disease, or arthritis. Effective self-management programs have been shown to reduce health care costs and improve quality of life across a range of conditions [ - ].
These two policy imperatives, increasing the use of ICT and enhancing people’s ability to self-care and adopt healthy behaviors, intersect in the field of Web-based interventions. The aim of this paper is to review the potential benefits of Web-based interventions, consider issues that require further attention before these potential benefits can be realized, and suggest ways of moving forward.
As Barak et al  have described, there has been a lack of clarity and consistency in the field of Internet-supported therapeutic interventions. This paper focuses on Barak et al’s “Web-based interventions” defined as:
“...a primarily self-guided intervention programme that is executed by means of a prescriptive online programme operated through a website and used by consumers seeking health- and mental-health related assistance. The intervention programme itself attempts to create positive change and or improve/enhance knowledge, awareness, and understanding via the provision of sound health-related material and use of interactive Web-based components.”
The key components of such interventions include program content, use of multimedia, interactive online activities, and guidance or supportive feedback . Web-based interventions have been developed for three main clinical areas: self-management of long-term conditions (eg, diabetes, heart disease, arthritis, and asthma), health promotion (eg, smoking cessation, alcohol reduction, sexual health, diet, and exercise), and mental health (eg, depression and anxiety).
Self-management is a complex concept. In their seminal work, Unending Work and Care: Managing Chronic Illness at Home, Corbin and Strauss  identified three tasks required for self-management: medical management; emotional management, and role management. Medical management receives the most attention from health professionals and designers of many Web-based interventions. It includes remembering to take medications regularly, managing interactions with health professionals, and adopting healthy behaviors such as eating healthily, exercising more, or stopping smoking. From a patient perspective, the other two tasks are just as important and just as challenging. Emotional management refers to the work required for individuals to come to terms with the very strong negative emotions (eg, guilt, shame, anger, and despair) that accompany a long-term condition. Role management is the work required to adapt to the changes in social roles and relationships (eg, at work, within the family, or among friends) caused by the long-term condition [ ].
The potential benefits of eHealth interventions for reach, accessibility, effectiveness, and cost-effectiveness have been described elsewhere [, ]. The Internet is now widely available in the developed world, with more than 90% penetration in Sweden, approximately 80% penetration in the United Kingdom, Australia, and the United States, and approximately 60% in Europe as a whole [ ]. An almost unlimited amount of information can be stored on the Web, yet it can be presented in an accessible and comprehensible format, in bite-size chunks, using video, graphics, and audio, and is available at the moment of need. Interactivity is a major advantage of the Internet, both for users interacting with websites and entering personal information that allows the site to tailor the information or services offered to that specific user, and for users interacting with one another through the Web. These two forms of interactivity can be used to provide formal behavior change support, decision support, and peer support. Delivering behavior change interventions over the Internet is appealing because this could combine the scalability of public health interventions with the effectiveness of personalized, individually tailored interventions.
Finally, because the main costs of Internet interventions tend to be incurred during the development phase and the marginal cost per additional user tends to be low, they have the potential to be highly cost-effective, particularly when used by large numbers of people [, ].
Many of these potential benefits have yet to be realized. This section outlines current difficulties in three areas (ie, equity, effectiveness, and implementation) that require further attention before the potential of Web-based interventions can be realized.
Web-based interventions could have two opposing impacts on health inequalities. Some have argued that Web-based interventions could help reduce health inequalities by opening up access to health information that was previously only accessible by health professionals. Reducing information asymmetry may help reduce the power imbalance between health professionals and patients, thus enabling patients to play a more active role in their health care [, ]. Moreover, the use of multimedia (eg, video, audio, and graphics) allows complex information to be presented in a simple format comprehensible even to those with low literacy skills. Web-based interventions may also reduce health inequalities by improving access to services. One example is the provision of mental health services in Australia. Patients in sparsely populated rural areas find it difficult to access therapists trained in cognitive behavioral therapy (CBT); delivery of online CBT, with or without email support from a therapist, enables these rural patients access to this therapy [ ].
An alternative view is that widespread use of Web-based interventions will widen health inequalities between those on either side of the “digital divide” . Those with access to the Internet will benefit from an increasing array of services, whereas those without will find themselves increasingly disadvantaged by not being able to access health information or services [ ]. Moreover, access is necessary—but not sufficient—for benefiting from Web-based interventions. Once people have gained access to such interventions, they have to go through a complex process of reading the information or other content, interpreting and making sense of it, and applying it to their personal circumstances. This ability to use and benefit from a Web-based intervention once provided with access can be thought of as “accessibility.” Accessibility could be affected by many factors. One factor will be user levels of literacy and health literacy, in which health literacy is defined as the ability of individuals to gain access to, understand, and use information for health [ ]. Other factors are likely to include internal and external constraints that may prevent users from acting on information. External constraints that may prevent health-promoting activities include poor housing, poor working conditions, and poverty [ ]. Internal, or psychological, constraints (eg, low self-efficacy or an external locus of control) may also play a part.
There are data to support both arguments. Some researchers have undertaken impressive work, demonstrating that Internet interventions can be used by and can benefit severely disadvantaged groups, including homeless drug users , single teenage mothers [ ], and vulnerable elderly people [ ]. In all of these studies, attention was paid both to providing access (eg, hardware and training in use of the system) and to accessibility (eg, ensuring the content and presentation were relevant and meaningful to the target audience). These studies demonstrate that if the problems of access and accessibility are both addressed, Web-based interventions have the potential to reach and to benefit socioeconomically deprived people.
Unfortunately, outside of these carefully designed and executed studies, there is evidence that Web-based interventions tend to be used by more advantaged groups. Looking first at the relatively simple question of access to the Internet, it is clear that there are considerable inequities in access, both between and within countries. In contrast to the high levels of Internet penetration seen in the United States, Australia, and Europe, Internet penetration in Africa was estimated at 11%, 24% in Asia, and 36% in Latin America and the Caribbean in 2011 . Even in countries where there is a relatively high level of access, such as the United Kingdom, there are access inequalities within the country. Access to the Internet increases with income and education. In 2011, Internet access among people with household incomes of £40,000 or more was 99%, whereas it was only 43% among people with household incomes of £12,500 or less (half the national median income). Similarly, among people with a university degree, access was 95%, whereas access was only 31% for those people who left school without graduating. Of greater concern, older people and people with disabilities or long-term illnesses are less likely to have Internet access. In 2011, Internet access among those aged 65 or over was <40%, and among those with health problems or disabilities that limited the kind or amount of work able to be done, access was 41% [ ]. In other words, those with the most need have the least access. Our own research on Web-based interventions supports these concerns about equity, with disproportionately high numbers of users having a university degree [ , ].
Barak et al’s definition of Web-based interventions posits an intention to create positive change across a range of outcomes. Apart from knowledge or understanding, these outcomes are undefined, but the conceptual framework of self-management developed by Corbin and Strauss implies that relevant outcomes are likely to include cognitive, behavioral, and emotional outcomes. Cognitive outcomes include knowledge or understanding, intention (eg, to adopt a particular healthy behavior), and self-efficacy (eg, a belief in one’s capacity to undertake an intended task or behaviors). Behavioral outcomes include changes in diet, physical activity, smoking cessation, moderating alcohol consumption, and managing medicines safely and effectively. Emotional outcomes that may be targeted include strong negative emotions such as anger, guilt, shame, depression, and anxiety. Improvements in emotional and behavioral outcomes are likely to lead to improvements in clinical outcomes and/or well-being . This next section explores the data on the effectiveness of Web-based interventions for these three outcome categories followed by a discussion of how such interventions achieve their effects.
Web-based interventions can improve knowledge. Computer-assisted learning (CAL) has been used as an educational tool since the 1960s  and there are ample data demonstrating its efficacy [ ]. In the health field, there have been a number of systematic reviews and meta-analyses that have demonstrated improvements in knowledge in users of Web-based interventions [ , ]. There are also data suggesting that some, but not all, Web-based interventions have a positive impact on mediators of behavior change such as intention and self-efficacy [ ].
From a clinical perspective, there are two main populations to target for behavior change: currently healthy people who are engaging in unhealthy behaviors likely to result in future physical health problems (health promotion or primary prevention) and people who are currently unwell and need to change their health behaviors to prevent further deterioration of their health status (self-management of long-term conditions or secondary prevention). The behaviors of interest tend to be the same across both populations (ie, healthy eating, physical activity, smoking cessation, moderating alcohol consumption, and practicing safer sex), but the levels of motivation may differ.
From a public health perspective, a small change across a large population can have a significant impact on public health . Hence, the positive findings of that numerous systematic reviews and meta-analyses of the effects of Web-based interventions for specific behaviors including smoking cessation [ ], reducing alcohol consumption [ ], safer sexual behaviors [ ], and increasing physical activity [ ] are reassuring even if the effect sizes tend to be small. Changing dietary behaviors appears to be more challenging, with a recent systematic review for the UK Health Technology Agency finding little or no impact of adaptive e-learning technologies across a wide range of dietary behaviors and no impact on weight loss or body mass index [ ]. Systematic reviews that have looked across a range of behaviors have demonstrated similar findings [ , ].
Although these findings are reassuring at a population level and may support the use of Web-based interventions for health promotion, the data on Web-based interventions for people with long-term conditions is less positive. It can be postulated that the motivation of people with a long-term condition differs from those without a diagnosis of a health problem because the need for change is both more immediate and more personal. For this population, the goal of behavior change tends not to be an end in itself, but rather as a step toward improved clinical outcomes . Although small changes in behavioral outcomes have been demonstrated, these have not converted into improved clinical outcomes [ ].
An alternative approach has been the use of computerized cognitive behavioral therapy (CCBT), which was first developed for use with people experiencing mental health problems such as depression and anxiety [, ]. The effectiveness of CCBT for mental health problems is discussed subsequently. More recently, interventions offering CCBT have been developed for a range of somatic problems such as tinnitus, insomnia, chronic pain, and headache. Although initial results are promising, further work is needed because many of the trials have been relatively small [ - ].
There has been a great deal of work on Web-based interventions for mental health. Interventions based on CCBT have been shown to be acceptable, effective, and cost-effective across a range of mental health problems including mild to moderate depression, anxiety, obsessive-compulsive disorder, and phobias [- ].
Web-based interventions not based on CCBT that are aimed at improving emotional outcomes have been less successful. Two main alternative approaches have been used: Web-based social networks and provision of personal stories. Personal stories are narratives from people experiencing similar health problems to the user. The underlying concept is that the user will obtain emotional and informational support by reading about “someone like them” who has had similar experiences. Perhaps the most well-known example of this approach is Health Talk Online (www.healthtalkonline.org), previously known as the Dictionary of Patient Experiences (DIPEX). Health Talk Online currently provides access to more than 2000 patient narratives about approximately 60 different health problems. Qualitative data suggest that users find such “personal experiences” helpful in reaching decisions , but there are less data available about whether and how such narratives impact emotional or clinical outcomes [ ].
Online social networks can be incorporated into Web-based interventions in the form of chat rooms, bulletin boards, or forums. Such social networks have a strong appeal to some users, both because of the ability to interact with other people going through similar experiences and because of their availability at all hours . Unfortunately, the research to date has failed to identify evidence of benefit (or harm) to users of online peer-support services. Authors of systematic reviews in this field have highlighted the paucity of comparative data, making it difficult to draw any robust conclusions about the impact of such interventions [ - ].
Mechanism of Action
Systematic reviews of Web-based interventions make it apparent that some interventions work better than others do. This may be because of differences in target populations, target behaviors, target outcomes, or differences in the content or delivery of the interventions themselves. To date, it has not been possible to untangle this, although it is possible to draw some tentative conclusions.
Some of the potential differences between healthy populations and those with a long-term condition have been mentioned in the preceding sections, and it seems likely that unsupported use of a Web-based intervention requires a fairly high degree of motivation and critical health literacy  on the part of the user. Among target behaviors, weight loss seems particularly difficult to achieve with Web-based interventions [ ].
Focusing on content and delivery of interventions suggests that those with a theoretical foundation are more likely to be effective than those without [, ]. Interventions offering CCBT appear to have a good chance of being effective across a range of physical and mental health problems known to respond to face-to-face CBT. Behavior-change interventions that do not use CBT techniques can also be effective. A recent large systematic review and meta-analysis of Web-based behavior-change interventions aimed to identify why some interventions worked and some did not. The review included approximately 85 studies covering more than 45,000 participants. The authors applied a newly developed taxonomy of behavior-change techniques to interventions in the included studies. From this analysis, they were able to conclude that more extensive use of theory (particularly the Theory of Planned Behavior) and certain behavior-change techniques (eg, stress management, goal setting, and action planning) were associated with larger effect sizes [ ]. A similar methodological approach, but focusing on the use of persuasive features and mechanisms embedded in Web-based interventions, found considerable use of persuasive techniques. However, the authors were unable to conclude whether specific techniques were associated with effectiveness [ ].
Equally important as considering the “active components” of the intervention is consideration of what constitutes an “effective dose” (ie, what level of engagement is needed for users to benefit from use of the intervention, to what extent does the “effective dose” vary between users, and what characteristics of users are likely to influence the “dose” that is needed). Attrition from Web-based interventions is a phenomenon that has been observed frequently  that may undermine effectiveness. Adherence to any specified intervention may be related to characteristics of the intervention, characteristics of the user, or characteristics of the condition addressed by the intervention. Characteristics of the intervention that may improve adherence to the intervention include a strong theoretical foundation [ ], perceived personal relevance to the user [ , ], perceived effectiveness [ , ], tailoring [ , ], persuasive technologies [ ], credibility [ , ], social networking [ , ], and regular “push factors” including human support [ - ] and/or periodic prompts (eg, by email or telephone) [ ]. Data on user characteristics are confusing and contradictory. Although many researchers have found that women, older people, and well-educated people are all more likely to demonstrate adherence to Web-based interventions than males, younger people, and less-educated people [ , , , ], others have found no association between adherence and age, gender, or education level [ , ]. Clearly, further work is needed in this area.
Cost-Effectiveness and Implementation
The potential cost-effectiveness of Internet interventions is highly appealing, but an intervention has to be effective before it can be cost-effective. Even when an intervention is effective, the main costs tend to be incurred during development, with relatively low marginal costs per additional user, so that any cost-benefit relies on achieving large numbers of users . Although there are some interventions that have been used by very large numbers of people [ , ], many interventions have not been widely disseminated. One way of ensuring an intervention is used by large numbers of people is to integrate it into routine health services, but this has been rarely done to date. Implementation of eHealth has proved problematic in most countries, with numerous reports of delay, budget overspends, and occasional severely negative impacts on the quality and effectiveness of care [ , ]. These difficulties have continued despite the considerable literature available about implementing eHealth systems and the growing awareness of the importance of a sociotechnical approach [ , ].
There is also a paucity of data on actual cost-effectiveness of Internet interventions [, ], making it difficult to determine their actual, versus potential, cost-benefits. Fortunately, this appears to be changing as newer studies include cost-effectiveness data [ , ].
The previous section described areas that need further attention before Web-based interventions can achieve their full potential. This section suggests ways to move forward within these areas of research.
Apply the Medical Research Council Framework
Most Web-based interventions are complex interventions (ie, interventions that are made up of a number of components that may act independently or interdependently). Therefore, the Medical Research Council (MRC) framework for developing, evaluating, and implementing complex interventions offers an appropriate framework for research on Web-based interventions. This framework was first published in 2000  and revised in 2008 [ ]. It has been highly influential, with many additional publications on applying, extending, and revising the framework [ - ]. It suggests a phased approach, with early work (Phases 0 to 2) consisting of systematic literature reviews to identify what is already known, theoretical work to establish an appropriate theoretical foundation, modeling studies to establish potential rate-limiting steps and population impact, qualitative studies to determine acceptability and feasibility, studies to confirm (or deny) the proposed pathway of action and identify appropriate intermediary outcomes, and pilot studies to optimize both the intervention and the trial parameters. These phases and studies are iterative, with development of the intervention and the evaluation methods proceeding in tandem [ , ]. Only when both the intervention and the trial parameters have been optimized and the mechanism of action has been well defined, should researchers proceed to a Phase 3 randomized controlled trial to establish the effectiveness of the intervention. Phase 4 (implementation) studies are needed both to establish how best to implement the intervention into routine practice and to determine whether the benefits shown in the trial manifest outside the trial environment. Phase 4 studies can also identify unintended adverse effects [ , ].
Apply Theory to the Development of Web-Based Interventions
The MRC framework advises the use of a theoretical framework for development of the intervention, and this advice is supported by the empirical literature which demonstrates that theoretically informed Web-based interventions are more likely to be effective than those without a theoretical foundation. Theories offer us generalizable frameworks that can apply across different settings and individuals, the opportunity for incremental accumulation of knowledge, and an explicit framework for analysis . Researchers interested in developing a Web-based behavior-change intervention have a wide range of psychological theories from which to choose. Once an appropriate theory is selected, researchers must identify the key constructs of the theory and consider how the intervention will act on these constructs based on the available data to support the use of that theory in the selected population for the target behavioral change. A simple example would be an intervention based on social cognitive theory (SCT). Key constructs of SCT are self-efficacy (an individual’s confidence in his or her ability to carry out a behavior) and outcome expectations (beliefs about the outcomes that are likely to result from a particular behavior). Hence, an intervention based on SCT would target users self-efficacy (eg, by breaking the behavior down into small, manageable steps or providing case histories of people who had achieved this behavior with details of how they managed it) and outcome expectancies (eg, by providing information about the benefits of change).
Researchers should publish detailed descriptions of the interventions they have developed, along with an explanation of the chosen theoretical framework and how it was operationalized for the active ingredients and the proposed pathway of action [, ]. Such publications will allow other researchers to learn from their experience and allow subsequent researchers to look across a range of interventions and identify common approaches associated with effectiveness.
Apply Theory to the Evaluation of the Web-Based Intervention
The MRC framework emphasizes the need for formative and pilot studies during the development of a complex intervention. These early phase studies aim to optimize both the intervention and the evaluation, with a view to ensuring that a final Phase 3 trial will provide a definitive answer. Early phase studies should reflect the theoretical framework used for development of the intervention. Thus if an intervention has been designed to cause changes in self-efficacy and outcome expectancies, it is important that the evaluation determines whether changes in these proximal outcomes occur as well as whether the target behavior changes. This provides empirical support for the proposed “pathway of action” of the intervention. Mediational analysis can be used to explore whether these proximal outcomes mediate the final outcome.
Phase 2 studies should also address the issue of defining and achieving an “effective dose” of the intervention. Kraft  has advised researchers to consider the use of an intervention as the first behavior change to target. He advocates “tunnelling,” or highly tailored pre-determined routes through the intervention, coupled with numerous proactive contacts by the intervention to the user delivered through short message service (SMS), email, or automated phone calls [ , ]. An alternative approach used in the mental health field is “facilitated access” in which use of the intervention is monitored and supported by a health care worker or therapist. Such support may be associated with improved outcomes for some conditions [ , , ]. Eysenbach [ ] has argued that researchers need to document and publish the content of interventions just as they should document both the planned and actual level of engagement by participants with interventions under evaluation.
Apply Theory to the Implementation of Web-Based Interventions
The eHealth researcher’s responsibility is not limited to developing and evaluating effective Web-based interventions. As we have seen previously, the main cost-benefits of such interventions tend to be achieved with large numbers of users. Achieving large numbers of users often requires implementing and integrating interventions into routine health care, but this has proved difficult to date. Difficulties in eHealth implementation are international phenomena, with similar problems being widely reported [- ]. Application of theory is likely to enhance the effectiveness and success of implementation initiatives.
The sociotechnical systems approach argues that it is the interaction between social and technical systems within an organization or context that is important for successful functioning. The recognition of the importance of both social and technical factors is reflected in a number of sociological theories pertinent to eHealth implementation, including the influential actor-network theory (ANT). ANT posits that both people and objects or technologies are actors in a social network and that disruption to any of the actors disrupts the network. Important contributions have been made to understanding the role of attitudes , and social transmission of innovations between [ ] or interactions within [ , ] actor-networks. Gidden’s Structuration Theory reconfigures the relationship between individual agency and social structures by considering them as a duality rather than two separate entities [ ] and has been applied extensively to information technology and eHealth [ ].
A theory that specifically focuses on implementation, integration, and embedding of new practices is normalization process theory (NPT). The precursor to NPT, normalization process model (NPM), originated from a large body of work on eHealth and was developed to explain the observation that many eHealth initiatives failed to embed into routine practice [, ]. NPT focuses on the “work” that health professionals and patients need to do for a new practice or technology to be implemented and become integrated and embedded into routine practice (ie, normalized). Normalization is important for sustainability. Once a new practice has become normalized or taken for granted, it is so embedded into routine practice that it requires relatively little effort to sustain its use [ ].
NPT has been used to explain the success or failure of a range of eHealth implementations [- ] and there is empirical support for its use as an explanatory model [ ]. The current focus of NPT research is to determine whether it can be used prospectively, to move beyond explaining success or failure of an implementation toward planning successful implementations. To this end, the NPT toolkit (www.normalizationprocess.org) has been developed to help researchers consider implementation issues from the early stages of developing and evaluating complex interventions [ ]. A similar toolkit, the eHealth Implementation Toolkit (e-HIT), is aimed specifically at eHealth interventions and has been developed for use by managers and other staff charged with implementing eHealth initiatives (ie, implementers) [ - ]. Research is underway to see if these tools have predictive utility. In the meantime, eHealth researchers should consider implementation issues from the beginning of the development and evaluation of a new intervention, including identifying and applying an appropriate theoretical approach to the issues of implementation.
The eHealth field is developing quickly, but there are still many challenges to face before it can reach its full potential. This paper has used the example of Web-based interventions to focus on three particular challenges: equity, effectiveness, and implementation. It has argued that the application of the MRC framework for development, evaluation, and implementation of complex interventions, together with a greater use of theory could help address these challenges. Specific recommendations include better descriptions of Web-based interventions in the published literature, including clear descriptions of the theoretical approach used, how this was operationalized, and what the developers consider the likely pathway of action and the active components of the intervention. This will facilitate improved research designs to evaluate interventions because important mediators or proximal outcomes will be clearly specified. Consideration of implementation issues needs to start at the point of development of a new intervention. Use of an appropriate theoretical framework (eg, NPT and its associated tool kit) may help researchers work through implementation issues in a structured fashion.
Conflicts of Interest
- World Health Organization. Geneva: World Health Organization; 1999. The World Health Report 1999: Making a Difference URL: http://www.who.int/whr/1999/en/ [accessed 2012-08-06] [WebCite Cache]
- Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med 2006 May 16;144(10):742-752. [Medline]
- Shekelle P, Morton S, Keeler E. Costs and Benefits of Health Information Technology Evidence Report/Technology Assessment No. 132. Rockville, MD: Agency for Healthcare Research and Quality; Apr 2006.
- Wanless D. Securing our Future Health: Taking a Long-Term View (Final Report). London: HM Treasury; 2002. URL: http://si.easp.es/derechosciudadania/wp-content/uploads/2009/10/4.Informe-Wanless.pdf [accessed 2012-08-06] [WebCite Cache]
- Mokdad AH, Marks JS, Stroup DF, Gerberding JL. Actual causes of death in the United States, 2000. JAMA 2004 Mar 10;291(10):1238-1245. [CrossRef] [Medline]
- Wanless D. Securing Good Health for the Whole Population: Population Health Trends. Norwich, UK: HM Treasury; 2003 Dec. URL: http://image.guardian.co.uk/sys-files/Society/documents/2003/12/09/wanless_health_trends.pdf [accessed 2012-08-11] [WebCite Cache]
- Wanless D. Department of Health. Norwich, UK: The Stationery Office; 2004 Feb 25. Securing good health for the whole population: final report URL: http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4074426 [accessed 2012-08-11] [WebCite Cache]
- Lorig KR, Sobel DS, Stewart AL, Brown B, Bandura A, Ritter P, et al. Evidence suggesting that a chronic disease self-management program can improve health status while reducing hospitalization: a randomized trial. Med Care 1999 Jan;37(1):5-14. [Medline]
- Department of Health. Supporting People with Long Term Conditions: An NHS and Social Care Model to Support Local Innovation and Integration. Leeds, UK: Department of Health; 2005 Jan 05. URL: http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4100252 [accessed 2012-08-11] [WebCite Cache]
- Bodenheimer T, Lorig K, Holman H, Grumbach K. Patient self-management of chronic disease in primary care. JAMA 2002 Nov 20;288(19):2469-2475. [Medline]
- Barak A, Klein B, Proudfoot JG. Defining internet-supported therapeutic interventions. Ann Behav Med 2009 Aug;38(1):4-17. [CrossRef] [Medline]
- Corbin JM, Strauss A. Unending Work and Care: Managing Chronic Illness at Home (Jossey Bass Social and Behavioral Science Series). San Francisco: Jossey-Bass; 1998.
- Bennett GG, Glasgow RE. The delivery of public health interventions via the Internet: actualizing their potential. Annu Rev Public Health 2009;30:273-292. [CrossRef] [Medline]
- Robinson TN, Patrick K, Eng TR, Gustafson D. An evidence-based approach to interactive health communication: a challenge to medicine in the information age. Science Panel on Interactive Communication and Health. JAMA 1998 Oct 14;280(14):1264-1269. [Medline]
- Internet World Stats: Usage and Population Statistics. 2011 Dec 31. Internet usage statistics: the Internet big picture URL: http://www.internetworldstats.com/stats.htm [accessed 2012-08-11] [WebCite Cache]
- Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res 2006;8(2):e10 [FREE Full text] [CrossRef] [Medline]
- Tate DF, Finkelstein EA, Khavjou O, Gustafson A. Cost effectiveness of internet interventions: review and recommendations. Ann Behav Med 2009 Aug;38(1):40-45. [CrossRef] [Medline]
- Hardey M. Doctor in the house: the Internet as a source of lay health knowledge and the challenge to expertise. Sociology of Health & Illness 1999;21:820-835.
- McMullan M. Patients using the Internet to obtain health information: how this affects the patient-health professional relationship. Patient Educ Couns 2006 Oct;63(1-2):24-28. [CrossRef] [Medline]
- Bennett-Levy J, Perry H. The promise of online cognitive behavioural therapy training for rural and remote mental health professionals. Australas Psychiatry 2009 Aug;17 Suppl 1:S121-S124. [CrossRef] [Medline]
- Eng TR, Maxfield A, Patrick K, Deering MJ, Ratzan SC, Gustafson DH. Access to health information and support: a public highway or a private road? JAMA 1998 Oct 21;280(15):1371-1375. [Medline]
- Hsu J, Huang J, Kinsman J, Fireman B, Miller R, Selby J, et al. Use of e-Health services between 1999 and 2002: a growing digital divide. J Am Med Inform Assoc 2005 Mar;12(2):164-171 [FREE Full text] [CrossRef] [Medline]
- Nutbeam D. The evolving concept of health literacy. Soc Sci Med 2008 Dec;67(12):2072-2078. [CrossRef] [Medline]
- Braveman P, Egerter S, Williams DR. The social determinants of health: coming of age. Annu Rev Public Health 2011;32:381-398. [CrossRef] [Medline]
- Cashen MS, Sklar BM, Nguyen HH, Just M, Galzagorry G, Bakken S. Implementing a Web-based information resource at an inner-city community church: lessons learned. Comput Inform Nurs 2002 Nov;20(6):244-250. [Medline]
- Dunham PJ, Hurshman A, Litwin E, Gusella J, Ellsworth C, Dodd PW. Computer-mediated social support: single young mothers as a model system. Am J Community Psychol 1998 Apr;26(2):281-306. [Medline]
- Heyn Billipp S. The psychosocial impact of interactive computer use within a vulnerable elderly population: a report on a randomized prospective trial in a home health care setting. Public Health Nurs 2001;18(2):138-145. [Medline]
- Dutton WH, Blank G. Next generation users: the Internet in Britain. SSRN Electronic Journal 2011 Oct 16 [FREE Full text] [CrossRef]
- Wallace P, Murray E, McCambridge J, Khadjesari Z, White IR, Thompson SG, et al. On-line randomized controlled trial of an internet based psychologically enhanced intervention for people with hazardous alcohol consumption. PLoS One 2011;6(3):e14740 [FREE Full text] [CrossRef] [Medline]
- Kerr C, Murray E, Noble L, Morris R, Bottomley C, Stevenson F, et al. The potential of Web-based interventions for heart disease self-management: a mixed methods investigation. J Med Internet Res 2010;12(4):e56 [FREE Full text] [CrossRef] [Medline]
- Murray E, Burns J, See TS, Lai R, Nazareth I. Interactive Health Communication Applications for people with chronic disease. Cochrane Database Syst Rev 2005(4):CD004274. [CrossRef] [Medline]
- Piemme TE. Computer-assisted learning and evaluation in medicine. JAMA 1988 Jul 15;260(3):367-372. [Medline]
- Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 2011 Sep 7;306(9):978-988. [CrossRef] [Medline]
- Bailey JV, Murray E, Rait G, Mercer CH, Morris RW, Peacock R, et al. Interactive computer-based interventions for sexual health promotion. Cochrane Database Syst Rev 2010(9):CD006483. [CrossRef] [Medline]
- Rose G. Sick individuals and sick populations. Int J Epidemiol 1985 Mar;14(1):32-38. [Medline]
- Shahab L, McEwen A. Online support for smoking cessation: a systematic review of the literature. Addiction 2009 Nov;104(11):1792-1804. [CrossRef] [Medline]
- Khadjesari Z, Murray E, Hewitt C, Hartley S, Godfrey C. Can stand-alone computer-based interventions reduce alcohol consumption? A systematic review. Addiction 2011 Feb;106(2):267-282. [CrossRef] [Medline]
- Vandelanotte C, Spathonis KM, Eakin EG, Owen N. Website-delivered physical activity interventions a review of the literature. Am J Prev Med 2007 Jul;33(1):54-64. [CrossRef] [Medline]
- Harris J, Felix L, Miners A, Murray E, Michie S, Ferguson E, et al. Adaptive e-learning to improve dietary behaviour: a systematic review and cost-effectiveness analysis. Health Technol Assess 2011 Oct;15(37):1-160 [FREE Full text] [CrossRef] [Medline]
- Portnoy DB, Scott-Sheldon LA, Johnson BT, Carey MP. Computer-delivered interventions for health promotion and behavioral risk reduction: a meta-analysis of 75 randomized controlled trials, 1988-2007. Prev Med 2008 Jul;47(1):3-16. [CrossRef] [Medline]
- Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
- Proudfoot J, Ryden C, Everitt B, Shapiro DA, Goldberg D, Mann A, et al. Clinical efficacy of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry 2004 Jul;185:46-54 [FREE Full text] [Medline]
- Proudfoot J, Goldberg D, Mann A, Everitt B, Marks I, Gray JA. Computerized, interactive, multimedia cognitive-behavioural program for anxiety and depression in general practice. Psychol Med 2003 Feb;33(2):217-227. [Medline]
- Andersson G, Strömgren T, Ström L, Lyttkens L. Randomized controlled trial of internet-based cognitive behavior therapy for distress associated with tinnitus. Psychosom Med 2002;64(5):810-816 [FREE Full text] [Medline]
- Ritterband LM, Thorndike FP, Gonder-Frederick LA, Magee JC, Bailey ET, Saylor DK, et al. Efficacy of an Internet-based behavioral intervention for adults with insomnia. Arch Gen Psychiatry 2009 Jul;66(7):692-698. [CrossRef] [Medline]
- Ritterband LM, Bailey ET, Thorndike FP, Lord HR, Farrell-Carnahan L, Baum LD. Initial evaluation of an Internet intervention to improve the sleep of cancer survivors with insomnia. Psychooncology 2012 Jul;21(7):695-705. [CrossRef] [Medline]
- Bender JL, Radhakrishnan A, Diorio C, Englesakis M, Jadad AR. Can pain be managed through the Internet? A systematic review of randomized controlled trials. Pain 2011 Aug;152(8):1740-1750. [CrossRef] [Medline]
- Kaltenthaler E, Brazier J, De Nigris E, Tumur I, Ferriter M, Beverley C, et al. Computerised cognitive behaviour therapy for depression and anxiety update: a systematic review and economic evaluation. Health Technol Assess 2006 Sep;10(33):iii, xi-ixiv, 1 [FREE Full text] [Medline]
- Kaltenthaler E, Sutcliffe P, Parry G, Beverley C, Rees A, Ferriter M. The acceptability to patients of computerized cognitive behaviour therapy for depression: a systematic review. Psychol Med 2008 Nov;38(11):1521-1530. [CrossRef] [Medline]
- Richardson T, Stallard P, Velleman S. Computerised cognitive behavioural therapy for the prevention and treatment of depression and anxiety in children and adolescents: a systematic review. Clin Child Fam Psychol Rev 2010 Sep;13(3):275-290. [CrossRef] [Medline]
- Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med 2007 Mar;37(3):319-328. [CrossRef] [Medline]
- Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
- Andrews G, Davies M, Titov N. Effectiveness randomized controlled trial of face to face versus Internet cognitive behaviour therapy for social phobia. Aust N Z J Psychiatry 2011 Apr;45(4):337-340. [CrossRef] [Medline]
- Wootton BM, Titov N, Dear BF, Spence J, Andrews G, Johnston L, et al. An Internet administered treatment program for obsessive-compulsive disorder: a feasibility study. J Anxiety Disord 2011 Dec;25(8):1102-1107. [CrossRef] [Medline]
- Entwistle VA, France EF, Wyke S, Jepson R, Hunt K, Ziebland S, et al. How information about other people's personal experiences can help with healthcare decision-making: a qualitative study. Patient Educ Couns 2011 Dec;85(3):e291-e298. [CrossRef] [Medline]
- Ziebland S, Wyke S. Health and Illness in a Connected World: How Might Sharing Experiences on the Internet Affect People's Health? Milbank Q 2012 Jun;90(2):219-249. [CrossRef] [Medline]
- Kerr C, Murray E, Stevenson F, Gore C, Nazareth I. Internet interventions for long-term conditions: patient and caregiver quality criteria. J Med Internet Res 2006;8(3):e13 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G, Powell J, Englesakis M, Rizo C, Stern A. Health related virtual communities and electronic support groups: systematic review of the effects of online peer to peer interactions. BMJ 2004 May 15;328(7449):1166. [CrossRef] [Medline]
- Demiris G. The diffusion of virtual communities in health care: concepts and challenges. Patient Educ Couns 2006 Aug;62(2):178-188. [CrossRef] [Medline]
- Griffiths KM, Calear AL, Banfield M. Systematic review on Internet Support Groups (ISGs) and depression (1): Do ISGs reduce depressive symptoms? J Med Internet Res 2009;11(3):e40 [FREE Full text] [CrossRef] [Medline]
- Chinn D. Critical health literacy: a review and critical analysis. Soc Sci Med 2011 Jul;73(1):60-67. [CrossRef] [Medline]
- Noar SM, Clark A, Cole C, Lustria ML. Review of interactive safer sex Web sites: practice and potential. Health Commun 2006;20(3):233-241. [CrossRef] [Medline]
- Lehto T, Oinas-Kukkonen H. Persuasive features in web-based alcohol and smoking interventions: a systematic review of the literature. J Med Internet Res 2011;13(3):e46 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [CrossRef] [Medline]
- Strecher VJ, McClure J, Alexander G, Chakraborty B, Nair V, Konkel J, et al. The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial. J Med Internet Res 2008;10(5):e36 [FREE Full text] [CrossRef] [Medline]
- Nicholas J, Proudfoot J, Parker G, Gillis I, Burckhardt R, Manicavasagar V, et al. The ins and outs of an online bipolar education program: a study of program attrition. J Med Internet Res 2010 Dec;12(5):e57 [FREE Full text] [CrossRef] [Medline]
- Gerhards SA, Abma TA, Arntz A, de Graaf LE, Evers SM, Huibers MJ, et al. Improving adherence and effectiveness of computerised cognitive behavioural therapy without support for depression: a qualitative study on patient experiences. J Affect Disord 2011 Mar;129(1-3):117-125. [CrossRef] [Medline]
- Zbikowski SM, Hapgood J, Smucker Barnwell S, McAfee T. Phone and web-based tobacco cessation treatment: real-world utilization patterns and outcomes for 11,000 tobacco users. J Med Internet Res 2008;10(5):e41 [FREE Full text] [CrossRef] [Medline]
- Wangberg SC, Bergmo TS, Johnsen JA. Adherence in Internet-based interventions. Patient Prefer Adherence 2008;2:57-65 [FREE Full text] [Medline]
- Couper MP, Alexander GL, Zhang N, Little RJ, Maddy N, Nowak MA, et al. Engagement and retention: measuring breadth and depth of participant use of an online intervention. J Med Internet Res 2010;12(4):e52 [FREE Full text] [CrossRef] [Medline]
- Cugelman B, Thelwall M, Dawes P. Online interventions for social marketing health behavior change campaigns: a meta-analysis of psychological architectures and adherence factors. J Med Internet Res 2011;13(1):e17 [FREE Full text] [CrossRef] [Medline]
- Nordgreen T, Havik OE, Ost LG, Furmark T, Carlbring P, Andersson G. Outcome predictors in guided and unguided self-help for social anxiety disorder. Behav Res Ther 2012 Jan;50(1):13-21. [CrossRef] [Medline]
- Harris PR, Sillence E, Briggs P. The effect of credibility-related design cues on responses to a web-based message about the breast cancer risks from alcohol: randomized controlled trial. J Med Internet Res 2009;11(3):e37 [FREE Full text] [CrossRef] [Medline]
- Richardson CR, Buis LR, Janney AW, Goodrich DE, Sen A, Hess ML, et al. An online community improves adherence in an internet-mediated walking program. Part 1: results of a randomized controlled trial. J Med Internet Res 2010;12(4):e71 [FREE Full text] [CrossRef] [Medline]
- Stoddard JL, Augustson EM, Moser RP. Effect of adding a virtual community (bulletin board) to smokefree.gov: randomized controlled trial. J Med Internet Res 2008 Dec;10(5):e53 [FREE Full text] [CrossRef] [Medline]
- Glasgow RE, Kurz D, King D, Dickman JM, Faber AJ, Halterman E, et al. Outcomes of minimal and moderate support versions of an internet-based diabetes self-management support program. J Gen Intern Med 2010 Dec;25(12):1315-1322. [CrossRef] [Medline]
- Titov N, Andrews G, Davies M, McIntyre K, Robinson E, Solley K. Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance. PLoS One 2010;5(6):e10939 [FREE Full text] [CrossRef] [Medline]
- Robinson E, Titov N, Andrews G, McIntyre K, Schwencke G, Solley K. Internet treatment for generalized anxiety disorder: a randomized controlled trial comparing clinician vs. technician assistance. PLoS One 2010;5(6):e10942 [FREE Full text] [CrossRef] [Medline]
- Fry JP, Neff RA. Periodic prompts and reminders in health promotion and health behavior interventions: systematic review. J Med Internet Res 2009;11(2):e16 [FREE Full text] [CrossRef] [Medline]
- Glasgow RE, Christiansen SM, Kurz D, King DK, Woolley T, Faber AJ, et al. Engagement in a diabetes self-management website: usage patterns and generalizability of program use. J Med Internet Res 2011;13(1):e9 [FREE Full text] [CrossRef] [Medline]
- Melville KM, Casey LM, Kavanagh DJ. Dropout from Internet-based treatment for psychological disorders. Br J Clin Psychol 2010 Nov;49(Pt 4):455-471. [CrossRef] [Medline]
- Linke S, Murray E, Butler C, Wallace P. Internet-based interactive health intervention for the promotion of sensible drinking: patterns of use and potential impact on members of the general public. J Med Internet Res 2007;9(2):e10 [FREE Full text] [CrossRef] [Medline]
- Cobb NK, Graham AL, Abrams DB. Social network structure of a large online community for smoking cessation. Am J Public Health 2010 Jul;100(7):1282-1289. [CrossRef] [Medline]
- Department of Health. National Audit Office. London: The Stationery Office; 2006. The National Programme for IT in the NHS URL: http://www.nao.org.uk/publications/0506/department_of_health_the_nati.aspx?alreadysearchfor=yes [accessed 2012-08-11] [WebCite Cache]
- Ellingsen G, Monteiro E. Big is beautiful: electronic patient records in large Norwegian hospitals 1980s-2001. Methods Inf Med 2003;42(4):366-370. [CrossRef] [Medline]
- Berg M, Aarts J, van der Lei J. ICT in health care: sociotechnical approaches. Methods Inf Med 2003;42(4):297-301. [CrossRef] [Medline]
- Mair F, May C, Murray E, Finch T, O'Donnell C, Anderson G. NIHR Health Services and Delivery Research programme. 2009 Sep. Understanding the implementation and integration of e-Health Services URL: http://www.netscc.ac.uk/hsdr/projdetails.php?ref=08-1602-135 [accessed 2012-08-11] [WebCite Cache]
- Krukowski RA, Tilford JM, Harvey-Berino J, West DS. Comparing behavioral weight loss modalities: incremental cost-effectiveness of an internet-based versus an in-person condition. Obesity (Silver Spring) 2011 Aug;19(8):1629-1635 [FREE Full text] [CrossRef] [Medline]
- Rasu RS, Hunter CM, Peterson AL, Maruska HM, Foreyt JP. Economic evaluation of an Internet-based weight management program. Am J Manag Care 2010 Apr;16(4):e98-104 [FREE Full text] [Medline]
- MRC Health Services and Public Health Research Board. Medical Research Council. London: Medical Research Council; 2000 Apr. A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health URL: http://www.mrc.ac.uk/Utilities/Documentrecord/index.htm?d=MRC003372 [accessed 2012-08-11] [WebCite Cache]
- Anderson R. New MRC guidance on evaluating complex interventions. BMJ 2008;337:a1937. [Medline]
- Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ 2007 Mar 3;334(7591):455-459. [CrossRef] [Medline]
- Eldridge S, Spencer A, Cryer C, Parsons S, Underwood M, Feder G. Why modelling a complex intervention is an important precursor to trial design: lessons from studying an intervention to reduce falls-related injuries in older people. J Health Serv Res Policy 2005 Jul;10(3):133-142. [CrossRef] [Medline]
- Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med 2010;8:63 [FREE Full text] [CrossRef] [Medline]
- Clinical Effectiveness Research Agenda Group. Implementation Science. London: Department of Health; 2009. An Implementation Research Agenda. A report prepared for the High Level Group on Clinical Effectiveness URL: http://www.implementationscience.com/content/4/1/18/additional/ [accessed 2012-08-11] [WebCite Cache]
- Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009;4:40 [FREE Full text] [CrossRef] [Medline]
- Kraft P, Yardley L. Current issues and new directions in Psychology and Health: What is the future of digital interventions for health behaviour change? Psychol Health 2009 Jul;24(6):615-618. [CrossRef] [Medline]
- Danaher BG, McKay HG, Seeley JR. The information architecture of behavior change websites. J Med Internet Res 2005;7(2):e12 [FREE Full text] [CrossRef] [Medline]
- Brendryen H, Kraft P. Happy ending: a randomized controlled trial of a digital multi-media smoking cessation intervention. Addiction 2008 Mar;103(3):478-84; discussion 485. [CrossRef] [Medline]
- Newman MG, Szkodny LE, Llera SJ, Przeworski A. A review of technology-assisted self-help and minimal contact therapies for anxiety and depression: is human contact necessary for therapeutic efficacy? Clin Psychol Rev 2011 Feb;31(1):89-103. [CrossRef] [Medline]
- Newman MG, Szkodny LE, Llera SJ, Przeworski A. A review of technology-assisted self-help and minimal contact therapies for drug and alcohol abuse and smoking addiction: is human contact necessary for therapeutic efficacy? Clin Psychol Rev 2011 Feb;31(1):178-186. [CrossRef] [Medline]
- Christensen MC, Remler D. Information and communications technology in U.S. health care: why is adoption so slow and is slower better? J Health Polit Policy Law 2009 Dec;34(6):1011-1034. [CrossRef] [Medline]
- Jha AK, Doolan D, Grandt D, Scott T, Bates DW. The use of health information technology in seven nations. Int J Med Inform 2008 Dec;77(12):848-854. [CrossRef] [Medline]
- Poon EG, Jha AK, Christino M, Honour MM, Fernandopulle R, Middleton B, et al. Assessing the level of healthcare information technology adoption in the United States: a snapshot. BMC Med Inform Decis Mak 2006;6:1 [FREE Full text] [CrossRef] [Medline]
- Ludwick DA, Doucette J. Adopting electronic medical records in primary care: lessons learned from health information systems implementation experience in seven countries. Int J Med Inform 2009 Jan;78(1):22-31. [CrossRef] [Medline]
- Jeyaraj A, Rottman JW, Lacity MC. A review of the predictors, linkages, and biases in IT innovation adoption research. Journal of Information Technology 2006;21:1-23. [CrossRef]
- Legris P, Ingham J, Collerette P. Why do people use information technology? A critical review of the technology acceptance model. Information & Management 2003 Jan;40:191-204. [CrossRef]
- Berg M. Patient care information systems and health care work: a sociotechnical approach. Int J Med Inform 1999 Aug;55(2):87-101. [Medline]
- Doolin B, Lowe A. To reveal is to critique: actor-network theory and critical information systems research. Journal of Information Technology 2002;17:69-78. [CrossRef]
- Hardcastle MA, Usher KJ, Holmes CA. An overview of structuration theory and its usefulness for nursing research. Nurs Philos 2005 Oct;6(4):223-234. [CrossRef] [Medline]
- Greenhalgh T, Stones R. Theorising big IT programmes in healthcare: strong structuration theory meets actor-network theory. Soc Sci Med 2010 May;70(9):1285-1294. [CrossRef] [Medline]
- May C, Finch T, Mair F, Ballini L, Dowrick C, Eccles M, et al. Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Serv Res 2007;7:148 [FREE Full text] [CrossRef] [Medline]
- May C. A rational model for assessing and evaluating complex interventions in health care. BMC Health Serv Res 2006;6:86 [FREE Full text] [CrossRef] [Medline]
- May C, Finch T. Implementation, embedding, and integration: an outline of Normalization Process Theory. Sociology 2009;433(3):535-554.
- Elwyn G, Légaré F, van der Weijden T, Edwards A, May C. Arduous implementation: does the Normalisation Process Model explain why it's so difficult to embed decision support technologies for patients in routine clinical practice. Implement Sci 2008;3:57 [FREE Full text] [CrossRef] [Medline]
- Finch TL, Mair FS, May CR. Teledermatology in the UK: lessons in service innovation. Br J Dermatol 2007 Mar;156(3):521-527. [CrossRef] [Medline]
- Mair FS, Hiscock J, Beaton SC. Understanding factors that inhibit or promote the utilization of telecare in chronic lung disease. Chronic Illn 2008 Jun;4(2):110-117. [CrossRef] [Medline]
- Gask L, Bower P, Lovell K, Escott D, Archer J, Gilbody S, et al. What work has to be done to implement collaborative care for depression? Process evaluation of a trial utilizing the Normalization Process Model. Implement Sci 2010;5:15 [FREE Full text] [CrossRef] [Medline]
- May CR, Finch T, Ballini L, MacFarlane A, Mair F, Murray E, et al. Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit. BMC Health Serv Res 2011;11:245 [FREE Full text] [CrossRef] [Medline]
- Murray E, Burns J, May C, Finch T, O'Donnell C, Wallace P, et al. Why is it difficult to implement e-health initiatives? A qualitative study. Implement Sci 2011;6:6 [FREE Full text] [CrossRef] [Medline]
- Murray E, May C, Mair F. Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT). BMC Med Inform Decis Mak 2010;10:61 [FREE Full text] [CrossRef] [Medline]
- MacFarlane A, Clerkin P, Murray E, Heaney DJ, Wakeling M, Pesola UM, et al. The e-Health Implementation Toolkit: qualitative evaluation across four European countries. Implement Sci 2011 Nov;6:122 [FREE Full text] [CrossRef] [Medline]
|ANT: actor–network theory|
|CAL: computer-assisted learning|
|CBT: cognitive behavioral therapy|
|CCBT: computerized cognitive behavioral therapy|
|DIPEX: Dictionary of Patient Experiences|
|e-HIT: eHealth Implementation Toolkit|
|ICT: information and communication technology|
|MRC: Medical Research Council|
|NPM: normalization process model|
|NPT: normalization process theory|
|SCT: social cognitive theory|
|SMS: short message service|
Edited by G Eysenbach; submitted 25.01.11; peer-reviewed by J Proudfoot, A Lewis; comments to author 27.07.11; revised version received 05.01.12; accepted 27.07.12; published 14.08.12
©Elizabeth Murray. Originally published in Medicine 2.0 (http://www.medicine20.com), 14.08.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in Medicine 2.0, is properly cited. The complete bibliographic information, a link to the original publication on http://www.medicine20.com/, as well as this copyright and license information must be included.