Back to Journals » Risk Management and Healthcare Policy » Volume 12
![Highly-accessed](assets/img/article_icons/highly-accessed.png)
A reliability and content analysis of Italian language anorexia nervosa-related websites
Authors Bragazzi NL, Prasso G, Re TS, Zerbetto R, Del Puente G
Received 1 November 2018
Accepted for publication 11 July 2019
Published 1 August 2019 Volume 2019:12 Pages 145—151
DOI https://doi.org/10.2147/RMHP.S193088
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 2
Editor who approved publication: Dr Kent Rondeau
Nicola Luigi Bragazzi,1–4 Giulia Prasso,5,6 Tania Simona Re,3,4 Riccardo Zerbetto,3 Giovanni Del Puente2
1School of Public Health, Department of Health Sciences (DISSAL), University of Genoa, Genoa, Italy; 2Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DINOGMI), Section of Psychiatry, University of Genoa, Genoa, Italy; 3Centro Studi Terapia Della Gestalt (CSTG), Milan, Italy; 4UNESCO Chair “Anthropology of Health-Biosphere and Healing System”, University of Genoa, Genoa, Italy; 5Department of Psychology (DISFOR), University of Genoa, Genoa, Italy; 6School of Psychotherapy “Associazione Italiana di Psicoterapia Psicoanalitica dell’Infanzia dell’Adolescenza e della Famiglia” (AIPPI), Milan, Italy
Objective: Internet represents a major source of information related to health issues, increasingly used by providers. Indeed, there are numerous websites concerning eating and weight disorders, such as anorexia nervosa. The aim of the current investigation was to systematically perform a reliability and content analysis of Italian language anorexia nervosa-related websites.
Methods: Reliability of the anorexia nervosa website pages was assessed using the Health on the Net Foundation Code of Conduct Standards (HonCode®) certification mark. A comprehensive content analysis (thematic cluster analysis, correspondence analysis of emerging themes and topics, density and degree-centrality analysis, and co-word analysis) was performed using the commercial software T-Lab.
Results: 402 unique website pages were included and analyzed in the current study. Statistically significant differences related to the accomplishment or less to the items of the HonCode® certificate mark were found for all items, except for confidentiality and webmaster/additional contact. From the thematic cluster analysis, four clusters were identified: namely, treatment (26.6%), vomiting (24.7%), weight (24.4%) and onset-age (24.3%). Treatment (in particular, cognitive-behavioral psychotherapy) was the most represented theme (with a frequency of 97.76%, recurring in 393 websites). Pro-ana content characterized 147 website pages (with a frequency of 36.57%).
Conclusion: The quality of Italian language anorexia nervosa-related websites was rather moderate-poor, being generally inconsistent with the principles of the HonCode® certification mark. Therefore, physicians and health authorities should be aware of such findings to provide their patients with proper answers and education.
Keywords: anorexia nervosa, internet, content analysis, qualitative analysis
Introduction
Eating disorders affect approximately 1% of the total population.1 Such prevalence rate raises concerns due to the lack of definitive therapeutic options, even though cognitive-behavioral therapy (CBT) represents the gold standard treatment for bulimia nervosa and binge-eating disorder, whereas family-based treatment (FBT) may be more indicated for adolescents and young adults with anorexia or bulimia nervosa.
The complexity of the disease etiology and the lack of favorable results of pharmacological and psychological treatments utilized may lead patients suffering from eating disorders to seek alternative options through available resources, for instance, the Internet.2
Nowadays, the Internet represents, indeed, a major source of information related to health issues, increasingly used both by providers and clients.3 In particular, numerous websites concerning eating and weight disorders, such as anorexia nervosa, exist.4 Lladó et al4 performed an extensive analysis of websites, analyzing the top 20 results for each search according to their quality and positioning ranks. More than a million entries were found with blog contents being the most shared among all the analyzed pages. Authors observed a high rate of contacts and interactions between the different anorexia nervosa-related communities scattered within the entire blogosphere.
However, health information available on the Internet remains unregulated and extremely varies in terms of quality and accuracy,5 in that, in most cases, it is not written or revised/approved by health professionals. As such, because of the lack of any editorial review policy, websites risk to disseminate and divulge potentially misleading information.5 Currently, very few studies have assessed such topics. In the existing scholarly literature, Hernández-Morante et al5 found that the quality of anorexia nervosa-related websites was moderate, and the information quality was rather fairly poor. Some websites, called pro-ana sites, are of particular concern in that they support and promote behaviors and practices that can lead to the development of eating disorders, encouraging a positive view on illness, with some web-pages even denying that anorexia or bulimia nervosa are disorders, being rather defined as lifestyle choices.
On the other hand, high-quality websites manually curated by physicians and workers in the field of public health can offer valuable support for patients with anorexia nervosa, as well as for patients suffering from other eating and weight disorders, making different health care services more accessible, providing web-based treatments and psycho-educational interventions or enabling to create self-help virtual groups.6–10
As such, patients could visit a range of websites that offer different kinds of information of different levels of scientific evidence, from personal accounts and blogs to academic websites including sites curated by the WHO, the Centers for Disease Control and Prevention or scholarly repositories and bibliographic thesauri like PubMed.11 Therefore, while it is empowering for individuals to access this important source of health-related information, which provides more assistance in the shared decision-making process between the physician and the patients, the quality of health information is highly variable.12,13 Thus, in most instances, individuals could be faced with the challenge of understanding which website offers high quality, evidence-based information.
Therefore, given the relationship between media exposure and eating and weight disorder symptom severity, and considering that the Internet provides easily accessible resources and treatment modalities for individuals who otherwise lack access to evidence-based care, it is of crucial importance to assess the content and the material present on the web. As such, the aim of the current investigation was to systematically perform a reliability and content analysis of Italian language anorexia nervosa-related websites. This would be beneficial both for patients and physicians, in that would offer them a snapshot of the information available online, helping to develop and implement ad hoc interventions for patients education and empowerment.
Materials and methods
Search strategy
Seven search engines (namely, Google, Yahoo, Virgilio, Microsoft Network or MSN, Ask, Ixquick, and Iasse), among the most popular in Italy, were selected for the current investigation. The terms “anorexia” and “anorexia nervosa” (in the Italian language, “anoressia” and “anoressia nervosa”) were used every time in individual searches for each search engine, selecting the first 100 results. Duplicate or not relevant website pages were not retained for the subsequent analyses. Further details related to the search strategy adopted are listed in Table 1.
![]() |
Table 1 Search strategy adopted in the current study for selecting relevant anorexia nervosa-related website pages |
Reliability assessment
Health on the Net Foundation Code of Conduct Standards (HonCode®) certification mark is based on eight principles, namely, authority (whether the website provides the qualifications and credential of authors: if, for example, they are medical professionals or not), complementarity (that is to say, a statement that maintains that information provided to readers, such as help, tips, advices or suggestions, is meant to support, not replace, patient–health care provider relationships), confidentiality (that is to say, how both personal and non-personal data of readers are handled), attribution (easily discoverable references to the source of information, such as the uniform resource locator or URL address, and information about the last update performed), justifiability (whether statements related to medical procedures or products are conveyed in terms of balanced, well-supported and well-referenced information), transparency of authorship (in terms of contact information, such as mail address or telephone number), financial disclosure (providing clear, exhaustive funding details) and advertising (information concerning advertising and editorial policy, and a clearly stated distinction between advertised and editorial material).
HonCode® certification mark-based reliability assessment has been performed in the existing literature to evaluate the quality of otitis media-, silicosis-, orthopedics-, and cancer-related website pages,13–18 among others.
Content analysis
Content analysis was performed using T-Lab software,19 which exploits a text-driven automatic approach allowing meaningful patterns of words and themes to emerge. The content of the unique websites included in the current study was copied, manually pre-processed and computationally analyzed: thematic cluster analysis (which is based on the results obtained with the correspondence analysis and utilizes the K-means clustering technique, performed according to the MacQueen’s unsupervised learning algorithm),20 correspondence analysis of emerging topics and themes, density and degree-centrality analysis, and co-word analysis (when two or more keywords representing an emerging theme/topic occur on the same website page, they have essential relationships, and the more co-occurrence between two keywords, the closer their relationship is) were carried out. Each thematic cluster contained a set of elementary contexts/structures (namely, sentences, short texts, and paragraphs) characterized by the same linguistic/lexical patterns and keywords. Clusters were described through lexical units (that is to say, words, lemmas, or categories) and the variables/features most characteristic of the context units they were composed of.
For the cluster analysis, the following objective function was used:
where is a given data point/object and
is the cluster center. The MacQueen’s algorithm comprises four steps: namely, placing k points within the space represented by the data points/objects that are being clustered, as initial group centroids (step I); assigning each data point/object to the group with the closest centroid (step II) and recalculating iteratively the positions of the k centroids, once the procedure of assigning the objects has been completed (step III). Steps II and III are repeated until the stability of centroids is achieved, in such a way to obtain a separation of the data points/objects into groups, to minimize and to compute the final metrics (step IV).
After individuating the main thematic clusters, the elementary contexts/structures of each cluster were used to extract the major narratives contained within each cluster.
Emerging thematic nuclei/topics were co-mapped together using a multidimensional scaling approach, based on the Sammon mapping technique, utilizing the Sammon’s error or Sammon’s stress function:
where is the distance between the ith and the jth object (theme/topic) within the original space and
is the distance between their projections. Summarizing, E is a function that enables to interpret both the relationships between the different data points/objects and the dimensions that organize the space in which the given structures are represented.
T-Lab software is a validated, reliable tool, which has been used in the existing literature to perform content/lexicographic analyses of cancer- or environmental issues-related patient narrative and website pages, respectively.21,22
The entire process was computer-assisted, with the involvement of psychologists, psychotherapists, and psychiatrists ensuring meaningful results.
Statistical analysis
To determine the websites quality, the frequency and percentage of the number of websites that met every item of the HonCode® certification mark were calculated.
Exact chi-squared test was performed to analyze the statistical significance related to the presence or absence of the HonCode® certification mark.
The significant level was established at a P<0.05. All statistical analysis was performed through the commercial software “Statistical Package for Social Sciences” (SPSS Inc., Chicago, IL, USA) version 23.0 for Windows.
Results
From an initial list of 1400 websites, 402 unique website pages were included and analyzed in the current study (Figure 1). Statistically significant differences related to the accomplishment or less to the items of the HonCode® certificate mark were found for all items, except for confidentiality and webmaster/additional contact (Table 2). Of the 8 procedural principles, 34.08% of the websites followed the authority principle, 86.07% followed the complementarity, 56.72% followed confidentiality, 15.67% complied to the justifiability concept, 29.35% to sources/date of information, 43.53% to attribution, 23.13% to financial disclosure, and 21.89% to advertising policy.
![]() |
Table 2 Compliance of the anorexia nervosa-related website pages included in the current study to the items of the HonCode certification mark and statistical significance |
![]() |
Figure 1 Flow-chart adopted in the current study. |
From the thematic cluster analysis, the MDS Sammon mapping of main themes/topics, the density and degree-centrality analysis, of the correspondence analysis of emerging themes/topics of all the anorexia nervosa-related website pages included in this study, four main clusters were identified: namely, treatment (26.6%), vomiting (24.7%), weight (24.4%) and onset-age (24.3%). The main topics are reported in Table 3 and pictorially shown in Figure 2: treatment, in particular CBT, was the most represented theme (with a frequency of 97.76%, recurring in 393 websites). Pro-ana content characterized 147 website pages (with a frequency of 36.57%).
![]() |
Table 3 The main emerging themes/topics from the content analysis of the included anorexia nervosa-related website pages |
![]() |
Figure 2 Cluster analysis of all the anorexia nervosa-related website pages included in this study. Factor 1 (treatment), factor 2 (vomiting), factor 3 (onset-age), and factor 4 (weight). |
Discussion
The present study aimed to assess Italian language websites on anorexia nervosa to determine their general as well as information-specific quality. Concerning the content, we found that the most represented topic was anorexia nervosa treatment (in particular, CBT), and furthermore, it was the first cluster in terms of weight.
This finding is perfectly in line with was observed by other scholars. For instance, in Israel, Yom-Tov and coworkers23 investigated members of the main pro-ana website and found them significantly more interested in treatment, having wishes of procreation and reporting the highest goal weights. A minority exhibited interest in depression, self-harm and suicide, with a small percentage being severely malnourished. In Italy, Abbate Daga et al24 found 546,000, 212,000 and 39,100 websites devoted to anorexia nervosa treatment, anorexia nervosa psychotherapy, and anorexia nervosa pharmacotherapy, respectively. “Pro-anorexia,” “pro-ana sites,” “thinspiration” and “anorexicnation” resulted in 257,000, 18,600, 14,200 and 577 websites, respectively. Forty-seven of 100 randomly selected pro-ana websites were found to be often visited. Authors concluded that the Internet had a Ying-Yang nature, making, on the one hand, some topics such as treatments more available and accessible to the general public, but on the other hand, potentially encouraging psychopathological traits like asceticism, competition, purging behaviors and obsession for control.
Pro-ana virtual communities tend, indeed, to create strong ties and links on the Internet, exhibiting values such as support, solidarity and sense of belonging.25–28 Yom-Tov et al29 analyzed 242,710 anorexia nervosa-related photos shared via the photo-sharing site Flickr from 491 users and found that members of the pro-anorexia digital communities tended to interact with each other to a much higher degree than what could be expected from the distribution of contacts (only 59–72% of contacts versus 74–83% of comments made to members inside the community). Being actively engaged online (namely, commenting and posting observations and likes) elicits, in its turn, further digital activities. In our analysis, we found that pro-ana websites represented approximately one-third of the online material. This finding can be compared with that obtained by a research carried out in Italy by Bert and collaborators.30 They systematically retrieved 341 “pro-ana” Twitter accounts and analyzed them in terms of number of followers (mean followers 2360.9, range 5–32,700), tweets (mean tweets: 4351.2, range: 5–85,700), and biographical information of the users (97.9% girls, mean age 17.9 years, range 12–28 years). Authors concluded that pro-ana content on Twitter was rather popular and, as such, potentially dangerous.
Another topic highly represented in the websites analyzed in the present study was body dissatisfaction and diet/weight control. The media, indeed, tend to divulge images of abnormally thin models represented as the ideal.31
In conclusion, at the same time, the Internet represents an important and precious resource, as well as a source of risks.32 According to a survey conducted in 25 European countries,33 the Internet is increasingly used to surf for health-related content and the exposure of adolescents to pro-ana websites is rather high and relevant. Since different investigations have found a link between online behaviors and offline eating and weight disorder behaviors,34,35 stakeholders should urgently prioritize results of search engines not based on popularity ranking but on trustworthiness and quality.36–38
Our investigation suffers from some limitations: for example, it does not investigate some interesting features, like the ranking and rankability or readability of the website pages. On the other hand, it has a number of strengths, including the systematic search of anorexia nervosa-related website pages.
Conclusion
The present systematic web searches-based study found that quality of Italian language anorexia nervosa-related websites was rather moderate-poor, being generally inconsistent with the principles of the HonCode® certification mark. The major themes/topics represented in the websites included in the analysis were treatment and management of anorexia nervosa. This has important, practical implications for health care workers working with patients suffering from eating and weight disorders. They should be, indeed, aware of the importance of the Internet in disseminating anorexia nervosa-related information and should discuss this point with their patients, trying to educate and empower them, showing them how to recognize high-quality, reliable and evidence-based websites. Moreover, the information provided in the present investigation could be exploited to develop ad hoc online resources for patients suffering from eating and weight disorders, as well as novel web-based treatments and psycho-educational interventions.
However, based on the above-mentioned shortcomings and drawbacks, further research in the field is urgently needed.
Ethical standards
No informed consent was necessary for the realization of the study, since all data analyzed are publicly available and have been handled at aggregated level.
Disclosure
The authors report no conflicts of interest in this work.
References
1. Smink FRE, van Hoeken D, Hoek HW. Epidemiology of eating disorders: incidence, prevalence and mortality rates. Curr Psychiatry Rep. 2012;14(4):406–414. doi:10.1007/s11920-012-0282-y
2. Hardoff D. Health issues in adolescents’ Internet use – benefits and risks. Georgian Med News. 2013;222:99–103.
3. Bragazzi N. From P0 to P6 medicine, a model of highly participatory, narrative, interactive, and “augmented” medicine: some considerations on Salvatore Iaconesi’s clinical story. Patient Prefer Adherence. 2013;7:353. doi:10.2147/PPA.S38578
4. Lladó G, González-Soltero R, Blanco fernández de valderrama MJ. Anorexia y bulimia nerviosas: difusión virtual de la enfermedad como estilo de vida. Nutricion Hospitalaria. 2017;34(3):693. doi:10.20960/nh.469
5. Hernandez-Morante JJ, Jimenez-Rodriguez D, Canavate R, Conesa-Fuentes Mdel C. Analysis of information content and general quality of obesity and eating disorders websites. Nutricion Hospitalaria. 2015;32(2):606–615. doi:10.3305/nh.2015.32.2.9163
6. Aardoom JJ, Dingemans AE, Fokkema M, Spinhoven P, Van Furth EF. Moderators of change in an internet-based intervention for eating disorders with different levels of therapist support: what works for whom? Behav Res Ther. 2017;89:66–74. doi:10.1016/j.brat.2016.11.012
7. Grunwald M, Wesemann D. Special online consulting for patients with eating disorders and their relatives: analysis of user characteristics and e-mail content. CyberPsychol Behav. 2007;10(1):57–63. doi:10.1089/cpb.2006.9992
8. Jacobi C, Morris L, Beckers C, et al. Maintenance of internet-based prevention: a randomized controlled trial. Int J Eat Disord. 2007;40(2):114–119. doi:10.1002/eat.20344
9. Muir S, Newell C, Griffiths J, et al. MotivATE: a pretreatment web-based program to improve attendance at uk outpatient services among adults with eating disorders. JMIR Res Protoc. 2017;6(7):e146. doi:10.2196/resprot.7440
10. Nevonen L, Mark M, Levin B, Lindström M, Paulson-Karlsson G. Evaluation of a new internet-based self-help guide for patients with bulimic symptoms in Sweden. Nord J Psychiatry. 2006;60(6):463–468. doi:10.1080/08039480601021993
11. Underhill C, McKeown L. Getting a second opinion: health information and the internet. Health Rep. 2008;19(1):65–69.
12. Charles C, Gafni A, Whelan T. Decision-making in the physician-patient encounter: revisiting the shared treatment decision-making model. Soc Sci Med. 1999;49(5):651–661. doi:10.1016/S0277-9536(99)00145-8
13. Ellsworth B, Patel H, Kamath AF. Assessment of quality and content of online information about hip arthroscopy. Arthroscopy. 2016;32(10):2082–2089. doi:10.1016/j.arthro.2016.03.019
14. Dini G, Bragazzi NL, D’Amico B, et al. A reliability and readability analysis of silicosis-related Italian websites: implications for occupational health. Med Lav. 2017;108(3):167–173. doi:10.23749/mdl.v108i3.6083
15. Janssen S, Käsmann L, Fahlbusch FB, Rades D, Vordermark D. Side effects of radiotherapy in breast cancer patients. Strahlentherapie und Onkologie. 2017;194(2):136–142. doi:10.1007/s00066-017-1197-7
16. Joury A, Joraid A, Alqahtani F, Alghamdi A, Batwa A, Pines JM. The variation in quality and content of patient-focused health information on the Internet for otitis media. Child Care Health Dev. 2018;44(2):221-226. doi:10.1111/cch.12524
17. Memon M, Ginsberg L, Simunovic N, Ristevski B, Bhandari M, Kleinlugtenbelt YV. Quality of web-based information for the 10 most common fractures. Interact J Med Res. 2016;5(2):e19. doi:10.2196/ijmr.5767
18. Paffenholz P, Salem J, Borgmann H, et al. Testicular cancer on the web – an appropriate source of patient information in concordance with the european association of urology guidelines? J Cancer Educ. 2018;33(6):1314-1322. doi:10.1007/s13187-017-1249-9
19. Lancia F. Introduzione all’uso di T-lab (tools for text analysis. Introduction to the use of T-lab). Strumenti per l’analisi dei testi. 2004.
20. JB M Some methods for classification and analysis of multivariate observations,
21. Barchitta M, Fragapane S, Quattrocchi A, et al. Environmental health risk communication in the case “Terra dei Fuochi”: content analysis of online newspaper articles. Annali Di Igiene. 2015;27(1):30–38. doi:10.7416/ai.2015.2020
22. Graffigna G, Cecchini I, Breccia M, et al. Recovering from chronic myeloid leukemia: the patients’ perspective seen through the lens of narrative medicine. Qual Life Res. 2017;26(10):2739–2754. doi:10.1007/s11136-017-1611-8
23. Yom-Tov E, Brunstein-Klomek A, Hadas A, Tamir O, Fennig S. Differences in physical status, mental state and online behavior of people in pro-anorexia web communities. Eat Behav. 2016;22:109–112. doi:10.1016/j.eatbeh.2016.05.001
24. Abbate Daga G, Gramaglia C, Piero A, Fassino S. Eating disorders and the internet: cure and curse. Eat Weight Disord. 2006;11(2):e68–e71.
25. Brotsky SR, Giles D. Inside the “Pro-ana” community: a covert online participant observation. Eat Disord. 2007;15(2):93–109. doi:10.1080/10640260701190600
26. Mulveen R, Hepworth J. An interpretative phenomenological analysis of participation in a pro-anorexia internet site and its relationship with disordered eating. J Health Psychol. 2006;11(2):283–296. doi:10.1177/1359105306061187
27. Oksanen A, Garcia D, Räsänen P. Proanorexia communities on social media. Pediatrics. 2015;137(1):e20153372. doi:10.1542/peds.2015-3372
28. Rodgers RF, Skowron S, Chabrol H. Disordered eating and group membership among members of a pro-anorexic online community. Eur Eat Disord Rev. 2011;20(1):9–12. doi:10.1002/erv.1096
29. Yom-Tov E, Fernandez-Luque L, Weber I, Crain SP. Pro-anorexia and pro-recovery photo sharing: a tale of two warring tribes. J Med Internet Res. 2012;14(6):e151. doi:10.2196/jmir.2239
30. Bert F, Gualano MR, Camussi E, Siliquini R. Risks and threats of social media websites: twitter and the proana movement. Cyberpsychology Behav Social Networking. 2016;19(4):233–238. doi:10.1089/cyber.2015.0553
31. Andrist LC. Media images, body dissatisfaction, and disordered eating in adolescent women. MCN Am J Mat/Child Nurs. 2003;28(2):119–123. doi:10.1097/00005721-200303000-00014
32. Mule A, Sideli L. Eating disorders on the web: risks and resources. Stud Health Technol Inform. 2009;144:8–12.
33. Almenara CA, Machackova H, Smahel D. Individual differences associated with exposure to “Ana-Mia” websites: an examination of adolescents from 25 European countries. Cyberpsychology Behav Social Networking. 2016;19(8):475–480. doi:10.1089/cyber.2016.0098
34. Branley DB, Covey J. Pro-ana versus pro-recovery: a content analytic comparison of social media users’ communication about eating disorders on twitter and tumblr. Front Psychol. 2017;8:1356. doi:10.3389/fpsyg.2017.01356
35. Branley DB, Covey J. Is exposure to online content depicting risky behavior related to viewers’ own risky behavior offline? Comput Human Behav. 2017;75:283–287. doi:10.1016/j.chb.2017.05.023
36. Boyer C. Accessing quality online health information: what is the solution? Stud Health Technol Inform. 2016;225:718–720.
37. Boyer C, Geissbuhler A. A decade devoted to improving online health information quality. Stud Health Technol Inform. 2005;116:891–896.
38. Gaudinat A, Ruch P, Joubert M, et al. Health search engine with e-document analysis for reliable search results. Int J Med Inform. 2006;75(1):73–85. doi:10.1016/j.ijmedinf.2005.11.002
© 2019 The Author(s). This work is published and licensed by Dove Medical Press Limited. The
full terms of this license are available at https://www.dovepress.com/terms.php
and incorporate the Creative Commons Attribution
- Non Commercial (unported, v3.0) License.
By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted
without any further permission from Dove Medical Press Limited, provided the work is properly
attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.