Pap Smear Readability on Google: An Analysis of Online Articles Regarding One of the Most Routine Medical Screening Tests
Background: The Papanicolaou smear (Pap smear, Pap test) is one of the most routine screening tests performed in medicine. The development and widespread use of this test has brought a considerable decrease in the incidence of cervical cancer. Unfortunately, this disease process continues to convey significant morbidity and mortality. These persistent phenomena may be the result of inadequate compliance with routine Pap smear screening, in which limited education is thought to play a role, particularly among ethnic minority groups.
Methods: A Google search using the phrase “pap smear” was performed and the first fourteen web addresses were analyzed using four standardized readability indices: the Flesh-Kinkaid Grade Level, the Simple Measure of Gobbledygook, the Gunning Fog Index and the Automated Readability Index. The average grade level readability was then compared to the American Medical Association recommendation that health care information should be written at a 5th or 6th-grade reading level (i.e., ages 10-12 years).
Results: The average grade-level readability values of the fourteen analyzed sites using the four aforementioned indices were 8.9, 8.8, 11.9, and 8.4, respectively. The mean readability of all four indices was 9.5.
Conclusion: The grade-level readability of commonly accessed internet information regarding Pap smears is above the recommendation of the American Medical Association. Health care providers and website authors should be cognizant of this, as it may impact compliance. This is particularly important given that this routine healthcare test is recommended for nearly fifty percent of the world’s population at various points throughout their lifetime.
Shaw PA. The History of Cervical Screening 1: The Pap. Test. J Soc Obstet Gynaecol Can. 2000 Feb 1;22(2):110-114.
American Cancer Society. Cancer Facts & Figures 2020. Available from: https://www.cancer.org/content/dam/cancer-org/research/cancer-facts-and-statistics/annual-cancer-facts-and-figures/2020/cancer-facts-and-figures-2020.pdf. Last updated 2020; cited Sep 14, 2020.
U.S. Preventive Services Task Force. Cervical Cancer: Screening. Available from: https://www.uspreventiveservicestaskforce.org/uspstf/recommendation/cervical-cancer-screening#fullrecommendationstart. Last updated Aug 21, 2018; cited Sep 14, 2020.
American Cancer Society. Pap/HPV test, women 21 to 65 years. Available from: https://cancerstatisticscenter.cancer.org/#!/data-analysis/Pap_Test. Last updated 2018; cited Sep 14, 2020.
Akinlotan M, Bolin JN, Helduser J, Ojinnaka C, Lichorad A, McClellan D. Cervical Cancer Screening Barriers and Risk Factor Knowledge Among Uninsured Women. J Community Health. 2017 Feb 2;42(4):770-778.
Musa J, Achenbach CJ, O'Dwyer LC, Evans CT, McHugh M, Hou L, et al. Effect of cervical cancer education and provider recommendation for screening on screening rates: A systematic review and meta-analysis. PLoS One. 2017 Sep 5;12(9):e0183924.
AL-Hammadi FA, Al-Tahri F, Al-Ali A, Nair SC, Abdulrahman M. Limited Understanding of Pap Smear Testing among Women, a Barrier to Cervical Cancer Screening in the United Arab Emirates. Asian Pac J Cancer Prev. 2017 Dec;18(12):3379-3387.
Ranabhat S, Tiwari M, Dhungana G, Shrestha R. Association of knowledge, attitude and demographic variables with cervical Pap smear practice in Nepal. Asian Pac J Cancer Prev. 2014 Dec;15(20):8905-8910.
Head SK, Crosby RA, Moore GR. Pap smear knowledge among young women following the introduction of the HPV vaccine. J Pediatr Adolesc Gynecol. 2009 Aug 1;22(4):251-256.
Chen HY, Kessler CL, Mori N, Chauhan SP. Cervical cancer screening in the United States, 1993-2010: characteristics of women who are never screened. J Womens Health (Larchmt). 2012 Nov 7;21(11):1132-1138.
Breitkopf CR, Pearson HC, Breitkopf DM. Poor knowledge regarding the Pap test among low-income women undergoing routine screening. Perspect Sex Reprod Health. 2005 Jun;37(2):78-84.
Center for Disease Control and Prevention. HPV-Associated Cervical Cancer Rates by Race and Ethnicity. Available from: https://www.cdc.gov/cancer/hpv/statistics/cervical.htm Last updated 2019; cited Jul 4, 2020.
Pew Research Center. Health Online 2013. Available from: https://www.pewinternet.org/wp-content/uploads/sites/9/media/Files/Reports/PIP_HealthOnline.pdf. Last updated January 15, 2013; cited Jul 4, 2020.
Statista. Global market share of search engines 2010-2020. Available from: https://www.statista.com/statistics/216573/worldwide-market-share-of-search-engines/. Last updated Sep 2, 2020; cited Sep 12, 2020.
Ryan, PM, Ryan CA. Mining Google Trends Data for Health Information: The Case of the Irish "CervicalCheck" Screening Programme Revelations. Cureus. 2019 Aug 29;11(8):e5513.
American Medical Association Foundation, American Medical Association. Health Literacy: A Manual for Clinicians. Available from: http://lib.ncfh.org/pdfs/6617.pdf. Last updated 2003; cited Ju 4, 2020.
Mac OA, Thayre A, Tan S, Dodd RH. Web-Based Health Information Following the Renewal of the Cervical Screening Program in Australia: An Evaluation of the Readability, Understandability and Credibility. J Med Internet Res. 2020 Jun 26;22(6):e16701.
Boztas N, Omur D, Ozbılgın S, Altuntas G, Piskin E, Ozkardesler S, et al. Readability of internet-sourced patient education material related to "labour analgesia". Medicine (Baltimore). 2017 Nov 10;96(45):e8526.
Patel SK, Gordon EJ, Wong CA, Grobman WA, Goucher H, Toledo P. Readability, Content, and Quality Assessment of Web-Based Patient Education Materials Addressing Neuraxial Labor Analgesia. Anesth Analg. 2015 Nov;121(5):1295-1300.
Basch CH, Fera J, Ethan D, Garcia P, Perin D, Basch CE. Readability of online material related to skin cancer. Public Health. 2018 Oct;163:137-140.
Mehta MP, Swindell HW, Westermann RW, Rosneck JT, Lynch TS. Assessing the Readability of Online Information About Hip Arthroscopy. Arthroscopy: The Journal of Arthroscopic & Related Surgery. 2018 Jul 1;34(7):2142-2149.
Vargas CR, DePry J, Lee BT, Bordeaux JS. The Readability of Online Patient Information About Mohs Micrographic Surgery. Dermatologic Surgery. 2016 Oct;42(10):1135-1141.
Rothrock SG, Rothrock AN, Swetland SB, Pagane M, Isaak SA, Romney J, et al. Quality, Trustworthiness, Readability, and Accuracy of Medical Information Regarding Common Pediatric Emergency Medicine-Related Complaints on the Web. J Emerg Med. 2019 Oct 1;57(4):469-477.
U.S. Department of Health and Human Services, National Cancer Institute. Making Health Communication Programs Work. Available from: https://www.cancer.gov/publications/health-communication/pink-book.pdf. Last updated July 2020; cited Jul 4, 2020.
U.S. Department of Health and Human Services, Centers for Medicare and Medicaid Services. TOOLKIT for Making Written Material Clear and Effective: SECTION 4 Special topics for writing and design. Part 7: Using readability formulas: A cautionary note. Available from: https://www.cms.gov/Outreach-and-Education/Outreach/WrittenMaterialsToolkit/Downloads/ToolkitPart07.pdf. Last updated Sep 2010; cited Jul 4, 2020.
Ley P, Florio T. The use of readability formulas in health care. Psychology, Health & Medicine. 1996;1:7-28.
Wang LW, Miller MJ, Schmitt MR, Wen FK. Assessing readability formula differences with written health information materials: application, results, and recommendations. Res Social Adm Pharm. 2013 Sep-Oct;9(5):503-516.
Kincaid JP, Fishburne RPJ, Rogers RL, Chissom BS. Derivation Of New Readability Formulas (Automated Readability Index, Fog Count And Flesch Reading Ease Formula) For Navy Enlisted Personnel. Institute for Simulation and Training. 1975 Jan 1;56.
Google Trends. Available from: https://trends.google.com/trends/?geo=US. Cited Oct 26, 2020.
Advanced Web ranking. Organic CTR History. Available from: https://www.advancedwebranking.com/ctrstudy/. Last updated 2020; cited Sep 12, 2020.
Kolesnikov A, Logachev Y, Topinskiy V. Predicting CTR of new ads via click prediction. CIKM ’12: Proceedings of the 21st ACM international conference on Information and knowledge management. 2012 Oct:2547-2550.
WebFX. Readability Test Tool. Available from: https://www.webfx.com/tools/read-able/. Last updated 2020; cited July 4, 2020.
DeVere Wolsey T, Lenski S, Grisham DL. Assessment Literacy: An Educator's Guide to Understanding Assessment, K-12. New York: The Guilford Press. 2020:125.
American Cancer Society. Cancer Screening Guidelines By Age. Available from: https://www.cancer.org/healthy/find-cancer-early/cancer-screening-guidelines/screening-recommendations-by-age.html. Last updated 2020; cited Jul 4, 2020.
Safaeian M, Solomon D, Castle PE. Cervical cancer prevention--cervical screening: science in evolution. Obstet Gynecol Clin North Am. 2007 Dec;34(4):739-760.
Berland GK, Elliott MN, Morales LS, Algazy JI, Kravitz RL, Broder MS, et al. Health information on the Internet: accessibility, quality, and readability in English and Spanish. JAMA. 2001 May 23-30;285(20):2612-2621.
Chen X, Acosta S, Barry AE. Evaluating the Accuracy of Google Translate for Diabetes Education Material. JMIR Diabetes. 2016 Jan-Jun;1(1):e3.
Search Engine Watch. SEO basics: 22 essentials you need for optimizing your site. Available from: https://www.searchenginewatch.com/2016/01/21/seo-basics-22-essentials-you-need-for-optimizing-your-site/. Last updated Jan 21, 2016; cited Sep 10, 2020.
Google Search. How Search algorithms work. Available from: https://www.google.com/search/howsearchworks/algorithms/. Cited Oct 31, 2020.
Brandwatch. 57 Fascinating and Incredible YouTube Statistics. Available from: https://www.brandwatch.com/blog/youtube-stats/#:~:text=YouTube%20is%20the%202nd%20most,Netflix%20and%20Facebook%20video%20combined. Last updated Feb 21, 2020; cited Sep 9, 2020.
Bosworth A, Ruhter J, Samson LW, Sheingold S, Taplin C, Tarazi W et al. Medicare Beneficiary Use of Telehealth Visits: Early Data from the Start of COVID-19 Pandemic. ASPE Issue Brief. 2020 July 28.
Education Week. COVID-19 Fuels Big Enrollment Increases in Virtual Schools. Available from: https://www.edweek.org/ew/articles/2020/09/03/covid-19-fuels-big-enrollment-increases-in-virtual.html. Last updated Sep 3, 2020; cited Sep 9, 2020.
Abu Abed M, Himmel W, Vormfelde S, Koschack J. Video-assisted patient education to modify behavior: a systematic review. Patient Educ Couns. 2014 Oct;97(1):16-22.
Lühnen J, Steckelberg A, Buhse S. Pictures in health information and their pitfalls: Focus group study and systematic review. Z Evid Fortbild Qual Gesundhwes. 2018 Nov 1;137-138:77-89.
Copyright (c) 2020 Mark J. Parry, Travis S. Dowdle, Jesse N. Steadman, Tiffany R. Guerra, Kim L. Cox
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- The Author retains copyright in the Work, where the term “Work” shall include all digital objects that may result in subsequent electronic publication or distribution.
- Upon acceptance of the Work, the author shall grant to the Publisher the right of first publication of the Work.
- The Author shall grant to the Publisher and its agents the nonexclusive perpetual right and license to publish, archive, and make accessible the Work in whole or in part in all forms of media now or hereafter known under a Creative Commons Attribution 4.0 International License or its equivalent, which, for the avoidance of doubt, allows others to copy, distribute, and transmit the Work under the following conditions:
- Attribution—other users must attribute the Work in the manner specified by the author as indicated on the journal Web site; with the understanding that the above condition can be waived with permission from the Author and that where the Work or any of its elements is in the public domain under applicable law, that status is in no way affected by the license.
- The Author is able to enter into separate, additional contractual arrangements for the nonexclusive distribution of the journal's published version of the Work (e.g., post it to an institutional repository or publish it in a book), as long as there is provided in the document an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post online a prepublication manuscript (but not the Publisher’s final formatted PDF version of the Work) in institutional repositories or on their Websites prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. Any such posting made before acceptance and publication of the Work shall be updated upon publication to include a reference to the Publisher-assigned DOI (Digital Object Identifier) and a link to the online abstract for the final published Work in the Journal.
- Upon Publisher’s request, the Author agrees to furnish promptly to Publisher, at the Author’s own expense, written evidence of the permissions, licenses, and consents for use of third-party material included within the Work, except as determined by Publisher to be covered by the principles of Fair Use.
- The Author represents and warrants that:
- the Work is the Author’s original work;
- the Author has not transferred, and will not transfer, exclusive rights in the Work to any third party;
- the Work is not pending review or under consideration by another publisher;
- the Work has not previously been published;
- the Work contains no misrepresentation or infringement of the Work or property of other authors or third parties; and
- the Work contains no libel, invasion of privacy, or other unlawful matter.
- The Author agrees to indemnify and hold Publisher harmless from the Author’s breach of the representations and warranties contained in Paragraph 6 above, as well as any claim or proceeding relating to Publisher’s use and publication of any content contained in the Work, including third-party content.
Enforcement of copyright
The IJMS takes the protection of copyright very seriously.
If the IJMS discovers that you have used its copyright materials in contravention of the license above, the IJMS may bring legal proceedings against you seeking reparation and an injunction to stop you using those materials. You could also be ordered to pay legal costs.
If you become aware of any use of the IJMS' copyright materials that contravenes or may contravene the license above, please report this by email to email@example.com
If you become aware of any material on the website that you believe infringes your or any other person's copyright, please report this by email to firstname.lastname@example.org