Pap Smear Readability on Google: An Analysis of Online Articles Regarding One of the Most Routine Medical Screening Tests

  • Mark J. Parry Texas Tech University Health Sciences Center – Paul L. Foster School of Medicine, El Paso, TX, United States https://orcid.org/0000-0001-5767-9278
  • Travis S. Dowdle Texas Tech University Health Sciences Center –School of Medicine, Lubbock, TX, United States https://orcid.org/0000-0001-5782-2935
  • Jesse N. Steadman University of Utah – School of Medicine, Salt Lake City, UT, United States https://orcid.org/0000-0002-1798-9367
  • Tiffany R. Guerra Texas Tech University Health Sciences Center – Paul L. Foster School of Medicine, El Paso, TX, United States
  • Kim L. Cox Pocatello Women’s Health Clinic – Pocatello, ID, United States
Keywords: Papanicolau test, Health literacy, Early detection of cancer, Search engine, Comprehension, Reading

Abstract

Background: The Papanicolaou smear (Pap smear, Pap test) is one of the most routine screening tests performed in medicine. The development and widespread use of this test has brought a considerable decrease in the incidence of cervical cancer. Unfortunately, this disease process continues to convey significant morbidity and mortality. These persistent phenomena may be the result of inadequate compliance with routine Pap smear screening, in which limited education is thought to play a role, particularly among ethnic minority groups.

Methods: A Google search using the phrase “pap smear” was performed and the first fourteen web addresses were analyzed using four standardized readability indices: the Flesh-Kinkaid Grade Level, the Simple Measure of Gobbledygook, the Gunning Fog Index and the Automated Readability Index. The average grade level readability was then compared to the American Medical Association recommendation that health care information should be written at a 5th or 6th-grade reading level (i.e., ages 10-12 years).

Results: The average grade-level readability values of the fourteen analyzed sites using the four aforementioned indices were 8.9, 8.8, 11.9, and 8.4, respectively. The mean readability of all four indices was 9.5.

Conclusion: The grade-level readability of commonly accessed internet information regarding Pap smears is above the recommendation of the American Medical Association. Health care providers and website authors should be cognizant of this, as it may impact compliance. This is particularly important given that this routine healthcare test is recommended for nearly fifty percent of the world’s population at various points throughout their lifetime.

Author Biographies

Mark J. Parry, Texas Tech University Health Sciences Center – Paul L. Foster School of Medicine, El Paso, TX, United States
BS. 
Travis S. Dowdle, Texas Tech University Health Sciences Center –School of Medicine, Lubbock, TX, United States

BS.

Jesse N. Steadman, University of Utah – School of Medicine, Salt Lake City, UT, United States

BS.

Tiffany R. Guerra, Texas Tech University Health Sciences Center – Paul L. Foster School of Medicine, El Paso, TX, United States

BS.

Kim L. Cox, Pocatello Women’s Health Clinic – Pocatello, ID, United States

BS, MD.

References

Shaw PA. The History of Cervical Screening 1: The Pap. Test. J Soc Obstet Gynaecol Can. 2000 Feb 1;22(2):110-114.

American Cancer Society. Cancer Facts & Figures 2020. Available from: https://www.cancer.org/content/dam/cancer-org/research/cancer-facts-and-statistics/annual-cancer-facts-and-figures/2020/cancer-facts-and-figures-2020.pdf. Last updated 2020; cited Sep 14, 2020.

U.S. Preventive Services Task Force. Cervical Cancer: Screening. Available from: https://www.uspreventiveservicestaskforce.org/uspstf/recommendation/cervical-cancer-screening#fullrecommendationstart. Last updated Aug 21, 2018; cited Sep 14, 2020.

American Cancer Society. Pap/HPV test, women 21 to 65 years. Available from: https://cancerstatisticscenter.cancer.org/#!/data-analysis/Pap_Test. Last updated 2018; cited Sep 14, 2020.

Akinlotan M, Bolin JN, Helduser J, Ojinnaka C, Lichorad A, McClellan D. Cervical Cancer Screening Barriers and Risk Factor Knowledge Among Uninsured Women. J Community Health. 2017 Feb 2;42(4):770-778.

Musa J, Achenbach CJ, O'Dwyer LC, Evans CT, McHugh M, Hou L, et al. Effect of cervical cancer education and provider recommendation for screening on screening rates: A systematic review and meta-analysis. PLoS One. 2017 Sep 5;12(9):e0183924.

AL-Hammadi FA, Al-Tahri F, Al-Ali A, Nair SC, Abdulrahman M. Limited Understanding of Pap Smear Testing among Women, a Barrier to Cervical Cancer Screening in the United Arab Emirates. Asian Pac J Cancer Prev. 2017 Dec;18(12):3379-3387.

Ranabhat S, Tiwari M, Dhungana G, Shrestha R. Association of knowledge, attitude and demographic variables with cervical Pap smear practice in Nepal. Asian Pac J Cancer Prev. 2014 Dec;15(20):8905-8910.

Head SK, Crosby RA, Moore GR. Pap smear knowledge among young women following the introduction of the HPV vaccine. J Pediatr Adolesc Gynecol. 2009 Aug 1;22(4):251-256.

Chen HY, Kessler CL, Mori N, Chauhan SP. Cervical cancer screening in the United States, 1993-2010: characteristics of women who are never screened. J Womens Health (Larchmt). 2012 Nov 7;21(11):1132-1138.

Breitkopf CR, Pearson HC, Breitkopf DM. Poor knowledge regarding the Pap test among low-income women undergoing routine screening. Perspect Sex Reprod Health. 2005 Jun;37(2):78-84.

Center for Disease Control and Prevention. HPV-Associated Cervical Cancer Rates by Race and Ethnicity. Available from: https://www.cdc.gov/cancer/hpv/statistics/cervical.htm Last updated 2019; cited Jul 4, 2020.

Pew Research Center. Health Online 2013. Available from: https://www.pewinternet.org/wp-content/uploads/sites/9/media/Files/Reports/PIP_HealthOnline.pdf. Last updated January 15, 2013; cited Jul 4, 2020.

Statista. Global market share of search engines 2010-2020. Available from: https://www.statista.com/statistics/216573/worldwide-market-share-of-search-engines/. Last updated Sep 2, 2020; cited Sep 12, 2020.

Ryan, PM, Ryan CA. Mining Google Trends Data for Health Information: The Case of the Irish "CervicalCheck" Screening Programme Revelations. Cureus. 2019 Aug 29;11(8):e5513.

American Medical Association Foundation, American Medical Association. Health Literacy: A Manual for Clinicians. Available from: http://lib.ncfh.org/pdfs/6617.pdf. Last updated 2003; cited Ju 4, 2020.

Mac OA, Thayre A, Tan S, Dodd RH. Web-Based Health Information Following the Renewal of the Cervical Screening Program in Australia: An Evaluation of the Readability, Understandability and Credibility. J Med Internet Res. 2020 Jun 26;22(6):e16701.

Boztas N, Omur D, Ozbılgın S, Altuntas G, Piskin E, Ozkardesler S, et al. Readability of internet-sourced patient education material related to "labour analgesia". Medicine (Baltimore). 2017 Nov 10;96(45):e8526.

Patel SK, Gordon EJ, Wong CA, Grobman WA, Goucher H, Toledo P. Readability, Content, and Quality Assessment of Web-Based Patient Education Materials Addressing Neuraxial Labor Analgesia. Anesth Analg. 2015 Nov;121(5):1295-1300.

Basch CH, Fera J, Ethan D, Garcia P, Perin D, Basch CE. Readability of online material related to skin cancer. Public Health. 2018 Oct;163:137-140.

Mehta MP, Swindell HW, Westermann RW, Rosneck JT, Lynch TS. Assessing the Readability of Online Information About Hip Arthroscopy. Arthroscopy: The Journal of Arthroscopic & Related Surgery. 2018 Jul 1;34(7):2142-2149.

Vargas CR, DePry J, Lee BT, Bordeaux JS. The Readability of Online Patient Information About Mohs Micrographic Surgery. Dermatologic Surgery. 2016 Oct;42(10):1135-1141.

Rothrock SG, Rothrock AN, Swetland SB, Pagane M, Isaak SA, Romney J, et al. Quality, Trustworthiness, Readability, and Accuracy of Medical Information Regarding Common Pediatric Emergency Medicine-Related Complaints on the Web. J Emerg Med. 2019 Oct 1;57(4):469-477.

U.S. Department of Health and Human Services, National Cancer Institute. Making Health Communication Programs Work. Available from: https://www.cancer.gov/publications/health-communication/pink-book.pdf. Last updated July 2020; cited Jul 4, 2020.

U.S. Department of Health and Human Services, Centers for Medicare and Medicaid Services. TOOLKIT for Making Written Material Clear and Effective: SECTION 4 Special topics for writing and design. Part 7: Using readability formulas: A cautionary note. Available from: https://www.cms.gov/Outreach-and-Education/Outreach/WrittenMaterialsToolkit/Downloads/ToolkitPart07.pdf. Last updated Sep 2010; cited Jul 4, 2020.

Ley P, Florio T. The use of readability formulas in health care. Psychology, Health & Medicine. 1996;1:7-28.

Wang LW, Miller MJ, Schmitt MR, Wen FK. Assessing readability formula differences with written health information materials: application, results, and recommendations. Res Social Adm Pharm. 2013 Sep-Oct;9(5):503-516.

Kincaid JP, Fishburne RPJ, Rogers RL, Chissom BS. Derivation Of New Readability Formulas (Automated Readability Index, Fog Count And Flesch Reading Ease Formula) For Navy Enlisted Personnel. Institute for Simulation and Training. 1975 Jan 1;56.

Google Trends. Available from: https://trends.google.com/trends/?geo=US. Cited Oct 26, 2020.

Advanced Web ranking. Organic CTR History. Available from: https://www.advancedwebranking.com/ctrstudy/. Last updated 2020; cited Sep 12, 2020.

Kolesnikov A, Logachev Y, Topinskiy V. Predicting CTR of new ads via click prediction. CIKM ’12: Proceedings of the 21st ACM international conference on Information and knowledge management. 2012 Oct:2547-2550.

WebFX. Readability Test Tool. Available from: https://www.webfx.com/tools/read-able/. Last updated 2020; cited July 4, 2020.

DeVere Wolsey T, Lenski S, Grisham DL. Assessment Literacy: An Educator's Guide to Understanding Assessment, K-12. New York: The Guilford Press. 2020:125.

American Cancer Society. Cancer Screening Guidelines By Age. Available from: https://www.cancer.org/healthy/find-cancer-early/cancer-screening-guidelines/screening-recommendations-by-age.html. Last updated 2020; cited Jul 4, 2020.

Safaeian M, Solomon D, Castle PE. Cervical cancer prevention--cervical screening: science in evolution. Obstet Gynecol Clin North Am. 2007 Dec;34(4):739-760.

Berland GK, Elliott MN, Morales LS, Algazy JI, Kravitz RL, Broder MS, et al. Health information on the Internet: accessibility, quality, and readability in English and Spanish. JAMA. 2001 May 23-30;285(20):2612-2621.

Chen X, Acosta S, Barry AE. Evaluating the Accuracy of Google Translate for Diabetes Education Material. JMIR Diabetes. 2016 Jan-Jun;1(1):e3.

Search Engine Watch. SEO basics: 22 essentials you need for optimizing your site. Available from: https://www.searchenginewatch.com/2016/01/21/seo-basics-22-essentials-you-need-for-optimizing-your-site/. Last updated Jan 21, 2016; cited Sep 10, 2020.

Google Search. How Search algorithms work. Available from: https://www.google.com/search/howsearchworks/algorithms/. Cited Oct 31, 2020.

Brandwatch. 57 Fascinating and Incredible YouTube Statistics. Available from: https://www.brandwatch.com/blog/youtube-stats/#:~:text=YouTube%20is%20the%202nd%20most,Netflix%20and%20Facebook%20video%20combined. Last updated Feb 21, 2020; cited Sep 9, 2020.

Bosworth A, Ruhter J, Samson LW, Sheingold S, Taplin C, Tarazi W et al. Medicare Beneficiary Use of Telehealth Visits: Early Data from the Start of COVID-19 Pandemic. ASPE Issue Brief. 2020 July 28.

Education Week. COVID-19 Fuels Big Enrollment Increases in Virtual Schools. Available from: https://www.edweek.org/ew/articles/2020/09/03/covid-19-fuels-big-enrollment-increases-in-virtual.html. Last updated Sep 3, 2020; cited Sep 9, 2020.

Abu Abed M, Himmel W, Vormfelde S, Koschack J. Video-assisted patient education to modify behavior: a systematic review. Patient Educ Couns. 2014 Oct;97(1):16-22.

Lühnen J, Steckelberg A, Buhse S. Pictures in health information and their pitfalls: Focus group study and systematic review. Z Evid Fortbild Qual Gesundhwes. 2018 Nov 1;137-138:77-89.

Published
2020-12-09
How to Cite
Parry, M. J., Dowdle, T. S., Steadman, J. N., Guerra, T. R., & Cox, K. L. (2020). Pap Smear Readability on Google: An Analysis of Online Articles Regarding One of the Most Routine Medical Screening Tests. International Journal of Medical Students, 8(3), 257-262. https://doi.org/10.5195/ijms.2020.653
Section
Original Article