Application of Indirect Race/ Ethnicity Data in Quality Metric Analyses

Similar documents
Defining Statistically Significant Spatial Clusters of a Target Population using a Patient-Centered Approach within a GIS

The Impacts of the Affordable Care Act on Preventive Services among Racial Groups UNDERGRADUATE RESEARCH THESIS

The Journal of Database Marketing, Vol. 6, No. 3, 1999, pp Retail Trade Area Analysis: Concepts and New Approaches

Applying Health Outcome Data to Improve Health Equity

This report details analyses and methodologies used to examine and visualize the spatial and nonspatial

Big-Geo-Data EHR Infrastructure Development for On-Demand Analytics

BROOKINGS May

CRP 608 Winter 10 Class presentation February 04, Senior Research Associate Kirwan Institute for the Study of Race and Ethnicity

ITEM 11 Information June 20, Visualize 2045: Update to the Equity Emphasis Areas. None

CCSG Needs Assessment: Characterizing the cancer burden in our catchment area

Keywords: Air Quality, Environmental Justice, Vehicle Emissions, Public Health, Monitoring Network

GROWING APART: THE CHANGING FIRM-SIZE WAGE PREMIUM AND ITS INEQUALITY CONSEQUENCES ONLINE APPENDIX

Spatial Disparities in the Distribution of Parks and Green Spaces in the United States

Assessing Social Vulnerability to Biophysical Hazards. Dr. Jasmine Waddell

ADDRESSING TITLE VI AND ENVIRONMENTAL JUSTICE IN LONG-RANGE TRANSPORTATION PLANS

Measuring Geographic Access to Primary Care Physicians

Environmental Analysis, Chapter 4 Consequences, and Mitigation

DIFFERENT INFLUENCES OF SOCIOECONOMIC FACTORS ON THE HUNTING AND FISHING LICENSE SALES IN COOK COUNTY, IL

Analyzing the Geospatial Rates of the Primary Care Physician Labor Supply in the Contiguous United States

1. Capitalize all surnames and attempt to match with Census list. 3. Split double-barreled names apart, and attempt to match first half of name.

Integrating GIS into Food Access Analysis

Child Opportunity Index Mapping

An Assessment of People, Place and Business on Syracuse s Near Northside

Geospatial Analysis of Job-Housing Mismatch Using ArcGIS and Python

Using American Factfinder

Integration for Informed Decision Making

Medical GIS: New Uses of Mapping Technology in Public Health. Peter Hayward, PhD Department of Geography SUNY College at Oneonta

1Department of Demography and Organization Studies, University of Texas at San Antonio, One UTSA Circle, San Antonio, TX

Community Opportunity Map

Linking Industry and Occupation Clusters in Regional Economic Development

Policy Paper Alabama Primary Care Service Areas

Measuring community health outcomes: New approaches for public health services research

Purpose Study conducted to determine the needs of the health care workforce related to GIS use, incorporation and training.

Mapping Communities of Opportunity in New Orleans

COMMISSION ON ACCREDITATION 2011 ANNUAL REPORT ONLINE

The Church Demographic Specialists

COMMISSION ON ACCREDITATION 2017 ANNUAL REPORT ONLINE

Are You Maximizing The Value Of All Your Data?

Proposed Scope of Work Village of Farmingdale Downtown Farmingdale BOA Step 2 BOA Nomination Study / Draft Generic Environmental Impact Statement

An online data and consulting resource of THE UNIVERSITY OF TOLEDO THE JACK FORD URBAN AFFAIRS CENTER

How is Your Health? Using SAS Macros, ODS Graphics, and GIS Mapping to Monitor Neighborhood and Small-Area Health Outcomes

SOUTH COAST COASTAL RECREATION METHODS

Ministry of Health and Long-Term Care Geographic Information System (GIS) Strategy An Overview of the Strategy Implementation Plan November 2009

Cultural Data in Planning and Economic Development. Chris Dwyer, RMC Research Sponsor: Rockefeller Foundation

The purpose of this report is to recommend a Geographic Information System (GIS) Strategy for the Town of Richmond Hill.

Spatiotemporal Analysis of Commuting Patterns in Southern California Using ACS PUMS, CTPP and LODES

Low-Income African American Women's Perceptions of Primary Care Physician Weight Loss Counseling: A Positive Deviance Study

PROGRAM EVALUATION REPORT The following information is organized by CACREP-Accredited Program Specialty Areas for

Understanding China Census Data with GIS By Shuming Bao and Susan Haynie China Data Center, University of Michigan

Using ArcGIS Server to Bring Geospatial Analysis

Creating a Staff Development Plan with Esri

Implications for the Sharing Economy

NEW YORK AND CONNECTICUT SUSTAINABLE COMMUNITIES. Fair Housing & Equity Assessment & Regional Planning Enhancement

Abortion Facilities Target College Students

Census Transportation Planning Products (CTPP)

Diffusion of GIS in Public Policy Doctoral Program

COMMISSION ON ACCREDITATION 2014 ANNUAL REPORT ONLINE

COMMISSION ON ACCREDITATION 2012 ANNUAL REPORT ONLINE

FIRE DEPARMENT SANTA CLARA COUNTY

Making Our Cities Safer: A Study In Neighbhorhood Crime Patterns

Spatiotemporal Analysis of Commuting Patterns: Using ArcGIS and Big Data

Methodological Issues in Quantitative Research on Race and Ethnicity

Globally Estimating the Population Characteristics of Small Geographic Areas. Tom Fitzwater

Crime Analysis. GIS Solutions for Intelligence-Led Policing

compass.durhamnc.gov Building Community by Illustrating Community Durham s Neighborhood Compass

Module 10 Summative Assessment

Social Vulnerability Index. Susan L. Cutter Department of Geography, University of South Carolina

The econ Planning Suite: CPD Maps and the Con Plan in IDIS for Consortia Grantees Session 1

The Global Statistical Geospatial Framework and the Global Fundamental Geospatial Themes

ArcGIS Online Analytics. Mike Flanagan

Long Island Breast Cancer Study and the GIS-H (Health)

International Development

Spatial and Socioeconomic Analysis of Commuting Patterns in Southern California Using LODES, CTPP, and ACS PUMS

Causal Inference with Big Data Sets

Indicator: Proportion of the rural population who live within 2 km of an all-season road

OC Enterprise GIS. Kevin Hills, PLS Cameron Smith, GISP. OC Survey

County Public Health Department. A practical guide, lessons learned and current projects in a small local health department

An Internet-Based Integrated Resource Management System (IRMS)

Completions Survey materials can be downloaded using the following link: Survey Materials.

Demographic Data in ArcGIS. Harry J. Moore IV

DEVELOPING DECISION SUPPORT TOOLS FOR THE IMPLEMENTATION OF BICYCLE AND PEDESTRIAN SAFETY STRATEGIES

EXAMINING THE DEMOGRAPHICS OF THE DOG RIVER WATERSHED

Temporal Changes of Access to Primary Health Care in Illinois ( ) and Policy Implications

Population Research Center (PRC) Oregon Population Forecast Program

A Street Named for a King

Empowering Local Health through GIS

AUTOMATED METERED WATER CONSUMPTION ANALYSIS

On the Use of the Bross Formula for Prioritizing Covariates in the High-Dimensional Propensity Score Algorithm

HAZUS-MH: Earthquake Event Report

Forecasting Using Time Series Models

Mapping the Route Identifying and Consulting with HS2 s Impacted Populations

Introducing GIS analysis

CSISS Resources for Research and Teaching

Urban GIS for Health Metrics

Finding Common Ground Through GIS

Developing a Community Geographical Information System (GIS) in Rural India

Mapping and Health Equity Advocacy

Using GIS to Brief New York City Public Officials after September 11

Neighborhood social characteristics and chronic disease outcomes: does the geographic scale of neighborhood matter? Malia Jones

Census Geography, Geographic Standards, and Geographic Information

Transcription:

Background The fifteen wholly-owned health plans under WellPoint, Inc. (WellPoint) historically did not collect data in regard to the race/ethnicity of it members. In order to overcome this lack of data and meet a number of health plan quality improvement, operations and business planning needs, the Health Disparities Analytic Unit at WellPoint has developed a methodology to derive indirect race and ethnicity information for members. While WellPoint also has a long-term plan to move towards the collection of member self-reported race/ethnicity data on its over 35 million insured members, current indirect data methodologies offer a relatively inexpensive, yet reliably accurate strategy to bridge the data collection gap until primary source data is available for all members. Traditionally, marketers have relied on surnames or geographically linked census data when attempting to predict race/ethnicity. Some of the first efforts to combine these two data sources were led by the RAND Corporation (RAND), which used a combination of absolute matches against surname lists and geocoded data linked to census blocks, then applied Bayesian statistical methods to determine the probability of each individual being Asian, African American, Hispanic, or White / other. In late 2006, WellPoint engaged RAND to access RAND s indirect methodologies to form an internal, dedicated Disparities Analytic Unit at WellPoint to support the quality and business needs of its plans. Throughout 2007, leveraging the preliminary work done by RAND, the Health Disparities Analytic Unit continued independent research and development on indirect methodologies to develop its own model that combines available name and geographic Census data using a series of logistic regressions. This new logistic method eliminated the use of absolute surname matches and the calculation of specificities and sensitivities. In addition, updated surname lists and a proprietary African American first name list developed by the Health Disparities Analytic Unit were included in the model. Finally, logistic regressions replaced the use of Bayesian methods to combine surname and census data. INTERVENTION AND IMPLEMENTATION WellPoint operates a small but dedicated the Health Disparities Analytic Unit that conducts continuous refinement of its indirect data methodology and health disparities analyses. Using a combination of geocoding, name analyses, and logistic regressions, the analytic unit provides estimation of member race/ethnicity or preferred language needs based on membership demographics. The resulting indirect data estimates also allow WellPoint plans to examine differences between racial / ethnic groups in various health indicators, such as diabetes, colorectal and mammography screening rates by linking the proxy race/ethnicity data with member claims data and quality process measures. Along with the traditional graphs and charts, GIS tools have allowed further detailed examination of screening rates through mapping. Application of Indirect Race/ Ethnicity Data in Quality Metric Analyses Health disparities analyses may be performed by applying indirect race/ethnicity data to a clinical study factor. The most commonly requested study measures at WellPoint are clinical quality progress measurements such as the major Health Plan Employer Data and Information Set (HEDIS ) screening and process measures. Major disadvantages of collecting and using primary source/member self-reported data are that race /ethnicity data is available for only a subset of the health plan s total insured population, and member self-selection in reporting the data that may impact and distort actual utilization patterns during summary-level comparisons of the clinical data. Indirect race/ethnicity data estimates, coupled with study metrics, offer comprehensive performance comparisons on quality metrics at summary levels to aid in health plan business planning and decisions. The resulting output allows the identification of disparities among the various groups. Comparisons are most successful when complete data is used. To Page 1 of 6

date, WellPoint has utilized summary reports that study and aggregate health disparities across multiple levels, including: state, regional, county, zip code, medical group/ipa, and provider practice levels for the following HEDIS and other quality measure indicators. Application of GIS mapping tools As a positive side effect from the geocoding process completed as a part of the logistic model of estimating race/ethnicity, proxy race/ethnicity and quality metric data can easily be loaded into GIS software to produce maps illustrating items such as health disparities hotspots, network access needs, member dispersion, provider locations, and minority locations. These maps are visually impactful and may be used for business decision support in designing quality improvement programs, provider network management or contracting initiatives, and/or community collaboration projects with external health care stakeholders. (See Appendix Case Study: Application of Indirect Race/ethnicity Data to Support Quality Improvement and Network Management Initiatives) In Ohio, indirect race/ethnicity data was linked with mammography screening HEDIS data to identify geographic regions with high health disparities for increased reminder mailings. (Appendix Sample Map A) Indirect race/ethnicity data and subsequent health disparities analyses may also be used to support provider network management activities, such as contracting/service access initiatives, physician cultural competency training outreach, and/or physician-targeted quality improvement outreach initiatives. In Georgia, mapping of Hispanic diabetic members using indirect race/ethnicity data is used to identify potential addition of rural telemedicine facilities/locations that would offer members the ability to consult with Spanish-speaking/bi-cultural diabetes health educators from large metropolitan areas. (Appendix Sample Map B) In California, WellPoint has used the demographic overlay/screening density gradient maps with additional provider network specific data to meet its network management quality improvement and contract planning needs. To determine whether health care disparities might be a contributing factor in low HEDIS performance in California s Inland Empire (San Bernardino and Riverside Counties), the Health Disparities Analytic Unit used indirect logistics modeling to apply racial/ethnic data to study geographic variation in the adherence to quality indicators. Member demographics and related quality process indicators were extracted based on 2006 HEDIS guidelines for colorectal cancer screening (n=160,203), pharyngitis screening (n=10, 863), and the four diabetes-related HEDIS screenings (n=40,375). (Appendix Sample Map C) EVALUATION METHODS Unlike intervention-based programs, the logistic model of indirect race/ethnicity data methodology does not have quantifiable inherent performance measures that might be were used to evaluate overall success of the program. As a process/administrative best practice, however, the program s success may be assessed several qualitative criteria: the reliability of the data generated by the model, the impact of the initiative and the potential for replication by others. The sensitivity, specificity and positive predictive value validation tests serve as a fair measure of the effectiveness and reliability of the logistic model of indirect race/ ethnicity data methodology as a diagnostic tool. Internal testing of WellPoint s current methodology has yielded excellent results to date. Model development and testing utilized a dataset from WellPoint s California and Connecticut State Sponsored business that contains race/ethnicity data on approximately 1.3 million members. Prior to running the regressions, 192,096 member records were extracted from the model development database and set aside to be used for validation testing. The resulting model predicted within 0.1% of the Page 2 of 6

actual aggregate demographics for the validation sample (Chart 1). This is a marked improvement over the more traditional marketing approaches of using surname lists or census data separately. When using the logistic model to predict the race/ethnicity of individual members, the model predicted the correct race/ethnicity for 86.2% of all members. Within ethnic minorities, however, indirect methodologies have proven to be highly reliable. The positive predictive value (PPV), or precision rate, is the proportion of people with specified demographic trait who are correctly diagnosed, and is the most important measure of a diagnostic method as it reflects the probability that a positive identification reflects the underlying trait that it is seeking. The logistic model s PPV for all racial / ethnic categories are over 90%, and in all categories except for Asians, the PPV is higher than those of more traditional indirect methods (Chart 2). IMPACT OF INITIATIVE As illustrated under the Intervention section, the logistic model of indirect race/ethnicity data methodology has proven itself to be flexible and applicable to address a wide range of project and business support needs. At WellPoint, indirect methodology and maps have been used to identify hotspots of unscreened members, study provider access for minority members, identify minority members for culturally/linguistically appropriate health screening reminders and health education materials, and determine member threshold language needs to meet regulatory requirements Reports and maps generated using the indirect race/ethnicity data process have also allowed WellPoint to collaborate with its network medical groups, external health advocacy organization like the American Cancer Society, and elective government officials to encourage open dialogues on the issue of health disparities and jointly work towards collaborative quality initiatives to reduce the gap in care. It is our hope that expansion of such transparency and engagement tools will improve the health of our communities we serve and the quality of care overall. Page 3 of 6

APPENDIX Case Study: Application of Indirect Race/ethnicity Data to Support Quality Improvement and Network Management Initiatives More sophisticated maps could provide an overlay of zip codes with certain demographic characteristics (such as race, ethnicity, income or education level) with a density gradient map of members who have received a particular HEDIS recommended screening. Maps like sample Map A, titled Eligible African American Members Not Receiving Mammography Screening Dayton Area by Census Blockgroup were used in WellPoint s Ohio health plan to increase mammography screening rates among African American women. Indirect race/ethnicity data was linked with mammography screening HEDIS data to identify geographic regions with health disparities for increased reminder mailings. Sample Map A Page 4 of 6

In WellPoint s Georgia plan, maps such as sample Map B, titled Hispanic Diabetic Members in Hall County, GA and Surrounding Area were used for network access and provider contract planning. Hispanic diabetic members were identified and mapped using indirect race/ethnicity data. Hospital location data is layered onto the map to identify potential rural telemedicine sites at hospital locations that would offer rural Hispanic diabetic members the ability to consult with Spanish-speaking/bi-cultural diabetes health educators from large metropolitan areas. Sample Map B Sample map C, titled, Colorectal Screening Rate for Los Angeles overlays the colorectal screening gradient density map with zip codes with Hispanic population majorities based on the 2000 U.S. Census. It is interesting to note that the more affluent coastal regions and areas like Beverly Hills show some of the highest screening rates, while many zip codes with Hispanic population majorities fall in areas with the lowest colorectal screening rates. At Anthem Blue Cross, these areas are called disparities hot spots. Page 5 of 6

Sample Map C Chart 1: Aggregate Demographics Predicted vs. Reported Approach N = 192,096 Hispanic Asian Black White / Other Surname 46.1 6.6 7.1 40.2 Geocoding 41.3 7.9 11.9 39.0 Logistic Model 52.1 7.9 14.7 25.3 Self report 52.0 8.0 14.8 25.2 Chart 2: Individual Predictions Approach N = 192,096 Hispanic Asian Black Surname 94.9 96.0 85.5 76.8 Geocoding 93.3 87.1 83.9 76.8 Logistic Model 95.3 94.8 90.3 90.2 White / Other Page 6 of 6