{'fraction_non_alphanumeric': 0.03988626183149612, 'fraction_numerical': 0.03061582206987886, 'mean_word_length': 4.865661411925977, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 1, 'https://': 0, 'lorem ipsum': 0, 'www.': 1, 'xml': 0}, 'pii_count': 1, 'substrings_counts': 1, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Identifying Homelessness among Veterans Using VA Administrative Data: Opportunities to Expand Detection Criteria

Researchers at the U.S. Department of Veterans Affairs (VA) have used administrative criteria to identify homelessness among U.S. Veterans. Our objective was to explore the use of these codes in VA health care facilities. We examined VA health records (2002-2012) of Veterans recently separated from the military and identified as homeless using VA conventional identification criteria (ICD-9-CM code V60.0, VA specific codes for homeless services), plus closely allied V60 codes indicating housing instability. Logistic regression analyses examined differences between Veterans who received these codes. Health care services and co-morbidities were analyzed in the 90 days post-identification of homelessness. VA conventional criteria identified 21,021 homeless Veterans from Operations Enduring Freedom, Iraqi Freedom, and New Dawn (rate 2.5%). Adding allied V60 codes increased that to 31,260 (rate 3.3%). While certain demographic differences were noted, Veterans identified as homeless using conventional or allied codes were similar with regards to utilization of homeless, mental health, and substance abuse services, as well as co-morbidities. Differences were noted in the pattern of usage of homelessness-related diagnostic codes in VA facilities nation-wide. Creating an official VA case definition for homelessness, which would include additional ICD-9-CM and other administrative codes for VA homeless services, would likely allow improved identification of homeless and at-risk Veterans. This also presents an opportunity for encouraging uniformity in applying these codes in VA facilities nationwide as well as in other large health care organizations.

Introduction U.S. Veterans are at higher risk for homelessness compared to the general population and are over-represented within the homeless population [1]. According to the U.S. Department of Housing and Urban Development [2], Veterans account for 9.5% of the U.S. adult population, yet represent 12% of the homeless adult population. Subsequently, the U.S. Department of Veteran Affairs (VA) has become the largest provider of health care services for homeless individuals in the U.S. [3]. Providing appropriate services to Veterans experiencing homelessness acutely depends on the VA health care system accurately recognizing them or those at risk as soon as possible. Those who are not promptly recognized or those who do not seek help (for various reasons) are not offered or are unable to access appropriate services to mitigate their circumstances.
By convention, VA researchers have used administrative criteria to identify homelessness among Veterans, such as ICD-9-CM coding by providers and VA specific administrative codes for outpatient clinics and inpatient treatment specialties indicating receipt of homelessness services [4][5][6][7]. The key element of the currently used criteria for identification of homelessness is an ICD-9-CM code of V60.0, signifying a lack of housing. However, additional ICD-9-CM codes in the V60 series (collectively referred to as V60.x in this study) exist with regard to housing instability (Table 1) [8].
There have been no systematic investigations of the administrative use and consequences of applying V60.0 as compared to one of the V60.x codes or the clinic and treatment codes to identify Veterans experiencing homelessness. Additionally, it is possible that non-uniform or non-standardized assignment of V60.0 to Veterans who are indeed homeless (e.g., received a VA homeless service, but never received a V60.0 code) and, conversely, the non-recognition of homeless Veterans who might receive a V60.x code instead of V60.0, could result in needy and eligible Veterans not being offered appropriate services in a timely manner. This in turn could lead to barriers to access to care and disparities among an already vulnerable population of Veterans. A related issue is that if V60 codes are not being used in a systematic or standardized way in the VA, this would have implications for arriving at accurate estimates of the prevalence of homelessness among Veterans. Finally, as stated by Brown, et al. [9], ". . .even though the [Veterans Health Administration] has committed numerous resources to both identify and Table 1. Comparison of V60 series ICD-9-CM codes and Z59 series ICD-10-codes from the Centers for Medicare & Medicaid Services. From http:// www.cms.gov/medicare-coverage-database/staticpages/icd-9-code-lookup.aspx?KeyWord = v60&bc=AAAAAAAAAAAQAA%3d%3d&; Accessed November 1, 2014 Access to these data can be granted to persons who are not employees of the VA; however, there is an official protocol that must be followed for doing so. Those wishing to access the raw data that were used for this analysis may contact Adi Gundlapalli, MD ( adi.gundlapalli@hsc.utah.edu) to discuss the details of the VA data access approval process. The authors also confirm that an interested researcher would be able to obtain a de-identified, raw dataset upon request pending ethical approval. eliminate homelessness among veterans, at present, there is no single code or identifier that is consistently used to indicate homeless status." Collectively, these issues underscore the need to better understand and standardize the use of all V60 codes. With anticipated transitions to the ICD-10 classification system [10], which includes the same ICD-9-CM code categories applicable to Veterans experiencing (V60.0) or at-risk (V60.x) of homelessness (Table 1), this is an opportune time to investigate the use of these codes and offer recommendations for their uniform use in the future. This investigation could also have implications for how other large managed health care systems understand and standardize the use of these same codes [11].
The purposes of this study are to 1) explore the use of V60 codes in the VA health care system for identifying homelessness among Veterans and 2) contribute to the accuracy of determining homelessness among Veterans in order to enhance prevention and early intervention efforts in the VA for Veterans experiencing or at-risk for homelessness. As a first step, we address the hypothesis that V60.x codes are used to designate homelessness among Veterans in a similar way that the V60.0 code is used (i.e., Are V60.0 and V60.x codes used interchangeably? Are there similar characteristics among Veterans receiving V60.0, V60.x codes, or homeless VA services?). Second, we examine the temporal course of the application of V60.0 and V60.x codes in order to understand administrative changes in homelessness (i.e., How often does receipt of a V60.0 code follow the receipt of a V60.x code, and vice versa?). Third, we assess the differences among Veterans receiving an ICD-9-CM V60 code and those who receive a non-ICD designation (VA clinic or treatment specialty code) as their first indicator of homelessness (i.e., What proportion of Veterans designated as homeless via administrative records did not receive a ICD-9-CM V60 code as their first indicator, and how do they differ in terms of their demographic and VA service use characteristics?). Fourth, we explore rates of V60.0 and V60.x codes across VA facilities to determine whether these codes are used systematically (i.e., Do frequencies of V60.0 or V60.x codes vary by region?).

Veteran Cohort
VA records were examined for all individuals listed on an official roster indicating they had served in the U.S. military as part of the recent conflicts in Iraq or Afghanistan. Specifically, these include those who were deployed as part of Operation Enduring Freedom (OEF), Operation Iraqi Freedom (OIF), and Operation New Dawn (OND). This roster consisted of 941,970 Veterans who separated from the military after deployment as part of OEF/OIF/OND and who were eligible for and enrolled in VA health care services as of July 2011. Of these, 845,593 (89.8%) had at least one documented encounter within the VA system as of April 2012. Records from this latter group were taken from a nationwide VA research database of administrative and clinical data managed by Veterans Informatics and Computing Infrastructure (VINCI) [12] to ascertain homelessness.
Veterans were selected for analysis if they belonged to one of three mutually exclusive homeless groups, based on the first administrative record with any of the following homelessness-related indicators: 1) V60.0, 2) V60.x, and 3) non-ICD indicators of homelessness. The first category included all those with records of receiving a V60.0 ICD-9-CM code as part of a VA contact. The second category included those who received any of three V60.x series ICD-9-CM codes related to housing circumstances: V60.1 (inadequate housing), V60.89 (other specified housing or economic circumstances) and V60.9 (unspecified housing or economic circumstances) (see Table 1). The final category included those whose records contained at least one of a set of specific non-ICD VA clinic codes or treatment specialty codes [7]. These include VA-specific codes that designate the clinic where the Veteran received a particular homeless service: Only Veterans who had at least one additional VA visit in the 90 days immediately following the identification of homelessness were retained in the sample to allow for an examination of receipt of at least one service (and associated ICD-9-CM codes) after the initial homeless designation. Outpatient clinic visits in the 90 days immediately after the first indicator of homelessness were categorized as either homeless, mental health, or substance abuse/addiction services. Additionally, comorbidities among VA homeless groups were also explored by summarizing their ICD-9-CM diagnoses. VA medical center region and station identification was also obtained from the administrative data.

Data Analyses
Descriptive statistics for study variables were computed and stratified by VA homeless group (V60.0, V60.x, and non-ICD indicators). We computed the percentage of Veterans receiving 1) V60.0, V60.x or a non-ICD indicator of homelessness in a VA medical facility after separation from the military; 2) a V60.x code first and a subsequent V60.0 code within the following 90 days and 3) a V60.0 code first and a subsequent V60.x code within the following 90 days. We then analyzed the type of clinical service assigning either V60.0 or V60.x (using chi-square statistics). We next explored various outpatient homeless, mental health, and substance abuse services the Veterans utilized in the immediate 90 days after receiving a homeless designation, stratified by first indicator of homelessness group (e.g., V60.0, V60.x, non-ICD).
To investigate differences among Veterans receiving a V60.0, V60.x, or non-ICD designation as their first indicator of homelessness, we conducted a series of three binary logistic regression analyses with the following dependent variables: 1) V60.x compared to V60.0; 2) V60.x compared to the non-ICD indicator; and 3) V60.0 or V60.x (any V60) compared to the non-ICD indicator. The following covariates were included in all logistic regression models: sex, race (Black, White, Hispanic, Other/Unknown), marital status (married, never married, divorced/separated), level of education (high school or less, post-high school), rank (officer, enlisted), and VA evidence of mental health visits (yes, no) or receipt of substance abuse/addiction services (yes, no) in the 90 days following the first indicator of homelessness.
To explore the possibility of geographic variations in the use of specific V60 codes, we performed both cartographic and statistical modeling. Nationally, the VA healthcare system is administratively divided into four regions, which are further subdivided into 21 Veterans Integrated Service Network (VISN) areas that contain 152 separate medical facilities (stations). First, maps were generated for the 1) 21 VISNs and 2) 152 VA station areas for each fiscal year (2002)(2003)(2004)(2005)(2006)(2007)(2008)(2009)(2010)(2011)(2012). These maps depicted the proportion of Veterans receiving each V60 code (V60.0, V60.1, V60.89, V60.9) of the total number of Veterans identified as homeless in each area. We then conducted statistical analyses to determine whether V60.0 and V60.x codes varied at the region, VISN, or medical facility level nationally. These analyses consisted of a set of multinomial models with three sets of predictor variables (region, VISN, and station) with the outcome being the proportion of Veterans with either V60.0 or V60.x.
Descriptive statistics and logistic regression analyses were conducted using SPSS Version 21 [13]. The geographic statistical models were fit using R version 3.0.2 [14] and the multinom function from the nnet package [15]. Maps were generated using ArcGIS [16].

Ethics Statement
The work described was approved by the University of Utah and Utah State University Institutional Review Boards as well as by the Research and Development committee at VA Salt Lake City Health Care System. A waiver of authorization was approved for retrospective review of existing medical record data. All data was de-identified prior to analysis.

Results
Of the 845,593 OEF/OIF/OND Veterans who had at least one documented encounter within the VA system as of April 2012, the current VA case definition of homelessness (V60.0 or homelessness-related clinic stop and specialty codes) was the basis for identifying 21,021 homeless Veterans (2.5%). Expanding the criteria to include the three V60.x codes increased that number to 31,260 Veterans (3.3% overall; 3.3% for males; 3.7% for females). Of these, 30,886 Veterans (98.8%) had at least one VA visit in the 90 days following the first identification of homelessness (using any of the aforementioned indicators) and were retained for further analysis.
A summary of the demographic characteristics of each "first indication of homelessness" group is presented in Table 2. Forty-two percent (n = 13,066) had V60.0 as their first indicator of homelessness, followed by 32.0% (n = 9,865) with V60.x (exclusive of V60.0). The remainder of the Veterans identified as homeless (n = 7,955, 25.8%) showed an initial receipt of a homeless service without having either type of V60-code in their record. The cohort was predominantly male (86.8%), White (42.3%), with many of "other" or "unknown" race (29.0%), and consisted almost exclusively of enlisted personnel (98.6%). The distributions of all demographic variables differed significantly following chi-square tests across 1 st homelessness classification groups due to the large sample sizes (all p < .0001). Table 3 presents the frequency of each indicator of first instance of homelessness group, as well as for each specific category included in each group. Focusing only on V60 codes as the first indicator of homelessness using the expanded criteria, 57.0% received V60.0 and 43.0% received V60.x. In total, 18.4% (n = 3,280) of those receiving V60.x as their first indicator subsequently received V60.0 code within 90 days. Of those who first received V60.0, 1,303 individuals (10%) subsequently received a V60.x code in the following 90 days. Of those Veterans who received either V60.0 or V60.x, less than half (41%) were noted to have received a homeless service through the VA in the 90 days after receipt of the V60.0 code. However, a majority (81.3%) received mental health services and nearly a quarter (23.7%) received substance abuse services in that 90-day period.
The frequency with which each specific type of service provider assigned V60.0 or V60.x for the first time for a given Veteran is presented in Table 4. Homeless service providers were the most common assignees of both V60.0 and V60.x codes, and, while V60.0 was assigned significantly more frequently than V60.x codes, almost 30% of the latter group received homeless services. Compared to the assignment of V60.0, V60.x codes were administered 1) significantly more frequently in medical specialty, primary care, and social work settings (all p < 0.001); 2) significantly less frequently in alcohol/substance abuse, emergency department, homeless, and inpatient settings (all p < 0.0001); and 3) with no difference in surgical specialties, mental health, and lab/imaging settings (all p > 0.05).
In the 90 days immediately after the first indicator of homelessness, Veterans receiving V60.0 logged an average of 14 visits (median 9, range 1-90) to VA medical facilities, similar to those with V60.x (average 11, median 7, range 1-89) ( Table 5). Veterans receiving V60.0 or V60.x as their first indicator appeared to have a similar profile in terms of their co-morbidities (as shown by the different categories of ICD-9-CM codes assigned to their visit) ( Table 5). Table 6 summarizes the results of three binary logistic analyses regressing first indicators of homelessness on demographic, military service, and health-related covariates: 1) V60.x versus V60.0; 2) V60.x versus non-ICD indicator; and 3) any V60 code (V60.0 or V60.x) versus non-ICD indicator. Results of the first model indicated that several Veteran characteristics were significantly associated (all p < 0.05) with a higher likelihood of receiving a V60.x as compared to a V60.0 designation: being male, Black or of other/unknown race/ethnicity, never married, having a high school education or less, served as an active duty service member, and not having received mental health or substance abuse services. Several Veteran characteristics were significantly associated with a higher likelihood of receiving V60.x as compared to a non-ICD indicator designation in the second model: being male, Black or Hispanic, a reservist, and receiving mental health, but not substance abuse, services. The results of the third model showed that several Veteran characteristics were significantly associated with a higher likelihood of receiving any V60 code as the first indicator of homelessness compared to a non-ICD indicator: being male, non-White (Black, Hispanic, or Other/Unknown), having a post-secondary education, served in the reserves, and received mental illness services. As shown on the map in Fig 1 (snapshot of 2002 and 2012 data for station level geographies), there tended to be a greater than average use of V60.0 in VA medical facilities in the coastal areas of the country; whereas in VA facilities in the central parts of the U.S., there was less-than-average use of the V60.0 code. An animation of these maps across the 10-year period, available in the (S1 File), shows a similar trend in the use of V60 and non-ICD codes at VA stations around the country. Results of the multinomial models showed statistically significant differences (p < 0.001) in the use of V60.0 versus V60.x across all geographic levels (region, VISN and station), indicating differences in the pattern of usage of these codes around the country at the region, VISN, and station level. There was a progressive increase in the use of V60.0 from Region 1 (East Coast) to Region 4 (West Coast); a reciprocal usage pattern of V60.89 and V60.9, and a decrease in use of non-ICD codes (Fig 2).

Discussion
These findings suggest that identifying homelessness based upon VA administrative records alone may lead to challenges in determining the extent of this problem among Veterans seeking Table 5. Frequencies of ICD-9-CM codes assigned to VA medical visits for a cohort of OEF/OIF/OND Veterans with an administrative indicator of homelessness (in the 90 days immediately after the first administrative indicator). care in VA medical facilities. Inferring homelessness based on a combination of V60 codes (from the ICD-9-CM) and evidence of receipt of homeless-related VA services is sensitive to the criteria used. The conventional criteria (V60.0 code or a non-ICD-9-CM administrative code for receipt of VA homeless services) identified 2.5% of Veterans who served in Iraq or Afghanistan as experiencing homelessness. When adding an additional set of V60 codes (denoted as V60.x in this study), which expands these criteria to include conditions indicating unstable housing, this proportion increased to 3.3%. Many of these added by a V60.x code subsequently also received a V60.0 code or a non-ICD-9-CM administrative code. It is likely that, in many instances, V60.x codes are either being used interchangeably with V60.0 by VA staff for indicating homelessness or that Veterans so designated have an unstable housing situation and subsequently become homeless. Determining which explanation is more prevalent goes beyond the parameters of these data, but the data do indicate fluidity among the expanded set of V60 codes and the conventional criteria for determining homelessness. It is likely that this fluidity is, in part, due to Veterans moving interchangeably from housing instability (V60.x) to literal homelessness (V60.0) as they negotiate a series of makeshift housing arrangements. This situation of assigning administrative codes for homelessness creates a degree of ambiguity that will likely persist after billing and coding systems are converted to ICD-10 in the U.S. (now scheduled for October 2015), as the equivalent ICD-10 codes for homelessness (Z59 series, Table 1) are similar to those in ICD-9-CM. Though there appears to be some variability in which type of provider assigns these codes and variation in the use of these codes across VA facilities, the co-morbidity profile of these Veterans appears to be similar. It was also interesting to note that over half of the Veterans in this OEF/OIF/OND cohort who received a V60.0 or V60.x code did not have a record of receiving a VA homeless service in the 90 days after receiving the code. Automated follow-up procedures should be in place to see that all cases of identified housing instability, whether based on V60-codes or on more direct ways of determining homelessness, are provided the opportunity to connect with VA homeless services.

ICD-9-CM
The strengths of our study include the availability of longitudinal medical records of military service members on the OEF/OIF/OND roster who subsequently received care in VA medical facilities over a 10-year period and the nationally representative samples of homeless Veterans from that era. The numbers of homeless Veterans analyzed here are among the largest reported in the literature.
We acknowledge several limitations. The reliability and usage of the ICD-9-CM codes analyzed (V60.0 and V60.x) may have changed over time from 2001 to 2012 and may represent a surveillance artifact. Other than the administrative indicators of homelessness and subsequent homeless/allied service use, for this study, we have not independently verified the homeless status of Veterans by interviewing Veterans or by a manual review of medical notes. There is a need for further studies to validate the use of V60 codes for homelessness in the VA with detailed follow-up and review of electronic medical records. Our analyses are restricted to those Veterans seeking care in the VA; we have no data on those Veterans who may be homeless and have never sought care in the VA (for any reason, including ineligibility for VA services).
In conclusion, these results support the creation of a standard administrative definition and method for identification of homeless Veterans. The expanded V60.x criteria proposed here would be consistent with changes in the 2009 HEARTH Act [17], in which the federal definition of homelessness broadened to encompass imminent loss of housing (within 14 days with no subsequent residence identified and a lack of resources or support to obtain permanent housing).
With the VA being the largest healthcare provider for individuals experiencing homelessness [3], our findings present an opportunity for encouraging uniformity in applying these codes now as well as in the future as VA transitions to ICD-10 in 2015. The challenges of using administrative data alone for determining homelessness may be mitigated by the recent introduction of a screener for homelessness among Veterans [18] or the use of informatics technologies to identify homelessness from the written medical record [19,20].
Our work in the VA likely has application to large health care organizations (inner city hospitals, academic centers, Medicaid managed care organizations) that provide care to individuals experiencing homelessness. Providers in VA medical facilities across the country, especially those in primary care, would likely benefit from an increased awareness of homelessness among Veterans and the importance of appropriate 'coding' to trigger the initiation of appropriate services.
Supporting Information S1 File. Time lapse animation showing maps of the U.S. and the usage of V60.x codes by VA providers over a 10-year period (2002-2012). There tended to be a greater than average use of V60.x codes in VA medical facilities in the coastal areas of the country; whereas in VA facilities in the central parts of the U.S., there was less-than-average use of the V60.0 code. (GIF) Funding for this project was provided by U.S. Department of Veterans Affairs, Veterans Health Administration, Office of Research and Development, Health Services Research and Development Project # HIR 10-002 and IIR 12-084 (PI: AVG). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
The views expressed are those of the authors and do not necessarily reflect the views of the U.S. Government or the U.S. Department of Veterans Affairs.