Evidence record

The Oregon Eligibility System Appropriately Determines Eligibility, But Input Errors Continue to Occur

Jurisdiction
Oregon
Publication date
October 2024
Source record
Original document linked
Open original reportOriginal source available

Findings

6

Recommendations

3

Overall conclusion

The audit found that the ONE system largely determines eligibility accurately for Medical and SNAP programs, and automated eligibility determinations are generally effective. However, input errors, manual data entry, and inconsistent override monitoring create risk for incorrect determinations and benefit calculations, particularly as the system and policies evolved during the COVID-19 Public Health Emergency. While change management is formal and well-documented, testing lacks a formal, unified plan, relying on informal controls. The report recommends automation, stronger override governance, and a formal UAT plan to mitigate these issues and improve input accuracy and overall reliability.

Scope

The audit evaluated the Oregon Eligibility System (ONE), a centralized system used by the Oregon Department of Human Services (ODHS) and the Oregon Health Authority (OHA) to determine eligibility and benefits for Medicaid, CHIP, and SNAP. The scope included automated system processes for processing applications and determining eligibility for Medical and SNAP programs. The test period ranged from eligibility determinations authorized on or after July 1, 2021, through May 31, 2023, though some tests evaluated ongoing eligibility beyond that period. The audit also assessed data input accuracy in ONE and the appropriateness of overrides by eligibility workers. It evaluated the sufficiency of ODHS and OHA procedures to analyze and prioritize changes to ONE; it did not assess Deloitte LLC's change management procedures. It also evaluated the sufficiency of user acceptance testing for system changes.

Findings (6)

Each finding has a stable link.

  1. F-712

    ONE system largely determines eligibility appropriately for Medical and SNAP programs, but some automated functions did not work properly or reliably for a small number of determinations, including interface errors and social security number verification against federal records.

  2. F-713

    Most errors in eligibility determinations and benefit calculations were the result of manual input errors, not automated processes, with complexity and COVID-19 policy changes increasing manual inputs and input errors.

  3. F-714

    Manual overrides by eligibility workers, while rare, have reversed appropriate automatic determinations; there are policies but they are not consistently followed and are only recently being reviewed by management; overrides documentation is inconsistent and monitoring is limited (e.g., 0.50% of Medical and 0.08% of SNAP overrides); SNAP overrides review found 40% lacked case notes and 90% were not approved by policy.

  4. F-715

    Change management for ONE is formal and well documented, but state tests of changes rely on informal controls and user acceptance testing lacks a formal, comprehensive plan.

  5. F-716

    Input controls exist to ensure required fields are completed, but accuracy of input data not controlled by automated checks is challenging, relying on staff; training materials exist but are primarily instructional; multiple internal units perform data accuracy reviews, yet prevent/detect errors remains insufficient, especially under the PHE.

  6. F-717

    During testing, residency and income data errors were found; 156 residency-related instances where residency status should have ended eligibility after change; 29 cases where workers did not rerun eligibility after residency change; various income data issues, and instances where high reported income was entered manually; test results showed inaccuracies in SNAP benefit calculations and Medicaid eligibility due to manual input errors (e.g., misstatement of household size, incorrect income entries, misrecorded expenses); 156 residency errors could lead to continued eligibility when not appropriate once PHE ended.

Recommendations (3)

  1. R-646

    Evaluate opportunities to improve input accuracy through automation and propose changes to the ONE system to enforce them, including requiring entry into income fields necessary for eligibility and requiring rerun/authorization when information changes.

    Related finding F-716
  2. R-647

    Refine override processes to ensure overrides are restricted to authorized personnel, consistently documented, and monitored: limit override rights to leads/managers or require approval, implement automated note requirement, formal override review schedule, and procedures to correct detected override errors.

    Related finding F-714
  3. R-648

    Develop a formal user acceptance testing plan for changes, consolidating existing practices into an overarching plan that defines test types, priorities, risk assessment, coverage, resources, documentation of decisions, and a target of implementing a comprehensive UAT plan by 9/30/2025.

    Related finding F-715