Evidence record
The Oregon Eligibility System Appropriately Determines Eligibility, But Input Errors Continue to Occur
- Jurisdiction
- Oregon
- Publishing agency
- Oregon Secretary of State, Audits Division
- Publication date
- October 2024
- Source record
- Original document linked
Findings
6
Recommendations
3
Overall conclusion
The audit found that the ONE system largely determines eligibility accurately for Medical and SNAP programs, and automated eligibility determinations are generally effective. However, input errors, manual data entry, and inconsistent override monitoring create risk for incorrect determinations and benefit calculations, particularly as the system and policies evolved during the COVID-19 Public Health Emergency. While change management is formal and well-documented, testing lacks a formal, unified plan, relying on informal controls. The report recommends automation, stronger override governance, and a formal UAT plan to mitigate these issues and improve input accuracy and overall reliability.
Scope
The audit evaluated the Oregon Eligibility System (ONE), a centralized system used by the Oregon Department of Human Services (ODHS) and the Oregon Health Authority (OHA) to determine eligibility and benefits for Medicaid, CHIP, and SNAP. The scope included automated system processes for processing applications and determining eligibility for Medical and SNAP programs. The test period ranged from eligibility determinations authorized on or after July 1, 2021, through May 31, 2023, though some tests evaluated ongoing eligibility beyond that period. The audit also assessed data input accuracy in ONE and the appropriateness of overrides by eligibility workers. It evaluated the sufficiency of ODHS and OHA procedures to analyze and prioritize changes to ONE; it did not assess Deloitte LLC's change management procedures. It also evaluated the sufficiency of user acceptance testing for system changes.
Findings (6)
Each finding has a stable link.
- F-712
ONE system largely determines eligibility appropriately for Medical and SNAP programs, but some automated functions did not work properly or reliably for a small number of determinations, including interface errors and social security number verification against federal records.
- F-713
Most errors in eligibility determinations and benefit calculations were the result of manual input errors, not automated processes, with complexity and COVID-19 policy changes increasing manual inputs and input errors.
- F-714
Manual overrides by eligibility workers, while rare, have reversed appropriate automatic determinations; there are policies but they are not consistently followed and are only recently being reviewed by management; overrides documentation is inconsistent and monitoring is limited (e.g., 0.50% of Medical and 0.08% of SNAP overrides); SNAP overrides review found 40% lacked case notes and 90% were not approved by policy.
- F-715
Change management for ONE is formal and well documented, but state tests of changes rely on informal controls and user acceptance testing lacks a formal, comprehensive plan.
- F-716
Input controls exist to ensure required fields are completed, but accuracy of input data not controlled by automated checks is challenging, relying on staff; training materials exist but are primarily instructional; multiple internal units perform data accuracy reviews, yet prevent/detect errors remains insufficient, especially under the PHE.
- F-717
During testing, residency and income data errors were found; 156 residency-related instances where residency status should have ended eligibility after change; 29 cases where workers did not rerun eligibility after residency change; various income data issues, and instances where high reported income was entered manually; test results showed inaccuracies in SNAP benefit calculations and Medicaid eligibility due to manual input errors (e.g., misstatement of household size, incorrect income entries, misrecorded expenses); 156 residency errors could lead to continued eligibility when not appropriate once PHE ended.
Recommendations (3)
- R-646
Evaluate opportunities to improve input accuracy through automation and propose changes to the ONE system to enforce them, including requiring entry into income fields necessary for eligibility and requiring rerun/authorization when information changes.
Related finding F-716 - R-647
Refine override processes to ensure overrides are restricted to authorized personnel, consistently documented, and monitored: limit override rights to leads/managers or require approval, implement automated note requirement, formal override review schedule, and procedures to correct detected override errors.
Related finding F-714 - R-648
Develop a formal user acceptance testing plan for changes, consolidating existing practices into an overarching plan that defines test types, priorities, risk assessment, coverage, resources, documentation of decisions, and a target of implementing a comprehensive UAT plan by 9/30/2025.
Related finding F-715