COA Standards Deep Dive: Managing Performance Improvement and Case Records

If you're working toward COA accreditation, you already know that the Council on Accreditation doesn't just check boxes: they want to see a living, breathing quality improvement system that actually drives better outcomes. And two areas where organizations consistently get tripped up? Performance and Quality Improvement (PQI) standards and case record management.

Here's the reality: COA surveyors aren't looking for perfection. They're looking for evidence that you're systematically measuring what matters, learning from your data, and making real improvements to how you serve clients. If your PQI system exists only in a binder that gets dusted off before site visits, or if your case record reviews are sporadic and surface-level, you're setting yourself up for lower ratings: or worse, conditional accreditation status.

We specialize in helping behavioral health organizations build compliance systems that aren't just audit-ready but actually strengthen operations. Let's break down exactly what COA expects for performance improvement and case records, and how to implement these standards in a way that works for your team.

Understanding COA's Performance and Quality Improvement Framework

COA's PQI standards create an organization-wide framework that uses data to promote efficient, effective service delivery and mission achievement. This isn't about generating reports for surveyors: it's about building a culture where data informs decisions at every level of your organization.

The PQI system serves four strategic purposes that COA evaluates:

✅ Achieving measurable results - You need to demonstrate that your services actually create the outcomes you promise clients, funders, and the community.

✅ Promoting health, safety, rights, and inclusion - Your quality metrics must track how well you're protecting and empowering the people you serve.

✅ Supporting and retaining staff - COA wants to see that you're measuring workforce stability, satisfaction, and competency because staff turnover directly impacts service quality.

✅ Ensuring sustainability and promoting growth - Your performance indicators should track financial health, operational efficiency, and capacity for expansion.

Organizations pursuing behavioral health accreditation through COA must demonstrate implementation through three key components: outcomes, outputs, and the data infrastructure (sources, indicators, and targets) that connects them. You can't just say you track outcomes: you need to show the specific measures, how you collect them, who analyzes them, and what you do with the findings.

What COA's Performance Measurement Standards Actually Require

PQI 3.03: Management and Operational Performance Metrics

This standard requires you to identify and track specific measures across four critical operational areas:

Efficiency in resource allocation and utilization - COA wants evidence that you're monitoring how effectively you deploy human and financial resources. Are staff caseloads balanced? Are programs operating within budget? Are you getting maximum impact from every dollar spent?

Effectiveness of risk prevention measures - You need data showing that your risk management strategies actually work. This includes incident tracking, near-miss analysis, and preventive interventions that reduce harm to clients and staff.

Workforce retention and competency - Track staff retention rates, turnover by position and department, exit interview findings, and employee satisfaction scores. COA knows that stable, satisfied teams deliver better care.

Fundraising cost-benefit analysis - For organizations with development functions, you must measure the costs versus benefits of fundraising efforts to demonstrate fiscal responsibility.

The key here is integration. These metrics can't live in isolation: they need to feed into decision-making processes, strategic planning, and continuous improvement cycles.

PQI 3.04: External Review Integration

COA accreditation isn't the only external review your organization undergoes. You're likely subject to state licensing surveys, Medicare/Medicaid audits, insurance payor reviews, and potentially other accreditation bodies.

PQI 3.04 requires you to systematically review findings from ALL external processes and incorporate relevant recommendations into your improvement cycle. This means:

👉 Creating a centralized tracking system for external review findings across all sources

👉 Conducting root cause analysis when deficiencies are identified

👉 Developing corrective action plans with clear timelines and accountability

👉 Monitoring implementation and measuring effectiveness

👉 Closing the loop by documenting resolution and preventing recurrence

Here's where organizations get into trouble: Failure to address findings and recommendations in a timely manner can put you at risk of sanction: not just from the original reviewing body, but from COA itself. If a state licensing survey identifies documentation gaps in August and you haven't implemented corrections by your COA site visit in November, surveyors will question your commitment to quality improvement.

Case Record Review Standards: The Operational Foundation

Case records are the primary evidence of service delivery, clinical decision-making, and regulatory compliance. COA has specific expectations for how you systematically review and improve case documentation practices.

Frequency matters - Reviews must be conducted more frequently than three times per year. Quarterly is the minimum acceptable standard, but many high-performing organizations conduct monthly reviews or use continuous monitoring systems that flag issues in real-time.

Comprehensiveness is non-negotiable - Reviews must cover all organizational services. You can't cherry-pick your best-performing programs or newest clinicians. If you provide outpatient counseling, residential treatment, case management, and peer support, every service line needs regular case record audits.

Design and execution must be systematic - Your case record review process should include:

✔ Standardized audit tools aligned with COA standards, state regulations, and payor requirements

✔ Clear sampling methodology (random selection, stratified by program/clinician, focused on high-risk cases)

✔ Inter-rater reliability processes to ensure consistency across reviewers

✔ Written feedback to clinicians with specific improvement recommendations

✔ Aggregate analysis identifying trends, patterns, and systemic issues

✔ Corrective action plans for identified deficiencies

✔ Follow-up reviews to verify implementation

Case records cannot pose organizational risk. When you identify documentation gaps, missing assessments, unsigned treatment plans, or non-compliance with regulatory standards, you must implement corrective actions immediately. Discovering problems without fixing them creates liability and demonstrates to COA that your quality improvement system isn't functional.

Understanding COA's Four-Level Rating System

COA uses a clear rating system to assess how well you've implemented each standard. Understanding these ratings helps you self-assess before the site visit:

Rating 1: Full Implementation - You have comprehensive policies, consistent practices across all staff and programs, documentation that proves implementation, and evidence of continuous improvement. This is the goal.

Rating 2: Basically Sound with Room for Improvement - Your practices are generally effective but have some gaps. For case record standards, this might mean you conduct reviews but they're less frequent than ideal, don't cover all services equally, or lack sufficient follow-up on findings.

Rating 3: Significant Improvement Needed - Major deficiencies exist. Reviews might be poorly designed, haphazardly conducted, missing for at least one service, or lack any meaningful corrective action process.

Rating 4: Minimal or No Evidence - You're not meeting the standard at all. This often results in a conditional accreditation or deferral.

Most organizations fall into the 1-2 range if they've done proper preparation. The key is being honest in your self-assessment and addressing Rating 2 issues before the site visit rather than hoping surveyors won't notice.

Building a Behavioral Health Strategy That Supports COA Compliance

Here's what we tell our clients: COA accreditation shouldn't be a separate "compliance project" that sits outside your normal operations. The most sustainable approach integrates performance improvement and case record review into your existing behavioral health strategy.

Start with your strategic plan and mission. What outcomes do you promise stakeholders? Those become your PQI measures. Build data collection into service delivery workflows so tracking doesn't require separate systems. Use case record reviews as clinical supervision tools rather than punitive audits: when clinicians see the value in documentation quality for continuity of care and treatment effectiveness, compliance improves naturally.

Assign clear accountability for each PQI standard. Someone needs to own the case record review process, another person manages external review integration, and leadership must review performance data quarterly at minimum. COA wants to see that quality improvement isn't just the QI Director's job: it's embedded in organizational culture.

Practical Implementation Steps You Can Take This Month

👉 Audit your current PQI system against COA standards PQI 3.03 and 3.04. Identify gaps in measurement, analysis, or action planning.

👉 Standardize your case record review process with tools, schedules, and feedback mechanisms that meet COA's frequency and comprehensiveness expectations.

👉 Create a centralized external review tracking system that captures findings from all sources (state licensing, payor audits, peer reviews) and monitors corrective action completion.

👉 Establish quarterly PQI data review meetings where leadership examines trends, discusses implications, and makes data-informed decisions about resource allocation and program modifications.

👉 Train staff on the "why" behind documentation standards: when your team understands how case records support continuity of care, risk management, and outcome measurement, compliance becomes easier.

COA accreditation demonstrates to funders, referral sources, and the communities you serve that you're committed to accountability, continuous improvement, and best practices in behavioral health. Organizations with strong PQI systems and rigorous case record review processes don't just pass accreditation: they deliver better services, retain staff longer, and achieve better client outcomes.

If you're building toward COA accreditation or strengthening your current PQI infrastructure, we're here to help you cut through the complexity and implement systems that actually work. Book a consultation and let's build a compliance framework that supports your mission.