Not statistically significant

The Fair Housing Council of Oregon conducted audits from the citizens' point of view to determine if housing discrimination existed. In Ashland and Beaverton, when African American and white testers were sent to the same location, two-thirds of the black testers faced discrimination in Ashland and 78 percent in Beaverton. Management response in Beaverton was that the testing sample was too small to be statistically significant. But one wonders what the tolerance level is. Even though it was not a large enough sample to generalize to the full population, is it then okay to have some discrimination?

Auditing the food we eat

We rely on our government to regulate the quality of the food that we eat. But recently there have been cracks in that protection. Here is another one. According to an audit of efforts to ensure the quality of meat that is sold in the U.S., high levels of veterinary drugs, pesticides, and heavy metals are not detected or, if detected, still enter the market for us to eat. Additionally, there is no attempt to recall meat, even when tests have confirmed the excessive presence of veterinary drugs. In 2008, when Mexico rejected the entry of U.S. meat for copper levels higher than its acceptable standard, there was no basis to stop this meat from entering the U.S. market since there was no comparable set tolerance level here.

Evaluation and Auditing

When I explain to people what a performance audit is, I usually refer to evaluation practice. Most people understand what an evaluation is while when they hear the word “audit” they immediately think about the IRS. I just finished reading the results of an evaluation of an area that I had wanted to audit. The evaluation was successful in determining the “condition” and the “effect.” In describing the “condition”, it also was able to allude to the “cause.” The recommendations are also on point; however, without addressing the “cause” head on, I wonder how easily they will be to implement.

Performance audits, to be successful, need to get to root causes. In this evaluation, the root cause is the organization. The evaluation looked at similar programs across departments and made recommendations to improve at the program level. However, without effective organization, clear lines of authority and responsibility, the road to improvement will be slow and possibly difficult. In this case, there should be a recommendation to consolidate leadership of programs.

I also was reminded of another difference between evaluation and auditing – the report. In this evaluation, the report language was very academic. Prior to getting to the findings, you had to wade through the methodology of the evaluation and the analysis. Usually the first draft of an audit will also contain writing about the methodology and the analysis, but by the time we get to a draft for our audiences (program, Council, public) that information is removed. We try to describe in simple and concise terms what we found and what it caused.