Watching treatment implementation is one of the key determinants behind whether great treatments lead to great results. But, deep down in our hearts, we all struggle to hit that magic 33% of sessions with greater than 80% agreement we all learned about in graduate school. But, what if interobserver agreement didnāt have to be that. What if we were thinking about IOA all wrong? This week we brush up on some of the basics of IOA procedures like āHow do I calculate IOA again?ā before moving on to more interesting research in the field like training folks to take good IOA and questioning the standard wisdom of how much IOA is good enough. Weāll be watching you! This episode is available for 1.0 LEARNING CEU. Articles discussed this episode: Hausman, N.L., Javed, N., Bednar, M.K., Guell, M., Schaller, E., Nevill, R.E., & Kahng, S. (2022). Interobserver agreement: A preliminary investigation into how much is enough? Journal of Applied Behavior Analysis, 55, 357-368. doi: 10.1002/jaba.811 Garrity, M.L., Luiselli, J.K., & McCollum, S.A. (2008). Effects of a supervisory intervention on assessment of interobserver agreement by educational service providers. Behavioral Interventions, 23, 105-112. doi: 10.1002/bin.258 Hartz, R.M., Gould, K., Harper, J.M., & Luiselli, J.K. (2020). Assessing interobserver agreement (IOA) with procedural integrity: Evaluation of training methods among classroom instructors. Child and Family Behavior Therapy, 43, 1-12. doi: 10.1080/00168890.2020.1848404 If you're interested in ordering CEs for listening to this episode, click here to go to the store page. You'll need to enter your name, BCBA #, and the two episode secret code words to complete the purchase. Email us at
[email protected] for further assistance.