Scheeringa, M,. Haslett, N. (2010) The reliability and Criterion Validity of the Diagnostic Infant and Preschool Assessment: A New Diagnostic Instrument for Young Children. Child Psychiatry and Human development. 41, 299-312.
Test-Retest reliability NOTES:
Intraclass Correlation Coefficients (ICC) reliability statistics are out of 7 disorders tested (ADHD, ODD, MDD, PTSD, SAD, GAD, OCD).
In regards to PTSD, reliabilities were calculated for four different PTSD outcomes: DSM-IV without the criterion of impairment, the PTSD alternative algorithm (PTSD-AA) with the criterion of impairment, PTSD-AA without the criterion of impairment, and functional impairment alone (there were insufficient cases to calculate reliabilities for DSM-IV with the criterion of impairment). The PTSD-AA was developed as a more developmentally appropriate, reliable and valid criteria for preschoolers than the DSM-IV (Scheeringa et al, 1995, 2001, 2003). The individual results are below:
|DSM IV without impairment||0.37||0.87|
|PTSD-AA without impairment||0.56||m/a|
|PTSD-AA without impairment||0.67||0.87|
|Functional impairment alone||0.42||0.38|
*Scheeringa & Haslett, 2010
For the other disorders, the reliabilities of continuous measures (ICC’s) were large (r > 0.50) for ADHD-inattentive, ADHD-hyperactive, ODD, and SAD. The ICC’s for MDD and GAD were medium (0.30 < r < 0.50). The ICC for OCD was small (0.10 < r < 0.30). The sample was not highly symptomatic with the disorders that had medium and small reliabilities, which may explain those lower reliabilities. The median ICC was 0.69, and mean was 0.61.
For disorder with impairment, the reliabilities of categorical diagnoses (kappa’s) were substantial (kappa 0.6–0.8) for one disorder (MDD), fair to good (kappa 0.4–0.6) for four disorders (ADHD-inattentive, ADHD-hyperactive, PTSD-AA, and SAD), and poor (kappa
0–0.4) for one (ODD). No cases of OCD with impairment were diagnosed by the one set of interviewers, so kappa’s could not be computed. The median kappa was 0.53, and mean was 0.52.