Dynamic support database clinical support tool: inter-rater reliability

Abstract

Purpose

The dynamic support database (DSD) clinical support tool structures the risk of admission rating for individuals with intellectual disabilities. This study aims to investigate inter-rater reliability between multi-disciplinary health care professionals within the North West of England.

Design/methodology/approach

A small-scale quantitative study investigated reliability between raters on the DSD clinical support tool. A data set of 60 rating tools for 30 individuals was used. Descriptive statistics and Kappa coefficient explored agreement.

Findings

The DSD clinical support tool was found to have strong inter-rater reliability between individual items and the differences between individual scores were spread suggesting variance found could not be attributed to specific questions. Strong inter-rater reliability was found in the overall ratings.

Research limitations/implications

Results suggest the DSD clinical support tool provides stratification for risk of admission ratings independent of who completes it. Future studies could investigate inter-rater reliability between organisations, i.e. health and social care professionals, and use a larger data sample to ensure generalisability. Replication of the study within child and adolescent services using the children’s DSD clinical support tool is also recommended.

Originality/value

The DSD clinical support tool has been implemented within the child and adult intellectual disability services across the North West. As more teams across England consider its implementation, the study provides reassurance that coding agreement is high, allowing for stratification for risk of admission independent of the rater.

Citation

Bohen, F. and Woodrow, C. (2020), "Dynamic support database clinical support tool: inter-rater reliability", Advances in Mental Health and Intellectual Disabilities, Vol. 14 No. 2, pp. 25-32. https://doi.org/10.1108/AMHID-09-2019-0027