Title
Using cognitive interviews with children to test the content validity of a paediatric patient reported experience measure
Link to article in PubMed
Author(s)
Barr, Karlen R
Fortunati, Erika
Studniberg, Zachary
Nikolovski, Jessica
White, Leslie
Elliott, Sarah
McCartney, Lynn
Smith-McCue, Dianna
Swaminathan, Girish
John, James R
Treadgold, Claire
Hall, Aaron
Dadich, Ann
Vernon, Barb
Toscano, Elesha
Hiscock, Harriet
Chow, Josephine
Johnston, Leanne
Whitehead, Lisa
Foster, Mandie
Sung, Valerie
Eapen, Valsamma
Abstract
BACKGROUND: Paediatric patient reported experience measures (pPREMs) can help children's voices be heard to evaluate and improve healthcare delivery. However, no standardised child-completed pPREM has been co-designed with children and validated in Australia. This research aimed to test the content validity of a co-created pPREM using an iterative, participatory approach with children.
METHODS: 21 children aged 6-11 years were recruited across four Australian hospitals. Children participated in online cognitive interviews to evaluate pPREM items and rating scales (using 'stars' or 'smiley faces') for their understandability, usability, relevance and importance related to their needs in hospital. Framework analysis was conducted iteratively, with items refined after the first round of interviews based on children's feedback.
RESULTS: Most (n=20; 95%) children understood the instructions. After nine interviews, two items were revised: 'Someone I knew could stay with me' changed to 'Family and friends could be with me' and 'I was able to talk to other patients', to 'I was able to talk to other kids in hospital'. Following these revisions, all children understood most (13 of 18=72%) items. In the remaining five items, some phrases, such as 'Care and treatment', were not easily understood, and items were edited according to children's feedback. Most children (n=14; 67%) preferred the 'smiley faces' rating system, and 83% (n=15) reported the number of questions as the right amount. Children generally found all items important, although some items did not apply to all and a 'Does not apply to me' response option was added.
CONCLUSIONS: Children aged 6-11 years can meaningfully engage with a co-designed pPREM. Cognitive interviews and an iterative approach helped identify and rectify comprehension issues. It is feasible to involve children in the design of pPREMs and doing so strengthens pPREMs' usability and understandability.
METHODS: 21 children aged 6-11 years were recruited across four Australian hospitals. Children participated in online cognitive interviews to evaluate pPREM items and rating scales (using 'stars' or 'smiley faces') for their understandability, usability, relevance and importance related to their needs in hospital. Framework analysis was conducted iteratively, with items refined after the first round of interviews based on children's feedback.
RESULTS: Most (n=20; 95%) children understood the instructions. After nine interviews, two items were revised: 'Someone I knew could stay with me' changed to 'Family and friends could be with me' and 'I was able to talk to other patients', to 'I was able to talk to other kids in hospital'. Following these revisions, all children understood most (13 of 18=72%) items. In the remaining five items, some phrases, such as 'Care and treatment', were not easily understood, and items were edited according to children's feedback. Most children (n=14; 67%) preferred the 'smiley faces' rating system, and 83% (n=15) reported the number of questions as the right amount. Children generally found all items important, although some items did not apply to all and a 'Does not apply to me' response option was added.
CONCLUSIONS: Children aged 6-11 years can meaningfully engage with a co-designed pPREM. Cognitive interviews and an iterative approach helped identify and rectify comprehension issues. It is feasible to involve children in the design of pPREMs and doing so strengthens pPREMs' usability and understandability.
Publication information
BMJ Paediatr Open . 2026 Sep 25;10(1):e004589. doi: 10.1136/bmjpo-2026-004589.
File(s)![Thumbnail Image]()
Loading...
Name
e004589full.pdf
Description
Re-used under a Creative Commons Attribution License: https://creativecommons.org/licenses/by/4.0/
Size
557.49 KB
Format
Adobe PDF
Checksum
(MD5):af8bc603afa5955efa733eb1f04e2829
Date Issued
2026-09-25
Type
Journal Article
Journal Title
BMJ paediatrics open
Permanent link to this record
ISSN
2399-9772
Journal Volume Number
10
Pages
e004589
Owning collection
