Thank you for downloading this publication. Please let us know why you chose this publication:
Why are you interested in this publication?
What organisation do you represent?
You will only need to complete this form once per browser/device
How do you prefer to read or receive publications?

We may contact you for feedback on the publication you have downloaded. If you do not want to be contacted, please leave the email field blank. Your information will never be shared with any third party.

Malaria Consortium US Donate
  • About us
    • Who we are
    • Our Strategy
    • Governance
    • Aid transparency
  • Projects
  • Where We Work
  • What we do
    • Diseases
    • Our responses
    • Burden reduction to elimination
    • Data-informed decision-making & digital approaches
    • Health sector resilience
    • Research & policy change
    • Networks & partnerships
  • News & Resources
    • News
    • Blog
    • Videos
    • Webinars
    • Photo stories
  • Publications
    • Interactive publications
  • Support us
  • Contact Us
    • Newsletter
  • Work with us
    • Tenders
  • Home
  • »
  • Publications
  • »
  • Evaluating the interrater agreement and acceptability of a new reference tool for assessing respiratory rate in children under five with cough and/or difficulty breathing

Share this page

Resources

Latest

Publications

Publication Date:
13/06/2021

Type:
Journal article
Publication

Evaluating the interrater agreement and acceptability of a new reference tool for assessing respiratory rate in children under five with cough and/or difficulty breathing
Author(s): Ann-Sophie Stratil, Charlotte Ward, Tedila Habte, Alice Maurel, Max Antson, Elina Naydenova, Kevin Baker

Publication Date:
13/06/2021
Type:
Journal article

Background

Manual assessment of respiratory rate (RR) in children is unreliable, but remains the main method to diagnose pneumonia in low-resource settings. While automated RR counters offer a potential solution, there is currently no gold standard to validate these diagnostic aids. A video-based reference tool is proposed that allows users to annotate breaths and distortions including movement periods, allowing the exclusion of distortions from the computation of RR measures similar to how new diagnostic aids account for distortions automatically. This study evaluated the interrater agreement and acceptability of the new reference tool.

Methods

Annotations were based on previously recorded reference videos of children under five years old with cough and/or difficulty breathing (n = 50). Five randomly selected medical experts from a panel of ten annotated each video. RR measures (breaths per minute, bpm) were computed as the number of annotated certain breaths divided by the length of calm periods after removing annotated distorted periods.

Results

Reviewers showed good interrater agreement on continuous RR {standard error of measurement (SEM) [4.8 (95 percent CI 4.4–5.3)]} and substantial agreement on classification of fast breathing (Fleiss kappa, 0.71). Agreement was lowest in the youngest age group [< two months: SEM 6.2 (5.4–7.4) bpm, k 0.48; 2–11 months: 4.7 (4.0–5.8) bpm, k 0.84; 12–59 months: 2.6 (2.2–3.1) bpm, k 0.8]. Reviewers found the functionalities of the tool helpful in annotating breaths, but remained uncertain about the validity of their annotations.

Conclusions

Before the new tool can be considered a reference standard for RR assessments, interrater agreement in children younger than two months must be improved.

Published in Journal of Tropical Pediatrics

Click here to download

Country: Ethiopia | South Sudan | Uganda

Keywords: Research | Pneumonia | Case management | Diagnosis | Quality improvement | SDG3

 

 

« Back to Publications

Sign up for our newsletter here:

Follow us on our social channels
  • Jobs
  • Contact us
  • Annual reviews
  • Support us
  • About us
  • Sitemap
  • Policies
  • Modern Slavery Statement
Fundraising Regulator logo
© 2023 Malaria Consortium | Charity No. 1099776 | Company No. 4785712