Document Type : Original Article

Authors

1 Communicable Disease Control Unit, Centre for Disease Control, Kelantan State Health Department, Jalan Mahmood Kota Bharu 15200 Kelantan, Malaysia

2 Public Health Division, Kelantan State Health Department, Wisma Persekutuan, Tingkat 5, Jalan Bayam, Kelantan, 15590 Kota Bharu, Kelantan, Malaysia

Abstract

Background and aims: Accurate and timely diagnosis is crucial for coronavirus disease 2019 (COVID-19) outbreaks. Antigen-detecting rapid diagnostic tests (Ag-RDTs) are easily accessible and affordable, producing rapid results. They are an alternative to the limited gold-standard real-time reverse-transcription polymerase chain reaction (rRT-PCR) tests. This study assessed the performance of Ag-RDTs for COVID-19 outbreaks in institutional settings with high disease prevalence in Kelantan State, Malaysia.
 
Methods: This study analyzed a total of 303 individuals from five institutional outbreaks with paired nasopharyngeal specimens tested for COVID-19 by Ag-RDTs and rRT-PCR. The diagnostic performance of Ag-RDTs was evaluated through rRT-PCR as the gold standard based on cycle threshold (Ct) value, disease prevalence, and manufacturers.
 
Results: There was a moderate agreement between Ag-RDTs and RT-PCR (κ = 0.603; 95% CI: 0.520- 0.686; P < 0.001). The overall specificity was 97.9% (95% CI: 94.1%-99.6%), sensitivity was 63.3% (95% CI: 55.3%-70.8%), accuracy Ag-RDTs was 81.2% (95% CI: 76.4%-85.5%), while positive and negative predictive value was 96.6% (95% CI: 90.2%-98.9%) and 74.1% (95% CI: 70.0%-77.9%), respectively. Further, lower median Ct was reported in 100 (33.0%) true-positive cases compared to 58 (19.1%) false-negative cases (20.3 vs 31.4, P < 0.001). The sensitivity was higher (P < 0.001) in those with high viral load (Ct value ≤ 25.0) with better performance and a prevalence > 10%. In addition, no significant difference was observed between the studied manufacturers.
 
Conclusion: The Ag-RDTs performed well in diagnosing COVID-19 among outbreaks with higher viral load and disease prevalence. High-risk cases tested negative by Ag-RDTs may have low viral load and require confirmation by rRT-PCR.

Keywords

1. World Health Organization (WHO). Weekly Operational Update on COVID-19. WHO; 2021. 
2. Syal K. Guidelines on newly identified limitations of diagnostic tools for COVID-19 and consequences. J Med Virol. 2021;93(4):1837-42. doi: 10.1002/jmv.26673. 
3. World Health Organization (WHO). Antigen-Detection in the Diagnosis of SARS-Cov-2 Infection Using Rapid Immunoassays: Interim Guidance, 6 October 2021. WHO; 2021. 
4. World Health Organization (WHO). Diagnostic Testing for SARS-CoV-2: Interim Guidance, 11 September 2020. WHO; 2020. 
5. Rai P, Kumar BK, Deekshit VK, Karunasagar I, Karunasagar I. Detection technologies and recent developments in the diagnosis of COVID-19 infection. Appl Microbiol Biotechnol. 2021;105(2):441-55. doi: 10.1007/s00253-020-11061-5. 
6. Khatami F, Saatchi M, Tamehri Zadeh SS, Aghamir ZS, Namazi Shabestari A, Reis LO, et al. A meta-analysis of accuracy and sensitivity of chest CT and RT-PCR in COVID-19 diagnosis. Sci Rep. 2020;10(1):22402. doi: 10.1038/s41598-020-80061- 2. 
7. Long C, Xu H, Shen Q, Zhang X, Fan B, Wang C, et al. Diagnosis of the coronavirus disease (COVID-19): rRT-PCR or CT? Eur J Radiol. 2020;126:108961. doi: 10.1016/j. ejrad.2020.108961. 
8. Baro B, Rodo P, Ouchi D, Bordoy AE, Saya Amaro EN, Salsench SV, et al. Performance characteristics of five antigen-detecting rapid diagnostic test (Ag-RDT) for SARS-CoV-2 asymptomatic infection: a head-to-head benchmark comparison. J Infect. 2021;82(6):269-75. doi: 10.1016/j.jinf.2021.04.009. 
9. Boum Y, Fai KN, Nikolay B, Mboringong AB, Bebell LM, Ndifon M, et al. Performance and operational feasibility of antigen and antibody rapid diagnostic tests for COVID-19 in symptomatic and asymptomatic patients in Cameroon: a clinical, prospective, diagnostic accuracy study. Lancet Infect Dis. 2021;21(8):1089-96. doi: 10.1016/s1473- 3099(21)00132-8. 
10. Dinnes J, Deeks JJ, Berhane S, Taylor M, Adriano A, Davenport C, et al. Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection. Cochrane Database Syst Rev. 2021;3(3):CD013705. doi: 10.1002/14651858. CD013705.pub2. 
11. Brümmer LE, Katzenschlager S, Gaeddert M, Erdmann C, Schmitz S, Bota M, et al. The accuracy of novel antigen rapid diagnostics for SARS-CoV-2: a living systematic review and meta-analysis. medRxiv [Preprint]. March 1, 2021. Available from: https://www.medrxiv.org/ content/10.1101/2021.02.26.21252546v1. 
12. Mak GCK, Lau SSY, Wong KKY, Chow NLS, Lau CS, Lam ETK, et al. Evaluation of rapid antigen detection kit from the WHO Emergency Use List for detecting SARS-CoV-2. J Clin Virol. 2021;134:104712. doi: 10.1016/j.jcv.2020.104712. 
13. Berger A, Nsoga MTN, Perez-Rodriguez FJ, Aad YA, Sattonnet- Roche P, Gayet-Ageron A, et al. Diagnostic accuracy of two commercial SARS-CoV-2 antigen-detecting rapid tests at the point of care in community-based testing centers. PLoS One. 2021;16(3):e0248921. doi: 10.1371/journal.pone.0248921. 
14. World Health Organization (WHO). COVID-19 Target Product Profiles for Priority Diagnostics to Support Response to the COVID-19 Pandemic. WHO; 2020. 
15. Centers for Disease Control and Prevention (CDC). Interim Guidance for Antigen Testing for SARS-Cov-2. CDC; 2021. 
16. Malaysia Ministry of Health. Guideline COVID-19 Management. No.5/2020 ed2020. 
17. Kanaujia R, Ghosh A, Mohindra R, Singla V, Goyal K, Gudisa R, et al. Rapid antigen detection kit for the diagnosis of SARS-CoV-2-are we missing asymptomatic patients? Indian J Med Microbiol. 2021;39(4):457-61. doi: 10.1016/j. ijmmb.2021.07.003. 
18. Schwob JM, Miauton A, Petrovic D, Perdrix J, Senn N, Jaton K, et al. Antigen rapid tests, nasopharyngeal PCR and saliva PCR to detect SARS-CoV-2: a prospective comparative clinical trial. medRxiv [Preprint]. November 24, 2020. Available from: https://www.medrxiv.org/ content/10.1101/2020.11.23.20237057v1. 
19. Zhu W, Zeng N, Wang N. Sensitivity, specificity, accuracy, associated confidence interval and ROC analysis with practical SAS implementations. NESUG proceedings: Health Care and Life Sciences; Baltimore, Maryland; 2010. 
20. Hajian-Tilaki K. Sample size estimation in diagnostic test studies of biomedical informatics. J Biomed Inform. 2014;48:193-204. doi: 10.1016/j.jbi.2014.02.013. 
21. Bruzzone B, De Pace V, Caligiuri P, Ricucci V, Guarona G, Pennati BM, et al. Comparative diagnostic performance of rapid antigen detection tests for COVID-19 in a hospital setting. Int J Infect Dis. 2021;107:215-8. doi: 10.1016/j. ijid.2021.04.072. 
22. Hayer J, Kasapic D, Zemmrich C. Real-world clinical performance of commercial SARS-CoV-2 rapid antigen tests in suspected COVID-19: a systematic meta-analysis of available data as of November 20, 2020. Int J Infect Dis. 2021;108:592- 602. doi: 10.1016/j.ijid.2021.05.029. 
23. Van Walle I, Leitmeyer K, Broberg EK. Meta-analysis of the clinical performance of commercial SARS-CoV-2 nucleic acid, antigen and antibody tests up to 22 August 2020. medRxiv [Preprint]. September 18, 2020. Available from: https://www. medrxiv.org/content/10.1101/2020.09.16.20195917v1. 
24. Wagenhäuser I, Knies K, Rauschenberger V, Eisenmann M, McDonogh M, Petri N, et al. Clinical performance evaluation of SARS-CoV-2 rapid antigen testing in point of care usage in comparison to RT-qPCR. medRxiv [Preprint]. March 29, 2021. Available from: https://www.medrxiv.org/ content/10.1101/2021.03.27.21253966v1. 
25. Peña-Rodríguez M, Viera-Segura O, García-Chagollán M, Zepeda-Nuño JS, Muñoz-Valle JF, Mora-Mora J, et al. Performance evaluation of a lateral flow assay for nasopharyngeal antigen detection for SARS-CoV-2 diagnosis. J Clin Lab Anal. 2021;35(5):e23745. doi: 10.1002/jcla.23745. 
26. Leeflang MM, Rutjes AW, Reitsma JB, Hooft L, Bossuyt PM. Variation of a test’s sensitivity and specificity with disease prevalence. CMAJ. 2013;185(11):E537-44. doi: 10.1503/ cmaj.121286. 
27. Medical Device Authority. List of Recommended for Use of COVID-19 IVD Test Kit (Professional Use Only). Malaysia: Ministry of Health; 2021. Available from: https://portal.mda. gov.my/announcement/596-list-of-recommended-for-use-of-covid-19-ivd-test-kit.html. Accessed 2021.