scieee Science in your language
[en] (orig)

Development of an expert-based scoring system for early identification of patients with inborn errors of immunity in primary care settings – the PIDCAP project

Abstract

Early diagnosis of inborn errors of immunity (IEIs) has been shown to reduce mortality, morbidity, and healthcare costs. The need for early diagnosis has led to the development of computational tools that trigger earlier clinical suspicion by physicians. Primary care professionals serve as the first line for improving early diagnosis. To this end, a computer-based tool (based on extended Jeffrey Modell Foundation (JMF) Warning Signs) was developed to assist physicians with diagnosis decisions for IEIs in the primary care setting. Two expert-guided scoring systems (one pediatric, one adult) were developed. IEI warning signs were identified and a panel of 36 experts reached a consensus on which signs to include and how they should be weighted. The resulting scoring system was tested against a retrospective registry of patients with confirmed IEI using primary care EHRs. A pilot study to assess the feasibility of implementation in primary care was conducted. The scoring system includes 27 warning signs for pediatric patients and 24 for adults, adding additional clinically relevant criteria established by expert consensus to the JMF Warning Signs. Cytopenias, ≥ 2 systemic infections, recurrent fever and bronchiectasis were the leading warning signs in children, as bronchiectasis, autoimmune diseases, cytopenias, and > 3 pneumonias were in adults. The PIDCAP (Primary Immune Deficiency “Centre d’Atenció Primària” that stands for Primary Care Center in Catalan) tool was implemented in the primary care workstation in a pilot area. The expert-based approach has the potential to lessen under-reporting and minimize diagnostic delays of IEIs. It can be seamlessly integrated into clinical primary care workstations.

Read accessible full text

Development of an expert-based scoring system for early identification of patients with inborn errors of immunity in primary care settings – the PIDCAP project

Author: Rivière, Jacques G.; Carot-Sans, Gerard; Piera-Jiménez, Jordi; de la Torre, Sergi; Santos Pérez, Juan Luis; Rodrigo, Carlos; Olbrich, Peter; Soler-Palacin, Pere
Publisher: Springer
Year: 2025
DOI: 10.1007/s10875-024-01825-3
Source: https://idus.us.es/bitstreams/016bb2e2-900b-4c1e-a8fd-077c8c2e02b9/download
Vol.:(0123456789)
Jou nal o Clinical Immunology (2025) 45:26
h ps://doi.o g/10.1007/s10875-024-01825-3
RESEARCH
De elopmen o anExpe ‑Based Sco ing Sys em o Ea ly
Iden i ica ion o Pa ien s wi hInbo n E o s o Immuni y inP ima y
Ca e Se ings – hePIDCAP P ojec
JacquesG.Ri iè e1,2,3,4· Ge a dCa o ‑Sans5,6· Jo diPie a‑Jiménez5,6,7· Se gidelaTo e5,6· PIDCAP expe g oup·
Xa ie Cos8,9· Xa ie Se a‑Picamal8· Pe eSole ‑Palacin1,2,3,4
Recei ed: 13 Ap il 2024 / Accep ed: 10 Oc obe 2024
© The Au ho (s) 2024
Abs ac
Ea ly diagnosis o inbo n e o s o immuni y (IEIs) has been shown o educe mo ali y, mo bidi y, and heal hca e cos s. The
need o ea ly diagnosis has led o he de elopmen o compu a ional ools ha igge ea lie clinical suspicion by physicians.
P ima y ca e p o essionals se e as he i s line o imp o ing ea ly diagnosis. To his end, a compu e -based ool (based on
ex ended Je ey Modell Founda ion (JMF) Wa ning Signs) was de eloped o assis physicians wi h diagnosis decisions o
IEIs in he p ima y ca e se ing. Two expe -guided sco ing sys ems (one pedia ic, one adul ) we e de eloped. IEI wa n-
ing signs we e iden i ied and a panel o 36 expe s eached a consensus on which signs o include and how hey should be
weigh ed. The esul ing sco ing sys em was es ed agains a e ospec i e egis y o pa ien s wi h con i med IEI using p i-
ma y ca e EHRs. A pilo s udy o assess he easibili y o implemen a ion in p ima y ca e was conduc ed. The sco ing sys em
includes 27 wa ning signs o pedia ic pa ien s and 24 o adul s, adding addi ional clinically ele an c i e ia es ablished by
expe consensus o he JMF Wa ning Signs. Cy openias, ≥ 2 sys emic in ec ions, ecu en e e and b onchiec asis we e he
leading wa ning signs in child en, as b onchiec asis, au oimmune diseases, cy openias, and > 3 pneumonias we e in adul s.
The PIDCAP (P ima y Immune De iciency “Cen e d’A enció P imà ia” ha s ands o P ima y Ca e Cen e in Ca alan) ool
was implemen ed in he p ima y ca e wo ks a ion in a pilo a ea. The expe -based app oach has he po en ial o lessen unde -
epo ing and minimize diagnos ic delays o IEIs. I can be seamlessly in eg a ed in o clinical p ima y ca e wo ks a ions.
Keywo ds Inbo n e o s o immuni y· p ima y immunode iciencies· Je ey Modell Founda ion· wa ning signs· a e
disease· expe -d i en sco ing sys em· ea ly diagnosis· compu e -assis ed medicine
* Jacques G. Ri iè e
[email p o ec ed]
* Pe e Sole -Palacin
pe e.sole @ allheb on.ca
1 In ec ion andImmuni y inPedia ic Pa ien s Resea ch
G oup, Vall d’Heb on Ins i u de Rece ca (VHIR),
Ba celona, Ca alonia, Spain
2 Pedia ic In ec ious Diseases andImmunode iciencies Uni ,
Hospi al In an il I de La Dona Vall d’Heb on, Vall d’Heb on
Ba celona Hospi al Campus, Ba celona, Ca alonia, Spain
3 P esen Add ess: Uni e si a Au ònoma de Ba celona (UAB),
Ba celona, Ca alonia, Spain
4 Je ey Modell Diagnos ic andResea ch Cen e o P ima y
Immunode iciencies, Ba celona, Ca alonia, Spain
5 Ca alan Heal h Se ice, Ba celona, Ca alonia, Spain
6 Digi aliza ion o  heSus ainabili y o  heHeal hca e Sys em
(DS3) Resea ch G oup, L’Hospi ale deLlob ega , Ca alonia,
Spain
7 Facul y o In o ma ics, Mul imedia andTelecommunica ions,
Uni e si a Obe a de Ca alunya, Ba celona, Spain
8 Ins i u Ca alà de La Salu (ICS), Ba celona, Ca alonia, Spain
9 The Founda ion Uni e si y Ins i u e o P ima y Heal h Ca e
Resea ch Jo di Gol I Gu ina (IDIAPJGol), Ba celona, Spain
Jou nal o Clinical Immunology (2025) 45:26 26 Page 2 o 13
In oduc ion
Inbo n E o s o Immuni y (IEIs), also known as p i-
ma y immunode iciencies (PI), a e a ca ego y o diseases
de ined by he p esence o a comp omised immune sys-
em, mainly as a esul o a single-gene loss-o - unc ion o
gain-o - unc ion mu a ion. IEIs a y in he mechanism o
ac ion, mode o inhe i ance, p e alence, and se e i y. They
ha e adi ionally been cha ac e ized by an inc ease in sus-
cep ibili y o se e e and ecu en in ec ions in he ea ly
yea s o li e, wi h many pa ien s ha ing a poo p ognosis
wi h educed quali y o li e and high a es o mo ali y [1].
Howe e , pa ien s wi h IEIs a e now known o p esen wi h
a wide ange o p esen a ions and an inc easing numbe o
clinical pheno ypes. In addi ion o an inc eased equency
o in ec ions, he de elopmen o immune dys egula ion
and au oimmuni y, cance , and alle gy a e also associa ed
wi h IEIs [1–4].While indi idual IEIs may be a e, wi h as
ew as one o wo cases epo ed in he li e a u e, hey col-
lec i ely accoun o a signi ican bu den o disease [5, 6].
Ea ly diagnosis o IEIs has been shown o educe a es
o pa ien mo ali y and mo bidi y, heal hca e cos s, and
imp o e quali y o li e o pa ien s [6–10]. While he diag-
nos ic delay o IEI a e he i s p esen a ion o symp-
oms is dec easing, i is s ill ypically be ween 1–4yea s
wo ldwide and 2–5yea s wi hin Eu ope, depending on he
coun y and he IEI [11]. Low awa eness o IEIs and lack
o esou ces a e among he p ima y causes o diagnos ic
delay [12–15]. The need o ea ly diagnosis o IEIs has
led o he de elopmen o ools ha may igge ea lie
clinical suspicion o IEIs by p ima y ca e physicians and
pedia icians, which in u n could lead o ea lie diagnosis
and managemen . The mos well-known o hese ools is
he SPIRIT analyze which is based upon he 10 Wa n-
ing Signs o P ima y Immunode iciency (JMF Wa ning
Signs), c ea ed by he Je ey Modell Founda ion in 1993
and upda ed wice since. The ool is based on a lis o
common wa ning signs aimed o help physicians iden i y
indi iduals wi h a suspec ed IEI, a ailable sepa a ely o
pedia ic and adul pa ien s. The e ec i eness o he JMF
Wa ning Signs has o en been e alua ed ega ding hei
abili y o de ec IEIs ha p esen p ima ily as an inc eased
suscep ibili y o in ec ions bu he e a e limi a ions among
he b oade ange o IEI pheno ypes [16–21]. Seconda y
wa ning sign lis s ha e been p oduced in a emp s o aid
in he diagnosis o unde lying IEIs in a ious indica ions,
including lung disease, oncohema ology, gas oen e ol-
ogy, de ma ology, and in ec ious diseases, among o he s
[2, 4, 22]. P e ious a emp s o e ise he JMF Wa ning
Signs in ligh o newly ecognized wa ning signs ha e
also been made, hough mos lis s appea o be limi ed
o a simila numbe and spec um o o al wa ning signs,
wi h some e o s ocusing on aising awa eness p ima ily
in he p ima y ca e se ing [17]. Mo e ecen ly, a emp s
ha e been made o p oduce medical expe sys ems (com-
pu e ools o aid physicians in diagnosis and ea men
choices) o acili a e he diagnosis o IEI wi hin p ima y
ca e se ings [23–31]. These ools may o e a mo e mod-
e n solu ion o aise heal hca e p o essionals’ awa eness
and clinical suspicion wi hin a p ima y ca e se ing. How-
e e , unlike highly p e alen diseases, which can be mo e
easily in es iga ed using e ospec i e da a om elec onic
heal h eco ds (EHRs), a e diseases such as IEIs a e o en
unde epo ed o a e no p ope ly egis e ed. This ea u e
challenges he de elopmen o p edic i e sco ing sys ems
based on s a is ical o machine-lea ning app oaches, which
equi e la ge amoun s o high-quali y da a on bo h cases
and con ols.
Wi h his in mind, we p oduced an expe -based sco -
ing sys em, de eloped by bo h p ima y ca e physicians and
immunologis s in Spain, based on ex ended wa ning signs o
he o iginal 10 JMF Wa ning Signs, o be applied o p ima y
ca e se ings.
Me hods
S udy O e iew andSe ing
The PIDCAP p ojec aimed o de elop and implemen a
sco ing sys em o he ea ly iden i ica ion o indi iduals
wi h IEIs in he p ima y ca e se ing. The p ojec was led
by a ask o ce consis ing o he ollowing p o iles: clinical
expe s and esea che s om he Child en’s Hospi al a Vall
d’Heb on Ba celona Hospi al Campus (Ca alonia, Spain),
echnical s a om he Ca alan Ins i u e o Heal h (ICS),
p ima y ca e consul o s, and a coo dina o om Innobics—
a i ual esea ch pla o m allowing o he applica ion and
managemen o p ojec s p oposed by ICS p o essionals.
The PIDCAP sco ing sys em was in ended o be embedded
in o he clinical wo ks a ion o he Ca alan Heal h Se ice’s p i-
ma y ca e se ings. The Ca alan Heal h Se ice p o ides public,
uni e sal ca e o he en i e popula ion o Ca alonia (8 million
inhabi an s) h ough a ne wo k o 64 gene al hospi als, 27 psy-
chia y hospi als, 375 p ima y ca e cen e s, 91 skilled nu sing
acili ies o in e media e ca e, and 130 ou pa ien men al heal h
acili ies. All p ima y ca e cen e s o he Ca alan Heal h Se ice
sha e a single clinical wo ks a ion (i.e., he eCAP pla o m) and
s o e all clinical in o ma ion in a single clinical da a eposi o y.
The ul ima e goal o he PIDCAP sco ing sys em was o inco -
po a e a buil -in ale sys em in he eCAP o iden i y pa ien s a
high isk o ha ing an IEI and o subsequen ly igge a e e al
o expe s o u he IEI in es iga ion.
Jou nal o Clinical Immunology (2025) 45:26 Page 3 o 13 26
All da a gene a ed and used in his s udy we e han-
dled acco ding o he Gene al Da a P o ec ion Regula ion
2016/679 on da a p o ec ion and p i acy o all indi iduals
wi hin he Eu opean Union and he local egula o y ame-
wo k ega ding da a p o ec ion. P ocedu es we e app o ed
by he esea ch e hics commi ee o he coo dina ing cen e
PR(AMI)339/2017. By he ime o admission o specialized
assessmen , all his o ical clinical da a o he pa ien s, i e-
spec i e o he cen e hey egula ly isi ed, was eques ed
and included in he EHR o he admi ing hospi al.
Sco ing Sys em De elopmen
Two sco ing sys ems we e concei ed: one o he pedia ic
popula ion (i.e., younge han 14yea s, as de ined by he
Ca alan Heal h Se ice) and one o he adul popula ion
(i.e. 14yea s o age and olde ). We used a quali a i e Delphi
me hodology o de eloping he sco ing sys ems ha would
be u ilized by he PIDCAP ool. The en i e p ocess consis ed
o h ee phases: (1) iden i ica ion o wa ning signs o IEI and
p elimina y signi icance weigh ing, (2) expe consensus on
he inclusion and weigh ing o each sign wi hin he sco ing
sys ems, and (3) assignmen o s uc u ed disease codes o
he iden i ied wa ning signs.
Po en ial wa ning signs known o sugges he p esence
o an IEI in bo h adul and pedia ic pa ien s we e de e -
mined ia an in-dep h li e a u e e iew. PubMed and Google
Schola da abases we e sc eened o English-language a i-
cles epo ing s udies o iden i y isk ac o s o IEI, includ-
ing hose de eloping and/o alida ing sco ing sys em o his
end. The sea ch combined key e ms (including a ian s wi h
he same oo e ms) ega ding p ima y immunode iciencies
and wa ning signs o sc eening s a egies. Sea ches we e
es ic ed om 1993 onwa d based on he i s published
lis o JMF wa ning signs, wi h no u he es ic ions. The
sea ch s a egy and esul a e desc ibed in he Supplemen-
a y Ma e ial. The ask o ce membe s e iewed all a icles
and ex ac ed he isk ac o s, hen collabo a ed wi h 8 local
expe s (consis ing o 3 pedia ic immunologis s, 1 p ima y
ca e pedia ician, 3 adul immunologis s, and 1 p ima y ca e
gene al p ac i ione ) o come up wi h an ini ial lis o wa n-
ing signs and hei weigh ing wi hin he sco ing sys em, by
means o a sco e be ween 10 and 75. Cu -o alues we e
a bi a ily es ablished: high isk (sco e ≥ 75), mode a e isk
(35–70), and low isk (< 35).
Fo he second phase, we se up a panel o expe s o a e
he ele ance o each o he p e-iden i ied wa ning signs
and i s ela i e con ibu ion (i.e., weigh ). We selec ed 36
expe s om ac oss e e ence cen e s in Ca alonia and Spain
a ending o pedia ic and/o adul pa ien s wi h IEIs, and
p ima y ca e physicians o hei expe ise and ealis ic iew
o p ima y ca e pi alls. Candida es we e in i ed o pa ici-
pa e ia email ques ionnai e wi h a esponse deadline se
5weeks ollowing in i a ion. Accompanying he ques ion-
nai e, he en olled expe s also ecei ed a summa y o he
chosen li e a u e, as well as in o ma ion on he a ionale and
backg ound o he PIDCAP p ojec o con ex . Expe s we e
asked o a e he inclusion and he sugges ed weigh ing o
each wa ning sign on a 1- o-4 scale based on hei ela i e
pe cei ed signi icance in he clinical suspicion o an unde -
lying IEI. Expe s could also sugges al e na i e weigh ings.
Consensus was conside ed when a gi en sign/weigh
sco ed 3 o highe by a leas hal o he pa icipa ing expe s.
In cases in which consensus o he sugges ed weigh ing o a
wa ning sign was no eached, hey we e ee alua ed by he
local ask o ce based on expe eedback. I ems no eaching
consensus could be ei he emo ed o ede ined. The inal
adul and pedia ic sco ing sys ems we e sen o he expe s,
along wi h he esul s o he consensus p ocess; he expe s
we e o e ed he oppo uni y o sugges inal amendmen s i
deemed necessa y.
Finally, he local ask o ce ansla ed he lis o wa ning
signs ( ypically epo ed in he li e a u e in na u al language)
in o codes o he In e na ional Classi ica ion o Diseases
e sion 10, Clinical Modi ica ion (ICD-10-CM).
Re ospec i e Tes ing in heIEI Coho
The esul ing sco ing sys em was es ed agains a e ospec-
i e egis y o pa ien s wi h con i med IEI a he coo dina -
ing cen e , using da a om hei p ima y ca e EHR. The
Vall d’Heb on Ba celona Hospi al Campus is ecognized
as a e e ence cen e egionally and na ionally and i is one
o he 3 ecognized Eu opean Re e ence Ne wo k o Ra e
Immunological Diso de s (ERN-RITA) cen e s o IEI in
Spain. The hospi al se es mo e han 950,000 pa ien s pe
yea e e ed om local p ima y heal h ca e (wi h a ca ch-
men popula ion o mo e han 500,000 indi iduals), bu also
e e ed om all o e Spain (especially in a e diseases).
Pedia ic and adul pa ien s diagnosed wi h an IEI and
egis e ed in he hospi al da abase be ween Ap il 2005 and
Janua y 2023 we e included in he analysis da ase . Da a on
p e ious diagnoses we e c oss- abula ed wi h he heal hca e
egis y o diagnoses o he Ca alan Minis y o Heal h,
which collec s all diagnoses epo ed o he SISAP cen al
egis y o p ima y ca e. The ollowing indi iduals we e
excluded: pedia ic pa ien s wi h selec i e IgA de iciency,
usually asymp oma ic; adul indi iduals wi h less han 5
diagnosis en ies in he p ima y ca e egis y (co esponding
o p10 o he numbe o adul diagnosis dis ibu ion) we e
conside ed non- ep esen a i e on he assump ion ha less
han 5 diagnosis en ies mean ha he e we e no ollowed
wi hin he public, uni e sal p ima y ca e sys em bu a he
ollowed by ei he a p i a e heal hca e sys em o ou side o
Ca alonia.
Jou nal o Clinical Immunology (2025) 45:26 26 Page 4 o 13
Jou nal o Clinical Immunology (2025) 45:26 Page 5 o 13 26
All pa ien s in he analysis da ase we e e alua ed using
he sco ing sys em, based on hei his o y o diagnoses
eco ded in he p ima y ca e egis y be o e IEI diagnosis.
Fo he e ospec i e es , he wa ning sign o ‘con i med
IEI’, in oduced o he sco ing sys em o ensu e adequa e
ollow-up o indi iduals wi h p e ious IEI diagnosis, was
emo ed as all indi iduals in he egis y al eady me he
c i e ia. We es ima ed he numbe and pe cen age o indi-
iduals alloca ed by he sco ing sys em in each o he isk
ca ego ies and he equency and pe cen age o each o he
wa ning signs. The analysis consis ed o desc ip i e s a is-
ics, and no hypo hesis es ing was conduc ed.
Pilo Implemen a ion inRou ine Ca e
In Ap il 2018, a pilo s udy was ini ia ed o es he ea-
sibili y o using he PIDCAP sco ing sys em in a clinical
wo ks a ion o a p ima y ca e eam. The sco ing sys em was
made a ailable o all heal hca e p o essionals o he El Ca -
mel, Ba celona, p ima y ca e eam, which p o ides ca e o
a ca chmen popula ion o 19,391 indi iduals: 16,794 adul s
and 2,597 child en. The sco ing sys em ac i a ed an ala m
along wi h a e e al ecommenda ion o an expe e alua-
ion o all pa ien s iden i ied a high isk o IEI. All e e als
we e eco ded and communica ed o he PIDCAP ask o ce.
Fig. 1 Ag eemen e e s o he deg ee o ag eemen o disag eemen
wi h he p oposed i ems and hei weigh . Resul s om 16 su ey
esponden s, 11 o whom a e iden i ied as pedia ic immunologis s, 1
as an adul /gene al immunologis and 4 as p ima y ca e pedia icians.
HSV: He pes Simplex Vi us, IEI: inbo n e o s o immuni y
◂
Table 1 Wa ning signs included in he inal pedia ic sco ing sys em
a Wa ning sign c i e ia amended ollowing he esul s o he su ey based on addi ional eedback p o ided by he su eyed expe s, and o align
wi h eal-wo ld implemen a ion ia coding
b Wa ning sign added based on ecommenda ion om su eyed expe , la e e iewed and implemen ed by local ask o ce
Wa ning sign o ‘Food in ole ance/alle gy’ emo ed ollowing he esul o he su ey. Wa ning signs o ‘2 o mo e mon hs o an ibio ic ea -
men ’ and ‘3 o mo e hospi al admissions/yea ’ emo ed due o limi a ions in ICD-10-CM coding wi hin he elec onic heal h eco d sys em
Wa ning sign Weigh in sco -
ing sys em
Wa ning sign Weigh in sco ing
sys em
Pedia ic pa ien s
 ≥ 10 acu e o i is mediaa20 Sys emic au oimmune diseases, no including
au oimmune cy openia (celiac disease, a h i is,
e c.)
30
 ≥ 3 sinusi is o o bi al celluli isa20 Endoc inopa hology: Hypo hy oidism, hype pa -
a hy oidism, diabe es, e c. (No desc ibed as
au oimmune)
30
 ≥ 3 pneumoniaa40 Hema ological malignancy 30
 Failu e o h i e 20 Solid o gan neoplasia (only hose ha ha e been
associa ed wi h inbo n e o s o immuni y in
pedia ics: hy oid)
30
 Deep abscesses (in o gans) 75 O al (den al/pala al) anomalies 20
 ≥ 3 ecu en skin abscess 20 Ch onic dia hea; o ≥ 10 episodes o acu e
dia hea)a
30
 Mucocu aneous candidiasis (o opha ynx, cu ane-
ous, excluded aginal) in pa ien s ≥ 12 mon hs o
age: ≥ 2 episodesa
30 Ch onic i al skin in ec ion; o ≥ 20 acu e episodes 10
 ≥ 2 sys emic in ec ions (including sepsis) 75 Ch onic eczema o o he de ma ological mani es-
a ions ela ed o inbo n e o s o immuni y
10
 ≥ 1 se ious in ec ions ha alone indica e IEI s udy
(meningi is caused by HSV, e c.)
75 Recu en e e 75
 Family his o y o inbo n e o s o immuni ya50 In lamma o y bowel disease in pa ien s ≥ 2yea s
o age
30
 Consanguini y o o he amily his o y compa ible
wi h mani es a ions o inbo n e o s o immuni y
(lymphomas, e c.)a
30 In lamma o y bowel disease in pa ien s < 2yea s
o age
75
 Cy openia (no speci ied as au oimmune) 20 B onchiec asis wi hou cys ic ib osis 75
 Au oimmune cy openiaa40 Vaccine eac ionb20
 P esence o 2 o mo e wa ning signs 10

Jou nal o Clinical Immunology (2025) 45:26 26 Page 6 o 13
Jou nal o Clinical Immunology (2025) 45:26 Page 7 o 13 26
In addi ion o he PIDCAP sco ing sys em, a se ies o educa-
ional sessions in p ima y and e ia y ca e cen e s was ca ied
ou be ween Oc obe 2017 and Janua y 2018 o p epa e o he
loca ions ecei ing he PIDCAP sco ing sys em and o aise
awa eness and clinical suspicion o IEIs wi hin hese loca ions.
Also, a se ies o in og aphics we e p oduced o highligh he
po en ial wa ning signs o IEIs in di e en indica ions. Dissem-
ina ion o hese esou ces was success ully achie ed h oughou
he a ge a ea in line wi h he goals o he p ojec .
Resul s
Sco ing Sys em De elopmen
Wa ning signs o conside a ion we e ex ac ed om he li -
e a u e sea ch epo ing wa ning signs and isk ac o s o
p ima y immunode iciency, and om medical expe ience
o he ask o ce eam. The li e a u e e iew, ollowed by
collabo a ion wi h local expe s, yielded 28 wa ning signs
o he pedia ic lis and 22 o he adul lis .
O he su eyed panel o 36 expe s, 22 (61%) answe ed
he online su ey: 16 he ques ionnai e o pedia ics and
10 o adul s. The gene al cha ac e is ics o he expe s a e
summa ized in TableS1.
O he 28 wa ning signs o iginally included in he su -
ey o pedia ics, 27 (96%) eached he p e-es ablished
consensus h eshold (Fig.1); ood alle gy did no achie e
a minimum o 50% ag eemen o s ong ag eemen . A e -
age sco e anged om 2.8 o 4.0 (TableS2). A e aking
in o accoun he expe e iew, one wa ning sign (‘ ood
alle gy’) was emo ed, and one i em (‘p esence o cy o-
penia’) was u he sepa a ed in o sepa a e wa ning signs
(‘cy openia ( ega dless o au oimmune o no )’ and ‘au o-
immune cy openia’) wi h wo di e en weigh ings. Fu -
he mo e, wo u he i ems we e no used la e due o
limi a ions in p ima y ca e coding (‘ ≥ 3 hospi al admis-
sions/yea ’ and ‘ ≥ 2mon hs o an ibio ic ea men ’). The
weigh ing o en i ems was adjus ed based on low sco e,
ee commen s and coding limi a ions. One i em (‘ accine
eac ion’) was added acco ding o expe ecommenda-
ion, alida ed by he local ask o ce. Table1 shows he
inal sco ing sys em o he pedia ic popula ion, which
includes 27 wa ning signs.
Rega ding he adul su ey, all 22 wa ning signs
eached he consensus h eshold (Fig.2); he a e age
sco e anged om 2.9 o 3.9 (TableS3). One i em was
pa i ioned in o wo (as abo e, ‘p esence o cy openia’).
Likewise, one i em was no used due o coding limi a-
ions (‘ ≥ 3 hospi al admissions/yea ’), he weigh ing o 8
i ems was adjus ed based on low sco e, ee commen s and
coding limi a ions, and wo i ems (‘O al (den al/pala al)
anomalies’ and ‘ch onic eczema o o he de ma ological
mani es a ions ela ed o inbo n e o s o immuni y’) we e
added acco ding o expe ecommenda ion, and la e ali-
da ed. Table2 shows he inal sco ing sys em o adul s,
which includes 24 wa ning signs.
O he o al 68,000 possible ICD-10-CM codes
e iewed ollowing he su ey, 3,387 o pedia ics and
3,497 o adul s we e e ained and assigned o each wa n-
ing sign (See Supplemen a y Ma e ial o he ICD-10-CM
codes). Subsequen ly, he ask o ce adap ed he sco ing
sys em o he speci ica ions o he eCAP clinical compu e
sys em o he Ca alan Heal h Se ice, aking in o accoun
he changes in oduced a e he su ey. Each wa ning sign
was pai ed manually by he ask o ce wi h ICD codes as
speci ied ea lie . In ou ine ca e, each isi o he p ima y
ca e cen e is conside ed an episode by he sys em, and
coding wi h ICD is manda o y. Some WS we e assigned
a numbe o episodes o o e come in insic limi a ions o
he coding sys em (e.g., ch onic dia hea was decided o
be equi alen o 10 acu e episodes).
Re ospec i e Tes ing inanIEI Coho
O e all, 305 pa ien s (184 child en and 121 adul s) wi hin
he Vall d’Heb on Ba celona Hospi al Campus eco ds me
he selec ion c i e ia o IEI and we e, he e o e, included
in he s udy. The main demog aphic cha ac e is ics o he
pa ien s included in he s udy a e summa ized in TableS4
and he diagnosis g oup classi ica ion in TablesS5 andS6.
The sco ing sys em classi ied 60 (32%) pedia ic pa ien s
wi h con i med IEI as high- isk indi iduals (Table3); 47
(78%) had 2 o mo e wa ning signs. Ch onic eczema, cy o-
penias, wo o mo e sys emic in ec ions, ecu en e e , ail-
u e o h i e, and b onchiec asis in absence o cys ic ib osis
we e he leading wa ning signs. Howe e , ch onic eczema
and ailu e o h i e we e also p esen in indi idual child en
iden i ied as low- isk by he sco ing sys em.
The sco ing sys em classi ied 36 (30%) adul pa ien s
wi h con i med IEI as high- isk indi iduals (Table4).
Nea ly all o hem (33/36 (92%)) had 2 o mo e wa ning
signs. The mos equen wa ning sign among adul s iden i-
ied as high isk was b onchiec asi in he absence o cys ic
ib osis, ollowed by sys emic and endoc ine au oimmune
diseases, cy openias, and mo e han 3 pneumonias. O no e,
sys emic and endoc ine au oimmune diseases we e also p e-
sen in indi idual adul s iden i ied as low- isk by he sco ing
sys em.
Fig. 2 Ag eemen e e s o he deg ee o ag eemen o disag eemen
wi h he p oposed i ems and hei weigh ing. Resul s om 10 su ey
esponden s, 9 o whom a e iden i ied as adul immunologis s, and 1
as a p ima y ca e physician. HSV: He pes Simplex Vi us, IEI: Inbo n
e o s o immuni y, TB: Tube culosis
◂
Jou nal o Clinical Immunology (2025) 45:26 26 Page 8 o 13
Pilo Implemen a ion
Du ing he pilo implemen a ion pe iod, he PIDCAP sco -
ing sys em es ed 16,794 adul s and 2,597 child en; o
hem, 286 (1.8%) adul s and 13 (0.5%) child en we e iden-
i ied as high isk o IEI. TableS7 summa izes he main
demog aphic cha ac e is ics o he sou ce popula ion. P i-
ma y ca e physicians we e no i ied o ollow up wi h hese
pa ien s. An ale in each pa ien ’s EHR was displayed o he
p ima y ca e physician. These ale s speci ically ou lined he
ICD-10-CM codes conside ed, he pa ien ’s o e all sco e,
and ex ac ed he mos ecen blood coun along wi h any
eco ded immunoglobulin le els. Wi hin his ale sys em,
heal hca e p o essionals we e p esen ed wi h h ee ac iona-
ble op ions: (1) eques a undamen al immunological wo k-
up (inclusi e o a ull blood coun and immunoglobulin le -
els) and wai o he esul s o de e mine he nex s ep, (2)
i ually e e he pa ien o a specialized e e ence cen e , o
(3) a ange an in-pe son e e al isi o he e e ence cen e .
Addi ionally, p ima y ca e p o essionals had he disc e ion
o dismiss he ale i hey deemed ha e e al unnecessa y
due o an al e na i e explana ion o i he pa ien was al eady
being ollowed up. The wo k low was e y well ecei ed in
p ima y ca e cen e s. A e p ima y ca e assessmen , a o al
o 40 adul and 3 pedia ic pa ien s we e e e ed o u he
immunological e alua ion. Un o una ely, owing o he p i-
o i iza ion c i e ia du ing he global COVID-19 heal hca e
c isis, no u he ollow-up in o ma ion is a ailable.
Discussion
In his s udy, we de eloped an expe -based sco ing sys em o
iden i ying indi iduals wi h IEI based on diagnoses eco ded in
he p ima y ca e se ing. The esul ing sco ing sys em expanded
on he 10 classical wa ning signs conside ed o IEI sc eening
wi h addi ional clinically meaning ul i ems. The sco ing sys em,
which can be e ec i ely implemen ed in p ima y ca e wo ks a-
ions, showed he abili y o iden i y indi iduals a high- isk o
IEI using e ospec i e da a s o ed in p ima y ca e eco ds.
Table 2 Wa ning signs included in he inal adul sco ing sys em
a Wa ning sign c i e ia amended ollowing he esul s o he su ey based on addi ional eedback p o ided by he su eyed expe s, and o align
wi h eal-wo ld implemen a ion ia coding
b Wa ning sign added based on ecommenda ion om su eyed expe s, la e e iewed and implemen ed by local ask o ce. Wa ning signs o ‘3
o mo e hospi al admissions/yea ’ emo ed due o limi a ions in ICD-10-CM coding wi hin he elec onic heal h eco d Sys em
HSV He pes Simplex Vi us
Wa ning sign Weigh in sco ing
sys em
Wa ning sign Weigh in sco -
ing sys em
Adul pa ien s
 ≥ 8 acu e o i is mediaa30 Consanguini y o o he amily his o y compa ible
wi h mani es a ions o inbo n e o s o immuni y
(haema ological neoplasms)a
30
 ≥ 8 sinusi is o ch onic sinusi isa30 P esence o cy openia (wi hou speci ying i au oim-
mune)
20
 ≥ 3 pneumoniaa30 Au oimmune cy openia 40
 Ch onic dia hea 30 P esence o b onchiec asis wi hou cys ic ib osis 75
 Deep abscesses (in o gans and/o ganglia) 50 Sys emic and endoc ine au oimmune diseases (celiac
disease, a h i is, sys emic lupus, hy oidi is, e c.)
30
 Recu en skin abscesses o epe i ion (3 o
mo e)a
20 Haema ological neoplasia (excluding mul iple mye-
loma, ch onic myeloid leukemia, Waldens öm’s
disease, e c.)a
50
 O opha yngeal o cu aneous candidiasis
(excluding aginal candidiasis)
30 Solid o gan neoplasia (only hose ela ed wi h inbo n
e o s o immuni y: skin, s omach, hy oid)a
30
 Recu en i al in ec ions (colds, he pes, wa s,
condylomas, e c.) 25 o mo e episodesa
30 In lamma o y bowel disease 20
 2 o mo e sys emic in ec ions including sepsis 75 Recu en e e 50
 Unique se e e condi ion ha alone equi e s udy
o inbo n e o s o immuni y
75 O al (den al/pala al) anomaliesb20
 A ypical mycobac e ia in ec ion 50 Ch onic eczema o o he de ma ological mani es a-
ions ela ed o inbo n e o s o immuni yb
10
 Family his o y o inbo n e o s o immuni ya50
 P esence o 2 o mo e wa ning signs 10
Jou nal o Clinical Immunology (2025) 45:26 Page 9 o 13 26
The de elopmen o sco ing sys ems o algo i hms o
au oma ic and ea ly iden i ica ion o indi iduals a high
isk o IEI in he p ima y ca e se ing aces wo impo an
challenges o be conside ed. Fi s , he e y low numbe o
diagnoses hinde s he de elopmen o sophis ica ed s a is-
ical models o p edic he p esence o IEI wi h adequa e
accu acy [32]. Second, he sca ci y o sc eenings, including
gene ic in es iga ions on indi iduals wi h clinical ea u es
sugges i e o IEI has also been associa ed wi h high le els
o unde epo ing [15, 33, 34]. Thus, some indi iduals con-
side ed o be con ols in his sco ing sys em de elopmen
migh be undiagnosed cases.
Despi e hese challenges, se e al au ho s ha e wo ked
o expand he 10 JMF Wa ning Signs [6, 18, 34] mos ly by
including non-in ec ious como bidi ies, unde - ep esen ed
in he JMF lis , such as au oimmune diso de s [18], o
hema ological signs [6], among o he s. Likewise, he panel
o expe s who pa icipa ed in he PIDCAP s udy, iden i-
ied non-in ec ious condi ions, such as cy openia, sys emic
au oimmune diseases, and ch onic skin condi ions, which
may aise suspicion o an IEI and may be impo an wa n-
ing signs o IEI. These indings also aligned wi h p e ious
wo k by Dąb owska e al., who highligh ed he impo ance
o o he wa ning signs (hema ooncologics, au oimmuni y,
and eczema) wi h simila indings [35].
The applica ion o ou sco ing sys em should be con-
side ed wi hin i s in ended use, which is au oma ically
assessing he isk o IEI om in o ma ion s o ed in p i-
ma y ca e EHRs. This app oach p ecludes wa ning signs
ha a e no adequa ely epo ed o eliable in p ima y ca e
eco ds. This is he case o amily his o y o IEI, which
has been highligh ed as an impo an p edic o o IEI [16,
Table 3 The sco ing sys em classi ica ions o pedia ic pa ien s wi h con i med IEI
Wa ning signs Risk To al
High Medium Low
Pedia ic IEI coho e ospec i e es
 ≥ 10 acu e o i is media 3 1 0 4
 ≥ 3 sinusi is o o bi al celluli is 0 0 0 0
 ≥ 3 pneumonias 8 3 0 11
 Failu e o h i e 12 5 7 24
 Deep abscesses (in o gans) 0 0 0 0
 ≥ 3 ecu en skin abscesses 11 5 2 18
 Mucocu aneous candidiasis (o opha ynx, cu aneous, excluded aginal) in pa ien s ≥ 12 mon hs o age: ≥ 2
episodes
2 0 0 2
 ≥ 2 sys emic in ec ions (including sepsis) 17 0 0 17
 ≥ 1 se ious in ec ion ha alone indica e IEI s udy (Meningi is caused by HSV, e c.) 10 0 0 10
 Family his o y o inbo n e o s o immuni y 1 1 0 2
Consanguini y o o he amily his o y compa ible wi h mani es a ions o inbo n e o s o immuni y (lymphomas,
e c.)
4 3 0 7
 Cy openia (no speci ied as au oimmune) 24 8 6 38
 Au oimmune cy openia 5 1 0 6
 Sys emic au oimmune diseases, no including au oimmune cy openia (celiac disease, a h i is, e c.) 11 2 2 15
 Endoc inopa hology: Hypo hy oidism, hype pa a hy oidism, diabe es, e c. (No desc ibed as au oimmune) 7 1 0 8
 Hema ological malignancy 2 1 1 4
 Solid o gan neoplasia (only hose ha ha e been associa ed wi h inbo n e o s o immuni y in pedia ics: hy-
oid)
0 0 0 0
 O al (den al/pala al) anomalies 11 1 5 17
 Ch onic dia hea; o ≥ 10 episodes o acu e dia hea) 2 0 1 3
 Ch onic i al skin in ec ion; o ≥ 20 acu e episodes 0 0 0 0
 Ch onic eczema o o he de ma ological mani es a ions ela ed o inbo n e o s o immuni y 22 6 14 42
 Recu en e e 14 0 0 14
 In lamma o y bowel disease in pa ien s ≥ 2 yea s o age 0 0 0 0
 In lamma o y bowel disease in pa ien s < 2 yea s o age 0 0 0 0
 B onchiec asis wi hou cys ic ib osis 12 0 0 12
 Vaccine eac ion 0 0 0 0
 P esence o 2 o mo e i ems o hose desc ibed abo e 47 16 0 63
 Numbe o pa ien s 60 20 104 184