Signal Detection: From Disproportionality to a Label Change
A safety signal is information suggesting a new potentially causal association, or a new aspect of a known one, that warrants further investigation.
A signal is a hypothesis. Dismissing it without evaluation and acting on it as an established risk are both errors.
The statistical screen
Most systematic detection starts with disproportionality analysis on a spontaneous reporting database: FAERS, EudraVigilance, VigiBase.
For a given drug and event, it asks whether the pair is reported more often than expected relative to everything else in the database. Common measures are the proportional reporting ratio (PRR), the reporting odds ratio (ROR), and Bayesian approaches such as the information component or empirical Bayes geometric mean.
Its limits:
- No incidence. Spontaneous databases have no denominator, so you cannot compute a rate from them.
- No causality. Disproportionate reporting is a reporting pattern.
- Reporting bias. Notoriety bias, where publicity drives reporting, and the Weber effect, where reporting peaks in early marketing years, both generate disproportionality with no underlying change in risk.
Its use is prioritizing which drug-event pairs to review.
Other signal sources
- Individual case review, especially well-documented cases with positive dechallenge and rechallenge.
- Literature monitoring, which is a standing obligation.
- Clinical trial data from ongoing studies.
- Regulatory communications about the class from other authorities.
- Non-interventional studies and registries.
A single well-documented case of a rare, serious event with no other explanation can be a stronger signal than a large disproportionality score on a common event.
Validation, then evaluation
Validation asks whether there is enough evidence to justify further analysis: is the association plausible, is it already known and in the label, are the cases real and distinct.
Evaluation is the assessment proper: all available data, biological plausibility, temporal relationship, dose relationship, alternative explanations, and what it means for benefit-risk.
The outcome is a decision, and the possible decisions include doing nothing with a documented rationale. Each is recorded, and the record appears in the next periodic report.
Downstream actions
A confirmed signal that changes the benefit-risk picture leads to a core data sheet change, then local label variations in every market, then implementation tracking, which makes signal management a regulatory function as well as a pharmacovigilance one.
For serious findings the chain also runs the other way: expedited reporting obligations, IND safety reports for products still in development, and direct healthcare professional communications.
Frequently asked questions
What is a safety signal?
Information suggesting a new potentially causal association, or a new aspect of a known association, that warrants further investigation.
What is disproportionality analysis?
A statistical screen asking whether a drug-event pair is reported more often than expected relative to the rest of a spontaneous reporting database.
Can you calculate incidence from FAERS?
No. Spontaneous reporting databases have no denominator, so they support disproportionality but not rates.
What is the Weber effect?
The tendency for adverse event reporting to peak in the early years after marketing and decline afterwards, independent of actual risk.
What happens after a signal is validated?
Evaluation against all available data, then a documented decision, which may be a label change, further study, risk minimization, or no action with a rationale.
Is a single case ever a signal?
Yes. A well-documented case of a rare serious event with no alternative explanation can outweigh a large disproportionality score on a common event.