AI opportunities

Deterministic and probabilistic record linkage with LLM-assisted disambiguation for near-misses

Matching the same real-world entity across systems using rule-based keys first, fuzzy matching second, and LLM judgement only for genuinely ambiguous remaining cases.

Technique

Rule-based key matching, then probabilistic record-linkage scoring, then an LLM prompted only on cases below a confidence threshold.

Open source tool

Standard record-linkage libraries (e.g. Splink-class tooling); LLM API for the disambiguation tier only