Entity linking at scale connects millions of entity mentions to knowledge bases — matching text references like "Apple" or "Paris" to specific entities in databases like Wikipedia or Wikidata, enabling large-scale knowledge extraction and semantic understanding across massive document collections.

What Is Entity Linking at Scale?

• Definition: Map entity mentions in text to knowledge base entries at massive scale.
• Scale: Billions of documents, millions of entities, trillions of mentions.
• Goal: Connect unstructured text to structured knowledge.

Why Scale Matters?

• Web-Scale: Process entire web, news archives, social media.
• Real-Time: Link entities in streaming data (news, tweets).
• Comprehensive: Cover millions of entities, not just popular ones.
• Performance: Sub-second latency for user-facing applications.

Scalability Challenges

Candidate Generation: Efficiently find possible entity matches from millions. Disambiguation: Resolve which entity among candidates at scale. Knowledge Base Size: Wikipedia has 60M+ entities, Wikidata 100M+. Computational Cost: Billions of mentions × millions of entities = huge. Real-Time Requirements: News, search need instant entity linking.

Scalable Techniques

Indexing: Fast candidate retrieval (Elasticsearch, FAISS). Approximate Methods: Trade accuracy for speed (LSH, quantization). Caching: Cache popular entity embeddings and candidates. Distributed Processing: Spark, MapReduce for batch linking. Neural Retrieval: Dense embeddings for fast similarity search. Hierarchical Linking: Coarse-to-fine entity resolution.

Applications: Web search (Google Knowledge Graph), news analysis, social media monitoring, enterprise knowledge management, scientific literature mining.

Systems: Google Knowledge Graph, Microsoft Satori, DBpedia Spotlight, TagMe, WAT, BLINK.

Entity linking at scale is connecting the world's text to knowledge — by mapping billions of entity mentions to structured knowledge bases, it enables semantic search, knowledge discovery, and intelligent information access across the entire web.