#17Search Engine Inverted Indexer
17 / 20
WorkflowCanvas
Elastic logoElastic System
HardData Systems
40–60 min

Search Engine Inverted Indexer

Design an inverted index and full-text search cluster supporting tokenization, TF-IDF / BM25 ranking, and distributed partition query execution.

Scale & Traffic1 Billion documents · 50,000 search queries/sec
Monthly Cloud Budget$30,000/month
Latency Target (P99)< 50ms Realtime SLA
Availability SLA99.99% Multi-AZ Active
OPEN IN PLAYGROUND CANVASVIEW REFERENCE WORKFLOW

System Requirements

  • Fast keyword search query resolution in < 30ms
  • Inverted index sharding with replica segment merging
  • Document ingestion pipeline with NLP stemming and stop-word filtering
  • Distributed scatter-gather query coordinator

Graded Constraints

01Budget: $30,000/month
02Load balancer routing search queries to query coordinators
03Dedicated Search Engine nodes (Elastic/Search index cluster)
04Document storage database for full document retrieval
05Message queue for continuous document update ingestion

Ready to design?

Open this challenge in the interactive system design playground and satisfy all architecture constraints.

OPEN IN PLAYGROUNDVIEW WORKFLOW
Explore More

Related Architecture Challenges

All Problems
DropboxMedium

Cloud File Storage (Dropbox)

Design a cloud sync and file storage architecture featuring block-level chunking, deduplication, delta synchronization, and metadata version control.

50PB storage →
YouTubeHard

YouTube Video Recommendation Engine

Design YouTube's two-stage recommendation pipeline: candidate generation (filtering millions to hundreds) followed by ranking & scoring for personalized user home feeds.

500M Daily Active Users →
NetflixHard

Netflix Home Page Recommendation

Design Netflix's personalized row generation system that curates customized titles, tailored artwork thumbnails, and dynamic row rankings for every member profile.

250M paid subscribers →
Search Engine Inverted Indexer — System Design Problem | Mimir Nest