Design a Log Collection and Analysis System

Functional Requirements:

• Collect and store logs from various services.
• Support querying logs by service, time range, and log level.
• Enable full-text search on log messages.
• Provide basic log aggregation metrics (e.g., error counts per service).
• Archive logs for long-term storage and retrieval.

Non-Functional Requirements:

• Scalability: System should handle increasing log volume as services grow.
• High availability: Logging and querying should be reliable and resilient to failures.
• Near real-time log ingestion and query (acceptable delay of a few seconds).
• Data retention: Support configurable log retention and archival policies.
• Consistency: Eventual consistency is acceptable for log queries and metrics.