Awesome Docker Compose

This repository contains a collection of Docker Compose configurations for various services.

Available Configurations

Base

These are individual service setups that can be used as building blocks for your projects:

• Postgres with pgAdmin: PostgreSQL database with pgAdmin for management.
• Postgres-pgVector with pgAdmin: PostgreSQL with pgVector extension and pgAdmin.
• Kafka with Kafka UI: Kafka message broker with a management UI.
• MinIO: High-performance object storage service.
• Redis with RedisInsight: In-memory data store with a management UI.
• Valkey: Drop-in Redis replacement managed by the Linux Foundation.
• RabbitMQ: Reliable messaging between distributed systems.
• Qdrant Vector DB: Optimized for storing and searching high-dimensional vectors.
• Milvus Vector DB: Open-source vector database for similarity search.
• ElasticSearch with Kibana: Distributed search engine with Kibana for visualization.
• Grafana with Prometheus: Metric collection, storage, and visualization.
• MongoDB with Mongo-Express: MongoDB paired with a web-based management interface.
• MySQL with Adminer and phpMyAdmin: MySQL with Adminer and phpMyAdmin for administration.
• Apache Airflow: Platform to programmatically author, schedule, and monitor workflows.
• Prefect: Workflow orchestration tool for automating and managing data workflows.
• Feast: Open-source feature store for managing and serving ML features in production.
• dbt Core: Data transformation tool for analytics engineering.
• GitLab: DevOps platform with integrated CI/CD, project management, and more.
• SonarQube: Code quality and security analysis platform for continuous inspection.
• Sonatype Nexus: Universal artifact repository manager for storing and distributing software components.
• FastAPI Example App: Modern Python web framework for building high-performance APIs with automatic documentation.
• InfluxDB with Telegraf: Time-series database optimized for IoT and monitoring data with metrics collection agent.
• ClickHouse with Tabix: High-performance columnar database for analytics with web-based query interface.
• CockroachDB: Distributed SQL database designed for cloud-native applications with strong consistency.

Stacks

These are pre-configured setups combining multiple services for specific use cases:

• MLflow with MinIO and Postgres: A stack for managing the machine learning lifecycle, including MinIO for object storage and Postgres for metadata storage.
• MLflow-OIDC with Keycloak, MinIO, and Postgres: Enterprise MLflow setup with OpenID Connect authentication via Keycloak, object storage with MinIO, and PostgreSQL for metadata.

Note: ElasticAPM integration for ElasticSearch is under development and may not work properly yet. Updates are in progress.

Roadmap

Recently Completed ✅

• ✅ SonarQube - Code quality and security analysis
• ✅ Sonatype Nexus - Artifact repository manager
• ✅ FastAPI Example App - Modern Python API framework
• ✅ InfluxDB with Telegraf - Time-series database with metrics collection agent
• ✅ ClickHouse with Tabix - High-performance columnar analytics database
• ✅ CockroachDB - Distributed SQL database for cloud-native apps

Upcoming Features

• 🚧 GitLab - DevOps platform
• ⬜ Apache Superset - Business intelligence web application
• ⬜ Great Expectations - Data validation and profiling
• ⬜ BentoML - ML model serving framework
• ⬜ Nvidia Triton - Inference server
• 🚧 Weights & Biases - ML experiment tracking

Postponed

• 🔄 dbt Core - Data transformation tool

Legend:

• ✅ Completed
• ⬜ Pending
• ❌ Canceled
• 🔄 Postponed
• 🚧 In Progress

Usage

To use any of the configurations, navigate to the respective directory and run:

docker-compose up

Contributing

Contributions are welcome! Please fork the repository and submit a pull request.