Installation on Docker Swarm
Prerequisites ππ»
If you are using a Linux-based operating system, you must have Docker Engine installed. If you are using Windows or MacOS, you must have Docker Desktop installed.A minimum of 4GB of memory must be allocated to Docker.Ensure that the ports 5000, 27019 and 27018 are open on the machine where you install product.
Using Docker Swarm
Swarm Init π
Initialize a single-node swarm by entering the following command:
sudo docker swarm init --advertise-addr <MASTER_NODE_IP_ADDRESS>
The output should look similar to the following:
Swarm initialized: current node (6muco3j7jjuo6k4rbiq8yr8fw) is now a manager.
To add a worker to this swarm, run the following command:
docker swarm join --token SWMTKN-1-6ak6diq1lbrwemx17up9c1ph039h64z0dxksjxv647qnqrd290-4tt6q22dd462p4lf2n6bqbnt4 192.168.65.3:2377
To add a manager to this swarm, run 'docker swarm join-token manager' and follow the instructions.
Swarm Join(Optional) β
You can use the docker swarm join command to add more nodes to the swarm. Note that the node you added in the previous step is the manager. For details, see the Docker Swarm Join page of the Docker documentation.
sudo docker swarm join --token <TOKEN> <MANAGER_IP>:2377
Deploy Stack π
Deploy Logger by entering the following command;
docker stack deploy -c logger/docker-compose.yml logger-stack
- -c and the path to the Compose file (logger/docker-compose.yml)
- The name of the stack (logger-stack)
The output should look similar to the following:
Creating network logger_default
Creating service logger_listener-service
Creating service logger_updater-service
Creating service logger_reportapi
Creating service logger_collectorapi
Creating service logger_kafka-1
Creating service logger_kafka-2
Creating service logger_clickhouse
Creating service logger_ksqldb-server
Creating service logger_ksqldb-cli
Creating service logger_managerapi
Creating service logger_identityapi
Creating service logger_alertapi
Creating service logger_layoutapi
Creating service logger_zookeeper-1
Creating service logger_app-ui
Creating service logger_minio
Creating service logger_mongodb
Creating service logger_coreapi
Creating service logger_apivue
Creating service logger_redis
Scaling(Optional) π
By default, the instructions in this document create a single replica and each replica can process 100K data per second. To handle more load, follow the steps in the Scaling Up section of the Running in Docker Swarm page.
Verify β
Verify the Installation. Ensure that your containers are running correctly. To view the status of your containers, run the following command:
docker service ls
docker service ps logger-stack
The output should look similar to the following:
| ID | NAME | MODE | REPLICAS | IMAGE | PORTS |
|---|---|---|---|---|---|
| 5b19b46aecd5 | logger_authentication-ui | replicated | 1/1 | 172.16.40.15:5000/authentication-ui:latest | *:3004-3005->3004-3005 |
| 5e4dc7219d98 | logger_ksqldb-cli | replicated | 1/1 | confluentinc/ksqldb-cli:latest | |
| 3b354d1433d7 | logger_ksqldb-server | replicated | 1/1 | confluentinc/ksqldb-server:latest | *:8088->8088 |
| 83dd1cca6c04 | logger_kafka-2 | replicated | 1/1 | confluentinc/cp-kafka:latest | *:29092->29092 |
| 66e25d758e83 | logger_kafka-1 | replicated | 1/1 | confluentinc/cp-kafka:latest | *:19092->19092 |
| 938c8a7ae901 | logger_managerapi | replicated | 1/1 | 172.16.40.15:5000/managerapi:latest | |
| 3be6b8ec02bf | logger_identityapi | replicated | 1/1 | 172.16.40.15:5000/identityapi:latest | |
| 6d335ccee893 | logger_alertapi | replicated | 1/1 | 172.16.40.15:5000/alertapi:latest | |
| 1bcfb51cd607 | logger_collectorapi | replicated | 1/1 | 172.16.40.15:5000/collectorapi:latest | |
| 9319188e8b1b | logger_updater | replicated | 1/1 | 172.16.40.15:5000/updater:latest | |
| d123bf95b42c | logger_reportapi | replicated | 1/1 | 172.16.40.15:5000/reportapi:latest | |
| f1431ba77049 | logger_preprocessor | replicated | 1/1 | 172.16.40.15:5000/preprocessor:latest | |
| 652755b0ab6b | logger_listener | replicated | 1/1 | 172.16.40.15:5000/listener:latest | *:514-515->514-515/udp |
| 770dd9137ceb | logger_layoutapi | replicated | 1/1 | 172.16.40.15:5000/layoutapi:latest | |
| 6eb397fef0c8 | logger_zookeeper-1 | replicated | 1/1 | confluentinc/cp-zookeeper:latest | *:12181->12181 |
| f839590bfd5e | logger_app-ui | replicated | 1/1 | 172.16.40.15:5000/app-ui:latest | *:443->3100, *:24678->24678 |
| 5014aa77759f | logger_minio | replicated | 1/1 | minio/minio | *:9001-9002->9001-9002 |
| 25428d945fed | logger_gatewayapi | replicated | 1/1 | 172.16.40.15:5000/gatewayapi:latest | *:5100-5101->5100-5101 |
| c9ceadfe68b1 | logger_mongodb | replicated | 1/1 | mongo:7.0.14 | *:27017->27017 |
| c2c5a65cfc96 | logger_clickhouse | replicated | 1/1 | clickhouse/clickhouse-server:latest | *:8123->8123, *:9000->9000 |
| 625d2665ff23 | logger_coreapi | replicated | 1/1 | 172.16.40.15:5000/coreapi:latest | |
| e1063be2f9e8 | logger_apivue | replicated | 1/1 | 172.16.40.15:5000/apivue:latest | *:5001->5001, *:5202->8080 |
| 30f3bdd56e3f | logger_redis | replicated | 1/1 | redis:7.2.3 | *:6379->6379 |
That's it! You have successfully completed the Logger installation.
You have successfully completed the Logger installation. You can start using it now. Wait for all the pods to be in running state, and then point your browser to http://ip_address:5000 to access the dashboard, replacing with the IP address of the machine where you installed product. π‘
Installation on Docker Standalone
This topic guides you through installing via the official Docker images. Specifically, it covers running via the Docker command line interface (CLI) and docker-compose.
Installation on Windows
This topic provides guidance on running Logger on Windows operating systems using Docker desktop and WSL infrastructure.