Deployment Guide
Cluster Architecture Overview
In the privatized deployment cluster mode, storage components are deployed separately from microservices, reducing system coupling. Microservices run on the Kubernetes architecture, enabling fast scaling up or down as needed and improving resource utilization.
Click here for server configuration recommendations for different cluster modes
The cluster mode includes the following types:
- Simplified Version: Saves server resources with a single-node deployment for storage components.
- Standard Version: Storage components are deployed in an official master-slave or cluster mode, offering basic HA capabilities.
- Professional Version: Based on the standard version, each server runs only one component instance to enhance reliability and performance, avoiding component interference and resource contention.
In the Standard and Professional deployment modes, the component architecture defaults to the following:
- MySQL: Supports master-slave and MGR modes; in the event of a master node failure, the slave node continues to provide service.
- MongoDB: Three-node replica set with automatic failover support, ensuring data availability. MGR mode is recommended.
- Redis: Supports master-slave and Sentinel modes to ensure service HA. Sentinel mode is recommended.
- Kafka: Three-node cluster with multi-replica Topic distribution, achieving data redundancy and reliability.
- Elasticsearch: Three-node cluster with multi-replica shards to enhance data redundancy and availability.
- MinIO: Four-node cluster with redundant data replication, ensuring reliability.
Deployment Process
Since the HAP microservices depend on components such as MongoDB, MySQL, Redis, Kafka, Elasticsearch, MinIO, these dependencies must be deployed before deploying HAP microservices.
Recommended deployment order:
- Deploy MongoDB, MySQL, Redis, Kafka, Elasticsearch, and MinIO
- Deploy HAP file service
- Deploy Kubernetes cluster
- Deploy Istio
- Deploy Flink (optional)
- Deploy HAP microservices
- Deploy Nginx proxy
- Deploy monitoring services (Prometheus + Grafana)
Notes:
-
The software installation directory is recommended to be unified as
/usr/local, and the data directory as/data. It is advised to pre-mount the server data disk to/data. -
Consistent time zones across all cluster nodes are required, and synchronization with the same NTP server must be ensured.
-
Some passwords in the example documentation are weak (e.g.,
123456). They must be replaced with strong passwords during deployment.- Passwords should include uppercase and lowercase letters along with numbers and be at least 8 characters long.
- If special characters are required, only
-or_are allowed. Characters such as@!#&are prohibited to avoid compatibility issues.
Environment Deployment Guide
The private deployment version of HAP supports various Linux distributions and mainstream CPU architectures.
- This document provides deployment examples for the x86_64/AMD64 architecture.
- For deployments on ARM64/AARCH64 architecture servers, the deployment steps are generally the same.
- Be aware that differences in software packages may exist across architectures. Ensure you use installation packages compatible with the target architecture.
Note: Nocoly is not supported for deployment on ARM64/AARCH64 architecture servers.
Download Links for x86_64/AMD64 Software Packages
| Software Name | Download Link |
|---|---|
| Docker | https://pdpublic.mingdao.com/private-deployment/offline/common/docker-28.5.2.tgz |
| Nginx | https://pdpublic.mingdao.com/private-deployment/offline/common/nginx-1.28.2-glibc2.17-amd64.tar.gz |
| MySQL | https://pdpublic.mingdao.com/private-deployment/offline/common/mysql-8.0.45-linux-glibc2.17-x86_64.tar.xz |
| MySQL Shell | https://pdpublic.mingdao.com/private-deployment/offline/common/mysql-shell-8.0.45-linux-glibc2.17-x86-64bit.tar.gz |
| MySQL Router | https://pdpublic.mingdao.com/private-deployment/offline/common/mysql-router-8.0.45-linux-glibc2.17-x86_64.tar.xz |
| MongoDB | https://www.mongodb.com/try/download/community-edition/releases/archive |
| Mongo Tools | https://www.mongodb.com/try/download/database-tools |
| Redis | https://pdpublic.mingdao.com/private-deployment/offline/common/redis-8.0.4-glibc2.17-amd64.tar.gz |
| JDK | https://pdpublic.mingdao.com/private-deployment/offline/common/OpenJDK21U-jdk_x64_linux_hotspot_21.0.8_9.tar.gz |
| Kafka | https://pdpublic.mingdao.com/private-deployment/offline/common/kafka_2.13-3.9.1.tgz |
| Elasticsearch | https://pdpublic.mingdao.com/private-deployment/offline/common/elasticsearch-8.19.8-linux-x86_64.tar.gz |
| Elasticsearch-ik | https://pdpublic.mingdao.com/private-deployment/offline/common/elasticsearch-analysis-ik-8.19.8.zip |
| CNI Plugin 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.25.4/cni-plugins-linux-amd64-v1.1.1.tgz |
| Crictl 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.25.4/crictl-v1.25.0-linux-amd64.tar.gz |
| Nerdctl 1.7 | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.25.4/nerdctl-1.7.0-linux-amd64.tar.gz |
| Kubeadm 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.25.4/kubeadm |
| Kubelet 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.25.4/kubelet |
| Kubectl 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.25.4/kubectl |
| K8S-1.25 Image Tar | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.25.4/kubeadm-1.25.4-images.tar.gz |
| CentOS Image | https://pdpublic.mingdao.com/private-deployment/offline/common/centos7.9.2009.tar.gz |
| Istio 1.18 | https://pdpublic.mingdao.com/private-deployment/offline/common/istio-1.18.0-linux-amd64.tar.gz |
| Istio 1.18 Image Tar | https://pdpublic.mingdao.com/private-deployment/offline/common/istio-1.18.0-images.tar.gz |
| Kubernetes 1.35 Package | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.35.3/1.35-k8s-amd64-pkg.tar.gz |
| Kubernetes 1.35 Image Tar | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.35.3/kubeadm-1.35.3-images-amd64.tar.gz |
| Calico - v3.30 YAML Image Package | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.35.3/calico-3.30.7-yaml-images-amd64.tar.gz |
| Prometheus | https://pdpublic.mingdao.com/private-deployment/offline/common/prometheus-3.5.0.linux-amd64.tar.gz |
| Grafana | https://pdpublic.mingdao.com/private-deployment/offline/common/grafana_12.1.2_17957162798_linux_amd64.tar.gz |
| Node Exporter | https://pdpublic.mingdao.com/private-deployment/offline/common/node_exporter-1.9.1.linux-amd64.tar.gz |
| Cadvisor | https://pdpublic.mingdao.com/private-deployment/offline/common/cadvisor-v0.52.1-linux-amd64 |
| Kafka Exporter | https://pdpublic.mingdao.com/private-deployment/offline/common/kafka_exporter-1.9.0.linux-amd64.tar.gz |
| K8S Metrics Image Tar | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-minio-linux-amd64-RELEASE.2025-04-22T22-12-26Z.tar.gz |
| File Initialization Package | https://pdpublic.mingdao.com/private-deployment/source/7.0.0/file_init.tar.gz |
| mingdaoyun-hap | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-hap-linux-amd64-7.2.4.tar.gz |
| mingdaoyun-file | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-file-linux-amd64-2.1.0.tar.gz |
| mingdaoyun-flink | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-flink-linux-amd64-1.19.720.tar.gz |
| mingdaoyun-doc | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-doc-linux-amd64-2.0.0.tar.gz |
| mingdaoyun-command | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-command-linux-amd64-node1018-python36.tar.gz |
Download Links for ARM64/AARCH64 Software Packages
| Software Name | Download Link |
|---|---|
| Docker | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/docker-28.5.2.tgz |
| Nginx | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/nginx-arm64-1.28.2.tar.gz |
| MySQL | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/mysql-8.0.45-linux-glibc2.28-aarch64.tar.xz |
| MySQL Shell | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/mysql-shell-8.0.45-linux-glibc2.28-aarch64.tar.xz |
| MySQL Router | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/mysql-router-8.0.45-linux-glibc2.28-arm-64bit.tar.gz |
| MongoDB | https://www.mongodb.com/try/download/community-edition/releases/archive |
| Mongo Tools | https://www.mongodb.com/try/download/database-tools |
| Redis | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/redis-8.0.4-glibc2.17-arm64.tar.gz |
| JDK | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/OpenJDK21U-jdk_aarch64_linux_hotspot_21.0.8_9.tar.gz |
| Kafka | https://pdpublic.mingdao.com/private-deployment/offline/common/kafka_2.13-3.9.1.tgz |
| Elasticsearch | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/elasticsearch-8.19.8-linux-aarch64.tar.gz |
| Elasticsearch-ik | https://pdpublic.mingdao.com/private-deployment/offline/common/elasticsearch-analysis-ik-8.19.8.zip |
| CNI Plugin 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/cni-plugins-linux-arm64-v1.1.1.tgz |
| Crictl 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/crictl-v1.25.0-linux-arm64.tar.gz |
| Nerdctl 1.7 | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/nerdctl-1.7.0-linux-arm64.tar.gz |
| Kubeadm 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/kubeadm |
| Kubelet 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/kubelet |
| Kubectl 1.25 | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/kubectl |
| K8S-1.25 Image Tar | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/kubeadm-1.25.4-images-arm64.tar.gz |
| CentOS Image | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/centos7.9.2009-arm64.tar.gz |
| Istio 1.18 | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/istio-1.18.0-linux-arm64.tar.gz |
| Istio 1.18 Image Tar | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/istio-1.18.0-images-arm64.tar.gz |
| Kubernetes 1.35 Package | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.35.3/1.35-k8s-arm64-pkg.tar.gz |
| Kubernetes 1.35 Image Tar | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.35.3/kubeadm-1.35.3-images-arm64.tar.gz |
| Calico - v3.30 YAML Image Package | https://pdpublic.mingdao.com/private-deployment/offline/common/kubernetes-1.35.3/calico-3.30.7-yaml-images-arm64.tar.gz |
| Prometheus | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/prometheus-3.5.0.linux-arm64.tar.gz |
| Grafana | https://pdpublic.mingdao.com/private-deployment/offline/common/grafana_12.1.2_17957162798_linux_amd64.tar.gz |
| Node Exporter | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/node_exporter-1.9.1.linux-arm64.tar.gz |
| Cadvisor | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/cadvisor-v0.52.1-linux-arm64 |
| Kafka Exporter | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/kafka_exporter-1.9.0.linux-arm64.tar.gz |
| K8S Metrics Image Tar | https://pdpublic.mingdao.com/private-deployment/offline/common/arm64/kube-state-metrics-arm-2.8.1.tar |
| MinIO | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-minio-linux-arm64-RELEASE.2025-04-22T22-12-26Z.tar.gz |
| File Initialization Package | https://pdpublic.mingdao.com/private-deployment/source/7.0.0/file_init.tar.gz |
| mingdaoyun-hap | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-hap-linux-arm64-7.2.4.tar.gz |
| mingdaoyun-file | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-file-linux-arm64-2.1.0.tar.gz |
| mingdaoyun-flink | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-flink-linux-arm64-1.19.720.tar.gz |
| mingdaoyun-doc | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-doc-linux-arm64-2.0.0.tar.gz |
| mingdaoyun-command | https://pdpublic.mingdao.com/private-deployment/offline/mingdaoyun-command-linux-arm64-node1018-python36.tar.gz |