Just starting… will be continued…

3 Servers Cluster. Must have two physical disk on each cluster server/node. One disk is for cluster OS and second disk is for Ceph storage.

Firewall:

Web interface: 8006
VNC web console: 5900-5999
SPICE proxy: 3128
SSH: 22
COROSYNC multicast: 5404, 5405 udp

Download Proxmox at https://www.proxmox.com/en/downloads/category/iso-images-pve

Before install please make sure the Intel VT-d is enabled in BIOS.

Start install Proxmox VE

Prepare FQDN, Static private IP, Netmask, Gateway, DNS server.

 

After installation visit https://proxmoxserverip:8006

Enable No-Subscription to /etc/apt/sources.list (https://pve.proxmox.com/wiki/Package_Repositories#sysadmin_no_subscription_repo)

Remove Enterprise Repo ( rm /etc/apt/sources.list.d/pve-enterprise.list )

Nodes > System > DNS

reboot

Update & upgrade

reboot

Update hostname/FQDN at /etc/hosts

reboot

Create a cluster from master server/node

Join in cluster the remaining two servers/nodes

Install Ceph on master server

Install Ceph on 2nd server (from 2nd server accessed in browser)

Install Ceph on 3rd server (from 3rd server accessed in browser)

Monitor already created on master server

Create monitor on 2nd server

Create monitor on 3rd server

Create OSD on master server

Create OSD on 2nd server

Create OSD on 3rd server

Create pool on master server (Must Tick-Mark to Add Storage)

Optional: Datacenter > Storage > Add > RBD

Disable auto update of proxmox.

systemctl stop pve-daily-update.timer
systemctl disable pve-daily-update.timer

 

– – – – – – – – – – – – – – – – – – – – – – – – – – – – – – – – – – – – – – –

 

 

Click Datacenter > Firewall > Add

Add the input for 22 & 8006

Enable Firewall

In the first server, click Datacenter > Storage, and then select Local and then click Edit. Enable ISO image support.

Back from Datacenter…

Select first server’s Local storage, select Content, click Upload.

Upload an ISO image for virtual machine installation (e.g. Elastix ISO)

We are ready to create VM.

Click create VM

Choose CPU Type to host.

On the OS tab select image ISO, create VM

Then start the new VM, and click Console.

We need to set Firewall to access/ping VM.

Select the VM, click Firewall, add the input rules what needed, then enable Firewall

– – – – – – – – – – – – – – – – – – – – – – – – – – – –

To remove Cluster and use each node separately as standalone one, do the following:

First, disable HA from the VM(s).

Clone the VM(s) to a single node, select local-lvm space (avoid cloud-storage space).

pvecm expected 1

 

Edit each node’s host file and set only one nameserver (as current machine hostname).

nano /etc/hosts

 

pvecm delnode cloud 3

pvecm delnode cloud2

Now, the all machine is individual, restart all machines.

– – — – – – – – – – – – – – – — – – – – – – – – – –

Continued…