Bug 2078902

Summary: [DOC] Document how to configure multiple public networks to the cluster
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Pawan <pdhiran>
Component: DocumentationAssignee: Rivka Pollack <rpollack>
Documentation sub component: Install Guide QA Contact: Sayalee <saraut>
Status: CLOSED CURRENTRELEASE Docs Contact: Ranjini M N <rmandyam>
Severity: high    
Priority: unspecified CC: adking, akraj, msaini, rkachach, rmandyam, rpollack, saraut, sunnagar, vereddy
Version: 5.0Flags: rpollack: needinfo? (adking)
Target Milestone: ---   
Target Release: 5.3z4   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-07-20 04:25:49 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Comment 2 Redouane Kachach Elhichou 2022-04-26 14:40:33 UTC
=== 1. Bootstrap a ceph cluster.

In order to bootstrap a ceph cluster configured with multiple public networks the user has to:
1.1) prepare a ceph.conf file that contains a global section public_network for example:

[global]
public_network = 10.40.0.0/24, 10.41.0.0/24, 10.42.0.0/24

Note: At least one of the provided public networks must be configured on the current host (used for bootstrap)


1.2) bootstrap the cluster by providing this configuration file as input (using the -c argument) + any additional arguments the user wants to provide during the bootstrap:

cephadm --image <image-url> bootstrap --mon-ip <monitor-ip> -c <path-to-ceph-conf>


==== 2. Add new hosts to the subnets.

In order to add new hosts, the user has to follow the guide from:

https://docs.ceph.com/en/pacific/cephadm/host-management/#cephadm-adding-hosts

Note: the host being add must be reachable from whatever host the active mgr is running on

=== 3. Add add the networks as config for the public network param.

In a running cluster, public_network parameter could be changed by using the following cephadm command:

ceph config set mgr public_network "subnet_1,subnet_2, ..." (comma separated list of nets in subnet/mask format:10.42.0.0/24 i.e)

In case the new public networks are only available from certain hosts (and we want to move monitors to them) then the user has
to use a valid mon spec to specify the new placement.

Comment 22 Redouane Kachach Elhichou 2023-06-14 12:37:37 UTC
@riv