Attachment 611806 Details for Bug 840478 – Backup Procedure for System Engine

Backup Procedure for System Engine

Backup.xml (text/xml), 5.68 KB, created by Dan Macpherson on 2012-09-11 14:59:33 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Dan Macpherson

Created: 2012-09-11 14:59:33 UTC

Size: 5.68 KB

patch

obsolete

><section>
>	<title>System Engine Backup Procedure</title>
>	<procedure>
>		<title>System Engine Backup Procedure</title>
>		<para>
>			This example uses the <filename>/backup</filename> directory as our target directory to hold backup archives. Execute the following commands as the <literal>root</literal> system account.
>		</para>
>		<step>
>			<para>
>				Prepare your backup location: 
>				<screen># umask 0027
># mkdir /backup
># chgrp postgres /backup
># cd /backup
>    </screen>
>			</para>
>		</step>
>		<step>
>			<para>
>				Backup the configuration and data files: 
>				<screen># tar &ndash;&ndash;selinux &ndash;czvf config_files.tar.gz \
>/etc/katello \
>/etc/elasticsearch \
>/etc/candlepin \
>/etc/pulp \
>/etc/gofer \
>/etc/grinder \
>/etc/pki/katello \
>/etc/pki/pulp \
>/etc/qpidd.conf \
>/etc/sysconfig/katello \
>/etc/sysconfig/elasticsearch \
>/root/ssl&ndash;build \
>/var/www/html/pub/*
>
># tar &ndash;&ndash;selinux &ndash;czvf elastic_data.tar.gz /var/lib/elasticsearch</screen>
>			</para>
>		</step>
>		<step>
>			<para>
>				Backup the repositories. Pulp repository backups will not use compression program because RPM files have low compression rates and, depending on the instance size, the <filename>pulp_data.tar</filename> archive can grow large.
>			</para>
>			<para>
>				There are two options to backup repositories.
>			</para>
>			<formalpara>
>				<title>Option One</title>
>				<para>
>					Perform a checksum of all timestamps, backup the repository and perform the checksum again. 
>					<screen># find /var/lib/pulp &ndash;printf '%T@\n' | md5sum
># tar &ndash;&ndash;selinux &ndash;cvf pulp_data.tar /var/lib/pulp /var/www/pub
># find /var/lib/pulp &ndash;printf '%T@\n' | md5sum</screen> If both checksums match, the online backup is correct and usable. If the checksums do not match, perform the repository backup again.
>				</para>
>			</formalpara>
>			<note>
>				<para>
>					Use rsync for speeding up file copying so checksums match.
>				</para>
>			</note>
>			<formalpara>
>				<title>Option Two</title>
>				<para>
>					Stop the Pulp server and perform the backup, then start the Pulp server again. 
>					<screen># service pulp&ndash;server stop
># tar &ndash;&ndash;selinux &ndash;cvf pulp_data.tar /var/lib/pulp /var/www/pub
># service pulp&ndash;server start</screen>
>				</para>
>			</formalpara>
>			<note>
>				<para>
>					Stopping the Pulp server will disconnect System Engine and yum clients from all repository actions. Any repository actions performed on System Engine will fail during this inactivity.
>				</para>
>			</note>
>		</step>
>		<step>
>			<para>
>				Backup the System Engine PostgreSQL and MongoDB databases with their respective tools.
>			</para>
>			<note>
>				<para>
>					As an optional method of backup, perform the following commands while database services are offline:
>				</para>
>				<screen># tar &ndash;&ndash;selinux &ndash;czvf mongo_data.tar.gz /var/lib/mongodb
># tar &ndash;&ndash;selinux &ndash;czvf pgsql_data.tar.gz /var/lib/pgsql/data/</screen>
>				<para>
>					This method archives the all PostgreSQL and MongoDB databases. This type of backup requires a complete shutdown of all services and it is recommended to perform this backup mainly during maintenance periods.
>				</para>
>			</note>
>			<formalpara>
>				<title>Backup PostgreSQL databases</title>
>				<para>
>					Check the names for System Engine PostgreSQL databases. Default database names are <literal>katelloschema</literal> and <literal>candlepin</literal>. Find all default values in the katello&ndash;configure manual page, or in the <filename>/usr/share/katello/install/default&ndash;answer&ndash;file</filename>. If the System Engine instance is not using the default names, check the <filename>katello&ndash;configure.conf</filename>, which stores all options provided to katello&ndash;configure command, and look for <literal>db_name</literal>. 
>					<screen># grep db_name /etc/katello/katello&ndash;configure.conf</screen>
>				</para>
>			</formalpara>
>			<para>
>				Execute <command>pg_dump</command> to create online database backups. It is not necessary to stop PostgreSQL or System Engine, and this process does not block logged users. However, the process can take minutes to finish depending on database sizes.
>			</para>
>			<screen># su postgres &ndash;c "pg_dump &ndash;Fc katelloschema > /backup/katello.dump"
># su postgres &ndash;c "pg_dump &ndash;Fc candlepin > /backup/candlepin.dump"</screen>
>			<note>
>				<para>
>					For more info about PostgreSQL backups consult <command>pg_dump</command> manual page or visit <ulink url="http://www.postgresql.org/docs/8.4/static/backup.html">http://www.postgresql.org/docs/8.4/static/backup.html</ulink>.
>				</para>
>			</note>
>			<formalpara>
>				<title>Backup MongoDB database</title>
>				<para>
>					Use online tools to backup the pulp database (MongoDB) while the database is running.. Execute the following command in the backup directory:
>				</para>
>			</formalpara>
>			<screen># mongodump &ndash;&ndash;host localhost &ndash;&ndash;out mongo_dump</screen>
>			<para>
>				This tool should create <filename>/backup/mongo_dump/pulp_database</filename> directory with seveal JSON files.
>			</para>
>			<note>
>				<para>
>					For more information consult mongodump man page or visit <ulink url="http://www.mongodb.org/display/DOCS/Backups">http://www.mongodb.org/display/DOCS/Backups</ulink>.
>				</para>
>			</note>
>		</step>
>		<step>
>			<para>
>				Check the backup process. The process creates the following archive files and a directory:
>			</para>
>			<screen># ls
>candlepin.dump    config_files.tar.gz    elastic_data.tar.gz    katello.dump
><emphasis role="bold">mongo_dump</emphasis>        pulp_data.tar
></screen>
>			<para>
>				System Engine is now backed up. Please ensure your System Engine instance is running.
>			</para>
>		</step>
>	</procedure>
></section>

Actions: View

Attachments on bug 840478: 611806 | 611808