407 views
asked in PostgreSQL by
PostgreSQL 16 pg_basebackup and Point in Time Recovery

1 Answer

answered by

inchirags@gmail.com              Chirags PostgreSQL DBA Tutorial                 https://www.chirags.in

*********************************************************************************************

PostgreSQL 16 pg_basebackup and Point in Time Recovery

***********************************************************************************************

YouTube Video:

//Install PostgreSQL

$ sudo apt update
$ sudo apt install -y postgresql postgresql-contrib

------------------------------------------------------------------------

Introduction

PostgreSQL is a widely used relational database that supports ACID transactions. The acronym ACID stands for atomicity, consistency, isolation, and durability. These are four key properties of database transactions that PostgreSQL supports to ensure the persistence and validity of data in the database.

One method PostgreSQL uses to maintain ACID properties is Write-Ahead Logging (WAL). PostgreSQL first records any transaction on the database to the WAL log files before it writes the changes to the database cluster’s data files.

Step 1 — Configuring Continuous Archiving on the Database Cluster

*****************************************************************

# create directory for archive logs

root@dept:~# 
cd /var/lib/postgresql/16
mkdir database_archive

# You now need to give the default PostgreSQL user, postgres, permission to write to this directory. You can achieve this by changing the ownership of the directory using the chown command:

sudo chown postgres:postgres database_archive

# Open the configuration file with your text editor: and enable archive logging

sudo nano /etc/postgresql/16/main/postgresql.conf

. . .
archive_mode = on
archive_command = 'test ! -f /var/lib/postgresql/16/database_archive/%f && cp %p /var/lib/postgresql/16/database_archive/%f'
wal_level = replica
...
sudo systemctl restart postgresql@16-main
sudo -u postgres psql -c "SELECT pg_switch_wal();"
sudo -u postgres psql -c "SHOW data_directory;"
sudo -u postgres psql
postgres=# create database chirags_db1;
postgres=# \c chirags_db1;
chirags_db1=# CREATE TABLE users (id SERIAL PRIMARY KEY, name VARCHAR(100),age INT);
chirags_db1=# INSERT INTO users (name, age) VALUES ('Chirag Mahto', 35);
chirags_db1=# INSERT INTO users (name, age) VALUES ('Sanju Mehta', 32);
chirags_db1=# select * from users; /* 10 recoreds */

Output:
 id |     name     | age
----+--------------+-----
  1 | Chirag Mahto |  35
  2 | Sanju Mehta  |  32
(2 rows)
chirags_db1=# select now();

now
-------------------------------
 2024-09-01 18:59:37.202803+05:30
(1 row)
chirags_db1=# SELECT pg_switch_wal();
pg_switch_wal
---------------
 0/242FE18
(1 row)
chirags_db1=# \q

Step 2 — Performing a Physical Backup of the PostgreSQL Cluster

***************************************************************

root@dept:~# 
cd /var/lib/postgresql/16
mkdir database_backup
sudo chown postgres:postgres database_backup

# Take basebackup

root@dept:~# sudo -u postgres pg_basebackup -D /var/lib/postgresql/16/database_backup

# Now add some more records

root@dept:~# su - postgres
postgres@dept:~$ psql
psql (16.4 (Ubuntu 16.4-1.pgdg22.04+1))
Type "help" for help.
postgres=# \c chirags_db1;
chirags_db1=# CREATE TABLE accounts (account_number SERIAL PRIMARY KEY, account_holder VARCHAR(100), balance DECIMAL(10, 2));
chirags_db1=# INSERT INTO accounts (account_holder, balance) VALUES ('Arjun', 1000.00);
INSERT INTO accounts (account_holder, balance) VALUES ('Purab', 500.00);
chirags_db1=# select * from accounts; 

Output:
 account_number | account_holder | balance
----------------+----------------+---------
              1 | Arjun          | 1000.00
              2 | Purab          |  500.00
(2 rows)

chirags_db1=# select now();

now
-------------------------------
 2024-09-01 19:58:51.598662+05:30
(1 row)

chirags_db1=# SELECT pg_switch_wal();

 pg_switch_wal
---------------
 0/5019348
(1 row)

chirags_db1=# \q
postgres@dept:~$ exit

Step 3 — Performing Point-In-Time-Recovery on the Database Cluster

*******************************************************************

root@dept:~# 
sudo systemctl stop postgresql@16-main
sudo mv /var/lib/postgresql/16/main/pg_wal ~/

# destroy data directory

sudo rm -rf /var/lib/postgresql/16/main

# manually create data directory

sudo mkdir /var/lib/postgresql/16/main

# Restoration :

sudo cp -a /var/lib/postgresql/16/database_backup/. /var/lib/postgresql/16/main/
sudo chown postgres:postgres /var/lib/postgresql/16/main
sudo chmod 700 /var/lib/postgresql/16/main
sudo rm -rf /var/lib/postgresql/16/main/pg_wal
sudo cp -a ~/pg_wal /var/lib/postgresql/16/main/pg_wal
sudo cp /var/lib/postgresql/16/database_archive/* /var/lib/postgresql/16/main/pg_wal
root@dept:~# sudo nano /etc/postgresql/16/main/postgresql.conf

. . .
restore_command = 'cp /var/lib/postgresql/16/database_archive/%f %p'
#recovery_target_time = '2024-08-30 01:32:23'
#recovery_target = 'immediate'
. . .

root@dept:~# sudo touch /var/lib/postgresql/16/main/recovery.signal

# Start PostgreSQL Services

root@dept:~# sudo systemctl start postgresql@16-main

# Check status PostgreSQL Services

root@dept:~# sudo systemctl status postgresql@16-main

# Now try to add some more records

root@dept:~# sudo -u postgres psql

psql (16.4 (Ubuntu 16.4-0ubuntu0.24.04.2))
Type "help" for help.

postgres=# \c chirags_db1
chirags_db1=# \dt
             List of relations

 Schema |      Name      | Type  |  Owner
--------+----------------+-------+----------
 public | accounts       | table | postgres
 public | random_numbers | table | postgres
 public | test_tbl1      | table | postgres
 public | users          | table | postgres
(4 rows)

chirags_db1=# select * from accounts;
 account_number | account_holder | balance
----------------+----------------+---------
              1 | Arjun          | 1000.00
              2 | Purab          |  500.00
(2 rows)
chirags_db1=#

# if database is in ready only mode then run below command for remove read-only mode.

root@dept:~# su - postgres
postgres@dept:~$ psql
psql (16.4 (Ubuntu 16.4-1.pgdg22.04+1))
Type "help" for help.
postgres=# select pg_wal_replay_resume();

Note : Flow the Process shown in video.

Subscribe and like for more videos:

https://www.youtube.com/@chiragstutorial

Don't forget to, Follow, Like,  Share &, Comment

Tutorial Link :

https://www.chirags.in/tutorials/PostgreSQL_Database

Thanks & Regards,

Chitt Ranjan Mahto "Chirag"

____________________________________________________________________

Note: All scripts used in this demo will be available in our website.

Link will be available in description.

Most popular tags

postgresql laravel replication laravel-10 ha postgresql mongodb ubuntu 24.04 lts mongodb database mongodb tutorial streaming-replication laravel-11 mysql database laravel postgresql backup laravel login register logout database mysql php technlogy asp.net asp.net c# mysql master slave replication centos linux laravel sql server schedule backup autobackup postgresql django python haproxy load balancer install self sign ssl laravel 11 - login with otp valid for 10 minutes. laravel 11 gaurds user and admin registration user and admin login multiauth postgresql 16 to postgresql 17 postgresql migration zabbix 7 how to install graylog on ubuntu 24.04 lts | step-by-step asp.net core mvc .net mvc network upload c# ssl integration sql server on ubuntu 22.04 lts mssql server ms sql server sql server user access in postgres mysql password change cent os linux configure replica kubernetes (k8s) install nginx load balancer install install and configure .net 8.0 in ubuntu 24.04 lts php in iis php with iis php tutorial chirags php tutorials chirags php tutorial chirags tutorial laravel 11 guards mongodb sharding metabase business analytics metabase ubuntu 24.04 koha 24.05 letsencrypt mongodb crud rocky linux laravel custom captcha laravel 11 captcha laravel captcha mongo dll php.ini debian 12 nginx apache nextcloud gitea in ubuntu git gitea npm error node js mysql ndb cluster mysql cluster ssl oracle login register logout in python debian windows shell batch file bat file time stamp date time shopping cart in laravel centos rhel swap memeory rhel 5.5
...