1. Features

1) What is PostgreSQL?

Untitled

🛢 Oracle
🗄 MS SQL Server
🐬 MySQL
🐘 PostgreSQL ← NEW!!

2) History

Untitled

In 1977, the University of California, Berkeley, USA
Commenced a development project under the name Ingres (INteractive Graphics REtrieval System)DB
The service ended in 1993, and PostgreSQL services began in 1997.

3) Keywords

`Portable(휴대성)`

Developed in the C language
Supports various platforms such as Windows, Linux, MAC OS/X, Unix Platform
Supports ANSI/ISO standard SQL

`Reliable(신뢰성)`

Provides ACID and transaction support to ensure reliable operations
Implements MVCC, low-level locking, and other features to enhance concurrency performance
Supports various indexing techniques
Offers flexible full-text search capabilities
Supports diverse and flexible replication methods
Provides support for various procedural languages (PL/pgSQL, Perl, Python, Ruby, TCL, etc.)
Supports various interfaces (JDBC, ODBC, C/C++, .Net, Perl, Python, etc.)

`Scalable(확장성)`

Enables the implementation of Table Partitioning and Tablespace features for handling large-scale data processing.

`Secure(보안)`

Data encryption, Access control, Log audit :Three aspects of DB security Three aspects of DB security:
Host-based authentication, Object-level permissions, Encryption of transmitted data between clients and the network through SSL communication

`Recovery & Availability(복구, 이용)`

Achieve point-in-time recovery through Write-Ahead Logging (WAL) archiving and Hot Backup.
Establish Hot Standby servers with synchronous and asynchronous Streaming Replication as a default option.

`Advanced(발전)`

A sophisticated and stable open-source RDBMS.
Allow upgrades using pg_upgrade.
Provide web-based and client-server GUI management tools for monitoring, administration, and tuning.
Receive support from a thriving community and commercial assistance.
Offer well-crafted documentation and ample manuals.

4) Internal Structure

DATABASE Structure

Untitled

Schema

A set of TABLEs, a concept that logically divides a single DATABASE.
Tables from different DATABASEs cannot be joined.
Tables from different schemas within the same DATABASE can be joined.

Key Creation Commands

        
      
-- Create user
CREATE USER [username] [[ WITH ] option [ ... ]]

-- Create table space
CREATE TABLESPACE [name] LOCATION '[location]';

-- Create database
CREATE DATABASE [db_name] WITH [TABLESPACE = [tablespace_name]] [AND] OWNER [username];
// CREATE DATABASE testdb WITH OWNER testdb;

-- Create schema
CREATE SCHEMA [sch_name] AUTHORIZATION [username];
// CREATE SCHEMA testdb AUTHORIZATION testuser;
// CREATE SCHEMA testdb_log AUTHORIZATION testuser;
// Three schemas created in the testdb: public, testdb, testdb_log.

-- 스키마에 대한 테이블 생성
CREATE TABLE "[sc_name]".[tb_name] ( ... );

-- Table creation for a schema
CREATE TABLE "[sc_name]".[tb_name] ( ... );

-- List of users
SELECT * FROM pg_shadow;

-- List of databases
SELECT * FROM pg_database;

-- List of table spaces
SELECT * FROM pg_tablespace;

-- List of tables
SELECT * FROM pg_tables;

template 데이터베이스

oid	datname
13442	postgres
16394	test
1	template1
16749	mytest2
16747	mytest
16736	mytable
13441	template0

💡 CREATE DATABASE actually works by copying an existing database. template1: The table copied by default when using CREATE DATABASE command.

Users can modify elements in the template1 table itself.

Subsequent tables created will have the elements from template1 table copied as is.

For example, if PL/pgSQL procedural language is installed in template1, it can be used in tables created later. template0: Has the same data as the initial state of template1.

Therefore, if you want to create a new database with the user-defined elements added to template1, you can copy from template0 after making changes.

        
-- pgAdmin
CREATE DATABASE dbname TEMPLATE template[0 | 1];

-- shell
CREATEDB -T template[0 | 1] dbname

권한

🔰 GRANT : Grant permissions on the object to a user, group, or all users.

        
GRANT privilege [,...] ON object [,...]
    TO { PUBLIC | GROUP group | username}

🔰 REVOKE : Revoke access privileges from a user, group, or all users.

        
      
REVOKE privilege [,...]
    ON object [,...]
    FROM { PUBLIC | GROUP gname | username }

💡 Detailed options

privilege SELECT: Grant/revoke access to specific columns of a TABLE/VIEW. INSERT: Grant/revoke permission to insert data into all columns of a specific TABLE. UPDATE: Grant/revoke permission to update all columns of a specific TABLE. DELETE: Grant/revoke permission to delete rows from a specific TABLE. RULE: Grant/revoke permission to define rules for a specific TABLE/VIEW. ALL: Grant/revoke all privileges.

object : Applicable objects include tables, views, sequences, and indexes.

PUBLIC : Grant/revoke permissions to all users.

Untitled

💡 When trying to access tables in another account’s database, the following errors may occur:

        
      
ERROR:  relation "public.users" does not exist
LINE 1: SELECT * FROM public.users;
                      ^
ERROR:  schema "testtest" does not exist
LINE 1: CREATE TABLE testtest.testtest(id int);
                     ^

아키텍처

Untitled

< Postmaster Daemon >

postmaster: The first process started when launching PostgreSQL. It performs initial recovery tasks, memory initialization, and starts background processes. As a daemon process, it receives connection requests from client processes and spawns backend processes.

< Shared Memory >

shared buffer: Space to store data blocks requested by users, and it is recommended to allocate more than 1/4 of server memory.
WAL (Write Ahead Log) buffer: A buffer storing changes to data, and the WAL writer process records them in the WAL file.
CLOG buffer: Commit log, a memory space caching the transaction status, indicating whether a transaction has been committed.

< Background Process >

Writer: Periodically writes dirty buffers to the data file.
WAL writer: Writes WAL buffers to the WAL file.
Checkpointer: Writes dirty buffers to the data file when a checkpoint occurs.
Archiver Process: When using archive mode, copies WAL files to a specified directory.
Logging Collector: Records error messages in the log file.
Stats collector: Gathers database management system (DBMS) statistics, such as session performance information and table usage statistics.
Autovacuum Launcher: Manages multiple versions of records in the database for Multi-Version Concurrency Control (MVCC). It cleans up records that are no longer referenced through vacuuming. Additionally, it performs tasks like cleaning up transaction IDs (XIDs) and table statistics. When vacuuming is needed, the Autovacuum Launcher requests the Postmaster process to start autovacuum worker processes.

< Backend Process >

Backend Processes
- The maximum number can be configured with the max_connections parameter, with a default value of 100.
- Responsible for executing the query requests of user processes and transmitting the results.

Simplify Architecture

Untitled

💡 ① Connection Initialization: Client initiates a connection request to the server through interface libraries (JDBC, ODBC, etc.)
👉 ② Server Creation: Postmaster process mediates the connection to the server
👉 ③ Query Request Response: The server performs the query on the allocated server and responds through the client.

5) Detailed Features and Limitations

Feature Name	Meaning
🚩 Nested transactions (savepoints)	Nested transactions (savepoints)
Point in time recovery	Point in time recovery
Online/hot backups, Parallel restore	Online/hot backups, Parallel restore
🚩 Rules system (query rewrite system)	Rules system (query rewrite system)
🚩 B-tree, R-tree, hash, GiST method indexes	B-tree, R-tree, hash, GiST method indexes
Multi-Version Concurrency Control (MVCC)	Multi-Version Concurrency Control (MVCC)
🚩 Tablespace	Tablespace
Procedural Language	Procedural Language
Information Schema	Information Schema
I18N(Internationalization), L10N(Localization)	Internationalization, Localization
Database & Column level collation	Database & Column level collation
🚩 Array, XML, UUID type	-
🚩 Auto-increment (sequences)	Auto-increment (sequences)
🚩 Asynchronous Replication	Asynchronous Replication
🚩 LIMIT/OFFSET	LIMIT/OFFSET
Full text search	Full text search
SSL, IPv6	Authentication
Key/Value storage	Key/Value storage
Table inheritance	Table inheritance

1. `Nested transactions (savepoints): 중첩된 트랜잭션(저장시점)`

Another transaction can be defined within a transaction.
Flexible operations can be performed by setting a savepoint.

💡 Details

Transaction operations in PostgreSQL: Use BEGIN before and COMMIT after the operations.

        
      
BEGIN;
// Within BEGIN and COMMIT is the transaction block
UPDATE accounts SET balance = balance - 100.00
  WHERE name = 'Alice';
-- etc, etc
COMMIT;

Setting a savepoint:

        
      
BEGIN;
UPDATE accounts SET balance = balance - 100.00
  WHERE name = 'Alice';
// Savepoint
SAVEPOINT my_savepoint;
UPDATE accounts SET balance = balance + 100.00
  WHERE name = 'Bob';
// Rollback
ROLLBACK TO my_savepoint;
// Rolled back to the savepoint, canceling the update for 'Bob'
UPDATE accounts SET balance = balance + 100.00
  WHERE name = 'Wally';
COMMIT;

2. `Rules system (query rewrite system): 규칙 시스템(쿼리 다시 쓰기 시스템)`

Rules creation allows for extension of SELECT, INSERT, UPDATE, DELETE operations.

💡 Rarely used due to operational issues; currently replaced by triggers.
1 2 3 CREATE [ OR REPLACE ] RULE name AS ON event TO table_name [ WHERE condition ] DO [ ALSO | INSTEAD ] { NOTHING | command | ( command ; command ... ) }
name: Rule name

event: One of SELECT, INSERT, UPDATE, DELETE operations

table_name: Name of the table or view to apply the rule to

condition: SQL conditional expression (boolean return)

INSTEAD: Execute the specified command instead of the original command

ALSO: Execute additional commands along with the original command

command: Command composing the rule action. Valid commands are SELECT, INSERT, UPDATE, DELETE, or NOTIFY.
1 2 3 4 5 CREATE VIEW myview AS SELECT * FROM mytab; CREATE TABLE myview (same column list as mytab); CREATE RULE "_RETURN" AS ON SELECT TO myview DO INSTEAD SELECT * FROM mytab;

3. `B-tree, R-tree, hash, GiST method indexes: B-트리, R-트리, 해시, GiST 메서드 인덱스`

B-tree Index: An index based on a tree-like data structure that maintains the sorted order of data, enabling efficient operations such as search, insertion, deletion, and sequential access.
R-tree: An index based on a tree data structure optimized for spatial data, allowing fast queries on data divided into spatial regions.
Hash Index: An index that uses a hash function to locate the bucket containing the key value, providing a quick way to retrieve data.
GiST Method Index: An index provided by PostgreSQL that supports various indexing options, such as geometric data and text search documents.

💡 Reference materials

        
      
// Index Creation
CREATE [ UNIQUE ] INDEX [ CONCURRENTLY ] [ [ IF NOT EXISTS ] name ] ON [ ONLY ] table_name [ USING index_method ]
    ( { column_name | ( expression ) } [ COLLATE collation_rule ] [ operator_class ] [ ASC | DESC ] [ NULLS { FIRST | LAST } ] [, ...] )
    [ INCLUDE ( column_name [, ...] ) ]
    [ WITH ( storage_parameter = value [, ... ] ) ]
    [ TABLESPACE tablespace_name ]
    [ WHERE condition ];

4. `Tablespace: 테이블스페이스`

The file system path where the objects of the database can be stored as defined by the database administrator.

💡 It allows the database administrator to define the file system location where files representing database objects can be stored.
The physical space where database objects are stored on the file system.
Using tablespace allows for the operation of using storage differently based on the purpose of the database, and it can also be utilized for purposes such as disaster response and recovery.
1 2 3 4 5 // Create a new tablespace CREATE TABLESPACE myTableSpace LOCATION '\data\myTableSpace'; // Create a database specifying the tablespace CREATE DATABASE myTable WITH TABLESPACE = myTableSpace;
When a table is created in the corresponding database, the storage of the tablespace is used to store files representing the database objects.
1 2 3 4 SELECT pg_database.dattablespace AS dtspcoid, datname, pg_database.oid, pg_tablespace.oid AS spcoid, spcname, spcowner FROM pg_database, pg_tablespace WHERE pg_database.dattablespace = pg_tablespace.oid;
DB_TS DB NAME DB ID TABLESPACE ID TABLESPACE NAME

1663 postgres 13442 1663 pg_default

1663 test 16394 1663 pg_default

1663 template1 1 1663 pg_default

1663 template0 13441 1663 pg_default

16735 mytable 16736 16735 mytablespace

16746 mytest 16747 16746 tbs1

16748 mytest2 16749 16748 tbs2

1663 newuserdb 16774 1663 pg_default

1663 testdb 16757 1663 pg_default

DB_TS	DB NAME	DB ID	TABLESPACE ID	TABLESPACE NAME
1663	postgres	13442	1663	pg_default
1663	test	16394	1663	pg_default
1663	template1	1	1663	pg_default
1663	template0	13441	1663	pg_default
16735	mytable	16736	16735	mytablespace
16746	mytest	16747	16746	tbs1
16748	mytest2	16749	16748	tbs2
1663	newuserdb	16774	1663	pg_default
1663	testdb	16757	1663	pg_default

5. `Array, XML, UUID type`

Support for various data types.

💡 Example of ARRAY type

CREATE

        
      
CREATE TABLE member(
    id	    serial  PRIMARY KEY,
    name    varchar(20),
    age     integer,
    hobby   varchar(100)[]   -- Array type column
    // When creating a table, adding [] after the column type makes it an array type column.
);

INSERT

        
INSERT INTO member (name, age, hobby) VALUES('kim', 10, '{book, music}');
INSERT INTO member (name, age, hobby) VALUES('park', 11, ARRAY['movie','sing','craft']);

SELECT

        
      
SELECT * FROM member;
// Result
id | name | age |       hobby
----+------+-----+--------------------
  1 | kim  |  10 | {book,music}
  2 | park |  11 | {movie,sing,craft}
(2 rows)
-- Read only the first data of the array type column
SELECT name, hobby[1] FROM member;
// Result
name | hobby
------+-------
 kim  | book
 park | movie
(2 rows)

6. `Auto-increment (sequences): 자동 증가(시퀀스)`

💡 Example of SEQUENCE

SEQUENCE

        
      
-- Create sequence
CREATE SEQUENCE seq_ttt;

-- Create table
CREATE TABLE tbl_ttt
(
    seq INT NOT NULL default NEXTVAL('seq_ttt') -- Matching sequence
,   a   VARCHAR(10)
);

-- When deleting the table, the sequence is also deleted together
ALTER SEQUENCE seq_ttt OWNED BY tbl_ttt.seq;

-- Insert
INSERT INTO tbl_ttt (a) VALUES ('aaa');
INSERT INTO tbl_ttt (a) VALUES ('bbb');
INSERT INTO tbl_ttt (a) VALUES ('ccc');
INSERT INTO tbl_ttt (a) VALUES ('ddd');
INSERT INTO tbl_ttt (a) VALUES ('eee');
INSERT INTO tbl_ttt (seq, a) VALUES (default,'eee');

-- Select
SELECT * FROM tbl_ttt;
// Result
seq |  a
-----+-----
   1 | aaa
   2 | bbb
   3 | ccc
   4 | ddd
   5 | eee
   6 | eee
(6 rows)

-- Automatically delete the table and sequence
DROP TABLE tbl_ttt;

SERIAL

        
      
-- CREATE
CREATE TABLE TEST (
  id SERIAL PRIMARY KEY, -- PK must be specified for auto-increment
  name VARCHAR NOT NULL
);

-- INSERT
INSERT INTO TEST(name) VALUES ('APPLE');
INSERT INTO TEST(id, name) VALUES (default, 'BANANA');
INSERT INTO TEST(id, name) VALUES (1, 'ORANGE');
-- Since you can forcibly enter the id value, duplicates may occur (ERROR with PK specification)
// ERROR: duplicate key value violates unique constraint "test_pkey"
// DETAIL: Key (id)=(1) already exists.

GENERATED { ALWAYS | BY DEFAULT } AS IDENTITY

        
      
CREATE TABLE foo
(
  id   INTEGER GENERATED ALWAYS AS IDENTITY,
  name VARCHAR
);

INSERT INTO foo (name) VALUES ('aaa');
INSERT INTO foo (id, name) VALUES (default,'bbb');
INSERT INTO foo (name) VALUES ('ccc');
INSERT INTO foo (id, name) VALUES (9,'ddd');
-- When directly assigning a value to the id field, an error occurs
// ERROR: cannot insert into column "id"
// DETAIL: Column "id" is an identity column and cannot be inserted into.
// HINT: OVERRIDING SYSTEM VALUE can be used to override.

-- When using OVERRIDING SYSTEM VALUE, duplicates are possible
INSERT INTO foo (id, name) OVERRIDING SYSTEM VALUE VALUES (3,'eee');

SELECT * FROM foo;
// Result
id |  name
----+--------
  1 | aaa
  2 | bbb
  3 | ccc
  3 | ddd
(4 rows)

        
      
CREATE TABLE foo1
(
  id   INTEGER GENERATED BY DEFAULT AS IDENTITY,
  name VARCHAR
);

INSERT INTO foo1 (name) VALUES ('aaa');
INSERT INTO foo1 (id,name) VALUES (1,'aaa'); -- Duplicates are possible
INSERT INTO foo1 (id,name) VALUES (default,'홍길동');

SELECT * FROM foo1;
// Result
id |  name
----+--------
  1 | aaa
  1 | aaa
  2 | 홍길동
(3 rows)

7. `Asynchronous Replication: 비동기 복제`

Log-Shipping, provides streaming replication.

💡 Source[Official][Official2][1][More detailed article on PostgreSQL Replication]

1. Why is replication necessary?

😨 If the operational server stops due to a failure,
→ 😧 Would operating a standby server improve availability?«br> → 🧐 If so, the data on the operational server and the standby server must match.
→ 😮 Replication is necessary! = warm standby, or log shipping feature

✔️ Both the operational server and the standby server must be running.
✔️ The operational server operates in archive mode, sending used WAL segment files (transaction log files) to the standby server in order.
✔️ The standby server runs in recovery mode only.
✔️ This method allows for easy replication management without the need to modify database tables.

Log Delivery to Standby Server Implementation

The operational server transports (ships) fully used WAL files to another server.

Note that the log delivery method is asynchronous.

In other words, since the WAL contents are already committed data, if the operational server stops before being sent to the server, it is lost (to reduce the loss, set the archive_timeout configuration value to a short time in seconds).

If the WAL file is delivered to the standby server in time, the time from the operational server stopping to the standby server taking over the role is very short, improving availability!

Types of Replication

When the server is running in standby mode, the server only performs the task of continuously reflecting WAL files received from the master server on its own server.

🔧 Log-Shipping(Warm standby)

The standby server checks if there is a new WAL file in the directory where the operational server sends the file and reflects the new WAL file.

🔧 Streaming Replication

Using TCP connection to directly connect the operational server and immediately reflect committed transactions to the standby server.

2. Streaming Replication

💡 Streaming-Replication : Streaming-Replication: A replication method that delivers WAL logs generated by the Master to the Slave DB in real-time to synchronize integrity.

3. More Detailed Article on PostgreSQL Replication

Test environment: CentOS 7.5, PostgreSQL 10.4 version

1-1) WAL-Write Ahead Log

Generates logs for all operations on the master server.

Sends the generated logs to the standby server.

Restores (re-executes) the received logs on the standby server.
💡 This operation creates a replication server with the same schema as the master server. – The logs on the master server are called WAL and are stored in $install_path/data/pg_xlog. – The installation path in the manual is /usr/local/pgsql/data.

1-2) WAL Delivery Method

< Log-Shipping Method >

The WAL files themselves are sent from the pg_xlog directory to the standby server.

The master server must fill the WAL files with a specified size before sending them to the standby server.

During the time it takes to fill the files, data between the master and standby servers may be inconsistent.

In the event of a master server failure, if the WAL files are not completely filled and transmitted, there is a risk of data loss.

< Streaming Method > * Available in PostgreSQL version 9.0 and above

Regardless of whether WAL files are stored, log contents are sent to the standby server.

Assuming no network issues between servers, it operates almost in real-time.

In the event of a standby server failure, to recover lost data, the standby server needs to be rebuilt from the beginning.
= It is advisable to apply Log-Shipping method even when using Streaming method.

2. Applying Streaming Replication

Proceeding with two servers, one master, and one standby.

The executing account is the installation account, which is typically “postgres.”

2-1) Master Server Configuration
To implement the streaming replication, create a dedicated replication user on the master server, which the standby server will use to access it.
1 # postgres= create role repluser with replication password ‘password’ login;
Set the access permissions for the created account.
1 2 # vim /usr/local/pgsql/data/pg_hba.conf host replication repluser [Standby Server ip]/32 trust
Configuration for replication.
1 2 3 4 listen_addresses = '*' # Authentication/authorization management is set in pg_hba.conf file wal_level = hot_standby # Enables read-only queries on standby server max_wal_senders = 2 # Maximum number of servers that can be connected for sending WAL files wal_keep_segments = 32 # Number of recent WAL files to keep in the master server directory
2-2) Setting up the standby server
Use the pg_basebackup command to perform the initial backup.

Replicate/restore the entire /usr/local/pgsql/data directory from the master server to the standby server.

Since all files in the standby server’s directory will be overwritten, it’s advisable to back up the postgresql.conf file in advance.

After replication/restoration, recover the backed-up postgresql.conf file.
The /usr/local/pgsql/data directory must be empty for the replication/restoration to proceed.
1 2 # pg_basebackup -h [Master Server ip] -D /usr/local/pgsql/data -U repluser -v -P –wal-method=stream
Configuring WAL content in streaming mode:
1 2 3 # vim /usr/local/pgsql/data/postgresql.conf listen_addresses = ‘*’ hot_standby = on # Allowing read-only operations on the standby server
Additionally, create a recovery.conf file in the same path as the postgresql.conf file.
Connect to the master server and receive WAL content in real-time using the information from the primary_conninfo option.
1 2 3 4 # vim /usr/local/pgsql/data/recovery.conf standby_mode = on primary_conninfo = ‘host=[Master Server ip] port=5432 user=repluser password=password’
2-3) Configuration Verification
After completing the configuration for the master and standby servers, start the daemons for the master server and standby server sequentially. [Master Server Running Status]
1 2 3 4 5 6 7 8 9 10 # ps -ef |grep postgres postgres 596 32676 0 05:46 ? 00:00:00 postgres: wal sender process repluser 115.68.x.x(56100) streaming 0/3000140 postgres 32676 1 0 04:36 ? 00:00:00 /usr/local/pgsql/bin/postgres -i -D /usr/local/pgsql/data postgres 32678 32676 0 04:36 ? 00:00:00 postgres: checkpointer process postgres 32679 32676 0 04:36 ? 00:00:00 postgres: writer process postgres 32680 32676 0 04:36 ? 00:00:00 postgres: wal writer process postgres 32681 32676 0 04:36 ? 00:00:00 postgres: autovacuum launcher process postgres 32682 32676 0 04:36 ? 00:00:00 postgres: stats collector process postgres 32683 32676 0 04:36 ? 00:00:00 postgres: bgworker: logical replication launcher // If the replication configuration is set up correctly, you should be able to see the wal sender process mentioned in the bold text above.
To further confirm, you can execute the following query on the master server. ```jsx
ps -ef |grep postgres

postgres 17151 1 0 05:39 ? 00:00:00 postmaster -p 5432 -D /usr/local/pgsql/data postgres 17152 17151 0 05:39 ? 00:00:00 postgres: startup process recovering 000000010000000000000003 postgres 17153 17151 0 05:39 ? 00:00:00 postgres: checkpointer process postgres 17154 17151 0 05:39 ? 00:00:00 postgres: writer process postgres 17155 17151 0 05:39 ? 00:00:00 postgres: stats collector process postgres 17156 17151 0 05:39 ? 00:00:07 postgres: wal receiver process streaming 0/3000140

If the replication setup is successful, you should see that the key being sent by the wal sender process on the master server (0/3000140) is being received on the standby server as well. ```
3. Applying Log-Shipping Replication

To prepare for potential failures on the standby server, you can also implement the Log-Shipping method as an additional measure.

The recovery of WAL on the standby server itself is done using the Streaming method, and the WAL files are stored as a backup.

3-1) Configure the directory to store WAL files * Configured on the standby server
This location doesn’t necessarily have to be on the standby server; it just needs to be accessible by it.
In this guide, we’ve chosen to store it in the home directory of the ‘postgres’ account on the standby server (/usr/local/pgsql).
1 2 3 # mkdir /usr/local/pgsql/archives # chown postgres:postgres /usr/local/pgsql/archives # chmod 700 /usr/local/pgsql/archives
3-2) Configure passwordless scp operation * Configured on the master server
To enable automation, set up passwordless SSH access to the master server.
1 2 # sudo -u postgres ssh-keygen # sudo -u postgres ssh-copy-id -i /usr/local/pgsql/.ssh/id_rsa.pub postgres@[Stanby Server ip]
WAL File Transfer Settings
1 2 3 # vim /usr/local/pgsql/data/postgresql.conf archive_command = 'scp -i /usr/local/pgsql/.ssh/id_rsa %p postgres@[Standby Server IP]:/usr/local/pgsql/archives/%f' archive_timeout = 30
%p represents the full path of the archive (WAL) file, and %f is the file name.
3-3) Confirmation of Configuration
After restarting the master server, you can confirm that files are accumulating in the specified directory on the standby server.
1 2 3 4 5 6 7 8 # ll /usr/local/pgsql/archives/ total 98304 -rw——- 1 postgres postgres 16777216 Aug 13 01:55 000000010000000000000004 -rw——- 1 postgres postgres 16777216 Aug 13 02:00 000000010000000000000005 -rw——- 1 postgres postgres 16777216 Aug 13 02:02 000000010000000000000006 -rw——- 1 postgres postgres 16777216 Aug 13 02:21 000000010000000000000008 -rw——- 1 postgres postgres 16777216 Aug 13 09:09 000000010000000000000009 -rw——- 1 postgres postgres 16777216 Aug 13 09:14 00000001000000000000000A
When installing PostgreSQL from source, daemon execution must be done using the pg_ctl command.

For security reasons, PostgreSQL does not allow daemon execution with root privileges.

Because of this, it is necessary to log in as a regular user to execute, typically using the account ‘postgres.’
The following is the content of the script file for daemon execution as root when installing from source.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 # vim /etc/init.d/postgresql #!/bin/sh # PostgreSQL START/STOP/RESTART Script SERVER=/usr/local/pgsql/bin/postmaster PGCTL=/usr/local/pgsql/bin/pg_ctl PGDATA=/usr/local/pgsql/data OPTIONS=-i LOGFILE=/usr/local/pgsql/data/postmaster.log case “$1” in start) echo -e “Starting PostgreSQL…” su -l postgres -c “nohup $SERVER $OPTIONS -D $PGDATA >> $LOGFILE 2>&1 &” ;; stop) echo -e “Stopping PostgreSQL…” su -l postgres -c “$PGCTL -D $PGDATA stop” ;; restart) echo -e “Stopping PostgreSQL…” su -l postgres -c “$PGCTL -D $PGDATA stop” echo -e “Starting PostgreSQL…” su -l postgres -c “nohup $SERVER $OPTIONS -D $PGDATA >> $LOGFILE 2>&1 &” ;; *) echo -e “Usage: $0 { start | stop | restart }” exit 1 ;; esac exit 0

8. `LIMIT/OFFSET: Limit/Offset`

Enables easy implementation of pagination.

        
      
-- Return the first 10 rows
SELECT * FROM test LIMIT 10;
SELECT * FROM test LIMIT 10 OFFSET 0;

-- Return 10 rows starting from the 11th row
SELECT * FROM test LIMIT 10 OFFSET 10;

9. `SSL, IPv6: Authentication`

Specifies the connection type, client IP address range (if applicable to the connection type), database name, username, and authentication method in each record of the pg_hba.conf configuration file stored within the database cluster for connections.

💡 pg_hba.conf Record and Field Detail

        
      
local      database  user  auth-method  [auth-options]
host       database  user  address  auth-method  [auth-options]
hostssl    database  user  address  auth-method  [auth-options]
hostnossl  database  user  address  auth-method  [auth-options]
host       database  user  IP-address  IP-mask  auth-method  [auth-options]
hostssl    database  user  IP-address  IP-mask  auth-method  [auth-options]
hostnossl  database  user  IP-address  IP-mask  auth-method  [auth-options]

10. `Key/Value storage: Key/Value Storage`

The module called hstore is provided in PostgreSQL to store a set of key/value pairs.

💡 Details[1][2]

        
      
 CREATE EXTENSION hstore; // hstore activate

        
      
k => v // => Whitespace around symbols is ignored. 
foo => bar, baz => whatever
"1-a" => "anything at all"
// Keys and values are enclosed in double quotes, which include spaces, commas, equals (=), or greater-than (>) signs.
//  To include double quotes or backslashes in keys or values, use a backslash.

        
      
SELECT 'a=>1,a=>2'::hstore;
// Result
  hstore
----------
 "a"=>"1" // No overlap

        
      
-- Apply to table
CREATE TABLE AddressBook (
    id SERIAL PRIMARY KEY,
    name VARCHAR,
    attributes HSTORE
);

-- Insert record
INSERT INTO AddressBook (name, attributes) VALUES (
    '김가가',
    'age => 38,
     telephone => "010-1111-1111",
     email => "111@aaa.co.kr"'
);
INSERT INTO AddressBook (name, attributes) VALUES (
    '김나나',
    'age => 29,
     telephone => "N/A",
     email => "222@bbb.co.kr"'
);

-- Select
SELECT * FROM AddressBook;
// Result
id |  name  |                             attributes
----+--------+---------------------------------------------------------------------
  1 | 김가가 | "age"=>"38", "email"=>"111@aaa.co.kr", "telephone"=>"010-1111-1111"
  2 | 김나나 | "age"=>"29", "email"=>"222@bbb.co.kr", "telephone"=>"N/A"
(2 rows)

-- To query individuals with 'N/A' as their telephone value:
SELECT * FROM AddressBook WHERE attributes->'telephone' = 'N/A';
// Result
id |  name  |                        attributes
----+--------+-----------------------------------------------------------
  2 | 김나나 | "age"=>"29", "email"=>"222@bbb.co.kr", "telephone"=>"N/A"
(1 row)

11. `Table inheritance: 테이블상속`

Inheritance functionality is provided when creating a table.
The table inheriting from another is referred to as the child table, while the table being inherited from is the parent table.

💡 Details[1][2]

        
      
// parents table
CREATE TABLE cities (
  name        TEXT,
  population  FLOAT,
  altitude    INT
);

        
      
// child table
CREATE TABLE capitals(
  state   char(2)
) INHERITS (cities);

Untitled

        
      
// Creating another table that inherits from the child table "capitals":
CREATE TABLE streets (
	col1 char(1)
) INHERITS (capitals);

Untitled

        
      
-- When attempting to delete the parent table
DROP TABLE public.cities;

// the following error occurs
ERROR: cannot drop table cities because other objects depend on it
DETAIL: dependent objects: capitals table, streets table
HINT: To remove this object and its dependencies, use the DROP ... CASCADE command.
SQL state: 2BP01

-- using CASCADE
DROP TABLE public.cities CASCADE;
// Result
NOTICE: related items for 2 different objects deleted
DETAIL: Object for the capitals table deleted by cascade
Object for the streets table deleted by cascade
DROP TABLE

-- After Deletion, Query
SELECT * FROM public.cities;
SELECT * FROM public.capitals;
SELECT * FROM public.streets;
// Result
ERROR: relation "public.streets" does not exist
LINE 2: SELECT * FROM public.streets; // Remaining tables are the same
                      ^

Constraints

Maximum DB Size(Database Size)	Unlimited
Maximum Table Size	32TB
Maximum Row Size	1.6TB
Maximum Field Size	1 GB
Rows per Table Limit	Unlimited
Columns per Table Limit	250~1600
Indexes per Table Limit	Unlimited

6) Comparison with Competing Products

Oracle

Extensive code validated over a long period
Abundance of references available
Drawback: Expensive cost

DB2 (IBM), MS SQL

Similarities with Oracle

MySQL

Diverse applications and references
Adoption in enterprise development models with licensing concerns (Commercial usage cost↑)

PostgreSQL

Strengthening its position in the enterprise DBMS market, including the release of the Postgres Plus Advanced Server product
Well-suited for handling large capacities and complex transactions
Advantages of relatively lower costs while offering a range of features
Services include education (manual), consulting, migration, and technical support

SELECT A.* FROM PostgreSQL A;

1. Features

1) What is PostgreSQL?

2) History

3) Keywords

Portable(휴대성)

Reliable(신뢰성)

Scalable(확장성)

Secure(보안)

Recovery & Availability(복구, 이용)

Advanced(발전)

4) Internal Structure

DATABASE Structure

Schema

Key Creation Commands

template 데이터베이스

권한

아키텍처

< Postmaster Daemon >

< Shared Memory >

< Background Process >

< Backend Process >

Simplify Architecture

5) Detailed Features and Limitations

1. Nested transactions (savepoints): 중첩된 트랜잭션(저장시점)

2. Rules system (query rewrite system): 규칙 시스템(쿼리 다시 쓰기 시스템)

3. B-tree, R-tree, hash, GiST method indexes: B-트리, R-트리, 해시, GiST 메서드 인덱스

4. Tablespace: 테이블스페이스

5. Array, XML, UUID type

CREATE

INSERT

SELECT

6. Auto-increment (sequences): 자동 증가(시퀀스)

SEQUENCE

SERIAL

GENERATED { ALWAYS | BY DEFAULT } AS IDENTITY

7. Asynchronous Replication: 비동기 복제

1. Why is replication necessary?

Log Delivery to Standby Server Implementation

Types of Replication

🔧 Log-Shipping(Warm standby)

🔧 Streaming Replication

2. Streaming Replication

3. More Detailed Article on PostgreSQL Replication

1-1) WAL-Write Ahead Log

1-2) WAL Delivery Method

< Log-Shipping Method >

< Streaming Method > * Available in PostgreSQL version 9.0 and above

2. Applying Streaming Replication

2-1) Master Server Configuration

2-2) Setting up the standby server

2-3) Configuration Verification

ps -ef |grep postgres

3. Applying Log-Shipping Replication

3-1) Configure the directory to store WAL files * Configured on the standby server

3-2) Configure passwordless scp operation * Configured on the master server

3-3) Confirmation of Configuration

8. LIMIT/OFFSET: Limit/Offset

9. SSL, IPv6: Authentication

10. Key/Value storage: Key/Value Storage

11. Table inheritance: 테이블상속

Constraints

6) Comparison with Competing Products

Oracle

DB2 (IBM), MS SQL

MySQL

PostgreSQL

Further Reading

SELECT B.* FROM PostgreSQL B;

GPT prompt for Highcharts

What is different between Vue2 and Vue3?

`Portable(휴대성)`

`Reliable(신뢰성)`

`Scalable(확장성)`

`Secure(보안)`

`Recovery & Availability(복구, 이용)`

`Advanced(발전)`

1. `Nested transactions (savepoints): 중첩된 트랜잭션(저장시점)`

2. `Rules system (query rewrite system): 규칙 시스템(쿼리 다시 쓰기 시스템)`

3. `B-tree, R-tree, hash, GiST method indexes: B-트리, R-트리, 해시, GiST 메서드 인덱스`

4. `Tablespace: 테이블스페이스`

5. `Array, XML, UUID type`

6. `Auto-increment (sequences): 자동 증가(시퀀스)`

7. `Asynchronous Replication: 비동기 복제`

< Streaming Method > `* Available in PostgreSQL version 9.0 and above`

3-1) Configure the directory to store WAL files `* Configured on the standby server`

3-2) Configure passwordless scp operation `* Configured on the master server`

8. `LIMIT/OFFSET: Limit/Offset`

9. `SSL, IPv6: Authentication`

10. `Key/Value storage: Key/Value Storage`

11. `Table inheritance: 테이블상속`