- 关于MogDB
- 快速入门
- 特性描述
- 概览
- 高性能
- 高可用
- 维护性
- 兼容性
- 视图增加%rowtype属性
- 聚合函数distinct性能优化
- 聚合函数支持KEEP子句
- 聚合函数支持场景扩展
- 兼容支持MySQL别名支持单引号
- 支持current_date/current_time关键字作为字段名
- 自定义type数组
- For Update支持外连接
- MogDB支持Insert All特性
- Oracle DBLink语法兼容
- 创建PACKAGE/FUNCTION/PROCEDURE时去除TYPE类型转换提示
- 支持MERGE INTO命中索引时使用Bypass方法
- 支持增加存储过程及函数参数的nocopy属性
- 支持在数组extend的参数中传入数组的count属性
- 支持q quote转义字符
- 支持两个date类型的数据相减返回numeric类型
- 支持表函数table()
- 支持PROCEDURE/FUNCTION/PACKAGE的end后的name和Oracle保持一致
- 支持WHERE CURRENT OF写法
- 支持包内常量作为函数或者过程入参的默认值
- 支持PLPGSQL subtype
- 支持无参数FUNCTION的同义词调用不加括号
- 支持dbms_utility.format_error_backtrace
- 支持PIVOT和UNPIVOT语法
- mod函数兼容
- 支持聚集函数嵌套
- ORDER BY/GROUP BY场景兼容
- 支持在建表后修改表日志属性
- INSERT支持ON CONFLICT子句
- 支持AUTHID CURRENT_USER
- PBE模式支持存储过程out出参
- 数据库安全
- 企业级特性
- 应用开发接口
- AI能力
- 中间件
- 负载管理
- 安装指南
- 升级指南
- 管理指南
- 高可用指南
- AI特性指南
- 安全指南
- 开发者指南
- 应用程序开发教程
- 开发规范
- 基于JDBC开发
- JDBC包、驱动类和环境类
- 开发流程
- 加载驱动
- 连接数据库
- 连接数据库(以SSL方式)
- 连接数据库(UDS方式)
- 执行SQL语句
- 处理结果集
- 关闭连接
- 日志管理
- 示例:常用操作
- 示例:重新执行应用SQL
- 示例:通过本地文件导入导出数据
- 示例:从MY向MogDB进行数据迁移
- 示例:逻辑复制代码示例
- 示例:不同场景下连接数据库参数配置
- 示例:jdbc主备集群负载均衡
- JDBC接口参考
- java.sql.Connection
- java.sql.CallableStatement
- java.sql.DatabaseMetaData
- java.sql.Driver
- java.sql.PreparedStatement
- java.sql.ResultSet
- java.sql.ResultSetMetaData
- java.sql.Statement
- javax.sql.ConnectionPoolDataSource
- javax.sql.DataSource
- javax.sql.PooledConnection
- javax.naming.Context
- javax.naming.spi.InitialContextFactory
- CopyManager
- JDBC常用参数参考
- JDBC发布记录
- 基于ODBC开发
- 基于libpq开发
- 基于Psycopg2开发
- 调试
- 存储过程
- 用户自定义函数
- PL/pgSQL-SQL过程语言
- 定时任务
- 自治事务
- 逻辑复制
- Extension
- MySQL兼容性说明
- Dolphin Extension
- Dolphin概述
- Dolphin安装
- Dolphin限制
- Dolphin语法介绍
- SQL参考
- 关键字
- 数据类型
- 函数和操作符
- 表达式
- DDL语法一览表
- DML语法一览表
- DCL语法一览表
- SQL语法
- ALTER DATABASE
- ALTER FUNCTION
- ALTER PROCEDURE
- ALTER SERVER
- ALTER TABLE
- ALTER TABLE PARTITION
- ALTER TABLESPACE
- ALTER VIEW
- ANALYZE | ANALYSE
- AST
- CHECKSUM TABLE
- CREATE DATABASE
- CREATE FUNCTION
- CREATE INDEX
- CREATE PROCEDURE
- CREATE SERVER
- CREATE TABLE
- CREATE TABLE AS
- CREATE TABLE PARTITION
- CREATE TABLESPACE
- CREATE TRIGGER
- CREATE VIEW
- DESCRIBE TABLE
- DO
- DROP DATABASE
- DROP INDEX
- DROP TABLESPACE
- EXECUTE
- EXPLAIN
- FLUSH BINARY LOGS
- GRANT
- GRANT/REVOKE PROXY
- INSERT
- KILL
- LOAD DATA
- OPTIMIZE TABLE
- PREPARE
- RENAME TABLE
- RENAME USER
- REVOKE
- SELECT
- SELECT HINT
- SET CHARSET
- SET PASSWORD
- SHOW CHARACTER SET
- SHOW COLLATION
- SHOW COLUMNS
- SHOW CREATE DATABASE
- SHOW CREATE FUNCTION
- SHOW CREATE PROCEDURE
- SHOW CREATE TABLE
- SHOW CREATE TRIGGER
- SHOW CREATE VIEW
- SHOW DATABASES
- SHOW FUNCTION STATUS
- SHOW GRANTS
- SHOW INDEX
- SHOW MASTER STATUS
- SHOW PLUGINS
- SHOW PRIVILEGES
- SHOW PROCEDURE STATUS
- SHOW PROCESSLIST
- SHOW SLAVE HOSTS
- SHOW STATUS
- SHOW TABLES
- SHOW TABLE STATUS
- SHOW TRIGGERS
- SHOW VARIABLES
- SHOW WARNINGS/ERRORS
- UPDATE
- USE db_name
- 系统视图
- GUC参数说明
- 重设参数
- 存储过程
- 标识符说明
- SQL参考
- MySQL语法兼容性评估工具
- Dolphin Extension
- 物化视图
- 分区管理
- 应用程序开发教程
- 性能优化指南
- 参考指南
- 系统表及系统视图
- 系统表和系统视图概述
- 查看系统表
- 系统表
- GS_ASP
- GS_AUDITING_POLICY
- GS_AUDITING_POLICY_ACCESS
- GS_AUDITING_POLICY_FILTERS
- GS_AUDITING_POLICY_PRIVILEGES
- GS_CLIENT_GLOBAL_KEYS
- GS_CLIENT_GLOBAL_KEYS_ARGS
- GS_COLUMN_KEYS
- GS_COLUMN_KEYS_ARGS
- GS_DB_PRIVILEGE
- GS_ENCRYPTED_COLUMNS
- GS_ENCRYPTED_PROC
- GS_GLOBAL_CHAIN
- GS_GLOBAL_CONFIG
- GS_MASKING_POLICY
- GS_MASKING_POLICY_ACTIONS
- GS_MASKING_POLICY_FILTERS
- GS_MATVIEW
- GS_MATVIEW_DEPENDENCY
- GS_MODEL_WAREHOUSE
- GS_OPT_MODEL
- GS_PACKAGE
- GS_POLICY_LABEL
- GS_RECYCLEBIN
- GS_TXN_SNAPSHOT
- GS_UID
- GS_WLM_EC_OPERATOR_INFO
- GS_WLM_INSTANCE_HISTORY
- GS_WLM_OPERATOR_INFO
- GS_WLM_PLAN_ENCODING_TABLE
- GS_WLM_PLAN_OPERATOR_INFO
- GS_WLM_SESSION_QUERY_INFO_ALL
- GS_WLM_USER_RESOURCE_HISTORY
- PG_AGGREGATE
- PG_AM
- PG_AMOP
- PG_AMPROC
- PG_APP_WORKLOADGROUP_MAPPING
- PG_ATTRDEF
- PG_ATTRIBUTE
- PG_AUTH_HISTORY
- PG_AUTH_MEMBERS
- PG_AUTHID
- PG_CAST
- PG_CLASS
- PG_COLLATION
- PG_CONSTRAINT
- PG_CONVERSION
- PG_DATABASE
- PG_DB_ROLE_SETTING
- PG_DEFAULT_ACL
- PG_DEPEND
- PG_DESCRIPTION
- PG_DIRECTORY
- PG_ENUM
- PG_EVENT_TRIGGER
- PG_EXTENSION
- PG_EXTENSION_DATA_SOURCE
- PG_FOREIGN_DATA_WRAPPER
- PG_FOREIGN_SERVER
- PG_FOREIGN_TABLE
- PG_HASHBUCKET
- PG_INDEX
- PG_INHERITS
- PG_JOB
- PG_JOB_PROC
- PG_LANGUAGE
- PG_LARGEOBJECT
- PG_LARGEOBJECT_METADATA
- PG_NAMESPACE
- PG_OBJECT
- PG_OPCLASS
- PG_OPERATOR
- PG_OPFAMILY
- PG_PARTITION
- PG_PLTEMPLATE
- PG_PROC
- PG_PUBLICATION
- PG_PUBLICATION_REL
- PG_RANGE
- PG_REPLICATION_ORIGIN
- PG_RESOURCE_POOL
- PG_REWRITE
- PG_RLSPOLICY
- PG_SECLABEL
- PG_SET
- PG_SHDEPEND
- PG_SHDESCRIPTION
- PG_SHSECLABEL
- PG_STATISTIC
- PG_STATISTIC_EXT
- PG_SUBSCRIPTION
- PG_SUBSCRIPTION_REL
- PG_SYNONYM
- PG_TABLESPACE
- PG_TRIGGER
- PG_TS_CONFIG
- PG_TS_CONFIG_MAP
- PG_TS_DICT
- PG_TS_PARSER
- PG_TS_TEMPLATE
- PG_TYPE
- PG_USER_MAPPING
- PG_USER_STATUS
- PG_WORKLOAD_GROUP
- PGXC_CLASS
- PGXC_GROUP
- PGXC_NODE
- PGXC_SLICE
- PLAN_TABLE_DATA
- STATEMENT_HISTORY
- 系统视图
- GET_GLOBAL_PREPARED_XACTS(废弃)
- GS_ASYNC_SUBMIT_SESSIONS_STATUS
- GS_AUDITING
- GS_AUDITING_ACCESS
- GS_AUDITING_PRIVILEGE
- GS_CLUSTER_RESOURCE_INFO
- GS_COMPRESSION
- GS_DB_PRIVILEGES
- GS_FILE_STAT
- GS_GSC_MEMORY_DETAIL
- GS_INSTANCE_TIME
- GS_LABELS
- GS_LSC_MEMORY_DETAIL
- GS_MASKING
- GS_MATVIEWS
- GS_OS_RUN_INFO
- GS_REDO_STAT
- GS_SESSION_CPU_STATISTICS
- GS_SESSION_MEMORY
- GS_SESSION_MEMORY_CONTEXT
- GS_SESSION_MEMORY_DETAIL
- GS_SESSION_MEMORY_STATISTICS
- GS_SESSION_STAT
- GS_SESSION_TIME
- GS_SHARED_MEMORY_DETAIL
- GS_SQL_COUNT
- GS_STAT_SESSION_CU
- GS_THREAD_MEMORY_CONTEXT
- GS_TOTAL_MEMORY_DETAIL
- GS_WLM_CGROUP_INFO
- GS_WLM_EC_OPERATOR_STATISTICS
- GS_WLM_OPERATOR_HISTORY
- GS_WLM_OPERATOR_STATISTICS
- GS_WLM_PLAN_OPERATOR_HISTORY
- GS_WLM_REBUILD_USER_RESOURCE_POOL
- GS_WLM_RESOURCE_POOL
- GS_WLM_SESSION_HISTORY
- GS_WLM_SESSION_INFO
- GS_WLM_SESSION_INFO_ALL
- GS_WLM_SESSION_STATISTICS
- GS_WLM_USER_INFO
- IOS_STATUS
- MPP_TABLES
- PG_AVAILABLE_EXTENSION_VERSIONS
- PG_AVAILABLE_EXTENSIONS
- PG_COMM_DELAY
- PG_COMM_RECV_STREAM
- PG_COMM_SEND_STREAM
- PG_COMM_STATUS
- PG_CONTROL_GROUP_CONFIG
- PG_CURSORS
- PG_EXT_STATS
- PG_GET_INVALID_BACKENDS
- PG_GET_SENDERS_CATCHUP_TIME
- PG_GROUP
- PG_GTT_ATTACHED_PIDS
- PG_GTT_RELSTATS
- PG_GTT_STATS
- PG_INDEXES
- PG_LOCKS
- PG_NODE_ENV
- PG_OS_THREADS
- PG_PREPARED_STATEMENTS
- PG_PREPARED_XACTS
- PG_PUBLICATION_TABLES
- PG_REPLICATION_ORIGIN_STATUS
- PG_REPLICATION_SLOTS
- PG_RLSPOLICIES
- PG_ROLES
- PG_RULES
- PG_RUNNING_XACTS
- PG_SECLABELS
- PG_SESSION_IOSTAT
- PG_SESSION_WLMSTAT
- PG_SETTINGS
- PG_SHADOW
- PG_STAT_ACTIVITY
- PG_STAT_ACTIVITY_NG
- PG_STAT_ALL_INDEXES
- PG_STAT_ALL_TABLES
- PG_STAT_BAD_BLOCK
- PG_STAT_BGWRITER
- PG_STAT_DATABASE
- PG_STAT_DATABASE_CONFLICTS
- PG_STAT_REPLICATION
- PG_STAT_SUBSCRIPTION
- PG_STAT_SYS_INDEXES
- PG_STAT_SYS_TABLES
- PG_STAT_USER_FUNCTIONS
- PG_STAT_USER_INDEXES
- PG_STAT_USER_TABLES
- PG_STAT_XACT_ALL_TABLES
- PG_STAT_XACT_SYS_TABLES
- PG_STAT_XACT_USER_FUNCTIONS
- PG_STAT_XACT_USER_TABLES
- PG_STATIO_ALL_INDEXES
- PG_STATIO_ALL_SEQUENCES
- PG_STATIO_ALL_TABLES
- PG_STATIO_SYS_INDEXES
- PG_STATIO_SYS_SEQUENCES
- PG_STATIO_SYS_TABLES
- PG_STATIO_USER_INDEXES
- PG_STATIO_USER_SEQUENCES
- PG_STATIO_USER_TABLES
- PG_STATS
- PG_TABLES
- PG_TDE_INFO
- PG_THREAD_WAIT_STATUS
- PG_TIMEZONE_ABBREVS
- PG_TIMEZONE_NAMES
- PG_TOTAL_MEMORY_DETAIL
- PG_TOTAL_USER_RESOURCE_INFO
- PG_TOTAL_USER_RESOURCE_INFO_OID
- PG_USER
- PG_USER_MAPPINGS
- PG_VARIABLE_INFO
- PG_VIEWS
- PG_WLM_STATISTICS
- PGXC_PREPARED_XACTS
- PLAN_TABLE
- PATCH_INFORMATION_TABLE
- 系统函数
- 逻辑操作符
- 比较操作符
- 字符处理函数和操作符
- 二进制字符串函数和操作符
- 位串函数和操作符
- 模式匹配操作符
- 数字操作函数和操作符
- 时间和日期处理函数和操作符
- 类型转换函数
- 几何函数和操作符
- 网络地址函数和操作符
- 文本检索函数和操作符
- JSON/JSONB函数和操作符
- HLL函数和操作符
- SEQUENCE函数
- 数组函数和操作符
- 范围函数和操作符
- 聚集函数
- 窗口函数(分析函数)
- 安全函数
- 账本数据库的函数
- 密态等值的函数
- 返回集合的函数
- 条件表达式函数
- 系统信息函数
- 系统管理函数
- 统计信息函数
- 触发器函数
- 事件触发器函数
- HashFunc函数
- 提示信息函数
- 全局临时表函数
- 故障注入系统函数
- AI特性函数
- 动态数据脱敏函数
- 其他系统函数
- 内部函数
- Global SysCache特性函数
- 数据损坏检测修复函数
- XML类型函数
- 废弃函数
- 支持的数据类型
- SQL语法
- ABORT
- ALTER AGGREGATE
- ALTER AUDIT POLICY
- ALTER DATABASE
- ALTER DATA SOURCE
- ALTER DEFAULT PRIVILEGES
- ALTER DIRECTORY
- ALTER EVENT
- ALTER EVENT TRIGGER
- ALTER EXTENSION
- ALTER FOREIGN DATA WRAPPER
- ALTER FOREIGN TABLE
- ALTER FUNCTION
- ALTER GLOBAL CONFIGURATION
- ALTER GROUP
- ALTER INDEX
- ALTER LANGUAGE
- ALTER LARGE OBJECT
- ALTER MASKING POLICY
- ALTER MATERIALIZED VIEW
- ALTER OPERATOR
- ALTER PACKAGE
- ALTER PROCEDURE
- ALTER PUBLICATION
- ALTER RESOURCE LABEL
- ALTER RESOURCE POOL
- ALTER ROLE
- ALTER ROW LEVEL SECURITY POLICY
- ALTER RULE
- ALTER SCHEMA
- ALTER SEQUENCE
- ALTER SERVER
- ALTER SESSION
- ALTER SUBSCRIPTION
- ALTER SYNONYM
- ALTER SYSTEM KILL SESSION
- ALTER SYSTEM SET
- ALTER TABLE
- ALTER TABLE PARTITION
- ALTER TABLE SUBPARTITION
- ALTER TABLESPACE
- ALTER TEXT SEARCH CONFIGURATION
- ALTER TEXT SEARCH DICTIONARY
- ALTER TRIGGER
- ALTER TYPE
- ALTER USER
- ALTER USER MAPPING
- ALTER VIEW
- ANALYZE | ANALYSE
- BEGIN
- CALL
- CHECKPOINT
- CLEAN CONNECTION
- CLOSE
- CLUSTER
- COMMENT
- COMMIT | END
- COMMIT PREPARED
- CONNECT BY
- COPY
- CREATE AGGREGATE
- CREATE AUDIT POLICY
- CREATE CAST
- CREATE CLIENT MASTER KEY
- CREATE COLUMN ENCRYPTION KEY
- CREATE DATABASE
- CREATE DATA SOURCE
- CREATE DIRECTORY
- CREATE EVENT
- CREATE EVENT TRIGGER
- CREATE EXTENSION
- CREATE FOREIGN DATA WRAPPER
- CREATE FOREIGN TABLE
- CREATE FUNCTION
- CREATE GROUP
- CREATE INCREMENTAL MATERIALIZED VIEW
- CREATE INDEX
- CREATE LANGUAGE
- CREATE MASKING POLICY
- CREATE MATERIALIZED VIEW
- CREATE MODEL
- CREATE OPERATOR
- CREATE PACKAGE
- CREATE PROCEDURE
- CREATE PUBLICATION
- CREATE RESOURCE LABEL
- CREATE RESOURCE POOL
- CREATE ROLE
- CREATE ROW LEVEL SECURITY POLICY
- CREATE RULE
- CREATE SCHEMA
- CREATE SEQUENCE
- CREATE SERVER
- CREATE SUBSCRIPTION
- CREATE SYNONYM
- CREATE TABLE
- CREATE TABLE AS
- CREATE TABLE PARTITION
- CREATE TABLESPACE
- CREATE TABLE SUBPARTITION
- CREATE TEXT SEARCH CONFIGURATION
- CREATE TEXT SEARCH DICTIONARY
- CREATE TRIGGER
- CREATE TYPE
- CREATE USER
- CREATE USER MAPPING
- CREATE VIEW
- CREATE WEAK PASSWORD DICTIONARY
- CURSOR
- DEALLOCATE
- DECLARE
- DELETE
- DELIMITER
- DO
- DROP AGGREGATE
- DROP AUDIT POLICY
- DROP CAST
- DROP CLIENT MASTER KEY
- DROP COLUMN ENCRYPTION KEY
- DROP DATABASE
- DROP DATA SOURCE
- DROP DIRECTORY
- DROP EVENT
- DROP EVENT TRIGGER
- DROP EXTENSION
- DROP FOREIGN DATA WRAPPER
- DROP FOREIGN TABLE
- DROP FUNCTION
- DROP GLOBAL CONFIGURATION
- DROP GROUP
- DROP INDEX
- DROP LANGUAGE
- DROP MASKING POLICY
- DROP MATERIALIZED VIEW
- DROP MODEL
- DROP OPERATOR
- DROP OWNED
- DROP PACKAGE
- DROP PROCEDURE
- DROP PUBLICATION
- DROP RESOURCE LABEL
- DROP RESOURCE POOL
- DROP ROLE
- DROP ROW LEVEL SECURITY POLICY
- DROP RULE
- DROP SCHEMA
- DROP SEQUENCE
- DROP SERVER
- DROP SUBSCRIPTION
- DROP SYNONYM
- DROP TABLE
- DROP TABLESPACE
- DROP TEXT SEARCH CONFIGURATION
- DROP TEXT SEARCH DICTIONARY
- DROP TRIGGER
- DROP TYPE
- DROP USER
- DROP USER MAPPING
- DROP VIEW
- DROP WEAK PASSWORD DICTIONARY
- EXECUTE
- EXECUTE DIRECT
- EXPLAIN
- EXPLAIN PLAN
- FETCH
- GRANT
- INSERT
- LOCK
- MERGE INTO
- MOVE
- PREDICT BY
- PREPARE
- PREPARE TRANSACTION
- PURGE
- REASSIGN OWNED
- REFRESH INCREMENTAL MATERIALIZED VIEW
- REFRESH MATERIALIZED VIEW
- REINDEX
- RELEASE SAVEPOINT
- RESET
- REVOKE
- ROLLBACK
- ROLLBACK PREPARED
- ROLLBACK TO SAVEPOINT
- SAVEPOINT
- SELECT
- SELECT INTO
- SET
- SET CONSTRAINTS
- SET ROLE
- SET SESSION AUTHORIZATION
- SET TRANSACTION
- SHOW
- SHOW EVENTS
- SHRINK
- SHUTDOWN
- SNAPSHOT
- START TRANSACTION
- TIMECAPSULE TABLE
- TRUNCATE
- UPDATE
- VACUUM
- VALUES
- SQL参考
- GUC参数说明
- Schema
- Information Schema
- DBE_PERF
- OS
- Instance
- Memory
- File
- Object
- STAT_USER_TABLES
- SUMMARY_STAT_USER_TABLES
- GLOBAL_STAT_USER_TABLES
- STAT_USER_INDEXES
- SUMMARY_STAT_USER_INDEXES
- GLOBAL_STAT_USER_INDEXES
- STAT_SYS_TABLES
- SUMMARY_STAT_SYS_TABLES
- GLOBAL_STAT_SYS_TABLES
- STAT_SYS_INDEXES
- SUMMARY_STAT_SYS_INDEXES
- GLOBAL_STAT_SYS_INDEXES
- STAT_ALL_TABLES
- SUMMARY_STAT_ALL_TABLES
- GLOBAL_STAT_ALL_TABLES
- STAT_ALL_INDEXES
- SUMMARY_STAT_ALL_INDEXES
- GLOBAL_STAT_ALL_INDEXES
- STAT_DATABASE
- SUMMARY_STAT_DATABASE
- GLOBAL_STAT_DATABASE
- STAT_DATABASE_CONFLICTS
- SUMMARY_STAT_DATABASE_CONFLICTS
- GLOBAL_STAT_DATABASE_CONFLICTS
- STAT_XACT_ALL_TABLES
- SUMMARY_STAT_XACT_ALL_TABLES
- GLOBAL_STAT_XACT_ALL_TABLES
- STAT_XACT_SYS_TABLES
- SUMMARY_STAT_XACT_SYS_TABLES
- GLOBAL_STAT_XACT_SYS_TABLES
- STAT_XACT_USER_TABLES
- SUMMARY_STAT_XACT_USER_TABLES
- GLOBAL_STAT_XACT_USER_TABLES
- STAT_XACT_USER_FUNCTIONS
- SUMMARY_STAT_XACT_USER_FUNCTIONS
- GLOBAL_STAT_XACT_USER_FUNCTIONS
- STAT_BAD_BLOCK
- SUMMARY_STAT_BAD_BLOCK
- GLOBAL_STAT_BAD_BLOCK
- STAT_USER_FUNCTIONS
- SUMMARY_STAT_USER_FUNCTIONS
- GLOBAL_STAT_USER_FUNCTIONS
- Workload
- Session/Thread
- SESSION_STAT
- GLOBAL_SESSION_STAT
- SESSION_TIME
- GLOBAL_SESSION_TIME
- SESSION_MEMORY
- GLOBAL_SESSION_MEMORY
- SESSION_MEMORY_DETAIL
- GLOBAL_SESSION_MEMORY_DETAIL
- SESSION_STAT_ACTIVITY
- GLOBAL_SESSION_STAT_ACTIVITY
- THREAD_WAIT_STATUS
- GLOBAL_THREAD_WAIT_STATUS
- LOCAL_THREADPOOL_STATUS
- GLOBAL_THREADPOOL_STATUS
- SESSION_CPU_RUNTIME
- SESSION_MEMORY_RUNTIME
- STATEMENT_IOSTAT_COMPLEX_RUNTIME
- LOCAL_ACTIVE_SESSION
- Transaction
- Query
- STATEMENT
- SUMMARY_STATEMENT
- STATEMENT_COUNT
- GLOBAL_STATEMENT_COUNT
- SUMMARY_STATEMENT_COUNT
- GLOBAL_STATEMENT_COMPLEX_HISTORY
- GLOBAL_STATEMENT_COMPLEX_HISTORY_TABLE
- GLOBAL_STATEMENT_COMPLEX_RUNTIME
- STATEMENT_RESPONSETIME_PERCENTILE
- STATEMENT_COMPLEX_RUNTIME
- STATEMENT_COMPLEX_HISTORY_TABLE
- STATEMENT_COMPLEX_HISTORY
- STATEMENT_WLMSTAT_COMPLEX_RUNTIME
- STATEMENT_HISTORY
- Cache/IO
- STATIO_USER_TABLES
- SUMMARY_STATIO_USER_TABLES
- GLOBAL_STATIO_USER_TABLES
- STATIO_USER_INDEXES
- SUMMARY_STATIO_USER_INDEXES
- GLOBAL_STATIO_USER_INDEXES
- STATIO_USER_SEQUENCES
- SUMMARY_STATIO_USER_SEQUENCES
- GLOBAL_STATIO_USER_SEQUENCES
- STATIO_SYS_TABLES
- SUMMARY_STATIO_SYS_TABLES
- GLOBAL_STATIO_SYS_TABLES
- STATIO_SYS_INDEXES
- SUMMARY_STATIO_SYS_INDEXES
- GLOBAL_STATIO_SYS_INDEXES
- STATIO_SYS_SEQUENCES
- SUMMARY_STATIO_SYS_SEQUENCES
- GLOBAL_STATIO_SYS_SEQUENCES
- STATIO_ALL_TABLES
- SUMMARY_STATIO_ALL_TABLES
- GLOBAL_STATIO_ALL_TABLES
- STATIO_ALL_INDEXES
- SUMMARY_STATIO_ALL_INDEXES
- GLOBAL_STATIO_ALL_INDEXES
- STATIO_ALL_SEQUENCES
- SUMMARY_STATIO_ALL_SEQUENCES
- GLOBAL_STATIO_ALL_SEQUENCES
- GLOBAL_STAT_DB_CU
- GLOBAL_STAT_SESSION_CU
- Utility
- REPLICATION_STAT
- GLOBAL_REPLICATION_STAT
- REPLICATION_SLOTS
- GLOBAL_REPLICATION_SLOTS
- BGWRITER_STAT
- GLOBAL_BGWRITER_STAT
- GLOBAL_CKPT_STATUS
- GLOBAL_DOUBLE_WRITE_STATUS
- GLOBAL_PAGEWRITER_STATUS
- GLOBAL_RECORD_RESET_TIME
- GLOBAL_REDO_STATUS
- GLOBAL_RECOVERY_STATUS
- CLASS_VITAL_INFO
- USER_LOGIN
- SUMMARY_USER_LOGIN
- GLOBAL_GET_BGWRITER_STATUS
- GLOBAL_SINGLE_FLUSH_DW_STATUS
- GLOBAL_CANDIDATE_STATUS
- Lock
- Wait Events
- Configuration
- Operator
- Workload Manager
- Global Plancache
- RTO
- DBE_PLDEBUGGER Schema
- DBE_PLDEBUGGER.turn_on
- DBE_PLDEBUGGER.turn_off
- DBE_PLDEBUGGER.local_debug_server_info
- DBE_PLDEBUGGER.attach
- DBE_PLDEBUGGER.info_locals
- DBE_PLDEBUGGER.next
- DBE_PLDEBUGGER.continue
- DBE_PLDEBUGGER.abort
- DBE_PLDEBUGGER.print_var
- DBE_PLDEBUGGER.info_code
- DBE_PLDEBUGGER.step
- DBE_PLDEBUGGER.add_breakpoint
- DBE_PLDEBUGGER.delete_breakpoint
- DBE_PLDEBUGGER.info_breakpoints
- DBE_PLDEBUGGER.backtrace
- DBE_PLDEBUGGER.disable_breakpoint
- DBE_PLDEBUGGER.enable_breakpoint
- DBE_PLDEBUGGER.finish
- DBE_PLDEBUGGER.set_var
- DB4AI Schema
- DBE_PLDEVELOPER
- DBE_SQL_UTIL Schema
- 工具参考
- 工具一览表
- 客户端工具
- 服务端工具
- 系统内部使用的工具
- dsscmd
- dssserver
- mogdb
- gs_backup
- gs_basebackup
- gs_ctl
- gs_initdb
- gs_install
- gs_postuninstall
- gs_preinstall
- gs_sshexkey
- gs_tar
- gs_uninstall
- gs_upgradectl
- gs_expansion
- gs_dropnode
- gs_probackup
- gstrace
- kdb5_util
- kadmin.local
- kinit
- klist
- krb5kdc
- kdestroy
- pg_config
- pg_controldata
- pg_recvlogical
- pg_resetxlog
- pg_archivecleanup
- pssh
- pscp
- transfer.py
- FAQ
- MogDB可运行脚本功能说明
- gs_collector工具支持收集的系统表和视图列表
- 数据库报错信息
- SQL标准错误码说明
- 第三方库错误码说明
- GAUSS-00001 - GAUSS-00100
- GAUSS-00101 - GAUSS-00200
- GAUSS 00201 - GAUSS 00300
- GAUSS 00301 - GAUSS 00400
- GAUSS 00401 - GAUSS 00500
- GAUSS 00501 - GAUSS 00600
- GAUSS 00601 - GAUSS 00700
- GAUSS 00701 - GAUSS 00800
- GAUSS 00801 - GAUSS 00900
- GAUSS 00901 - GAUSS 01000
- GAUSS 01001 - GAUSS 01100
- GAUSS 01101 - GAUSS 01200
- GAUSS 01201 - GAUSS 01300
- GAUSS 01301 - GAUSS 01400
- GAUSS 01401 - GAUSS 01500
- GAUSS 01501 - GAUSS 01600
- GAUSS 01601 - GAUSS 01700
- GAUSS 01701 - GAUSS 01800
- GAUSS 01801 - GAUSS 01900
- GAUSS 01901 - GAUSS 02000
- GAUSS 02001 - GAUSS 02100
- GAUSS 02101 - GAUSS 02200
- GAUSS 02201 - GAUSS 02300
- GAUSS 02301 - GAUSS 02400
- GAUSS 02401 - GAUSS 02500
- GAUSS 02501 - GAUSS 02600
- GAUSS 02601 - GAUSS 02700
- GAUSS 02701 - GAUSS 02800
- GAUSS 02801 - GAUSS 02900
- GAUSS 02901 - GAUSS 03000
- GAUSS 03001 - GAUSS 03100
- GAUSS 03101 - GAUSS 03200
- GAUSS 03201 - GAUSS 03300
- GAUSS 03301 - GAUSS 03400
- GAUSS 03401 - GAUSS 03500
- GAUSS 03501 - GAUSS 03600
- GAUSS 03601 - GAUSS 03700
- GAUSS 03701 - GAUSS 03800
- GAUSS 03801 - GAUSS 03900
- GAUSS 03901 - GAUSS 04000
- GAUSS 04001 - GAUSS 04100
- GAUSS 04101 - GAUSS 04200
- GAUSS 04201 - GAUSS 04300
- GAUSS 04301 - GAUSS 04400
- GAUSS 04401 - GAUSS 04500
- GAUSS 04501 - GAUSS 04600
- GAUSS 04601 - GAUSS 04700
- GAUSS 04701 - GAUSS 04800
- GAUSS 04801 - GAUSS 04900
- GAUSS 04901 - GAUSS 05000
- GAUSS 05001 - GAUSS 05100
- GAUSS 05101 - GAUSS 05200
- GAUSS 05201 - GAUSS 05300
- GAUSS 05301 - GAUSS 05400
- GAUSS 05401 - GAUSS 05500
- GAUSS 05501 - GAUSS 05600
- GAUSS 05601 - GAUSS 05700
- GAUSS 05701 - GAUSS 05800
- GAUSS 05801 - GAUSS 05900
- GAUSS 05901 - GAUSS 06000
- GAUSS 06001 - GAUSS 06100
- GAUSS 06101 - GAUSS 06200
- GAUSS 06201 - GAUSS 06300
- GAUSS 06301 - GAUSS 06400
- GAUSS 06401 - GAUSS 06500
- GAUSS 06501 - GAUSS 06600
- GAUSS 06601 - GAUSS 06700
- GAUSS 06701 - GAUSS 06800
- GAUSS 06801 - GAUSS 06900
- GAUSS 06901 - GAUSS 07000
- GAUSS 07001 - GAUSS 07100
- GAUSS 07101 - GAUSS 07200
- GAUSS 07201 - GAUSS 07300
- GAUSS 07301 - GAUSS 07400
- GAUSS 07401 - GAUSS 07500
- GAUSS 50000 - GAUSS 50999
- GAUSS 51000 - GAUSS 51999
- GAUSS 52000 - GAUSS 52999
- GAUSS 53000 - GAUSS 53699
- 错误日志信息参考
- 系统表及系统视图
- 故障诊断指南
- 源码解析
- 常见问题解答 (FAQs)
- 术语表
- 通信矩阵
- Mogeaver
例行维护表
为了保证数据库的有效运行,数据库必须在插入/删除操作后,基于客户场景,定期做VACUUM FULL和ANALYZE,更新统计信息,以便获得更优的性能。
相关概念
使用VACUUM、VACUUM FULL和ANALYZE命令定期对每个表进行维护,主要有以下原因:
- VACUUM FULL可回收已更新或已删除的数据所占据的磁盘空间,同时将小数据文件合并。
- VACUUM对每个表维护了一个可视化映射来跟踪包含对别的活动事务可见的数组的页。一个普通的索引扫描首先通过可视化映射来获取对应的数组,来检查是否对当前事务可见。若无法获取,再通过堆数组抓取的方式来检查。因此更新表的可视化映射,可加速唯一索引扫描。
- VACUUM可避免执行的事务数超过数据库阈值时,事务ID重叠造成的原有数据丢失。
- ANALYZE可收集与数据库中表内容相关的统计信息。统计结果存储在系统表PG_STATISTIC中。查询优化器会使用这些统计数据,生成最有效的执行计划。
操作步骤
-
使用VACUUM或VACUUM FULL命令,进行磁盘空间回收。
-
VACUUM:
对表执行VACUUM操作
postgres=# VACUUM customer;
VACUUM
可以与数据库操作命令并行运行。(执行期间,可正常使用的语句: SELECT、INSERT、UPDATE和DELETE。不可正常使用的语句: ALTER TABLE)。
对表分区执行VACUUM操作
postgres=# VACUUM customer_par PARTITION ( P1 );
VACUUM
-
VACUUM FULL:
postgres=# VACUUM FULL customer;
VACUUM
需要向正在执行的表增加排他锁,且需要停止其他所有数据库操作。
-
-
使用ANALYZE语句更新统计信息。
postgres=# ANALYZE customer;
ANALYZE
使用ANALYZE VERBOSE语句更新统计信息,并输出表的相关信息。
postgres=# ANALYZE VERBOSE customer;
ANALYZE
也可以同时执行VACUUM ANALYZE命令进行查询优化。
postgres=# VACUUM ANALYZE customer;
VACUUM
说明: VACUUM和ANALYZE会导致I/O流量的大幅增加,这可能会影响其他活动会话的性能。因此,建议通过"vacuum_cost_delay"参数设置。
-
删除表。
postgres=# DROP TABLE customer; postgres=# DROP TABLE customer_par; postgres=# DROP TABLE part;
当结果显示为如下信息,则表示删除成功。
DROP TABLE
维护建议
- 定期对部分大表做VACUUM FULL,在性能下降后为全库做VACUUM FULL,目前暂定每月做一次VACUUM FULL。
- 定期对系统表做VACUUM FULL,主要是PG_ATTRIBUTE。
- 启用系统自动清理线程(AUTOVACUUM)自动执行VACUUM和ANALYZE,回收被标识为删除状态的记录空间,并更新表的统计数据。
MogDB空闲空间回收机制简介
VACUUM的作用
空闲空间回收
由于MogDB的MVCC机制,表中会同时存放一行记录的多个历史版本,对于经常更新的表来说,会造成表空间的膨胀。为了解决这个问题,引入了空闲空间回收机制,并提供三种不同力度的空闲空间回收方式,用于不同场景下的空闲空间回收。根据触发时机和清理方式的不同,空闲空间回收分为三类:
- 轻量级:轻量级空间回收在访问数据页时顺带清理页面中的过期元组,不清理索引,磁盘上的物理空间不会回收
- 中量级:中量级空间回收有两种触发场景,一是后台线程自动发起的autovacuum,另一种是用户手动执行的VACUUM操作,会对索引和数据页面进行清理,特殊场景下会回收磁盘上的物理空间
- 重量级:重量级空间回收主要由VACUUM FULL操作触发,会对指定的表进行彻底重建,回收磁盘上的物理空间
更新统计信息
中量级的空间回收会更新系统的统计信息,使planner能够计算出更准确的执行计划。
更新vm
在MogDB中,通过visibility map来标记数据页面的可见性,被vm标记的数据页面中没有过期元组,下一次VACUUM时会跳过该页面。此外,在进行索引扫描时,会首先检查页面的vm标记,以判断是否可进行indexonlyscan。
VACUUM的分类
轻量级
当查询扫描到某个数据页面时,会顺带清理页面中的过期元组。由于是顺带清理页面内容,因此只会删除过期元组本身,在页面内释放过期元组占用的空间,行指针则不做处理,避免在索引侧造成空指针或空引用。一个特殊情况是HOT场景,HOT场景是指对于表上的所有的索引,更新前后的索引键值均没有发生变化,因此对于更新后的元组只需要在数据页面中插入一条新记录,而不需要插入一条新的索引记录,通过HOT链来维护数据元组的新老版本。在轻量级空间回收时,只保留第一个版本的行指针,并将其重定向到第一个需要保留的元组版本的行指针。
中量级
MogDB提供VACUUM语句来让用户主动执行对某个astore表及其表上的索引进行空间回收,在astore中,新老版本的数据混合存储,进行VACUUM时会会首先对数据页面进行顺序扫描,判断哪些元组需要被清理,对于需要被清理的元组,会首先清理其对应的索引,然后再清理数据页面中的元组,从而避免索侧的空指针/空引用问题。
除了用户手动执行VACUUM操作外,MogDB还提供了自动的空闲空间回收功能,通过autovacuum周期性对表中的过期元组进行清理。与手动的VACUUM不同的是,autovacuum清理表和表的toast表是分开处理的,而手动vacuum是连续处理(该差异在MogDB 3.0.8最新补丁版本提供参数handle_toast_in_autovac供用户选择)。此外,autovacuum会被DDL操作中断,而手动的VACUUM操作则会阻塞DDL操作。
重量级
轻量级和中量级的空间回收都无法彻底释放磁盘上的物理空间,只能将数据页内的过期元组回收,释放其占用的空间,但是这些空间只能被当前表复用,无法将磁盘空间归还给操作系统。因此,MogDB提供了重量级的空闲空间回收VACUUM FULL操作。VACUUM FULL操作会将一个表中所有未过期元组从原数据页面中读取出来,然后重新紧密地插入到新的数据文件中,对于有索引的表,会在新的数据文件上重建索引,以彻底回收表中过期元组占用的空间。重量级空间回收操作的主体流程中只允许执行查询操作,而在提交流程,只读查询也会被阻塞。
示例及说明
自动空闲空间回收autovacuum
-- 1. update后等待连续的两次autovacuum
MogDB=# create table tb(id int, name text);
CREATE TABLE
MogDB=# insert into tb values(0, 'asdf');
INSERT 0 1
MogDB=# update tb set id = 1 ;
UPDATE 1
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-----------------+------------------
tb | 1 | 0 | 1 | 1 | | 0
(1 row)
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 17095 | 17096 | 16386 | 258 | (0,2)
2 | 17096 | 0 | 32770 | 10242 | (0,2)
(2 rows)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-------------------------------+------------------
tb | 1 | 0 | 1 | 1 | 2023-12-24 15:36:23.018133+08 | 1
(1 row)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-------------------------------+------------------
tb | 1 | 0 | 1 | 0 | 2023-12-24 15:37:23.079814+08 | 2
(1 row)
-- 2. update后等待一次autovacuum,然后insert一条记录,查看xid是否被推进
MogDB=# create table tb(id int, name text);
CREATE TABLE
MogDB=# insert into tb values(0, 'asdf');
INSERT 0 1
MogDB=# update tb set id = 1 ;
UPDATE 1
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-----------------+------------------
tb | 1 | 0 | 1 | 1 | | 0
(1 row)
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 17088 | 17089 | 16386 | 258 | (0,2)
2 | 17089 | 0 | 32770 | 10242 | (0,2)
(2 rows)
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 17088 | 17089 | 16386 | 1282 | (0,2)
2 | 17089 | 0 | 32770 | 10498 | (0,2)
(2 rows)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-------------------------------+------------------
tb | 1 | 0 | 1 | 1 | 2023-12-24 15:33:22.873957+08 | 1
(1 row)
MogDB=# insert into tb values(0, 'asdf');
INSERT 0 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 17088 | 17089 | 16386 | 1282 | (0,2)
2 | 17089 | 0 | 32770 | 10498 | (0,2)
3 | 17091 | 0 | 2 | 2050 | (0,3)
(3 rows)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-------------------------------+------------------
tb | 2 | 0 | 2 | 0 | 2023-12-24 15:34:22.897349+08 | 2
(1 row)
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | | | | |
2 | 17089 | 0 | 32770 | 10498 | (0,2)
3 | 17091 | 0 | 2 | 2306 | (0,3)
(3 rows)
-
从第一个示例可以看到,update后,第二次对表执行autovacuum,表中的过期元组将被清理掉
-
在第二个示例中,第一次insert的xid是17088,update的xid是17089,等待一次autovacuum之后再次进行insert的xid是17091,也就是autovacuum将xid从17089推进到了17090
手动空闲空间回收VACUUM
-- 1. update后直接vacuum
MogDB=# create table tb(id int, name text);
CREATE TABLE
MogDB=# insert into tb values(0, 'asdf');
INSERT 0 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16702 | 0 | 2 | 2050 | (0,1)
(1 row)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-----------------+------------------
tb | 1 | 0 | 1 | 0 | | 0
(1 row)
MogDB=# update tb set id = 1;
UPDATE 1
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-----------------+------------------
tb | 1 | 0 | 1 | 1 | | 0
(1 row)
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16702 | 16703 | 16386 | 258 | (0,2)
2 | 16703 | 0 | 32770 | 10242 | (0,2)
(2 rows)
MogDB=# vacuum tb;
VACUUM
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16702 | 16703 | 16386 | 1282 | (0,2)
2 | 16703 | 0 | 32770 | 10498 | (0,2)
(2 rows)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-----------------+------------------
tb | 1 | 0 | 1 | 1 | | 0
(1 row)
MogDB=# insert into tb values(0, 'asdf');
INSERT 0 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16702 | 16703 | 16386 | 1282 | (0,2)
2 | 16703 | 0 | 32770 | 10498 | (0,2)
3 | 16704 | 0 | 2 | 2050 | (0,3)
(3 rows)
MogDB=# vacuum tb;
VACUUM
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | | | | |
2 | 16703 | 0 | 32770 | 10498 | (0,2)
3 | 16704 | 0 | 2 | 2306 | (0,3)
(3 rows)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-----------------+------------------
tb | 2 | 0 | 2 | 0 | | 0
(1 row)
-- 2. update后执行其他操作推进一下xid,然后再vacuum
MogDB=# create table tb(id int, name text);
CREATE TABLE
MogDB=# insert into tb values(0, 'asdf');
INSERT 0 1
MogDB=# update tb set id = 1;
UPDATE 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16719 | 16720 | 16386 | 258 | (0,2)
2 | 16720 | 0 | 32770 | 10242 | (0,2)
(2 rows)
MogDB=# create table tbb(id int);
CREATE TABLE
MogDB=# vacuum tb;
VACUUM
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | | | | |
2 | 16720 | 0 | 32770 | 10498 | (0,2)
(2 rows)
MogDB=# insert into tb values (0, 'asdf');
INSERT 0 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | | | | |
2 | 16720 | 0 | 32770 | 10498 | (0,2)
3 | 16722 | 0 | 2 | 2050 | (0,3)
(3 rows)
- 示例1中,update的xid是16702,update的xid是16703,update之后进行vacuum,然后进行了第二次insert,第二次的insert的xid是16704,也就是vacuum操作没有推进xid
表重建VACUUM FULL
-- 1. update后直接vacuum full
MogDB=# create table tb(id int, name text);
CREATE TABLE
MogDB=# insert into tb values(0, 'asdf');
INSERT 0 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16707 | 0 | 2 | 2050 | (0,1)
(1 row)
MogDB=# update tb set id = 1;
UPDATE 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16707 | 16708 | 16386 | 258 | (0,2)
2 | 16708 | 0 | 32770 | 10242 | (0,2)
(2 rows)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-----------------+------------------
tb | 1 | 0 | 1 | 1 | | 0
(1 row)
MogDB=# vacuum full tb;
VACUUM
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16708 | 0 | 2 | 10498 | (0,1)
2 | 2 | 16708 | 2 | 1282 | (0,1)
(2 rows)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-----------------+------------------
tb | 1 | 0 | 1 | 1 | | 0
(1 row)
MogDB=# vacuum full tb;
VACUUM
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 2 | 0 | 2 | 10498 | (0,1)
(1 row)
MogDB=# select relname, n_tup_ins, n_tup_del, n_live_tup, n_dead_tup, last_autovacuum, autovacuum_count from pg_stat_user_tables where relname = 'tb';
relname | n_tup_ins | n_tup_del | n_live_tup | n_dead_tup | last_autovacuum | autovacuum_count
---------+-----------+-----------+------------+------------+-----------------+------------------
tb | 1 | 0 | 1 | 0 | | 0
(1 row)
-- 2. update后先执行一次insert,再vacuum full
MogDB=# create table tb(id int, name text);
CREATE TABLE
MogDB=# insert into tb values(0, 'asdf');
INSERT 0 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16713 | 0 | 2 | 2050 | (0,1)
(1 row)
MogDB=# update tb set id = 1;
UPDATE 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16713 | 16714 | 16386 | 258 | (0,2)
2 | 16714 | 0 | 32770 | 10242 | (0,2)
(2 rows)
MogDB=# insert into tb values(0, 'asdf');
INSERT 0 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 16713 | 16714 | 16386 | 258 | (0,2)
2 | 16714 | 0 | 32770 | 10242 | (0,2)
3 | 16715 | 0 | 2 | 2050 | (0,3)
(3 rows)
MogDB=# vacuum full tb;
VACUUM
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 2 | 0 | 2 | 10498 | (0,1)
2 | 16715 | 0 | 2 | 2306 | (0,2)
(2 rows)
-- 3. 测试vacuum full是否会推进xid
MogDB=# insert into tb values(0, 'asef');
INSERT 0 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | | | | |
2 | 17096 | 0 | 32770 | 10498 | (0,2)
3 | 17100 | 0 | 2 | 2050 | (0,3)
(3 rows)
MogDB=# vacuum full tb;
VACUUM
MogDB=# insert into tb values(0, 'asef');
INSERT 0 1
MogDB=# select lp, t_xmin, t_xmax, t_infomask2, t_infomask, t_ctid from heap_page_items(get_raw_page('tb', 0));
lp | t_xmin | t_xmax | t_infomask2 | t_infomask | t_ctid
----+--------+--------+-------------+------------+--------
1 | 2 | 0 | 2 | 10498 | (0,1)
2 | 17100 | 0 | 2 | 2306 | (0,2)
3 | 17102 | 0 | 2 | 2050 | (0,3)
(3 rows)
- 示例1中,第一次vacuum full将过期元组的xmax设置为无效的xmax,将更新后的xmin设置为2,xmax设置为更新的xid,并推进xid,第二次vacuum full的时候将过期的元组清理掉,将更新后的元组xmin设置为2
- 示例2中,update后通过insert将xid推进,然后进行vacuum full,所有过期元组均被清理掉
- 示例3连续的两次insert之间进行了一次vacuum full,可以看到vacuum full将xid进行了推进
相关日志
autovacuum日志
-- 第一次autovacuum
2023-12-24 10:57:45.633 sxb postgres localhost 140347577464576 0[0:0#0] 0 [VACUUM] LOG: normally vacuum rel "public.tb" freeze 2000000000 OldestXmin 15540, FreezeLimit 3, freezeTableLimit 3
2023-12-24 10:57:47.952 sxb postgres localhost 140347577464576 0[0:0#0] 0 [VACUUM] LOG: "tb": found 0 removable, 100000 nonremovable row versions in 1031 out of 1031 pages
2023-12-24 10:57:47.952 sxb postgres localhost 140347577464576 0[0:0#0] 0 [VACUUM] DETAIL: 50000 dead row versions cannot be removed yet. There were 0 unused item pointers. 0 pages are entirely empty. CPU 0.00s/0.04u sec elapsed 2.31 sec.
-- 第二次autovacuum
2023-12-24 10:58:15.634 sxb postgres localhost 140347577464576 0[0:0#0] 0 [VACUUM] LOG: normally vacuum rel "public.tb" freeze 2000000000 OldestXmin 15541, FreezeLimit 3, freezeTableLimit 3
2023-12-24 10:58:15.756 sxb postgres localhost 140347521890048 0[0:0#0] 0 [BACKEND] LOG: clean statement thread start
2023-12-24 10:58:17.950 sxb postgres localhost 140347577464576 0[0:0#0] 0 [VACUUM] LOG: "tb": found 50000 removable, 50000 nonremovable row versions in 1031 out of 1031 pages
2023-12-24 10:58:17.950 sxb postgres localhost 140347577464576 0[0:0#0] 0 [VACUUM] DETAIL: 0 dead row versions cannot be removed yet. There were 0 unused item pointers. 0 pages are entirely empty. CPU 0.00s/0.04u sec elapsed 2.31 sec.
手动vacuum日志
-- 第一次vacuum
2023-12-24 10:50:12.308 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842767 [VACUUM] LOG: normally vacuum rel "public.tb" freeze -1 OldestXmin 15178, FreezeLimit 3, freezeTableLimit 3
2023-12-24 10:50:12.349 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842767 [VACUUM] LOG: "tb": found 0 removable, 100000 nonremovable row versions in 741 out of 741 pages
2023-12-24 10:50:12.349 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842767 [VACUUM] DETAIL: 50000 dead row versions cannot be removed yet. There were 0 unused item pointers. 0 pages are entirely empty. CPU 0.00s/0.04u sec elapsed 0.04 sec.
-- 第二次vacuum
2023-12-24 10:52:12.909 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842783 [VACUUM] LOG: normally vacuum rel "public.tb" freeze -1 OldestXmin 15178, FreezeLimit 3, freezeTableLimit 3
2023-12-24 10:52:12.932 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842783 [VACUUM] LOG: "tb": found 0 removable, 100000 nonremovable row versions in 741 out of 741 pages
2023-12-24 10:52:12.932 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842783 [VACUUM] DETAIL: 50000 dead row versions cannot be removed yet. There were 0 unused item pointers. 0 pages are entirely empty. CPU 0.00s/0.02u sec elapsed 0.02 sec.
vacuum full日志
-- 第一次vacuum full
2023-12-24 10:35:36.294 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842659 [BACKEND] LOG: vacuum test, OldestXmin: 15172
2023-12-24 10:35:36.294 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842659 [BACKEND] LOG: Relation tb(24642) [0/16245/24642] Swap files with Relation 24648 [0/16245/24648] xid 15173
-- 第二次vacuum full
2023-12-24 10:35:42.499 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842661 [BACKEND] LOG: vacuum test, OldestXmin: 15173
2023-12-24 10:35:42.499 sxb postgres [local] 139638516152064 0[0:0#0] 1125899906842661 [BACKEND] LOG: Relation tb(24642) [0/16245/24648] Swap files with Relation 24654 [0/16245/24654] xid 15174
相关结论
-
autovacuum和手动vacuum的区别
- 手动vacuum清理表和表的toast表是连续处理的,而autovacuum处理表和表的toast表之间有间隔。MogDB 3.0.8新增handle_toast_in_autovac参数,用于控制是否在autovacuum中清理表的同时清理该表对应的toast表
- DDL操作会中断autovacuum对表的清理,而手动vacuum则会阻塞对正在进行清理的表进行的DDL操作
- autovacuum执行后会推进OldestXmin,但是手动执行的vacuum不会推进OldestXmin
-
什么情况下会清理页面中的过期元组,并更新pg_stat_user_tables中的n_dead_tup?
- 页面中的过期元组足够老时,autovacuum、vacuum和vacuum full操作都会将这些过期元组清理掉
- 由于autovacuum和vacuum full会推进xid,对于刚update/delete的老版本的元组,第一次autovacuum/vacuum full不会直接清理掉老版本的元组,但是会将老版本元组的informask相关位进行标记,第二次autovacuum/vacuum full时会将老版本元组清理掉
-
如何理解足够老?
- MogDB中,根据可见性判断将元组分为
HEAPTUPLE_DEAD、HEAPTUPLE_LIVE、HEAPTUPLE_RECENTLY_DEAD、HEAPTUPLE_INSERT_IN_PROGRESS、HEAPTUPLE_DELETE_IN_PROGRESS
几种类型,其中,判断为HEAPTUPLE_RECENTLY_DEAD
的元组,删除/更新老版本的事务已提交,但是在当前这个触发vacuum的事务中暂时还不能被删除,比如某一条元组,执行插入的xid=16000,xid=16001的事务将其更新到版本1,xid=16002的事务发起vacuum操作,此时,对老版本执行更新的事务16001虽然已经提交,但是对于当前这个vacuum来说,老版本属于HEAPTUPLE_RECENTLY_DEAD
,当前这个vacuum操作不能直接对其进行清理。对于被判断为HEAPTUPLE_DEAD
的元组,vacuum操作可直接将其进行清理
- MogDB中,根据可见性判断将元组分为
说明:本章节所有测试基于MogDB 5.0.5,日志中部分内容为修改源码后输出,正式版本中不包含。