对PostgreSQL xmax的理解

本文涉及的产品
云原生数据库 PolarDB MySQL 版,通用型 2核4GB 50GB
云原生数据库 PolarDB PostgreSQL 版,标准版 2核4GB 50GB
简介:

xmax

The identity (transaction ID) of the deleting transaction, or zero for an undeleted row version. It is possible for this column to be nonzero in a visible row version. That usually indicates that the deleting transaction hasn't committed yet, or that an attempted deletion was rolled back.

http://www.postgresql.org/docs/9.1/static/ddl-system-columns.html

作一个实验:

我数据库关闭前,最后一条transaction的id是 1874。

我开一个终端A,此时终端A的当前transactionId为 1875。

复制代码
[pgsql@localhost bin]$ ./psql
psql (9.1.2)
Type "help" for help.

pgsql=# begin;
BEGIN

pgsql=# select xmin,xmax,* from tab01;
 xmin | xmax | id | cd 
------+------+----+----
 1866 |    0 |  3 | 3
 1867 |    0 |  4 | 4
 1868 |    0 |  5 | 5
 1870 |    0 |  6 | 6
 1872 |    0 |  7 | 7
 1873 |    0 |  8 | 8
 1874 |    0 |  9 | 9
(7 rows)

pgsql=# 
复制代码

我再开一个终端B,此时,终端B的transactionId为:1876。

复制代码
[pgsql@localhost bin]$ ./psql
psql (9.1.2)
Type "help" for help.

pgsql=# begin;
BEGIN
pgsql=# select xmin,xmax,* from tab01;
 xmin | xmax | id | cd 
------+------+----+----
 1866 |    0 |  3 | 3
 1867 |    0 |  4 | 4
 1868 |    0 |  5 | 5
 1870 |    0 |  6 | 6
 1872 |    0 |  7 | 7
 1873 |    0 |  8 | 8
 1874 |    0 |  9 | 9
(7 rows)

pgsql=# 
复制代码

回到终端A,执行 delete 操作:

pgsql=# delete from tab01 where id=9;
DELETE 1
pgsql=# 

此时,在终端A中,已经看不到删除后的数据:

复制代码
pgsql=# select xmin,xmax,* from tab01;
 xmin | xmax | id | cd 
------+------+----+----
 1866 |    0 |  3 | 3
 1867 |    0 |  4 | 4
 1868 |    0 |  5 | 5
 1870 |    0 |  6 | 6
 1872 |    0 |  7 | 7
 1873 |    0 |  8 | 8
(6 rows)

pgsql=# 
复制代码

此时,由于终端A尚未提交,所以,可以在终端B中看到如下的情形:

复制代码
pgsql=# select xmin,xmax,* from tab01;
 xmin | xmax | id | cd 
------+------+----+----
 1866 |    0 |  3 | 3
 1867 |    0 |  4 | 4
 1868 |    0 |  5 | 5
 1870 |    0 |  6 | 6
 1872 |    0 |  7 | 7
 1873 |    0 |  8 | 8
 1874 | 1875 |  9 | 9
(7 rows)

pgsql=# 
复制代码

也就是说,id为9的那条记录,其xmax为1875,表明其为 transactionid为 1875的事务所删除。

回到终端A,进行提交:

复制代码
pgsql=# commit;
COMMIT
pgsql=# select xmin,xmax,* from tab01;
 xmin | xmax | id | cd 
------+------+----+----
 1866 |    0 |  3 | 3
 1867 |    0 |  4 | 4
 1868 |    0 |  5 | 5
 1870 |    0 |  6 | 6
 1872 |    0 |  7 | 7
 1873 |    0 |  8 | 8
(6 rows)

pgsql=# 
复制代码

再回到终端B,查看:

复制代码
pgsql=# select xmin,xmax,* from tab01;
 xmin | xmax | id | cd 
------+------+----+----
 1866 |    0 |  3 | 3
 1867 |    0 |  4 | 4
 1868 |    0 |  5 | 5
 1870 |    0 |  6 | 6
 1872 |    0 |  7 | 7
 1873 |    0 |  8 | 8
(6 rows)

pgsql=# 
复制代码

让我来再进一步,看一看:

重新开两个终端:

终端A和终端B。

在终端A中:

复制代码
[pgsql@localhost bin]$ ./psql
psql (9.1.2)
Type "help" for help.

pgsql=# select xmin,xmax,cmin,cmax,* from tab01;
 xmin | xmax | cmin | cmax | id | cd 
------+------+------+------+----+----
 1878 |    0 |    0 |    0 |  1 | 1
 1879 |    0 |    0 |    0 |  2 | 2
(2 rows)

pgsql=# \q
复制代码

可以看到两条由不同的事务提交所形成的记录。

然后再次使用psql: 经过update 后,自己所看到的是 xmin的变化,这时尚未提交,别的终端看到就不一样了。

终端A:

复制代码
[pgsql@localhost bin]$ ./psql
psql (9.1.2)
Type "help" for help.

pgsql=# begin;
BEGIN
pgsql=# update tab01 set id=3 where cd='2';
UPDATE 1
pgsql=# select xmin,xmax,cmin,cmax,* from tab01;
 xmin | xmax | cmin | cmax | id | cd 
------+------+------+------+----+----
 1878 |    0 |    0 |    0 |  1 | 1
 1880 |    0 |    0 |    0 |  3 | 2
(2 rows)

pgsql=# 
复制代码

此时,进入终端B:

复制代码
[pgsql@localhost bin]$ ./psql
psql (9.1.2)
Type "help" for help.

pgsql=# select xmin,xmax,cmin,cmax,* from tab01;
 xmin | xmax | cmin | cmax | id | cd 
------+------+------+------+----+----
 1878 |    0 |    0 |    0 |  1 | 1
 1879 | 1880 |    0 |    0 |  2 | 2
(2 rows)

pgsql=# 
复制代码

我推测,update的时候,自身事务所看到的是内存中的影像。同时它也已经提交到了物理文件上。而别的事务是从物理文件来读取的。

在A终端提交以后:

pgsql=# commit;
COMMIT
pgsql=# 

B终端所看到的:

复制代码
pgsql=# select xmin,xmax,cmin,cmax,* from tab01;
 xmin | xmax | cmin | cmax | id | cd 
------+------+------+------+----+----
 1878 |    0 |    0 |    0 |  1 | 1
 1880 |    0 |    0 |    0 |  3 | 2
(2 rows)

pgsql=# 
复制代码

 继续从代码上进行分析:

 

复制代码
/*
 *    heap_update - replace a tuple
 *
 * NB: do not call this directly unless you are prepared to deal with
 * concurrent-update conditions.  Use simple_heap_update instead.
 *
 *    relation - table to be modified (caller must hold suitable lock)
 *    otid - TID of old tuple to be replaced
 *    newtup - newly constructed tuple data to store
 *    ctid - output parameter, used only for failure case (see below)
 *    update_xmax - output parameter, used only for failure case (see below)
 *    cid - update command ID (used for visibility test, and stored into
 *        cmax/cmin if successful)
 *    crosscheck - if not InvalidSnapshot, also check old tuple against this
 *    wait - true if should wait for any conflicting update to commit/abort
 *
 * Normal, successful return value is HeapTupleMayBeUpdated, which
 * actually means we *did* update it.  Failure return codes are
 * HeapTupleSelfUpdated, HeapTupleUpdated, or HeapTupleBeingUpdated
 * (the last only possible if wait == false).
 *
 * On success, the header fields of *newtup are updated to match the new
 * stored tuple; in particular, newtup->t_self is set to the TID where the
 * new tuple was inserted, and its HEAP_ONLY_TUPLE flag is set iff a HOT
 * update was done.  However, any TOAST changes in the new tuple's
 * data are not reflected into *newtup.
 *
 * In the failure cases, the routine returns the tuple's t_ctid and t_xmax.
 * If t_ctid is the same as otid, the tuple was deleted; if different, the
 * tuple was updated, and t_ctid is the location of the replacement tuple.
 * (t_xmax is needed to verify that the replacement tuple matches.)
 */
HTSU_Result
heap_update(Relation relation, ItemPointer otid, HeapTuple newtup,
            ItemPointer ctid, TransactionId *update_xmax,
            CommandId cid, Snapshot crosscheck, bool wait)
{
    HTSU_Result result;
    TransactionId xid = GetCurrentTransactionId();
    Bitmapset  *hot_attrs;
    ItemId        lp;
    HeapTupleData oldtup;
    HeapTuple    heaptup;
    Page        page;
    Buffer        buffer,
                newbuf;
    bool        need_toast,
                already_marked;
    Size        newtupsize,
                pagefree;
    bool        have_tuple_lock = false;
    bool        iscombo;
    bool        use_hot_update = false;
    bool        all_visible_cleared = false;
    bool        all_visible_cleared_new = false;

    ...

    ////////////////First Phase marked by gaojian

    newtup->t_data->t_infomask &= ~(HEAP_XACT_MASK);
    newtup->t_data->t_infomask2 &= ~(HEAP2_XACT_MASK);
    newtup->t_data->t_infomask |= (HEAP_XMAX_INVALID | HEAP_UPDATED);
    HeapTupleHeaderSetXmin(newtup->t_data, xid);
    HeapTupleHeaderSetCmin(newtup->t_data, cid);
    HeapTupleHeaderSetXmax(newtup->t_data, 0);    /* for cleanliness */
    newtup->t_tableOid = RelationGetRelid(relation);

    ...
if (!already_marked) { /* Clear obsolete visibility flags ... */ oldtup.t_data->t_infomask &= ~(HEAP_XMAX_COMMITTED | HEAP_XMAX_INVALID | HEAP_XMAX_IS_MULTI | HEAP_IS_LOCKED | HEAP_MOVED); /* ... and store info about transaction updating this tuple */ ///HeapTupleHeaderSetXmax(oldtup.t_data, xid); /////>>>>>added by gaojian for testing. ////xid = (TransactionId)8888; fprintf(stderr,"x-----1,xid is :%d \n",(int)xid); HeapTupleHeaderSetXmax(oldtup.t_data, xid); HeapTupleHeaderSetCmax(oldtup.t_data, cid, iscombo); sleep(60); } ... return HeapTupleMayBeUpdated; }
复制代码

 

可以看到,第一段的 :

复制代码
    newtup->t_data->t_infomask &= ~(HEAP_XACT_MASK);
    newtup->t_data->t_infomask2 &= ~(HEAP2_XACT_MASK);
    newtup->t_data->t_infomask |= (HEAP_XMAX_INVALID | HEAP_UPDATED);
    HeapTupleHeaderSetXmin(newtup->t_data, xid);
    HeapTupleHeaderSetCmin(newtup->t_data, cid);
    HeapTupleHeaderSetXmax(newtup->t_data, 0);    /* for cleanliness */
    newtup->t_tableOid = RelationGetRelid(relation);
复制代码

写的很明白, HeapTupleHeaderSetXmin(newtup->t_data, xid);

而第二段的 :

复制代码
    if (!already_marked)
    {
        /* Clear obsolete visibility flags ... */
        oldtup.t_data->t_infomask &= ~(HEAP_XMAX_COMMITTED |
                                       HEAP_XMAX_INVALID |
                                       HEAP_XMAX_IS_MULTI |
                                       HEAP_IS_LOCKED |
                                       HEAP_MOVED);
        /* ... and store info about transaction updating this tuple */

        HeapTupleHeaderSetXmax(oldtup.t_data, xid);
        HeapTupleHeaderSetCmax(oldtup.t_data, cid, iscombo);
    }
复制代码

然后,我再来验证一下,加点调试代码,这样,我执行sql时会出错:

复制代码
    if (!already_marked)
    {
        /* Clear obsolete visibility flags ... */
        oldtup.t_data->t_infomask &= ~(HEAP_XMAX_COMMITTED |
                                       HEAP_XMAX_INVALID |
                                       HEAP_XMAX_IS_MULTI |
                                       HEAP_IS_LOCKED |
                                       HEAP_MOVED);
        /* ... and store info about transaction updating this tuple */

        ///HeapTupleHeaderSetXmax(oldtup.t_data, xid);
        /////>>>>>added by gaojian for testing.
        ////xid = (TransactionId)8888;

        fprintf(stderr,"x-----1,xid is :%d \n",(int)xid);

        HeapTupleHeaderSetXmax(oldtup.t_data, xid);
        HeapTupleHeaderSetCmax(oldtup.t_data, cid, iscombo);

    }
复制代码

执行结果:

复制代码
pgsql=# begin;
BEGIN
pgsql=# update tab01 set id=2 where cd = '2';
ERROR:  could not access status of transaction 8888
DETAIL:  Could not read from file "pg_subtrans/0000" at offset 32768: Success.
pgsql=# \q
[pgsql@loca
复制代码

再次登陆进来看看,哈,这证明我所看到的代码部分,就是实现写入xmax的部分。

总结来说,就是,在update(可能delete也是),用向oldtup写入transaction id的方式,来记录哪个transaction改动了记录。

复制代码
[pgsql@localhost bin]$ ./psql
psql (9.1.2)
Type "help" for help.

pgsql=# select xmin,xmax,cmin,cmax, * from tab01;
 xmin | xmax | cmin | cmax |    id     | cd 
------+------+------+------+-----------+----
 1878 |    0 |    0 |    0 |         1 | 1
 1884 | 8888 |    0 |    0 | 999888777 | 2
 1885 |    0 |    0 |    0 |         2 | 2
(3 rows)

pgsql=# 
复制代码
相关实践学习
使用PolarDB和ECS搭建门户网站
本场景主要介绍基于PolarDB和ECS实现搭建门户网站。
阿里云数据库产品家族及特性
阿里云智能数据库产品团队一直致力于不断健全产品体系,提升产品性能,打磨产品功能,从而帮助客户实现更加极致的弹性能力、具备更强的扩展能力、并利用云设施进一步降低企业成本。以云原生+分布式为核心技术抓手,打造以自研的在线事务型(OLTP)数据库Polar DB和在线分析型(OLAP)数据库Analytic DB为代表的新一代企业级云原生数据库产品体系, 结合NoSQL数据库、数据库生态工具、云原生智能化数据库管控平台,为阿里巴巴经济体以及各个行业的企业客户和开发者提供从公共云到混合云再到私有云的完整解决方案,提供基于云基础设施进行数据从处理、到存储、再到计算与分析的一体化解决方案。本节课带你了解阿里云数据库产品家族及特性。
目录
相关文章
|
4月前
|
SQL 关系型数据库 数据库
PostgreSQL|认识PostgreSQL
【7月更文挑战第1天】
|
18天前
|
存储 JSON 关系型数据库
PostgreSQL介绍
【10月更文挑战第11天】
|
2月前
|
SQL 前端开发 关系型数据库
PostgreSQL特点
PostgreSQL特点
44 1
|
2月前
|
关系型数据库 Linux 数据库
PostgreSQL
PostgreSQL
39 2
|
3月前
|
SQL 关系型数据库 数据库
在 PostgreSQL 中使用 LIKE
【8月更文挑战第12天】
419 1
|
3月前
|
关系型数据库 数据挖掘 数据库
在 PostgreSQL 中使用 IN
【8月更文挑战第12天】
257 0
在 PostgreSQL 中使用 IN
|
3月前
|
存储 关系型数据库 PostgreSQL
PostgreSQL有何特点?
【8月更文挑战第5天】PostgreSQL有何特点?
130 6
|
3月前
|
SQL 存储 关系型数据库
PostgreSQL的介绍
【8月更文挑战第4天】PostgreSQL的介绍
58 0
|
关系型数据库 PostgreSQL
postgresql中geom处理
pgsql中的geom格式处理
262 0
|
存储 JSON 安全
PostgreSQL 13
背景         PostgreSQL 全球开发组于2020年9月24日宣布PostgreSQL 13正式发布,作为世界上最先进的开源数据库,PostgresSQL 13是目前的最新版本。         阿里云是中国地区第一家支持PostgreSQL 13的云厂商,在 RDS 和 专属集群 两条产品线都提供了