-
Notifications
You must be signed in to change notification settings - Fork 49
Incorrect comparison result on a specific table – data exists but reported as different #97
Copy link
Copy link
Open
Description
Hi team,
We encountered an issue during data comparison:
One specific table always shows differences in the comparison result, but after checking the actual records manually, the data does exist and looks consistent.
Important notes:
- This problem only happens on one particular table
- Other tables are compared correctly
- Manual queries confirm that the records are present
- But pgcompare reports differences for this table
So far we are not sure whether this is related to:
- or comparison logic itself
bash-4.4$ java -jar pgcompare.jar compare -t pca_aft_check_log
Picked up _JAVA_OPTIONS:
[2026-02-06 01:39:40] [INFO ] [main ] Starting - rid: 1770341980777
[2026-02-06 01:39:40] [INFO ] [main ] Version: 0.5.0.0
[2026-02-06 01:39:40] [INFO ] [main ] Batch Number: 0
[2026-02-06 01:39:40] [INFO ] [main ] Connecting to repository database
[2026-02-06 01:39:41] [INFO ] [connection ] Successfully connected to postgres database (repo)
[2026-02-06 01:39:41] [INFO ] [preflight-util ] Performing Preflight checks for source
[2026-02-06 01:39:41] [INFO ] [preflight-util ] Performing Preflight checks for target
[2026-02-06 01:39:41] [INFO ] [main ] Parameters:
[2026-02-06 01:39:41] [INFO ] [main ] action=compare
[2026-02-06 01:39:41] [INFO ] [main ] batch=0
[2026-02-06 01:39:41] [INFO ] [main ] batch-commit-size=2000
[2026-02-06 01:39:41] [INFO ] [main ] batch-fetch-size=2000
[2026-02-06 01:39:41] [INFO ] [main ] batch-progress-report-size=1000000
[2026-02-06 01:39:41] [INFO ] [main ] column-hash-method=database
[2026-02-06 01:39:41] [INFO ] [main ] config=/opt/pgcompare/pgcompare.properties
[2026-02-06 01:39:41] [INFO ] [main ] config-file=/opt/pgcompare/pgcompare.properties
[2026-02-06 01:39:41] [INFO ] [main ] database-sort=true
[2026-02-06 01:39:41] [INFO ] [main ] fix=false
[2026-02-06 01:39:41] [INFO ] [main ] float-cast=notation
[2026-02-06 01:39:41] [INFO ] [main ] float-scale=3
[2026-02-06 01:39:41] [INFO ] [main ] genReport=false
[2026-02-06 01:39:41] [INFO ] [main ] home=/opt/pgcompare
[2026-02-06 01:39:41] [INFO ] [main ] isCheck=false
[2026-02-06 01:39:41] [INFO ] [main ] loader-threads=2
[2026-02-06 01:39:41] [INFO ] [main ] log-destination=stdout
[2026-02-06 01:39:41] [INFO ] [main ] log-level=INFO
[2026-02-06 01:39:41] [INFO ] [main ] message-queue-size=100
[2026-02-06 01:39:41] [INFO ] [main ] number-cast=notation
[2026-02-06 01:39:41] [INFO ] [main ] observer-throttle=true
[2026-02-06 01:39:41] [INFO ] [main ] observer-throttle-size=2000000
[2026-02-06 01:39:41] [INFO ] [main ] observer-vacuum=true
[2026-02-06 01:39:41] [INFO ] [main ] project=1
[2026-02-06 01:39:41] [INFO ] [main ] repo-dbname=pgcompare
[2026-02-06 01:39:41] [INFO ] [main ] repo-host=******
[2026-02-06 01:39:41] [INFO ] [main ] repo-port==******
[2026-02-06 01:39:41] [INFO ] [main ] repo-schema=pgcompare
[2026-02-06 01:39:41] [INFO ] [main ] repo-sslmode=disable
[2026-02-06 01:39:41] [INFO ] [main ] repo-user=postgres
[2026-02-06 01:39:41] [INFO ] [main ] reportFileName=
[2026-02-06 01:39:41] [INFO ] [main ] source-dbname=bdc
[2026-02-06 01:39:41] [INFO ] [main ] source-host==******
[2026-02-06 01:39:41] [INFO ] [main ] source-port==******
[2026-02-06 01:39:41] [INFO ] [main ] source-schema=fis
[2026-02-06 01:39:41] [INFO ] [main ] source-sslmode=disable
[2026-02-06 01:39:41] [INFO ] [main ] source-type=postgres
[2026-02-06 01:39:41] [INFO ] [main ] source-user=postgres
[2026-02-06 01:39:41] [INFO ] [main ] source-warehouse=compute_wh
[2026-02-06 01:39:41] [INFO ] [main ] stage-table-parallel=0
[2026-02-06 01:39:41] [INFO ] [main ] standard-number-format=0000000000000000000000.0000000000000000000000
[2026-02-06 01:39:41] [INFO ] [main ] table=pca_aft_check_log
[2026-02-06 01:39:41] [INFO ] [main ] target-dbname=bdc_test
[2026-02-06 01:39:41] [INFO ] [main ] target-host==******
[2026-02-06 01:39:41] [INFO ] [main ] target-port==******
[2026-02-06 01:39:41] [INFO ] [main ] target-schema=fis
[2026-02-06 01:39:41] [INFO ] [main ] target-sslmode=disable
[2026-02-06 01:39:41] [INFO ] [main ] target-type=postgres
[2026-02-06 01:39:41] [INFO ] [main ] target-user=postgres
[2026-02-06 01:39:41] [INFO ] [main ] target-warehouse=compute_wh
[2026-02-06 01:39:41] [INFO ] [main ] Connecting to source and target databases
[2026-02-06 01:39:41] [INFO ] [connection ] Successfully connected to postgres database (source)
[2026-02-06 01:39:41] [INFO ] [connection ] Successfully connected to postgres database (target)
[2026-02-06 01:39:41] [INFO ] [compare-ctrl ] Recheck Out of Sync: false
[2026-02-06 01:39:41] [INFO ] [compare-ctrl ] Retrieving tables for project 1, batch 0, table filter: pca_aft_check_log
[2026-02-06 01:39:41] [INFO ] [table-ctrl ] --- START RECONCILIATION FOR TABLE: PCA_AFT_CHECK_LOG ---
[2026-02-06 01:39:41] [INFO ] [table-ctrl ] Clearing data compare findings
[2026-02-06 01:39:42] [INFO ] [repo-ctrl ] Data comparison results deleted for table 1061, batch 1
[2026-02-06 01:39:42] [INFO ] [column-metadata-builder ] (source) Building column expressions for fis.pca_aft_check_log
[2026-02-06 01:39:42] [INFO ] [column-metadata-builder ] (target) Building column expressions for fis.pca_aft_check_log
[2026-02-06 01:39:42] [INFO ] [compare-ctrl ] (source) Columns: badgeno,cdt,fixno,inputtype,ispass,mcbsno,pdline,refid,remark,snoid,testcount,wc
[2026-02-06 01:39:42] [INFO ] [compare-ctrl ] (target) Columns: badgeno,cdt,fixno,inputtype,ispass,mcbsno,pdline,refid,remark,snoid,testcount,wc
[2026-02-06 01:39:42] [INFO ] [compare-ctrl ] (source) PK Columns: id
[2026-02-06 01:39:42] [INFO ] [compare-ctrl ] (target) PK Columns: id
[2026-02-06 01:39:42] [INFO ] [sql-syntax-srv ] (source) Compare SQL: SELECT lower(md5(coalesce(trim(to_char(id,'0.9999999999EEEE')),' '))) AS pk_hash, '{'||'"id": ' || id||'}' as pk,lower(md5(coalesce(case when length(coalesce(trim(badgeno::text),''))=0 then ' ' else trim(badgeno::text) end,' ')||coalesce(to_char(cdt,'MMDDYYYYHH24MISS'),' ')||coalesce(case when length(coalesce(trim(fixno::text),''))=0 then ' ' else trim(fixno::text) end,' ')||coalesce(case when length(coalesce(trim(inputtype::text),''))=0 then ' ' else trim(inputtype::text) end,' ')||coalesce(case when length(coalesce(trim(ispass::text),''))=0 then ' ' else trim(ispass::text) end,' ')||coalesce(case when length(coalesce(trim(mcbsno::text),''))=0 then ' ' else trim(mcbsno::text) end,' ')||coalesce(case when length(coalesce(trim(pdline::text),''))=0 then ' ' else trim(pdline::text) end,' ')||coalesce(trim(to_char(refid,'0.9999999999EEEE')),' ')||coalesce(case when length(coalesce(trim(remark::text),''))=0 then ' ' else trim(remark::text) end,' ')||coalesce(trim(to_char(snoid,'0.9999999999EEEE')),' ')||coalesce(trim(to_char(testcount,'0.9999999999EEEE')),' ')||coalesce(case when length(coalesce(trim(wc::text),''))=0 then ' ' else trim(wc::text) end,' '))) AS column_hash FROM fis.pca_aft_check_log WHERE 1=1
[2026-02-06 01:39:42] [INFO ] [sql-syntax-srv ] (target) Compare SQL: SELECT lower(md5(coalesce(trim(to_char(id,'0.9999999999EEEE')),' '))) AS pk_hash, '{'||'"id": ' || id||'}' as pk,lower(md5(coalesce(case when length(coalesce(trim(badgeno::text),''))=0 then ' ' else trim(badgeno::text) end,' ')||coalesce(to_char(cdt,'MMDDYYYYHH24MISS'),' ')||coalesce(case when length(coalesce(trim(fixno::text),''))=0 then ' ' else trim(fixno::text) end,' ')||coalesce(case when length(coalesce(trim(inputtype::text),''))=0 then ' ' else trim(inputtype::text) end,' ')||coalesce(case when length(coalesce(trim(ispass::text),''))=0 then ' ' else trim(ispass::text) end,' ')||coalesce(case when length(coalesce(trim(mcbsno::text),''))=0 then ' ' else trim(mcbsno::text) end,' ')||coalesce(case when length(coalesce(trim(pdline::text),''))=0 then ' ' else trim(pdline::text) end,' ')||coalesce(trim(to_char(refid,'0.9999999999EEEE')),' ')||coalesce(case when length(coalesce(trim(remark::text),''))=0 then ' ' else trim(remark::text) end,' ')||coalesce(trim(to_char(snoid,'0.9999999999EEEE')),' ')||coalesce(trim(to_char(testcount,'0.9999999999EEEE')),' ')||coalesce(case when length(coalesce(trim(wc::text),''))=0 then ' ' else trim(wc::text) end,' '))) AS column_hash FROM fis.pca_aft_check_log WHERE 1=1
[2026-02-06 01:39:42] [INFO ] [thread-manager ] Starting compare hash threads
[2026-02-06 01:39:42] [INFO ] [staging-operations ] Staging table created: dc_source_1061_0 for location: source, table: 1061, thread: 0
[2026-02-06 01:39:42] [INFO ] [staging-operations ] Staging table created: dc_target_1061_0 for location: target, table: 1061, thread: 0
[2026-02-06 01:39:42] [INFO ] [observer-c170-t0 ] Starting reconcile observer
[2026-02-06 01:39:42] [INFO ] [observer-c170-t0 ] Connecting to repository database
[2026-02-06 01:39:42] [INFO ] [compare-source-1061-t0 ] (source) Start database reconcile thread
[2026-02-06 01:39:42] [INFO ] [compare-target-1061-t0 ] (target) Start database reconcile thread
[2026-02-06 01:39:42] [INFO ] [compare-source-1061-t0 ] (source) Connecting to repository database
[2026-02-06 01:39:42] [INFO ] [compare-target-1061-t0 ] (target) Connecting to repository database
[2026-02-06 01:39:42] [INFO ] [loader-source-t0-i1 ] Start repository loader thread
[2026-02-06 01:39:42] [INFO ] [loader-source-t0-i2 ] Start repository loader thread
[2026-02-06 01:39:42] [INFO ] [loader-target-t0-i1 ] Start repository loader thread
[2026-02-06 01:39:42] [INFO ] [loader-target-t0-i2 ] Start repository loader thread
[2026-02-06 01:39:42] [INFO ] [loader-source-t0-i2 ] Connecting to repository database
[2026-02-06 01:39:42] [INFO ] [loader-target-t0-i1 ] Connecting to repository database
[2026-02-06 01:39:42] [INFO ] [loader-source-t0-i1 ] Connecting to repository database
[2026-02-06 01:39:42] [INFO ] [loader-target-t0-i2 ] Connecting to repository database
[2026-02-06 01:39:42] [INFO ] [connection ] Successfully connected to postgres database (repo)
[2026-02-06 01:39:42] [INFO ] [connection ] Successfully connected to postgres database (repo)
[2026-02-06 01:39:42] [INFO ] [compare-target-1061-t0 ] (target) Connecting to database
[2026-02-06 01:39:42] [INFO ] [connection ] Successfully connected to postgres database (repo)
[2026-02-06 01:39:42] [INFO ] [compare-source-1061-t0 ] (source) Connecting to database
[2026-02-06 01:39:42] [INFO ] [connection ] Successfully connected to postgres database (repo)
[2026-02-06 01:39:42] [INFO ] [connection ] Successfully connected to postgres database (repo)
[2026-02-06 01:39:42] [INFO ] [connection ] Successfully connected to postgres database (repo)
[2026-02-06 01:39:42] [INFO ] [connection ] Successfully connected to postgres database (repo)
[2026-02-06 01:39:42] [INFO ] [connection ] Successfully connected to postgres database (target)
[2026-02-06 01:39:42] [INFO ] [connection ] Successfully connected to postgres database (source)
[2026-02-06 01:39:42] [INFO ] [compare-target-1061-t0 ] (target) Loaded 10,000 rows
[2026-02-06 01:39:42] [INFO ] [compare-target-1061-t0 ] (target) Wait for Observer
[2026-02-06 01:39:44] [INFO ] [thread-manager ] Waiting for compare threads to complete
[2026-02-06 01:42:32] [INFO ] [compare-source-1061-t0 ] (source) Loaded 10,000 rows
[2026-02-06 01:42:32] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:42:32] [INFO ] [compare-target-1061-t0 ] (target) Cleared by Observer
[2026-02-06 01:42:32] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:42:33] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:34] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:36] [INFO ] [compare-source-1061-t0 ] (source) Loaded 1,000,000 rows
[2026-02-06 01:42:36] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:37] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:38] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:38] [INFO ] [compare-target-1061-t0 ] (target) Complete. Total rows loaded: 244,198
[2026-02-06 01:42:40] [INFO ] [compare-source-1061-t0 ] (source) Loaded 2,000,000 rows
[2026-02-06 01:42:40] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:42:42] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:42:42] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:43] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:45] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:46] [INFO ] [compare-source-1061-t0 ] (source) Loaded 3,000,000 rows
[2026-02-06 01:42:46] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:47] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:49] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:50] [INFO ] [compare-source-1061-t0 ] (source) Loaded 4,000,000 rows
[2026-02-06 01:42:50] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:42:52] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:42:53] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:54] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:55] [INFO ] [compare-source-1061-t0 ] (source) Loaded 5,000,000 rows
[2026-02-06 01:42:55] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:57] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:42:58] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:00] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:01] [INFO ] [compare-source-1061-t0 ] (source) Loaded 6,000,000 rows
[2026-02-06 01:43:01] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:43:02] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:43:03] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:06] [INFO ] [compare-source-1061-t0 ] (source) Loaded 7,000,000 rows
[2026-02-06 01:43:07] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:08] [INFO ] [compare-source-1061-t0 ] (source) Loaded 8,000,000 rows
[2026-02-06 01:43:08] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:43:13] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:43:14] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:16] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:17] [INFO ] [compare-source-1061-t0 ] (source) Loaded 9,000,000 rows
[2026-02-06 01:43:17] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:19] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:20] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:21] [INFO ] [compare-source-1061-t0 ] (source) Loaded 10,000,000 rows
[2026-02-06 01:43:21] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:43:25] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:43:26] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:27] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:28] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:29] [INFO ] [compare-source-1061-t0 ] (source) Loaded 11,000,000 rows
[2026-02-06 01:43:30] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:31] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:32] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:33] [INFO ] [compare-source-1061-t0 ] (source) Loaded 12,000,000 rows
[2026-02-06 01:43:33] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:43:40] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:43:41] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:43] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:44] [INFO ] [compare-source-1061-t0 ] (source) Loaded 13,000,000 rows
[2026-02-06 01:43:44] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:45] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:46] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:48] [INFO ] [compare-source-1061-t0 ] (source) Loaded 14,000,000 rows
[2026-02-06 01:43:48] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:43:48] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:43:48] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:50] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:51] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:52] [INFO ] [compare-source-1061-t0 ] (source) Loaded 15,000,000 rows
[2026-02-06 01:43:52] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:53] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:55] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:56] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:43:57] [INFO ] [compare-source-1061-t0 ] (source) Loaded 16,000,000 rows
[2026-02-06 01:43:57] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:44:07] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:44:07] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:08] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:10] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:11] [INFO ] [compare-source-1061-t0 ] (source) Loaded 17,000,000 rows
[2026-02-06 01:44:11] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:12] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:14] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:15] [INFO ] [compare-source-1061-t0 ] (source) Loaded 18,000,000 rows
[2026-02-06 01:44:15] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:44:16] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:44:16] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:18] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:19] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:20] [INFO ] [compare-source-1061-t0 ] (source) Loaded 19,000,000 rows
[2026-02-06 01:44:20] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:22] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:23] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:24] [INFO ] [compare-source-1061-t0 ] (source) Loaded 20,000,000 rows
[2026-02-06 01:44:24] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:44:27] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:44:27] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:28] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:29] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:31] [INFO ] [compare-source-1061-t0 ] (source) Loaded 21,000,000 rows
[2026-02-06 01:44:31] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:32] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:34] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:35] [INFO ] [compare-source-1061-t0 ] (source) Loaded 22,000,000 rows
[2026-02-06 01:44:35] [INFO ] [compare-source-1061-t0 ] (source) Wait for Observer
[2026-02-06 01:44:38] [INFO ] [compare-source-1061-t0 ] (source) Cleared by Observer
[2026-02-06 01:44:38] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:39] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:41] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:42] [INFO ] [compare-source-1061-t0 ] (source) Loaded 23,000,000 rows
[2026-02-06 01:44:42] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:43] [INFO ] [compare-source-1061-t0 ] (source) Waiting for Queue space
[2026-02-06 01:44:44] [INFO ] [compare-source-1061-t0 ] (source) Complete. Total rows loaded: 23,648,465
[2026-02-06 01:44:44] [INFO ] [compare-source-1061-t0 ] (source) Waiting for message queue to empty
[2026-02-06 01:44:46] [INFO ] [thread-manager ] Waiting for reconcile threads to complete
[2026-02-06 01:44:47] [INFO ] [loader-source-t0-i1 ] Loader thread complete.
[2026-02-06 01:44:47] [INFO ] [loader-source-t0-i2 ] Loader thread complete.
[2026-02-06 01:44:47] [INFO ] [loader-target-t0-i2 ] Loader thread complete.
[2026-02-06 01:44:47] [INFO ] [loader-target-t0-i1 ] Loader thread complete.
[2026-02-06 01:45:02] [INFO ] [observer-c170-t0 ] Matched 82,685 rows
[2026-02-06 01:45:13] [INFO ] [observer-c170-t0 ] Staging table cleanup
[2026-02-06 01:46:25] [INFO ] [staging-operations ] Findings loaded from staging table dc_source_1061_0 to main table for location: source
[2026-02-06 01:46:39] [INFO ] [staging-operations ] Findings loaded from staging table dc_target_1061_0 to main table for location: target
[2026-02-06 01:46:42] [INFO ] [thread-manager ] All reconciliation threads completed
[2026-02-06 01:46:42] [INFO ] [result-processor ] Starting result summarization
[2026-02-06 02:04:08] [INFO ] [result-processor ] Result summarization completed successfully
[2026-02-06 02:04:08] [INFO ] [compare-ctrl ] Reconciliation Complete: Table = pca_aft_check_log; Status = out-of-sync; Equal = 82,685; Not Equal = 0; Missing Source = 163,315; Missing Target = 23,494,466
[2026-02-06 02:04:08] [INFO ] [repo-ctrl ] Table history completed for table 1061, batch 1
[2026-02-06 02:04:08] [INFO ] [display-operations ] Summary:
[2026-02-06 02:04:08] [INFO ] [report-ctrl ] Summary calculated: 23740466 total rows, 23657781 out of sync rows, 1467 seconds elapsed
[2026-02-06 02:04:08] [INFO ] [display-operations ] Table Summaries:
[2026-02-06 02:04:08] [INFO ] [display-operations ] Table: pca_aft_check_log
[2026-02-06 02:04:08] [INFO ] [display-operations ] Status: out-of-sync
[2026-02-06 02:04:08] [INFO ] [display-operations ] Elapsed Time: 1465 seconds
[2026-02-06 02:04:08] [INFO ] [display-operations ] Total Rows: 23,740,466
[2026-02-06 02:04:08] [INFO ] [display-operations ] Equal Rows: 82,685
[2026-02-06 02:04:08] [INFO ] [display-operations ] Not Equal Rows: 0
[2026-02-06 02:04:08] [INFO ] [display-operations ] Missing Source: 163,315
[2026-02-06 02:04:08] [INFO ] [display-operations ] Missing Target: 23,494,466
[2026-02-06 02:04:08] [INFO ] [display-operations ] Throughput: 16,205 rows/second
[2026-02-06 02:04:08] [INFO ] [display-operations ] Job Summary:
[2026-02-06 02:04:08] [INFO ] [display-operations ] Tables Processed: 1
[2026-02-06 02:04:08] [INFO ] [display-operations ] Total Rows: 23,740,466
[2026-02-06 02:04:08] [INFO ] [display-operations ] Out of Sync Rows: 23,657,781
[2026-02-06 02:04:08] [INFO ] [display-operations ] Elapsed Time: 1,467 seconds
[2026-02-06 02:04:08] [INFO ] [display-operations ] Throughput: 16,183 rows/second
[2026-02-06 02:04:08] [INFO ] [compare-ctrl ] Comparison operation completed successfully
[2026-02-06 02:04:08] [INFO ] [main ] Shutting down
- pgcompare db
WITH mr AS (SELECT max(rid) rid FROM pgcompare.dc_result)
SELECT compare_start, table_name, status, equal_cnt+not_equal_cnt+missing_source_cnt+missing_target_cnt AS total_cnt,
equal_cnt, not_equal_cnt, missing_source_cnt, missing_target_cnt
FROM pgcompare.dc_result r
JOIN mr ON (mr.rid = r.rid)
ORDER BY compare_start;
"compare_start" "table_name" "status" "total_cnt" "equal_cnt" "not_equal_cnt" "missing_source_cnt" "missing_target_cnt"
"2026-02-06 09:39:42.250113+08" "pca_aft_check_log" "out-of-sync" 23740466 82685 0 163315 23494466
select count(1) from pgcompare.dc_target;
"count"
163315
select * from pgcompare.dc_target limit 10;
"tid" "table_name" "batch_nbr" "pk" "pk_hash" "column_hash" "compare_result" "thread_nbr"
1061 "pca_aft_check_log" 1 "{""id"": 201328370}" "bc14751034baff756b4da99363248f65" "05272698b63c81879492f15abab3ec56" "m" 0
1061 "pca_aft_check_log" 1 "{""id"": 201294865}" "c6f5977834fe34e6d81aa0ce2f97371e" "790e2c407dd1c8e0765904d8459da457" "m" 0
1061 "pca_aft_check_log" 1 "{""id"": 201181023}" "fb4ccbd1e359b52c59fd3083171afa6d" "9f63c7b85f4081f313e56f34dba977cd" "m" 0
1061 "pca_aft_check_log" 1 "{""id"": 201268371}" "1d0c32fe99d97f95d177b4b1172a403e" "eec47d5f31a7ddab717a9c4fc2cb3fd4" "m" 0
1061 "pca_aft_check_log" 1 "{""id"": 201211553}" "2a3d497642ad5ae3f3324c98c935236b" "77587b425d8dc7bb263148b2228ad35c" "m" 0
1061 "pca_aft_check_log" 1 "{""id"": 201210435}" "7aee50990e9a63166aaadbc87135fd88" "a64257bcbe4940397068e9fee6bd3e26" "m" 0
1061 "pca_aft_check_log" 1 "{""id"": 201367046}" "fb728b452bceb492eed95ba54a940eb3" "1c5e881743e1f40740a6bdfd325c712a" "m" 0
1061 "pca_aft_check_log" 1 "{""id"": 201192993}" "42ff91c8fdd09a8a071fced52d6cdc5b" "d3b8168c308b0011ba18f5e66e5824bd" "m" 0
1061 "pca_aft_check_log" 1 "{""id"": 201191696}" "cbadc1470f9cbefa285d095363c0936e" "9738971f08fee646b6c32e28a60a12e8" "m" 0
1061 "pca_aft_check_log" 1 "{""id"": 201353429}" "b17c3e51f43c14b83c5eb483e9723dc9" "5bf53d50a11bb05c53293d96390cf6be" "m" 0- target db
not missing
select * from fis.pca_aft_check_log where id = 201328370;
"id" "pdline" "wc" "mcbsno" "ispass" "remark" "badgeno" "cdt" "snoid" "testcount" "fixno" "inputtype" "refid"
201328370 "P22" "24" "IV61GNAN99" "1" "CT262040W2" "IEC141200" "2026-02-04 12:44:43.953" 32068992 1 "M" 0
- source db
select * from fis.pca_aft_check_log where id = 201328370;
"id" "pdline" "wc" "mcbsno" "ispass" "remark" "badgeno" "cdt" "snoid" "testcount" "fixno" "inputtype" "refid"
201328370 "P22" "24" "IV61GNAN99" "1" "CT262040W2" "IEC141200" "2026-02-04 12:44:43.953" 32068992 1 "M" 0
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels