Skip to content

[ut](hash) add be ut for crc32 #60392

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jacktengg wants to merge 2 commits into
base: master
Choose a base branch
from
Open

[ut](hash) add be ut for crc32 #60392

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
59885a6
[ut](hash) add be ut for crc32
jacktengg Jan 30, 2026
15dd32e
add missing files
jacktengg Jan 30, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 2 additions & 4 deletions be/src/vec/columns/column_nullable.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -115,8 +115,7 @@ void ColumnNullable::update_crcs_with_value(uint32_t* __restrict hashes, doris::
}

void ColumnNullable::update_crc32c_batch(uint32_t* __restrict hashes,
const uint8_t* __restrict null_map) const {
DCHECK(null_map == nullptr);
const uint8_t* __restrict /* null_map */) const {
const auto* __restrict real_null_data =
assert_cast<const ColumnUInt8&>(get_null_map_column()).get_data().data();
if (_nested_column->support_replace_column_null_data()) {
Expand All @@ -135,8 +134,7 @@ void ColumnNullable::update_crc32c_batch(uint32_t* __restrict hashes,
}

void ColumnNullable::update_crc32c_single(size_t start, size_t end, uint32_t& hash,
const uint8_t* __restrict null_map) const {
DCHECK(null_map == nullptr);
const uint8_t* __restrict /* null_map */) const {
const auto* __restrict real_null_data =
assert_cast<const ColumnUInt8&>(get_null_map_column()).get_data().data();
constexpr int NULL_VALUE = 0;
Expand Down
Empty file added be/test/expected_result/vec/columns/column_array_update_crc32c_batch.out
View file
Open in desktop
Empty file.
12 changes: 12 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_0.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
0
0
0
0
4067132163
0
0
4067132163
2747096916
2747096916
216868426
216868426
12 changes: 12 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_0.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
0
0
0
0
4067132163
0
0
4067132163
2747096916
2747096916
216868426
216868426
11 changes: 11 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_1.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
0
0
0
0
3561525968
1889384571
3722505002
3537221586
3061579435
3836781809
2057675024
11 changes: 11 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_1.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
0
0
0
0
3561525968
1889384571
3722505002
3537221586
3061579435
3836781809
2057675024
17 changes: 17 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_10.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
0
0
0
1872750122
1752235803
3930893573
2801165814
1017039421
0
0
0
3235574030
0
0
1632426658
1632426658
1636859078
17 changes: 17 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_10.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
0
0
0
1872750122
1752235803
3930893573
2801165814
1017039421
0
0
0
3235574030
0
0
1632426658
1632426658
1636859078
24 changes: 24 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_11.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
0
0
0
3151763130
1087075022
417171664
4071924378
3034693506
397552065
1077535508
4069168847
91665574
3074307001
2212483339
1216981678
3913045381
1909710069
456153211
2258032926
3967114640
3273183395
1983084248
394481206
2888253957
24 changes: 24 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_11.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
0
0
0
3151763130
1087075022
417171664
4071924378
3034693506
397552065
1077535508
4069168847
91665574
3074307001
2212483339
1216981678
3913045381
1909710069
456153211
2258032926
3967114640
3273183395
1983084248
394481206
2888253957
17 changes: 17 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_12.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
0
0
0
767860991
174112307
1666175110
2173425109
329330016
0
0
0
2814551020
0
0
3255322266
3255322266
366903698
17 changes: 17 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_12.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
0
0
0
767860991
174112307
1666175110
2173425109
329330016
0
0
0
2814551020
0
0
3255322266
3255322266
366903698
24 changes: 24 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_13.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
0
0
0
425567578
4137229719
3308958442
2079999457
2209589379
28901508
2348862776
4130715442
1078942158
1385183375
1291153304
2900472686
1615819816
507094796
349377002
1236434327
1129892721
891860571
2784250839
94492299
358020005
24 changes: 24 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_13.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
0
0
0
425567578
4137229719
3308958442
2079999457
2209589379
28901508
2348862776
4130715442
1078942158
1385183375
1291153304
2900472686
1615819816
507094796
349377002
1236434327
1129892721
891860571
2784250839
94492299
358020005
6 changes: 6 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_14.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
0
0
0
1654528736
3804949715
282782997
6 changes: 6 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_14.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
0
0
0
1654528736
3804949715
282782997
7 changes: 7 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_15.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
0
0
0
0
216529851
333749482
3227154546
7 changes: 7 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_15.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
0
0
0
0
216529851
333749482
3227154546
5 changes: 5 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_16.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
0
0
0
0
1749400974
5 changes: 5 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_16.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
0
0
0
0
1749400974
5 changes: 5 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_17.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
0
0
0
1114675946
2813373500
5 changes: 5 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_17.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
0
0
0
1114675946
2813373500
5 changes: 5 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_18.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
0
0
0
2324772522
4282582972
5 changes: 5 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_18.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
0
0
0
2324772522
4282582972
12 changes: 12 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_19.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
0
0
0
0
3119113712
0
0
4067132163
2747096916
137161965
216868426
886757660
12 changes: 12 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_19.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
0
0
0
0
3119113712
0
0
4067132163
2747096916
137161965
216868426
886757660
13 changes: 13 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_2.out
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
0
0
0
0
122633193
2438243087
2680870109
565313884
1274151196
415518346
891484347
0
733149472
13 changes: 13 additions & 0 deletions be/test/expected_result/vec/columns/column_array_update_crc32c_batch_2.out_with_nullmap
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
0
0
0
0
122633193
2438243087
2680870109
565313884
1274151196
415518346
891484347
0
733149472
Loading
Loading