Skip to content

Compute MC/DC coverage - #3029

Merged
jviotti merged 1 commit into
mainfrom
mc-dc
Oct 25, 2026
Merged

jviotti merged 1 commit into
mainfrom
mc-dc

Conversation

@jviotti

@jviotti jviotti commented Oct 25, 2026

Copy link
Copy Markdown
Member

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 1 file

View guided diff | Re-trigger cubic

@jviotti
jviotti merged commit 3d6a225 into main Oct 25, 2026
14 of 15 checks passed
@jviotti
jviotti deleted the mc-dc branch October 25, 2026 01:38
@github-actions

Copy link
Copy Markdown

Benchmark linux/llvm

Measured against main at 2aa17a8.

1 slower, 0 faster, 117 within 5%.

Benchmark main This branch Change
JSON_Array_Of_Integers_Unique_256 4.61 us 4.94 us +7.2%
All 118 benchmarks
Benchmark main This branch Change
Regex_Lower_S_Or_Upper_S_Asterisk 2.18 ns 2.18 ns -0.0%
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar 2.18 ns 2.18 ns -0.1%
Regex_Period_Asterisk 2.18 ns 2.18 ns +0.0%
Regex_Group_Period_Asterisk_Group 2.18 ns 2.18 ns +0.0%
Regex_Period_Plus 2.80 ns 2.80 ns -0.0%
Regex_Period 2.80 ns 2.80 ns -0.1%
Regex_Caret_Period_Plus_Dollar 2.49 ns 2.49 ns -0.1%
Regex_Caret_Group_Period_Plus_Group_Dollar 2.49 ns 2.49 ns -0.1%
Regex_Caret_Period_Asterisk_Dollar 3.42 ns 3.42 ns -0.0%
Regex_Caret_Group_Period_Asterisk_Group_Dollar 3.42 ns 3.42 ns -0.0%
Regex_Caret_X_Hyphen 7.15 ns 7.16 ns +0.1%
Regex_Period_Md_Dollar 26.72 ns 26.64 ns -0.3%
Regex_Caret_Slash_Period_Asterisk 7.16 ns 7.16 ns -0.1%
Regex_Caret_Period_Range_Dollar 4.37 ns 4.35 ns -0.3%
Regex_Nested_Backtrack 37.95 ns 38.03 ns +0.2%
JSON_Array_Of_Objects_Unique 402.92 ns 413.98 ns +2.7%
JSON_Array_Of_Integers_Unique_256 4.61 us 4.94 us +7.2%
JSON_Array_Of_Strings_Unique_Colliding_256 216.18 us 215.82 us -0.2%
JSON_Parse_1 4.55 us 4.49 us -1.3%
JSON_Parse_Real 4.53 us 4.69 us +3.6%
JSON_Parse_Real_Inexact 4.23 us 4.21 us -0.5%
JSON_Parse_Decimal 7.37 us 7.41 us +0.5%
JSON_Parse_Schema_ISO_Language 3.38 ms 3.31 ms -2.0%
JSON_Parse_KrakenD 1.10 ms 1.09 ms -0.6%
JSON_Stringify_ISO_Language 2.58 ms 2.64 ms +2.3%
JSON_Prettify_KrakenD 2.27 ms 2.27 ms +0.1%
JSON_Parse_Integer 3.67 us 3.66 us -0.3%
JSON_Parse_String_NonSSO_Plain 3.45 us 3.35 us -3.0%
JSON_Parse_String_SSO_Plain 3.03 us 2.92 us -3.6%
JSON_Parse_String_Escape_Heavy 12.38 us 12.36 us -0.2%
JSON_Parse_Object_Short_Keys 7.90 us 7.89 us -0.1%
JSON_Parse_Object_Scalar_Properties 3.95 us 4.02 us +1.8%
JSON_Parse_Object_Array_Properties 5.47 us 5.23 us -4.4%
JSON_Parse_Object_Object_Properties 5.50 us 5.24 us -4.7%
JSON_Parse_Nested_Containers 34.00 us 33.65 us -1.0%
JSON_Fast_Hash_Helm_Chart_Lock 60.99 ns 60.99 ns +0.0%
JSON_Equality_Helm_Chart_Lock 160.79 ns 160.80 ns +0.0%
JSON_String_Equal_10 6.55 ns 6.55 ns -0.0%
JSON_String_Equal_100 7.17 ns 6.86 ns -4.3%
JSON_String_Equal_Small_By_Perfect_Hash_10 0.94 ns 0.94 ns +0.2%
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 10.58 ns 10.58 ns +0.0%
JSON_String_Fast_Hash_10 2.49 ns 2.49 ns +0.1%
JSON_String_Fast_Hash_100 2.49 ns 2.49 ns +0.1%
JSON_String_Key_Hash_10 2.18 ns 2.18 ns -0.1%
JSON_String_Key_Hash_100 6.54 ns 6.54 ns +0.0%
JSON_Object_Defines_Miss_Same_Length 2.99 ns 2.98 ns -0.4%
JSON_Object_Defines_Miss_Too_Small 3.42 ns 3.42 ns +0.0%
JSON_Object_Defines_Miss_Too_Large 2.80 ns 2.77 ns -1.0%
JSON_From_String_Copy 10.49 ns 10.69 ns +1.9%
JSON_From_String_Temporary 9.90 ns 10.30 ns +4.0%
JSON_Number_To_Double 13.42 ns 13.41 ns -0.1%
JSON_Object_At_Last_Key_8 5.92 ns 5.83 ns -1.5%
JSON_Object_At_Last_Key_32 12.35 ns 12.18 ns -1.4%
JSON_Object_At_Last_Key_128 48.57 ns 48.55 ns -0.0%
JSON_Object_At_Last_Key_512 381.60 ns 382.31 ns +0.2%
JSON_Divisible_By_Decimal 287.34 ns 286.62 ns -0.3%
JSON_PropertySet_Contains 50.59 ns 50.60 ns +0.0%
JSON_PropertySet_Filter_Object_Properties 51.10 ns 51.24 ns +0.3%
JSON_PropertySet_Insert 531.85 ns 541.23 ns +1.8%
JSON_Stringify_Schema_Web_Of_Things 64.46 us 63.86 us -0.9%
JSON_Prettify_Schema_Web_Of_Things 177.13 us 180.87 us +2.1%
Pointer_Object_Traverse 29.14 ns 28.98 ns -0.6%
Pointer_Object_Try_Traverse 30.20 ns 30.22 ns +0.1%
Pointer_Push_Back_Pointer_To_Weak_Pointer 144.76 ns 146.02 ns +0.9%
Pointer_Walker_Schema_ISO_Language 1.53 ms 1.50 ms -2.0%
Pointer_Untracked_Deeply_Nested 1.24 ms 1.22 ms -1.3%
Pointer_Tracked_Deeply_Nested 1.65 ms 1.65 ms +0.2%
Pointer_Position_Tracker_Get_Deeply_Nested 620.53 ns 601.09 ns -3.1%
Schema_Tracker_ISO_Language 4.38 ms 4.36 ms -0.3%
Schema_Tracker_ISO_Language_To_JSON 16.47 ms 16.34 ms -0.8%
Schema_Frame_WoT_References 2.04 ms 2.02 ms -1.1%
Schema_Frame_OMC_References 9.21 ms 9.13 ms -0.9%
Schema_Frame_OMC_Pointers 16.90 ms 16.74 ms -0.9%
Schema_Frame_OMC_Locations 7.90 ms 7.87 ms -0.4%
Schema_Frame_ISO_Language_Locations 42.24 ms 42.11 ms -0.3%
Schema_Frame_ISO_Language_Root 317.37 ns 316.12 ns -0.4%
Schema_Frame_KrakenD_References 15.26 ms 14.82 ms -2.9%
Schema_Frame_KrakenD_Reachable 150.23 ms 148.09 ms -1.4%
Schema_Frame_ISO_Language_Locations_To_JSON 30.41 ms 30.54 ms +0.4%
Schema_Frame_Many_Resources_References 108.09 ms 108.28 ms +0.2%
Schema_Frame_Deeply_Nested_References 10.63 ms 10.51 ms -1.2%
Schema_Format_ISO_Language 46.86 ms 46.49 ms -0.8%
Schema_Bundle_Meta_2020_12 610.96 us 607.11 us -0.6%
Schema_Bundle_Many_Remotes_With_Fragments 6.54 ms 6.49 ms -0.9%
OpenAPI_Frame_GSMTasks_3_0 152.35 ms 153.13 ms +0.5%
OpenAPI_Format_Synthetic_3_1 48.90 ms 47.77 ms -2.3%
JSONPath_Descendant_Filter_Nested 1.81 us 1.81 us +0.1%
URITemplateRouter_Create 22.86 us 23.36 us +2.2%
URITemplateRouter_Match 177.24 ns 170.61 ns -3.7%
URITemplateRouterView_Restore 8.47 us 8.51 us +0.5%
URITemplateRouterView_Match 141.03 ns 140.81 ns -0.2%
URITemplateRouterView_Arguments 431.82 ns 431.47 ns -0.1%
URITemplateRouter_Match_BasePath 200.32 ns 190.72 ns -4.8%
URITemplateRouterView_Match_BasePath 161.12 ns 161.14 ns +0.0%
JSONL_Parse_Large 9.64 ms 9.43 ms -2.3%
JSONL_Parse_Large_GZIP 9.82 ms 9.61 ms -2.1%
JSONLD_Catalog_Annotation_List_Populate 610.31 us 614.31 us +0.7%
JSONLD_Catalog_Materialize 3.54 ms 3.53 ms -0.3%
HTML_Build_Table_100000 37.23 ms 37.63 ms +1.1%
HTML_Render_Table_100000 1.82 ms 1.83 ms +1.0%
Markdown_To_HTML_Realistic_Document 4.11 ms 4.08 ms -0.7%
Markdown_To_HTML_Pathological 12.93 ms 12.99 ms +0.5%
Markdown_To_HTML_Short_Descriptions 577.57 ns 568.43 ns -1.6%
GZIP_Compress_ISO_Language_Set_3_Locations 37.66 ms 37.67 ms +0.0%
GZIP_Decompress_ISO_Language_Set_3_Locations 5.14 ms 5.13 ms -0.2%
GZIP_Decompress_Default_Level_ISO_Language_Set_3_Locations 7.06 ms 7.07 ms +0.1%
GZIP_Decompress_Stream_Default_Level_ISO_Language_Set_3_Locations 9.13 ms 8.99 ms -1.5%
GZIP_Compress_ISO_Language_Set_3_Schema 2.23 ms 2.23 ms -0.0%
GZIP_Decompress_ISO_Language_Set_3_Schema 419.26 us 419.75 us +0.1%
JOSE_VerifySignature_RS256 46.72 us 46.74 us +0.0%
JOSE_VerifySignature_ES512 1.73 ms 1.74 ms +0.3%
Crypto_CRC32_Large_JSONL 101.75 us 101.82 us +0.1%
Crypto_AES_GCM_Encrypt_128_1KB 31.28 us 31.25 us -0.1%
Crypto_AES_GCM_Decrypt_128_1KB 31.24 us 31.23 us -0.0%
Crypto_AES_GCM_Encrypt_256_1KB 38.09 us 38.05 us -0.1%
Metapack_Parse_OMC_JSON_V2 6.85 ns 6.84 ns -0.0%
Metapack_Read_OMC_JSON_V2 370.53 us 368.23 us -0.6%
Metapack_Write_OMC_JSON_V2 1.08 ms 1.04 ms -3.7%

@augmentcode

augmentcode Bot commented Oct 25, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Enables LLVM MC/DC instrumentation to measure independent condition effects.
Reads condition-independence verdicts from LLVM's JSON exports.
Combines condition coverage across binaries and template instantiations.
Applies the existing function exceptions to the new condition metric.
Adds TOTAL conditions and an optional REQUIRE_MINIMUM_CONDITION_COVERAGE gate.
Shows MC/DC decision details and summary statistics in the HTML report.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 2 suggestions posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread contrib/website.sh
if excused(key):
continue

total_conditions += len(shown)

@augmentcode augmentcode Bot Oct 25, 2026 •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you check the denominator at contrib/website.sh:389? LLVM exports false for constant-folded conditions but excludes them in sumMCDCPairs(), so a fully exercised a && true counts as 1/2 here instead of LLVM's 1/1, understating coverage and potentially failing REQUIRE_MINIMUM_CONDITION_COVERAGE despite complete measurable coverage.

Severity: medium

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

Comment thread contrib/website.sh
if isinstance(field, list))
shown = decisions.setdefault(key, {})
for index, independent in enumerate(verdicts):
where = (record[0], record[1], index)

@augmentcode augmentcode Bot Oct 25, 2026 •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you check the decision identity at contrib/website.sh:302? Distinct expansions of the same compound macro inside one function have identical start coordinates but different LLVM FileIDs, so this key collapses their condition entries and allows a covered expansion to hide an uncovered one in both TOTAL conditions and its coverage gate.

Severity: medium

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

@github-actions

Copy link
Copy Markdown

Benchmark windows/msvc

Measured against main at 2aa17a8.

4 slower, 2 faster, 112 within 5%.

Benchmark main This branch Change
Schema_Frame_Deeply_Nested_References 20.94 ms 24.00 ms +14.6%
JSON_Stringify_Schema_Web_Of_Things 229.95 us 245.69 us +6.8%
JSON_Stringify_ISO_Language 10.04 ms 10.69 ms +6.5%
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 14.13 ns 15.02 ns +6.3%
Schema_Tracker_ISO_Language_To_JSON 64.25 ms 60.70 ms -5.5%
JSON_Parse_Object_Object_Properties 12.45 us 11.44 us -8.1%
All 118 benchmarks
Benchmark main This branch Change
Regex_Lower_S_Or_Upper_S_Asterisk 4.70 ns 4.71 ns +0.4%
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar 4.79 ns 4.78 ns -0.2%
Regex_Period_Asterisk 4.70 ns 4.81 ns +2.2%
Regex_Group_Period_Asterisk_Group 4.81 ns 4.80 ns -0.2%
Regex_Period_Plus 4.85 ns 4.79 ns -1.3%
Regex_Period 4.71 ns 4.70 ns -0.2%
Regex_Caret_Period_Plus_Dollar 4.75 ns 4.72 ns -0.7%
Regex_Caret_Group_Period_Plus_Group_Dollar 4.71 ns 4.70 ns -0.1%
Regex_Caret_Period_Asterisk_Dollar 4.70 ns 4.70 ns +0.0%
Regex_Caret_Group_Period_Asterisk_Group_Dollar 4.77 ns 4.77 ns +0.1%
Regex_Caret_X_Hyphen 7.83 ns 7.83 ns +0.0%
Regex_Period_Md_Dollar 46.22 ns 46.11 ns -0.2%
Regex_Caret_Slash_Period_Asterisk 7.57 ns 7.55 ns -0.3%
Regex_Caret_Period_Range_Dollar 5.33 ns 5.33 ns +0.1%
Regex_Nested_Backtrack 57.66 ns 57.44 ns -0.4%
JSON_Array_Of_Objects_Unique 536.69 ns 515.07 ns -4.0%
JSON_Array_Of_Integers_Unique_256 4.67 us 4.68 us +0.2%
JSON_Array_Of_Strings_Unique_Colliding_256 289.52 us 291.00 us +0.5%
JSON_Parse_1 8.67 us 8.68 us +0.2%
JSON_Parse_Real 7.64 us 7.70 us +0.8%
JSON_Parse_Real_Inexact 7.16 us 7.23 us +0.9%
JSON_Parse_Decimal 12.27 us 12.34 us +0.5%
JSON_Parse_Schema_ISO_Language 7.61 ms 7.61 ms -0.1%
JSON_Parse_KrakenD 2.26 ms 2.23 ms -1.5%
JSON_Stringify_ISO_Language 10.04 ms 10.69 ms +6.5%
JSON_Prettify_KrakenD 7.48 ms 7.48 ms +0.0%
JSON_Parse_Integer 6.60 us 6.66 us +0.9%
JSON_Parse_String_NonSSO_Plain 8.20 us 8.27 us +0.9%
JSON_Parse_String_SSO_Plain 4.12 us 4.21 us +2.2%
JSON_Parse_String_Escape_Heavy 22.33 us 22.03 us -1.3%
JSON_Parse_Object_Short_Keys 14.17 us 13.78 us -2.7%
JSON_Parse_Object_Scalar_Properties 7.26 us 7.08 us -2.6%
JSON_Parse_Object_Array_Properties 11.59 us 11.49 us -0.8%
JSON_Parse_Object_Object_Properties 12.45 us 11.44 us -8.1%
JSON_Parse_Nested_Containers 82.30 us 80.35 us -2.4%
JSON_Fast_Hash_Helm_Chart_Lock 103.86 ns 101.75 ns -2.0%
JSON_Equality_Helm_Chart_Lock 209.16 ns 209.19 ns +0.0%
JSON_String_Equal_10 10.11 ns 10.22 ns +1.1%
JSON_String_Equal_100 11.42 ns 11.61 ns +1.7%
JSON_String_Equal_Small_By_Perfect_Hash_10 2.20 ns 2.20 ns +0.1%
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 14.13 ns 15.02 ns +6.3%
JSON_String_Fast_Hash_10 6.29 ns 6.37 ns +1.2%
JSON_String_Fast_Hash_100 6.35 ns 6.47 ns +1.9%
JSON_String_Key_Hash_10 5.01 ns 5.02 ns +0.2%
JSON_String_Key_Hash_100 11.87 ns 11.86 ns -0.2%
JSON_Object_Defines_Miss_Same_Length 4.07 ns 4.07 ns +0.0%
JSON_Object_Defines_Miss_Too_Small 3.77 ns 3.77 ns -0.2%
JSON_Object_Defines_Miss_Too_Large 4.08 ns 4.07 ns -0.2%
JSON_From_String_Copy 64.10 ns 64.29 ns +0.3%
JSON_From_String_Temporary 60.26 ns 58.06 ns -3.7%
JSON_Number_To_Double 40.58 ns 40.64 ns +0.2%
JSON_Object_At_Last_Key_8 7.21 ns 7.21 ns -0.1%
JSON_Object_At_Last_Key_32 23.16 ns 23.18 ns +0.1%
JSON_Object_At_Last_Key_128 88.51 ns 88.47 ns -0.1%
JSON_Object_At_Last_Key_512 422.18 ns 424.23 ns +0.5%
JSON_Divisible_By_Decimal 386.22 ns 384.69 ns -0.4%
JSON_PropertySet_Contains 77.65 ns 78.08 ns +0.6%
JSON_PropertySet_Filter_Object_Properties 48.46 ns 48.03 ns -0.9%
JSON_PropertySet_Insert 1.30 us 1.30 us +0.6%
JSON_Stringify_Schema_Web_Of_Things 229.95 us 245.69 us +6.8%
JSON_Prettify_Schema_Web_Of_Things 720.43 us 718.65 us -0.2%
Pointer_Object_Traverse 70.35 ns 70.32 ns -0.0%
Pointer_Object_Try_Traverse 70.30 ns 70.08 ns -0.3%
Pointer_Push_Back_Pointer_To_Weak_Pointer 193.11 ns 199.72 ns +3.4%
Pointer_Walker_Schema_ISO_Language 8.39 ms 8.73 ms +4.1%
Pointer_Untracked_Deeply_Nested 2.35 ms 2.34 ms -0.6%
Pointer_Tracked_Deeply_Nested 3.60 ms 3.63 ms +0.9%
Pointer_Position_Tracker_Get_Deeply_Nested 556.18 ns 529.32 ns -4.8%
Schema_Tracker_ISO_Language 10.59 ms 10.18 ms -3.8%
Schema_Tracker_ISO_Language_To_JSON 64.25 ms 60.70 ms -5.5%
Schema_Frame_WoT_References 5.01 ms 4.98 ms -0.7%
Schema_Frame_OMC_References 21.92 ms 21.34 ms -2.7%
Schema_Frame_OMC_Pointers 39.44 ms 40.06 ms +1.6%
Schema_Frame_OMC_Locations 18.55 ms 18.70 ms +0.8%
Schema_Frame_ISO_Language_Locations 72.49 ms 75.71 ms +4.4%
Schema_Frame_ISO_Language_Root 2.58 us 2.60 us +1.0%
Schema_Frame_KrakenD_References 36.25 ms 36.41 ms +0.4%
Schema_Frame_KrakenD_Reachable 291.75 ms 292.28 ms +0.2%
Schema_Frame_ISO_Language_Locations_To_JSON 154.88 ms 156.39 ms +1.0%
Schema_Frame_Many_Resources_References 358.07 ms 354.41 ms -1.0%
Schema_Frame_Deeply_Nested_References 20.94 ms 24.00 ms +14.6%
Schema_Format_ISO_Language 79.43 ms 81.55 ms +2.7%
Schema_Bundle_Meta_2020_12 1.54 ms 1.51 ms -2.0%
Schema_Bundle_Many_Remotes_With_Fragments 28.94 ms 28.67 ms -0.9%
OpenAPI_Frame_GSMTasks_3_0 375.96 ms 375.07 ms -0.2%
OpenAPI_Format_Synthetic_3_1 128.65 ms 126.39 ms -1.8%
JSONPath_Descendant_Filter_Nested 2.88 us 2.88 us -0.1%
URITemplateRouter_Create 39.21 us 39.66 us +1.2%
URITemplateRouter_Match 231.42 ns 231.91 ns +0.2%
URITemplateRouterView_Restore 34.81 us 35.28 us +1.3%
URITemplateRouterView_Match 213.40 ns 213.04 ns -0.2%
URITemplateRouterView_Arguments 551.56 ns 545.68 ns -1.1%
URITemplateRouter_Match_BasePath 263.19 ns 267.68 ns +1.7%
URITemplateRouterView_Match_BasePath 242.57 ns 241.83 ns -0.3%
JSONL_Parse_Large 32.91 ms 32.61 ms -0.9%
JSONL_Parse_Large_GZIP 31.87 ms 31.46 ms -1.3%
JSONLD_Catalog_Annotation_List_Populate 2.91 ms 2.93 ms +1.0%
JSONLD_Catalog_Materialize 7.73 ms 7.77 ms +0.5%
HTML_Build_Table_100000 66.36 ms 66.13 ms -0.3%
HTML_Render_Table_100000 7.50 ms 7.53 ms +0.3%
Markdown_To_HTML_Realistic_Document 5.57 ms 5.59 ms +0.2%
Markdown_To_HTML_Pathological 17.18 ms 17.30 ms +0.7%
Markdown_To_HTML_Short_Descriptions 714.59 ns 720.62 ns +0.8%
GZIP_Compress_ISO_Language_Set_3_Locations 37.40 ms 37.45 ms +0.1%
GZIP_Decompress_ISO_Language_Set_3_Locations 9.65 ms 9.67 ms +0.2%
GZIP_Decompress_Default_Level_ISO_Language_Set_3_Locations 11.91 ms 11.88 ms -0.3%
GZIP_Decompress_Stream_Default_Level_ISO_Language_Set_3_Locations 14.05 ms 14.18 ms +0.9%
GZIP_Compress_ISO_Language_Set_3_Schema 2.28 ms 2.30 ms +0.9%
GZIP_Decompress_ISO_Language_Set_3_Schema 624.19 us 644.68 us +3.3%
JOSE_VerifySignature_RS256 21.32 us 21.24 us -0.4%
JOSE_VerifySignature_ES512 1.52 ms 1.52 ms +0.1%
Crypto_CRC32_Large_JSONL 103.42 us 103.36 us -0.1%
Crypto_AES_GCM_Encrypt_128_1KB 2.35 us 2.33 us -1.0%
Crypto_AES_GCM_Decrypt_128_1KB 2.36 us 2.36 us +0.1%
Crypto_AES_GCM_Encrypt_256_1KB 2.42 us 2.39 us -1.1%
Metapack_Parse_OMC_JSON_V2 11.91 ns 11.93 ns +0.2%
Metapack_Read_OMC_JSON_V2 647.27 us 649.79 us +0.4%
Metapack_Write_OMC_JSON_V2 2.14 ms 2.17 ms +1.6%

@github-actions

Copy link
Copy Markdown

Benchmark linux/gcc

Measured against main at 2aa17a8.

15 slower, 1 faster, 102 within 5%.

Benchmark main This branch Change
Schema_Frame_OMC_Locations 8.40 ms 10.69 ms +27.2%
Schema_Frame_OMC_References 9.60 ms 12.01 ms +25.1%
Schema_Frame_KrakenD_References 15.81 ms 19.62 ms +24.1%
Schema_Frame_Deeply_Nested_References 11.21 ms 13.16 ms +17.4%
Schema_Frame_ISO_Language_Locations 42.20 ms 49.00 ms +16.1%
Schema_Frame_OMC_Pointers 17.78 ms 20.63 ms +16.0%
Schema_Tracker_ISO_Language_To_JSON 16.20 ms 17.63 ms +8.9%
OpenAPI_Format_Synthetic_3_1 50.57 ms 54.97 ms +8.7%
Schema_Frame_ISO_Language_Locations_To_JSON 35.69 ms 38.78 ms +8.7%
Schema_Frame_Many_Resources_References 120.64 ms 130.74 ms +8.4%
Schema_Format_ISO_Language 47.57 ms 50.75 ms +6.7%
Schema_Frame_KrakenD_Reachable 133.09 ms 141.94 ms +6.6%
Pointer_Push_Back_Pointer_To_Weak_Pointer 167.95 ns 178.97 ns +6.6%
Schema_Frame_WoT_References 2.12 ms 2.24 ms +5.9%
Schema_Tracker_ISO_Language 5.13 ms 5.43 ms +5.9%
JSONLD_Catalog_Materialize 4.17 ms 3.75 ms -10.0%
All 118 benchmarks
Benchmark main This branch Change
Metapack_Parse_OMC_JSON_V2 2.10 ns 2.10 ns +0.0%
Metapack_Read_OMC_JSON_V2 439.62 us 442.82 us +0.7%
Metapack_Write_OMC_JSON_V2 733.95 us 731.47 us -0.3%
Crypto_CRC32_Large_JSONL 47.03 us 47.13 us +0.2%
Crypto_AES_GCM_Encrypt_128_1KB 1.06 us 1.08 us +1.5%
Crypto_AES_GCM_Decrypt_128_1KB 1.06 us 1.07 us +0.9%
Crypto_AES_GCM_Encrypt_256_1KB 1.09 us 1.11 us +1.9%
JOSE_VerifySignature_RS256 21.18 us 21.16 us -0.1%
JOSE_VerifySignature_ES512 542.12 us 542.32 us +0.0%
GZIP_Compress_ISO_Language_Set_3_Locations 31.30 ms 31.25 ms -0.2%
GZIP_Decompress_ISO_Language_Set_3_Locations 5.11 ms 5.11 ms +0.1%
GZIP_Decompress_Default_Level_ISO_Language_Set_3_Locations 6.81 ms 6.73 ms -1.1%
GZIP_Decompress_Stream_Default_Level_ISO_Language_Set_3_Locations 11.09 ms 10.88 ms -1.9%
GZIP_Compress_ISO_Language_Set_3_Schema 2.15 ms 2.15 ms +0.1%
GZIP_Decompress_ISO_Language_Set_3_Schema 398.06 us 399.80 us +0.4%
Markdown_To_HTML_Realistic_Document 5.01 ms 5.13 ms +2.3%
Markdown_To_HTML_Pathological 16.44 ms 16.85 ms +2.5%
Markdown_To_HTML_Short_Descriptions 581.32 ns 577.91 ns -0.6%
HTML_Build_Table_100000 47.57 ms 46.70 ms -1.8%
HTML_Render_Table_100000 3.67 ms 3.75 ms +2.4%
JSONLD_Catalog_Annotation_List_Populate 755.17 us 740.66 us -1.9%
JSONLD_Catalog_Materialize 4.17 ms 3.75 ms -10.0%
JSONL_Parse_Large 10.23 ms 10.24 ms +0.1%
JSONL_Parse_Large_GZIP 10.44 ms 10.44 ms +0.1%
URITemplateRouter_Create 19.12 us 19.08 us -0.2%
URITemplateRouter_Match 144.34 ns 144.96 ns +0.4%
URITemplateRouterView_Restore 3.69 us 3.66 us -0.8%
URITemplateRouterView_Match 128.23 ns 128.45 ns +0.2%
URITemplateRouterView_Arguments 533.16 ns 542.83 ns +1.8%
URITemplateRouter_Match_BasePath 160.63 ns 161.38 ns +0.5%
URITemplateRouterView_Match_BasePath 144.76 ns 144.71 ns -0.0%
JSONPath_Descendant_Filter_Nested 1.97 us 1.93 us -1.9%
OpenAPI_Frame_GSMTasks_3_0 147.14 ms 151.80 ms +3.2%
OpenAPI_Format_Synthetic_3_1 50.57 ms 54.97 ms +8.7%
Schema_Frame_WoT_References 2.12 ms 2.24 ms +5.9%
Schema_Frame_OMC_References 9.60 ms 12.01 ms +25.1%
Schema_Frame_OMC_Pointers 17.78 ms 20.63 ms +16.0%
Schema_Frame_OMC_Locations 8.40 ms 10.69 ms +27.2%
Schema_Frame_ISO_Language_Locations 42.20 ms 49.00 ms +16.1%
Schema_Frame_ISO_Language_Root 327.83 ns 330.19 ns +0.7%
Schema_Frame_KrakenD_References 15.81 ms 19.62 ms +24.1%
Schema_Frame_KrakenD_Reachable 133.09 ms 141.94 ms +6.6%
Schema_Frame_ISO_Language_Locations_To_JSON 35.69 ms 38.78 ms +8.7%
Schema_Frame_Many_Resources_References 120.64 ms 130.74 ms +8.4%
Schema_Frame_Deeply_Nested_References 11.21 ms 13.16 ms +17.4%
Schema_Format_ISO_Language 47.57 ms 50.75 ms +6.7%
Schema_Bundle_Meta_2020_12 611.39 us 624.10 us +2.1%
Schema_Bundle_Many_Remotes_With_Fragments 6.29 ms 6.49 ms +3.1%
Pointer_Object_Traverse 25.96 ns 26.08 ns +0.5%
Pointer_Object_Try_Traverse 28.85 ns 28.88 ns +0.1%
Pointer_Push_Back_Pointer_To_Weak_Pointer 167.95 ns 178.97 ns +6.6%
Pointer_Walker_Schema_ISO_Language 1.87 ms 1.87 ms +0.0%
Pointer_Untracked_Deeply_Nested 1.35 ms 1.35 ms +0.1%
Pointer_Tracked_Deeply_Nested 2.28 ms 2.31 ms +0.9%
Pointer_Position_Tracker_Get_Deeply_Nested 623.16 ns 624.83 ns +0.3%
Schema_Tracker_ISO_Language 5.13 ms 5.43 ms +5.9%
Schema_Tracker_ISO_Language_To_JSON 16.20 ms 17.63 ms +8.9%
JSON_Array_Of_Objects_Unique 425.52 ns 428.57 ns +0.7%
JSON_Array_Of_Integers_Unique_256 4.64 us 4.69 us +1.1%
JSON_Array_Of_Strings_Unique_Colliding_256 192.12 us 192.28 us +0.1%
JSON_Parse_1 5.09 us 5.07 us -0.3%
JSON_Parse_Real 4.85 us 4.88 us +0.5%
JSON_Parse_Real_Inexact 4.58 us 4.49 us -2.1%
JSON_Parse_Decimal 7.95 us 7.87 us -1.0%
JSON_Parse_Schema_ISO_Language 3.56 ms 3.62 ms +1.6%
JSON_Parse_KrakenD 1.59 ms 1.61 ms +0.8%
JSON_Stringify_ISO_Language 2.36 ms 2.36 ms -0.1%
JSON_Prettify_KrakenD 1.88 ms 1.87 ms -0.6%
JSON_Parse_Integer 3.90 us 3.93 us +1.0%
JSON_Parse_String_NonSSO_Plain 3.73 us 3.74 us +0.2%
JSON_Parse_String_SSO_Plain 2.88 us 2.88 us +0.2%
JSON_Parse_String_Escape_Heavy 16.01 us 16.06 us +0.3%
JSON_Parse_Object_Short_Keys 9.01 us 9.01 us -0.1%
JSON_Parse_Object_Scalar_Properties 4.64 us 4.63 us -0.1%
JSON_Parse_Object_Array_Properties 5.97 us 6.04 us +1.2%
JSON_Parse_Object_Object_Properties 5.90 us 5.95 us +0.7%
JSON_Parse_Nested_Containers 37.19 us 37.34 us +0.4%
JSON_Fast_Hash_Helm_Chart_Lock 58.51 ns 58.43 ns -0.1%
JSON_Equality_Helm_Chart_Lock 170.14 ns 170.01 ns -0.1%
JSON_String_Equal_10 5.29 ns 5.29 ns -0.0%
JSON_String_Equal_100 6.45 ns 6.45 ns -0.0%
JSON_String_Equal_Small_By_Perfect_Hash_10 0.82 ns 0.83 ns +0.1%
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 9.50 ns 9.51 ns +0.1%
JSON_String_Fast_Hash_10 2.73 ns 2.73 ns -0.0%
JSON_String_Fast_Hash_100 2.73 ns 2.74 ns +0.3%
JSON_String_Key_Hash_10 2.70 ns 2.70 ns -0.0%
JSON_String_Key_Hash_100 12.97 ns 12.97 ns +0.0%
JSON_Object_Defines_Miss_Same_Length 2.93 ns 2.92 ns -0.3%
JSON_Object_Defines_Miss_Too_Small 3.39 ns 3.39 ns +0.3%
JSON_Object_Defines_Miss_Too_Large 3.93 ns 3.97 ns +1.0%
JSON_From_String_Copy 8.12 ns 8.13 ns +0.2%
JSON_From_String_Temporary 7.57 ns 7.59 ns +0.2%
JSON_Number_To_Double 20.22 ns 20.22 ns +0.0%
JSON_Object_At_Last_Key_8 4.87 ns 4.89 ns +0.4%
JSON_Object_At_Last_Key_32 18.43 ns 18.43 ns -0.0%
JSON_Object_At_Last_Key_128 73.45 ns 73.48 ns +0.0%
JSON_Object_At_Last_Key_512 299.93 ns 299.98 ns +0.0%
JSON_Divisible_By_Decimal 341.80 ns 335.62 ns -1.8%
JSON_PropertySet_Contains 45.63 ns 45.73 ns +0.2%
JSON_PropertySet_Filter_Object_Properties 36.57 ns 36.24 ns -0.9%
JSON_PropertySet_Insert 416.03 ns 414.85 ns -0.3%
JSON_Stringify_Schema_Web_Of_Things 52.28 us 52.33 us +0.1%
JSON_Prettify_Schema_Web_Of_Things 151.01 us 151.48 us +0.3%
Regex_Lower_S_Or_Upper_S_Asterisk 2.20 ns 2.21 ns +0.3%
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar 2.30 ns 2.30 ns +0.0%
Regex_Period_Asterisk 2.15 ns 2.15 ns -0.1%
Regex_Group_Period_Asterisk_Group 2.14 ns 2.15 ns +0.1%
Regex_Period_Plus 2.20 ns 2.20 ns +0.0%
Regex_Period 2.30 ns 2.30 ns +0.0%
Regex_Caret_Period_Plus_Dollar 2.16 ns 2.15 ns -0.0%
Regex_Caret_Group_Period_Plus_Group_Dollar 2.13 ns 2.14 ns +0.2%
Regex_Caret_Period_Asterisk_Dollar 2.28 ns 2.29 ns +0.4%
Regex_Caret_Group_Period_Asterisk_Group_Dollar 2.30 ns 2.30 ns -0.0%
Regex_Caret_X_Hyphen 5.31 ns 5.31 ns +0.0%
Regex_Period_Md_Dollar 23.51 ns 23.38 ns -0.6%
Regex_Caret_Slash_Period_Asterisk 5.37 ns 5.38 ns +0.2%
Regex_Caret_Period_Range_Dollar 2.89 ns 2.89 ns +0.0%
Regex_Nested_Backtrack 37.09 ns 37.09 ns +0.0%

@github-actions

Copy link
Copy Markdown

Benchmark macos/llvm

Measured against main at 2aa17a8.

31 slower, 31 faster, 56 within 5%.

Benchmark main This branch Change
Schema_Frame_Deeply_Nested_References 12.16 ms 15.29 ms +25.8%
JSON_Parse_KrakenD 811.26 us 958.34 us +18.1%
JSONPath_Descendant_Filter_Nested 1.33 us 1.54 us +15.3%
JSON_Array_Of_Strings_Unique_Colliding_256 152.03 us 174.17 us +14.6%
JSONL_Parse_Large 6.14 ms 6.99 ms +13.9%
JSON_String_Equal_100 6.25 ns 7.07 ns +13.2%
Schema_Frame_OMC_References 8.13 ms 9.16 ms +12.6%
JSON_Parse_Schema_ISO_Language 2.20 ms 2.47 ms +12.3%
Schema_Frame_OMC_Locations 6.90 ms 7.75 ms +12.2%
Pointer_Untracked_Deeply_Nested 826.93 us 922.74 us +11.6%
Schema_Frame_KrakenD_Reachable 163.54 ms 181.48 ms +11.0%
JSON_String_Equal_Small_By_Perfect_Hash_10 0.33 ns 0.36 ns +9.8%
Pointer_Tracked_Deeply_Nested 1.00 ms 1.10 ms +9.5%
Schema_Frame_KrakenD_References 13.21 ms 14.46 ms +9.5%
GZIP_Decompress_ISO_Language_Set_3_Locations 3.07 ms 3.34 ms +8.7%
Pointer_Walker_Schema_ISO_Language 1.28 ms 1.39 ms +8.7%
Schema_Format_ISO_Language 25.76 ms 28.00 ms +8.7%
Schema_Frame_WoT_References 1.70 ms 1.84 ms +8.4%
Schema_Frame_OMC_Pointers 15.40 ms 16.68 ms +8.3%
Schema_Frame_Many_Resources_References 82.87 ms 89.70 ms +8.2%
JSON_Array_Of_Integers_Unique_256 4.70 us 5.07 us +7.9%
Pointer_Position_Tracker_Get_Deeply_Nested 328.32 ns 353.07 ns +7.5%
Schema_Bundle_Meta_2020_12 450.65 us 483.96 us +7.4%
JSONLD_Catalog_Materialize 2.36 ms 2.52 ms +6.8%
JSONLD_Catalog_Annotation_List_Populate 490.77 us 520.64 us +6.1%
Schema_Bundle_Many_Remotes_With_Fragments 5.25 ms 5.57 ms +6.0%
Schema_Tracker_ISO_Language 2.75 ms 2.91 ms +6.0%
JSON_Stringify_ISO_Language 2.30 ms 2.43 ms +5.6%
Schema_Tracker_ISO_Language_To_JSON 10.64 ms 11.23 ms +5.6%
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 3.08 ns 3.25 ns +5.5%
JSON_Parse_Decimal 5.15 us 5.44 us +5.5%
Markdown_To_HTML_Short_Descriptions 349.13 ns 331.51 ns -5.0%
URITemplateRouter_Create 19.50 us 18.45 us -5.4%
JOSE_VerifySignature_RS256 22.16 us 20.94 us -5.5%
GZIP_Decompress_ISO_Language_Set_3_Schema 306.03 us 287.95 us -5.9%
JSON_Divisible_By_Decimal 235.69 ns 221.06 ns -6.2%
GZIP_Decompress_Stream_Default_Level_ISO_Language_Set_3_Locations 5.50 ms 5.13 ms -6.7%
URITemplateRouter_Match 182.39 ns 170.04 ns -6.8%
Crypto_AES_GCM_Encrypt_128_1KB 3.55 us 3.31 us -6.9%
JSON_Object_Defines_Miss_Too_Large 2.92 ns 2.71 ns -7.1%
JSON_Parse_Object_Array_Properties 3.51 us 3.25 us -7.2%
Regex_Caret_Group_Period_Asterisk_Group_Dollar 1.98 ns 1.82 ns -8.1%
JSON_PropertySet_Insert 325.25 ns 298.55 ns -8.2%
Markdown_To_HTML_Pathological 10.78 ms 9.87 ms -8.5%
JSON_Parse_Object_Object_Properties 3.49 us 3.19 us -8.7%
JSON_Parse_Object_Short_Keys 5.58 us 5.08 us -9.0%
JSON_Parse_String_Escape_Heavy 18.26 us 16.38 us -10.3%
Regex_Caret_Period_Plus_Dollar 2.00 ns 1.79 ns -10.5%
Regex_Caret_Slash_Period_Asterisk 5.15 ns 4.59 ns -10.8%
JSON_Equality_Helm_Chart_Lock 176.01 ns 156.71 ns -11.0%
Schema_Frame_ISO_Language_Locations 25.74 ms 22.79 ms -11.5%
Regex_Period_Plus 1.91 ns 1.69 ns -11.5%
Regex_Lower_S_Or_Upper_S_Asterisk 2.06 ns 1.82 ns -12.0%
Metapack_Read_OMC_JSON_V2 293.00 us 252.99 us -13.7%
Metapack_Write_OMC_JSON_V2 671.80 us 569.62 us -15.2%
Regex_Caret_X_Hyphen 7.56 ns 6.23 ns -17.6%
Regex_Group_Period_Asterisk_Group 2.08 ns 1.69 ns -18.7%
Regex_Period 2.13 ns 1.72 ns -19.5%
JSON_Prettify_Schema_Web_Of_Things 195.62 us 151.98 us -22.3%
Regex_Period_Asterisk 2.25 ns 1.71 ns -24.0%
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar 2.27 ns 1.70 ns -24.9%
JSON_Stringify_Schema_Web_Of_Things 80.15 us 60.07 us -25.1%
All 118 benchmarks
Benchmark main This branch Change
Regex_Lower_S_Or_Upper_S_Asterisk 2.06 ns 1.82 ns -12.0%
Regex_Caret_Lower_S_Or_Upper_S_Asterisk_Dollar 2.27 ns 1.70 ns -24.9%
Regex_Period_Asterisk 2.25 ns 1.71 ns -24.0%
Regex_Group_Period_Asterisk_Group 2.08 ns 1.69 ns -18.7%
Regex_Period_Plus 1.91 ns 1.69 ns -11.5%
Regex_Period 2.13 ns 1.72 ns -19.5%
Regex_Caret_Period_Plus_Dollar 2.00 ns 1.79 ns -10.5%
Regex_Caret_Group_Period_Plus_Group_Dollar 1.95 ns 1.91 ns -1.9%
Regex_Caret_Period_Asterisk_Dollar 1.93 ns 1.85 ns -3.9%
Regex_Caret_Group_Period_Asterisk_Group_Dollar 1.98 ns 1.82 ns -8.1%
Regex_Caret_X_Hyphen 7.56 ns 6.23 ns -17.6%
Regex_Period_Md_Dollar 19.07 ns 18.32 ns -3.9%
Regex_Caret_Slash_Period_Asterisk 5.15 ns 4.59 ns -10.8%
Regex_Caret_Period_Range_Dollar 2.04 ns 2.09 ns +2.5%
Regex_Nested_Backtrack 27.93 ns 28.66 ns +2.6%
JSON_Array_Of_Objects_Unique 365.25 ns 370.65 ns +1.5%
JSON_Array_Of_Integers_Unique_256 4.70 us 5.07 us +7.9%
JSON_Array_Of_Strings_Unique_Colliding_256 152.03 us 174.17 us +14.6%
JSON_Parse_1 3.16 us 3.04 us -4.0%
JSON_Parse_Real 3.11 us 3.14 us +1.2%
JSON_Parse_Real_Inexact 3.11 us 3.27 us +5.0%
JSON_Parse_Decimal 5.15 us 5.44 us +5.5%
JSON_Parse_Schema_ISO_Language 2.20 ms 2.47 ms +12.3%
JSON_Parse_KrakenD 811.26 us 958.34 us +18.1%
JSON_Stringify_ISO_Language 2.30 ms 2.43 ms +5.6%
JSON_Prettify_KrakenD 1.76 ms 1.74 ms -1.2%
JSON_Parse_Integer 2.61 us 2.70 us +3.3%
JSON_Parse_String_NonSSO_Plain 3.12 us 3.11 us -0.1%
JSON_Parse_String_SSO_Plain 1.81 us 1.78 us -2.0%
JSON_Parse_String_Escape_Heavy 18.26 us 16.38 us -10.3%
JSON_Parse_Object_Short_Keys 5.58 us 5.08 us -9.0%
JSON_Parse_Object_Scalar_Properties 2.67 us 2.58 us -3.1%
JSON_Parse_Object_Array_Properties 3.51 us 3.25 us -7.2%
JSON_Parse_Object_Object_Properties 3.49 us 3.19 us -8.7%
JSON_Parse_Nested_Containers 23.56 us 22.60 us -4.1%
JSON_Fast_Hash_Helm_Chart_Lock 52.02 ns 50.59 ns -2.7%
JSON_Equality_Helm_Chart_Lock 176.01 ns 156.71 ns -11.0%
JSON_String_Equal_10 7.00 ns 6.94 ns -0.8%
JSON_String_Equal_100 6.25 ns 7.07 ns +13.2%
JSON_String_Equal_Small_By_Perfect_Hash_10 0.33 ns 0.36 ns +9.8%
JSON_String_Equal_Small_By_Runtime_Perfect_Hash_10 3.08 ns 3.25 ns +5.5%
JSON_String_Fast_Hash_10 1.96 ns 2.04 ns +4.2%
JSON_String_Fast_Hash_100 1.63 ns 1.69 ns +4.1%
JSON_String_Key_Hash_10 1.76 ns 1.70 ns -3.4%
JSON_String_Key_Hash_100 2.14 ns 2.05 ns -4.0%
JSON_Object_Defines_Miss_Same_Length 2.84 ns 2.71 ns -4.5%
JSON_Object_Defines_Miss_Too_Small 2.85 ns 2.72 ns -4.6%
JSON_Object_Defines_Miss_Too_Large 2.92 ns 2.71 ns -7.1%
JSON_From_String_Copy 10.68 ns 10.25 ns -4.1%
JSON_From_String_Temporary 5.93 ns 6.13 ns +3.3%
JSON_Number_To_Double 9.90 ns 9.56 ns -3.5%
JSON_Object_At_Last_Key_8 4.31 ns 4.36 ns +1.1%
JSON_Object_At_Last_Key_32 13.02 ns 12.55 ns -3.6%
JSON_Object_At_Last_Key_128 58.68 ns 55.89 ns -4.8%
JSON_Object_At_Last_Key_512 188.64 ns 188.58 ns -0.0%
JSON_Divisible_By_Decimal 235.69 ns 221.06 ns -6.2%
JSON_PropertySet_Contains 46.86 ns 45.08 ns -3.8%
JSON_PropertySet_Filter_Object_Properties 39.21 ns 37.35 ns -4.8%
JSON_PropertySet_Insert 325.25 ns 298.55 ns -8.2%
JSON_Stringify_Schema_Web_Of_Things 80.15 us 60.07 us -25.1%
JSON_Prettify_Schema_Web_Of_Things 195.62 us 151.98 us -22.3%
Pointer_Object_Traverse 20.02 ns 19.82 ns -1.0%
Pointer_Object_Try_Traverse 32.60 ns 34.14 ns +4.7%
Pointer_Push_Back_Pointer_To_Weak_Pointer 139.49 ns 142.75 ns +2.3%
Pointer_Walker_Schema_ISO_Language 1.28 ms 1.39 ms +8.7%
Pointer_Untracked_Deeply_Nested 826.93 us 922.74 us +11.6%
Pointer_Tracked_Deeply_Nested 1.00 ms 1.10 ms +9.5%
Pointer_Position_Tracker_Get_Deeply_Nested 328.32 ns 353.07 ns +7.5%
Schema_Tracker_ISO_Language 2.75 ms 2.91 ms +6.0%
Schema_Tracker_ISO_Language_To_JSON 10.64 ms 11.23 ms +5.6%
Schema_Frame_WoT_References 1.70 ms 1.84 ms +8.4%
Schema_Frame_OMC_References 8.13 ms 9.16 ms +12.6%
Schema_Frame_OMC_Pointers 15.40 ms 16.68 ms +8.3%
Schema_Frame_OMC_Locations 6.90 ms 7.75 ms +12.2%
Schema_Frame_ISO_Language_Locations 25.74 ms 22.79 ms -11.5%
Schema_Frame_ISO_Language_Root 118.28 ns 123.86 ns +4.7%
Schema_Frame_KrakenD_References 13.21 ms 14.46 ms +9.5%
Schema_Frame_KrakenD_Reachable 163.54 ms 181.48 ms +11.0%
Schema_Frame_ISO_Language_Locations_To_JSON 22.27 ms 22.41 ms +0.6%
Schema_Frame_Many_Resources_References 82.87 ms 89.70 ms +8.2%
Schema_Frame_Deeply_Nested_References 12.16 ms 15.29 ms +25.8%
Schema_Format_ISO_Language 25.76 ms 28.00 ms +8.7%
Schema_Bundle_Meta_2020_12 450.65 us 483.96 us +7.4%
Schema_Bundle_Many_Remotes_With_Fragments 5.25 ms 5.57 ms +6.0%
OpenAPI_Frame_GSMTasks_3_0 136.47 ms 137.58 ms +0.8%
OpenAPI_Format_Synthetic_3_1 39.92 ms 41.07 ms +2.9%
JSONPath_Descendant_Filter_Nested 1.33 us 1.54 us +15.3%
URITemplateRouter_Create 19.50 us 18.45 us -5.4%
URITemplateRouter_Match 182.39 ns 170.04 ns -6.8%
URITemplateRouterView_Restore 10.25 us 10.14 us -1.1%
URITemplateRouterView_Match 128.89 ns 130.11 ns +0.9%
URITemplateRouterView_Arguments 552.82 ns 558.84 ns +1.1%
URITemplateRouter_Match_BasePath 200.52 ns 202.38 ns +0.9%
URITemplateRouterView_Match_BasePath 148.81 ns 149.00 ns +0.1%
JSONL_Parse_Large 6.14 ms 6.99 ms +13.9%
JSONL_Parse_Large_GZIP 6.25 ms 6.31 ms +0.8%
JSONLD_Catalog_Annotation_List_Populate 490.77 us 520.64 us +6.1%
JSONLD_Catalog_Materialize 2.36 ms 2.52 ms +6.8%
HTML_Build_Table_100000 26.17 ms 26.07 ms -0.4%
HTML_Render_Table_100000 1.71 ms 1.63 ms -4.7%
Markdown_To_HTML_Realistic_Document 2.97 ms 3.11 ms +4.6%
Markdown_To_HTML_Pathological 10.78 ms 9.87 ms -8.5%
Markdown_To_HTML_Short_Descriptions 349.13 ns 331.51 ns -5.0%
GZIP_Compress_ISO_Language_Set_3_Locations 29.55 ms 29.58 ms +0.1%
GZIP_Decompress_ISO_Language_Set_3_Locations 3.07 ms 3.34 ms +8.7%
GZIP_Decompress_Default_Level_ISO_Language_Set_3_Locations 4.49 ms 4.64 ms +3.3%
GZIP_Decompress_Stream_Default_Level_ISO_Language_Set_3_Locations 5.50 ms 5.13 ms -6.7%
GZIP_Compress_ISO_Language_Set_3_Schema 1.74 ms 1.81 ms +3.9%
GZIP_Decompress_ISO_Language_Set_3_Schema 306.03 us 287.95 us -5.9%
JOSE_VerifySignature_RS256 22.16 us 20.94 us -5.5%
JOSE_VerifySignature_ES512 975.67 us 982.79 us +0.7%
Crypto_CRC32_Large_JSONL 20.64 us 19.94 us -3.4%
Crypto_AES_GCM_Encrypt_128_1KB 3.55 us 3.31 us -6.9%
Crypto_AES_GCM_Decrypt_128_1KB 3.64 us 3.51 us -3.5%
Crypto_AES_GCM_Encrypt_256_1KB 3.54 us 3.40 us -3.9%
Metapack_Parse_OMC_JSON_V2 1.31 ns 1.28 ns -2.7%
Metapack_Read_OMC_JSON_V2 293.00 us 252.99 us -13.7%
Metapack_Write_OMC_JSON_V2 671.80 us 569.62 us -15.2%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant