[WIP] Add several tests for edge cases on the compiler/evaluator

[jviotti]

No description provided.

[augmentcode]

🤖 Augment PR Summary

Summary: This PR fixes a fast-validation bug affecting LogicalCondition when targets are inlined and annotation whitelists are enabled.

Changes:

• Refactors schema-location rebasing into rebase_anchored and adds is_pass_through_instruction to correctly rebase only instructions whose schema locations are effectively anchored at the splice point.
• Updates postprocessing traversal to track each rewritten instruction list’s owning instruction, enabling safe remapping of LogicalCondition child cursors after instructions are dropped/expanded.
• Adds regression coverage across evaluator JSON suites (draft7/2019-09/2020-12) for if/then/else with inlined shared $ref targets.
• Adds C++ regression tests for fast mode + annotation whitelist behavior on both then and else branches.

Technical Notes: The fix ensures conditional consequence/alternative children (and pass-through children) keep correct schema anchoring after inlining, and that conditional boundary cursors remain consistent after fusion/inlining transformations.

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: 909f499	Previous: 2e64038	Ratio
Schema_Iterator_ISO_Language	3531557.6550391945 ns/iter	1928940.3078884427 ns/iter	1.83
Schema_Tracker_ISO_Language	4896459.795775268 ns/iter	2773979.7896996094 ns/iter	1.77
Schema_Tracker_ISO_Language_To_JSON	25577443.181818485 ns/iter	14797708.333333047 ns/iter	1.73
Schema_Frame_WoT_References	6763109.649124058 ns/iter	4112142.4670648426 ns/iter	1.64
Schema_Frame_OMC_References	28982890.13636589 ns/iter	18587566.4594548 ns/iter	1.56
Schema_Frame_OMC_Locations	27899491.07143132 ns/iter	18122390.243899822 ns/iter	1.54
Schema_Frame_ISO_Language_Locations	176769339.28571868 ns/iter	69382263.88888325 ns/iter	2.55
Schema_Frame_KrakenD_References	58438326.416667975 ns/iter	35490497.89999117 ns/iter	1.65
Schema_Frame_KrakenD_Reachable	747879375.0001386 ns/iter	305133979.50005585 ns/iter	2.45
Schema_Frame_ISO_Language_Locations_To_JSON	140379666.59998348 ns/iter	71815828.77776943 ns/iter	1.95
Schema_Frame_Many_Resources_References	639058541.9999298 ns/iter	246349555.66671124 ns/iter	2.59
Schema_Bundle_Meta_2020_12	2010702.633092053 ns/iter	1137295.7499995858 ns/iter	1.77
Schema_Format_ISO_Language_To_JSON	132104541.59998336 ns/iter	69649666.89997709 ns/iter	1.90
E2E_Compiler_adaptivecard	79838192.62500447 ns/iter	45988191.66667453 ns/iter	1.74
E2E_Compiler_ansible_meta	40961649.10526425 ns/iter	20987367.424244106 ns/iter	1.95
E2E_Compiler_aws_cdk	444792.5392670372 ns/iter	237101.96810311303 ns/iter	1.88
E2E_Compiler_babelrc	3105488.6694562114 ns/iter	1818809.6337662619 ns/iter	1.71
E2E_Compiler_clang_format	23182147.32142516 ns/iter	14030926.020407662 ns/iter	1.65
E2E_Compiler_cmake_presets	41768606.49999981 ns/iter	21765748.727272116 ns/iter	1.92
E2E_Compiler_code_climate	3238731.3319995883 ns/iter	1882247.072972933 ns/iter	1.72
E2E_Compiler_cql2	15754488.217389142 ns/iter	9921437.500000658 ns/iter	1.59
E2E_Compiler_cspell	28361122.03571669 ns/iter	17749604.692303717 ns/iter	1.60
E2E_Compiler_cypress	4830865.663793388 ns/iter	3077140.784141157 ns/iter	1.57
E2E_Compiler_deno	9011537.13043542 ns/iter	5693099.934959963 ns/iter	1.58
E2E_Compiler_dependabot	3708708.104395955 ns/iter	3001005.0085836304 ns/iter	1.24
E2E_Compiler_draft_04	2455300.8620692897 ns/iter	1770754.3022671216 ns/iter	1.39
E2E_Compiler_fabric_mod	4372716.204724434 ns/iter	3183237.5000001118 ns/iter	1.37
E2E_Compiler_geojson	28363237.903220344 ns/iter	17563419.800001156 ns/iter	1.61
E2E_Compiler_gitpod_configuration	4049933.035713052 ns/iter	3658446.0197047135 ns/iter	1.11
E2E_Compiler_helm_chart_lock	649414.6451090936 ns/iter	439710.00753297965 ns/iter	1.48
E2E_Compiler_importmap	223189.48659650577 ns/iter	180212.45936213122 ns/iter	1.24
E2E_Compiler_jasmine	1305715.6399998767 ns/iter	894482.7365726468 ns/iter	1.46
E2E_Compiler_jshintrc	4176055.6358385026 ns/iter	2864625.167347519 ns/iter	1.46
E2E_Compiler_jsconfig	18787284.722217616 ns/iter	16087891.11363442 ns/iter	1.17
E2E_Compiler_krakend	143398697.9999986 ns/iter	110927319.50001658 ns/iter	1.29
E2E_Compiler_lazygit	37189659.090906635 ns/iter	27226576.923077606 ns/iter	1.37
E2E_Compiler_lerna	1407180.106061039 ns/iter	1108731.5687202185 ns/iter	1.27
E2E_Compiler_nest_cli	6839231.3647055905 ns/iter	5401432.170542683 ns/iter	1.27
E2E_Compiler_omc	233729333.33333397 ns/iter	133269983.39998682 ns/iter	1.75
E2E_Compiler_omnisharp	6896272.340205523 ns/iter	5094557.065216827 ns/iter	1.35
E2E_Compiler_openapi	34710109.37500788 ns/iter	20269853.594588827 ns/iter	1.71
E2E_Compiler_pre_commit_hooks	5583305.00000011 ns/iter	3689677.4157891115 ns/iter	1.51
E2E_Compiler_pulumi	4017084.1049387124 ns/iter	2756970.5217392263 ns/iter	1.46
E2E_Compiler_semantic_release	1742251.3992935307 ns/iter	1035861.0491072979 ns/iter	1.68
E2E_Compiler_stale	1520808.5076628567 ns/iter	1040909.8452380963 ns/iter	1.46
E2E_Compiler_stylecop	6845631.94736735 ns/iter	4572743.233765109 ns/iter	1.50
E2E_Compiler_tmuxinator	1805710.731414845 ns/iter	1308185.2886404858 ns/iter	1.38
E2E_Compiler_ui5	58325875.000001855 ns/iter	42525742.187507376 ns/iter	1.37
E2E_Compiler_ui5_manifest	416130062.49997395 ns/iter	260523194.66665116 ns/iter	1.60
E2E_Compiler_unreal_engine_uproject	4255298.491228275 ns/iter	3214373.6651378362 ns/iter	1.32
E2E_Compiler_users_array	835542.9364237111 ns/iter	614068.9579685279 ns/iter	1.36
E2E_Compiler_vercel	13297019.230767896 ns/iter	10420890.267606013 ns/iter	1.28
E2E_Compiler_yamllint	261270.7233698053 ns/iter	219413.24247176765 ns/iter	1.19
E2E_Evaluator_adaptivecard	20767.43001442962 ns/iter	17251.199911315132 ns/iter	1.20
E2E_Evaluator_ansible_meta	241782.2657908084 ns/iter	154846.80354767258 ns/iter	1.56
E2E_Evaluator_aws_cdk	44473.17957937473 ns/iter	33437.85649776762 ns/iter	1.33
E2E_Evaluator_babelrc	106536.72115919764 ns/iter	76584.7983184213 ns/iter	1.39
E2E_Evaluator_cerebrum_criminal_case	797470.0552018579 ns/iter	635544.7212670253 ns/iter	1.25
E2E_Evaluator_clang_format	117884.8869589394 ns/iter	88416.49305729635 ns/iter	1.33
E2E_Evaluator_cmake_presets	4149557.7126439433 ns/iter	2918159.720833084 ns/iter	1.42
E2E_Evaluator_code_climate	136557.34954037584 ns/iter	116554.01098530681 ns/iter	1.17
E2E_Evaluator_cql2	174922.50455558544 ns/iter	131536.58281630848 ns/iter	1.33
E2E_Evaluator_cspell	510602.66699983 ns/iter	393714.78680804244 ns/iter	1.30
E2E_Evaluator_cypress	189857.19593049362 ns/iter	128203.2043661552 ns/iter	1.48
E2E_Evaluator_deno	285122.8882681515 ns/iter	215411.98591980428 ns/iter	1.32
E2E_Evaluator_dependabot	273424.23041112366 ns/iter	218242.75070032774 ns/iter	1.25
E2E_Evaluator_draft_04	6035688.218389624 ns/iter	4729553.209459924 ns/iter	1.28
E2E_Evaluator_fabric_mod	550715.7920001191 ns/iter	433943.10627715255 ns/iter	1.27
E2E_Evaluator_geojson	10975163.550000388 ns/iter	7994214.285715246 ns/iter	1.37
E2E_Evaluator_gitpod_configuration	187706.6852821102 ns/iter	155819.00244713027 ns/iter	1.20
E2E_Evaluator_helm_chart_lock	398331.1364763824 ns/iter	200889.1001722664 ns/iter	1.98
E2E_Evaluator_importmap	45344.90037150245 ns/iter	33912.81336072187 ns/iter	1.34
E2E_Evaluator_jasmine	107280.1231764546 ns/iter	79004.43562014395 ns/iter	1.36
E2E_Evaluator_jshintrc	1077721.7938458796 ns/iter	861963.7592136911 ns/iter	1.25
E2E_Evaluator_jsconfig	317368.03404473036 ns/iter	297320.21372029645 ns/iter	1.07
E2E_Evaluator_krakend	160878.55184441598 ns/iter	120553.97333797732 ns/iter	1.33
E2E_Evaluator_lazygit	133543.54856669414 ns/iter	86122.38201964227 ns/iter	1.55
E2E_Evaluator_lerna	157047.0640926872 ns/iter	110538.91289700283 ns/iter	1.42
E2E_Evaluator_nest_cli	135735.6068435896 ns/iter	120738.49603860381 ns/iter	1.12
E2E_Evaluator_omc	18395.9786917877 ns/iter	13715.927801386068 ns/iter	1.34
E2E_Evaluator_omnisharp	473548.18428581377 ns/iter	400378.80309991364 ns/iter	1.18
E2E_Evaluator_openapi	10728517.417911503 ns/iter	6882052.835051807 ns/iter	1.56
E2E_Evaluator_pre_commit_hooks	404801.6023719466 ns/iter	321285.8887872238 ns/iter	1.26
E2E_Evaluator_pulumi	702332.097607636 ns/iter	468755.8763369654 ns/iter	1.50
E2E_Evaluator_semantic_release	87522.16089848871 ns/iter	65422.396742185345 ns/iter	1.34
E2E_Evaluator_stale	144574.46145127024 ns/iter	108814.79035511836 ns/iter	1.33
E2E_Evaluator_stylecop	260691.06240983633 ns/iter	199588.8841446052 ns/iter	1.31
E2E_Evaluator_tmuxinator	90585.89943479816 ns/iter	62762.036681603924 ns/iter	1.44
E2E_Evaluator_ui5	517515.70289124467 ns/iter	325862.0341642939 ns/iter	1.59
E2E_Evaluator_ui5_manifest	1859831.4649860936 ns/iter	1422571.465163818 ns/iter	1.31
E2E_Evaluator_unreal_engine_uproject	410790.0819192404 ns/iter	321852.99162993755 ns/iter	1.28
E2E_Evaluator_users_array	468721.69440470776 ns/iter	383192.60199003306 ns/iter	1.22
E2E_Evaluator_vercel	221136.5825602609 ns/iter	211177.56836057734 ns/iter	1.05
E2E_Evaluator_yamllint	6982.510117711251 ns/iter	5886.741429343846 ns/iter	1.19
JSONLD_Catalog	18583538.1142819 ns/iter	16425884.674416984 ns/iter	1.13
Micro_Draft4_Meta_1_No_Callback	131.67094344790024 ns/iter	122.48740713193078 ns/iter	1.07
Micro_Draft4_Required_Properties	679.0684640704078 ns/iter	631.1863897314342 ns/iter	1.08
Micro_Draft4_Many_Optional_Properties_Minimal_Match	15.648727445268749 ns/iter	15.105401078057245 ns/iter	1.04
Micro_Draft4_Few_Optional_Properties_Minimal_Match	7.516483960304893 ns/iter	7.397140124088885 ns/iter	1.02
Micro_Draft4_Items_Schema	238.1114973193657 ns/iter	198.49271025923758 ns/iter	1.20
Micro_Draft4_Nested_Object	0.9447527366095528 ns/iter	0.9403676370346828 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	199.0342195846475 ns/iter	190.2837922643556 ns/iter	1.05
Micro_Draft4_Properties_Triad_Closed	170.42444895590847 ns/iter	164.69135350543147 ns/iter	1.03
Micro_Draft4_Properties_Triad_Required	258.563588722372 ns/iter	202.89254294570935 ns/iter	1.27
Micro_Draft4_Properties_Closed	59.67795122491983 ns/iter	38.217838156496704 ns/iter	1.56
Micro_Draft4_Non_Recursive_Ref	14.000438329199069 ns/iter	11.730640073595914 ns/iter	1.19
Micro_Draft4_Pattern_Properties_True	172.90566335892646 ns/iter	132.6541399004624 ns/iter	1.30
Micro_Draft4_Ref_To_Single_Property	8.729718572400008 ns/iter	7.368407932983402 ns/iter	1.18
Micro_Draft4_Additional_Properties_Type	26.742608280311572 ns/iter	24.453967945371 ns/iter	1.09
Micro_Draft4_Nested_Oneof	36.849317024681966 ns/iter	33.01162525288346 ns/iter	1.12
Micro_Draft4_Short_Enum	5.358739203656654 ns/iter	4.543831767502345 ns/iter	1.18
Micro_Draft4_Long_Enum	10.524757745654558 ns/iter	8.777302426619002 ns/iter	1.20
Micro_Draft4_Long_Enum_Short_Strings	7.186361017283782 ns/iter	6.082643446011741 ns/iter	1.18
Micro_Draft4_Type_Object	2.64379339602641 ns/iter	2.3004680644947513 ns/iter	1.15
Micro_Draft4_Ref_Single_100	2044671.8337725517 ns/iter	1632501.6758798652 ns/iter	1.25
Micro_Draft4_Compile_Ref_Many_Nested	1294646.5930655282 ns/iter	1153171.9620460393 ns/iter	1.12
Micro_Draft4_Compile_Wrap	2062267.9093566153 ns/iter	1807116.731958896 ns/iter	1.14
Micro_Draft6_Property_Names	92.95512900019146 ns/iter	89.19266311775331 ns/iter	1.04
Micro_Draft6_Compile_FHIR	15208241625.000029 ns/iter	8903069582.999933 ns/iter	1.71
Micro_Draft7_If_Then_Else	16.859018283174045 ns/iter	15.973432046479603 ns/iter	1.06
Micro_2019_09_Unevaluated_Properties	26.23179485313778 ns/iter	25.06687555587346 ns/iter	1.05
Micro_2019_09_Compile_Wrap	287579999.99993443 ns/iter	258327903.0000085 ns/iter	1.11
Micro_2020_12_Dynamic_Ref	593.5703574196 ns/iter	551.9725055102433 ns/iter	1.08
Micro_2020_12_Dynamic_Ref_Single	2.5058885438289047 ns/iter	2.2379273938647812 ns/iter	1.12
Micro_2020_12_Simple_Output_Mask	807.495853091771 ns/iter	750.020389712628 ns/iter	1.08
Micro_2020_12_Simple_Output_Annotations	57415.560022744634 ns/iter	54850.181775358236 ns/iter	1.05
Micro_2020_12_Simple_Output_Annotation_Dropping	1685644.0251141153 ns/iter	1410922.3574296557 ns/iter	1.19
Micro_2020_12_Compile_NonCircular_Shared_Refs	783046.5360094544 ns/iter	718723.2657055064 ns/iter	1.09
Micro_2020_12_Exhaustive_Deep_Numeric	4834.41594138693 ns/iter	4801.900412493774 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	34325.14627945443 ns/iter	32705.6132814326 ns/iter	1.05
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	14546.637879133697 ns/iter	13218.714301857653 ns/iter	1.10
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	84.42917657662414 ns/iter	80.43105383458678 ns/iter	1.05
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	3231.742026183794 ns/iter	3051.9120465878423 ns/iter	1.06
Alterschema_Check_Readibility_ISO_Language_Set_3	224477444.66671792 ns/iter	200761972.00000933 ns/iter	1.12
Alterschema_Check_Readibility_OMC	60575386.36363543 ns/iter	56749201.92306952 ns/iter	1.07
Alterschema_Check_Readibility_KrakenD	669827500.0001104 ns/iter	600320208.0000846 ns/iter	1.12
Alterschema_Apply_Readibility_KrakenD	88626101124.00012 ns/iter	63883028749.99999 ns/iter	1.39
Alterschema_Check_Invalid_External_Refs	157541395.99999917 ns/iter	163165437.50002664 ns/iter	0.97

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: 909f499	Previous: 2e64038	Ratio
E2E_Evaluator_adaptivecard	131235 ns	91828 ns	1.43
E2E_Evaluator_ansible-meta	419663 ns	325062 ns	1.29
E2E_Evaluator_aws-cdk	141472 ns	109435 ns	1.29
E2E_Evaluator_babelrc	261689 ns	246887 ns	1.06
E2E_Evaluator_cerebrum-criminal-case	1652166 ns	1481200 ns	1.12
E2E_Evaluator_clang-format	207860 ns	151025 ns	1.38
E2E_Evaluator_cmake-presets	13409044 ns	10259821 ns	1.31
E2E_Evaluator_code-climate	385228 ns	317670 ns	1.21
E2E_Evaluator_cql2	1066634 ns	844138 ns	1.26
E2E_Evaluator_cspell	1239510 ns	914450 ns	1.36
E2E_Evaluator_cypress	586426 ns	493359 ns	1.19
E2E_Evaluator_deno	804784 ns	655970 ns	1.23
E2E_Evaluator_dependabot	841255 ns	684243 ns	1.23
E2E_Evaluator_draft-04	18473857 ns	13957259 ns	1.32
E2E_Evaluator_fabric-mod	1717255 ns	1331638 ns	1.29
E2E_Evaluator_geojson	21121968 ns	14469546 ns	1.46
E2E_Evaluator_gitpod-configuration	590243 ns	450004 ns	1.31
E2E_Evaluator_helm-chart-lock	975623 ns	781948 ns	1.25
E2E_Evaluator_importmap	262930 ns	204233 ns	1.29
E2E_Evaluator_jasmine	243337 ns	195990 ns	1.24
E2E_Evaluator_jsconfig	1062904 ns	785281 ns	1.35
E2E_Evaluator_jshintrc	2327908 ns	1837353 ns	1.27
E2E_Evaluator_krakend	536390 ns	394542 ns	1.36
E2E_Evaluator_lazygit	495696 ns	256304 ns	1.93
E2E_Evaluator_lerna	362029 ns	297469 ns	1.22
E2E_Evaluator_nest-cli	454570 ns	398037 ns	1.14
E2E_Evaluator_omc	94734 ns	84548 ns	1.12
E2E_Evaluator_omnisharp	995190 ns	912065 ns	1.09
E2E_Evaluator_openapi	28426074 ns	23718142 ns	1.20
E2E_Evaluator_pre-commit-hooks	1528676 ns	1210366 ns	1.26
E2E_Evaluator_pulumi	1580648 ns	1275926 ns	1.24
E2E_Evaluator_semantic-release	194110 ns	165154 ns	1.18
E2E_Evaluator_stale	322980 ns	275184 ns	1.17
E2E_Evaluator_stylecop	731203 ns	655224 ns	1.12
E2E_Evaluator_tmuxinator	178114 ns	149336 ns	1.19
E2E_Evaluator_ui5	2193961 ns	1409867 ns	1.56
E2E_Evaluator_ui5-manifest	13057806 ns	7062286 ns	1.85
E2E_Evaluator_unreal-engine-uproject	1349642 ns	1062252 ns	1.27
E2E_Evaluator_users-array	3161752 ns	2025013 ns	1.56
E2E_Evaluator_vercel	917479 ns	673154 ns	1.36
E2E_Evaluator_yamllint	26173 ns	22150 ns	1.18

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: 909f499	Previous: 2e64038	Ratio
Schema_Iterator_ISO_Language	3205479.9403668987 ns/iter	1975833.2869318193 ns/iter	1.62
Schema_Tracker_ISO_Language	4751630.738255607 ns/iter	3033048.64502178 ns/iter	1.57
Schema_Tracker_ISO_Language_To_JSON	19862217.999999695 ns/iter	14991138.595746635 ns/iter	1.32
Schema_Frame_WoT_References	4785072.766666569 ns/iter	3002041.2543106447 ns/iter	1.59
Schema_Frame_OMC_References	20550302.61764761 ns/iter	13162537.943398057 ns/iter	1.56
Schema_Frame_OMC_Locations	18789556.594592918 ns/iter	12066658.25862211 ns/iter	1.56
Schema_Frame_ISO_Language_Locations	102819562.83332269 ns/iter	60366569.00000708 ns/iter	1.70
Schema_Frame_KrakenD_References	41363595.31250378 ns/iter	24792707.607141603 ns/iter	1.67
Schema_Frame_KrakenD_Reachable	613329071.9999423 ns/iter	566525433.000038 ns/iter	1.08
Schema_Frame_ISO_Language_Locations_To_JSON	124141378.50000392 ns/iter	83754691.2857111 ns/iter	1.48
Schema_Frame_Many_Resources_References	355655559.4999509 ns/iter	263947139.33333 ns/iter	1.35
Schema_Bundle_Meta_2020_12	1459466.2656886575 ns/iter	974478.3059808576 ns/iter	1.50
Schema_Format_ISO_Language_To_JSON	111856982.33331703 ns/iter	67158563.39999391 ns/iter	1.67
E2E_Compiler_adaptivecard	60594675.749996446 ns/iter	39214910.16666955 ns/iter	1.55
E2E_Compiler_ansible_meta	25942512.96296466 ns/iter	16650435.928570893 ns/iter	1.56
E2E_Compiler_aws_cdk	311386.79497905885 ns/iter	210411.81851511734 ns/iter	1.48
E2E_Compiler_babelrc	2325466.819999823 ns/iter	1498054.8888886985 ns/iter	1.55
E2E_Compiler_clang_format	16572361.833333444 ns/iter	10470326.970150055 ns/iter	1.58
E2E_Compiler_cmake_presets	25962980.555555582 ns/iter	17047265.658536673 ns/iter	1.52
E2E_Compiler_code_climate	2341599.777778111 ns/iter	1528082.0893247155 ns/iter	1.53
E2E_Compiler_cql2	13007760.537037585 ns/iter	8750793.887499241 ns/iter	1.49
E2E_Compiler_cspell	23090221.666666366 ns/iter	15062353.276595999 ns/iter	1.53
E2E_Compiler_cypress	3947780.619317856 ns/iter	2546243.3927271958 ns/iter	1.55
E2E_Compiler_deno	7208565.577318893 ns/iter	4585012.805194594 ns/iter	1.57
E2E_Compiler_dependabot	3579062.8512819614 ns/iter	2261243.1419353867 ns/iter	1.58
E2E_Compiler_draft_04	2435929.645833094 ns/iter	1610012.2505746896 ns/iter	1.51
E2E_Compiler_fabric_mod	4297965.754601159 ns/iter	2796809.3280001087 ns/iter	1.54
E2E_Compiler_geojson	20729586.235294096 ns/iter	13513103.55769241 ns/iter	1.53
E2E_Compiler_gitpod_configuration	4587100.058822864 ns/iter	2950818.932773194 ns/iter	1.55
E2E_Compiler_helm_chart_lock	593332.0790144725 ns/iter	380733.5741548557 ns/iter	1.56
E2E_Compiler_importmap	232555.63554517168 ns/iter	156263.7592963796 ns/iter	1.49
E2E_Compiler_jasmine	1202315.135505999 ns/iter	797440.505773681 ns/iter	1.51
E2E_Compiler_jshintrc	3835656.2950820676 ns/iter	2417260.5743945786 ns/iter	1.59
E2E_Compiler_jsconfig	20527361.205883127 ns/iter	13240548.423075674 ns/iter	1.55
E2E_Compiler_krakend	141658026.4000004 ns/iter	88722687.37499666 ns/iter	1.60
E2E_Compiler_lazygit	31300855.545458198 ns/iter	20347184.199999902 ns/iter	1.54
E2E_Compiler_lerna	1427259.338742432 ns/iter	944300.1218836473 ns/iter	1.51
E2E_Compiler_nest_cli	6763501.699028276 ns/iter	4371054.339622622 ns/iter	1.55
E2E_Compiler_omc	161582209.24998546 ns/iter	102184863.57143775 ns/iter	1.58
E2E_Compiler_omnisharp	6079542.9304354675 ns/iter	3887700.461110752 ns/iter	1.56
E2E_Compiler_openapi	23244301.93333455 ns/iter	15488667.688888807 ns/iter	1.50
E2E_Compiler_pre_commit_hooks	4721105.743243471 ns/iter	2994892.7735042674 ns/iter	1.58
E2E_Compiler_pulumi	3643308.5468748533 ns/iter	2449094.3031359566 ns/iter	1.49
E2E_Compiler_semantic_release	1367942.5351562635 ns/iter	932061.431241681 ns/iter	1.47
E2E_Compiler_stale	1396922.0277226444 ns/iter	919559.9039474556 ns/iter	1.52
E2E_Compiler_stylecop	5356945.526717527 ns/iter	3428266.121951066 ns/iter	1.56
E2E_Compiler_tmuxinator	1672831.0477325928 ns/iter	1124761.5313001433 ns/iter	1.49
E2E_Compiler_ui5	48406246.00000562 ns/iter	32295571.31818307 ns/iter	1.50
E2E_Compiler_ui5_manifest	324850422.49999195 ns/iter	208834708.33333227 ns/iter	1.56
E2E_Compiler_unreal_engine_uproject	4158779.5714284373 ns/iter	2747588.027451082 ns/iter	1.51
E2E_Compiler_users_array	759262.7145945821 ns/iter	530280.3166286959 ns/iter	1.43
E2E_Compiler_vercel	12273373.789474119 ns/iter	8305054.380952827 ns/iter	1.48
E2E_Compiler_yamllint	288327.167973606 ns/iter	197978.40804758764 ns/iter	1.46
E2E_Evaluator_adaptivecard	25597.85624402084 ns/iter	15873.634310340642 ns/iter	1.61
E2E_Evaluator_ansible_meta	218552.01061174777 ns/iter	140175.85197900143 ns/iter	1.56
E2E_Evaluator_aws_cdk	45464.030171296356 ns/iter	30961.747539679334 ns/iter	1.47
E2E_Evaluator_babelrc	98889.06543365642 ns/iter	79928.31006231353 ns/iter	1.24
E2E_Evaluator_cerebrum_criminal_case	1115818.443729919 ns/iter	755939.5053532927 ns/iter	1.48
E2E_Evaluator_clang_format	114760.66995236173 ns/iter	74699.2609954947 ns/iter	1.54
E2E_Evaluator_cmake_presets	4770729.557047149 ns/iter	3324502.099526097 ns/iter	1.44
E2E_Evaluator_code_climate	161479.13976743267 ns/iter	130360.35679336946 ns/iter	1.24
E2E_Evaluator_cql2	197279.8962527748 ns/iter	124338.83248996557 ns/iter	1.59
E2E_Evaluator_cspell	622967.2195340013 ns/iter	491934.5197132515 ns/iter	1.27
E2E_Evaluator_cypress	175678.444329881 ns/iter	140972.8542897786 ns/iter	1.25
E2E_Evaluator_deno	266323.1738140383 ns/iter	222466.68542197067 ns/iter	1.20
E2E_Evaluator_dependabot	327825.20993439207 ns/iter	232970.854284749 ns/iter	1.41
E2E_Evaluator_draft_04	11538913.901638987 ns/iter	5795209.669812257 ns/iter	1.99
E2E_Evaluator_fabric_mod	679640.0883218314 ns/iter	478969.7033493026 ns/iter	1.42
E2E_Evaluator_geojson	18193951.256409653 ns/iter	15464222.955557084 ns/iter	1.18
E2E_Evaluator_gitpod_configuration	226715.16819473315 ns/iter	163992.71077673178 ns/iter	1.38
E2E_Evaluator_helm_chart_lock	272690.6816745865 ns/iter	310578.67994626734 ns/iter	0.88
E2E_Evaluator_importmap	52312.22496611307 ns/iter	26515.20503265049 ns/iter	1.97
E2E_Evaluator_jasmine	100475.20874981776 ns/iter	77813.30490382233 ns/iter	1.29
E2E_Evaluator_jshintrc	1195676.3299491832 ns/iter	868477.465923169 ns/iter	1.38
E2E_Evaluator_jsconfig	412804.73092846107 ns/iter	270025.4429504558 ns/iter	1.53
E2E_Evaluator_krakend	187981.1190604728 ns/iter	128417.43691461397 ns/iter	1.46
E2E_Evaluator_lazygit	129438.4151154213 ns/iter	90014.13704662658 ns/iter	1.44
E2E_Evaluator_lerna	115781.65133835548 ns/iter	95414.94871795531 ns/iter	1.21
E2E_Evaluator_nest_cli	185817.70418433004 ns/iter	122423.34698199373 ns/iter	1.52
E2E_Evaluator_omc	23514.32650969103 ns/iter	13537.887275572213 ns/iter	1.74
E2E_Evaluator_omnisharp	567207.9039869845 ns/iter	446231.55159232725 ns/iter	1.27
E2E_Evaluator_openapi	18202031.10526408 ns/iter	8716071.805556187 ns/iter	2.09
E2E_Evaluator_pre_commit_hooks	501417.5134370242 ns/iter	361340.3746769546 ns/iter	1.39
E2E_Evaluator_pulumi	680390.9341722684 ns/iter	562197.4052969876 ns/iter	1.21
E2E_Evaluator_semantic_release	87072.53706505273 ns/iter	61883.078364873945 ns/iter	1.41
E2E_Evaluator_stale	154167.20364274547 ns/iter	98493.57998591253 ns/iter	1.57
E2E_Evaluator_stylecop	272701.54781584017 ns/iter	177839.80752383033 ns/iter	1.53
E2E_Evaluator_tmuxinator	85867.5602203226 ns/iter	59744.921206465566 ns/iter	1.44
E2E_Evaluator_ui5	500942.84671006777 ns/iter	327060.17017298954 ns/iter	1.53
E2E_Evaluator_ui5_manifest	2463617.7664233497 ns/iter	1868702.76203223 ns/iter	1.32
E2E_Evaluator_unreal_engine_uproject	450745.24521073396 ns/iter	312665.52104566555 ns/iter	1.44
E2E_Evaluator_users_array	670231.8212561022 ns/iter	505901.71707670455 ns/iter	1.32
E2E_Evaluator_vercel	265053.28193501034 ns/iter	221399.4952770779 ns/iter	1.20
E2E_Evaluator_yamllint	8627.856504919837 ns/iter	5654.901568964639 ns/iter	1.53
JSONLD_Catalog	25824087.333334047 ns/iter	14693776.893617474 ns/iter	1.76
Micro_Draft4_Meta_1_No_Callback	204.84894209197148 ns/iter	163.3367476203974 ns/iter	1.25
Micro_Draft4_Required_Properties	918.465018700944 ns/iter	593.200919322952 ns/iter	1.55
Micro_Draft4_Many_Optional_Properties_Minimal_Match	26.43054563176741 ns/iter	14.681382611356518 ns/iter	1.80
Micro_Draft4_Few_Optional_Properties_Minimal_Match	11.740658674183846 ns/iter	6.777302261159358 ns/iter	1.73
Micro_Draft4_Items_Schema	280.07113621321463 ns/iter	198.1565013669569 ns/iter	1.41
Micro_Draft4_Nested_Object	1.406482637728041 ns/iter	0.7429342521195614 ns/iter	1.89
Micro_Draft4_Properties_Triad_Optional	329.04793498240247 ns/iter	196.69829826271152 ns/iter	1.67
Micro_Draft4_Properties_Triad_Closed	272.3621593162624 ns/iter	176.64411204871735 ns/iter	1.54
Micro_Draft4_Properties_Triad_Required	345.4028849185544 ns/iter	213.6470006465989 ns/iter	1.62
Micro_Draft4_Properties_Closed	71.72408935213136 ns/iter	37.15799562898909 ns/iter	1.93
Micro_Draft4_Non_Recursive_Ref	16.18303032437702 ns/iter	10.473084232979112 ns/iter	1.55
Micro_Draft4_Pattern_Properties_True	142.77139517279704 ns/iter	102.40155992317212 ns/iter	1.39
Micro_Draft4_Ref_To_Single_Property	12.169578627930319 ns/iter	6.979361063863665 ns/iter	1.74
Micro_Draft4_Additional_Properties_Type	38.24932328618007 ns/iter	27.706208744630466 ns/iter	1.38
Micro_Draft4_Nested_Oneof	57.4007667704198 ns/iter	38.498908308154974 ns/iter	1.49
Micro_Draft4_Short_Enum	10.91887968348576 ns/iter	7.415841012107778 ns/iter	1.47
Micro_Draft4_Long_Enum	13.720368294342844 ns/iter	8.936605540605038 ns/iter	1.54
Micro_Draft4_Long_Enum_Short_Strings	11.107375006294815 ns/iter	7.441645224137885 ns/iter	1.49
Micro_Draft4_Type_Object	3.5216425411574384 ns/iter	2.3956788409563985 ns/iter	1.47
Micro_Draft4_Ref_Single_100	2330647.5833336054 ns/iter	1526147.9978260903 ns/iter	1.53
Micro_Draft4_Compile_Ref_Many_Nested	1715371.6082725015 ns/iter	1141829.3713354275 ns/iter	1.50
Micro_Draft4_Compile_Wrap	2346019.3087251983 ns/iter	1586396.6643990583 ns/iter	1.48
Micro_Draft6_Property_Names	140.16261741650717 ns/iter	93.62793228651815 ns/iter	1.50
Micro_Draft6_Compile_FHIR	16784699068.999998 ns/iter	16958261730.000004 ns/iter	0.99
Micro_Draft7_If_Then_Else	23.618429903199008 ns/iter	17.081791376020437 ns/iter	1.38
Micro_2019_09_Unevaluated_Properties	26.681358157428438 ns/iter	17.144661549484397 ns/iter	1.56
Micro_2019_09_Compile_Wrap	320776327.4999707 ns/iter	217215453.66665396 ns/iter	1.48
Micro_2020_12_Dynamic_Ref	728.3667025305285 ns/iter	497.0973554055159 ns/iter	1.47
Micro_2020_12_Dynamic_Ref_Single	3.526160899204755 ns/iter	2.431842570988948 ns/iter	1.45
Micro_2020_12_Simple_Output_Mask	1048.8344013763417 ns/iter	685.1059983815861 ns/iter	1.53
Micro_2020_12_Simple_Output_Annotations	62032.563350222656 ns/iter	46585.94371257478 ns/iter	1.33
Micro_2020_12_Simple_Output_Annotation_Dropping	1554851.926767476 ns/iter	1070590.0629800062 ns/iter	1.45
Micro_2020_12_Compile_NonCircular_Shared_Refs	963906.076712603 ns/iter	650364.706319658 ns/iter	1.48
Micro_2020_12_Exhaustive_Deep_Numeric	8684.594377260468 ns/iter	5347.705344451759 ns/iter	1.62
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	43292.19938049184 ns/iter	30828.712510145644 ns/iter	1.40
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	23152.505345569793 ns/iter	14367.389484492316 ns/iter	1.61
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	153.1067385171187 ns/iter	88.34813071706883 ns/iter	1.73
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	2725.5223059307064 ns/iter	1731.987531134813 ns/iter	1.57
Alterschema_Check_Readibility_ISO_Language_Set_3	393855303.5000041 ns/iter	252753634.33331677 ns/iter	1.56
Alterschema_Check_Readibility_OMC	93011789.8749927 ns/iter	72494880.6000043 ns/iter	1.28
Alterschema_Check_Readibility_KrakenD	1338900305.000152 ns/iter	1320810859.9999378 ns/iter	1.01
Alterschema_Apply_Readibility_KrakenD	130296723098.00003 ns/iter	127937071127.99995 ns/iter	1.02
Alterschema_Check_Invalid_External_Refs	276570192.99999774 ns/iter	143615421.39999983 ns/iter	1.93

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: 909f499	Previous: 2e64038	Ratio
E2E_Evaluator_adaptivecard	118052 ns	78710 ns	1.50
E2E_Evaluator_ansible-meta	545236 ns	422108 ns	1.29
E2E_Evaluator_aws-cdk	135225 ns	111995 ns	1.21
E2E_Evaluator_babelrc	432733 ns	398827 ns	1.09
E2E_Evaluator_cerebrum-criminal-case	2725461 ns	1901899 ns	1.43
E2E_Evaluator_clang-format	271708 ns	255164 ns	1.06
E2E_Evaluator_cmake-presets	20844930 ns	13630485 ns	1.53
E2E_Evaluator_code-climate	506479 ns	399112 ns	1.27
E2E_Evaluator_cql2	1383025 ns	759985 ns	1.82
E2E_Evaluator_cspell	1675451 ns	1468441 ns	1.14
E2E_Evaluator_cypress	851697 ns	796768 ns	1.07
E2E_Evaluator_deno	1090637 ns	848747 ns	1.28
E2E_Evaluator_dependabot	1094153 ns	837169 ns	1.31
E2E_Evaluator_draft-04	21489336 ns	13331033 ns	1.61
E2E_Evaluator_fabric-mod	2440005 ns	1834990 ns	1.33
E2E_Evaluator_geojson	23459869 ns	25333895 ns	0.93
E2E_Evaluator_gitpod-configuration	734393 ns	626200 ns	1.17
E2E_Evaluator_helm-chart-lock	1014052 ns	726850 ns	1.40
E2E_Evaluator_importmap	262198 ns	227932 ns	1.15
E2E_Evaluator_jasmine	297209 ns	241577 ns	1.23
E2E_Evaluator_jsconfig	1460354 ns	1368955 ns	1.07
E2E_Evaluator_jshintrc	2919380 ns	2340781 ns	1.25
E2E_Evaluator_krakend	631911 ns	423088 ns	1.49
E2E_Evaluator_lazygit	472191 ns	398490 ns	1.18
E2E_Evaluator_lerna	449737 ns	358619 ns	1.25
E2E_Evaluator_nest-cli	609856 ns	530740 ns	1.15
E2E_Evaluator_omc	115511 ns	79292 ns	1.46
E2E_Evaluator_omnisharp	1503081 ns	1181919 ns	1.27
E2E_Evaluator_openapi	41665730 ns	26814503 ns	1.55
E2E_Evaluator_pre-commit-hooks	2031292 ns	1626194 ns	1.25
E2E_Evaluator_pulumi	2002673 ns	1710111 ns	1.17
E2E_Evaluator_semantic-release	237040 ns	226800 ns	1.05
E2E_Evaluator_stale	382860 ns	344215 ns	1.11
E2E_Evaluator_stylecop	1168420 ns	986398 ns	1.18
E2E_Evaluator_tmuxinator	221445 ns	243161 ns	0.91
E2E_Evaluator_ui5	2155701 ns	1392086 ns	1.55
E2E_Evaluator_ui5-manifest	10454359 ns	7264516 ns	1.44
E2E_Evaluator_unreal-engine-uproject	1586672 ns	1357253 ns	1.17
E2E_Evaluator_users-array	2839176 ns	2105350 ns	1.35
E2E_Evaluator_vercel	997051 ns	851456 ns	1.17
E2E_Evaluator_yamllint	24365 ns	20594 ns	1.18

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: 909f499	Previous: 2e64038	Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3	244229951.6666632 ns/iter	365818622.9999956 ns/iter	0.67
Alterschema_Check_Readibility_OMC	81087140.77777928 ns/iter	102436130.71429536 ns/iter	0.79
Alterschema_Check_Readibility_KrakenD	1377819470.0000768 ns/iter	1437598101.0000486 ns/iter	0.96
Alterschema_Apply_Readibility_KrakenD	134076355787.00002 ns/iter	134634981063.00017 ns/iter	1.00
Alterschema_Check_Invalid_External_Refs	169412562.4999856 ns/iter	291345705.0000261 ns/iter	0.58
Micro_2020_12_Dynamic_Ref	577.8087852728071 ns/iter	805.9591339556231 ns/iter	0.72
Micro_2020_12_Dynamic_Ref_Single	4.0590558058244 ns/iter	4.574884619068258 ns/iter	0.89
Micro_2020_12_Simple_Output_Mask	812.895225534135 ns/iter	1074.0922747472243 ns/iter	0.76
Micro_2020_12_Simple_Output_Annotations	64086.29146639253 ns/iter	70342.45583210033 ns/iter	0.91
Micro_2020_12_Simple_Output_Annotation_Dropping	1448125.80855366 ns/iter	1750469.38095232 ns/iter	0.83
Micro_2020_12_Compile_NonCircular_Shared_Refs	904966.8489848591 ns/iter	1067260.310030198 ns/iter	0.85
Micro_2020_12_Exhaustive_Deep_Numeric	6941.717626304161 ns/iter	8782.669572614535 ns/iter	0.79
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	37584.74998563946 ns/iter	51419.405309174064 ns/iter	0.73
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	18273.419427126984 ns/iter	27564.01943484258 ns/iter	0.66
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	115.8860424174613 ns/iter	161.3366899506 ns/iter	0.72
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	2355.4841226391145 ns/iter	2957.9927480867623 ns/iter	0.80
Micro_2019_09_Unevaluated_Properties	25.067049011703144 ns/iter	30.693367896188807 ns/iter	0.82
Micro_2019_09_Compile_Wrap	225331717.3333471 ns/iter	314609820.0001006 ns/iter	0.72
Micro_Draft7_If_Then_Else	19.3157751787465 ns/iter	24.892664271227915 ns/iter	0.78
Micro_Draft6_Property_Names	124.68444416971525 ns/iter	143.08008529003712 ns/iter	0.87
Micro_Draft6_Compile_FHIR	14648068501.000126 ns/iter	14956315428.000153 ns/iter	0.98
Micro_Draft4_Meta_1_No_Callback	151.20297445815237 ns/iter	180.08213474688972 ns/iter	0.84
Micro_Draft4_Required_Properties	781.6158345188971 ns/iter	908.3232442659302 ns/iter	0.86
Micro_Draft4_Many_Optional_Properties_Minimal_Match	20.990718820943993 ns/iter	22.185004326123536 ns/iter	0.95
Micro_Draft4_Few_Optional_Properties_Minimal_Match	12.139569374106928 ns/iter	15.848429727565781 ns/iter	0.77
Micro_Draft4_Items_Schema	303.9649429911816 ns/iter	293.56377754171893 ns/iter	1.04
Micro_Draft4_Nested_Object	1.6079815462809128 ns/iter	1.7597292880098496 ns/iter	0.91
Micro_Draft4_Properties_Triad_Optional	235.50772160107994 ns/iter	474.78283449541703 ns/iter	0.50
Micro_Draft4_Properties_Triad_Closed	193.02031281006032 ns/iter	370.20166865940445 ns/iter	0.52
Micro_Draft4_Properties_Triad_Required	261.8989061968773 ns/iter	525.7186840931909 ns/iter	0.50
Micro_Draft4_Properties_Closed	55.04793759587426 ns/iter	65.14515791296193 ns/iter	0.85
Micro_Draft4_Non_Recursive_Ref	7.522128933459005 ns/iter	8.855536380915158 ns/iter	0.85
Micro_Draft4_Pattern_Properties_True	165.3227546320131 ns/iter	184.87081105091127 ns/iter	0.89
Micro_Draft4_Ref_To_Single_Property	11.287722605473672 ns/iter	15.920715404891295 ns/iter	0.71
Micro_Draft4_Additional_Properties_Type	11.996654108611105 ns/iter	13.931537706139244 ns/iter	0.86
Micro_Draft4_Nested_Oneof	57.486769781975404 ns/iter	64.76167662769072 ns/iter	0.89
Micro_Draft4_Short_Enum	10.009562286218973 ns/iter	14.5669786078846 ns/iter	0.69
Micro_Draft4_Long_Enum	10.50253550794932 ns/iter	13.221336175411496 ns/iter	0.79
Micro_Draft4_Long_Enum_Short_Strings	9.875105236228903 ns/iter	14.471847605929293 ns/iter	0.68
Micro_Draft4_Type_Object	4.867649686467785 ns/iter	4.573876080355757 ns/iter	1.06
Micro_Draft4_Ref_Single_100	1997050.3595168807 ns/iter	2416997.537931099 ns/iter	0.83
Micro_Draft4_Compile_Ref_Many_Nested	1555441.2283295344 ns/iter	1798802.4923076807 ns/iter	0.86
Micro_Draft4_Compile_Wrap	2171382.3775812895 ns/iter	2566559.003649626 ns/iter	0.85
JSONLD_Catalog	17229168.00000007 ns/iter	25759287.925927345 ns/iter	0.67
E2E_Compiler_adaptivecard	48416626.19999928 ns/iter	62111528.90907876 ns/iter	0.78
E2E_Compiler_ansible_meta	21849196.875002973 ns/iter	27783165.9200001 ns/iter	0.79
E2E_Compiler_aws_cdk	289954.1693317015 ns/iter	344304.9478603517 ns/iter	0.84
E2E_Compiler_babelrc	2093362.6752873778 ns/iter	2511282.5827337676 ns/iter	0.83
E2E_Compiler_clang_format	13776818.979999917 ns/iter	17465512.6250002 ns/iter	0.79
E2E_Compiler_cmake_presets	21938227.93749689 ns/iter	27042713.461530466 ns/iter	0.81
E2E_Compiler_code_climate	2140571.829850567 ns/iter	2545576.0872724075 ns/iter	0.84
E2E_Compiler_cql2	11651852.393440288 ns/iter	14043260.939997708 ns/iter	0.83
E2E_Compiler_cspell	20314111.228565577 ns/iter	24014222.20689961 ns/iter	0.85
E2E_Compiler_cypress	3358446.3886262453 ns/iter	4157330.428571846 ns/iter	0.81
E2E_Compiler_deno	6073456.1896557845 ns/iter	7745908.322221517 ns/iter	0.78
E2E_Compiler_dependabot	3087256.4711549226 ns/iter	3822337.5792340497 ns/iter	0.81
E2E_Compiler_draft_04	2215376.583607111 ns/iter	2683592.0881227674 ns/iter	0.83
E2E_Compiler_fabric_mod	3807483.107526687 ns/iter	4631823.576158282 ns/iter	0.82
E2E_Compiler_geojson	17788678.10810732 ns/iter	22345010.16129152 ns/iter	0.80
E2E_Compiler_gitpod_configuration	3972735.8707865644 ns/iter	4897957.95804232 ns/iter	0.81
E2E_Compiler_helm_chart_lock	522156.9439042211 ns/iter	630879.2631104173 ns/iter	0.83
E2E_Compiler_importmap	211352.60422576664 ns/iter	253061.38117567313 ns/iter	0.84
E2E_Compiler_jasmine	1129512.4788066573 ns/iter	1313476.0733085973 ns/iter	0.86
E2E_Compiler_jshintrc	3231060.8818182694 ns/iter	4040532.2601161366 ns/iter	0.80
E2E_Compiler_jsconfig	17916326.947371136 ns/iter	21292090.69696778 ns/iter	0.84
E2E_Compiler_krakend	108027909.99999464 ns/iter	138808675.5999666 ns/iter	0.78
E2E_Compiler_lazygit	26398439.555552814 ns/iter	32840885.857142765 ns/iter	0.80
E2E_Compiler_lerna	1275522.36429898 ns/iter	1543063.063877025 ns/iter	0.83
E2E_Compiler_nest_cli	5817697.322314897 ns/iter	7241517.639175109 ns/iter	0.80
E2E_Compiler_omc	126665881.00000808 ns/iter	165101948.4999665 ns/iter	0.77
E2E_Compiler_omnisharp	5062051.789854774 ns/iter	6418248.688073994 ns/iter	0.79
E2E_Compiler_openapi	20737409.00000303 ns/iter	25318711.321428318 ns/iter	0.82
E2E_Compiler_pre_commit_hooks	4073014.9204545217 ns/iter	5042735.23740934 ns/iter	0.81
E2E_Compiler_pulumi	3418137.5275226166 ns/iter	3934071.971750873 ns/iter	0.87
E2E_Compiler_semantic_release	1285899.6382186017 ns/iter	1501355.2682403354 ns/iter	0.86
E2E_Compiler_stale	1285601.782918099 ns/iter	1502223.8522484195 ns/iter	0.86
E2E_Compiler_stylecop	4427326.238993493 ns/iter	5666456.9674799945 ns/iter	0.78
E2E_Compiler_tmuxinator	1571088.672605881 ns/iter	1847857.9422573217 ns/iter	0.85
E2E_Compiler_ui5	41392606.705879666 ns/iter	49854646.714298464 ns/iter	0.83
E2E_Compiler_ui5_manifest	251102044.99992505 ns/iter	322486234.9999285 ns/iter	0.78
E2E_Compiler_unreal_engine_uproject	3567801.35937503 ns/iter	4443348.518988606 ns/iter	0.80
E2E_Compiler_users_array	764010.4929578229 ns/iter	882784.5411470048 ns/iter	0.87
E2E_Compiler_vercel	11287243.560604332 ns/iter	12837938.309092518 ns/iter	0.88
E2E_Compiler_yamllint	286645.2765690411 ns/iter	320202.12167123624 ns/iter	0.90
E2E_Evaluator_adaptivecard	18815.566581731935 ns/iter	25788.80675646743 ns/iter	0.73
E2E_Evaluator_ansible_meta	189240.10470496677 ns/iter	262614.65191297536 ns/iter	0.72
E2E_Evaluator_aws_cdk	42793.74586739629 ns/iter	56531.15941676225 ns/iter	0.76
E2E_Evaluator_babelrc	88077.9893392643 ns/iter	100067.02672291663 ns/iter	0.88
E2E_Evaluator_cerebrum_criminal_case	1053000.6130501945 ns/iter	1179093.5238092884 ns/iter	0.89
E2E_Evaluator_clang_format	88707.5627188888 ns/iter	104117.00969428082 ns/iter	0.85
E2E_Evaluator_cmake_presets	4387045.060811206 ns/iter	4917522.007299738 ns/iter	0.89
E2E_Evaluator_code_climate	182299.48096707466 ns/iter	201615.14430596516 ns/iter	0.90
E2E_Evaluator_cql2	180324.8696537543 ns/iter	211615.42740720612 ns/iter	0.85
E2E_Evaluator_cspell	546703.7522123687 ns/iter	577772.7690355465 ns/iter	0.95
E2E_Evaluator_cypress	147017.70803549982 ns/iter	161785.57230698544 ns/iter	0.91
E2E_Evaluator_deno	330985.3124999622 ns/iter	316801.88816370023 ns/iter	1.04
E2E_Evaluator_dependabot	310693.17583896266 ns/iter	358987.01653751923 ns/iter	0.87
E2E_Evaluator_draft_04	5834686.703389892 ns/iter	9896481.353846937 ns/iter	0.59
E2E_Evaluator_fabric_mod	666591.0966823236 ns/iter	773597.6372658851 ns/iter	0.86
E2E_Evaluator_geojson	10331926.590167508 ns/iter	20600429.088236686 ns/iter	0.50
E2E_Evaluator_gitpod_configuration	199082.55998865108 ns/iter	244503.58016470217 ns/iter	0.81
E2E_Evaluator_helm_chart_lock	422824.3081113928 ns/iter	219746.9493710816 ns/iter	1.92
E2E_Evaluator_importmap	29981.152615891286 ns/iter	41608.25432433553 ns/iter	0.72
E2E_Evaluator_jasmine	98417.13708934965 ns/iter	113291.37127107494 ns/iter	0.87
E2E_Evaluator_jshintrc	998801.7493112638 ns/iter	1067545.0476922449 ns/iter	0.94
E2E_Evaluator_jsconfig	324223.1790152711 ns/iter	413266.3495838902 ns/iter	0.78
E2E_Evaluator_krakend	146237.23418926398 ns/iter	196833.460078196 ns/iter	0.74
E2E_Evaluator_lazygit	100375.52427982567 ns/iter	133399.67777994263 ns/iter	0.75
E2E_Evaluator_lerna	177558.20320855768 ns/iter	138723.9456083818 ns/iter	1.28
E2E_Evaluator_nest_cli	160341.87471730224 ns/iter	193300.4666851478 ns/iter	0.83
E2E_Evaluator_omc	16556.252936623954 ns/iter	22106.69523689181 ns/iter	0.75
E2E_Evaluator_omnisharp	528290.3046407113 ns/iter	526156.1091603084 ns/iter	1.00
E2E_Evaluator_openapi	10518146.439394651 ns/iter	16420410.92682897 ns/iter	0.64
E2E_Evaluator_pre_commit_hooks	467853.40218878316 ns/iter	488163.682394341 ns/iter	0.96
E2E_Evaluator_pulumi	714496.2773360459 ns/iter	775579.5284916714 ns/iter	0.92
E2E_Evaluator_semantic_release	77668.2353014934 ns/iter	95169.23732628429 ns/iter	0.82
E2E_Evaluator_stale	126729.71698792813 ns/iter	172818.30581566988 ns/iter	0.73
E2E_Evaluator_stylecop	243451.93736808028 ns/iter	308126.7112087676 ns/iter	0.79
E2E_Evaluator_tmuxinator	83396.02312545021 ns/iter	96590.48008385168 ns/iter	0.86
E2E_Evaluator_ui5	432722.317412397 ns/iter	557604.0322059941 ns/iter	0.78
E2E_Evaluator_ui5_manifest	2671796.0645165285 ns/iter	2930613.6666671513 ns/iter	0.91
E2E_Evaluator_unreal_engine_uproject	411293.88679240196 ns/iter	501464.8550002221 ns/iter	0.82
E2E_Evaluator_users_array	636002.7810708971 ns/iter	699401.9759518752 ns/iter	0.91
E2E_Evaluator_vercel	293322.6116751185 ns/iter	283527.24969693675 ns/iter	1.03
E2E_Evaluator_yamllint	8822.82198809343 ns/iter	12029.029648109008 ns/iter	0.73
Schema_Format_ISO_Language_To_JSON	86281842.62499872 ns/iter	113234441.33336125 ns/iter	0.76
Schema_Bundle_Meta_2020_12	1487283.8924797943 ns/iter	1696431.6884030374 ns/iter	0.88
Schema_Frame_WoT_References	4102727.5443793875 ns/iter	5175993.644444236 ns/iter	0.79
Schema_Frame_OMC_References	17531232.36585452 ns/iter	22313850.451617386 ns/iter	0.79
Schema_Frame_OMC_Locations	16467532.767444218 ns/iter	20622330.73529034 ns/iter	0.80
Schema_Frame_ISO_Language_Locations	78017382.55554685 ns/iter	103096556.14284046 ns/iter	0.76
Schema_Frame_KrakenD_References	32025031.28570589 ns/iter	41383237.94118418 ns/iter	0.77
Schema_Frame_KrakenD_Reachable	583659030.0000353 ns/iter	584725144.0000037 ns/iter	1.00
Schema_Frame_ISO_Language_Locations_To_JSON	162654534.00001207 ns/iter	188278475.49999887 ns/iter	0.86
Schema_Frame_Many_Resources_References	313307936.99999046 ns/iter	381211597.5000552 ns/iter	0.82
Schema_Iterator_ISO_Language	3099529.4481134857 ns/iter	3747332.4074071376 ns/iter	0.83
Schema_Tracker_ISO_Language	4748475.832257686 ns/iter	5281515.593984787 ns/iter	0.90
Schema_Tracker_ISO_Language_To_JSON	23202279.321424156 ns/iter	26943232.000007812 ns/iter	0.86

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: 909f499	Previous: 2e64038	Ratio
E2E_Evaluator_adaptivecard	94967 ns	118221 ns	0.80
E2E_Evaluator_ansible-meta	378435 ns	544080 ns	0.70
E2E_Evaluator_aws-cdk	111014 ns	131992 ns	0.84
E2E_Evaluator_babelrc	293176 ns	334483 ns	0.88
E2E_Evaluator_cerebrum-criminal-case	1829396 ns	2692645 ns	0.68
E2E_Evaluator_clang-format	203145 ns	272579 ns	0.75
E2E_Evaluator_cmake-presets	13522838 ns	19019902 ns	0.71
E2E_Evaluator_code-climate	397850 ns	518630 ns	0.77
E2E_Evaluator_cql2	903463 ns	1292917 ns	0.70
E2E_Evaluator_cspell	1264611 ns	1697423 ns	0.75
E2E_Evaluator_cypress	698990 ns	867797 ns	0.81
E2E_Evaluator_deno	845314 ns	1112041 ns	0.76
E2E_Evaluator_dependabot	799099 ns	1109254 ns	0.72
E2E_Evaluator_draft-04	16115590 ns	21420797 ns	0.75
E2E_Evaluator_fabric-mod	1732729 ns	2471744 ns	0.70
E2E_Evaluator_geojson	15691358 ns	25113491 ns	0.62
E2E_Evaluator_gitpod-configuration	533080 ns	744807 ns	0.72
E2E_Evaluator_helm-chart-lock	824390 ns	1053747 ns	0.78
E2E_Evaluator_importmap	256876 ns	267383 ns	0.96
E2E_Evaluator_jasmine	223618 ns	282486 ns	0.79
E2E_Evaluator_jsconfig	1086581 ns	1540498 ns	0.71
E2E_Evaluator_jshintrc	2362023 ns	2974091 ns	0.79
E2E_Evaluator_krakend	479237 ns	653495 ns	0.73
E2E_Evaluator_lazygit	328676 ns	477634 ns	0.69
E2E_Evaluator_lerna	372050 ns	440978 ns	0.84
E2E_Evaluator_nest-cli	456235 ns	621851 ns	0.73
E2E_Evaluator_omc	94548 ns	115293 ns	0.82
E2E_Evaluator_omnisharp	1107672 ns	1492756 ns	0.74
E2E_Evaluator_openapi	29949272 ns	41057104 ns	0.73
E2E_Evaluator_pre-commit-hooks	1561985 ns	2091286 ns	0.75
E2E_Evaluator_pulumi	1530763 ns	2045904 ns	0.75
E2E_Evaluator_semantic-release	186857 ns	244693 ns	0.76
E2E_Evaluator_stale	295847 ns	387675 ns	0.76
E2E_Evaluator_stylecop	918772 ns	1246672 ns	0.74
E2E_Evaluator_tmuxinator	193060 ns	230210 ns	0.84
E2E_Evaluator_ui5	1743047 ns	2190212 ns	0.80
E2E_Evaluator_ui5-manifest	7942382 ns	12109025 ns	0.66
E2E_Evaluator_unreal-engine-uproject	1224459 ns	1648701 ns	0.74
E2E_Evaluator_users-array	2180774 ns	2748896 ns	0.79
E2E_Evaluator_vercel	819102 ns	1063301 ns	0.77
E2E_Evaluator_yamllint	18303 ns	24322 ns	0.75

This comment was automatically generated by workflow using github-action-benchmark.