Skip to content

Commit 75408c1

Browse files
boe20211boe20211
authored
Split quantized features into separate YAML files, and add MoE and MLA to the feature support matrix (#1120)
Signed-off-by: Teresa Chen <boe20211@gmail.com>
1 parent b090f12 commit 75408c1

File tree

8 files changed

+269
-55
lines changed

8 files changed

+269
-55
lines changed

‎.buildkite/features/Collective_Communication_Matmul.yml‎

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,3 +20,25 @@ steps:
2020
commands:
2121
- |
2222
.buildkite/scripts/record_step_result.sh Collective_Communication_Matmul_CorrectnessTest
23+
24+
- label: "Performance tests for Collective Communication Matmul"
25+
key: "Collective_Communication_Matmul_PerformanceTest"
26+
depends_on: "record_Collective_Communication_Matmul_CorrectnessTest"
27+
soft_fail: true
28+
agents:
29+
queue: tpu_v6e_queue
30+
commands:
31+
- |
32+
buildkite-agent meta-data set "Collective_Communication_Matmul_PerformanceTest" "to be added"
33+
- label: "Record performance test result for Collective Communication Matmul"
34+
key: "record_Collective_Communication_Matmul_PerformanceTest"
35+
depends_on: "Collective_Communication_Matmul_PerformanceTest"
36+
env:
37+
CI_TARGET: "Collective Communication Matmul"
38+
CI_STAGE: "PerformanceTest"
39+
CI_CATEGORY: "kernel support matrix"
40+
agents:
41+
queue: cpu
42+
commands:
43+
- |
44+
.buildkite/scripts/record_step_result.sh Collective_Communication_Matmul_PerformanceTest

‎.buildkite/features/MLA.yml‎

Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
# MLA
2+
# feature support matrix
3+
steps:
4+
- label: "Correctness tests for MLA"
5+
key: "MLA_CorrectnessTest"
6+
soft_fail: true
7+
agents:
8+
queue: tpu_v6e_queue
9+
commands:
10+
- |
11+
buildkite-agent meta-data set "MLA_CorrectnessTest" "to be added"
12+
- label: "Record correctness test result for MLA"
13+
key: "record_MLA_CorrectnessTest"
14+
depends_on: "MLA_CorrectnessTest"
15+
env:
16+
CI_TARGET: "MLA"
17+
CI_STAGE: "CorrectnessTest"
18+
CI_CATEGORY: "feature support matrix"
19+
agents:
20+
queue: cpu
21+
commands:
22+
- |
23+
.buildkite/scripts/record_step_result.sh MLA_CorrectnessTest
24+
25+
- label: "Performance tests for MLA"
26+
key: "MLA_PerformanceTest"
27+
depends_on: "record_MLA_CorrectnessTest"
28+
soft_fail: true
29+
agents:
30+
queue: tpu_v6e_queue
31+
commands:
32+
- |
33+
buildkite-agent meta-data set "MLA_PerformanceTest" "to be added"
34+
- label: "Record performance test result for MLA"
35+
key: "record_MLA_PerformanceTest"
36+
depends_on: "MLA_PerformanceTest"
37+
env:
38+
CI_TARGET: "MLA"
39+
CI_STAGE: "PerformanceTest"
40+
CI_CATEGORY: "feature support matrix"
41+
agents:
42+
queue: cpu
43+
commands:
44+
- |
45+
.buildkite/scripts/record_step_result.sh MLA_PerformanceTest

‎.buildkite/features/MoE.yml‎

Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
# MoE
2+
# feature support matrix
3+
steps:
4+
- label: "Correctness tests for MoE"
5+
key: "MoE_CorrectnessTest"
6+
soft_fail: true
7+
agents:
8+
queue: tpu_v6e_queue
9+
commands:
10+
- |
11+
buildkite-agent meta-data set "MoE_CorrectnessTest" "to be added"
12+
- label: "Record correctness test result for MoE"
13+
key: "record_MoE_CorrectnessTest"
14+
depends_on: "MoE_CorrectnessTest"
15+
env:
16+
CI_TARGET: "MoE"
17+
CI_STAGE: "CorrectnessTest"
18+
CI_CATEGORY: "feature support matrix"
19+
agents:
20+
queue: cpu
21+
commands:
22+
- |
23+
.buildkite/scripts/record_step_result.sh MoE_CorrectnessTest
24+
25+
- label: "Performance tests for MoE"
26+
key: "MoE_PerformanceTest"
27+
depends_on: "record_MoE_CorrectnessTest"
28+
soft_fail: true
29+
agents:
30+
queue: tpu_v6e_queue
31+
commands:
32+
- |
33+
buildkite-agent meta-data set "MoE_PerformanceTest" "to be added"
34+
- label: "Record performance test result for MoE"
35+
key: "record_MoE_PerformanceTest"
36+
depends_on: "MoE_PerformanceTest"
37+
env:
38+
CI_TARGET: "MoE"
39+
CI_STAGE: "PerformanceTest"
40+
CI_CATEGORY: "feature support matrix"
41+
agents:
42+
queue: cpu
43+
commands:
44+
- |
45+
.buildkite/scripts/record_step_result.sh MoE_PerformanceTest

‎.buildkite/features/Quantized_Attention.yml‎

Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
# Quantized Attention
2+
# kernel support matrix
3+
steps:
4+
- label: "Correctness tests for Quantized Attention"
5+
key: "Quantized_Attention_CorrectnessTest"
6+
soft_fail: true
7+
agents:
8+
queue: tpu_v6e_queue
9+
commands:
10+
- |
11+
buildkite-agent meta-data set "Quantized_Attention_CorrectnessTest" "to be added"
12+
- label: "Record correctness test result for Quantized Attention"
13+
key: "record_Quantized_Attention_CorrectnessTest"
14+
depends_on: "Quantized_Attention_CorrectnessTest"
15+
env:
16+
CI_TARGET: "Quantized Attention"
17+
CI_STAGE: "CorrectnessTest"
18+
CI_CATEGORY: "kernel support matrix"
19+
agents:
20+
queue: cpu
21+
commands:
22+
- |
23+
.buildkite/scripts/record_step_result.sh Quantized_Attention_CorrectnessTest
24+
25+
- label: "Performance tests for Quantized Attention"
26+
key: "Quantized_Attention_PerformanceTest"
27+
depends_on: "record_Quantized_Attention_CorrectnessTest"
28+
soft_fail: true
29+
agents:
30+
queue: tpu_v6e_queue
31+
commands:
32+
- |
33+
buildkite-agent meta-data set "Quantized_Attention_PerformanceTest" "to be added"
34+
- label: "Record performance test result for Quantized Attention"
35+
key: "record_Quantized_Attention_PerformanceTest"
36+
depends_on: "Quantized_Attention_PerformanceTest"
37+
env:
38+
CI_TARGET: "Quantized Attention"
39+
CI_STAGE: "PerformanceTest"
40+
CI_CATEGORY: "kernel support matrix"
41+
agents:
42+
queue: cpu
43+
commands:
44+
- |
45+
.buildkite/scripts/record_step_result.sh Quantized_Attention_PerformanceTest

‎.buildkite/features/Quantized_KV_Cache.yml‎

Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
# Quantized KV Cache
2+
# kernel support matrix
3+
steps:
4+
- label: "Correctness tests for Quantized KV Cache"
5+
key: "Quantized_KV_Cache_CorrectnessTest"
6+
soft_fail: true
7+
agents:
8+
queue: tpu_v6e_queue
9+
commands:
10+
- |
11+
buildkite-agent meta-data set "Quantized_KV_Cache_CorrectnessTest" "to be added"
12+
- label: "Record correctness test result for Quantized KV Cache"
13+
key: "record_Quantized_KV_Cache_CorrectnessTest"
14+
depends_on: "Quantized_KV_Cache_CorrectnessTest"
15+
env:
16+
CI_TARGET: "Quantized KV Cache"
17+
CI_STAGE: "CorrectnessTest"
18+
CI_CATEGORY: "kernel support matrix"
19+
agents:
20+
queue: cpu
21+
commands:
22+
- |
23+
.buildkite/scripts/record_step_result.sh Quantized_KV_Cache_CorrectnessTest
24+
25+
- label: "Performance tests for Quantized KV Cache"
26+
key: "Quantized_KV_Cache_PerformanceTest"
27+
depends_on: "record_Quantized_KV_Cache_CorrectnessTest"
28+
soft_fail: true
29+
agents:
30+
queue: tpu_v6e_queue
31+
commands:
32+
- |
33+
buildkite-agent meta-data set "Quantized_KV_Cache_PerformanceTest" "to be added"
34+
- label: "Record performance test result for Quantized KV Cache"
35+
key: "record_Quantized_KV_Cache_PerformanceTest"
36+
depends_on: "Quantized_KV_Cache_PerformanceTest"
37+
env:
38+
CI_TARGET: "Quantized KV Cache"
39+
CI_STAGE: "PerformanceTest"
40+
CI_CATEGORY: "kernel support matrix"
41+
agents:
42+
queue: cpu
43+
commands:
44+
- |
45+
.buildkite/scripts/record_step_result.sh Quantized_KV_Cache_PerformanceTest

‎.buildkite/features/Quantized_Matmul.yml‎

Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
# Quantized Matmul
2+
# kernel support matrix
3+
steps:
4+
- label: "Correctness tests for Quantized Matmul"
5+
key: "Quantized_Matmul_CorrectnessTest"
6+
soft_fail: true
7+
agents:
8+
queue: tpu_v6e_queue
9+
commands:
10+
- |
11+
buildkite-agent meta-data set "Quantized_Matmul_CorrectnessTest" "to be added"
12+
- label: "Record correctness test result for Quantized Matmul"
13+
key: "record_Quantized_Matmul_CorrectnessTest"
14+
depends_on: "Quantized_Matmul_CorrectnessTest"
15+
env:
16+
CI_TARGET: "Quantized Matmul"
17+
CI_STAGE: "CorrectnessTest"
18+
CI_CATEGORY: "kernel support matrix"
19+
agents:
20+
queue: cpu
21+
commands:
22+
- |
23+
.buildkite/scripts/record_step_result.sh Quantized_Matmul_CorrectnessTest
24+
25+
- label: "Performance tests for Quantized Matmul"
26+
key: "Quantized_Matmul_PerformanceTest"
27+
depends_on: "record_Quantized_Matmul_CorrectnessTest"
28+
soft_fail: true
29+
agents:
30+
queue: tpu_v6e_queue
31+
commands:
32+
- |
33+
buildkite-agent meta-data set "Quantized_Matmul_PerformanceTest" "to be added"
34+
- label: "Record performance test result for Quantized Matmul"
35+
key: "record_Quantized_Matmul_PerformanceTest"
36+
depends_on: "Quantized_Matmul_PerformanceTest"
37+
env:
38+
CI_TARGET: "Quantized Matmul"
39+
CI_STAGE: "PerformanceTest"
40+
CI_CATEGORY: "kernel support matrix"
41+
agents:
42+
queue: cpu
43+
commands:
44+
- |
45+
.buildkite/scripts/record_step_result.sh Quantized_Matmul_PerformanceTest

‎.buildkite/features/Quantized_Matmul_Attention_and_KV_Cache.yml‎

Lines changed: 0 additions & 55 deletions
This file was deleted.

‎.buildkite/features/Structured_Decoding.yml‎

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,3 +20,25 @@ steps:
2020
commands:
2121
- |
2222
.buildkite/scripts/record_step_result.sh Structured_Decoding_CorrectnessTest
23+
24+
- label: "Performance tests for Structured Decoding"
25+
key: "Structured_Decoding_PerformanceTest"
26+
depends_on: "record_Structured_Decoding_CorrectnessTest"
27+
soft_fail: true
28+
agents:
29+
queue: tpu_v6e_queue
30+
commands:
31+
- |
32+
buildkite-agent meta-data set "Structured_Decoding_PerformanceTest" "to be added"
33+
- label: "Record performance test result for Structured Decoding"
34+
key: "record_Structured_Decoding_PerformanceTest"
35+
depends_on: "Structured_Decoding_PerformanceTest"
36+
env:
37+
CI_TARGET: "Structured Decoding"
38+
CI_STAGE: "PerformanceTest"
39+
CI_CATEGORY: "feature support matrix"
40+
agents:
41+
queue: cpu
42+
commands:
43+
- |
44+
.buildkite/scripts/record_step_result.sh Structured_Decoding_PerformanceTest

0 commit comments

Comments
 (0)