Add GPT2ForSequenceClassification to use_larger_multiplier_for_smaller_tensor list (#160001)

generatedunixname499836121 · facebook-github-bot · commit 9e418359d21d · 2025-08-18T12:09:54.000-07:00
Summary: GPT2ForSequenceClassification Hugging Face (HF) model fails on ROCm for bfloat16. The failure is numerically small. This PRs adds this model to an exception list for small tensors. The exception list already includes two models. This increases the multiplier factor to 10.0 instead of 3 (default) for this model used in `torch/_dynamo/utils.py`. In the PR comment below, I include a short analysis of the numerics. X-link: pytorch/pytorch#160001 Approved by: https://github.com/anijain2305, https://github.com/jataylo, https://github.com/jeffdaily Reviewed By: seemethere Differential Revision: D80465664 fbshipit-source-id: 986a0cc2f9e23c73c9ed9e714020ae785c7b4a58
diff --git a/userbenchmark/dynamo/dynamobench/huggingface.py b/userbenchmark/dynamo/dynamobench/huggingface.py
@@ -370,6 +370,7 @@ def use_larger_multiplier_for_smaller_tensor(self, name):
         return name in [
             "ElectraForQuestionAnswering",
             "MegatronBertForQuestionAnswering",
+            "GPT2ForSequenceClassification",
         ]
 
     def _get_model_cls_and_config(self, model_name):

Original file line number	Diff line number	Diff line change
`@@ -370,6 +370,7 @@ def use_larger_multiplier_for_smaller_tensor(self, name):`
`370`	`370`	`return name in [`
`371`	`371`	`"ElectraForQuestionAnswering",`
`372`	`372`	`"MegatronBertForQuestionAnswering",`
	`373`	`+ "GPT2ForSequenceClassification",`
`373`	`374`	`]`
`374`	`375`
`375`	`376`	`def _get_model_cls_and_config(self, model_name):`