[Bug] API sends all hidden states when asked for only mean hidden state #292
Description
I haven't tested it for other models but for ESM-C-6B when the logits config is set to logits_config = esm_api.LogitsConfig(sequence=True, return_mean_hidden_states=True) the api also returns the full hidden states of all layers. This makes the api calls really slow.
Since the expected behaviour for the 6B model is to never send all hidden states this seems to be a bug in how the LogitsConfig is handled.