Gemma4 support

[mkopcins]

Export gemma4 E2B and E4B models. Key to this is efficient memory management, as a huge part of model params (above 50%) is not needed at runtime, but only on first token consumption (PLE layers)

[ninjapayofficial]

yeah Gemma is needed

[Andrewgrillo23]

Truly excited for this one!