google

/

gemma-2-27b-it

like 560

Follow

Google 46k

Hello!
I wanted to share another users way of enabling the system prompt with a jinja chat template

props to @piotr25691

This modified template:

{{ bos_token }}{% if messages[0]['role'] == 'system' %}{{ messages[0]['content'] + '\n' }}{% endif %}{% for message in messages %}{% if (message['role'] == 'user') != ((loop.index0 + 1) % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if (message['role'] == 'assistant') %}{% set role = 'model' %}{% else %}{% set role = message['role'] %}{% endif %}{% if message['role'] != 'system' %}{{ '<start_of_turn>' + role + '\n' + message['content'] | trim + '<end_of_turn>\n' }}{% endif %}{% endfor %}{% if add_generation_prompt %}{{'<start_of_turn>model\n'}}{% endif %}

will enable the system prompt functionality.

You can also use https://huggingface.co/piotr25691/SystemGemma2-27b-it to get this immediately

Thank you so much @lunahr and @muhammedalkhy for sharing the different prompt templates that could be used with Gemma models. I really appreciates your contribution to make Gemma models better. I'm really excited to experiment with these prompt templates.

Thanks.

If you're looking for an easy way to access this model via API, you can use Crazyrouter — it provides an OpenAI-compatible endpoint for 600+ models including this one. Just pip install openai and change the base URL.