Prerequisites

• I am running the latest code. Mention the version if possible as well.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Support the models at https://huggingface.co/collections/swiss-ai/apertus-llm-68b699e65415c231ace3b059

Motivation

New fully open-source model with training data and code. It supports almost all languages in the world.

Possible Implementation

vllm-project/vllm#23068
huggingface/transformers#39381