Instructions to use Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs")
model = AutoModelForMultimodalLM.from_pretrained("Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs

SGLang

How to use Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs with Docker Model Runner:
```
docker model run hf.co/Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs
```

Model Card for Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs

This model was finetuned by performing instruct tuning on Wolof language datatsets.

Model Details

Model Description

Developed by: Orange
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Model type: [More Information Needed]
Language(s) (NLP): Wolof
License: [More Information Needed]
Finetuned from model [optional]: Orange/Qwen2.5-7B-Instruct
Date [optional]: 2026-06-04 20:32:43

Model Sources [optional]

Repository: [More Information Needed]
Paper [optional]: [More Information Needed]
Demo [optional]: [More Information Needed]

Uses

Direct Use

This model can be used with the transformers library using pipeline abstraction as follows:

import torch
from transformers import pipeline

model_id = "Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs"
pipe = pipeline(
    "text-generation",
    model=model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)
messages = [
    {"role": "system", "content": "You are chatbot specialized on Wolof language."},
    {"role": "user", "content": "Can you give a sample of your specialized knowledge?"},
]
outputs = pipe(
    messages,
    max_new_tokens=256,
)
print(outputs[0]["generated_text"][-1])

Downstream Use [optional]

[More Information Needed]

Out-of-Scope Use

[More Information Needed]

Bias, Risks, and Limitations

[More Information Needed]

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

Training Details

This model was finetuned with Orange internal fine tuning tools with the Docker Image tagged 0.2.4 in the registry and the following configuration file:

data:
    dataset_name:
        train:
        -   path: wolof-lm/en_function_calling-instructions
            revision: v10
            split: train
        -   path: wolof-lm/alpaca_translated_into_wolof-instructions
            revision: 2025.02.28
            split: train
        -   path: wolof-lm/argilla_databricks-dolly-15k-curated-multilingual_en_translated_into_wolof-instructions
            revision: 2025.02.28
            split: train
        -   path: wolof-lm/samsung_samsum_instruct_dialogues_translated_in_wolof-instructions
            revision: 2025.02.28
            split: train
        -   path: wolof-lm/alwaly_french_wolof-instructions
            split: train
        -   path: wolof-lm/alwaly_wolof_to_french-instructions
            split: train
        -   path: wolof-lm/claire_masking_multilogue-instructions
            split: train
        -   path: wolof-lm/huggingfaceh4_helpful-anthropic-raw_train_translated_in_wolof-instructions
            split: train
        -   path: wolof-lm/lodrick-the-lafted-hermes-217k-instructions
            split: train
        -   path: wolof-lm/wisenut-nlp-team_translated_in_wolof-instructions
            split: train
        -   path: wolof-lm/claire_one_to_one_dialogue-instructions
            revision: 2026.01.16
            split: train
        -   path: wolof-lm/wol-sonatel-2025-conversations
            revision: 2026.02.18
            split: train
        validation_conversational_eng:
        -   path: wolof-lm/oasst1-en-instructions
            revision: 2026.03.19
            split: validation
        validation_conversational_fra:
        -   path: wolof-lm/oasst1-fr-instructions
            revision: 2026.03.19
            split: validation
        -   path: wolof-lm/synthetic-fr-instructions
            revision: 2026.03.19
            split: validation
        validation_conversational_wol:
        -   path: wolof-lm/claire_one_to_one_dialogue-instructions
            revision: 2026.01.16
            split: validation
        -   path: wolof-lm/wol-sonatel-2025-conversations
            revision: 2026.02.18
            split: validation
        validation_fc:
        -   path: wolof-lm/en_function_calling-instructions
            revision: v10
            split: validation
        validation_if:
        -   path: wolof-lm/tulu-3-sft-personas-instruction-following
            split: validation
        validation_it-v2:
        -   path: wolof-lm/alpaca_translated_into_wolof-instructions
            revision: 2025.02.28
            split: validation
        -   path: wolof-lm/argilla_databricks-dolly-15k-curated-multilingual_en_translated_into_wolof-instructions
            revision: 2026.03.02
            split: validation
        -   path: wolof-lm/samsung_samsum_instruct_dialogues_translated_in_wolof-instructions
            revision: 2025.02.28
            split: validation
        -   path: wolof-lm/alwaly_french_wolof-instructions
            split: validation
        -   path: wolof-lm/alwaly_wolof_to_french-instructions
            split: validation
        -   path: wolof-lm/claire_masking_multilogue-instructions
            split: validation
        -   path: wolof-lm/huggingfaceh4_helpful-anthropic-raw_train_translated_in_wolof-instructions
            split: validation
        -   path: wolof-lm/lodrick-the-lafted-hermes-217k-instructions
            split: validation
        -   path: wolof-lm/wisenut-nlp-team_translated_in_wolof-instructions
            split: validation
    debug: false
    implementation_name: conversations
description:
    contributors:
    -   email: claire.perroux@orange.com
        first_name: Claire
        last_name: Perroux
    -   email: pierre.adam@orange.com
        first_name: Pierre
        last_name: Adam
    domain: Wolof
    languages:
    - wo
    model_name: Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs
image:
    name: registry.gitlab.tech.orange/nepal/knowledge/orangelm/lm-adaptation/lm-adaptation
    version: 0.2.4
model:
    attn_implementation: flash_attention_2
    chat_template_tokenizer: Orange/Qwen2.5-7B-Instruct
    model_name_or_path: Orange/Qwen2.5-7B-Instruct
    trust_remote_code: true
software_info:
    parameters:
        accelerate_file: null
        clean_output: false
        cluster: marcel
        codecarbon_log_level: warning
        collator_stats: false
        config_file: resources/configs/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs_4gpu.yml
        constraints: queue:name=gpu_H100,gpu:4
        data_seed: 42
        debug: false
        deepspeed_file: resources/deepspeed/zero3.json
        dry_run: false
        environment_variable:
            TOKENIZERS_PARALLELISM: 'false'
        load_only: null
        log_level: INFO
        log_output: null
        merge_peft: false
        no_requeue: false
        output_dir: qwen-training/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs_4gpu
        profiler_config: null
        push_to_hub: false
        qat_config: null
        requeue_n_epochs: 1
        time_out: 24h
        time_requeue: false
        use_qat: false
    version: 0.20.0
training:
    assistant_only_loss: true
    bf16: true
    dataloader_num_workers: 4
    dataloader_persistent_workers: true
    dataloader_pin_memory: true
    dataloader_prefetch_factor: 2
    deepspeed: /config/zero3.json
    disable_tqdm: true
    eval_accumulation_steps: 10
    eval_steps: 10
    eval_strategy: steps
    fp16: false
    gradient_accumulation_steps: 32
    gradient_checkpointing: true
    group_by_length: false
    learning_rate: 2.0e-05
    log_level: warning
    logging_dir: /outputs/qwen-training/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs_4gpu/logs
    logging_steps: 1
    lr_scheduler_type: cosine
    max_grad_norm: 1.0
    max_length: 2048
    max_steps: -1
    num_train_epochs: 2
    optim: paged_adamw_32bit
    output_dir: /outputs/qwen-training/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs_4gpu
    per_device_eval_batch_size: 8
    per_device_train_batch_size: 8
    push_to_hub: false
    report_to: tensorboard
    save_steps: 0
    save_strategy: epoch
    save_total_limit: 1
    seed: 42
    torch_compile: false
    training_type: instruct-tuning
    use_liger_kernel: false
    warmup_ratio: 0.05
    weight_decay: 0.1

The model was trained on 4 gpus.

The model was trained using deepspeed with the following configuration file:

{
    "fp16": {
        "enabled": "auto",
        "loss_scale": 0,
        "loss_scale_window": 1000,
        "initial_scale_power": 16,
        "hysteresis": 2,
        "min_loss_scale": 1
    },
    "bf16": {
        "enabled": "auto"
    },
    "zero_optimization": {
        "stage": 3,
        "offload_optimizer": {
            "device": "cpu",
            "pin_memory": false
        },
        "offload_param": {
            "device": "cpu",
            "pin_memory": false
        },
        "overlap_comm": true,
        "contiguous_gradients": true,
        "sub_group_size": "1e9",
        "reduce_bucket_size": "auto",
        "stage3_prefetch_bucket_size": "auto",
        "stage3_param_persistence_threshold": "auto",
        "stage3_max_live_parameters": "1e9",
        "stage3_max_reuse_distance": "1e9",
        "stage3_gather_16bit_weights_on_model_save": true
    },
    "gradient_accumulation_steps": "auto",
    "gradient_clipping": "auto",
    "steps_per_print": 2000,
    "train_batch_size": "auto",
    "train_micro_batch_size_per_gpu": "auto",
    "wall_clock_breakdown": false
}

Training Data

This model was trained on the following datasets:

-   path: wolof-lm/en_function_calling-instructions
    revision: v10
    split: train
-   path: wolof-lm/alpaca_translated_into_wolof-instructions
    revision: 2025.02.28
    split: train
-   path: wolof-lm/argilla_databricks-dolly-15k-curated-multilingual_en_translated_into_wolof-instructions
    revision: 2025.02.28
    split: train
-   path: wolof-lm/samsung_samsum_instruct_dialogues_translated_in_wolof-instructions
    revision: 2025.02.28
    split: train
-   path: wolof-lm/alwaly_french_wolof-instructions
    split: train
-   path: wolof-lm/alwaly_wolof_to_french-instructions
    split: train
-   path: wolof-lm/claire_masking_multilogue-instructions
    split: train
-   path: wolof-lm/huggingfaceh4_helpful-anthropic-raw_train_translated_in_wolof-instructions
    split: train
-   path: wolof-lm/lodrick-the-lafted-hermes-217k-instructions
    split: train
-   path: wolof-lm/wisenut-nlp-team_translated_in_wolof-instructions
    split: train
-   path: wolof-lm/claire_one_to_one_dialogue-instructions
    revision: 2026.01.16
    split: train
-   path: wolof-lm/wol-sonatel-2025-conversations
    revision: 2026.02.18
    split: train

Training Procedure

Preprocessing [optional]

[More Information Needed]

Training Hyperparameters

Training regime: This model was trained with the following hyperparameters for SFTTrainer,other parameters were set as default:

assistant_only_loss: true
bf16: true
dataloader_num_workers: 4
dataloader_persistent_workers: true
dataloader_pin_memory: true
dataloader_prefetch_factor: 2
deepspeed: /config/zero3.json
disable_tqdm: true
eval_accumulation_steps: 10
eval_steps: 10
eval_strategy: steps
fp16: false
gradient_accumulation_steps: 32
gradient_checkpointing: true
group_by_length: false
learning_rate: 2.0e-05
log_level: warning
logging_dir: /outputs/qwen-training/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs_4gpu/logs
logging_steps: 1
lr_scheduler_type: cosine
max_grad_norm: 1.0
max_length: 2048
max_steps: -1
num_train_epochs: 2
optim: paged_adamw_32bit
output_dir: /outputs/qwen-training/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs_4gpu
per_device_eval_batch_size: 8
per_device_train_batch_size: 8
push_to_hub: false
report_to: tensorboard
save_steps: 0
save_strategy: epoch
save_total_limit: 1
seed: 42
torch_compile: false
use_liger_kernel: false
warmup_ratio: 0.05
weight_decay: 0.1

Number of Tokens vs Steps

Learning Rate Curve

Training Loss

Validation Loss

Speeds, Sizes, Times [optional]

[More Information Needed]

Evaluation

Testing Data, Factors & Metrics

Testing Data

[More Information Needed]

Factors

[More Information Needed]

Metrics

[More Information Needed]

Results

[More Information Needed]

Summary

Model Examination [optional]

[More Information Needed]

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Hardware Type: CPUs: AMD EPYC 9124 16-Core Processor; GPUs: 4 x NVIDIA H100 NVL
Hours used: 35:31:56
Cloud Provider: [More Information Needed]
Compute Region: [More Information Needed]
Carbon Emitted: 2 kg CO2eq, detailed emissions can be found in emissions.csv (emissions were computed using codecarbon)

Technical Specifications [optional]

Model Architecture and Objective

[More Information Needed]

Compute Infrastructure

[More Information Needed]

Hardware

[More Information Needed]

Software

[More Information Needed]

Citation [optional]

BibTeX:

[More Information Needed]

APA:

[More Information Needed]

Glossary [optional]

[More Information Needed]

More Information [optional]

[More Information Needed]

Model Card Authors [optional]

[More Information Needed]

Model Card Contact

Thanks to Claire Perroux, Pierre Adam for adding this model.

Downloads last month: 187

Safetensors

Model size

333k params

Tensor type

BF16

Model tree for Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs

Base model

Orange/Qwen2.5-7B-Instruct

Finetuned

(1)

this model

Paper for Orange/Wolof-Qwen2.5-7B-it-v2-fc-v2-conv-v1_2epochs

Quantifying the Carbon Emissions of Machine Learning

Paper • 1910.09700 • Published Oct 21, 2019 • 51