BERT Fine-Tuned on SQuAD (Extractive Question Answering)

This model extracts answers to questions directly from a provided text passage. It was fine-tuned from bert-base-cased on the SQuAD v1.1 dataset.

How It Works

Given a context (a paragraph of text) and a question, the model finds and returns the exact span of text in the context that answers the question.

Performance

Metric Score
Exact Match 81.05%
F1 Score 88.55%

(Evaluated on SQuAD v1.1 validation set — 10,570 examples)

How to Use

from transformers import pipeline

qa = pipeline(
    "question-answering",
    model="samandar1105/Question_Answering"
)

result = qa(
    question="Who designed the Eiffel Tower?",
    context="The Eiffel Tower was designed by Gustave Eiffel and built between 1887 and 1889 in Paris."
)
print(result)
# {'answer': 'Gustave Eiffel', 'score': 0.99, 'start': 31, 'end': 45}

Training Details

Parameter Value
Base model bert-base-cased
Dataset SQuAD v1.1 (87,599 train / 10,570 val)
Learning rate 2e-5
Epochs 3
Batch size 16
Max sequence length 384
Stride 128
Framework PyTorch + HuggingFace Transformers
Downloads last month
132
Safetensors
Model size
0.1B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train samandar1105/Question_Answering

Spaces using samandar1105/Question_Answering 2

Evaluation results