NEW
Also known as: Fβ-Score, F-measure with beta
A generalized F-score that weights recall beta times more than precision to balance detection sensitivity.
DESCRIPTION
The F-beta score combines precision and recall into a single metric that emphasizes recall by a factor beta. It is especially useful when false negatives are more costly than false positives, such as in fraud detection or medical diagnoses. Setting beta greater than 1 prioritizes recall, while beta less than 1 favors precision. The score is the weighted harmonic mean: higher values indicate a better balance according to the chosen emphasis. It is commonly used for imbalanced classification and threshold tuning alongside precision-recall curves.
ALTERNATIVE DEFINITIONS
Wikipedia
The Fβ score weighs recall β times more than precision.
States the recall emphasis explicitly, defining the generalization beyond F1.
scikit-learn
The F-beta score is the weighted harmonic mean of precision and recall with beta weighting recall.
Highlights harmonic mean and explicit beta weighting in standard ML library documentation.
RELATED TERMS
Precision Recall F1 Score Confusion Matrix Precision-Recall Curve Classification Threshold Macro Averaging Micro Averaging Class Imbalance
COMPETING TERMS
Accuracy ROC AUC Matthews Correlation Coefficient
RELATIONS
- Broader: Score
KNOWLEDGE AREAS
Mathematics Data Science AI Testing & Validation
TARGET AUDIENCE
Data Scientist AI Engineer MLOps Engineer Data Analyst
EXTERNAL SOURCES
- Wikipedia - F1 score
- scikit-learn - Official ML metrics documentation
- Microsoft Learn - Azure ML guide on model metrics
TOP QUESTIONS
When should the F-beta Score be used over F1 Score?
Use F-beta when recall or precision needs stronger emphasis. Beta greater than 1 prioritizes recall; less than 1 prioritizes precision. It suits imbalanced classification and cost-sensitive contexts.
Category: Requirements
How does class imbalance affect the F-beta Score?
Imbalance increases the need to balance precision and recall. F-beta helps tune performance priorities to mitigate skewed class distributions and misleading high accuracy.
Category: Risks
What is the relationship between the F-beta Score and precision-recall curves?
F-beta summarizes a point on the precision-recall curve for a chosen threshold, reflecting the selected recall emphasis.
Category: Example
How do you choose beta for the F-beta Score?
Set beta based on business costs of false negatives versus false positives. Domain experts should quantify priorities, validating with experiments.
Category: Opinion
What is a common misunderstanding about the F-beta Score?
Many assume F-beta automatically optimizes thresholds. It is a metric, not an optimizer; thresholds still require tuning and validation.
Category: Misunderstanding
What risks exist when relying only on the F-beta Score?
Overemphasis on recall or precision can ignore calibration and class coverage. Complement with ROC AUC, lift, and confusion matrix analyses.
Category: Risk
How does F-beta Score compare to ROC AUC?
F-beta focuses on a single threshold and the precision-recall trade-off; ROC AUC aggregates performance across thresholds using TPR and FPR.
Category: Alternatives
Is F-beta Score suitable for multi-class classification?
Yes, by averaging across classes using macro, micro, or weighted schemes. Choice depends on class importance and imbalance.
Category: Requirements
How is the F-beta Score computed?
It is the weighted harmonic mean of precision and recall, with beta controlling recall weight.
Category: Definition