com.indeed.vw.wrapper.progvalidation

Class Metrics

java.lang.Object

com.indeed.vw.wrapper.progvalidation.Metrics

public class Metrics
extends Object

Class that wraps multiple metrics and prints their scores every n examples.

Field Summary

Fields

Modifier and Type	Field and Description
protected int	examplesCount

Constructor Summary

Constructors

Constructor and Description
Metrics(int printScoreEveryNExamples, ProgressiveValidation... validationMetrics)

Method Summary

Modifier and Type	Method and Description
Map<String,Double>	getScores()
void	printScores()
static Metrics	probabilityClassificationMetrics(int printEveryN) Factory method for classification probability metrics
static Metrics	regressionMetrics(int printEveryN) Factory method for regression metrics
void	updateScore(double prediction, double actual)
static Metrics	zeroOneClassificationMetrics(int printEveryN, double decisionThreshold) Factory method for classification 1-0 metrics

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

examplesCount

protected int examplesCount

Constructor Detail

Metrics

public Metrics(int printScoreEveryNExamples,
               ProgressiveValidation... validationMetrics)

Method Detail

regressionMetrics

public static Metrics regressionMetrics(int printEveryN)

Factory method for regression metrics

Parameters:

printEveryN - print score every n example

Returns:

metrics

zeroOneClassificationMetrics

public static Metrics zeroOneClassificationMetrics(int printEveryN,
                                                   double decisionThreshold)

Factory method for classification 1-0 metrics

Parameters:

printEveryN - print score every n example

decisionThreshold - threasold to decide whether prediction is positive or negative

Returns:

metrics

probabilityClassificationMetrics

public static Metrics probabilityClassificationMetrics(int printEveryN)

Factory method for classification probability metrics

Parameters:

printEveryN - print score every n example

Returns:

metrics

updateScore

public void updateScore(double prediction,
                        double actual)

printScores

public void printScores()

getScores

public Map<String,Double> getScores()