arthur_bench.scoring.readability.Readability#

class arthur_bench.scoring.readability.Readability#

Flesch Reading Ease Score: the higher the score, the easier to read. Scores of 100-90 correlate to a 5th grade reading level, while scores <10 are classified as “Extremely difficult to read, and best understood by university graduates.”

https://en.wikipedia.org/wiki/Flesch%E2%80%93Kincaid_readability_tests

__init__()#

Methods

__init__()

arun(candidate_outputs[, reference_outputs, ...])

Async version of run method.

arun_batch(candidate_batch[, ...])

Async version of run_batch method.

categories()

All possible values returned by the scorer if output type is categorical.

from_dict(config)

Load a scorer from a json configuration file.

is_categorical()

Whether the scorer is continuous or categorical.

name()

Get the name of this Scorer :return: the Scorer name

requires_reference()

True if scorer requires reference output to compute score, False otherwise

run(candidate_outputs[, reference_outputs, ...])

Score a set of test cases.

run_batch(candidate_batch[, ...])

Score a batch of candidate generations.

to_dict([warn])

Provides a json serializable representation of the scorer.

to_metadata()

type()

Supplies whether a scorer is built-in or custom.