extra credit Search 85,062 technologies ⌘K Download for Mac

Evaluations

App Frameworks

Category
Apple frameworks
Docs outline
7 sections

Official docs outline

developer.apple.com
  1. Essentials

    Covers Evaluating language model responses, Designing effective evaluations, Book Tracker: Using Evaluations to evaluate an intelligent feature, Evaluating multimodal prompts.

  2. Datasets

    Covers Generating synthetic datasets, Designing datasets to test your feature, ModelSample, Loader.

  3. Metrics and evaluators

    Covers Designing specific, measurable criteria in an evaluation suite, Metric, Evaluator, MetricsAggregator.

  4. Results

    Covers EvaluationResult, EvaluationRunErrors, ResultColumn, inputColumn.

  5. Model-judge evaluations

    Covers Designing effective model-judge evaluators, Scoring with model-judge evaluators, ModelJudgeEvaluator, ModelJudgePrompt.

  6. Tool-call evaluation

    Covers Evaluating tool-calling behavior, ToolCallEvaluator, TrajectoryExpectation, ArgumentMatcher.

  7. Swift Testing integration

    Covers EvaluationTrait, EvaluationContext.

Each section links to the official page. Titles and summaries by Extra Credit; the docs belong to their authors.

All 394
↑↓ move ↵ open