Package {paretoinfer}

Title:	Sequential Identification of Approximately Pareto-Optimal Alternatives under Noise
Version:	0.1.0
Description:	Sequential identification of epsilon-Pareto-optimal alternatives among a finite set with noisy, possibly correlated objectives. Simultaneous anytime-valid confidence sequences for every objective of every alternative (Waudby-Smith and Ramdas, 2024, <doi:10.1093/jrsssb/qkad009>) certify, at any time, which alternatives are epsilon-dominated and which are not, report the estimated frontier, the plausible Pareto set and the certified-dominated set, propose the next alternative to evaluate, and record an auditable result contract.
License:	GPL (≥ 3)
URL:	https://castlaboratory.github.io/paretoinfer/, https://github.com/castlaboratory/paretoinfer
BugReports:	https://github.com/castlaboratory/paretoinfer/issues
Encoding:	UTF-8
RoxygenNote:	8.0.0
Language:	en-GB
Depends:	R (≥ 4.1)
Imports:	cli (≥ 3.6.0), generics, ggplot2 (≥ 3.5.0), rlang (≥ 1.1.0), seqbench (≥ 0.1.0), stats, tibble (≥ 3.2.0), utils
Suggests:	knitr, rmarkdown, testthat (≥ 3.0.0)
Config/testthat/edition:	3
VignetteBuilder:	knitr
NeedsCompilation:	no
Packaged:	2026-10-15 10:47:31 UTC; leite
Author:	André Leite [aut, cre], Raydonal Ospina [aut], Cristiano Ferraz [aut]
Maintainer:	André Leite <leite@castlab.org>
Repository:	CRAN
Date/Publication:	2026-10-24 15:50:01 UTC

paretoinfer: Sequential Identification of Approximately Pareto-Optimal Alternatives under Noise

Description

Sequential identification of epsilon-Pareto-optimal alternatives among a finite set with noisy, possibly correlated objectives. Simultaneous anytime-valid confidence sequences for every objective of every alternative (Waudby-Smith and Ramdas, 2024, doi:10.1093/jrsssb/qkad009) certify, at any time, which alternatives are epsilon-dominated and which are not, report the estimated frontier, the plausible Pareto set and the certified-dominated set, propose the next alternative to evaluate, and record an auditable result contract.

Author(s)

Maintainer: André Leite leite@castlab.org (ORCID)

Authors:

• André Leite leite@castlab.org (ORCID)

• Raydonal Ospina raydonal@castlab.org (ORCID)

• Cristiano Ferraz cferraz@castlab.org (ORCID)

See Also

Useful links:

• https://castlaboratory.github.io/paretoinfer/

• https://github.com/castlaboratory/paretoinfer

• Report bugs at https://github.com/castlaboratory/paretoinfer/issues

Plot the uncertain frontier

Description

Draws, for two objectives, the simultaneous confidence box of every alternative (the product of its two running intersections), its point estimate, and the estimated frontier. The boxes correspond to the actual guarantee: with probability at least 1 - alpha every true mean vector lies in its box at every time. Alternatives are coloured by status.

Usage

## S3 method for class 'paretoinfer_state'
autoplot(object, objectives = c(1L, 2L), ...)

plot_uncertain_frontier(state, objectives = c(1L, 2L))

Arguments

Value

A ggplot.

Examples

design <- pareto_design(alternatives = 3, objectives = 2, bounds = c(0, 1), epsilon = 0.05)
set.seed(1)
ev <- data.frame(alternative = rep(c("A1", "A2", "A3"), each = 40),
                 y1 = runif(120, c(0.1, 0.5, 0.6), c(0.3, 0.7, 0.8)),
                 y2 = runif(120, c(0.6, 0.1, 0.6), c(0.8, 0.3, 0.8)))
autoplot(update_objectives(initialize_pareto(design), ev))

Choose the next alternative(s) to evaluate

Description

Scores every uncertain alternative by the width of its simultaneous confidence box, normalised by the objective ranges and divided by its evaluation cost, and returns the highest-scoring ones. Certified alternatives (dominated or optimal) are never proposed: more evaluations cannot change their certificate. The rule is a heuristic that targets the ambiguous comparisons; it does not affect the validity of the certificates, which holds for any adaptive choice.

Usage

choose_next_evaluation(state, n = 1L)

Arguments

Value

A tibble with columns alternative, score (normalised width per unit cost), width (largest normalised width over objectives) and n_evaluations; zero rows when nothing is uncertain.

Examples

design <- pareto_design(alternatives = 3, objectives = 2, bounds = c(0, 1), epsilon = 0.05)
state <- initialize_pareto(design)
choose_next_evaluation(state, n = 2)

Glance at an identification

Description

Glance at an identification

Usage

## S3 method for class 'paretoinfer_state'
glance(x, ...)

Arguments

Value

A one-row tibble: K, m, alpha, n_evaluations, total_cost, n_frontier, n_plausible, n_certified_optimal, n_uncertain, n_dominated, identified, stopping_reason.

Examples

design <- pareto_design(alternatives = 2, objectives = 2, bounds = c(0, 1), epsilon = 0.1)
glance(initialize_pareto(design))

Initialise a Pareto identification

Description

Initialise a Pareto identification

Usage

initialize_pareto(design)

Arguments

Value

An object of class paretoinfer_state.

Examples

design <- pareto_design(alternatives = 4, objectives = 2, bounds = c(0, 1), epsilon = 0.05)
state <- initialize_pareto(design)
state

Design a sequential Pareto identification problem

Description

Fixes, before any evaluation is seen, the finite set of alternatives, the objectives (all minimised) with their known bounds, the tolerance epsilon that defines practical dominance, the error level, the confidence-sequence boundary and the budget.

Usage

pareto_design(
  alternatives,
  objectives = 2L,
  bounds,
  alpha = 0.05,
  epsilon = 0,
  boundary = "betting",
  cost = 1,
  budget = Inf,
  max_evaluations = Inf,
  c = 0.5
)

Arguments

Value

An object of class pareto_design.

Dominance and guarantee

Alternative j epsilon-dominates k when, for every objective i, mu[j, i] <= mu[k, i] + epsilon[i]: j is at least as good as k up to the tolerance everywhere. The package maintains one confidence sequence per alternative and objective, each at level alpha / (K * m), so that with probability at least 1 - alpha every true mean lies in its running intersection at every time. On that event every certificate the package issues is true: an alternative reported as certified dominated is truly epsilon-dominated by the alternative named, and one reported as certified optimal is truly not epsilon-dominated by any other plausible alternative. When two alternatives certifiably epsilon-dominate each other (an epsilon-tie), only the later one in design order is discarded, so every tie keeps one representative; the discarded one is still truly epsilon-dominated by the alternative named. The guarantee holds under optional stopping, adaptive choice of what to evaluate next and arbitrary dependence between the objectives of one evaluation.

References

Waudby-Smith, I. and Ramdas, A. (2024). Estimating means of bounded random variables by betting. Journal of the Royal Statistical Society: Series B, 86(1), 1–27. doi:10.1093/jrsssb/qkad009

Auer, P., Chiang, C.-K., Ortner, R. and Drugan, M. (2016). Pareto front identification from stochastic bandit feedback. AISTATS 2016, 939–947.

Examples

pareto_design(alternatives = 6, objectives = c("error", "time"), bounds = c(0, 1),
              alpha = 0.05, epsilon = 0.02)

The full report of an identification

Description

Everything needed to audit the result: the design (alternatives, objectives, bounds, tolerance, level and its split, boundary, budget), the evaluations and cost per alternative, the three sets with their certificates, the simultaneous confidence boxes, the stopping reason and the software versions.

Usage

pareto_report(state)

Arguments

Value

A list of class pareto_report.

Examples

design <- pareto_design(alternatives = 2, objectives = 2, bounds = c(0, 1), epsilon = 0.1)
state <- update_objectives(initialize_pareto(design),
  data.frame(alternative = c("A1", "A2"), y1 = c(0.2, 0.8), y2 = c(0.3, 0.9)))
pareto_report(state)

Run an identification to completion with a simulator

Description

Repeats "choose the next alternative, evaluate it, update" until every alternative is certified or the budget is exhausted.

Usage

pareto_run(design, simulate, batch = 1L, initial = 2L, max_rounds = 1e+05)

Arguments

Value

The final paretoinfer_state.

Examples

design <- pareto_design(alternatives = 4, objectives = 2, bounds = c(0, 1), epsilon = 0.05,
                        max_evaluations = 400)
means <- rbind(c(0.2, 0.7), c(0.5, 0.4), c(0.7, 0.2), c(0.6, 0.6))
sim <- function(alternative, n) {
  k <- match(alternative, design$alternatives)
  data.frame(y1 = runif(n, means[k, 1] - 0.1, means[k, 1] + 0.1),
             y2 = runif(n, means[k, 2] - 0.1, means[k, 2] + 0.1))
}
set.seed(1)
state <- pareto_run(design, sim)
state

The three sets of a Pareto identification

Description

The three sets of a Pareto identification

Usage

plausible_pareto_set(state)

Arguments

Value

A list of class pareto_sets with frontier (alternatives whose point estimates are not dominated by the estimate of any other plausible alternative), plausible (not certified dominated), certified_optimal (plausible and certified not epsilon-dominated by any other plausible alternative), uncertain (plausible but not certified), dominated (certified epsilon-dominated), identified (no uncertain alternative left) and table, a tibble with one row per alternative: status, on_estimated_frontier, dominated_by, n_evaluations, cost, cs_empty.

Examples

design <- pareto_design(alternatives = 3, objectives = 2, bounds = c(0, 1), epsilon = 0.05)
state <- initialize_pareto(design)
set.seed(1)
ev <- data.frame(alternative = rep(c("A1", "A2", "A3"), each = 40),
                 y1 = runif(120, c(0.1, 0.5, 0.6), c(0.3, 0.7, 0.8)),
                 y2 = runif(120, c(0.6, 0.1, 0.6), c(0.8, 0.3, 0.8)))
plausible_pareto_set(update_objectives(state, ev))

Objects exported from other packages

Description

These objects are imported from other packages. Follow the links below to see their documentation.

generics

glance(), tidy()

ggplot2

autoplot()

Tidy the confidence boxes

Description

One row per alternative and objective with the point estimate, the running intersection of the confidence sequence, the number of evaluations and the status of the alternative.

Usage

## S3 method for class 'paretoinfer_state'
tidy(x, ...)

Arguments

Value

A tibble with columns alternative, objective, estimate, lower, upper, n_evaluations, status.

Examples

design <- pareto_design(alternatives = 2, objectives = 2, bounds = c(0, 1), epsilon = 0.1)
state <- update_objectives(initialize_pareto(design),
  data.frame(alternative = c("A1", "A2"), y1 = c(0.2, 0.8), y2 = c(0.3, 0.9)))
tidy(state)

Update the identification with new evaluations

Description

Feeds one or more evaluations, each a vector of objective values for one alternative, to the confidence sequences. The running intersections are updated and the three sets are recomputed.

Usage

update_objectives(state, evaluations)

Arguments

Value

The updated state.

Examples

design <- pareto_design(alternatives = c("a", "b"), objectives = c("y1", "y2"),
                        bounds = c(0, 1), epsilon = 0.05)
state <- initialize_pareto(design)
state <- update_objectives(state, data.frame(alternative = c("a", "b", "a"),
                                             y1 = c(0.2, 0.5, 0.25), y2 = c(0.6, 0.3, 0.55)))
state