Exact Values Still Require Square-Root Query Complexity

Coordinate finite differences plus accelerated projection attain the deterministic rate, while a transcript-consistent hard instance proves it cannot generally be improved.

Editorial Desk·September 20, 2026·4 min readtheoretical

Underlying Paper

Near-Optimal Deterministic Exact-Value Complexity for Smooth Convex Optimization

We study the deterministic oracle complexity of smooth convex optimization when the algorithm receives only exact function values. The objective is a globally $\beta$-smooth convex function, all queries and the final output are restricted to the Euclidean ball of radius $R$, and the unique minimizer lies in the ball of radius $R/2$. We establish an upper bound of $O(d\sqrt{\beta R^2/\epsilon})$ using coordinate finite differences together with an error-robust accelerated projected method. Our main contribution is a matching lower bound, up to the high-accuracy saturation of the construction: any deterministic adaptive value-oracle algorithm requires $\Omega\!\left(d\min\{\sqrt{\beta R^2/\epsilon},(d/\log(ed))^{1/3}\}\right)$ queries. Consequently, the minimax oracle complexity is $\Theta(d\sqrt{\beta R^2/\epsilon})$ throughout the moderate-accuracy regime $\beta R^2(\log(ed)/d)^{2/3}\leq\epsilon\leq c\beta R^2$ for a universal constant $c>0$. The lower bound must account for the fact that a single exact real value can encode arbitrarily much information. To overcome this difficulty, we construct a single fixed smooth convex hard instance using a Moreau-smoothed biased max chain, an exact prefix-shielding mechanism, and batched delayed rotations. These techniques preserve consistency with the full adaptive transcript and establish the optimality of the square-root complexity branch for deterministic bounded-query algorithms.

arXiv:2609.18230Submitted: Sep 17, 2026v1

Exact function values appear unusually informative: in an idealized real-number oracle model, one response can in principle carry unlimited information. That creates a technical obstacle for lower bounds in derivative-free optimization, since a deterministic adaptive algorithm might try to encode and recover far more from values than conventional resisting-oracle arguments permit. This paper studies that issue for globally β\beta-smooth convex objectives over a radius-RR Euclidean ball, assuming the unique minimizer lies within radius R/2R/2.

The central conclusion is that exact values do not eliminate the familiar square-root dependence on target accuracy. In the moderate-accuracy regime, the paper characterizes deterministic exact-value complexity as Θ ⁣(dβR2/ϵ)\Theta\!\left(d\sqrt{\beta R^2/\epsilon}\right). The result is a clean answer for bounded-query algorithms: the cost of recovering enough directional information remains proportional to dimension, even when oracle responses have infinite numerical precision.

Core Contribution

The paper pairs a direct upper bound with a lower-bound construction designed for exact real-valued transcripts. On the algorithmic side, coordinate finite differences estimate gradients from function evaluations, and an error-tolerant accelerated projected method uses those estimates to optimize the smooth convex objective. This gives an upper bound of O ⁣(dβR2/ϵ)O\!\left(d\sqrt{\beta R^2/\epsilon}\right) queries.

The more consequential contribution is the matching lower bound, subject to a high-accuracy saturation term. For every deterministic adaptive value-oracle algorithm, the authors show a requirement of

Ω ⁣(dmin{βR2ϵ,(dlog(ed))1/3})\Omega\!\left(d\min\left\{\sqrt{\frac{\beta R^2}{\epsilon}},\left(\frac{d}{\log(ed)}\right)^{1/3}\right\}\right)

queries. The square-root branch matches the upper bound over the stated moderate-accuracy interval, rather than merely supplying a dimension-dependent obstruction. That distinction matters: a lower bound that ignored exact-value information could fail because its hard instances might be distinguishable from a single carefully chosen oracle response.

Technical Approach

The hard instance is one fixed smooth convex function rather than an oracle that changes adversarially after each query. The construction starts from a biased max chain and applies Moreau smoothing, preserving convexity and controlled smoothness while making the objective compatible with the value-oracle setting. Its purpose is to reveal progress through a sequence of hidden directions only gradually.

Two mechanisms address adaptivity. Exact prefix shielding keeps the function-value transcript consistent with the portions of the construction that have not yet been revealed. Batched delayed rotations then defer the relevant geometry: queries made before a batch becomes exposed cannot reliably identify the directions that govern later progress. Together, these devices prevent an algorithm from exploiting arbitrary precision to shortcut the chain through encoded information in the scalar values.

This is more specific than a standard zero-chain argument. The proof must establish that one globally defined function remains compatible with the entire adaptive transcript, not just with a finite sequence of locally chosen answers. The construction is therefore aimed at the information-model issue itself, while the finite-difference upper bound shows that no more exotic value-only method is needed to meet the rate.

Results and Analysis

The main quantitative statement holds when βR2(log(ed)/d)2/3ϵcβR2\beta R^2(\log(ed)/d)^{2/3}\leq\epsilon\leq c\beta R^2 for a universal constant c>0c>0. In that interval, the lower bound's square-root term is active and matches the O ⁣(dβR2/ϵ)O\!\left(d\sqrt{\beta R^2/\epsilon}\right) upper bound. The paper thus identifies the minimax deterministic complexity, up to constants, rather than only proving that finite differences are sufficient.

Outside that regime, the lower-bound construction saturates at d(d/log(ed))1/3d(d/\log(ed))^{1/3} through its minimum term. This is an explicit boundary on what the presented hard instance establishes at very high accuracy; it should not be read as a full exact characterization there. The result is theoretical, but it sharpens the interpretation of zeroth-order smooth convex optimization: exact arithmetic changes proof techniques, not the moderate-accuracy query rate.

Practitioners designing deterministic derivative-free routines benefit mainly from the negative result. Under these geometric assumptions, efforts to extract substantially more optimization progress from exact scalar evaluations alone face a proved information barrier. Researchers in oracle complexity gain a construction that handles the part conventional adaptive lower-bound templates leave exposed.

Evidence Box

theoretical

Key Claims

  • Coordinate finite differences achieve the deterministic square-root query rate
  • Exact function values do not beat dimension-linear square-root accuracy dependence
  • A fixed smooth convex instance can remain consistent with an adaptive exact-value transcript

Key Results

  • Upper bound O(d√(βR²/ε)) value queries
  • Lower bound Ω(d min{√(βR²/ε), (d/log(ed))^(1/3)}) queries
  • Matching Θ(d√(βR²/ε)) rate for βR²(log(ed)/d)^(2/3) ≤ ε ≤ cβR²

Limitations & Caveats

  • Guarantee restricted to deterministic adaptive value-oracle algorithms
  • Matching characterization only covers the stated moderate-accuracy regime
  • Lower-bound construction saturates at d(d/log(ed))^(1/3) in the high-accuracy branch
  • Assumes global β-smooth convexity and a minimizer within radius R/2

Related Articles

Readers are encouraged to consult the original arXiv paper for complete details. SOTA Papers does not make claims beyond what is supported by the authors' reported evidence.