On the Measurability of Vacuum Energy

On the Measurability of Vacuum Energy Russell Waller∗ November 4, 2025 Abstract The standard quantum–field–theoretic estimate of vacuum energy density is of order M4 Pl, exceeding the observed value by 10120. This discrepancy is usually interpreted as a failure of the vacuum Hamiltonian. We instead identify it as a failure of an implicit measurement assumption. The vacuum is described by an observer–independent density operator ρvac, while a physical observation is the expectation value Tr(ρvacA(q)) of an operator A(q) determined by the kinematic state qof the detector. For non-inertial (bound) observers, A(q) reduces to the response operator of an Unruh–DeWitt detector with acceleration a, which couples only to modes with ω≲a. The Planckscale contribution to ρvac is therefore mathematically decoupled from the trace, and the operationally accessible energy density scales as ∼a4(or H4). The 10120 mismatch is thus resolved without modifying QFT or GR: the ultraviolet vacuum energy does not enter the semiclassical Einstein equation because it is operationally inaccessible. 1 Introduction The vacuum energy problem arises from comparing two quantities that are never measured in the same way. Quantum field theory predicts a vacuum energy density of order M4 Pl, while cosmological observations infer a value of ∗Manuscript prepared for public release. Comments welcome. 1 order H2 0M2 Pl. The ratio between these two scales is ∼10120, often described as the largest known mismatch between theory and observation. This mismatch is typically framed as a failure of QFT, of general relativity, or of their combination. In all such approaches, it is assumed that the vacuum energy is a single, observer-independent quantity that should appear in both the microscopic theory and the macroscopic measurement. The present work challenges that assumption. We adopt the operational viewpoint that what is experimentally inferred as “vacuum energy” is not a property of the quantum state alone, but of the interaction between the state and the observer. In particular, we model the observer as a physical system with a well-defined acceleration and finite response bandwidth, implemented through an Unruh–DeWitt detector. The key result is that such detectors act as infrared filters: they couple only to modes at or below their characteristic acceleration scale a, and are insensitive to ultraviolet contributions. In this framework, the observed vacuum energy density is not the full expectation value of the quantum stress tensor, but the portion reconstructed by the detector. The 10120 discrepancy is then resolved not by cancelation or fine tuning, but by decoupling: the ultraviolet contribution never appears in the operationally defined observable. 2 Axiom: Observer–Dependent Expectation Rule 2.1 Universal state We assume a single, observer–independent density operator ρ:H → H,(1) defined on a complex Hilbert space H. No collapse postulate is introduced; ρevolves unitarily according to the von Neumann equation iℏdρ dt = [H, ρ].(2) Thus the state of the world is formally mixed (i.e. need not be pure) and is taken to be observer–independent by postulate. 2 2.2 Observers as measurement operators An “observer” is not represented as a subsystem of ρ, but as a choice of Hermitian operator acting on H. We denote this operator by A(q),(3) where the label qspecifies the physical state of the observer, including both •kinematic data (velocity, acceleration), •gravitational embedding (local potential, curvature, horizon structure). Different observers correspond not to different states, but to different operators acting on the same state. 2.3 Trace rule for observed quantities The operational value assigned to an observable is given by the expectation ⟨A(q)⟩= Tr(ρ A(q)) .(4) This reduces to the standard Born rule when A(q) is independent of q. 2.4 Inertial and accelerated limits Inertial (Minkowski) observer. For q=qinertial, the operator reduces to a fixed observable, A(qinertial)=A, (5) and the formalism becomes ordinary quantum mechanics. Uniform acceleration (Unruh limit). For q=qacc, the operator becomes thermal with Unruh temperature TU=ℏa 2πckB .(6) 3 Cosmological (de Sitter) observer. For q=qΛ, the operator is thermal with de Sitter temperature TdS =ℏH 2πkB .(7) These three cases illustrate that the dependence of A(q) on the observer’s kinematic and gravitational state unifies the Unruh and Gibbons–Hawking effects under the single trace rule (4). In Section 4 we apply this rule to show that ultraviolet vacuum energy does not contribute to ⟨A(q)⟩for accelerated observers, resolving the 10120 discrepancy. 3 Reconstruction Effects vs. Ontology 3.1 Failure of the Standard Assumption The conventional formulation treats both wavefunction collapse and the cosmological constant Λ as ontological features of the world. Both lead to foundational inconsistencies: •The collapse postulate cannot be made consistent with unitary evolution. •The observed vacuum energy density differs from the QFT prediction by a factor of 10120. 3.2 Proposed Replacement We replace the assumption of ontological collapse and ontological Λ with a single operational principle: ⟨A(q)⟩= Tr(ρ A(q)). What is conventionally called “collapse” and what is conventionally called “Λ” are both reinterpreted as observer–dependent reconstruction effects arising from different choices of A(q). 4 3.3 Preservation of Local Physics •The universal density operator ρis unchanged; no modification to the Hamiltonian, QFT, or GR is introduced. •Only the observer–dependent operator A(q) varies. •Laboratory observers are effectively inertial, qlab ≈qinertial, so standard quantum mechanics is recovered in all tested regimes. •Unruh and de Sitter effects arise automatically for accelerated and cosmological observers, without introducing additional fields or constants. 3.4 Operational Interpretation of Λ Instead of treating Λ as a universal constant appearing in the Einstein field equations, we define the observed value as Λobs ≡Tr(ρ A(qcosmic)) . Thus Λobs is not a property of the state ρ, but of the operator A(qcosmic) associated with a bound observer in a horizon–bearing spacetime. This places Λ in exact analogy with the Unruh temperature, which likewise arises from the same trace rule under a different observer state q. 4 Dark energy as an observer–dependent reconstruction In this section we show that the observed dark–energy density is not a property of the vacuum state itself, but of the operational procedure by which an accelerating observer extracts expectation values. The key result is that the Planck–scale vacuum energy predicted by quantum field theory (QFT) does not appear in such measurements because the corresponding detector observable has support only on infrared modes determined by its proper acceleration. This removes the 10120 discrepancy without modifying either QFT or general relativity. 5 4.1 Detector as reconstruction operator We model a bound observer (e.g. comoving with a galaxy in an expanding universe) as an Unruh–DeWitt detector with energy gap Ω and proper acceleration a. The measured vacuum energy is defined operationally as ⟨E⟩obs ≡Tr(ρvac A(qa)) ,(8) where ρvac is the Lorentz–invariant vacuum state and A(qa) is the detector observable determined by the observer’s state qa. If A(qa) coupled to all modes of ρvac, one would obtain the usual QFT estimate ⟨E⟩QFT ∼M4 Pl,(9) leading to the standard 10120 fold mismatch with observation. The question is whether a physically realizable detector in fact couples to the ultraviolet modes that dominate this estimate. 4.2 Response function and thermal spectrum The excitation probability of the detector is governed by the response function F(Ω, a), which is exactly the trace F(Ω, a) = Tr(ρvac A(qa)) ,(10) written in the Unruh–DeWitt formalism. The full expression in terms of the Wightman function is given in Appendix A. For constant acceleration and sufficiently adiabatic switching, the response reduces to the standard Planck spectrum [1, 2]: F(Ω, a)∝1 e2πΩ/a −1,(11) corresponding to a thermal bath at the Unruh temperature TU=ℏa 2πckB .(12) Thus the detector does not access the full vacuum spectrum; it returns a finite–temperature response fixed by its acceleration. 6 4.3 Ultraviolet–infrared decoupling Because the detector bandwidth is set by the scale a, modes with frequency ω≫acontribute negligibly to the response. Schematically one may write Tr(ρvac A(qa)) = Tr(ρIR A(qa)) + Tr(ρUV A(qa)) ,(13) with the second term suppressed because A(qa) has no support on the ultraviolet sector. This is not an assumption but the standard consequence of the Unruh detector kernel: the operator A(qa) is effectively an infrared filter with characteristic scale a. 4.4 Resolution of the 10120 problem The cosmological constant problem arises from comparing two inequivalent quantities: ρQFT vac ∼M4 Pl (UV property of the state),(14) ρobs Λ∼H2M2 Pl (IR quantity reconstructed by a bound observer).(15) Our result shows that the mismatch is not a failure of QFT but a mismatch of operational domains. The ultraviolet vacuum energy is present in ρvac, but it does not appear in any trace Tr(ρvacA(q)) performed by an observer with finite acceleration. The only contribution that survives is the finite–temperature term generated by the observer’s own kinematics, of order T4 U∼H4rather than M4 Pl. Thus the “10120 catastrophe” never arises in measurement: the Planck–scale energy is not cancelled or fine–tuned, but is simply inaccessible to any physical reconstruction operator A(q). 5 Relation to Existing Frameworks The central result of Section 4 may be summarized as follows: The Planck-scale vacuum energy predicted by QFT is not “fine–tuned away”; it is operationally inaccessible to any observer with finite acceleration. This mechanism is new, but its motivation intersects several prior approaches. Below we briefly state the points of contact and the distinctions, without assuming any of these frameworks. 7 5.1 Jacobson (1995): Thermodynamics →Einstein Equation Jacobson showed that imposing the Clausius relation δQ =T dS on local Rindler horizons yields the Einstein field equations. His result established a connection between: 1. spacetime curvature, 2. horizon thermodynamics, 3. the Unruh temperature. Our derivation is compatible with Jacobson’s insight, but differs in scope: we do not assume any thermodynamic postulate or gravitational field equation — only the QFT detector response function. 5.2 AdS/CFT and Holographic UV/IR Correspondence In holographic dualities, high-energy (UV) modes in the boundary theory correspond to deep infrared (IR) geometric data in the bulk. Our result is structurally analogous in that UV vacuum modes do not contribute to IR observables, but the present derivation requires neither AdS geometry nor any duality assumption. The decoupling arises entirely from the trace rule Tr(ρA(q)) and the finite bandwidth of the accelerated detector. 5.3 Emergent Gravity Programs Approaches such as Verlinde and Padmanabhan share three motivating principles: 1. gravity is associated with coarse-graining rather than a fundamental field, 2. thermality and entanglement are central to spacetime dynamics, 3. the cosmological constant is not a fundamental parameter. The difference is methodological: these programs modify the gravitational dynamics or introduce new degrees of freedom, whereas the present framework leaves both QFT and GR unchanged and instead identifies an observational constraint on what vacuum energy can be reconstructed. 8 5.4 Summary The present work is distinct in that: •no modification of QFT, GR, or the Einstein equation is introduced, •no entropy postulate or emergent gravity assumption is required, •no appeal is made to holography, AdS geometry, or duality, •the resolution of the vacuum energy problem arises purely from the operational meaning of the trace Tr(ρA(q)) applied to an accelerating observer. The result is therefore not a proposal for modified gravity, but a demonstration that the 10120 discrepancy does not arise once one distinguishes the vacuum energy in the state from the vacuum energy in the measurement. 6 Discussion and Outlook The analysis in Section 4 establishes that the large UV contribution to the vacuum energy in quantum field theory does not appear in operationally defined measurements performed by accelerating observers. The trace rule ⟨A(q)⟩= Tr(ρvac A(q)) together with the Unruh response of the detector observable A(q) implies that only infrared modes contribute to the measured energy density. The Planck-scale term O(M4 Pl) remains present in the state ρvac but is dynamically decoupled from the reconstruction process. 6.1 Summary of Results •The cosmological constant problem is reformulated as a mismatch between the state energy of ρvac and the operationally defined energy accessible to a physical observer. •The decoupling of UV modes follows from standard QFT and the Unruh–DeWitt detector model; no modification of the Hamiltonian, field content, or Einstein gravity is introduced. •The observed dark-energy density is determined by the kinematic properties of the detector, not by the UV structure of the vacuum. 9