共找到 20 条结果
3D Gaussian Splatting (3DGS) has significantly advanced 3D scene reconstruction and novel view synthesis. However, like Neural Radiance Fields (NeRF), 3DGS struggles with accurately modeling physical reflections, particularly in mirrors, leading to incorrect reconstructions and inconsistent reflective properties. To address this challenge, we introduce Mirror-3DGS, a novel framework designed to accurately handle mirror geometries and reflections, thereby generating realistic mirror reflections. By incorporating mirror attributes into 3DGS and leveraging plane mirror imaging principles, Mirror-3DGS simulates a mirrored viewpoint from behind the mirror, enhancing the realism of scene renderings. Extensive evaluations on both synthetic and real-world scenes demonstrate that our method can render novel views with improved fidelity in real-time, surpassing the state-of-the-art Mirror-NeRF, especially in mirror regions.
Policy Mirror Descent (PMD) is a popular framework in reinforcement learning, serving as a unifying perspective that encompasses numerous algorithms. These algorithms are derived through the selection of a mirror map and enjoy finite-time convergence guarantees. Despite its popularity, the exploration of PMD's full potential is limited, with the majority of research focusing on a particular mirror map -- namely, the negative entropy -- which gives rise to the renowned Natural Policy Gradient (NPG) method. It remains uncertain from existing theoretical studies whether the choice of mirror map significantly influences PMD's efficacy. In our work, we conduct empirical investigations to show that the conventional mirror map choice (NPG) often yields less-than-optimal outcomes across several standard benchmark environments. Using evolutionary strategies, we identify more efficient mirror maps that enhance the performance of PMD. We first focus on a tabular environment, i.e. Grid-World, where we relate existing theoretical bounds with the performance of PMD for a few standard mirror maps and the learned one. We then show that it is possible to learn a mirror map that outperforms the nega
Do object part localization methods produce bilaterally symmetric results on mirror images? Surprisingly not, even though state of the art methods augment the training set with mirrored images. In this paper we take a closer look into this issue. We first introduce the concept of mirrorability as the ability of a model to produce symmetric results in mirrored images and introduce a corresponding measure, namely the \textit{mirror error} that is defined as the difference between the detection result on an image and the mirror of the detection result on its mirror image. We evaluate the mirrorability of several state of the art algorithms in two of the most intensively studied problems, namely human pose estimation and face alignment. Our experiments lead to several interesting findings: 1) Surprisingly, most of state of the art methods struggle to preserve the mirror symmetry, despite the fact that they do have very similar overall performance on the original and mirror images; 2) the low mirrorability is not caused by training or testing sample bias - all algorithms are trained on both the original images and their mirrored versions; 3) the mirror error is strongly correlated to th
Recently, Neural Radiance Fields (NeRF) has exhibited significant success in novel view synthesis, surface reconstruction, etc. However, since no physical reflection is considered in its rendering pipeline, NeRF mistakes the reflection in the mirror as a separate virtual scene, leading to the inaccurate reconstruction of the mirror and multi-view inconsistent reflections in the mirror. In this paper, we present a novel neural rendering framework, named Mirror-NeRF, which is able to learn accurate geometry and reflection of the mirror and support various scene manipulation applications with mirrors, such as adding new objects or mirrors into the scene and synthesizing the reflections of these new objects in mirrors, controlling mirror roughness, etc. To achieve this goal, we propose a unified radiance field by introducing the reflection probability and tracing rays following the light transport model of Whitted Ray Tracing, and also develop several techniques to facilitate the learning process. Experiments and comparisons on both synthetic and real datasets demonstrate the superiority of our method. The code and supplementary material are available on the project webpage: https://zj
Human motion capture either requires multi-camera systems or is unreliable when using single-view input due to depth ambiguities. Meanwhile, mirrors are readily available in urban environments and form an affordable alternative by recording two views with only a single camera. However, the mirror setting poses the additional challenge of handling occlusions of real and mirror image. Going beyond existing mirror approaches for 3D human pose estimation, we utilize mirrors for learning a complete body model, including shape and dense appearance. Our main contributions are extending articulated neural radiance fields to include a notion of a mirror, making it sample-efficient over potential occlusion regions. Together, our contributions realize a consumer-level 3D motion capture system that starts from off-the-shelf 2D poses by automatically calibrating the camera, estimating mirror orientation, and subsequently lifting 2D keypoint detections to 3D skeleton pose that is used to condition the mirror-aware NeRF. We empirically demonstrate the benefit of learning a body model and accounting for occlusion in challenging mirror scenes.
As artificial intelligence (AI) advances toward superhuman capabilities, aligning these systems with human values becomes increasingly critical. Current alignment strategies rely largely on externally specified constraints that may prove insufficient against future super-intelligent AI capable of circumventing top-down controls. This research investigates whether artificial neural networks (ANNs) can develop patterns analogous to biological mirror neurons cells that activate both when performing and observing actions, and how such patterns might contribute to intrinsic alignment in AI. Mirror neurons play a crucial role in empathy, imitation, and social cognition in humans. The study therefore asks: (1) Can simple ANNs develop mirror-neuron patterns? and (2) How might these patterns contribute to ethical and cooperative decision-making in AI systems? Using a novel Frog and Toad game framework designed to promote cooperative behaviors, we identify conditions under which mirror-neuron patterns emerge, evaluate their influence on action circuits, introduce the Checkpoint Mirror Neuron Index (CMNI) to quantify activation strength and consistency, and propose a theoretical framework for
Multimodal agentic retrieval-augmented generation (RAG) systems expand the attack surface beyond prompt injection to include text poisoning, image injection, direct-query attacks, and orchestrator-level tool manipulation. Existing red-teaming approaches are typically surface-specific and often recycle known attack templates; on text-poisoning benchmarks we measure 73-84% exact duplication. We present MIRROR, a unified cross-surface framework that performs memory-guided Monte Carlo tree search while conditioning candidate generation on retrieved context under an explicit novelty constraint. A deterministic Novelty Gate rejects any candidate matching the retrieval set under normalized comparison, allowing retrieval to inform search priors without enabling prompt copying. Across four attack surfaces on a multimodal agentic RAG target, MIRROR attains 76% ASR on image poisoning compared with 52% for baselines, 97% ASR on orchestrator attacks at half the query cost, and the lowest cross-surface variance (coefficient of variation 0.47). In contrast, specialized baselines collapse across surfaces: suffix optimization reaches 79% ASR on text poisoning but 1% on direct queries. We release AR
We introduce MIRROR, a benchmark comprising eight experiments across four metacognitive levels that evaluates whether large language models can use self-knowledge to make better decisions. We evaluate 16 models from 8 labs across approximately 250,000 evaluation instances using five independent behavioral measurement channels. Core experiments are run across the full model roster; experiments with specialized infrastructure requirements report explicitly marked model subsets. We find two phenomena with direct implications for agentic deployment: (1) compositional self-prediction fails universally -- the Compositional Calibration Error ranges from 0.500 to 0.943 on the original 15-model Exp3-v1 set (and 0.434 to 0.758 on the balanced 16-model Exp3-v2 expansion), indicating that models cannot predict their own performance on multi-domain tasks, and (2) models exhibit above-chance but imperfect domain-specific self-knowledge yet systematically fail to translate even this partial awareness into appropriate agentic action-selection -- external metacognitive control reduces the Confident Failure Rate from 0.600 to 0.143 (76% reduction at temperature 0; mean 70% at temperature 0.7 across
Histopathology and transcriptomics are fundamental modalities in oncology, encapsulating the morphological and molecular aspects of the disease. Multi-modal self-supervised learning has demonstrated remarkable potential in learning pathological representations by integrating diverse data sources. Conventional multi-modal integration methods primarily emphasize modality alignment, while paying insufficient attention to retaining the modality-specific structures. However, unlike conventional scenarios where multi-modal inputs share highly overlapping features, histopathology and transcriptomics exhibit pronounced heterogeneity, offering orthogonal yet complementary insights. Histopathology provides morphological and spatial context, elucidating tissue architecture and cellular topology, whereas transcriptomics delineates molecular signatures through gene expression patterns. This inherent disparity introduces a major challenge in aligning them while maintaining modality-specific fidelity. To address these challenges, we present MIRROR, a novel multi-modal representation learning method designed to foster both modality alignment and retention. MIRROR employs dedicated encoders to extr
3d mirror symmetry is a mysterious duality for certian pairs of hyperkähler manifolds, or more generally complex symplectic manifolds/stacks. In this paper, we will describe its relationships with 2d mirror symmetry. This could be regarded as a 3d analog of the paper "Mirror Symmetry is T-Duality" by Strominger, Yau and Zaslow which described 2d mirror symmetry via 1d dualities.
We prove Kontsevich's homological mirror symmetry conjecture for a large class of mirror pairs of Calabi--Yau hypersurfaces in toric varieties. These mirror pairs were constructed by Batyrev from dual reflexive polytopes. The theorem holds in characteristic zero and in all but finitely many positive characteristics.
We prove the `integrality of Taylor coefficients of mirror maps' conjecture for Greene--Plesser mirror pairs as a natural byproduct of an arithmetic refinement of homological mirror symmetry. We also prove homological mirror symmetry for Greene--Plesser mirror pairs in all characteristics such that the B-side family has good reduction, generalizing work of the fifth author and Smith over the complex numbers. A key technical ingredient is a new versality argument which allows us to work throughout over a Novikov-type ring with integer coefficients.
An optomechanical microcavity can considerably enhance the interaction between light and mechanical motion by confining light to a sub-wavelength volume. However, this comes at the cost of an increased optical loss rate. Therefore, microcavity-based optomechanical systems are placed in the unresolved-sideband regime, preventing sideband-based ground-state cooling. A pathway to reduce optical loss in such systems is to engineer the cavity mirrors, i.e., the optical modes that interact with the mechanical resonator. In our work, we analyze such an optomechanical system, whereby one of the mirrors is strongly frequency-dependent, i.e., a suspended Fano mirror. This optomechanical system consists of two optical modes that couple to the motion of the suspended Fano mirror. We formulate a quantum-coupled-mode description that includes both the standard dispersive optomechanical coupling as well as dissipative coupling. We solve the Langevin equations of the system dynamics in the linear regime showing that ground-state cooling from room temperature can be achieved even if the cavity is per se not in the resolved-sideband regime, but achieves effective sideband resolution through strong o
Large language models are often described as capable of reflective reasoning, yet recursive self-evaluation without external feedback frequently yields reformulation rather than progress. We test this prediction in a cross-provider study of 144 reasoning sequences across three models (OpenAI GPT-4o-mini, Anthropic Claude 3 Haiku, and Google Gemini 2.0 Flash) and four task families (arithmetic, code, explanation, reflection), each iterated ten times under two conditions: ungrounded self-critique and a minimal grounding intervention (a single verification step at iteration three). Mean informational change (delta I, measured via normalized edit distance) declined by 55% from early (0.193) to late (0.087) iterations in ungrounded runs, with consistent patterns across all three providers. Grounded runs showed a +28% rebound in informational change immediately after the intervention and sustained non-zero variance thereafter. Complementary measures-n-gram novelty, embedding drift, and character-level entropy-converged on the same pattern: reflection without contact tends toward informational closure. We interpret this as evidence for a structural limit on self-correction in generative r
We prove Kontsevich's homological mirror symmetry conjecture for certain mirror pairs arising from Batyrev-Borisov's `dual reflexive Gorenstein cones' construction. In particular we prove HMS for all Greene-Plesser mirror pairs (i.e., Calabi-Yau hypersurfaces in quotients of weighted projective spaces). We also prove it for certain mirror Calabi-Yau complete intersections arising from Borisov's construction via dual nef partitions, and also for certain Calabi-Yau complete intersections which do not have a Calabi-Yau mirror, but instead are mirror to a Calabi-Yau subcategory of the derived category of a higher-dimensional Fano variety. The latter case encompasses Kuznetsov's `K3 category of a cubic fourfold', which is mirror to an honest K3 surface; and also the analogous category for a quotient of a cubic sevenfold by an order-3 symmetry, which is mirror to a rigid Calabi-Yau threefold.
Existence of a mirror world in the universe is a fundamental way to restore the observed parity violation in weak interactions and provides the lightest mirror nucleon as a unique GeV-scale dark matter particle candidate. The visible and mirror worlds share the same spacetime of the universe and are connected by a unique space-inversion symmetry -- the mirror parity (P). We conjecture that the mirror parity is respected by the fundamental interaction Lagrangian, and study its spontaneous breaking from minimizing the Higgs vacuum potential. The domain wall problem is resolved by a unique soft breaking linear-term from the P-odd weak-singlet Higgs field. We also derive constraint from the Big-Bang nucleosynthesis. We then analyze the neutrino seesaw for both visible and mirror worlds, and demonstrate that the desired amounts of visible matter and mirror dark matter in the universe arise from a common origin of CP violation in the neutrino sector via leptogenesis. We derive the Higgs mass-spectrum and Higgs couplings with gauge bosons and fermions. We show their consistency with the direct Higgs searches and the indirect precision constraints. We further study the distinctive signatur
One of the deepest unsolved puzzles of subatomic physics is why Nature prefers the left particles to the right ones. Mirror matter is an attempt to understand this mystery by assuming the existence of a "parallel''world where this preference is exactly opposite. Thus in the Universe consisting of the ordinary and the mirror matter the symmetry between the left and right is completely restored. Mirror matter is constrained to interact with us only very weakly. Still, its existence can be inferred by using experimental evidence such as the observation of astrophysical objects related to the dark matter (MACHO), neutrino physics and other sources. This talk will focus on several key aspects of mirror matter physics including the possible existence of mirror matter inside the Earth and the suggestion that the recently observed "isolated" planets may in fact be orbiting around mirror stars.
We introduce an approach to building a custom model from ready-made self-supervised models via their associating instead of training and fine-tuning. We demonstrate it with an example of a humanoid robot looking at the mirror and learning to detect the 3D pose of its own body from the image it perceives. To build our model, we first obtain features from the visual input and the postures of the robot's body via models prepared before the robot's operation. Then, we map their corresponding latent spaces by a sample-efficient robot's self-exploration at the mirror. In this way, the robot builds the solicited 3D pose detector, which quality is immediately perfect on the acquired samples instead of obtaining the quality gradually. The mapping, which employs associating the pairs of feature vectors, is then implemented in the same way as the key-value mechanism of the famous transformer models. Finally, deploying our model for imitation to a simulated robot allows us to study, tune up, and systematically evaluate its hyperparameters without the involvement of the human counterpart, advancing our previous research.
Axion dark matter (DM) produces echo images of bright radio sources via stimulated decay. These images appear as a faint radio line centered at half the axion mass, with the line width set by the DM velocity dispersion. Due to the kinematics of the decay, the echo can be emitted in the direction nearly opposite to the incoming source of stimulating radiation, meaning that axions effectively behave as imperfect monochromatic mirrors. We present an all-sky analysis of axion DM-induced echo images using extragalactic radio point sources, Galactic supernova remnants (SNRs), and Galactic synchrotron radiation (GSR) as sources of stimulating radiation. The aggregate signal strength is not significantly affected by unknown properties of individual sources of stimulating radiation, which we sample from an empirical distribution to generate an ensemble of realizations for the all-sky signal template. We perform forecasts for CHIME, HERA, CHORD, HIRAX, and BURSTT, finding that they can run as competitive axion experiments simultaneously with other objectives, requiring no new hardware.
We present an identity relating the partition function of N=4 supersymmetric QED to that of its dual under mirror symmetry. The identity is a generalized Fourier transform. Many known properties of abelian theories can be derived from this formula, including the mirror transforms for more general gauge and matter content. We show that N=3 Chern-Simons QED and N=4 QED with BF-type couplings are conformal field theories with exactly marginal couplings. Mirror symmetry acts on these theories as strong-weak coupling duality. After identifying the mirror of the gauge coupling (sometimes called the ``magnetic coupling'') we construct a theory which is exactly mirror -- at all scales -- to N=4 SQED. We also study vortex-creation operators in the large $N_f$ limit.