搜索结果：Ophthalmology. Retina

The human retina contains a complex arrangement of photoreceptors that convert light into visual information. Conventional image sensors mimic the trichromacy of the retina using periodic filter mosaics responsive to three primary colors. However, this is, at best, an approximation, as an actual retina exhibits a quasi-random spatial distribution of light-sensitive rod and cone photoreceptors, where the ratio of rods to cones and their concentrations vary across the retina. Hence, the periodic mosaics are limited to accurately simulate the properties of the eye. Here, we present an image sensor with similar distribution, spacing, ratios and spectral characteristics of an actual foveal mosaic for emulating eye-like sampling and mimicking color blindness. To perform image reconstruction, we use a fully convolutional U-Net neural network adopting the concept of receptive fields in the retinal circuitry. Our research will enable the development of digital twin of a retina to further understand color vision deficiencies.

Standard dynamic vision sensors approximate retinal processing by detecting temporal contrast changes, offering high speed and high dynamic range. In this work, we explore whether incorporating additional biologically inspired processing stages - specifically spatial filtering and gain control - can offer advantages for certain downstream tasks such as saliency prediction. We present the first implementation of a multi-stage Silicon Retina model on the SCAMP-5 Pixel Processor Array, along with a GPU-based simulation framework. We evaluate the performance of our model on Video Intensity Reconstruction and Video Saliency Prediction. While the bio-inspired model is less effective at reconstructing absolute intensity frames, it achieves a 13\% reduction in saliency prediction loss in comparison to standard DVS event representation, while reducing the event rate by approximately 47\%. These experiments are obtained using a lightweight $\approx 100$k-parameter FireNet-style network, adapted from event-based reconstruction to saliency prediction. These results suggest that the silicon retina's "information distillation" mechanism can achieve a more efficient representation for downstream

Deep Neural Networks (DNNs) are vulnerable to elaborately designed adversarial noise, although they have achieved extraordinary success in many tasks. Compared with DNNs, the human visual system is highly robust. However, it is unclear how the human visual system defends against adversarial attacks, especially the role of the early visual system and its influence on the brain manifold. Due to retina gap junctions being crucial for the denoising function in the early visual system, we combine a retina gap junction-based filter, G-filter, with DNN as an abstract human visual system model called the biological hybrid model. We adopt this model to study the defense performance of retina gap junctions and their impact on the brain manifold. Compared with other defense methods, the biological hybrid model is more robust and can be further improved by introducing noise during training. Next, we analyze the manifold and its decision boundary of the biological hybrid model from a geometry perspective. The results show that the biological hybrid model has a unique 2D decision boundary with high nonlinearity and a lower curvature of the decision boundary of the manifold compared to other defe

We introduce a probabilistic model of early visual processing, beginning with the interaction between a light wavefront and the retina. We argue that perception originates not with deterministic transduction, but with probabilistic threshold crossings shaped by quantum photon arrival statistics and biological variability. We formalize this with an uncertainty relation, \( Δα\cdot Δt \geq η\), through the transformation of light into symbolic neural code through the layered retinal architecture. Our model is supported by previous experimental results, which show intrinsic variability in retinal responses even under fixed stimuli. We contrast this with a classical null hypothesis of deterministic encoding and propose experiments to further test our uncertainty relation. By re-framing the retina as a probabilistic measurement device, we lay the foundation for future models of cortical dynamics rooted in quantum-like computation. We are not claiming that the brain could be working as a quantum-system, but rather putting forth the argument that the brain as a classical system could still implement quantum-inspired computations. We define quantum-inspired computation as a scheme that inc

The scientific study of the retina has reached a remarkable state of completion. We can now explain many aspects of early visual processing based on a relatively simple model of neural circuitry in the retina. The same model, with different parameters, produces a great diversity of neural computations. In this article I lay out what that "standard model" is and how it accounts for such a diversity of phenomena. The emergence of such a powerful standard model is unique in systems neuroscience, and I consider what conditions made it possible. The standard model now serves as a baseline from which to organize future retinal research, either by testing the model's assumptions directly, or by identifying phenomena that remain unexplained.

The advent of foundation models (FMs) is transforming medical domain. In ophthalmology, RETFound, a retina-specific FM pre-trained sequentially on 1.4 million natural images and 1.6 million retinal images, has demonstrated high adaptability across clinical applications. Conversely, DINOv2, a general-purpose vision FM pre-trained on 142 million natural images, has shown promise in non-medical domains. However, its applicability to clinical tasks remains underexplored. To address this, we conducted head-to-head evaluations by fine-tuning RETFound and three DINOv2 models (large, base, small) for ocular disease detection and systemic disease prediction tasks, across eight standardized open-source ocular datasets, as well as the Moorfields AlzEye and the UK Biobank datasets. DINOv2-large model outperformed RETFound in detecting diabetic retinopathy (AUROC=0.850-0.952 vs 0.823-0.944, across three datasets, all P<=0.007) and multi-class eye diseases (AUROC=0.892 vs. 0.846, P<0.001). In glaucoma, DINOv2-base model outperformed RETFound (AUROC=0.958 vs 0.940, P<0.001). Conversely, RETFound achieved superior performance over all DINOv2 models in predicting heart failure, myocardial

As demand for immersive experiences grows, displays are moving closer to the eye with smaller sizes and higher resolutions. However, shrinking pixel emitters reduce intensity, making them harder to perceive. Electronic Papers utilize ambient light for visibility, maintaining optical contrast regardless of pixel size, but cannot achieve high resolution. We show electrically tunable meta-pixels down to ~560 nm in size (>45,000 PPI) consisting of WO3 nanodiscs, allowing one-to-one pixel-photodetector mapping on the retina when the display size matches the pupil diameter, which we call Retina Electronic Paper. Our technology also supports video display (25 Hz), high reflectance (~80%), and optical contrast (~50%), which will help create the ultimate virtual reality display.

We propose the design of an original scalable image coder/decoder that is inspired from the mammalians retina. Our coder accounts for the time-dependent and also nondeterministic behavior of the actual retina. The present work brings two main contributions: As a first step, (i) we design a deterministic image coder mimicking most of the retinal processing stages and then (ii) we introduce a retinal noise in the coding process, that we model here as a dither signal, to gain interesting perceptual features. Regarding our first contribution, our main source of inspiration will be the biologically plausible model of the retina called Virtual Retina. The main novelty of this coder is to show that the time-dependent behavior of the retina cells could ensure, in an implicit way, scalability and bit allocation. Regarding our second contribution, we reconsider the inner layers of the retina. We emit a possible interpretation for the non-determinism observed by neurophysiologists in their output. For this sake, we model the retinal noise that occurs in these layers by a dither signal. The dithering process that we propose adds several interesting features to our image coder. The dither noise

The in vivo observation of the human retina at the cellular level is crucial to detect lesions before irreversible visual loss occurs, to follow the time course of retinal diseases and to evaluate and monitor the early effects of treatments. Despite the phenomenal advances in optical coherence tomography (OCT) and adaptive optics systems, in vivo imaging of several retinal cells is still elusive. Here we propose a radically different method compared to OCT, called transscleral optical phase imaging (TOPI), which allows to image retinal cells with high contrast, high resolution, and within an acquisition time suitable for clinical use. TOPI relies on high-angle oblique illumination of the retina, combined with adaptive optics, to enhance the phase contrast of transparent cells. We first present in-vivo images of retinal cells, from the retinal pigment epithelium (RPE) to the nerve and vascular layers of the retina, in eleven healthy volunteers without pupil dilation. The morphology of the cells in vivo is then compared to that of images obtained with the same technique applied on ex vivo human RPE and pig retinas. Finally, we demonstrate the ability of high resolution phase microsco

With a kind of magnetism, the human retina draws the eye of neuroscientist and physicist alike. It is attractive as a self-organizing system, which forms as a part of the central nervous system via biochemical and mechanical cues. The retina is also intriguing as an electro-optical device, converting photons into voltages to perform on-the-fly filtering before the signals are sent to our brain. Here, we consider how the advent of stem cell derived in vitro analogs of the retina, termed retina organoids, opens up an exploration of the interplay between optics, electrics, and mechanics in a complex neuronal network, all in a Petri dish. This review presents state-of-the-art retina organoid protocols by emphasizing links to the biochemical and mechanical signals of in vivo retinogenesis. Electrophysiological recording of active signal processing becomes possible as retina organoids generate light sensitive and synaptically connected photoreceptors. Experimental biophysical tools provide data to steer the development of mathematical models operating at different levels of coarse-graining. In concert, they provide a means to study how mechanical factors guide retina self-assembly. In tu

The rapid adoption of smart grids demands robust security and efficiency measures due to their critical role in delivering electricity and their potential for customer-oriented benefits. This paper presents an innovative framework, named RETINA, which provides a resilient and secure energy trading mechanism within smart grid systems. RETINA tackles the inherent security and infrastructure challenges in smart grids by establishing a trust-based security layer and facilitating energy transactions through blockchain technology. Our proposed solution integrates Public Key Infrastructure (PKI) and the Web of Trust (WoT) concepts, promoting decentralized communication channels and robust key management. We further introduce a smart contract-based energy trading mechanism that factors in trust, distance, and energy type (green or non-green) in cost calculation. The utility and robustness of RETINA have been validated in a virtualized testbed environment with 500 nodes, demonstrating superior performance in terms of scalability and resilience compared to the existing WoT scheme. Furthermore, RETINA successfully enables a secure and efficient energy trading scheme, promoting the use of rene

The increasing interest in spacecraft autonomy and the complex tasks to be accomplished by the spacecraft raise the need for a trustworthy approach to perform Verification & Validation of Guidance, Navigation, and Control algorithms. In the context of autonomous operations, vision-based navigation algorithms have established themselves as effective solutions to determine the spacecraft state in orbit with low-cost and versatile sensors. Nevertheless, detailed testing must be performed on ground to understand the algorithm's robustness and performance on flight hardware. Given the impossibility of testing directly on orbit these algorithms, a dedicated simulation framework must be developed to emulate the orbital environment in a laboratory setup. This paper presents the design of a low-aberration optical facility called RETINA to perform this task. RETINA is designed to accommodate cameras with different characteristics (e.g., sensor size and focal length) while ensuring the correct stimulation of the camera detector. A preliminary design is performed to identify the range of possible components to be used in the facility according to the facility requirements. Then, a detailed

Real-time track tracking in high energy physics experiments at colliders running at high luminosity is very challenging for trigger systems. To perform pattern-recognition and track fitting in online trigger system, the artificial Retina algorithm has been introduced in the field. Retina can be implemented in the state of the art FPGA devices. Our developments use Retina in an iterative way to identify track for barrel-shape tracker embedded in a high magnetic field and with high track multiplicity. As a benchmark we simulate LHC t-tbar events, with a pile-up of 200 and a GEANT-4 based simulation of a 6-layers barrel tracker detector made of silicon modules. With this sample the performance of the hardware design (resource usage, latency) is evaluated. Both efficiency and purity of the Retina fitting are over 90%. Moreover we have also added a Kalman filter after the Retina fit to improve the resolution on the track parameters. Our simulation results show that the Kalman filter can work well together with the Retina algorithm to find track through t-tbar event and provides high resolutions of the reconstructed parameters.

The mechanism of negative group delay (NGD) is used to understand the anticipatory capability of a retina. Experiments with retinas from bull frogs are performed to compare with the predictions of the NGD model. In particulars, whole field stochastic stimulation with various time correlations are used to probe anticipatory responses from the retina. We find that the NGD model can reproduce essential features of experimental observations characterized by the cross correlations between the stimulation and the retinal responses. The prediction horizon of a retina is found to depend on the correlation time of the stimulation as predicted by the NGD model. Experiments with dark and bright Gaussian light pulses further support the NGD mechanism; but only for the dark pulses indicating that the NGD effect of a retina might originate from its OFF response. Our finding suggests that sensory systems capable of using negative feedback for adaptation can give rise to anticipation as a consequence of the delay in the system.

Quantum technologies are rapidly advancing across multiple research domains, with a growing impact on biomedical imaging and sensing. We examine their emerging role in ophthalmology through four complementary directions: photon-limited retinal imaging, correlation based imaging, nanoscale optical probes, and quantum-limited visual perception. Advances in optical coherence tomography and single-photon detection enable imaging under strict photon budget constraints, reducing phototoxicity while preserving image quality. Correlation-based approaches, including ghost imaging, offer alternative strategies for image formation in low-light and scattering environments, although practical implementation remains limited by detection efficiency and acquisition time. In parallel, nanoscale optical platforms such as quantum dots provide tunable and photostable probes for enhanced contrast and targeted delivery, with ongoing challenges related to biocompatibility and clinical translation. Finally, experiments at the single-photon level and with structured light fields demonstrate how the visual system itself operates near physical detection limits and can be probed using controlled optical state

We have developed a multimodal photoacoustic remote sensing (PARS) microscope combined with swept source optical coherence tomography for in vivo, non-contact retinal imaging. Building on the proven strength of multiwavelength PARS imaging, the system is applied for estimating retinal oxygen saturation in the rat retina. The capability of the technology is demonstrated by imaging both microanatomy and the microvasculature of the retina in vivo. To our knowledge this is the first time a non-contact photoacoustic imaging technique is employed for in vivo oxygen saturation measurement in the retina.

The predictive properties of a retina are studied by measuring the mutual information (MI) between its stimulation and the corresponding firing rates while it is being probed by a train of short pulses with stochastic intervals. Features of the measured MI at various time shifts between the stimulation and the response are used to characterize the predictive properties of the retina. By varying the statistical properties of the pulse train, our experiments show that a retina has the ability to predict future events of the stimulation if the information rate of the stimulation is low enough. Also, this predictive property of the retina occurs at a time scale similar to the well established anticipative phenomenon of omitted stimulus response in a retina. Furthermore, a retina can make use of its predictive ability to distinguish between time series created by an Ornstein--Uhlenbeck and a hidden Markovian process.

While looking for evidence of quantum coherent states within the brain, many quantum mind advocates proposed experiments based on the assumption that the coherent state of a photon entering the visual system could somehow be preserved through the neural processing, or in other words they suppose that photons collapse not in the retina, but in the brain cortex. In this paper we show that photons do collapse within the retina and subsequent processing of information at the level of neural membranes proceeds. Moreover, we explicitly stress on the fact that due to existent amplification of the signal produced by each photon, a basic quantum mechanical theorem forbids the photon state to be teleported from the retina to the brain cortex. The changes of the membrane potential of the neurons in the primary visual cortex are shown to be relevant to inputting visual sensory information that is already processed and is not identical to the visual image entering in the retina. A striking evidence for the existent processing of the incoming visual information by the retina is provided by visual illusions resulting from the lateral inhibition mechanism.

Precision medicine in ophthalmology requires accurate longitudinal predictions, but the fragmented nature of multimodal clinical data remains a barrier to forecasting. We introduce OphthaDT, an LLM-based digital twin for ophthalmology that serializes longitudinal patient histories from 3,220 patients across four Phase III clinical trials into structured narratives to forecast best corrected visual acuity (BCVA). In benchmarks spanning up to 100 weeks, OphthaDT demonstrated the lowest prediction error in neovascular age-related macular degeneration (nAMD), achieving an average mean absolute error (MAE) reduction of 6.0% compared to all baselines. In diabetic macular edema (DME), OphthaDT demonstrated competitive performance against all baselines while outperforming Random Forest and XGBoost by an average MAE reduction of 2.6% and 6.9%, respectively. Results reveal that OphthaDT's predictive advantage scales with trajectory complexity: whereas linear models remain effective for the more stable treatment responses of DME, OphthaDT's capacity is better suited for capturing the high longitudinal variability of nAMD. Finally, OphthaDT handles irregular sampling without imputation, positi