共找到 20 条结果
Vision-Language Models (VLMs) have demonstrated remarkable success in natural language generation, excelling at instruction following and structured output generation. Knowledge graphs play a crucial role in radiology, serving as valuable sources of factual information and enhancing various downstream tasks. However, generating radiology-specific knowledge graphs presents significant challenges due to the specialized language of radiology reports and the limited availability of domain-specific data. Existing solutions are predominantly unimodal, meaning they generate knowledge graphs only from radiology reports while excluding radiographic images. Additionally, they struggle with long-form radiology data due to limited context length. To address these limitations, we propose a novel multimodal VLM-based framework for knowledge graph generation in radiology. Our approach outperforms previous methods and introduces the first multimodal solution for radiology knowledge graph generation.
LLM based copilot assistants are useful in everyday tasks. There is a proliferation in the exploration of AI assistant use cases to support radiology workflows in a reliable manner. In this work, we present RadPhi-3, a Small Language Model instruction tuned from Phi-3-mini-4k-instruct with 3.8B parameters to assist with various tasks in radiology workflows. While impression summary generation has been the primary task which has been explored in prior works w.r.t radiology reports of Chest X-rays, we also explore other useful tasks like change summary generation comparing the current radiology report and its prior report, section extraction from radiology reports, tagging the reports with various pathologies and tubes, lines or devices present in them etc. In-addition, instruction tuning RadPhi-3 involved learning from a credible knowledge source used by radiologists, Radiopaedia.org. RadPhi-3 can be used both to give reliable answers for radiology related queries as well as perform useful tasks related to radiology reports. RadPhi-3 achieves SOTA results on the RaLEs radiology report generation benchmark.
The European Research and Development for Space based High Contrast Imaging II Workshop, held at MPIA in May 2025, advanced Europe strategic coordination in support of future exoplanet imaging missions such as the Habitable Worlds Observatory and the Large Interferometer for Exoplanets mission. Building on the first 2024 workshop, this meeting defined concrete priorities across eight technical areas, including wavefront sensing, coronagraphs, post processing, nulling interferometry, deformable mirrors, detectors, and telescope design. Discussions emphasized Europe strengths in adaptive optics, ground-based facilities, and interferometry, while identifying key gaps, particularly the need for a dedicated European vacuum testbed for high contrast imaging. The community highlighted near infrared or UV coronagraphy as a promising domain for European leadership and called for joint development of advanced data reduction algorithms, detectors, and cross-mission coordination with HWO and LIFE. The workshop outcomes establish a collaborative roadmap to strengthen Europe technological readiness, foster agency partnerships, and ensure its continued leadership in the next generation of space-b
Small Language Models (SLMs) have shown remarkable performance in general domain language understanding, reasoning and coding tasks, but their capabilities in the medical domain, particularly concerning radiology text, is less explored. In this study, we investigate the application of SLMs for general radiology knowledge specifically question answering related to understanding of symptoms, radiological appearances of findings, differential diagnosis, assessing prognosis, and suggesting treatments w.r.t diseases pertaining to different organ systems. Additionally, we explore the utility of SLMs in handling text-related tasks with respect to radiology reports within AI-driven radiology workflows. We fine-tune Phi-2, a SLM with 2.7 billion parameters using high-quality educational content from Radiopaedia, a collaborative online radiology resource. The resulting language model, RadPhi-2-Base, exhibits the ability to address general radiology queries across various systems (e.g., chest, cardiac). Furthermore, we investigate Phi-2 for instruction tuning, enabling it to perform specific tasks. By fine-tuning Phi-2 on both general domain tasks and radiology-specific tasks related to chest
Energy system optimization models are indispensable for planning the European energy transition. Yet their applicability is constrained by the fundamental trade-off between spatial detail and computational tractability. Modelers often tackle this by spatially aggregating electricity networks. Existing methods, however, neglect differences in voltage levels, reducing them to a single level and thereby overlooking the critical role of transformers in expansion planning. Therefore, we propose a novel voltage-aware network partitioning and aggregation methodology that preserves individual voltage levels and transformers. We demonstrate the effectiveness of this approach and compare it against a voltage-unaware grid aggregation by solving a network expansion problem for a European case study using PyPSA. Our findings show that the proposed methodology preserves up to 70% of the transformer expansion costs in the aggregated model compared to the full grid model, thereby significantly improving the accuracy of investment decisions for transformers in the aggregated grid.
This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning. Radiology-Llama2 is based on the Llama2 architecture and further trained on a large dataset of radiology reports to generate coherent and clinically useful impressions from radiological findings. Quantitative evaluations using ROUGE metrics on the MIMIC-CXR and OpenI datasets demonstrate that Radiology-Llama2 achieves state-of-the-art performance compared to other generative language models, with a Rouge-1 score of 0.4834 on MIMIC-CXR and 0.4185 on OpenI. Additional assessments by radiology experts highlight the model's strengths in understandability, coherence, relevance, conciseness, and clinical utility. The work illustrates the potential of localized language models designed and tuned for specialized domains like radiology. When properly evaluated and deployed, such models can transform fields like radiology by automating rote tasks and enhancing human expertise.
In recent years, the field of radiology has increasingly harnessed the power of artificial intelligence (AI) to enhance diagnostic accuracy, streamline workflows, and improve patient care. Large language models (LLMs) have emerged as particularly promising tools, offering significant potential in assisting radiologists with report generation, clinical decision support, and patient communication. This paper presents an advanced radiology-focused large language model: MGH Radiology Llama. It is developed using the Llama 3 70B model, building upon previous domain-specific models like Radiology-GPT and Radiology-Llama2. Leveraging a unique and comprehensive dataset from Massachusetts General Hospital, comprising over 6.5 million de-identified medical reports across various imaging modalities, the model demonstrates significant improvements in generating accurate and clinically relevant radiology impressions given the corresponding findings. Our evaluation, incorporating both traditional metrics and a GPT-4-based assessment, highlights the enhanced performance of this work over general-purpose LLMs.
The Proton Improvement Plan (PIP-II) to the FNAL accelerator chain and the Long-Baseline Neutrino Facility (LBNF) will provide the world's most intense neutrino beam to the Deep Underground Neutrino Experiment (DUNE) enabling a wide-ranging physics program. This document outlines the significant contributions made by European national laboratories and institutes towards realizing the first phase of the project with a 1.2 MW neutrino beam. Construction of this first phase is well underway. For DUNE Phase II, this will be closely followed by an upgrade of the beam power to > 2 MW, for which the European groups again have a key role and which will require the continued support of the European community for machine aspects of neutrino physics. Beyond the neutrino beam aspects, LBNF is also responsible for providing unique infrastructure to install and operate the DUNE neutrino detectors at FNAL and at the Sanford Underground Research Facility (SURF). The cryostats for the first two Liquid Argon Time Projection Chamber detector modules at SURF, a contribution of CERN to LBNF, are central to the success of the ongoing execution of DUNE Phase I. Likewise, successful and timely procurem
This document is submitted as input to the European Strategy for Particle Physics Update (ESPPU). The U.S.-based Electron-Ion Collider (EIC) aims at understanding how the complex dynamics of confined quarks and gluons makes up nucleons, nuclei and all visible matter, and determines their macroscopic properties. In April 2024, the EIC project received approval for critical-decision 3A (CD-3A) allowing for Long-Lead Procurement, bringing its realization another step closer. The ePIC Collaboration was established in July 2022 around the realization of a general purpose detector at the EIC. The EIC is based in U.S.A. but is characterized as a genuine international project. In fact, a large group of European scientists is already involved in the EIC community: currently, about a quarter of the EIC User Group (consisting of over 1500 scientists) and 29% of the ePIC Collaboration (consisting of $\sim$1000 members) is based in Europe. This European involvement is not only an important driver of the EIC, but can also be beneficial to a number of related ongoing and planned particle physics experiments at CERN. In this document, the connections between the scientific questions addressed at C
We introduce Radiology-GPT, a large language model for radiology. Using an instruction tuning approach on an extensive dataset of radiology domain knowledge, Radiology-GPT demonstrates superior performance compared to general language models such as StableLM, Dolly and LLaMA. It exhibits significant versatility in radiological diagnosis, research, and communication. This work serves as a catalyst for future developments in clinical NLP. The successful implementation of Radiology-GPT is indicative of the potential of localizing generative large language models, specifically tailored for distinctive medical specialties, while ensuring adherence to privacy standards such as HIPAA. The prospect of developing individualized, large-scale language models that cater to specific needs of various hospitals presents a promising direction. The fusion of conversational competence and domain-specific knowledge in these models is set to foster future development in healthcare AI. A demo of Radiology-GPT is available at https://huggingface.co/spaces/allen-eric/radiology-gpt.
At the heart of radiological practice is the challenge of integrating complex imaging data with clinical information to produce actionable insights. Nuanced application of language is key for various activities, including managing requests, describing and interpreting imaging findings in the context of clinical data, and concisely documenting and communicating the outcomes. The emergence of large language models (LLMs) offers an opportunity to improve the management and interpretation of the vast data in radiology. Despite being primarily general-purpose, these advanced computational models demonstrate impressive capabilities in specialized language-related tasks, even without specific training. Unlocking the potential of LLMs for radiology requires basic understanding of their foundations and a strategic approach to navigate their idiosyncrasies. This review, drawing from practical radiology and machine learning expertise and recent literature, provides readers insight into the potential of LLMs in radiology. It examines best practices that have so far stood the test of time in the rapidly evolving landscape of LLMs. This includes practical advice for optimizing LLM characteristic
Axions and other very weakly interacting slim (with $m <$ 1 GeV) particles (WISPs) are a common feature of several extensions of the Standard Model of Particle Physics. The search of WISPs was already recommended in the last update of the European strategy on particle physics (ESPP). After that, the physics case for WISPs has gained additional momentum. Indeed, WISPs may provide a new paradigm to explain the nature of dark matter and puzzling astrophysical and particle physics observations. This document briefly summarizes current searches for WISPs and the perspectives in this research field for the next decade, ranging from their theoretical underpinning, over their indirect observational consequences in astrophysics, to their search in laboratory experiments. It is stressed that in Europe a rich, diverse, and low-cost experimental program is already underway with the potential for one or more game-changing discoveries. In this context, it is also reported the role of the EU funded COST Action ''Cosmic WISPers in the Dark Universe: Theory, astrophysics, and experiments'' (CA21106, https://www.cost.eu/actions/CA21106) in coordinating and supporting WISPs searches in Europe, sha
This document represents a contribution of the United States early career collider physics community to the 2025--2026 update to the European Strategy for Particle Physics. Preferences with regard to different future collider options and R&D priorities were assessed via a survey. The early career community was defined as anyone who is a graduate student, postdoctoral researcher, untenured faculty member, or research scientist under 40 years of age. In total, 105 participants responded to the survey between February and March 10th, 2025. Questions were formulated primarily to gauge the enthusiasm and preferences for different collider options in line with the recommendations of the United States' P5 report, relevant to the European Strategy Update.
Heavy-flavour physics is an essential component of the particle-physics programme, offering critical tests of the Standard Model and far-reaching sensitivity to physics beyond it. Experiments such as LHCb, Belle II, and BESIII drive progress in the field, along with contributions from ATLAS and CMS. The LHCb Upgrade II and upgraded Belle II experiments will provide unique and highly sensitive measurements for decades, playing a key role in the searches for new physics. Future facilities with significant heavy-flavour capabilities will further expand these opportunities. We advocate for a European Strategy that fully supports Upgrade II of LHCb and an upgrade of Belle II, along with their subsequent exploitation. Additionally, we support a long-term plan that fully integrates flavour physics in an $e^+e^-$ collider to run as a $Z$ factory.
The LISA mission is an international collaboration between ESA, its member states, and NASA, for the detection of gravitational waves from space. It was adopted in January 2024 and is scheduled for launch in the mid-2030's. It will be a constellation of three identical spacecraft forming a near-equilateral triangle in an heliocentric orbit, transferring laser beams over $2.5 \cdot 10^6$ km long arms. Laser interferometry is used to track separations between test masses, thus measuring spacetime strain variations as a function of time. LISA Science Objectives tackle many open questions in astrophysics, fundamental physics and cosmology, including ESA's Cosmic Vision questions "What are the fundamental laws of the universe?" and "How did the universe originate and of what is it made?". In this contribution, based on the LISA Red Book, we present a summary of the LISA Science Objectives relevant for the European Strategy for Particle Physics.
Purpose: This study aims to evaluate the effectiveness of large language models (LLMs) in automating disease annotation of CT radiology reports. We compare a rule-based algorithm (RBA), RadBERT, and three lightweight open-weight LLMs for multi-disease labeling of chest, abdomen, and pelvis (CAP) CT reports. Materials and Methods: This retrospective study analyzed 40,833 chest-abdomen-pelvis (CAP) CT reports from 29,540 patients, with 1,789 reports manually annotated across three organ systems. External validation was conducted using the CT RATE dataset. Three open-weight LLMs were tested with zero-shot prompting. Performance was evaluated using Cohen's Kappa ($κ$) and micro/macro-averaged F1 scores. Results: In the internal test set of 12,197 CAP reports from 8,854 patients, Llama-3.1 8B and Gemma-3 27B showed the highest agreement ($κ$ median: 0.87). On the manually annotated set, Gemma-3 27B achieved the top macro-F1 (0.82), followed by Llama-3.1 8B (0.79), while the RBA scored lowest (0.64). On the CT RATE dataset (lungs/pleura labels only), Llama-3.1 8B performed best (0.91), with Gemma-3 27B close behind (0.89). Performance differences were mainly due to differing labeling pra
Recent advances in artificial intelligence have witnessed the emergence of large-scale deep learning models capable of interpreting and generating both textual and imaging data. Such models, typically referred to as foundation models, are trained on extensive corpora of unlabeled data and demonstrate high performance across various tasks. Foundation models have recently received extensive attention from academic, industry, and regulatory bodies. Given the potentially transformative impact that foundation models can have on the field of radiology, this review aims to establish a standardized terminology concerning foundation models, with a specific focus on the requirements of training data, model training paradigms, model capabilities, and evaluation strategies. We further outline potential pathways to facilitate the training of radiology-specific foundation models, with a critical emphasis on elucidating both the benefits and challenges associated with such models. Overall, we envision that this review can unify technical advances and clinical needs in the training of foundation models for radiology in a safe and responsible manner, for ultimately benefiting patients, providers, a
In Regional Economics, the attractiveness of regions for capital, migrants, tourists, and other kinds of flows is a relevant topic. Usually, studies in this field explore single flows, characterizing the dimensions of territorial attractiveness separately, rarely considering the interwoven effect of flows. Here, we investigate attractiveness from a multi-dimensional perspective (i.e., dealing with different flows), asking how various types of regional flows collectively shape the attractiveness dynamics of European regions. We analyze eight distinct flow types across NUTS2 regions from 2010 to 2018, employing a multilayer network approach. Notably, the multilayer approach unveils insights that would be missed in single-layer analyses. Community detection reveals complex structures that demonstrate the cohesive power of national borders and the existence of strong cross-border ties in specific regions. Our study contributes to a more nuanced understanding of regional attractiveness, with implications for targeted policy interventions in regional development and European cohesion.
The European Strategy for Particle Physics (ESPP) - 2026 update is taking place in a turbulent international climate. Many of the norms that have governed relations between states for decades are being broken or challenged. The future progress of science in general, and particle physics in particular, will depend on our ability to maintain peaceful international scientific collaboration in the face of political pressures. We plead that the ESPP 2026 update acknowledge explicitly the importance of peaceful international scientific collaboration, not only for the progress of science, but also as a precious bridge between geopolitical blocs. "Scientific thought is the common heritage of mankind" - Abdus Salam
Major European Union-funded research infrastructure and open science projects have traditionally included dissemination work, for mostly one-way communication of the research activities. Here we present and review our radical re-envisioning of this work, by directly engaging citizen science volunteers into the research. We summarise the citizen science in the Horizon-funded projects ASTERICS (Astronomy ESFRI and Research Infrastructure Clusters) and ESCAPE (European Science Cluster of Astronomy and Particle Physics ESFRI Research Infrastructures), engaging hundreds of thousands of volunteers in providing millions of data mining classifications. Not only does this have enormously more scientific and societal impact than conventional dissemination, but it facilitates the direct research involvement of what is often arguably the most neglected stakeholder group in Horizon projects, the science-inclined public. We conclude with recommendations and opportunities for deploying crowdsourced data mining in the physical sciences, noting that the primary goal is always the fundamental research question; if public engagement is the primary goal to optimise, then other, more targeted approache