共找到 20 条结果
Vision-Language Models (VLMs) have demonstrated remarkable success in natural language generation, excelling at instruction following and structured output generation. Knowledge graphs play a crucial role in radiology, serving as valuable sources of factual information and enhancing various downstream tasks. However, generating radiology-specific knowledge graphs presents significant challenges due to the specialized language of radiology reports and the limited availability of domain-specific data. Existing solutions are predominantly unimodal, meaning they generate knowledge graphs only from radiology reports while excluding radiographic images. Additionally, they struggle with long-form radiology data due to limited context length. To address these limitations, we propose a novel multimodal VLM-based framework for knowledge graph generation in radiology. Our approach outperforms previous methods and introduces the first multimodal solution for radiology knowledge graph generation.
LLM based copilot assistants are useful in everyday tasks. There is a proliferation in the exploration of AI assistant use cases to support radiology workflows in a reliable manner. In this work, we present RadPhi-3, a Small Language Model instruction tuned from Phi-3-mini-4k-instruct with 3.8B parameters to assist with various tasks in radiology workflows. While impression summary generation has been the primary task which has been explored in prior works w.r.t radiology reports of Chest X-rays, we also explore other useful tasks like change summary generation comparing the current radiology report and its prior report, section extraction from radiology reports, tagging the reports with various pathologies and tubes, lines or devices present in them etc. In-addition, instruction tuning RadPhi-3 involved learning from a credible knowledge source used by radiologists, Radiopaedia.org. RadPhi-3 can be used both to give reliable answers for radiology related queries as well as perform useful tasks related to radiology reports. RadPhi-3 achieves SOTA results on the RaLEs radiology report generation benchmark.
Skeletal reaction models are derived for a four-component gasoline surrogate model via an instantaneous local sensitivity analysis technique. The sensitivities of the species mass fractions and the temperature with respect to the reaction rates are estimated by a reduced-order modeling (ROM) methodology. Termed "implicit time-dependent basis CUR (implicit TDB-CUR)," this methodology is based on the CUR matrix decomposition and incorporates implicit time integration for evolving the bases. The estimated sensitivities are subsequently analyzed to develop skeletal reaction models with a fully automated procedure. The 1389-species gasoline surrogate model developed at Lawrence Livermore National Laboratory (LLNL) is selected as the detailed kinetics model. The skeletal reduction procedure is applied to this model in a zero-dimensional constant-pressure reactor over a wide range of initial conditions. The performances of the resulting skeletal models are appraised by comparison against the results via the LLNL detailed model, and also predictions via other skeletal models. Two new skeletal models are developed consisting of 679 and 494 species, respectively. The first is an alternative
Skeletal polyhedra are discrete connected structures consisting of finite (planar or skew) or infinite (linear, planar, or spatial) polygons as faces, with two faces on each edge and a circular vertex figure at each vertex. The present paper describes the blueprint for the snub construction and shows that it can be applied to both regular and chiral skeletal polyhedra in ordinary space. The resulting skeletal snub polyhedra are vertex-transitive and highly locally symmetric. Their properties - from a combinatorial, topological, and geometric perspective - are described and illustrated on some particularly interesting examples. We examine when the construction yields uniform skeletal polyhedra and discuss the completeness of our list of generated structures.
Skeletal editing enables precise structural modifications of molecules at late stages of a synthetic sequence, with applications in drug discovery and materials science. We recently demonstrated skeletal editing on the single-molecule scale. Voltage pulses applied by the tip of a scanning probe microscope to an oxygen-containing seven-membered heterocycle led to both oxygen deletion and ring-contraction rearrangement reactions. An open question is whether selective skeletal editing of a heterocyclic core can be achieved by an appropriate choice of the heteroatom. Here, we show that tip-induced reactions of an analogous sulfur-containing seven-membered ring results in sulfur deletion in virtually all cases. Our results demonstrate that the combination of tip-induced chemistry and heteroatom selection in the molecular design is a powerful strategy for single-molecule skeletal editing, with the potential to enable diverse structural transformations of heterocyclic frameworks.
Small Language Models (SLMs) have shown remarkable performance in general domain language understanding, reasoning and coding tasks, but their capabilities in the medical domain, particularly concerning radiology text, is less explored. In this study, we investigate the application of SLMs for general radiology knowledge specifically question answering related to understanding of symptoms, radiological appearances of findings, differential diagnosis, assessing prognosis, and suggesting treatments w.r.t diseases pertaining to different organ systems. Additionally, we explore the utility of SLMs in handling text-related tasks with respect to radiology reports within AI-driven radiology workflows. We fine-tune Phi-2, a SLM with 2.7 billion parameters using high-quality educational content from Radiopaedia, a collaborative online radiology resource. The resulting language model, RadPhi-2-Base, exhibits the ability to address general radiology queries across various systems (e.g., chest, cardiac). Furthermore, we investigate Phi-2 for instruction tuning, enabling it to perform specific tasks. By fine-tuning Phi-2 on both general domain tasks and radiology-specific tasks related to chest
This paper presents a data-driven approach, referred to as Quantized Skeletal Learning (QSL), for generating skeletal mechanisms. The approach has two key components: (1) a weight vector that can be used to eliminate relatively unimportant species and reactions, and (2) an end-to-end differentiable program whose loss-function gradients, with respect to the weight vector, can be used to adjust those weights. To promote sparsity in the weight vector -- and to reduce the influence of certain reactions or species to zero -- an $l_1$-regularized objective is employed alongside the standard mean squared error loss, thus removing the least important components. The proposed QSL approach is validated by generating skeletal mechanisms for methane and ethylene based on the GRI 3.0 and USC II mechanisms, respectively, demonstrating effectiveness in deriving skeletal mechanisms with various levels of fidelity. Two variants of QSL, designated as QSL-R and QSL-S, are tested; these focus on eliminating reactions and species, respectively. Analysis of ignition delay times and species mass fractions demonstrate QSL's capabilities to reliably and efficiently extract data-driven skeletal mechanisms o
A novel methodology is developed to extract accurate skeletal reaction models for nuclear combustion. Local sensitivities of isotope mass fractions with respect to reaction rates are modeled based on the forced optimally time-dependent (f-OTD) scheme. These sensitivities are then analyzed temporally to generate skeletal models. The methodology is demonstrated by conducting skeletal reduction of constant density and temperature burning of carbon and oxygen relevant to SNe Ia. The 495-isotopes Torch model is chosen as the detailed reaction network. A map of maximum production of $^{56}\text{Ni}$ in SNe Ia is produced for different temperatures, densities, and proton to neutron ratios. The f-OTD simulations and the sensitivity analyses are then performed with initial conditions from this map. A series of skeletal models are derived and their performances are assessed by comparison against currently existing skeletal models. Previous models have been constructed intuitively by assuming the dominance of $α$-chain reactions. The comparison of the newly generated skeletal models against previous models is based on the predicted energy release and $^{44}\text{Ti}$ and $^{56}\text{Ni}$ abun
Skeletal call-by-need is an optimization of call-by-need evaluation also known as "fully lazy sharing": when the duplication of a value has to take place, it is first split into "skeleton", which is then duplicated, and "flesh" which is instead kept shared. Here, we provide two cost analyses of skeletal call-by-need. Firstly, we provide a family of terms showing that skeletal call-by-need can be asymptotically exponentially faster than call-by-need in both time and space; it is the first such evidence, to our knowledge. Secondly, we prove that skeletal call-by-need can be implemented efficiently, that is, with bi-linear overhead. This result is obtained by providing a new smooth presentation of ideas by Shivers and Wand for the reconstruction of skeletons, which is then smoothly plugged into the study of an abstract machine following the distillation technique by Accattoli et al.
In recent years, the field of radiology has increasingly harnessed the power of artificial intelligence (AI) to enhance diagnostic accuracy, streamline workflows, and improve patient care. Large language models (LLMs) have emerged as particularly promising tools, offering significant potential in assisting radiologists with report generation, clinical decision support, and patient communication. This paper presents an advanced radiology-focused large language model: MGH Radiology Llama. It is developed using the Llama 3 70B model, building upon previous domain-specific models like Radiology-GPT and Radiology-Llama2. Leveraging a unique and comprehensive dataset from Massachusetts General Hospital, comprising over 6.5 million de-identified medical reports across various imaging modalities, the model demonstrates significant improvements in generating accurate and clinically relevant radiology impressions given the corresponding findings. Our evaluation, incorporating both traditional metrics and a GPT-4-based assessment, highlights the enhanced performance of this work over general-purpose LLMs.
This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning. Radiology-Llama2 is based on the Llama2 architecture and further trained on a large dataset of radiology reports to generate coherent and clinically useful impressions from radiological findings. Quantitative evaluations using ROUGE metrics on the MIMIC-CXR and OpenI datasets demonstrate that Radiology-Llama2 achieves state-of-the-art performance compared to other generative language models, with a Rouge-1 score of 0.4834 on MIMIC-CXR and 0.4185 on OpenI. Additional assessments by radiology experts highlight the model's strengths in understandability, coherence, relevance, conciseness, and clinical utility. The work illustrates the potential of localized language models designed and tuned for specialized domains like radiology. When properly evaluated and deployed, such models can transform fields like radiology by automating rote tasks and enhancing human expertise.
The principal left ideal graph of a semigroup is a simple graph whose vertices are the non-zero elements of the semigroup, and two vertices are adjacent if their principal left ideals intersect non-trivially. In this paper, we study the structure of the principal ideal graphs of inverse semigroups, particularly symmetric inverse semigroups. We also introduce the concept of skeletal of a graph and show that the principal ideal graph of an inverse semigroup has a skeletal, which is a simple graph with vertex set as $\mathcal{L}$ classes of non-zero elements. It is also proved that the principal ideal graph of symmetric inverse semigroups has a skeletal which is isomorphic to the intersection graph on the power set of a non-empty set.
Recent advances in deep learning have enabled researchers to explore tasks at the intersection of computer vision and natural language processing, such as image captioning, visual question answering, visual dialogue, and visual language navigation. Taking inspiration from image captioning, the task of radiology report generation aims at automatically generating radiology reports by having a comprehensive understanding of medical images. However, automatically generating radiology reports from medical images is a challenging task due to the complexity, diversity, and nature of medical images. In this paper, we outline the design of a robust radiology report generation system by integrating different modules and highlighting best practices drawing upon lessons from our past work and also from relevant studies in the literature. We also discuss the impact of integrating different components to form a single integrated system. We believe that these best practices, when implemented, could improve automatic radiology report generation, augment radiologists in decision making, and expedite diagnostic workflow, in turn improve healthcare and save human lives.
We introduce Radiology-GPT, a large language model for radiology. Using an instruction tuning approach on an extensive dataset of radiology domain knowledge, Radiology-GPT demonstrates superior performance compared to general language models such as StableLM, Dolly and LLaMA. It exhibits significant versatility in radiological diagnosis, research, and communication. This work serves as a catalyst for future developments in clinical NLP. The successful implementation of Radiology-GPT is indicative of the potential of localizing generative large language models, specifically tailored for distinctive medical specialties, while ensuring adherence to privacy standards such as HIPAA. The prospect of developing individualized, large-scale language models that cater to specific needs of various hospitals presents a promising direction. The fusion of conversational competence and domain-specific knowledge in these models is set to foster future development in healthcare AI. A demo of Radiology-GPT is available at https://huggingface.co/spaces/allen-eric/radiology-gpt.
Due to their tunable material properties, sorptive materials have a wide range of applications in energy storage, water treatment, carbon capture, analytical chemistry, and more. One crucial factor in determining the effectiveness of such materials is their skeletal density, or "true density" because it is often used to calculate key metrics, such as storage capacities. In this paper, we present skeletal density measurements through helium pycnometry for several types of adsorbent carbon materials derived from either corncob, sawdust, coffee grounds, polyvinylidene chloride (PVDC), graphitic carbon nitride (GCN), or metal organic frameworks (MOFs). The measured skeletal density of sawdust-based activated carbon was 2.02 +/- 0.05 g/$cm^{ 3}$. The measured skeletal density of coffee-based activated carbon was 2.23 +/- 0.06 $cm^{ 3}$. We also expound upon the impact that skeletal density has upon hydrogen excess adsorption measurements and other calculated engineering quantities. If a skeletal density is underestimated by 10%, it can affect the room temperature excess adsorption by at least 5% at 100 bar and by 7% at 200 bar, depending on the material type.
Skeletal editing of cyclic molecules has garnered considerable attention in the context of drug discovery and green chemistry, with notable examples in solution-phase synthesis. Here, we extend the scope of skeletal editing to the single-molecule scale. We demonstrate tip-induced oxygen deletion and ring contraction of an oxygen-containing seven-membered ring on bilayer NaCl films to generate molecules containing the perylene skeleton. The products were identified and characterized by atomic force and scanning tunneling microscopies, which provided access to bond-resolved molecular structures and orbital densities. Insights into the reaction mechanisms were obtained by density functional theory calculations. Our work expands the toolbox of tip-induced chemistry for single-molecule synthesis.
Radiology report generation aims to automatically provide clinically meaningful descriptions of radiology images such as MRI and X-ray. Although great success has been achieved in natural scene image captioning tasks, radiology report generation remains challenging and requires prior medical knowledge. In this paper, we propose PromptRRG, a method that utilizes prompt learning to activate a pretrained model and incorporate prior knowledge. Since prompt learning for radiology report generation has not been explored before, we begin with investigating prompt designs and categorise them based on varying levels of knowledge: common, domain-specific and disease-enriched prompts. Additionally, we propose an automatic prompt learning mechanism to alleviate the burden of manual prompt engineering. This is the first work to systematically examine the effectiveness of prompt learning for radiology report generation. Experimental results on the largest radiology report generation benchmark, MIMIC-CXR, demonstrate that our proposed method achieves state-of-the-art performance. Code will be available upon the acceptance.
Skeletal animations of large-scale characters are widely used in video games. However, with a large number of characters are involved, relying on the CPU to calculate skeletal animations leads to significant performance problems. There are two main types of traditional GPU- based solutions. One is referred to as pre-baked animation texture technology. The problem with this solution is that it can only play animations from the pre-baked animation. It is impossible to perform interpolation, blending and other calculations on the animation, which affects the quality of the animations. The other solution is referred to as dedicated processing with a simple skeleton hierarchy (the number of skeleton levels < 64). This option does not need to simulate and bake animation data in advance. However, performance is dramatically impaired when processing complex skeletons with too many skeleton levels (such as fluttering clothing, soft plants, dragon-like creatures, etc.). In order to solve these issues, we developed a parallel prefix tree update solution to optimize the animation update process of complex skeletons with too many levels, and combined traditional solutions to implement a GPU-
At the heart of radiological practice is the challenge of integrating complex imaging data with clinical information to produce actionable insights. Nuanced application of language is key for various activities, including managing requests, describing and interpreting imaging findings in the context of clinical data, and concisely documenting and communicating the outcomes. The emergence of large language models (LLMs) offers an opportunity to improve the management and interpretation of the vast data in radiology. Despite being primarily general-purpose, these advanced computational models demonstrate impressive capabilities in specialized language-related tasks, even without specific training. Unlocking the potential of LLMs for radiology requires basic understanding of their foundations and a strategic approach to navigate their idiosyncrasies. This review, drawing from practical radiology and machine learning expertise and recent literature, provides readers insight into the potential of LLMs in radiology. It examines best practices that have so far stood the test of time in the rapidly evolving landscape of LLMs. This includes practical advice for optimizing LLM characteristic
Recent advances in artificial intelligence have witnessed the emergence of large-scale deep learning models capable of interpreting and generating both textual and imaging data. Such models, typically referred to as foundation models, are trained on extensive corpora of unlabeled data and demonstrate high performance across various tasks. Foundation models have recently received extensive attention from academic, industry, and regulatory bodies. Given the potentially transformative impact that foundation models can have on the field of radiology, this review aims to establish a standardized terminology concerning foundation models, with a specific focus on the requirements of training data, model training paradigms, model capabilities, and evaluation strategies. We further outline potential pathways to facilitate the training of radiology-specific foundation models, with a critical emphasis on elucidating both the benefits and challenges associated with such models. Overall, we envision that this review can unify technical advances and clinical needs in the training of foundation models for radiology in a safe and responsible manner, for ultimately benefiting patients, providers, a