Tiebangchui (TBC), is a well-known traditional Tibetan medicine that coexists with toxicity and effects. Highland barley wine is an effective and unique processing method to reduce TBC's toxic side effects. However, the toxicity reduction mechanism is ambiguous and needs to be explored urgently. Meanwhile, the limitations of traditional animal models and two-dimensional (2D) cell culture models urgently require the development of more reliable analytical platforms for drug detection. The integrated metabolomics and biomimetic 3D anisotropic heart-on-a-chip were utilized to reveal the toxicity-attenuating effect of highland barley wine-processed TBC from the dual perspectives of in vitro compositional changes and in vivo toxicity mechanisms. The combination of organ-on-a-chip and metabolomics provides a powerful tool for achieving spatiotemporal control of cell growth and biochemistry, as well as rapid detection of small molecule metabolites. Ultra-performance liquid chromatography-quadrupole time-of-flight mass spectrometry (UPLC-Q-TOF-MS) coupled with global natural products social molecular networking (GNPS) was utilized for the expeditious identification of chemical constituents in both raw and processed TBC products. Multivariate statistical analysis was applied to screen for differential constituents before and after processing, followed by quantification of these constituents using ultra-performance liquid chromatography-triple quadrupole tandem mass spectrometry (UPLC-QqQ-MS/MS). After constructing a 3D heart-on-a-chip model, the structure and function of the chip model were validated via COMSOL finite element analysis, immunofluorescence, and qPCR. Leveraging this chip model, integrating molecular biology and metabolomics was employed to further elucidate the detoxification mechanism by highland barley wine-processed TBC. The comprehensive analytical strategies demonstrated that the loss of the toxic constituents of TBC through leaching during steeping and the esterification of diterpene alkaloids with long-chain fatty acids in highland barley wine to produce less toxic lipid alkaloids were the main mechanisms of toxicity reduction. Furthermore, a biomimetic 3D anisotropic heart-on-a-chip was fabricated to evaluate differences in cardiotoxicity before and after processing. The results illustrated that the raw TBC and aconitine caused a significant increase in the extracellular LDH level, resulting in intracellular Ca2+ overload, substantial ROS production, and metabolite disorders primarily associated with the tricarboxylic acid cycle. This cascade of reactions ultimately led to apoptosis; however, highland barley wine processing of TBC mitigated these cardiotoxic effects. This work not only revealed the toxicity-reducing mechanism of highland barley wine-processed TBC but also provided a novel paradigm for drug toxicity evaluation integrating metabolomics and organ-on-a-chip technologies.
To examine the association between breastfeeding duration and incidence of type 2 diabetes (T2D) across five racial and ethnic groups. Breastfeeding is a potent protective factor for many adverse perinatal outcomes and subsequent chronic disease conditions. Compared to non-breastfeeding parous women, multinational meta-analysis revealed that women who breastfed, especially for a duration extending beyond 12 months, experienced a significant T2D risk reduction later in life. This study will examine the relationship between breastfeeding and T2D in women from five racial and ethnic groups with a range of risks. All multiethnic cohort (MEC) women who completed the 2003-2008 follow-up questionnaire when breastfeeding was assessed. Incident T2D was assessed using self-reported data and administrative data sources. Cox proportional hazards regression of incident T2D with age as the time metric stratified by race and ethnicity estimated its association with breastfeeding adjusted for relevant covariates. After exclusion of prevalent T2D cases, 5122 incident cases were detected. Of these, 53% of women without incident T2D ever breastfed in comparison to 51.8% of those with incident T2D. In women with any number of children, cumulative breastfeeding duration of ≥24 months resulted in an adjusted hazard ratio (HR) of 0.87 [0.78, 0.96], P-value <.01. In models examining any breastfeeding stratified by race and ethnic group, a lower risk was observed only in White women (adjusted HR of 0.87 [0.77,0.98], P-value < .02) while for cumulative duration of ≥24 months a lower risk was observed only in Native Hawaiian women (adjusted HR of 0.65 [0.45,0.93], P-value < .02). Risk of T2D was reduced with cumulative duration of breastfeeding ≥24 months, especially in Native Hawaiian women. Extended breastfeeding should be encouraged as a preventative strategy for T2D prevention, especially in Native Hawaiian women who have a high risk for T2D.
Complex in vitro models (CIVM) offer the potential to improve pharmaceutical clinical drug attrition due to safety and/ or efficacy concerns. For this technology to have an impact, the establishment of robust characterization and qualifi­cation plans constructed around specific contexts of use (COU) is required. This article covers the output from a workshop between the Food and Drug Administration (FDA) and Innovation and Quality Microphysiological Systems (IQ MPS) Affiliate. The intent of the workshop was to understand how CIVM technologies are currently being applied by pharma­ceutical companies during drug development and are being tested at the FDA through various case studies in order to identify hurdles (real or perceived) to the adoption of microphysiological systems (MPS) technologies, and to address evaluation/qualification pathways for these technologies. Output from the workshop includes the alignment on a working definition of MPS, a detailed description of the eleven CIVM case studies presented at the workshop, in-depth analysis, and key take aways from breakout sessions on ADME (absorption, distribution, metabolism, and excretion), pharmacology, and safety that covered topics such as qualification and performance criteria, species differences and concordance, and how industry can overcome barriers to regulatory submission of CIVM data. In conclusion, IQ MPS Affiliate and FDA scientists were able to build a general consensus on the need for animal CIVMs for preclinical species to better determine species concordance. Furthermore, there was acceptance that CIVM technologies for use in ADME, pharmacology and safety assessment will require qualification, which will vary depending on the specific COU.
A reasonable and balanced diet is essential for maintaining good health. With the advancements in deep learning, automated nutrition estimation method based on food images offers a promising solution for monitoring daily nutritional intake and promoting dietary health. While monocular image-based nutrition estimation is convenient, efficient, and economical, the challenge of limited accuracy remains a significant concern. To tackle this issue, we proposed DPF-Nutrition, an end-to-end nutrition estimation method using monocular images. In DPF-Nutrition, we introduced a depth prediction module to generate depth maps, thereby improving the accuracy of food portion estimation. Additionally, we designed an RGB-D fusion module that combined monocular images with the predicted depth information, resulting in better performance for nutrition estimation. To the best of our knowledge, this was the pioneering effort that integrated depth prediction and RGB-D fusion techniques in food nutrition estimation. Comprehensive experiments performed on Nutrition5k evaluated the effectiveness and efficiency of DPF-Nutrition.
Accurate estimation of food nutrition plays a vital role in promoting healthy dietary habits and personalized diet management. Most existing food datasets primarily focus on Western cuisines and lack sufficient coverage of Chinese dishes, which restricts accurate nutritional estimation for Chinese meals. Moreover, many state-of-the-art nutrition prediction methods rely on depth sensors, restricting their applicability in daily scenarios. To address these limitations, we introduce OmniFood8K, a comprehensive multimodal dataset comprising 8,036 food samples, each with detailed nutritional annotations and multi-view images. In addition, to enhance models' capability in nutritional prediction, we construct NutritionSynth-115K, a large-scale synthetic dataset that introduces compositional variations while preserving precise nutritional labels. Moreover, we propose an end-to-end framework for nutritional prediction from a single RGB image. First, we predict a depth map from a single RGB image and design the Scale-Shift Residual Adapter (SSRA) to refine it for global scale consistency and local structural preservation. Second, we propose the Frequency-Aligned Fusion Module (FAFM) to hiera
Nutrition estimation is an important component of promoting healthy eating and mitigating diet-related health risks. Despite advances in tasks such as food classification and ingredient recognition, progress in nutrition estimation is limited due to the lack of datasets with nutritional annotations. To address this issue, we introduce FastFood, a dataset with 84,446 images across 908 fast food categories, featuring ingredient and nutritional annotations. In addition, we propose a new model-agnostic Visual-Ingredient Feature Fusion (VIF$^2$) method to enhance nutrition estimation by integrating visual and ingredient features. Ingredient robustness is improved through synonym replacement and resampling strategies during training. The ingredient-aware visual feature fusion module combines ingredient features and visual representation to achieve accurate nutritional prediction. During testing, ingredient predictions are refined using large multimodal models by data augmentation and majority voting. Our experiments on both FastFood and Nutrition5k datasets validate the effectiveness of our proposed method built in different backbones (e.g., Resnet, InceptionV3 and ViT), which demonstrat
Nutrition estimation of meals from visual data is an important problem for dietary monitoring and computational health, but existing approaches largely rely on single images of the finally completed dish. This setting is fundamentally limited because many nutritionally relevant ingredients and transformations, such as oils, sauces, and mixed components, become visually ambiguous after cooking, making accurate calorie and macronutrient estimation difficult. In this paper, we investigate whether the cooking process information from egocentric cooking videos can contribute to dish-level nutrition estimation. First, we further manually annotated the HD-EPIC dataset and established the first benchmark for video-based nutrition estimation. Most importantly, we propose V-Nutri, a staged framework that combines Nutrition5K-pretrained visual backbones with a lightweight fusion module that aggregates features from the final dish frame and cooking process keyframes extracted from the egocentric videos. V-Nutri also includes a cooking keyframes selection module, a VideoMamba-based event-detection model that targets ingredient-addition moments. Experiments on the HD-EPIC dataset show that proce
Diet plays a critical role in human health, yet tailoring dietary reasoning to individual health conditions remains a major challenge. Nutrition Question Answering (QA) has emerged as a popular method for addressing this problem. However, current research faces two critical limitations. On one hand, the absence of datasets involving user-specific medical information severely limits \textit{personalization}. This challenge is further compounded by the wide variability in individual health needs. On the other hand, while large language models (LLMs), a popular solution for this task, demonstrate strong reasoning abilities, they struggle with the domain-specific complexities of personalized healthy dietary reasoning, and existing benchmarks fail to capture these challenges. To address these gaps, we introduce the Nutritional Graph Question Answering (NGQA) benchmark, the first graph question answering dataset designed for personalized nutritional health reasoning. NGQA leverages data from the National Health and Nutrition Examination Survey (NHANES) and the Food and Nutrient Database for Dietary Studies (FNDDS) to evaluate whether a food is healthy for a specific user, supported by ex
Chest X-ray interpretation is one of the most frequently performed diagnostic tasks in medicine and a primary target for AI development, yet current vision-language models are primarily trained on datasets of paired images and reports, not the cognitive processes and visual attention that underlie clinical reasoning. Here, we present CheXthought, a global, multimodal resource containing 103,592 chain-of-thought reasoning traces and 6,609,082 synchronized visual attention annotations across 50,312 multi-read chest X-rays from 501 radiologists in 71 countries. Our analysis reveals clinical reasoning patterns in how experts deploy distinct visual search strategies, integrate clinical context, and communicate uncertainty. We demonstrate the clinical utility of CheXthought across four dimensions. First, CheXthought reasoning significantly outperforms state-of-the-art vision-language model chain-of-thought in factual accuracy and spatial grounding. Second, visual attention data used as an inference-time hint recovers missed findings and significantly reduces hallucinations. Third, vision-language models trained on CheXthought data achieve significantly stronger pathology classification,
77% of adults over 50 want to age in place today, presenting a major challenge to ensuring adequate nutritional intake. It has been reported that one in four older adults that are 65 years or older are malnourished and given the direct link between malnutrition and decreased quality of life, there have been numerous studies conducted on how to efficiently track nutritional intake of food. Recent advancements in machine learning and computer vision show promise of automated nutrition tracking methods of food, but require a large high-quality dataset in order to accurately identify the nutrients from the food on the plate. Unlike existing datasets, a collection of 3D models with nutritional information allow for view synthesis to create an infinite number of 2D images for any given viewpoint/camera angle along with the associated nutritional information. In this paper, we develop a methodology for collecting high-quality 3D models for food items with a particular focus on speed and consistency, and introduce NutritionVerse-3D, a large-scale high-quality high-resolution dataset of 105 3D food models, in conjunction with their associated weight, food name, and nutritional value. These
In the article we present a general theory of augmented Lagrangian functions for cone constrained optimization problems that allows one to study almost all known augmented Lagrangians for cone constrained programs within a unified framework. We develop a new general method for proving the existence of global saddle points of augmented Lagrangian functions, called the localization principle. The localization principle unifies, generalizes and sharpens most of the known results on existence of global saddle points, and, in essence, reduces the problem of the existence of saddle points to a local analysis of optimality conditions. With the use of the localization principle we obtain first necessary and sufficient conditions for the existence of a global saddle point of an augmented Lagrangian for cone constrained minimax problems via both second and first order optimality conditions. In the second part of the paper, we present a general approach to the construction of globally exact augmented Lagrangian functions. The general approach developed in this paper allowed us not only to sharpen most of the existing results on globally exact augmented Lagrangians, but also to construct first
While agriculture is recognised as vital for improving nutrition, the evidence linking women's participation to sustained nutritional gains remains inconclusive. This review synthesizes studies published between 2000 and 2024 to reflect current agricultural practices and nutritional challenges. We examine how agricultural practices and time use affect nutritional outcomes among rural women through pathways such as income generation food preparation and intra-household labour allocation. A structured methodology with clear inclusion and exclusion criteria was used to assess gender-sensitive and nutrition-sensitive interventions. Using narrative synthesis the review categorizes findings around key themes and contextual factors including socio-economic status seasonality and labour intensity. The results show that while increased involvement in agriculture can boost household dietary diversity and income it also raises time burdens that affect food preparation childcare and self-care. Positive outcomes occur when interventions enhance women's decision-making power income access and use of time-saving technologies whereas negative outcomes emerge when excessive workloads compromise ene
Crop yield production could be enhanced for agricultural growth if various plant nutrition deficiencies, and diseases are identified and detected at early stages. The deep learning methods have proven its superior performances in the automated detection of plant diseases and nutrition deficiencies from visual symptoms in leaves. This article proposes a new deep learning method for plant nutrition deficiencies and disease classification using a graph convolutional network (GNN), added upon a base convolutional neural network (CNN). Sometimes, a global feature descriptor might fail to capture the vital region of a diseased leaf, which causes inaccurate classification of disease. To address this issue, regional feature learning is crucial for a holistic feature aggregation. In this work, region-based feature summarization at multi-scales is explored using spatial pyramidal pooling for discriminative feature representation. A GCN is developed to capacitate learning of finer details for classifying plant diseases and insufficiency of nutrients. The proposed method, called Plant Nutrition Deficiency and Disease Network (PND-Net), is evaluated on two public datasets for nutrition deficien
Accurate nutrition estimation helps people make informed dietary choices and is essential in the prevention of serious health complications. We present NutriBench, the first publicly available natural language meal description nutrition benchmark. NutriBench consists of 11,857 meal descriptions generated from real-world global dietary intake data. The data is human-verified and annotated with macro-nutrient labels, including carbohydrates, proteins, fats, and calories. We conduct an extensive evaluation of NutriBench on the task of carbohydrate estimation, testing twelve leading Large Language Models (LLMs), including GPT-4o, Llama3.1, Qwen2, Gemma2, and OpenBioLLM models, using standard, Chain-of-Thought and Retrieval-Augmented Generation strategies. Additionally, we present a study involving professional nutritionists, finding that LLMs can provide comparable but significantly faster estimates. Finally, we perform a real-world risk assessment by simulating the effect of carbohydrate predictions on the blood glucose levels of individuals with diabetes. Our work highlights the opportunities and challenges of using LLMs for nutrition estimation, demonstrating their potential to aid
With diet and nutrition apps reaching 1.4 billion users in 2022 [1], it's not surprise that popular health apps, MyFitnessPal, Noom, and Calorie Counter, are surging in popularity. However, one major setback [2] of nearly all nutrition applications is that users must enter food data manually, which is time-consuming and tedious. Thus, there has been an increasing demand for applications that can accurately identify food items, analyze their nutritional content, and offer dietary recommendations in real-time. This paper introduces a comprehensive system that combines advanced computer vision techniques with nutritional analysis, implemented in a versatile mobile and web application. The system is divided into three key concepts: 1) food detection using the YOLOv8 model, 2) nutrient analysis via the Edamam Nutrition Analysis API, and 3) personalized meal recommendations using the Edamam Meal Planning and Recipe Search APIs. Preliminary results showcase the system's effectiveness by providing immediate, accurate dietary insights, with a demonstrated food recognition accuracy of nearly 80%, making it a valuable tool for users to make informed dietary decisions.
Large Multimodal Models (LMMs) are increasingly applied to meal images for nutrition analysis. However, existing work primarily evaluates proprietary models, such as GPT-4. This leaves the broad range of LLMs underexplored. Additionally, the influence of integrating contextual metadata and its interaction with various reasoning modifiers remains largely uncharted. This work investigates how interpreting contextual metadata derived from GPS coordinates (converted to location/venue type), timestamps (transformed into meal/day type), and the food items present can enhance LMM performance in estimating key nutritional values. These values include calories, macronutrients (protein, carbohydrates, fat), and portion sizes. We also introduce \textbf{ACETADA}, a new food-image dataset slated for public release. This open dataset provides nutrition information verified by the dietitian and serves as the foundation for our analysis. Our evaluation across eight LMMs (four open-weight and four closed-weight) first establishes the benefit of contextual metadata integration over straightforward prompting with images alone. We then demonstrate how this incorporation of contextual information enhan
Many approaches for addressing Global Optimization problems typically rely on relaxations of nonlinear constraints over specific mathematical primitives. This is restricting in applications with constraints that are black-box, implicit or consist of more general primitives. Trying to address such limitations, Bertsimas and Ozturk (2023) proposed OCTHaGOn as a way of solving black-box global optimization problems by approximating the nonlinear constraints using hyperplane-based Decision-Trees and then using those trees to construct a unified mixed integer optimization (MIO) approximation of the original problem. We provide extensions to this approach, by (i) approximating the original problem using other MIO-representable ML models besides Decision Trees, such as Gradient Boosted Trees, Multi Layer Perceptrons and Suport Vector Machines, (ii) proposing adaptive sampling procedures for more accurate machine learning-based constraint approximations, (iii) utilizing robust optimization to account for the uncertainty of the sample-dependent training of the ML models, and (iv) leveraging a family of relaxations to address the infeasibilities of the final MIO approximation. We then test t
Diet plays a central role in human health, and Nutrition Question Answering (QA) offers a promising path toward personalized dietary guidance and the prevention of diet-related chronic diseases. However, existing methods face two fundamental challenges: the limited reasoning capacity of single-agent systems and the complexity of designing effective multi-agent architectures, as well as contextual overload that hinders accurate decision-making. We introduce Nutritional-Graph Router (NG-Router), a novel framework that formulates nutritional QA as a supervised, knowledge-graph-guided multi-agent collaboration problem. NG-Router integrates agent nodes into heterogeneous knowledge graphs and employs a graph neural network to learn task-aware routing distributions over agents, leveraging soft supervision derived from empirical agent performance. To further address contextual overload, we propose a gradient-based subgraph retrieval mechanism that identifies salient evidence during training, thereby enhancing multi-hop and relational reasoning. Extensive experiments across multiple benchmarks and backbone models demonstrate that NG-Router consistently outperforms both single-agent and ense
AI has driven significant progress in the nutrition field, especially through multimedia-based automatic dietary assessment. However, existing automatic dietary assessment systems often overlook critical non-visual factors, such as recipe-specific ingredient substitutions that can significantly alter nutritional content, and rarely account for individual dietary needs, including allergies, restrictions, cultural practices, and personal preferences. In Switzerland, while food-related information is available, it remains fragmented, and no centralized repository currently integrates all relevant nutrition-related aspects within a Swiss context. To bridge this divide, we introduce the Swiss Food Knowledge Graph (SwissFKG), the first resource, to our best knowledge, to unite recipes, ingredients, and their substitutions with nutrient data, dietary restrictions, allergen information, and national nutrition guidelines under one graph. We establish a LLM-powered enrichment pipeline for populating the graph, whereby we further present the first benchmark of four off-the-shelf (<70 B parameter) LLMs for food knowledge augmentation. Our results demonstrate that LLMs can effectively enrich
Personalized nutrition management aims to tailor dietary guidance to an individual's intake and phenotype, but most existing systems handle food logging, nutrient analysis and recommendation separately. We present a next-generation mobile nutrition assistant that combines image based meal logging with an LLM driven multi agent controller to provide meal level closed loop support. The system coordinates vision, dialogue and state management agents to estimate nutrients from photos and update a daily intake budget. It then adapts the next meal plan to user preferences and dietary constraints. Experiments with SNAPMe meal images and simulated users show competitive nutrient estimation, personalized menus and efficient task plans. These findings demonstrate the feasibility of multi agent LLM control for personalized nutrition and reveal open challenges in micronutrient estimation from images and in large scale real world studies.