This paper introduces PINT (Physics-Informed Neural Time Series Models), a framework that integrates physical constraints into neural time series models to improve their ability to capture complex dynamics. We apply PINT to the ERA5 WeatherBench dataset, focusing on long-term forecasting of 2m-temperature data. PINT incorporates the Simple Harmonic Oscillator Equation as a physics-informed prior, embedding its periodic dynamics into RNN, LSTM, and GRU architectures. This equation's analytical solutions (sine and cosine functions) facilitate rigorous evaluation of the benefits of incorporating physics-informed constraints. By benchmarking against a linear regression baseline derived from its exact solutions, we quantify the impact of embedding physical principles in data-driven models. Unlike traditional time series models that rely on future observations, PINT is designed for practical forecasting. Using only the first 90 days of observed data, it iteratively predicts the next two years, addressing challenges posed by limited real-time updates. Experiments on the WeatherBench dataset demonstrate PINT's ability to generalize, capture periodic trends, and align with physical principl
The stable rotation of young pulsars is often interrupted by two non-deterministic phenomena: glitches and red timing noise. Timing noise provides insights into plasma and nuclear physics under extreme conditions. The framework leverages rotational symmetry in pulsar spin-down models and temporal symmetry in noise processes to achieve computational efficiency, aligning with the journal's focus on symmetry principles in physical systems. In this paper, we apply a novel frequentist framework developed within the PINT software package (v0.9.8) to analyze single-pulsar noise processes. Using 17.5 years of pulse time-of-arrival (TOA) data for the young pulsar PSR J1741-3016, observed with the Nanshan 26 m radio telescope, we investigate its timing properties. In this study, we employed the Downhill Weighted Least-Squares Fitter to estimate the pulsar's spin parameters and position. The Akaike Information Criterion (AIC) was used for model parameter selection. The results obtained with PINT were compared to those from ENTERPRISE and TEMPONEST, two Bayesian-based frameworks. We demonstrate that PINT achieves comparable results with significantly reduced computational costs. Additionally,
This paper presents a compute-efficient approach to pre-training a Language Model-the "1.5-Pints"-in only 9 days, while outperforming state-of-the-art models as an instruction-following assistant.Based on MT-Bench (a benchmark that emulates human judgments), 1.5-Pints outperforms Apple's OpenELM and Microsoft's Phi.This is achieved by a carefully curated pre-training dataset of 57 billion tokens, using a mix of automated workflows and manual human review. The selection of the dataset prioritizes content that is considered expository and "textbook-like" to aid the model in reasoning and logical deduction, culminating in its overall ability as a strong and versatile AI model. In terms of the model architecture, we employed a modified Mistral tokenizer, alongside a Llama-2 architecture for wider compatibility. For training, we adopted the methodologies used by StableLM, TinyLlama, and Huggingface Zephyr. 1.5-Pints demonstrates that by focusing on data quality over quantity in LLM training, we can significantly reduce training time and resources required. We believe this approach will not only make pre-training more accessible but also reduce our carbon footprint. Our findings and reso
PINT is a pure-Python framework for high-precision pulsar timing developed on top of widely used and well-tested Python libraries, supporting both interactive and programmatic data analysis workflows. We present a new frequentist framework within PINT to characterize the single-pulsar noise processes present in pulsar timing datasets. This framework enables the parameter estimation for both uncorrelated and correlated noise processes as well as the model comparison between different timing and noise models in a computationally inexpensive way. We demonstrate the efficacy of the new framework by applying it to simulated datasets as well as a real dataset of PSR B1855+09. We also describe the new features implemented in PINT since it was first described in the literature.
Higher-order nonlinear time-evolution equations have widespread applications in science and engineering, such as in solid mechanics, materials science, and fluid mechanics. This paper mainly studies a direct time-parallel algorithm for solving time-dependent differential equations of orders 1 to 3. Different from the traditional time-stepping approach, we directly solve the all-at-once system from higher-order evolution equations by diagonalization the time discretization matrix $B$. Based on the connection between the characteristic equation and Chebyshev polynomials, we give explicit formulas for the eigenvector matrix $V$ of $B$ and its inverse $V^{-1}$. We prove that $Cond_2\left( V \right) =\mathcal{O} \left( n^3 \right)$, where $n$ is the number of time steps. A direct parallel-in-time algorithm is designed by exploring the structure of the spectral decomposition of $B$. Numerical experiments are provided to show the significant computational speedup of the proposed algorithm.
Commodity network devices support adding in-band telemetry measurements into data packets, enabling a wide range of applications, including network troubleshooting, congestion control, and path tracing. However, including such information on packets adds significant overhead that impacts both flow completion times and application-level performance. We introduce PINT, an in-band telemetry framework that bounds the amount of information added to each packet. PINT encodes the requested data on multiple packets, allowing per-packet overhead limits that can be as low as one bit. We analyze PINT and prove performance bounds, including cases when multiple queries are running simultaneously. PINT is implemented in P4 and can be deployed on network devices. Using real topologies and traffic characteristics, we show that PINT concurrently enables applications such as congestion control, path tracing, and computing tail latencies, using only sixteen bits per packet, with performance comparable to the state of the art.
Over the past few decades, the measurement precision of some pulsar-timing experiments has advanced from ~10 us to ~10 ns, revealing many subtle phenomena. Such high precision demands both careful data handling and sophisticated timing models to avoid systematic error. To achieve these goals, we present PINT (PINT Is Not Tempo3), a high-precision Python pulsar timing data analysis package, which is hosted on GitHub and available on Python Package Index (PyPI) as pint-pulsar. PINT is well-tested, validated, object-oriented, and modular, enabling interactive data analysis and providing an extensible and flexible development platform for timing applications. It utilizes well-debugged public Python packages (e.g., the NumPy and Astropy libraries) and modern software development schemes (e.g., version control and efficient development with git and GitHub) and a continually expanding test suite for improved reliability, accuracy, and reproducibility. PINT is developed and implemented without referring to, copying, or transcribing the code from other traditional pulsar timing software packages (e.g., TEMPO and TEMPO2) and therefore provides a robust tool for cross-checking timing analyses
Time series models are ubiquitous in science, arising in any situation where researchers seek to understand how a system's behaviour changes over time. A key problem in time series modelling is \emph{inference}; determining properties of the underlying system based on observed time series. For both statistical and mechanistic models, inference involves finding parameter values, or distributions of parameters values, for which model outputs are consistent with observations. A wide variety of inference techniques are available and different approaches are suitable for different classes of problems. This variety presents a challenge for researchers, who may not have the resources or expertise to implement and experiment with these methods. PINTS (Probabilistic Inference on Noisy Time Series - https://github.com/pints-team/pints is an open-source (BSD 3-clause license) Python library that provides researchers with a broad suite of non-linear optimisation and sampling methods. It allows users to wrap a model and data in a transparent and straightforward interface, which can then be used with custom or pre-defined error measures for optimisation, or with likelihood functions for Bayesian
We present the mathematical framework of a Domain Decomposition (DD) aproach based on Parallel-in-Time methods (PinT-based approach) for solving the 4D-Var Data Assimilation (DA) model. The main outcome of the proposed DD PinT-based approach is: 1. DA acts as coarse/predictor for the local PDE-based forecasting model, increasing the accuracy of the local solution. 2. The fine and coarse solvers can be used in parallel, increasing the efficiency of the algorithm.3. Data locality is preserved and data movement is reduced, increasing the software scalability. We provide the mathematical framework including convergence analysis and error propagation.
In this paper, we propose a direct parallel-in-time (PinT) algorithm for time-dependent problems with first- or second-order derivative. We use a second-order boundary value method as the time integrator that leads to a tridiagonal time discretization matrix. Instead of solving the corresponding all-at-once system iteratively, we diagonalize the time discretization matrix, which yields a direct parallel implementation across all time levels. A crucial issue on this methodology is how the condition number of the eigenvector matrix $V$ grows as $n$ is increased, where $n$ is the number of time levels. A large condition number leads to large roundoff error in the diagonalization procedure, which could seriously pollute the numerical accuracy. Based on a novel connection between the characteristic equation and the Chebyshev polynomials, we present explicit formulas for computing $V$ and $V^{-1}$, by which we prove that $\mathrm{Cond}_2(V)=\mathcal{O}(n^{2})$. This implies that the diagonalization process is well-conditioned and the roundoff error only increases moderately as $n$ grows and thus, compared to other direct PinT algorithms, a much larger $n$ can be used to yield satisfactor
Cities have recognized the local impact of small craft breweries, in many ways altering municipal codes to make it easier to establish breweries and making them the anchor points of economic development and revitalization. Nevertheless, we do not know the extent to which these strategies impacted changes at the neighborhood level across the nation. In this chapter, we examine the relationship between growth and locations of craft breweries and the incidence of neighborhood change across the United States. In the first part of the chapter, we rely on a unique dataset of geocoded brewery locations that tracks openings and closings from 2004 to the present. Using measures of neighborhood change often found in literature on gentrification-related topics, we develop statistical models relying on census tract demographic and employment data to determine the extent to which brewery locations are associated with social and demographic shifts since 2000. The strongest predictor of whether a craft brewery opened in 2013 or later in a neighborhood was the presence of a prior brewery. We do not find evidence entirely consistent with the common narrative of a link between gentrification and cra
Time parallelization, also known as PinT (Parallel-in-Time) is a new research direction for the development of algorithms used for solving very large scale evolution problems on highly parallel computing architectures. Despite the fact that interesting theoretical work on PinT appeared as early 1964, it was not until 2004, when processor clock speeds reached their physical limit, that research in PinT took off. A distinctive characteristic of parallelization in time is that information flow only goes forward in time, meaning that time evolution processes seem necessarily to be sequential. Nevertheless, many algorithms have been developed over the last two decades to do PinT computations, and they are often grouped into four basic classes according to how the techniques work and are used: shooting-type methods; waveform relaxation methods based on domain decomposition; multigrid methods in space-time; and direct time parallel methods. However, over the past few years, it has been recognized that highly successful PinT algorithms for parabolic problems struggle when applied to hyperbolic problems. We focus in this survey therefore on this important aspect, by first providing a summar
Long-time simulations of evolution equations present substantial computational challenges due to the inherently sequential nature of conventional time-stepping schemes. The parareal method, a leading parallel-in-time (PinT) algorithm, offers a promising approach to overcome the challenge by introducing concurrency in the time domain. While its convergence theory is well-established for linear problems, extending the theory to nonlinear problems, particularly when the problem data have only limited regularity, remains a significant challenge. In this work, we provide the convergence analysis of the parareal algorithm for solving semilinear parabolic equations with an $H^2$ initial data. We employ stable rational approximations and first-order linearization as coarse propagators, establish the linear convergence of the parareal algorithm and provide a sharp estimate for the convergence factor. The analysis combines the error-splitting technique from the superlinear convergence analysis of the parareal method, a refined linear convergence theory for linear parabolic equations, and \textsl{a priori} error estimates that are optimal with respect to the regularity of the problem data. Th
Parallel-in-time (PinT) techniques have been proposed to solve systems of time-dependent differential equations by parallelizing the temporal domain. Among them, Parareal computes the solution sequentially using an inaccurate (fast) solver, and then "corrects" it using an accurate (slow) integrator that runs in parallel across temporal subintervals. This work introduces RandNet-Parareal, a novel method to learn the discrepancy between the coarse and fine solutions using random neural networks (RandNets). RandNet-Parareal achieves speed gains up to x125 and x22 compared to the fine solver run serially and Parareal, respectively. Beyond theoretical guarantees of RandNets as universal approximators, these models are quick to train, allowing the PinT solution of partial differential equations on a spatial mesh of up to $10^5$ points with minimal overhead, dramatically increasing the scalability of existing PinT approaches. RandNet-Parareal's numerical performance is illustrated on systems of real-world significance, such as the viscous Burgers' equation, the Diffusion-Reaction equation, the two- and three-dimensional Brusselator, and the shallow water equation.
AI pipelines that reason quantitatively over technical text depend on input where physical quantities, numbers, units, and symbolic expressions arrive intact; when these entities fragment at tokenization, errors propagate downstream. Byte-Pair Encoding, optimized for vocabulary compression, is blind to such entities and fragments them into arbitrary subwords -- a problem aggravated in technical Brazilian Portuguese. We present TOTEN, a knowledge-based system whose input representation preserves each technical entity as a whole, typed unit: vocabulary is not derived statistically but classified declaratively under a formal ontology of engineering entities (OEE). The core is the triple <O, classify, {inst_tau}>: types, principles, and invariants; a classifier mapping raw text into typed regions; and instantiators yielding a self-descriptive representation. Integrity rests on deterministic coupling to three external authorities: Pint (dimensional), Unicode Character Database (typographic), and RSLP (Portuguese morphology). We evaluate four properties verifiable by construction -- atomicity, dimensional equivalence, typographic robustness, numerical reconstruction -- on an intern
We introduce Prob-GParareal, a probabilistic extension of the GParareal algorithm designed to provide uncertainty quantification for the Parallel-in-Time (PinT) solution of (ordinary and partial) differential equations (ODEs, PDEs). The method employs Gaussian processes (GPs) to model the Parareal correction function, in line with GParareal, further enabling the propagation of numerical uncertainty across time and yielding probabilistic forecasts of the system's evolution. Furthermore, Prob-GParareal accommodates probabilistic initial conditions and maintains compatibility with classical numerical solvers, ensuring its straightforward integration into existing Parareal frameworks. Here, we first conduct a theoretical analysis of the computational complexity and derive error bounds of Prob-GParareal. Then, we numerically demonstrate the accuracy and robustness of the proposed algorithm on five benchmark ODE systems, including chaotic, stiff, and bifurcation problems. To showcase the flexibility and potential scalability of the proposed algorithm, we also consider Prob-nnGParareal, a variant obtained by replacing the GPs in Parareal with the nearest-neighbors GPs, illustrating its in
The timing (cross-)calibration of astronomical instruments is often done by comparing pulsar times-of-arrival (TOAs) to a reference timing model. In high-energy astronomy, the choice of solar system ephemerides and source positions used to barycenter the photon arrival times has a significant impact on the procedure, requiring a full reprocessing of the data each time a new convention is used. Our method, developed as part of the activities of the International Astronomical Consortium for High Energy Calibration (IACHEC), adapts an existing pulsar solution to arbitrary JPL ephemerides and source positions by simulating geocentric TOAs and refitting timing models (implemented with PINT). We validate the procedure and apply it to thousands of observations of the Crab pulsar from 15 missions spanning 1996--2025, demonstrating inter-ephemeris TOA consistency at the $\lesssim5 μ$s level, using the DE200/FK5-based Jodrell Bank Monthly Ephemeris as a common reference. We release the TOAExtractor open-source tool and a TOA database to support future calibration and scientific studies. Instrument timing performance is broadly consistent with mission specifications; the X-ray-to-radio phase
With the advent of supercomputers, multi-processor environments and parallel-in-time (PinT) algorithms offer ways to solve initial value problems for ordinary and partial differential equations (ODEs and PDEs) over long time intervals, a task often unfeasible with sequential solvers within realistic time frames. A recent approach, GParareal, combines Gaussian Processes with traditional PinT methodology (Parareal) to achieve faster parallel speed-ups. The method is known to outperform Parareal for low-dimensional ODEs and a limited number of computer cores. Here, we present Nearest Neighbors GParareal (nnGParareal), a novel data-enriched PinT integration algorithm. nnGParareal builds upon GParareal by improving its scalability properties for higher-dimensional systems and increased processor count. Through data reduction, the model complexity is reduced from cubic to log-linear in the sample size, yielding a fast and automated procedure to integrate initial value problems over long time intervals. First, we provide both an upper bound for the error and theoretical details on the speed-up benefits. Then, we empirically illustrate the superior performance of nnGParareal, compared to G
We present Vela, an efficient, modular, easy-to-use Bayesian pulsar timing and noise analysis package written in Julia. Vela provides an independent, efficient, and parallelized implementation of the full non-linear pulsar timing and noise model along with a Python binding named pyvela. One-time operations such as data file input, clock corrections, and solar system ephemeris computations are performed by pyvela with the help of the PINT pulsar timing package. Its reliability is ensured via careful design utilizing Julia's type system, strict version control, and an exhaustive test suite. This paper describes the design and usage of Vela focusing on the narrowband paradigm.
Protein-protein interactions (PPIs) are critical for various biological processes, and understanding their dynamics is essential for decoding molecular mechanisms and advancing fields such as cancer research and drug discovery. Mutations in PPIs can disrupt protein binding affinity and lead to functional changes and disease. Predicting the impact of mutations on binding affinity is valuable but experimentally challenging. Computational methods, including physics-based and machine learning-based approaches, have been developed to address this challenge. Machine learning-based methods, fueled by extensive PPI datasets such as Ab-Bind, PINT, SKEMPI, and others, have shown promise in predicting binding affinity changes. However, accurate predictions and generalization of these models across different datasets remain challenging. Geometric graph learning has emerged as a powerful approach, combining graph theory and machine learning, to capture structural features of biomolecules. We present GGL-PPI, a novel method that integrates geometric graph learning and machine learning to predict mutation-induced binding free energy changes. GGL-PPI leverages atom-level graph coloring and multi-s