We study a stochastic multi-armed bandit problem in which the set of available arms expands over time. This setting arises in sequential experimentation when new actions or treatments become available during an ongoing study, making regret against a single best arm in hindsight inappropriate. We instead evaluate performance relative to the best arm currently available, leading to a dynamic-regret criterion for arriving-arm environments. To address the resulting challenges of arrival information discrepancy (AID) and a drifting benchmark (DB), we propose UCB for Arriving Arms (UCB-AA), an elimination-based procedure with an aiding preliminary screening step for newly arrived arms before full competition with incumbent arms. We show that UCB-AA attains regret bounds that depend explicitly on the arrival process, achieves sublinear dynamic regret under regularity conditions on gap evolution, and admits an online extension for unknown horizons. Simulation results show that UCB-AA reduces wasted pulls and maintains a smaller active arm set while preserving competitive regret performance.
This article proposes a mobile quad-arm robot: ARMS, which unifies wheeled-legged tripedal locomotion, wheeled locomotion, and quad-arm loco-manipulation. ARMS's four arms have different mechanisms and are partially designed to be general-purpose arms for the hybrid locomotion and loco-manipulation. One three-degree-of-freedom (DOF) arm has an active wheel, which is used for wheeled-legged tripedal walking and wheeled driving with passive wheels attached to the torso. Two three-DOF general-purpose arms are series elastic and used for wheeled-legged tripedal walking, object grasping, and manipulation. The upper two-DOF arm is used for manipulation only; its position and orientation are determined by coordinating all arms. Each motor is controlled by an angle controller and trajectory modification with angle, angular velocity, angular acceleration, and torque constraints. ARMS was verified with seven experiments involving joint control, wheeled-legged locomotion, wheeled locomotion and grasping, slope locomotion, block terrain locomotion, carrying a bag, and outdoor locomotion.
Mapping the Milky Way spiral arms in the vertical direction remains a challenging task that has received little attention. Taking advantage of recent results that link the position of the Galactic spiral arms to metal-rich regions in the disc, we analyse a sample of young giant stars from {\it Gaia} DR3 and use their metallicity distribution to produce a 3D metallicity excess map. The map shows signatures of the spiral arms, whose vertical height vary across the Galactic disc, reaching up to 400 pc in amplitude and exhibiting vertical asymmetries with respect to the mid-plane. Specifically, the Perseus arm displays a high vertical asymmetry consistent with the Galactic warp. Moreover, we find evidence of a metal-rich stellar structure that undulates vertically, nearly in phase with the arrangement of star-forming regions named the Radcliffe Wave. This new structure is larger and extends beyond the Radcliffe Wave, reaching vertical amplitudes of $\sim$ 270 pc and extending for at least 4 kpc in length. We confirm that for at least half of its length this Extended Radcliffe Wave is the inner edge of the Local Arm. The finding of a metal-rich stellar counterpart of the Radcliffe Wave
Open Arms is a novel open-source platform of realistic human-like robotic hands and arms hardware with 28 Degree-of-Freedom (DoF), designed to extend the capabilities and accessibility of humanoid robotic grasping and manipulation. The Open Arms framework includes an open SDK and development environment, simulation tools, and application development tools to build and operate Open Arms. This paper describes these hands controls, sensing, mechanisms, aesthetic design, and manufacturing and their real-world applications with a teleoperated nursing robot. From 2015 to 2022, the authors have designed and established the manufacturing of Open Arms as a low-cost, high functionality robotic arms hardware and software framework to serve both humanoid robot applications and the urgent demand for low-cost prosthetics, as part of the Hanson Robotics Sophia Robot platform. Using the techniques of consumer product manufacturing, we set out to define modular, low-cost techniques for approximating the dexterity and sensitivity of human hands. To demonstrate the dexterity and control of our hands, we present a Generative Grasping Residual CNN (GGR-CNN) model that can generate robust antipodal gras
Generally, identifying the spiral arms of a spiral galaxy is not a hard task. However, defining the main characteristics, width and length of those structure is not a common task. Previous studies have used different tracers: Star clusters, Massers, H$α$. It was until recently that individual stars were used as tracers of spiral structures. The basic method of measuring the width of spiral arms assumes a Gaussian distribution around the mean concentration, either of gas or other tracer. In this work we use NGC 5236's stars as tracers. We estimated the surface stellar density of arms and inter-arm regions to measure the width of the arms. As a test case, this works focused on NGC 5236 (M83). We find that field stellar populations can trace the (two) main spiral arms of NGC 5236. We find a correlation between the arm width and the galactocentric radii, found using other tracers. The slope of the growth of the width of the arm correlates with the morphological types of spiral galaxies. A second finding of our study suggest the possible correlation between the width of the arms and the corrotation radius, result that will be presented in a follow up paper.
We define a general framework for a large class of combinatorial multi-armed bandit (CMAB) problems, where subsets of base arms with unknown distributions form super arms. In each round, a super arm is played and the base arms contained in the super arm are played and their outcomes are observed. We further consider the extension in which more based arms could be probabilistically triggered based on the outcomes of already triggered arms. The reward of the super arm depends on the outcomes of all played arms, and it only needs to satisfy two mild assumptions, which allow a large class of nonlinear reward instances. We assume the availability of an offline (α,β)-approximation oracle that takes the means of the outcome distributions of arms and outputs a super arm that with probability β generates an α fraction of the optimal expected reward. The objective of an online learning algorithm for CMAB is to minimize (α,β)-approximation regret, which is the difference between the αβ fraction of the expected reward when always playing the optimal super arm, and the expected reward of playing super arms according to the algorithm. We provide CUCB algorithm that achieves O(log n) distribution
We report the discovery of two symmetric spiral arms in the near-infrared (NIR) images of the starburst galaxy M82. The spiral arms are recovered when an axi-symmetric exponential disk is subtracted from the NIR images. The arms emerge from the ends of the NIR bar and can be traced up to three disk scalelengths. The winding of the arms is consistent with an m=2 logarithmic spiral mode of pitch angle 14 degrees. The arms are bluer than the disk in spite of their detection on the NIR images. If the northern side of the galaxy is nearer to us, as is normally assumed, the observed sense of rotation implies trailing arms. The nearly edge-on orientation, high disk surface brightness, and the presence of a complex network of dusty filaments in the optical images, are responsible for the lack of detection of the arms in previous studies.
Potential advancements in artificial intelligence (AI) could have profound implications for how countries research and develop weapons systems, and how militaries deploy those systems on the battlefield. The idea of AI-enabled military systems has motivated some activists to call for restrictions or bans on some weapon systems, while others have argued that AI may be too diffuse to control. This paper argues that while a ban on all military applications of AI is likely infeasible, there may be specific cases where arms control is possible. Throughout history, the international community has attempted to ban or regulate weapons or military systems for a variety of reasons. This paper analyzes both successes and failures and offers several criteria that seem to influence why arms control works in some cases and not others. We argue that success or failure depends on the desirability (i.e., a weapon's military value versus its perceived horribleness) and feasibility (i.e., sociopolitical factors that influence its success) of arms control. Based on these criteria, and the historical record of past attempts at arms control, we analyze the potential for AI arms control in the future and
The origin and types of spiral arms are reviewed with an emphasis on the connections between these arms and star formation. Flocculent spiral arms are most likely the result of transient instabilities in the gas that promote dense cloud formation, star formation, and generate turbulence. Long irregular spiral arms are usually initiated by gravitational instabilities in the stars, with the gas contributing to and following these instabilities, and star formation in the gas. Global spiral arms triggered by global perturbations, such as a galaxy interaction, can be wavemodes with wave reflection in the inner regions. They might grow and dominate the disk for several rotations before degenerating into higher-order modes by non-linear effects. Interstellar gas flows through these global arms, and through the more transient stellar spiral arms as well, where it can reach a high density and low shear, thereby promoting self-gravitational instabilities. The result is the formation of giant spiral arm cloud complexes, in which dense molecular clouds form and turn into stars. The molecular envelops and debris from these clouds appear to survive and drift through the interarm regions for a lo
Galactic magnetic arms have been observed between the gaseous arms of some spiral galaxies; their origin remains unclear. We suggest that magnetic spiral arms can be naturally generated in the interarm regions because the galactic fountain flow or wind is likely to be weaker there than in the arms. Galactic outflows lead to two countervailing effects: removal of small-scale magnetic helicity, which helps to avert catastrophic quenching of the dynamo, and advection of the large-scale magnetic field, which suppresses dynamo action. For realistic galactic parameters, the net consequence of outflows being stronger in the gaseous arms is higher saturation large-scale field strengths in the interarm regions as compared to in the arms. By incorporating rather realistic models of spiral structure and evolution into our dynamo models, an interlaced pattern of magnetic and gaseous arms can be produced.
We study dueling bandits with weak utility-based regret when preferences over arms have a total order and carry observable feature vectors. The order is assumed to be determined by these feature vectors, an unknown preference vector, and a known utility function. This structure introduces dependence between preferences for pairs of arms, and allows learning about the preference over one pair of arms from the preference over another pair of arms. We propose an algorithm for this setting called Comparing The Best (CTB), which we show has constant expected cumulative weak utility-based regret. We provide a Bayesian interpretation for CTB, an implementation appropriate for a small number of arms, and an alternate implementation for many arms that can be used when the input parameters satisfy a decomposability condition. We demonstrate through numerical experiments that CTB with appropriate input parameters outperforms all benchmarks considered.
Isotropic and anisotropic wavelet transforms are used to decompose the images of the spiral galaxy M83 in various tracers to quantify structures in a range of scales from 0.2 to 10 kpc. We used radio polarization observations at λ6 cm and 13 cm obtained with the VLA, Effelsberg and ATCA telescopes and APEX sub-mm observations at 870 μm, which are first published here, together with maps of the emission of warm dust, ionized gas, molecular gas, and atomic gas. The spatial power spectra are similar for the tracers of dust, gas, and total magnetic field, while the spectra of the ordered magnetic field are significantly different. The wavelet cross-correlation between all material tracers and total magnetic field is high, while the structures of the ordered magnetic field are poorly correlated with those of other tracers. -- The magnetic field configuration in M83 contains pronounced magnetic arms. Some of them are displaced from the corresponding material arms, while others overlap with the material arms. The magnetic field vectors at λ6 cm are aligned with the outer material arms, while significant deviations occur in the inner arms and in the bar region, possibly due to non-axisymme
In order to understand the physical mechanisms underlying non-steady stellar spiral arms in disk galaxies, we analyzed the growing and damping phases of their spiral arms using three-dimensional $N$-body simulations. We confirmed that the spiral arms are formed due to a swing amplification mechanism that reinforces density enhancement as a seeded wake. In the damping phase, the Coriolis force exerted on a portion of the arm surpasses the gravitational force that acts to shrink the portion. Consequently, the stars in the portion escape from the arm, and subsequently they form a new arm at a different location. The time-dependent nature of the spiral arms are originated in the continual repetition of this non-linear phenomenon. Since a spiral arm does not rigidly rotate, but follows the galactic differential rotation, the stars in the arm rotate at almost the same rate as the arm. In other words, every single position in the arm can be regarded as the co-rotation point. Due to interaction with their host arms, the energy and angular momentum of the stars change, thereby causing the radial migration of the stars. During this process, the kinetic energy of random motion (random energy)
We have measured the positions of large numbers of H II regions in four nearly face-on, late-type, spiral galaxies: NGC 628 (M 74), NGC 1232, NGC 3184 and NGC 5194 (M 51). Fitting log-periodic spiral models to segments of each arm yields local estimates of spiral pitch angle and arm width. While pitch angles vary considerably along individual arms, among arms within a galaxy, and among galaxies, we find no systematic trend with galactocentric distance. We estimate the widths of the arm segments from the scatter in the distances of the H II regions from the spiral model. All major arms in these galaxies show spiral arm width increasing with distance from the galactic center, similar to the trend seen in the Milky Way. However, in the outer-most parts of the galaxies, where massive star formation declines, some arms reverse this trend and narrow. We find that spiral arms often appear to be composed of segments of ~5 kpc length, which join to form kinks and abrupt changes in pitch angle and arm width; these characteristics are consistent with properties seen in the large N-body simulations of D'Onghia, Vogelsberger and Hernquist (2013) and others.
We consider the problem of identifying any $k$ out of the best $m$ arms in an $n$-armed stochastic multi-armed bandit. Framed in the PAC setting, this particular problem generalises both the problem of `best subset selection' and that of selecting `one out of the best m' arms [arcsk 2017]. In applications such as crowd-sourcing and drug-designing, identifying a single good solution is often not sufficient. Moreover, finding the best subset might be hard due to the presence of many indistinguishably close solutions. Our generalisation of identifying exactly $k$ arms out of the best $m$, where $1 \leq k \leq m$, serves as a more effective alternative. We present a lower bound on the worst-case sample complexity for general $k$, and a fully sequential PAC algorithm, \GLUCB, which is more sample-efficient on easy instances. Also, extending our analysis to infinite-armed bandits, we present a PAC algorithm that is independent of $n$, which identifies an arm from the best $ρ$ fraction of arms using at most an additive poly-log number of samples than compared to the lower bound, thereby improving over [arcsk 2017] and [Aziz+AKA:2018]. The problem of identifying $k > 1$ distinct arms fr
The most important theory of the spiral arms of galaxies is the density wave theory based on the Lin-Shu dispersion relation. However, the density waves move with the group velocity towards the inner Lindblad resonance and tend to disappear. Various mechanisms to replenish the spiral waves have been proposed. Nonlinear effects play an important role near the inner and outer Lindblad resonances and corotation. The orbits supporting the spiral arms are precessing ellipses in normal galaxies that extend up to the 4/1 resonance. On the other hand, in barred galaxies the spiral arms extend along the manifolds of the unstable periodic orbits at the ends of the bar and they are composed of chaotic orbits. However these chaotic orbits can be found analytically.
We study a variant of the classical multi-armed bandit problem (MABP) which we call as Multi-Armed Bandits with dependent arms. More specifically, multiple arms are grouped together to form a cluster, and the reward distributions of arms belonging to the same cluster are known functions of an unknown parameter that is a characteristic of the cluster. Thus, pulling an arm $i$ not only reveals information about its own reward distribution, but also about all those arms that share the same cluster with arm $i$. This "correlation" amongst the arms complicates the exploration-exploitation trade-off that is encountered in the MABP because the observation dependencies allow us to test simultaneously multiple hypotheses regarding the optimality of an arm. We develop learning algorithms based on the UCB principle which utilize these additional side observations appropriately while performing exploration-exploitation trade-off. We show that the regret of our algorithms grows as $O(K\log T)$, where $K$ is the number of clusters. In contrast, for an algorithm such as the vanilla UCB that is optimal for the classical MABP and does not utilize these dependencies, the regret scales as $O(M\log T)
Consider the problem of best arm identification with a security constraint. Specifically, assume a setup of stochastic linear bandits with $K$ arms of dimension $d$. In each arm pull, the player receives a reward that is the sum of the dot product of the arm with an unknown parameter vector and independent noise. The player's goal is to identify the best arm after $T$ arm pulls. Moreover, assume a copycat Chloe is observing the arm pulls. The player wishes to keep Chloe ignorant of the best arm. While a minimax--optimal algorithm identifies the best arm with an $Ω\left(\frac{T}{\log(d)}\right)$ error exponent, it easily reveals its best-arm estimate to an outside observer, as the best arms are played more frequently. A naive secure algorithm that plays all arms equally results in an $Ω\left(\frac{T}{d}\right)$ exponent. In this paper, we propose a secure algorithm that plays with \emph{coded arms}. The algorithm does not require any key or cryptographic primitives, yet achieves an $Ω\left(\frac{T}{\log^2(d)}\right)$ exponent while revealing almost no information on the best arm.
This paper considers the problem of combinatorial multi-armed bandits with semi-bandit feedback and a cardinality constraint on the super-arm size. Existing algorithms for solving this problem typically involve two key sub-routines: (1) a parameter estimation routine that sequentially estimates a set of base-arm parameters, and (2) a super-arm selection policy for selecting a subset of base arms deemed optimal based on these parameters. State-of-the-art algorithms assume access to an exact oracle for super-arm selection with unbounded computational power. At each instance, this oracle evaluates a list of score functions, the number of which grows as low as linearly and as high as exponentially with the number of arms. This can be prohibitive in the regime of a large number of arms. This paper introduces a novel realistic alternative to the perfect oracle. This algorithm uses a combination of group-testing for selecting the super arms and quantized Thompson sampling for parameter estimation. Under a general separability assumption on the reward function, the proposed algorithm reduces the complexity of the super-arm-selection oracle to be logarithmic in the number of base arms while
Theoretical models of spiral arms suggest that the spiral arms provoke a vertical bulk motion in disc stars. By analysing the breathing motion, a coherent asymmetric vertical motion around the mid-plane of the Milky Way disc, with $\textit{Gaia}$ DR3, we found that a compressing breathing motion presents along the Local arm. On the other hand, with an $N$-body simulation of an isolated Milky Way-like disc galaxy, we found that the transient and dynamic spiral arms induce compressing breathing motions when the arms are in the growth phase, while the expanding breathing motion appears in the disruption phase. The observed clear alignment of the compressing breathing motion with the Local arm is similar to what is seen in the growth phase of the simulated spiral arms. Hence, we suggest that the Local arm's compressing breathing motion can be explained by the Local arm being in the growth phase of a transient and dynamic spiral arm. We also identified the tentative signatures of the expanding breathing motion associated with the Perseus arm and also the Outer arm coinciding with the compressing breathing motion. This may infer that the Perseus and Outer arms are in the disruption and g