We describe a novel slow oscillation in intracellular recordings from cortical association areas 5 and 7, motor areas 4 and 6, and visual areas 17 and 18 of cats under various anesthetics. The recorded neurons (n = 254) were antidromically and orthodromically identified as corticothalamic or callosal elements receiving projections from appropriate thalamic nuclei as well as from homotopic foci in the contralateral cortex. Two major types of cells were recorded: regular-spiking (mainly slow-adapting, but also fast-adapting) neurons and intrinsically bursting cells. A group of slowly oscillating neurons (n = 21) were intracellularly stained and found to be pyramidal-shaped cells in layers III-VI, with luxuriant basal dendritic arbors. The slow rhythm appeared in 88% of recorded neurons. It consisted of slow depolarizing envelopes (lasting for 0.8-1.5 sec) with superimposed full action potentials or presumed dendritic spikes, followed by long-lasting hyperpolarizations. Such sequences recurred rhythmically at less than 1 Hz, with a prevailing oscillation between 0.3 and 0.4 Hz in 67% of urethane-anesthetized animals. While in most neurons (approximately 70%) the repetitive spikes superimposed on the slow depolarization were completely blocked by slight DC hyperpolarization, 30% of cells were found to display relatively small (3-12 mV), rapid, all-or-none potentials after obliteration of full action potentials. These fast spikes were suppressed in an all-or-none fashion at Vm more negative than -90 mV. The depolarizing envelope of the slow rhythm was reduced or suppressed at a Vm of -90 to -100 mV and its duration was greatly reduced by administration of the NMDA blocker ketamine. In keeping with this action, most (56%) neurons recorded in animals under ketamine and nitrous oxide or ketamine and xylazine anesthesia displayed the slow oscillation at higher frequencies (0.6-1 Hz) than under urethane anesthesia (0.3-0.4 Hz). In 18% of the oscillating cells, the slow rhythm mainly consisted of repetitive (15-30 Hz), relatively short-lasting (15-25 msec) IPSPs that could be revealed by bringing the Vm at more positive values than -70 mV. The long-lasting (approximately 1 sec) hyperpolarizing phase of the slow oscillation was best observed at the resting Vm and was reduced at about -100 mV. Simultaneous recording of another cell across the membrane demonstrated synchronous inhibitory periods in both neurons. Intracellular diffusion of Cl- or Cs+ reduced the amplitude and/or duration of cyclic long-lasting hyperpolaryzations.(ABSTRACT TRUNCATED AT 400 WORDS)
We propose a unified framework for dimension reduction of partial differential equations posed on thin domains. Our approach combines three complementary ingredients: a careful boundary-condition analysis, an averaging-based splitting for general thin geometries, and a slow-manifold viewpoint for the resulting fast-slow system. Homogeneous Neumann conditions on the thin faces emerge as the most relevant and physical regime because they preserve the transverse zero mode and therefore lead to a genuine lower-dimensional reduced equation. For general thin domains we derive the averaged fast-slow system and isolate the geometry-induced correction term. We then formulate a splitting-based Lyapunov-Perron construction for an exact slow manifold when a suitable spectral decomposition of the slow variable is available, and we construct approximate slow manifolds and corrected reduced dynamics directly from the invariance equation by asymptotic expansion. Moreover, we propose the Schnakenberg reaction-diffusion system as a canonical test problem for comparing the full thin-domain dynamics, the averaged model, and the manifold-corrected reduced dynamics. Finally, we also extend the framework
Large language models (LLMs) are trained for downstream tasks by updating their parameters (e.g., via RL). However, updating parameters forces them to absorb task-specific information, which can result in catastrophic forgetting and loss of plasticity. In contrast, in-context learning with fixed LLM parameters can cheaply and rapidly adapt to task-specific requirements (e.g., prompt optimization), but cannot by itself typically match the performance gains available through updating LLM parameters. There is no good reason for restricting learning to being in-context or in-weights. Moreover, humans also likely learn at different time scales (e.g., System 1 vs 2). To this end, we introduce a fast-slow learning framework for LLMs, with model parameters as "slow" weights and optimized context as "fast" weights. These fast "weights" can learn from textual feedback to absorb the task-specific information, while allowing slow weights to stay closer to the base model and persist general reasoning behaviors. Fast-Slow Training (FST) is up to 3x more sample-efficient than only slow learning (RL) across reasoning tasks, while consistently reaching a higher performance asymptote. Moreover, FST-
In this paper, we study ergodic properties of the slow relation function (or entry-exit function) in planar slow-fast systems. It is well known that zeros of the slow divergence integral associated with canard limit periodic sets give candidates for limit cycles. We present a new approach to detect the zeros of the slow divergence integral by studying the structure of the set of all probability measures invariant under the corresponding slow relation function. Using the slow relation function, we also show how to estimate (in terms of weak convergence) the transformation of families of probability measures that describe initial point distribution of canard orbits during the passage near a slow-fast Hopf point (or a more general turning point). We provide formulas to compute exit densities for given entry densities and the slow relation function. We apply our results to slow-fast Liénard equations.
In the corona, plasma is accelerated to hundreds of kilometers per second, and heated to temperatures hundreds of times hotter than the Sun's surface, before it escapes to form the solar wind. Decades of space-based experiments have shown that the energization process does not stop after it escapes. Instead, the solar wind continues to accelerate and it cools far more slowly than a freely-expanding adiabatic gas. Recent work suggests that fast solar wind requires additional momentum beyond what can be provided by the observed thermal pressure gradients alone whereas it is sufficient for the slowest wind. The additional acceleration for fast wind can be provided through an Alfvén wave pressure gradient. Beyond this fast-slow categorization, however, a subset of slow solar wind exhibits high Alfvénicity that suggest Alfvén waves could play a larger role in its acceleration compared to conventional slow wind outflows. Through a well-timed conjunction between Solar Orbiter and Parker Solar Probe, we trace the energetics of slow wind to compare with a neighboring Alfvénic slow solar wind stream. An analysis that integrates remote and heliospheric properties and modeling of the two disti
We introduce the extra slow Tamari lattices, a new family of lattices defined on faithfully balanced tableaux. These tableaux arise naturally from the representation theory of type \( A \) quivers, and our construction extends the classical Tamari lattice and the slow Tamari lattice. We explicitly describe meets and joins in the extra slow Tamari lattices, and then prove that they are lattices. We then show that they are semidistributive, trim, polygonal, and congruence uniform. Their join-irreducible elements are described in terms of a three-color analogue of the positive roots of type \( A \), which leads to descriptions of their spines and congruence lattices. We also obtain several enumerative results for the extra slow Tamari lattices and their associated structures. Finally, we derive new structural and enumerative results for the slow Tamari lattices.
Esser and Loosveldt have recently resolved a long-standing open problem in the folklore by proving that fractional Brownian motion (fBm) has slow points in the sense of Kahane, following a rich theory of slow points developed for Brownian motion and other, related, self-similar Markov processes. We presently introduce another method for the study of slow points in order to compute the Hausdorff dimension of fBm slow points. Our method follows recent ideas on the points of slow growth for SPDEs but also requires a number of new localization ideas that are likely to have other applications.
The sparse identification of nonlinear dynamics (SINDy) has been established as an effective method to learn interpretable models of dynamical systems from data. However, for high-dimensional slow-fast dynamical systems, the regression problem becomes simultaneously computationally intractable and ill-conditioned. Although, in principle, modeling only the dynamics evolving on the underlying slow manifold addresses both of these challenges, the truncated fast variables have to be compensated by including higher-order nonlinearities as candidate terms for the model, leading to an explosive growth in the size of the SINDy library. In this work, we develop a SINDy variant that is able to robustly and efficiently identify slow-fast dynamics in two steps: (i) identify the slow manifold, that is, an algebraic equation for the fast variables as functions of the slow ones, and (ii) learn a model for the dynamics of the slow variables restricted to the manifold. Critically, the equation learned in (i) is leveraged to build a manifold-informed function library for (ii) that contains only essential higher-order nonlinearites as candidate terms. Rather than containing all monomials of up to a c
Recent AI research has given rise to powerful techniques for deep reinforcement learning. In their combination of representation learning with reward-driven behavior, deep reinforcement learning would appear to have inherent interest for psychology and neuroscience. One reservation has been that deep reinforcement learning procedures demand large amounts of training data, suggesting that these algorithms may differ fundamentally from those underlying human learning. While this concern applies to the initial wave of deep RL techniques, subsequent AI work has established methods that allow deep RL systems to learn more quickly and efficiently. Two particularly interesting and promising techniques center, respectively, on episodic memory and meta-learning. Alongside their interest as AI techniques, deep RL methods leveraging episodic memory and meta-learning have direct and interesting implications for psychology and neuroscience. One subtle but critically important insight which these techniques bring into focus is the fundamental connection between fast and slow forms of learning. Deep reinforcement learning (RL) methods have driven impressive advances in artificial intelligence in recent years, exceeding human performance in domains ranging from Atari to Go to no-limit poker. This progress has drawn the attention of cognitive scientists interested in understanding human learning. However, the concern has been raised that deep RL may be too sample-inefficient – that is, it may simply be too slow – to provide a plausible model of how humans learn. In the present review, we counter this critique by describing recently developed techniques that allow deep RL to operate more nimbly, solving problems much more quickly than previous methods. Although these techniques were developed in an AI context, we propose that they may have rich implications for psychology and neuroscience. A key insight, arising from these AI methods, concerns the fundamental connection between fast RL and slower, more incremental forms of learning. Deep reinforcement learning (RL) methods have driven impressive advances in artificial intelligence in recent years, exceeding human performance in domains ranging from Atari to Go to no-limit poker. This progress has drawn the attention of cognitive scientists interested in understanding human learning. However, the concern has been raised that deep RL may be too sample-inefficient – that is, it may simply be too slow – to provide a plausible model of how humans learn. In the present review, we counter this critique by describing recently developed techniques that allow deep RL to operate more nimbly, solving problems much more quickly than previous methods. Although these techniques were developed in an AI context, we propose that they may have rich implications for psychology and neuroscience. A key insight, arising from these AI methods, concerns the fundamental connection between fast RL and slower, more incremental forms of learning. Over just the past few years, revolutionary advances have occurred in artificial intelligence (AI) research, where a resurgence in neural network or ‘deep learning’ methods [1LeCun Y. et al.Deep learning.Nature. 2015; 521: 436Crossref PubMed et al.Deep has in understanding et with deep neural et representation and PubMed et by learning to and et a model for and have interest from and in AI human and et an of deep learning and PubMed et training of neural for cognitive and PubMed deep learning to PubMed et neural network that a for the of 2015; PubMed Deep but may it PubMed One of AI research that particularly from this is deep RL Deep RL neural network with reinforcement a of methods for learning from and than from more as an than deep RL has the past into of the of AI research, performance in from et deep reinforcement learning.Nature. 2015; PubMed to et artificial intelligence in no-limit PubMed et performance in with deep reinforcement and and et the of with deep neural and PubMed et and by with a reinforcement learning et the of human PubMed et reinforcement learning that and PubMed on the of learning a a from or to which In the be as a the for In this of is and the be as a work in the how this be a neural network learning and learning to from to A and However, the of deep neural with RL work how deep RL be to work in domains as Atari et deep reinforcement learning.Nature. 2015; PubMed and progress has been and deep RL et in deep reinforcement to domains as Go et the of with deep neural and PubMed and the et training of neural In the advances have deep RL with and as et the of with deep neural and PubMed or memory et a neural network with PubMed and have on the of learning deep RL to progress on just a few as in the the of deep RL methods, in A with learning and This on a neural network which as a representation of the and to an of the as simply to the of a from the the network by and et deep reinforcement learning.Nature. 2015; PubMed a neural network et with deep neural as and to a representation of a deep RL by and et memory in a A of the of this RL is the of the present be in et memory in a However, as the the a neural network that an memory to which to a that on the to in as in RL on the of learning a a from or to which In the be as a the for In this of is and the be as a work in the how this be a neural network learning and learning to from to A and However, the of deep neural with RL work how deep RL be to work in domains as Atari et deep reinforcement learning.Nature. 2015; PubMed and progress has been and deep RL et in deep reinforcement to domains as Go et the of with deep neural and PubMed and the et training of neural In the advances have deep RL with and as et the of with deep neural and PubMed or memory et a neural network with PubMed and have on the of learning deep RL to progress on just a few as in the the of deep RL methods, in A with learning and This on a neural network which as a representation of the and to an of the as simply to the of a from the the network by and et deep reinforcement learning.Nature. 2015; PubMed a neural network et with deep neural as and to a representation of a deep RL by and et memory in a A of the of this RL is the of the present be in et memory in a However, as the the a neural network that an memory to which to a that on the to in as in inherent interest as an AI deep RL would appear to interest for psychology and neuroscience. that learning in deep RL were by research a of and PubMed and to to neural for learning on et neural of and PubMed the deep RL neural to learn powerful that and key of these deep RL would appear to a rich of and for interested in human and the and have to et an of deep learning and PubMed et training of neural for cognitive and PubMed the on the wave of deep RL research has a of it that deep RL systems learn in a from of this it has been in the of human learning deep to the of for a learning to of this the initial wave of deep RL systems appear from human performance on as Atari or deep RL systems have of more training than human et learning in In deep in initial much too slow to a plausible model for human learning. the has et learning 2015; PubMed Deep a critique is to the wave of deep RL methods, et with deep reinforcement However, in the important have occurred in deep RL research, which how the of deep RL be methods the by deep RL for amounts of training data, deep RL to be of these techniques deep RL as a model of human learning and a of insight for psychology and neuroscience. In the present review, we key deep RL methods that the episodic deep RL and how these techniques fast deep RL and their implications for psychology and neuroscience. A key for techniques for fast RL is to initial methods for deep RL were in we of the of the of the we to how the of by these in of in deep RL is the for incremental deep RL methods in AI to the of a deep neural network from to has been in AI but in psychology et learning systems learning systems PubMed the this of learning be in to et of 2015; and the of learning to as This demand for in learning is of in the methods for deep A is A of learning is that learning a the the initial the learning the to be the the initial of the learning the be for learning to be the initial in the A learning with be to a of but in be and and In is fast learning. A learning that a of in on the more than a with the that initial neural learning they have and of these to a of by the this that neural in the in the deep RL to be large amounts of to learn. these and the of deep RL However, subsequent research has that of these be deep RL to in a much more In we techniques, of which the incremental and the of which the of In to their implications the AI of these AI techniques with psychology and as we incremental is of in deep to learn be to incremental the learning to the of However, recent research that is to the which is to an of past and this as a of in This to as episodic RL et episodic learning and episodic memory in humans and an PubMed to the in learning and and and or of learning in psychology an of and a is and a be to the is to an representation of the with of past is the with the on the of the past that to the the representation is by a neural we to the as deep A more of the of episodic deep RL is in Deep RL algorithms the of and episodic learning and episodic memory in humans and an PubMed et of past for in PubMed episodic for PubMed for the episodic in the with the of the an episodic memory of the and the that the of a the a of the by the between and the This be to by the with the and in the memory the to in which the In et episodic an episodic RL to performance on Atari of episodic RL on the to In a to et episodic et et episodic that performance be by these learning. performance and of the on the in the Atari et episodic the of slow learning and fast learning. RL algorithms the of and episodic learning and episodic memory in humans and an PubMed et of past for in PubMed episodic for PubMed for the episodic in the with the of the an episodic memory of the and the that the of a the a of the by the between and the This be to by the with the and in the memory the to in which the In et episodic an episodic RL to performance on Atari of episodic RL on the to In a to et episodic et et episodic that performance be by these learning. performance and of the on the in the Atari et episodic the of slow learning and fast learning. In episodic deep the incremental the be to However, episodic deep RL is to where methods for deep RL is a to this the fast learning of episodic deep RL critically on slow incremental learning. This is the learning of the connection that the to or of of these is the of incremental that forms the of deep the of episodic deep RL is by this of learning. is, fast learning is by slow learning. This of fast learning on slow learning is we it is a fundamental to psychology and than to a of this we in the recently developed AI for deep a key of in deep incremental is in the of the fast learning the to in with a of the of the that it the the learning However, as is a a learning it the While they the the to with the to be a of a learning how the to One to this is to on past this the in for the of learning to a In this context, past with and the the work and of the initial to the in the and they for the to quickly learn how to the A these with would a of the the of learning leveraging of past to learning is to in learning as meta-learning However, the from where it has been to In the to this of learning PubMed an that the were with and to of a or an were the and the for a of Two and were and with these of and the were to that a and the of with a of were to learn in which the a but of learning to learn learning the of a learning that the with and et to learn on to and to of learning to to et of in reinforcement PubMed This is in of of an that to that the of an that the to to the where the and RL learning from and that in the of this a of neural network in memory et to learn on PubMed In this the of learning of the connection by a deep RL Over the of this rise to an learning which is in the of the network et to reinforcement Y. et fast reinforcement learning slow reinforcement et with neural on et to learn on PubMed A training a neural network on a the between the or and is on that the for a of problems is with a of with for a of and on to for the in is to of the with of to to this learning to more on a with that more with of training on a of the network with connection a and on the a that with algorithms the learning that in the is of the RL that the it work than that it that with the on which the is is in et et as a learning PubMed performance is training on a of which the the training on a in which the they to the training on the to in on the more This an in the a of in the of learning PubMed the of to a where between of learning on in the for of is with of to an on and the to for In recent and et as a learning PubMed that a neural rise to the of learning learning the of a learning that the with and et to learn on to and to of learning to to et of in reinforcement PubMed This is in of of an that to that the of an that the to to the where the and RL learning from and that in the of this a of neural network in memory et to learn on PubMed In this the of learning of the connection by a deep RL Over the of this rise to an learning which is in the of the network et to reinforcement Y. et fast reinforcement learning slow reinforcement et with neural on et to learn on PubMed A training a neural network on a the between the or and is on that the for a of problems is with a of with for a of and on to for the in is to of the with of to to this learning to more on a with that more with of training on a of the network with connection a and on the a that with algorithms the learning that in the is of the RL that the it work than that it that with the on which the is is in et et as a learning PubMed performance is training on a of which the the training on a in which the they to the training on the to in on the more This an in the a of in the of learning PubMed the of to a where between of learning on in the for of is with of to an on and the to for In recent and et as a learning PubMed that a neural rise to the of learning to recent work has how learning to learn be to learning in deep This has been in a of et to learn by by et meta-learning for fast of deep However, that has to and psychology by et to reinforcement and Y. et fast reinforcement learning slow reinforcement and their a neural network is on a of RL in the network they is but fast to the of In this of the network to their RL which for quickly solving on from past RL to and the with episodic deep an connection between fast and slow learning. in the network that to be the of the network a learning which problems they have been with by the underlying of slow learning fast learning and is slow learning. the techniques we have recent work has an to meta-learning and episodic on their et meta-learning with episodic on et as In episodic meta-learning a neural as in the previous and However, on this is an episodic memory the of which is to of in the in episodic deep the episodic memory a of past which be on the However, than with episodic with from the or important they to the has from with for In episodic the a that to in the it the from the previous to the In episodic memory the to work in and et et meta-learning with episodic on that episodic just that it to with a episodic and the it the to the with a the from the of on the and it from the learning by episodic we the the of has been as a for the of deep RL to learning in humans and et learning 2015; PubMed Deep a One important of episodic deep RL and from the of of psychology and is that they this by that deep RL in be This deep RL as a model of human and learning. this the of episodic deep RL and to interesting in psychology and neuroscience. with episodic deep we have the interesting connection between this and of human where previous an of and RL a for how reward-driven learning. recent work on RL in and humans has the of episodic with that of and on for past learning and episodic memory in humans and an PubMed to the et of past for in PubMed episodic for PubMed deep RL a for how this to learning more it the important that representation learning and learning in RL on episodic deep RL that it may be to the that fast episodic RL in humans and may with and learning While this between fast and slow learning has been in work on memory work on memory systems et learning systems learning systems PubMed et and memory PubMed et is a cognitive for et learning systems in the and from the and of of learning and PubMed in learning has been et reinforcement to this has interesting implications for psychology and neuroscience. and et as a learning PubMed have a direct from the of to neural and they propose that may to the of in a that the to an of learning procedures a of and et as a learning PubMed how in this for a of from the and and in the and et as a learning PubMed that as in model learning in that on the of and that this is by an of focus on the is to learning et is a cognitive for et and learning and PubMed and in for that learning. et et for in PubMed from a in which that for the of a but for the previous the previous and the of previous and previous key for an learning in this et et as a learning PubMed on the the of the artificial network to a fast learning with that in this network to et et as a learning PubMed that meta-learning the of an the in to have that for learning to the to the of learning et for systems on PubMed and reinforcement the PubMed et of PubMed In this incremental to and these the to This learning is as to a in and in the PubMed et between and systems for PubMed and learning and their PubMed this is by the that et on and PubMed et and in a PubMed et and for of PubMed in a to and et et on and PubMed in to be the of et et as a learning PubMed on a of this et to PubMed In of behavior, they that the network in a learning the that the training of they the of they that the work has been to understanding how the and et is a cognitive for et neural underlying and reinforcement PubMed et and model in PubMed memory a model of learning in the and PubMed a that learning to a learning may be an important of In this incremental learning into algorithms that in the to learn in reinforcement PubMed et of in reinforcement PubMed et and the of reinforcement learning in and et as a learning PubMed that as in model learning in that on the of and that this is by an of focus on the is to learning et is a cognitive for et and learning and PubMed and in for that learning. et et for in PubMed from a in which that for the of a but for the previous the previous and the of previous and previous key for an learning in this et et as a learning PubMed on the the of the artificial network to a fast learning with that in this network to et et as a learning PubMed that meta-learning the of an the in to have that for learning to the to the of learning et for systems on PubMed and reinforcement the PubMed et of PubMed In this incremental to and these the to This learning is as to a in and in the PubMed et between and systems for PubMed and learning and their PubMed However, this is by the that et on and PubMed et and in a PubMed et and for of PubMed in a to and et et on and PubMed in to be the of et et as a learning PubMed on a of this et to PubMed In of behavior, they that the network in a learning the that the training of they the of they that the work has been to understanding how the and et is a cognitive for et neural underlying and reinforcement PubMed et and model in PubMed memory a model of learning in the and PubMed a that learning to a learning In may be an important of In this incremental learning into algorithms that in the to learn in reinforcement PubMed et of in reinforcement PubMed et and the of reinforcement learning in direct episodic with psychology and neuroscience. the in episodic by that episodic memory to of in memory et as and et meta-learning with episodic on how a be rise to a that et with neural on et memory in a et a neural network with PubMed In to the initial it from this work to by a for recently between episodic and in human learning et to reinforcement on a the work by and et meta-learning with episodic on an of how meta-learning operate memory systems et learning systems learning systems PubMed their that they learning. In episodic RL and we have the of learning in learning. In as we have the of learning is to that and to of incremental learning in episodic RL be in RL on between or learning the that and in a of which episodic RL more that is an into the learning In episodic RL a of for than this is into the of the learning that episodic In AI this is a of or in to as in A of AI research is on to this is learning or the direct of or the has been for the resurgence of neural in neural which the for this in a with in However, the past few years, an large of AI research has been or on the of et deep and et deep reinforcement and et for a these of concerns in we have the that may be learning in from psychology of learning PubMed and has an of research et learning 2015; PubMed However, meta-learning in neural may provide a to the and of in the RL and in has the that that is, PubMed However, the more of and of into neural network learning have been in and in the a model of PubMed et and cognitive PubMed in a of PubMed methods for deep learning and deep RL provide a that may be in for in the implications of et and of PubMed of network PubMed of the in the PubMed is AI work a between that learning and that by in a a more is and as arising a learning driven by is the learning and that allow learning. this meta-learning a but this that for a learning but for an which the in the in which have In this context, recent in AI may in implications for and Recent AI work has into methods for as as by et performance in with deep reinforcement neural PubMed et learning by the learning et for it on or AI work on and with a for how the to learning. by AI research on the initial of network et meta-learning for fast of deep of learning et to learn by by Y. et a learning from on et neural and the of or et deep and et learning with a on et in reinforcement and et memory in a the of and and a in which learning is from to that learning and with of this and a that is by the of the et and the of 2015; this and which these which on this as the learning in a with a by to that this is to cognitive the of learning to learn has a in psychology for of learning PubMed et that learn and PubMed and of learning have with the for et learning 2015; PubMed et of in et of and PubMed et to a and PubMed et meta-learning as on has on learning these the recent in AI research the of slow and fast learning in neural and in a of and a of of deep RL interest for psychology and given focus on representation learning and In the present review, we have recently forms of deep RL that the of deep RL to work techniques the of deep RL to psychology and recent they the by to as episodic memory and learning to learn. arising from deep RL research and for research in psychology and neuroscience. we have a key of recent work on deep RL is that where fast learning it on slow which the and that fast learning. This a for memory systems in the as as their However, human learning those in this review, and we that deep RL model to of these in to learning a understanding the between fast and slow in RL a for psychology and neuroscience. this may be a key where and psychology as has been the in cognitive AI methods for deep RL to the of rich humans In these methods rich of the that human of training be for human learning from to those in is their neural important for AI techniques, in the or is the by important for learning in the that human were these and or and to they that human is that we the that and human and how we those in AI AI methods for deep RL to the of rich humans In these methods rich of the that human of training be for human learning from to those in is their neural important for AI techniques, in the or is the by important for learning in the that human were these and or and to they One that human is that we the that and human and how we those in AI were by a neural network with or more a representation in a of a neural a of a neural network in between the and a of and in which an in to an learn and in A of and in a the of is and as more is to the a neural network that in a from to the
Weakly supervised temporal action localization (WTAL) aims to localize actions in untrimmed videos with only weak supervision information (e.g. video-level labels). Most existing models handle all input videos with a fixed temporal scale. However, such models are not sensitive to actions whose pace of the movements is different from the ``normal" speed, especially slow-motion action instances, which complete the movements with a much slower speed than their counterparts with a normal speed. Here arises the slow-motion blurred issue: It is hard to explore salient slow-motion information from videos at ``normal" speed. In this paper, we propose a novel framework termed Slow Motion Enhanced Network (SMEN) to improve the ability of a WTAL network by compensating its sensitivity on slow-motion action segments. The proposed SMEN comprises a Mining module and a Localization module. The mining module generates mask to mine slow-motion-related features by utilizing the relationships between the normal motion and slow motion; while the localization module leverages the mined slow-motion features as complementary information to improve the temporal action localization results. Our proposed fr
In this paper we generalize the Fenichel theory for attracting critical/slow manifolds to fast-reaction systems in infinite dimensions. In particular, we generalize the theory of invariant manifolds for fast-slow partial differential equations in standard form to the case of fast reaction terms. We show that the solution of the fast-reaction system can be approximated by the corresponding slow flow of the limit system. Introducing an additional parameter that stems from a splitting in the slow variable space, we construct a family of slow manifolds and we prove that the slow manifolds are close to the critical manifold. Moreover, the semi-flow on the slow manifold converges to the semi-flow on the critical manifold. Finally, we apply these results to an example and show that the underlying assumptions can be verified in a straightforward way.
Earnings announcements release two types of information sequentially: quantitative surprise (numeric earnings-per-share (EPS)/revenue versus analyst estimate) arrives first in press releases and financial news, processed by algorithmic traders within minutes; qualitative language (management tone, guidance, question-and-answer (Q&A) credibility) arrives 30-90 min later in the earnings conference call transcript (ECT), requiring human interpretation overnight. Financial economists have studied quantitative surprise for 50 years; natural language processing (NLP) researchers have studied qualitative ECT signals for a decade. Despite studying the same event, the two communities used incompatible frameworks: different targets (return vs. volatility), trading setups (long top-decile and short bottom-decile vs. trade-all), and metrics (return spread between top and bottom 20% (Q5-Q1) vs. mean squared error (MSE)), making direct comparison and connection challenging. We bridge these communities with EarningsInOne, the first corpus aligning earnings news, ECTs, and intraday and next-day prices across SP 1500 (broad U.S. equity universe, 2022-2025). Applying unified trading and evaluati
The failure of the population of micro-junctions forming the frictional interface between two solids is central to fields ranging from biomechanics to seismology. This failure is mediated by the propagation along the interface of various types of rupture fronts, covering a wide range of velocities. Among them are so-called slow fronts, which are recently discovered fronts much slower than the materials' sound speeds. Despite intense modelling activity, the mechanisms underlying slow fronts remain elusive. Here, we introduce a multi-scale model capable of reproducing both the transition from fast to slow fronts in a single rupture event and the short-time slip dynamics observed in recent experiments. We identify slow slip immediately following the arrest of a fast front as a phenomenon sufficient for the front to propagate further at a much slower pace. Whether slow fronts are actually observed is controlled both by the interfacial stresses and by the width of the local distribution of forces among micro-junctions. Our results show that slow fronts are qualitatively different from faster fronts. Since the transition from fast to slow fronts is potentially as generic as slow slip, we
We study the drift of slow variables in a slow-fast Hamiltonian system with several fast and slow degrees of freedom. For any periodic trajectory of the fast subsystem with the frozen slow variables we define an action. For a family of periodic orbits, the action is a scalar function of the slow variables and can be considered as a Hamiltonian function which generates some slow dynamics. These dynamics depend on the family of periodic orbits. Assuming the fast system with the frozen slow variables has a pair of hyperbolic periodic orbits connected by two transversal heteroclinic trajectories, we prove that for any path composed of a finite sequence of slow trajectories generated by action Hamiltonians, there is a trajectory of the full system whose slow component shadows the path.
This work is concerned with the dynamics of a slow-fast stochastic evolutionary system quantified with a scale parameter. An invariant foliation decomposes the state space into geometric regions of different dynamical regimes, and thus helps understand dynamics. A slow invariant foliation is established for this system. It is shown that the slow foliation converges to a critical foliation (i.e., the scale parameter is zero) in probability distribution, as the scale parameter tends to zero. The approximation of slow foliation is also constructed with error estimate in distribution. Furthermore, the geometric structure of the slow foliation is investigated: every fiber of the slow foliation parallels each other, with the slow manifold as a special fiber. In fact, when an arbitrarily chosen point of a fiber falls in the slow manifold, the fiber must be the slow manifold itself.
The notion of slow entropy, both upper and lower slow entropy, was defined by Katok and Thouvenot as a more refined measure of complexity for dynamical systems, than the classical Kolmogorov-Sinai entropy. For any subexponential rate function $a_n(t)$, we prove there exists a generic class of invertible measure preserving systems such that the lower slow entropy is zero and the upper slow entropy is infinite. Also, given any subexponential rate $a_n(t)$, we show there exists a rigid, weak mixing, invertible system such that the lower slow entropy is infinite with respect to $a_n(t)$. This gives a general solution to a question on the existence of rigid transformations with positive polynomial upper slow entropy, Finally, we connect slow entropy with the notion of entropy covergence rate presented by Blume. In particular, we show slow entropy is a strictly stronger notion of complexity and give examples which have zero upper slow entropy, but also have an arbitrary sublinear positive entropy convergence rate.
Capable of reaching similar magnitudes to large megathrust earthquakes ($M_w>7$), slow slip events play a major role in accommodating tectonic motion on plate boundaries. These slip transients are the slow release of built-up tectonic stress that are geodetically imaged as a predominantly aseismic rupture, which is smooth in both time and space. We demonstrate here that large slow slip events are in fact a cluster of short-duration slow transients. Using a dense catalog of low-frequency earthquakes as a guide, we investigate the $M_w7.5$ slow slip event that occurred in 2006 along the subduction interface 40~km beneath Guerrero, Mexico. We show that while the long-period surface displacement as recorded by GPS suggests a six month duration, motion in the direction of tectonic release only sporadically occurs over 55 days and its surface signature is attenuated by rapid relocking of the plate interface.These results demonstrate that our current conceptual model of slow and continuous rupture is an artifact of low-resolution geodetic observations of a superposition of small, clustered slip events. Our proposed description of slow slip as a cluster of slow transients implies that w
We study the stochastic formalism of inflation beyond the usual slow-roll approximation. We verify that the assumptions on which the stochastic formalism relies still hold even far from the slow-roll attractor. This includes demonstrating the validity of the separate universe approach to evolving long-wavelength scalar field perturbations beyond slow roll. We also explain that, in general, there is a gauge correction to the amplitude of the stochastic noise. This is because the amplitude is usually calculated in the spatially-flat gauge, while the number of e-folds is used as the time variable (hence one works in the uniform-$N$ gauge) in the Langevin equations. We show that these corrections vanish in the slow-roll limit, but we also explain how to calculate them in general. We compute them in difference cases, including ultra-slow roll and the Starobinsky model that interpolates between slow roll and ultra-slow roll, and find the corrections to be negligible in practice. This confirms the validity of the stochastic formalism for studying quantum backreaction effects in the very early universe beyond slow roll.
We establish a slow manifold for a fast-slow stochastic evolutionary system with anomalous diffusion, where both fast and slow components are influ- enced by white noise. Furthermore, we prove the exponential tracking property for the random slow manifold and this leads to a lower dimensional reduced sys- tem based on the slow manifold. Also we consider parameter estimation for this nonlocal fast-slow stochastic dynamical system, where only the slow component is observable. In quantifying parameters in stochastic evolutionary systems, this offers an advantage of dimension reduction.
In this work we present a reduction result for discrete time systems with two time scales. In order to be valid, previous results in the field require some strong hypotheses that are difficult to check in practical applications. Roughly speaking, the iterates of a map as well as their differentials must converge uniformly on compact sets. Here, we eliminate the hypothesis of uniform convergence of the differentials at no significant cost in the conclusions of the result. This new result is then used to extend to nonlinear cases the reduction of some population discrete models involving processes acting at different time scales. In practical cases, some processes that occur at a fast time scale are often only measured at slow time intervals, notably mortality. For a general class of linear models that include such kind of processes, it has been shown that a more realistic approach requires the re-scaling of those processes to be considered at the fast time scale. We develop the same type of re-scaling in some nonlinear models and prove the corresponding reduction results. We also provide an application to a particular model of a structured population in a two-patch environment.