In speech separation, time-domain approaches have successfully replaced the time-frequency domain with latent sequence feature from a learnable encoder. Conventionally, the feature is separated into speaker-specific ones at the final stage of the network. Instead, we propose a more intuitive strategy that separates features earlier by expanding the feature sequence to the number of speakers as an extra dimension. To achieve this, an asymmetric strategy is presented in which the encoder and decoder are partitioned to perform distinct processing in separation tasks. The encoder analyzes features, and the output of the encoder is split into the number of speakers to be separated. The separated sequences are then reconstructed by the weight-shared decoder, which also performs cross-speaker processing. Without relying on speaker information, the weight-shared network in the decoder directly learns to discriminate features using a separation objective. In addition, to improve performance, traditional methods have extended the sequence length, leading to the adoption of dual-path models, which handle the much longer sequence effectively by segmenting it into chunks. To address this, we in
We argue for the use of separate exchangeability as a modeling principle in Bayesian nonparametric (BNP) inference. Separate exchangeability is \emph{de facto} widely applied in the Bayesian parametric case, e.g., it naturally arises in simple mixed models. However, while in some areas, such as random graphs, separate and (closely related) joint exchangeable models are widely used, they are curiously underused for several other applications in BNP. We briefly review the definition of separate exchangeability, focusing on the implications of such a definition in Bayesian modeling. We then discuss two tractable classes of models that implement separate exchangeability, which are the natural counterparts of familiar partially exchangeable BNP models. The first is nested random partitions for a data matrix, defining a partition of columns and nested partitions of rows, nested within column clusters. Many recent models for nested partitions implement partially exchangeable models related to variations of the well-known nested Dirichlet process. We argue that inference under such models in some cases ignores important features of the experimental setup. We obtain the separately exchangea
Self-supervised training methods for transformers have demonstrated remarkable performance across various domains. Previous transformer-based models, such as masked autoencoders (MAE), typically utilize a single normalization layer for both the [CLS] symbol and the tokens. We propose in this paper a simple modification that employs separate normalization layers for the tokens and the [CLS] symbol to better capture their distinct characteristics and enhance downstream task performance. Our method aims to alleviate the potential negative effects of using the same normalization statistics for both token types, which may not be optimally aligned with their individual roles. We empirically show that by utilizing a separate normalization layer, the [CLS] embeddings can better encode the global contextual information and are distributed more uniformly in its anisotropic space. When replacing the conventional normalization layer with the two separate layers, we observe an average 2.7% performance improvement over the image, natural language, and graph domains.
Language-queried audio source separation (LASS) is a new paradigm for computational auditory scene analysis (CASA). LASS aims to separate a target sound from an audio mixture given a natural language query, which provides a natural and scalable interface for digital audio applications. Recent works on LASS, despite attaining promising separation performance on specific sources (e.g., musical instruments, limited classes of audio events), are unable to separate audio concepts in the open domain. In this work, we introduce AudioSep, a foundation model for open-domain audio source separation with natural language queries. We train AudioSep on large-scale multimodal datasets and extensively evaluate its capabilities on numerous tasks including audio event separation, musical instrument separation, and speech enhancement. AudioSep demonstrates strong separation performance and impressive zero-shot generalization ability using audio captions or text labels as queries, substantially outperforming previous audio-queried and language-queried sound separation models. For reproducibility of this work, we will release the source code, evaluation benchmark and pre-trained model at: https://gith
In distributed storage systems (DSSs), the optimal tradeoff between node storage and repair bandwidth is an important issue for designing distributed coding strategies to ensure large scale data reliability. The capacity of DSSs is obtained as a function of node storage and repair bandwidth parameters, characterizing the tradeoff. There are lots of works on DSSs with clusters (racks) where the repair bandwidths from intra-cluster and cross-cluster are differentiated. However, separate nodes are also prevalent in the realistic DSSs, but the works on DSSs with clusters and separate nodes (CSN-DSSs) are insufficient. In this paper, we formulate the capacity of CSN-DSSs with one separate node for the first time where the bandwidth to repair a separate node is of cross-cluster. Consequently, the optimal tradeoff between node storage and repair bandwidth are derived and compared with cluster DSSs. A regenerating code instance is constructed based on the tradeoff. Furthermore, the influence of adding a separate node is analyzed and formulated theoretically. We prove that when each cluster contains R nodes and any k nodes suffice to recover the original file (MDS property), adding an extra
The problem of speech separation, also known as the cocktail party problem, refers to the task of isolating a single speech signal from a mixture of speech signals. Previous work on source separation derived an upper bound for the source separation task in the domain of human speech. This bound is derived for deterministic models. Recent advancements in generative models challenge this bound. We show how the upper bound can be generalized to the case of random generative models. Applying a diffusion model Vocoder that was pretrained to model single-speaker voices on the output of a deterministic separation model leads to state-of-the-art separation results. It is shown that this requires one to combine the output of the separation model with that of the diffusion model. In our method, a linear combination is performed, in the frequency domain, using weights that are inferred by a learned model. We show state-of-the-art results on 2, 3, 5, 10, and 20 speakers on multiple benchmarks. In particular, for two speakers, our method is able to surpass what was previously considered the upper performance bound.
(abridged version) The separate universe conjecture states that in General Relativity a density perturbation behaves locally (i.e. on scales much smaller than the wavelength of the mode) as a separate universe with different background density and curvature. We prove this conjecture for a spherical compensated tophat density perturbation of arbitrary amplitude and radius in $Λ$CDM. We then use Conformal Fermi Coordinates to generalize this result to scalar perturbations of arbitrary configuration and scale. In this case, the separate universe conjecture holds for the isotropic part of the perturbations. The anisotropic part on the other hand is exactly captured by a tidal field in the Newtonian form. We show that the separate universe picture is restricted to scales larger than the sound horizons of all fluid components. We then derive an expression for the locally measured matter bispectrum induced by a long-wavelength mode of arbitrary wavelength. We show that nonlinear gravitational dynamics does not generate observable contributions that scale like local-type non-Gaussianity $f_{\rm NL}^{\rm loc}$, and hence does not contribute to a scale-dependent galaxy bias $Δb \propto k^{-2
In this paper, we introduce the task of language-queried audio source separation (LASS), which aims to separate a target source from an audio mixture based on a natural language query of the target source (e.g., "a man tells a joke followed by people laughing"). A unique challenge in LASS is associated with the complexity of natural language description and its relation with the audio sources. To address this issue, we proposed LASS-Net, an end-to-end neural network that is learned to jointly process acoustic and linguistic information, and separate the target source that is consistent with the language query from an audio mixture. We evaluate the performance of our proposed system with a dataset created from the AudioCaps dataset. Experimental results show that LASS-Net achieves considerable improvements over baseline methods. Furthermore, we observe that LASS-Net achieves promising generalization results when using diverse human-annotated descriptions as queries, indicating its potential use in real-world scenarios. The separated audio samples and source code are available at https://liuxubo717.github.io/LASS-demopage.
Entanglement, or quantum inseparability, is a crucial resource in quantum information applications, and therefore the experimental generation of separated yet entangled systems is of paramount importance. Experimental demonstrations of inseparability with light are not uncommon, but such demonstrations in physically well-separated massive systems, such as distinct gases of atoms, are new and present significant challenges and opportunities. Rigorous theoretical criteria are needed for demonstrating that given data are sufficient to confirm entanglement. Such criteria for experimental data have been derived for the case of continuous-variable systems obeying the Heisenberg-Weyl (position- momentum) commutator. To address the question of experimental verification more generally, we develop a sufficiency criterion for arbitrary states of two arbitrary systems. When applied to the recent study by Julsgaard, Kozhekin, and Polzik [Nature 413, 400 - 403 (2001)] of spin-state entanglement of two separate, macroscopic samples of atoms, our new criterion confirms the presence of spin entanglement.
Mixed finite element methods with flux errors in $H(div)$-norms and div-least-squares finite element methods require a separate marking strategy in obligatory adaptive mesh-refining. The refinement indicator $σ^2(\mathcal T,K)=η^2(\mathcal T,K)+μ^2(K)$ of a finite element domain $K$ in an admissible triangulation $\mathcal T$ consists of some residual-based error estimator $η(\mathcal T,K)$ with some reduction property under local mesh-refining and some data approximation error $μ(K)$. Separate marking means either Dörfler marking if $μ^2(\mathcal T) \leq κη^2(\mathcal T)$ or otherwise an optimal data approximation algorithm runs with controlled accuracy as established in [Carstensen, Rabus, Math.Comp. 2011; Rabus, J.Numer.Math. 2015]. The axioms are abstract and sufficient conditions on the estimators $η(\mathcal T,K)$ and data approximation errors $μ(K)$ for optimal asymptotic convergence rates. The enfolded set of axioms simplifies \cite{CFP14} for collective marking, treats separate marking established for the first time in an abstract framework, generalizes [Carstensen, Park, SIAM J.Numer.Anal. 2015] for least-squares schemes, and extends [Carstensen, Rabus, Math.Comp. 2011] t
Voids have emerged as a novel probe of cosmology and large-scale structure. These regions of extreme underdensity are sensitive to physics beyond the standard model of cosmology, and can potentially be used as a testing ground to constrain new physics. We present the first determination of the linear void bias measured in separate universe simulations. Our methods are validated by comparing the separate universe response bias with the clustering bias of voids. We find excellent agreement between the two methods for voids identified in the halo field and the down-sampled dark matter field. For voids traced by halos, we identify two different contributions to the bias. The first is due to the bias of the underlying halo field used to identify voids, while the second we attribute to the dynamical impact of long-wavelength density perturbations on void formation and expansion. By measuring these contributions individually, we demonstrate that their sum is consistent with the total void bias. We also measure the void profiles in our simulations, and determine their separate universe response. These can be interpreted as the sensitivity of the profiles to the background density of the Un
In light of the growing number of user privacy violations in centralized social networks, the need to define effective platforms for decentralized online social networks (DOSNs) is deeply felt. Interesting solutions have been proposed in the past, which own the necessary mechanisms to allow users keeping control over their personal information and setting the rules to regulate the access of other users. Unfortunately, the effectiveness of this type of solutions is severely reduced by the fact that different user communities with a shared interest could be disconnected/separated from each other. This translates into a reduced ability in effectively spreading data of common interest towards all interested users, as it currently happens in centralized social networks. In order to overcome the cited limitation, this paper proposes a disruptive approach, which exploits the availability of a new class of Internet of Things (IoT) devices with autonomous social behaviors and cognitive abilities. Such devices can be leveraged as friendship intermediaries between devices' owners who are connected to a DOSN platform and share the same interest. We will demonstrate that clear advantages can be