1 Centre for Digital Music, Queen Mary University of London, U.K. 2 Music & Audio Machine Learning Lab, Universal Music Group, London, U.K. Multimodal contrastive models have achieved strong ...

Abstract: Latent Diffusion Models have emerged as an efficient alternative to conventional diffusion approaches by compressing high-dimensional images into a lower-dimensional latent space using a ...

Abstract: Text encoders in diffusion models have rapidly evolved, transitioning from CLIP to T5-XXL. Although this evolution has significantly enhanced the models’ ability to understand complex ...

We introduce a video diffusion transformer to design metasurfaces with a given Eletromagnetic response via generating current distributions at different frequencies. To use the pretained models, start ...

T5Gemma 2 follows the same adaptation idea introduced in T5Gemma, initialize an encoder-decoder model from a decoder-only checkpoint, then adapt with UL2. In the above figure the research team show ...

Chinese startup Z.ai has released GLM-4.6V, a model family that allows agents to pass images directly to tools without converting them to text first. The release includes a 106-billion-parameter ...