LAMP

Category: Publications

  • Exemplar-free Continual Representation Learning via Learnable Drift Compensation

    Alex Gomez-Villa, Dipam Goswami, Kai Wang, Andrew D. Bagdanov, Bartlomiej Twardowski, Joost van de Weijer Read Full Paper → Exemplar-free class-incremental learning using a backbone trained from scratch and starting from a small first task presents a significant challenge for continual representation learning. Prototype-based approaches, when continually updated, face the critical issue of semantic drift due to which the old […]

  • ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglement

    Muhammad Atif Butt, Kai Wang, Javier Vazquez-Corral, Joost van de Weijer Read Full Paper → Text-to-Image (T2I) generation has made significant advancements with the advent of diffusion models. These models exhibit remarkable abilities to produce images based on textual prompts. Current T2I models allow users to specify object colors using linguistic color names. However, these labels encompass broad […]

  • Enhancing Perceptual Quality in Video Super-Resolution through Temporally-Consistent Detail Synthesis using Diffusion Models

    Claudio Rota, Marco Buzzelli, Joost van de Weijer Read Full Paper → In this paper, we address the problem of enhancing perceptual quality in video super-resolution (VSR) using Diffusion Models (DMs) while ensuring temporal consistency among frames. We present StableVSR, a VSR method based on DMs that can significantly enhance the perceptual quality of upscaled videos by […]

  • MagMax: Leveraging Model Merging for Seamless Continual Learning

    Daniel Marczak, Bartłomiej Twardowski, Tomasz Trzciński, Sebastian Cygert Read Full Paper → This paper introduces a continual learning approach named MagMax, which utilizes model merging to enable large pre-trained models to continuously learn from new data without forgetting previously acquired knowledge. Distinct from traditional continual learning methods that aim to reduce forgetting during task training, MagMax combines sequential […]

  • Revisiting Supervision for Continual Representation Learning

    Daniel Marczak, Sebastian Cygert, Tomasz Trzciński, Bartłomiej Twardowski Read Full Paper → In the field of continual learning, models are designed to learn tasks one after the other. While most research has centered on supervised continual learning, there is a growing interest in unsupervised continual learning, which makes use of the vast amounts of unlabeled data. Recent studies […]

  • Category Adaptation Meets Projected Distillation in Generalized Continual Category Discovery

    Grzegorz Rypeść, Daniel Marczak, Sebastian Cygert, Tomasz Trzciński, Bartłomiej Twardowski Read Full Paper → Generalized Continual Category Discovery (GCCD) tackles learning from sequentially arriving, partially labeled datasets while uncovering new categories. Traditional methods depend on feature distillation to prevent forgetting the old knowledge. However, this strategy restricts the model’s ability to adapt and effectively distinguish new categories. To address […]

  • Resurrecting Old Classes with New Data for Exemplar-Free Continual Learning

    Dipam Goswami, Albin Soutif-Cormerais, Yuyang Liu, Sandesh Kamath, Bartlomiej Twardowski, Joost van de Weijer Read Full Paper → Continual learning methods are known to suffer from catastrophic forgetting a phenomenon that is particularly hard to counter for methods that do not store exemplars of previous tasks. Therefore to reduce potential drift in the feature extractor […]

  • Plasticity-Optimized Complementary Networks for Unsupervised Continual Learning

    Alex Gomez-Villa, Bartlomiej Twardowski, Kai Wang, Joost van de Weijer Read Full Paper → Continuous unsupervised representation learning (CURL) research has greatly benefited from improvements in self-supervised learning (SSL) techniques. As a result, existing CURL methods using SSL can learn high-quality representations without any labels, but with a notable performance drop when learning on a […]

  • Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-Free Continual Learning

    Filip Szatkowski, Mateusz Pyla, Marcin Przewięźlikowski, Sebastian Cygert, Bartłomiej Twardowski, Tomasz Trzciński Read Full Paper → In this work, we investigate exemplar-free class incremental learning (CIL) with knowledge distillation (KD) as a regularization strategy, aiming to prevent forgetting. KD-based methods are successfully used in CIL, but they often struggle to regularize the model without access […]

  • Divide and not forget: Ensemble of selectively trained experts in Continual Learning

    Grzegorz Rypeść, Sebastian Cygert, Valeriya Khan, Tomasz Trzciński, Bartosz Zieliński, Bartłomiej Twardowski Read Full Paper → Class-incremental learning is becoming more popular as it helps models widen their applicability while not forgetting what they already know. A trend in this area is to use a mixture-of-expert technique, where different models work together to solve the task. However, the experts are […]