Image Segmentation

Towards robust referring image segmentation
Towards robust referring image segmentation

We propose a novel ranking loss function, named Bi-directional Exponential Angular Triplet Loss, to help learn an angularly separable common feature space by explicitly constraining the included angles between embedding vectors.

Mar 5, 2024
Betrayed by captions: Joint caption grounding and generation for open vocabulary instance segmentation
Betrayed by captions: Joint caption grounding and generation for open vocabulary instance segmentation

This paper presents a joint Caption Grounding and Generation (CGG) framework for instance-level open vocabulary segmentation. The main contributions are: (1) using fine-grained object nouns in captions to improve grounding with object queries. (2) using captions as supervision signals to extract rich information from other words helps identify novel categories. To our knowledge, this paper is the first to unify segmentation and caption generation for open vocabulary learning. The proposed framework significantly improves OVIS and OSPS and comparable results on OVOD without pre-training on large-scale datasets.

Oct 2, 2023
Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation
Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation

We propose Prototypical Cross-Attention Network (PCAN), capable of leveraging rich spatio-temporal information for online multiple object tracking and segmentation.

Sep 12, 2021
Towards efficient scene understanding via squeeze reasoning
Towards efficient scene understanding via squeeze reasoning

Jul 30, 2021
PointFlow: Flowing Semantics Through Points for Aerial Image Segmentation
PointFlow: Flowing Semantics Through Points for Aerial Image Segmentation

Feb 13, 2021
Is Attention Better Than Matrix Decomposition?
Is Attention Better Than Matrix Decomposition?

Self-attention is not better than the matrix decomposition~(MD) model developed 20 years ago regarding the performance and computational cost for encoding the long-distance dependencies.

Sep 28, 2020
Improving Semantic Segmentation via Decoupled Body and Edge Supervision
Improving Semantic Segmentation via Decoupled Body and Edge Supervision

Jul 3, 2020
Spatial Pyramid Based Graph Reasoning for Semantic Segmentation
Spatial Pyramid Based Graph Reasoning for Semantic Segmentation

Feb 24, 2020
SOGNet: Scene Overlap Graph Network for Panoptic Segmentation
SOGNet: Scene Overlap Graph Network for Panoptic Segmentation

We leverage each object’s category, geometry and appearance features to perform relational embedding, and output a relation matrix that encodes overlap relations. In order to overcome the lack of supervision, we introduce a differentiable module to resolve the overlap between any pair of instances.

Feb 7, 2020
Expectation Maximization Attention Networks for Semantic Segmentation
Expectation Maximization Attention Networks for Semantic Segmentation

We formulate the attention mechanism into an expectation-maximization manner and iteratively estimate a much more compact set of bases upon which the attention maps are computed.

Jul 22, 2019