Dense semantic image segmentation with objects and attributes

Dense semantic image segmentation with objects and attributes Shuai Zheng, Ming-Ming Cheng, Jonathan Warrell, Paul Sturgess, Vibhav Vineet, Carsten Rother*, Philip H. S. Torr Vision Group, University of Oxford 01/06/2014 *The Technische Universität Dresden Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014. 1/6

Traditional Goal • Object class segmentation • Assigning an object class label to each pixel ceiling Wall Cabinet Chair Box Floor 01/06/2014 Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014. 2/6

Our Goal • Segmentation with Objects and Attributes • Assigning an object class and a set of attribute labels to each pixel ceiling: painted, textured Wall: Wood, Cabinet: Painted, Glossy, textured Chair: shiny, Wood Cube, plastic Box: cube Floor : pavement, textured, dry, flat 01/06/2014 Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014. 3/6

Att Seg ribut me es nta tio n Hierarchical Multi-Label Factorial CRF Input Image Grid CRF 01/06/2014 Object segmentation Fully-connected CRF Hierarchical Fully-connected CRF Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014. 4/6

Hierarchical Joint Inference Picture Painted Wall Chair Floor Object Classes Segmentation Painted attribute segmentation Glossy Input Image Cotton attribute segmentation 01/06/2014 Glossy attribute segmentation Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014. 5/6

Thank you! Posters P 6 16: 30 -18: 30, Thursday, June 26. http: //www. robots. ox. ac. uk/~tvg/ 01/06/2014 Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014. 6/6