Computer & Robot Vision: Activities
IEEE Robotics and Automation Society's Technical Committee on Computer & Robot Vision
Activities
Recent innovations summaries

Like all RAS technical committees, Computer & Robot Vision TC attempts to follow current trends in its area, producing recent innovations summaries. Follow our new Twitter blog or join our Facebook discussion group.

Conference and workshop activities

The technical committee takes part in organizing workshops and conferences in its area.

  • Workshop    Challenges in Perception based on Domain Requirements. Roadmap-Workshop at the European Robotics Forum 2015. Organizers Topic Group Perception Chairs: M. Suppa and D. Burschka

  • Workshop    Believing in Robot’s Eyes - Robust Observations on of Task Relevant Cues , Roadmap- Workshop at the European Robotics Forum 2016. Organizers Topic Group Perception Chairs: M. Suppa and D. Burschka

  • Workshop    Perception Challenges in Times of Deep Learning and Cognition. Roadmap-Workshop at the European Robotics Forum 2017. Organizers Topic Group Perception Chairs: M. Suppa and D. Burschka

  • Workshop    Vision for Robotics Tutorial, IEEE ICRA 2016, with F. Chaumettee, P. Corke and J.Kosecka

  • Resource-efficient Integration of Planning and Perception for true autonomous operation of Micro Air Vehicles (MAVs)(RSS 2014)   Workshop    July 12, 2014 - Berkeley, USA
    Contact Information: Darius Burschka (burschka at tum.de)

    The goal of the workshop is to collect current state-of-the art solutions to navigation of flying robots. Our key interests lie in the latest developments in the area of robust integration of perception with control and planning of the highly dynamic motion of resource-limited flying platforms. The goal is to provide an opportunity to compare and discuss the current state-of-the-art approaches and solutions to the aforementioned problems. We encourage video and live presentations of the approaches during the conference. We aim to organize a panel at the end of the workshop to discuss current challenges in the field and to foster collaborations between the research groups.

  • European Robotics Forum ERF 2014: Closing the Gap between Action and Perception to enable robots to learn, adapt anAd react in real world scenarios.   Workshop    March 13, 2014 - Rovereto, Italy
    Contact Information: Darius Burschka (burschka at tum.de)

    The goal of the workshop is to motivate and coordinate the work of the Topic Group Perception in the euRobotics consortium. Talks in the broad spectrum of cognitive tasks in static and dynamic environments are presented.

  • Resource-Efficient Integration of Perception, Control and Navigation for Micro Air Vehicles (MAVs) (RSS2013)   Workshop    June 24, 2013 - Berlin, Germany
    Contact Information: Darius Burschka (burschka at tum.de)

    The goal of the workshop is to collect current state-of-the art solutions to navigation of flying robots. Our key interests lie in the latest developments in the area of robust integration of perception with control and planning of the highly dynamic motion of resource-limited flying platforms. We are also interested in new developments in the field of internal environment representation and collaborative approaches in perception and exploration.

  • Workshop on Resource-Efficient Integration of Perception and Control for Highly Dynamic Mobile Systems (RSS2012)   Workshop    July 9-10, 2012 - Sydney, Australia
    Contact Information: Darius Burschka (burschka at tum.de)

    The goal of the workshop is to collect current state-of-the art solutions to navigation of flying robots. Our key interests lie in the latest developments in the area of robust integration of perception with control and planning of the highly dynamic motion of resource-limited flying platforms. We are also interested in new developments in the field of internal environment representation and collaborative approaches in perception and exploration.

  • 2nd Workshop on Visual Control of Mobile Robots (ViCoMoR 2012)   Workshop    October 11, 2012 - Vilamoura, Algarve, Portugal
    Contact Information: Gonzalo Lopez-Nicolas (gonlopez at unizar dot es)

    This workshop is aimed to promote exchange and sharing of experiences among researchers in the field of visual control of mobile robots. Previously, the first edition of ViCoMoR was held in San Francisco during IROS'11. This new edition of the workshop will consist of invited talks and selected papers for oral presentation and interactive session.

  • Advanced 3D Point Cloud Processing with Point Cloud Library (PCL)   Tutorial    May 18, 2012 - St. Paul, Minnesota, USA
    Contact Information: Radu B. Rusu (rusu at openperception dot org)

    Point clouds are one of the most fascinating and challenging sensor streams, leading to countless publications. The advent of low cost 3D cameras, such as the Microsoft Kinect, has lead to a wide range of new ideas and projects in this field. The PCL community tries to bring together all these activities to produce one open source library. Backed up by leading institutions and researchers around the world, as well as dedicated senior level programmers, this gives us the opportunity to join all the lose ends in point cloud processing. The point cloud library gives every researcher the opportunity to try new ideas fast as well as discuss them with and get support from a big community. Most of this is done through electronic communication, including mailing lists and chat systems, but to share it with the broader robotics community, as well as to get more people involved, we propose a one day tutorial. We will give an introduction to the library, guide the attendees in their first steps using it, as well as show what great results have been achieved with it already.

  • 2nd IEEE International Conference on Robotics and Automation (ICRA) Workshop on Semantic Perception, Mapping and Exploration (SPME)   Workshop    May 14, 2012 - St. Paul, Minnesota, USA
    Contact Information: Radu B. Rusu (rusu at openperception dot org)

    As robots and autonomous systems move away from laboratory setups towards complex real-world scenarios, both the perception capabilities of these systems and their abilities to acquire and model semantic information must become more powerful. The autonomous acquisition of information, the extraction of semantic models, and exploration strategies for deciding where and how to acquire the most relevant information pertinent to a specific semantic model are the research foci of an annual series of workshops at ICRA, called Semantic Perception, Mapping and Exploration (SPME).

Publication activities

The technical committee takes part in publishing in its area.

  • Participation in the Topic Group Perception for the Horizon 2020 EU programme  Roadmap     April 2014 - Multi-Annual Roadmap in Robotics
  • Special Issue on Robot Vision  Special Issue    Forthcoming Winter 2011-2012 - International Journal of Robotics Research
    Contact Information: Danica Kragic (dani at kth dot se)
  • Computer and Robot Vision  Column    June 2011 - Robotics and Automation Magazine
    Contact Information: Ville Kyrki (kyrki at lut dot fi)
  • Recent trends in computational and robot vision  Survey article    2008 - Springer LNEE
    Contact Information: Ville Kyrki (kyrki at lut dot fi)
  • Unifying Perspectives in Computational and Robot Vision  Book    2008 - Springer LNEE
    Contact Information: Ville Kyrki (kyrki at lut dot fi)
Past Activities
  • ICRA 2011 Workshop on Mobile Manipulation: Integrating Perception and Manipulation   Workshop    May 13, 2011 - Shanghai, China
    Contact Information: Danica Kragic (dani at kth dot se)

    The purpose of this workshop is to provide a forum for researchers across various fields to discuss methods for integrating perception and manipulation in the context of a unified mobile manipulation system. Recent years have seen tremendous progress toward the goal of autonomous mobile robots that can interact with unstructured, dynamic, and human-centered environments. Research in mobile manipulation has gained momentum with the development of integrated systems, (like Willow Garage's PR2 robot, Intel's HERB, DLR's Justin, the iCub, HRP2, etc.) with the necessary onboard sensing, computation, manipulation and mobility capabilities to start tackling such environments. Mobile manipulation is a highly integrative, interdisciplinary field. The workshop will bring together researchers from academia and industry from diverse disciplines to discuss innovations, applications, success stories, and future prospects for mobile manipulation. While contributions in all the relevant fields will be welcome, this workshop will focus on methods of integrating perception with manipulation and how methods in one field may inform another. The workshop aims to spark vibrant discussion with speakers from a wide range of disciplines, as well as lively panel discussions that address the current state of the art and future directions.

  • ECCV 2010 Workshop - Vision for Cognitive Tasks   Workshop    September 10, 2010 - Heraklion, Greece
    Contact Information: Danica Kragic (dani at kth dot se)

    We are on the verge of a new era when technical systems expand from typical industrial applications with pre-programmed, hard-wired behaviors into everyday life situations where they have to deal with complex and unpredictable events. Many practical applications such as mobility, manipulation and interaction require a large number of vision-based cognitive tasks such as human tracking, activity interpretation, object tracking, recognition and classification. In the relation to robotic and cognitive systems, vision however faces a number of new challenges going beyond present-day approaches benchmarked on databases.

    Hence, the main objective of the workshop is to initiate a close dialog between the communities and allow for long term planning of synergistic effects from the integrated research. It will be beneficial for participants to learn about the potential of vision techniques in the wide area of possible applications in these fields. In addition, in many cases, methods available in the computer vision community are not fully exploited in the robotics and cognitive systems communities.

    The target audience are computer vision researchers willing to have a look into the challenges of application areas such as robotics and cognitive systems as well as researchers from these fields interested to become acquainted with state of the art vision methods. While researchers in computer vision mainly work on image and video databases, robot researchers predominantly work with single-coloured objects. It would be great to start bridging this rather large gap by bringing these communities closely together at the level of present day experience. Knowing about tasks makes it possible to obtain more robust perception while state of the art vision methods will push systems to new applications.

  • ICRA 2010 Workshop Representations for object grasping and manipulation   Workshop    May 3, 2010 - Anchorage, AL, US
    Contact Information: Danica Kragic (dani at kth dot se)

    Object grasping and manipulation is of significant importance for robot systems interacting with the environment. However, there are no a general, widely accepted representations of sensory data that can be used in different applications and across different embodiments. There are systems relying only on visual feedback and those that integrate visual and haptic feedback but in very constrained situations. The goal of this workshop is to bring together researchers from computer vision, machine learning and control to discuss the future avenues in the area of sensory based object grasping and manipulation. Of special interest are systems that are based on multiple sensory input and have been demonstrated to perform in natural settings with different types of objects.

    The increasing demand for robotic applications in dynamic and unstructured environments and novel situations is motivating the need for dexterous robot hands and grasping abilities, which can cope with the wide variety of tasks and objects encountered in such environments. Thus, we ask: "Where is the robot that fills a shopping bag and empties it at home?" Compared to humans or primates, the ability of today’s robotic grippers and hands is surprisingly limited and their dexterity cannot be compared to human hand capabilities. Contemporary robotic hands can grasp only a few objects in constricted poses with limited grasping postures and positions.

    The main objective of this workshop is to discuss the needs for the design of a robot system capable of performing grasping and manipulation tasks in open-ended environments, dealing with novelty, uncertainty and unforeseen situations. The design of such a system must take into account three important facts: i) it has to be based on solid theoretical basis, ii) it has to be extensively evaluated on a suitable and measurable foundation, thus iii) allowing for self-understanding and self-extension. As an outcome, we expect the participating researchers to provide insight in what is needed for robotic systems to reason about graspable targets, to explore and investigate their physical properties and finally to make artificial hands grasp any object. In particular, we are interested in discussing the mathematical models of uncertainty and sensors integration as well as plausible machine learning, computer vision and control strategies.

  • Schloss Dahstuhl seminar: From form to action   Conference    October 18, 2009 - Dagstuhl, Germany
    Contact Information: Danica Kragic (dani at kth dot se)

    The aim of this seminar is to bring together researchers from different fields related to the goal of advancing our understanding of human and machine perception of form and function. We set out to explore findings from different disciplines to build more comprehensive and complete models and methods. Neuroscientists and experimental psychologists will provide initial conceptual findings on the selective nature of sensor processing and on how action-relevant information is extracted. Cognitive scientists will tackle the modeling of knowledge of object function and task relations. Computer vision scientists are challenged to develop procedures to achieve context-driven attention and a targeted detection of relevant form features. All participants will profit from the ideas and findings in the related disciplines and contribute towards establishing a comprehensive understanding of brain and computing processes to extract object function from form features.

  • ECCV 2008 WORKSHOP - Vision in Action: Efficient strategies for cognitive agents in complex environments   Workshop    October 12, 2008 - Marseille, France
    Contact Information: Danica Kragic (dani at kth dot se)

    As a continuation of the ECCV workshop series on Cognitive Vision, this workshop aims to bring together researchers from various programs and projects working on novel approaches for cognition in technical systems. The second objective of the workshop is to discuss ways of how to integrate biological and psychological findings from human and insect perception and action generation, their exploration and representation strategies. Recent results in combining biological insights into development of perception and action algorithms promise a large impact on research in several fields.

  • From features to actions - Unifying perspectives in computational and robot vision   Workshop    April 11, 2007 - Rome, Italy
    Contact Information: Danica Kragic (dani at kth dot se)

    The field of computer vision has developed significantly over the past few years and its importance for robotics is also growing. Due to many practical applications in a diverse variety of sub-disciplines, such as surveillance, robot control, and virtual environments, vision algorithms have a significant application impact. The robotics and computer vision communities have, however, remained largely separate. Dialog between the two communities would then contribute greatly to the progress in both disciplines. In many cases, methods available in the computer vision community are not in general use in the robotics community. On the other hand, the system level perspective is often neglected in the computer vision community, because the research is focused on individual problems and algorithms. There is consequently a need to bring the communities of robot and computer vision to a joint appreciation of the value of systems, where there is a need to consider all aspects from perception to action generation. This workshop is intended to highlight the problems and new approaches to the above issues by bringing together computer vision and robotics researchers.

  • Video Surveillance   Tutorial    March 1, 2006 - Honeywell Labs
    Contact Information: Nikos Papanikolopoulos (npapas at cs dot umn dot edu)

    A short tutorial on video surveillance to fifty engineers.

  • Visual Tracking: 2D/3D Methods and Cue Integration   Tutorial    April 18, 2005 - Barcelona
    Contact Information: Danica Kragic (dani at kth dot se)

    Vision is one of the most powerful sensory modalities in the field of robotics. Longterm research in application areas such as service robotics, intelligent vehicles, medical robotics, surveillance, and human-robot interaction has resulted with different types of visual tracking algorithms. The aim of this tutorial is to present theoretical basics of visual tracking and overview some of the most common methods. We will spend time on issues such as the choice and estimation of visual cues and their integration for both 2D and 3D tracking.

    Issues covered:
    * visual tracking basics
    * 2D visual cues
    * visual tracking in 3-D
    * cue integration
    * motion models
    * applications

  • Tutorial on Video Surveillance   Tutorial    March 23, 2005 - USF, FL
    Contact Information: Nikos Papanikolopoulos (npapas at cs dot umn dot edu)

    The tutorial had an audience of 40 engineers interested in homeland security applications.

  • Special Issue on Panoramic Robotics   Publication - Journal    December 1, 2004 - Robotics and Automation Magazine
    Contact Information: Kostas and Nikos Daniilidis and Papanikolopoulos (npapas at cs dot umn dot edu)

    The special issue involved papers on Panoramic Robotics, a quickly evolving area.

  • Advances in Robot Vision - From Domestic Environments to Medical Applications   Workshop    September 28, 2004 - Sendai, Japan
    Contact Information: Danica Kragic (dani at kth dot se)

    This workshop aims at presenting state-of-the-art computer vision research and related problems such as algorithm design and modeling, underlying control methodologies, visual cues and their integration, real-time aspects, vision for autonomus navigation and cognitive aspects.