V-SENSE – News & Events
Dr Jordi Pont-Tuset talk: Monday 24th April at 11:30am
Speaker: Dr Jordi Pont-Tuset, Post-Doctoral Researcher at ETHZ
Venue: Large Conference Room, O’Reilly Institute
Date & Time: Monday 24th April at 11:30am
Title: One-Shot Video Object Segmentation
Abstract: In this talk I’ll present our recent work on semi-supervised video object segmentation, i.e., the separation of an object from the background in a video, given the mask of the first frame. We present One-Shot Video Object Segmentation (OSVOS), based on a fully-convolutional neural network architecture that is able to successively transfer generic semantic information, learned on ImageNet, to the task of foreground segmentation, and finally to learning the appearance of a single annotated object of the test sequence (hence one-shot). Although all frames are processed independently, the results are temporally coherent and stable. We perform experiments on three annotated video segmentation databases, which show that OSVOS is fast and improves the state of the art by a significant margin (79.8% vs 68.0%).
Speaker Bio: Jordi Pont-Tuset is a post-doctoral researcher at ETHZ, Switzerland, in Prof Luc Van Gool’s Computer Vision Lab (since 2015). He received the degree in Mathematics in 2008, the degree in Electrical Engineering in 2008, the M.Sc. in Research on Information and Communication Technologies in 2010, and the Ph.D. with honours in 2014; from the Universitat Politècnica de Catalunya, BarcelonaTech (UPC). He worked at Disney Research, Zürich (2014). More info: http://jponttuset.cat.
Dr Laura Toni talk Invitation: Wednesday 26th April at 2pm
Speaker: Dr Laura Toni, Lecturer University College London
Venue: Large Conference Room, O’Reilly Institute
Date & Time: Wednesday 26th April at 2pm
Title: Navigation-Aware Communications for Interactive Multiview Video Systems
Abstract: Recent advances in video technology have moved the research toward novel interactive Multiview services, such as 360-degree videos, and virtual reality, where users can actively interact with the scene. Because of their interactivity, users are no longer seen as mere terminals interconnected by links but active players in the communication with all possible levels of interactivity: from passively consuming contents, to actively crafting ones own media stream and social experience. This user-centric paradigm calls for adaptation of streaming policies to both the nature of the content of the communication and the social dynamics among users to face the astonishing diversity of novel networks.
In this talk, we will provide an overview on adaptive communication paradigms that need to be designed to cope with both the massive traffic of Multiview data and the interactivity level of the users. Then, we will describe in more details novel navigation-aware frameworks for optimal coding, streaming, and Multiview processing in adaptive streaming processes. We conclude with a perspective on open challenges in the field on 360-videos, stressing in particular the need to learn in real time users' behaviours to optimally design future interactive streaming systems
Speaker Bio: Laura Toni received the M.S. and Ph.D. degrees in electrical engineering, from the University of Bologna, Italy, in 2005 and 2009, respectively. In 2007, she was a visiting scholar at the University of California at San Diego (UCSD), CA, and since 2009, she has been a frequent visitor to the UCSD, working on media coding and streaming technologies.
Between 2009 and 2011, she worked at the Tele-Robotics and Application (TERA) department at the Italian Institute of Technology (IIT), investigating wireless sensor networks for robotics applications. In 2012, she was a Post-doctoral fellow at the UCSD and between 2013 and 2016 she was a Post-doctoral fellow in the Signal Processing Laboratory (LTS4) at the Swiss Federal Institute of Technology (EPFL), Switzerland.
Since July 2016, she has been appointed as Lecturer in the Electronic and Electrical Engineering Department of University College London (UCL), UK.
Her research mainly involves interactive multimedia systems, decision-making strategies under uncertainty, large-scale signal processing and communications.
Launch of the Trinity Centre for Creative Technologies & Media Engineering (CHIME) Thursday 23rd February
Provost, Patrick Prendergast, opened the Trinity Centre for Creative Technologies & Media Engineering (CHIME) on Thursday 23rd February. The event took place in the newly refurbished Stack B in the IFSC.
CHIME hosts 14 academic staff and 50 full time researchers from two internationally reknowned research groups: Graphics, Vision and Visualization (GV2) in the School of Computer Science and Statistics (SCSS); and Media Signal Processing (Sigmedia) in the School of Engineering.
SCSS recently recruited SFI Research Professor of Creative Technologies, Aljosa Smolic, who co-directs the Centre, along with EE Professor Anil Kokaram, Head of Sigmedia. Prof. Smolic’s research project, V-SENSE, aims to Extend the Dimensions of Visual Sensation through novel algorithms and workflows for Image-Based Visual Computing expanding the classical 2D video viewing experience common today, and to enable and support new consumer behaviours and preferences in consumption and creation of such content. SCSS Professor of Visual Computing, Carol O’Sullivan, has also recently returned from a career break in Seoul National University and Disney Research Los Angeles to resume her role as Head of GV2 and to continue her research on Animation and Perception. Together they lead a team of world-class researchers who are continuing to build on the considerable achievements of both research groups, which include high-impact publications and successful spin-outs, including Havok, SureWash and Green Parrot Pictures (acquired by Google).
Commenting at the event, Provost Patrick Prendergast said: “The Centre's ambition is to establish Trinity as a world class centre of excellence in Creative Technologies & Media Engineering, and to push the boundaries of visual and auditory processing. That's a high ambition but look what's already been achieved! With the talent, leadership and commitment here, I have full confidence.