Demos & code

Object Detection & Geotagging

Many applications such as autonomous navigation, urban planning and asset monitoring, rely on the availability of accurate information about objects and their geolocations. Using a combination of fully convolutional neural networks for processing geolocated street view images, we propose to geolocate assets of interest using a Markov Random field for performing multi-sensor information fusion.


Social Media based 3D Visual Popularity

We create a geotagged virtual world to visualise people's visual interests and their sentiment as captured from their social network activities. The 3D map is created automatically using information from OpenStreetMap and Google Street View. The Unreal game engine is used to animate the 3D world where lights represent flash photography of images posted on Twitter. Areas accumulating the most lights are associated with high popularity scores.

Colour transfer

Colour transfer aims at changing the colour feel of an image (target image) using the colour palette of another image (palette image). Colour transfer can also be applied to videos, and for creating dynamic effects on static images.


Populating virtual cities using social media

We propose to automatically populate geo-located virtual cities by harvesting and analyzing online contents shared on social networks and websites.

Object Detection & Geotagging

Many applications such as autonomous navigation, urban planning and asset monitoring, rely on the availability of accurate information about objects and their geolocations. We have recently proposed a pipeline combining fully convolutional neural networks for processing geolocated street view images, and a Markov Random field for performing multi-sensor information fusion.

Automatic Discovery and Geotagging of Objects from Street View Imagery

Publications

Automatic Discovery and Geotagging of Objects from Street View Imagery
V. A. Krylov, E. Kenny, and R. Dahyot, https://arxiv.org/abs/1708.08417, August 2017
Modeles probabilistes d'apparence et estimation robuste
P. Charbonnier, R. Dahyot, T. Vik and F. Heitz, chapter in the book Detection et reconnaissance de la signalisation verticale par analyse d'images edited by P. Foucher, Etudes et Recherches des laboratoires des Ponts et Chaussees, CR53 July 2010, ISBN 978-2-7208-2578-1 (book in pdf)
Analyse d'images sequentielles de scenes routieres par modeles d'apparence pour la gestion du reseau routier
Appearance based road scene video analysis for the management of the road network
R. Dahyot, PhD Thesis University of Strasbourg France, November 2001. Published ISBN10 (2-7208-2028-1) in 2003.
scd-theses.u-strasbg.fr/1167/
Unsupervised Statistical Detection of Changing Objects in Camera-in-Motion Video
R. Dahyot, P. Charbonnier and F. Heitz, IEEE International Conference on Image Processing (ICIP'01), October 2001, Greece.
DOI:10.1109/ICIP.2001.959126
Robust Visual Recognition of Colour Images
R. Dahyot, P. Charbonnier and F. Heitz, IEEE conference on Computer Vision and Pattern Recognition (CVPR'00), volume 1, pages 685-690, Juin 2000, Hilton Head Island USA, (poster).
DOI:10.1109/CVPR.2000.855886

Social Media based 3D Visual Popularity

We create a geotagged virtual world to visualise people s visual interests and their sentiment as captured from their social network activities. Using game engine technologies, lights in the virtual environment are used to highlight areas with high popularity score.

Publications

Social Media based 3D Visual Popularity
A. Bulbul and R. Dahyot, Computer & Graphics, volume 63, pages 28-36, April 2017.
DOI:10.1016/j.cag.2017.01.005

Populating virtual cities using social media

We propose to automatically populate geo-located virtual cities by harvesting and analyzing online contents shared on social networks and websites. We show how pose and motion paths of agents can be realistically rendered using information gathered from social media. 3d cities are automatically generated using open-source information available online. Our final rendering of both static and dynamic urban scenes is generated using Unreal game engine.

Publications

Populating Virtual Cities using Social Media
A. Bulbul and R. Dahyot, Computer Animation and Virtual Worlds journal 2016
DOI:10.1002/cav.1742

Colour Transfer

Colour transfer aims at changing the colour feel of an image (target image) using the colour palette of another image (palette image). Colour transfer can also be applied to videos, and creating dynamic effects on static images. Two techniques have been proposed: the most recent proposes to estimate a parametric transfer function by minimising a distance between Colour distributions (cf. Mairead Grogan's PhD 2013-2016, Code), while the other technique is non parametric and calculate the optimal path that minimise the transportation cost (Francois Pitie's PhD 2002-2006 - Code). Videos have been created using the most recent technique.

Publications

User Interaction for Image Recolouring using L2
M. Grogan, R. Dahyot and A. Smolic, in Conference on Visual Media Production (CVMP), London, December 2017.
Robust Registration of Gaussian Mixtures for Colour Transfer
M. Grogan and R. Dahyot, https://arxiv.org/abs/1705.06091, May 2017
Online Demo and webpage
L2 Registration for Colour Transfer
M. Grogan, M. Prasad and R. Dahyot, European Signal Processing Conference (Eusipco), ISBN 978-0-9928626-4-0, Nice France, September 2015. Code and demo
DOI:10.1109/EUSIPCO.2015.7362799
L2 registration for Colour Transfer in Videos
M. Grogan and R. Dahyot, in Conference on Visual Media Production, London, November 2015. Code and demo
Automated Colour Grading using Colour Distribution Transfer
F. Pitie, A. Kokaram and R. Dahyot, in Computer Vision and Image Understanding, vol. 107, July-August, Elsevier, pp.123-137, 2007. DOI:10.1016/j.cviu.2006.11.011, Code
N-Dimensional Probability Density Function Transfer and its Application to Colour Transfer
F. Pitie, A. Kokaram and R. Dahyot, in proceedings of the IEEE International Conference on Computer Vision (ICCV'05), Beijing, China, Oct. 2005.
DOI:10.1109/ICCV.2005.166
Code
Towards Automated Colour Grading
F. Pitie, A. C. Kokaram and R. Dahyot, 2nd European Conference on Visual Media Production (IEE CVMP 2005), London November 2005. Code

Spherical & reflective surfaces

Several software solutions exist for creating a 3d mesh from multiple RGB images. Artefacts occurs however when dealing with reflective surfaces. We propose a solution for spherical reflective surfaces.

Walton statue

walton sculpture without spherical refinement

walton sculpture with spherical refinement

Berkeley sphere

berkeley sphere without spherical refinement

berkeley sphere with spherical refinement

Publications

3D Reconstruction of Reflective Spherical Surfaces from Multiple Images
A. Bulbul, M. Grogan and R. Dahyot, Irish Machine Vision and Image Processing conference, pages 19-26, (Permanent link to full book: http://hdl.handle.net/2262/74714) ISBN 978-0-9934207-0-2, August 2015, demo.
-->