Research

Master Diploma / Term student projects

Project Title: Sparse Image Reconstruction with Trainable Image priors

Project Description:

Sparse image reconstruction refers to the problem of recovering an image from a limited number of measurements. Since this is a highly ill-posed problem, a meaningful reconstruction is only possible if prior information about certain image properties is taken into account. An example of an important real-world problem where sparse image reconstruction methods are typically applied is MRI reconstruction. In this case in order to reduce the scanning time and to avoid image artifacts that can appear because of the movement of the patient, usually only a limited number of k-space data are sampled. Then a sparse image reconstruction technique needs to further process the sampled data in order to recover the missing information.

Current methods that are employed for dealing with this task mainly rely on handcrafted image priors and iterative convex optimization techniques. However, due to their iterative nature, these recovery methods are computationally demanding. The goal of this project is to investigate if an alternative method, which will be based on convolutional neural networks (CNNs) and supervised deep learning, can be used to speed-up the reconstruction time and lead to further improvements in terms of image quality.

For more details, click at here.

Project Title: Image Inpainting with Learnable Deep Non-Local Image Priors

Project Description:

Image inpainting refers to the problem of filling in missing regions in an image in a plausible way. This is a very important problem in image processing and computer vision and can be found useful in numerous practical applications such as degraded film restoration, movie postproduction, photograph restoration and retouching, and damaged paintings restoration.

The main goal of this project is the design and supervised training of a deep learning network for image inpainting, and the comparison of its performance with current state-of-the-art image inpainting algorithms. In this context, the core idea that will be pursued is the design of a non-local hierarchical image model, which will be able to explore the very important non-local self-similarity property of natural images (natural images usually consist of patterns that tend to repeat in different locations in the image domain), and investigate if its use can lead to further improvements in terms of reconstruction quality compared to other non-machine learning methods that have been employed so far.

For more details, click at here.

Project Title: Image Super-resolution with Convolutional Neural Networks

Project Description:

Super-resolution (SR) refers to the problem of constructing high-resolution (HR) images from a single or several observed low-resolution (LR) images, thereby increasing the high frequency components and removing the degradations caused by the imaging process of the low resolution camera. The basic idea behind SR is to exploit prior knowledge of image properties and/or combine the non-redundant information contained in multiple low-resolution frames to generate a high-resolution image.

The goal of this project is to investigate whether by using a deep convolutional neural network architecture and supervised learning, it is possible to develop a fast and efficient super-resolution method that will be able to produce super-resolved images of superior quality compared to the ones obtained by current image regularization techniques.

For more details, click at here.

Project Title: Trainable Filters and Shrinkage Functions for Motion Image Deblurring

Project Description:

When a photograph is taken under low-light conditions or the scene involves a fast moving object then motion blur appears in the captured image and significantly degrades the image quality. The motion blur is caused by the movement of the object relative to the sensor of the camera during the time that the shutter is open. Both the movement of the object and the camera shake contribute to this blurring effect. This problem is particularly apparent in low-light conditions when the exposure time is longer and can often be in the order of several seconds.

The focus of this project will be on the design of a motion deblurring algorithm that will be able to restore the underlying image from the blurred observation. To deal with this problem conventional algorithms employ hand-crafted regularizers to explore prior information about the image properties. In this project, the goal is to learn instead a suitable regularizer directly from training data. This is possible by designing a suitable neural network and learning the optimal parameters through supervised learning. Such an approach is expected to lead to superior deblurring results while at a significantly reduced computational complexity, which will cast the designed method practical for real-world applications.

For more details, click at here.

Project Title: Image Restoration of Photon-Limited Data using Convolutional Neural Networks

Project Description:

Photon-limited imaging arises in a wide variety of applications, including night vision, biomedical imaging, space weather, astronomy, and spectral imaging. In such applications image acquisition is accomplished by detecting the number of photons “hitting” a sensor, over some time interval. For low intensity levels, one of the dominant noise sources responsible for the degradation of the quality of the captured images is the so-called quantum or shot noise. Quantum noise is due to fluctuations on the number of detected photons, an inherent limitation of the discrete nature of the detection process, and degrades such images both qualitatively and quantitatively. The resulting degradation can prove to be a major obstacle preventing further image analysis and information extraction. Thus, the development of methods and techniques that are able to deal with this type of degradation is of fundamental importance.

Recently, several image denoising techniques based on convolutional neural networks have been proposed in the literature and they have been shown to lead to impressive results. However, such methods are specifically designed for image denoising under Gaussian noise and thus cannot be directly applied to photon-limited data. The goal of this project is to investigate whether it is possible either to modify existing CNN architectures that are designed for Gaussian image denoising or to design new deep models that will be able to eliminate quantum noise and lead to state-of-the-art results.

For more details, click at here.

Project Title: Machine Learning in Seismic Data Processing

Project Description:

Seismic is a geophysical method for studying the Earth structure using seismic (elastic) waves. These waves propagate through the subsurface and can be used to recover its structure. Active seismic exploration relies on artificial seismic sources for sounding the upper kilometers of the Earth crust. This method is widely used for exploration and imaging hydrocarbon fields. Passive seismic monitoring uses permanent or temporal seismic arrays recording natural or induced seismic activity (earthquakes of different strength). Such monitoring is used for improving seismic hazard prediction, mining safety, studying slope and building stability etc. Arrays of seismic sensors (like microphones) are recording large amounts of seismic data. Major obstacle to efficient seismic data analysis is that many processing procedures require participation of an expert-geophysicist. Thus, the development of methods and techniques for reliable automatic processing of seismic data is of fundamental importance.

Data recorded by seismic arrays contains multiple useful signals of various form contaminated with noise of different properties. There are several processing procedures which we wanted to address. First problem is signal enhancement (denoising) of seismic array data given that signals from one event at different sensors should be similar. Given catalog of several signals from different seismic events we arrive to another problem of classification of these events according to similarity of their waveforms.

Recently, neural networks have been proposed in the literature for processing seismic data. However, these methods need improvement so that data can be robustly analyzed automatically. The goal of this project is to investigate whether it is possible either to modify existing CNN architectures or to design new deep models that will be useful for signal enhancement in seismic array data. Another possible project is aiming at using state-of-the-art cluster analysis methods for classification of seismic events in the catalog.

For more details, click at here.