deep learning bachelor thesis

The Future of AI Research: 20 Thesis Ideas for Undergraduate Students in Machine Learning and Deep Learning for 2023!

A comprehensive guide for crafting an original and innovative thesis in the field of ai..

By Aarafat Islam on 2023-01-11

“The beauty of machine learning is that it can be applied to any problem you want to solve, as long as you can provide the computer with enough examples.” — Andrew Ng

This article provides a list of 20 potential thesis ideas for an undergraduate program in machine learning and deep learning in 2023. Each thesis idea includes an  introduction , which presents a brief overview of the topic and the  research objectives . The ideas provided are related to different areas of machine learning and deep learning, such as computer vision, natural language processing, robotics, finance, drug discovery, and more. The article also includes explanations, examples, and conclusions for each thesis idea, which can help guide the research and provide a clear understanding of the potential contributions and outcomes of the proposed research. The article also emphasized the importance of originality and the need for proper citation in order to avoid plagiarism.

1. Investigating the use of Generative Adversarial Networks (GANs) in medical imaging:  A deep learning approach to improve the accuracy of medical diagnoses.

Introduction:  Medical imaging is an important tool in the diagnosis and treatment of various medical conditions. However, accurately interpreting medical images can be challenging, especially for less experienced doctors. This thesis aims to explore the use of GANs in medical imaging, in order to improve the accuracy of medical diagnoses.

2. Exploring the use of deep learning in natural language generation (NLG): An analysis of the current state-of-the-art and future potential.

Introduction:  Natural language generation is an important field in natural language processing (NLP) that deals with creating human-like text automatically. Deep learning has shown promising results in NLP tasks such as machine translation, sentiment analysis, and question-answering. This thesis aims to explore the use of deep learning in NLG and analyze the current state-of-the-art models, as well as potential future developments.

3. Development and evaluation of deep reinforcement learning (RL) for robotic navigation and control.

Introduction:  Robotic navigation and control are challenging tasks, which require a high degree of intelligence and adaptability. Deep RL has shown promising results in various robotics tasks, such as robotic arm control, autonomous navigation, and manipulation. This thesis aims to develop and evaluate a deep RL-based approach for robotic navigation and control and evaluate its performance in various environments and tasks.

4. Investigating the use of deep learning for drug discovery and development.

Introduction:  Drug discovery and development is a time-consuming and expensive process, which often involves high failure rates. Deep learning has been used to improve various tasks in bioinformatics and biotechnology, such as protein structure prediction and gene expression analysis. This thesis aims to investigate the use of deep learning for drug discovery and development and examine its potential to improve the efficiency and accuracy of the drug development process.

5. Comparison of deep learning and traditional machine learning methods for anomaly detection in time series data.

Introduction:  Anomaly detection in time series data is a challenging task, which is important in various fields such as finance, healthcare, and manufacturing. Deep learning methods have been used to improve anomaly detection in time series data, while traditional machine learning methods have been widely used as well. This thesis aims to compare deep learning and traditional machine learning methods for anomaly detection in time series data and examine their respective strengths and weaknesses.

Photo by  Joanna Kosinska  on  Unsplash

6. Use of deep transfer learning in speech recognition and synthesis.

Introduction:  Speech recognition and synthesis are areas of natural language processing that focus on converting spoken language to text and vice versa. Transfer learning has been widely used in deep learning-based speech recognition and synthesis systems to improve their performance by reusing the features learned from other tasks. This thesis aims to investigate the use of transfer learning in speech recognition and synthesis and how it improves the performance of the system in comparison to traditional methods.

7. The use of deep learning for financial prediction.

Introduction:  Financial prediction is a challenging task that requires a high degree of intelligence and adaptability, especially in the field of stock market prediction. Deep learning has shown promising results in various financial prediction tasks, such as stock price prediction and credit risk analysis. This thesis aims to investigate the use of deep learning for financial prediction and examine its potential to improve the accuracy of financial forecasting.

8. Investigating the use of deep learning for computer vision in agriculture.

Introduction:  Computer vision has the potential to revolutionize the field of agriculture by improving crop monitoring, precision farming, and yield prediction. Deep learning has been used to improve various computer vision tasks, such as object detection, semantic segmentation, and image classification. This thesis aims to investigate the use of deep learning for computer vision in agriculture and examine its potential to improve the efficiency and accuracy of crop monitoring and precision farming.

9. Development and evaluation of deep learning models for generative design in engineering and architecture.

Introduction:  Generative design is a powerful tool in engineering and architecture that can help optimize designs and reduce human error. Deep learning has been used to improve various generative design tasks, such as design optimization and form generation. This thesis aims to develop and evaluate deep learning models for generative design in engineering and architecture and examine their potential to improve the efficiency and accuracy of the design process.

10. Investigating the use of deep learning for natural language understanding.

Introduction:  Natural language understanding is a complex task of natural language processing that involves extracting meaning from text. Deep learning has been used to improve various NLP tasks, such as machine translation, sentiment analysis, and question-answering. This thesis aims to investigate the use of deep learning for natural language understanding and examine its potential to improve the efficiency and accuracy of natural language understanding systems.

Photo by  UX Indonesia  on  Unsplash

11. Comparing deep learning and traditional machine learning methods for image compression.

Introduction:  Image compression is an important task in image processing and computer vision. It enables faster data transmission and storage of image files. Deep learning methods have been used to improve image compression, while traditional machine learning methods have been widely used as well. This thesis aims to compare deep learning and traditional machine learning methods for image compression and examine their respective strengths and weaknesses.

12. Using deep learning for sentiment analysis in social media.

Introduction:  Sentiment analysis in social media is an important task that can help businesses and organizations understand their customers’ opinions and feedback. Deep learning has been used to improve sentiment analysis in social media, by training models on large datasets of social media text. This thesis aims to use deep learning for sentiment analysis in social media, and evaluate its performance against traditional machine learning methods.

13. Investigating the use of deep learning for image generation.

Introduction:  Image generation is a task in computer vision that involves creating new images from scratch or modifying existing images. Deep learning has been used to improve various image generation tasks, such as super-resolution, style transfer, and face generation. This thesis aims to investigate the use of deep learning for image generation and examine its potential to improve the quality and diversity of generated images.

14. Development and evaluation of deep learning models for anomaly detection in cybersecurity.

Introduction:  Anomaly detection in cybersecurity is an important task that can help detect and prevent cyber-attacks. Deep learning has been used to improve various anomaly detection tasks, such as intrusion detection and malware detection. This thesis aims to develop and evaluate deep learning models for anomaly detection in cybersecurity and examine their potential to improve the efficiency and accuracy of cybersecurity systems.

15. Investigating the use of deep learning for natural language summarization.

Introduction:  Natural language summarization is an important task in natural language processing that involves creating a condensed version of a text that preserves its main meaning. Deep learning has been used to improve various natural language summarization tasks, such as document summarization and headline generation. This thesis aims to investigate the use of deep learning for natural language summarization and examine its potential to improve the efficiency and accuracy of natural language summarization systems.

Photo by  Windows  on  Unsplash

16. Development and evaluation of deep learning models for facial expression recognition.

Introduction:  Facial expression recognition is an important task in computer vision and has many practical applications, such as human-computer interaction, emotion recognition, and psychological studies. Deep learning has been used to improve facial expression recognition, by training models on large datasets of images. This thesis aims to develop and evaluate deep learning models for facial expression recognition and examine their performance against traditional machine learning methods.

17. Investigating the use of deep learning for generative models in music and audio.

Introduction:  Music and audio synthesis is an important task in audio processing, which has many practical applications, such as music generation and speech synthesis. Deep learning has been used to improve generative models for music and audio, by training models on large datasets of audio data. This thesis aims to investigate the use of deep learning for generative models in music and audio and examine its potential to improve the quality and diversity of generated audio.

18. Study the comparison of deep learning models with traditional algorithms for anomaly detection in network traffic.

Introduction:  Anomaly detection in network traffic is an important task that can help detect and prevent cyber-attacks. Deep learning models have been used for this task, and traditional methods such as clustering and rule-based systems are widely used as well. This thesis aims to compare deep learning models with traditional algorithms for anomaly detection in network traffic and analyze the trade-offs between the models in terms of accuracy and scalability.

19. Investigating the use of deep learning for improving recommender systems.

Introduction:  Recommender systems are widely used in many applications such as online shopping, music streaming, and movie streaming. Deep learning has been used to improve the performance of recommender systems, by training models on large datasets of user-item interactions. This thesis aims to investigate the use of deep learning for improving recommender systems and compare its performance with traditional content-based and collaborative filtering approaches.

20. Development and evaluation of deep learning models for multi-modal data analysis.

Introduction:  Multi-modal data analysis is the task of analyzing and understanding data from multiple sources such as text, images, and audio. Deep learning has been used to improve multi-modal data analysis, by training models on large datasets of multi-modal data. This thesis aims to develop and evaluate deep learning models for multi-modal data analysis and analyze their potential to improve performance in comparison to single-modal models.

I hope that this article has provided you with a useful guide for your thesis research in machine learning and deep learning. Remember to conduct a thorough literature review and to include proper citations in your work, as well as to be original in your research to avoid plagiarism. I wish you all the best of luck with your thesis and your research endeavors!

Continue Learning

Top 5 open-source image super-resolution projects to boost your image processing tasks, best practices for ai professional headshots: mastering your visual brand, art generating ai, 6 best ai apis to build intelligent apps in 2023, 2050: what ai foresees for the future world.

Exploring the future of AI and its potential impact on various aspects of our world by the year 2050.

How to Run the LLAMA Web UI on Collab or Locally?

Search code, repositories, users, issues, pull requests...

Provide feedback.

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly.

To see all available qualifiers, see our documentation .

• Notifications

Deep Learning Algorithms Applied to Blockchain-Based Financial Time Series

PsiPhiTheta/Bachelor-Thesis

Folders and files, repository files navigation, bachelor thesis.

Deep Learning Algorithms Applied to Blockchain-Based Financial Time Series (FTS).

1. Exercises

The main project was approached via multiple sub-tasks or exercises, before building up the final model. All R scripts corresponding to each sub-task can be found in the src directory, with corresponding datasets in the datasets directory. A short PDF document accompanies each exercise to present a summary of results, all of which can be found in the doc directory.

Exercise 1: AR Yule-Walker, AR Burg

This exercise investigates linear AR Yule-Walker and AR Burg models applied to FTS prediction.

Exercise 2: ARMA & ARIMA

These exercises investigate linear ARMA & ARIMA models applied to FTS prediction and why linear models are not necessarily the most suited for modelling FTS.

Exercise 3: ARCH & GARCH

This exercise investigates linear ARCH & GARCH models applied to FTS prediction and why linear models are not necessarily the most suited for modelling FTS.

Exercise 4: SLP & NN

This exercise investigates non-linear Single Layer Perceptron (SLP) & basic Neural Networks (NN) and their performance for modelling FTS.

Exercise 5: NNetAR

This exercise investigates Single Hidden Layer Neural Networks (NNetAR algorithm) and their performance for modelling FTS.

Exercise 6: SOM (Animals)

This exercise investigates Self Organising Maps (SOM) and their performance in unsupervised learning.

Exercise 7: Forex vs. BTC

This exercise investigates the differences in applying the AR, ARMA, ARIMA, ARCH, GARCH & SLP models to Forex & BTC FTS (binary only).

Exercise 8: NARMAX

This exercise investigates applying the Nonlinear Auto Regressive Moving Average model with eXogenous inputs (NARMAX) to both predicting Forex & BTC FTS (trend & binary).

Exercise 9: SOM (BTC/Forex)

This exercise investigates Self Organising Maps (SOM) and their performance in unsupervised learning applied to Forex & BTC FTS.

Exercise 10: ESN (BTC/Forex)

This exercise investigates Echo State Networks (ESN) and their performance in unsupervised learning applied to Forex & BTC FTS.

Exercise 11: LF Granger Causality (Cryptocurrencies)

This exercise investigates Low Frequency Granger Causality in cryptocurrencies.

Exercise 12: HF Granger Causality (Cryptocurrencies)

This exercise investigates High Frequency Granger Causality in cryptocurrencies.

Exercise 13: HF NN (BTC)

This exercise investigates a preliminary High Frequency NN for forecasting BTC close price with OCLH data.

Exercise 14: HF NN (DASH)

This exercise investigates a slightly improved High Frequency NN for forecasting DASH close price with delayed time series and exogenous BTC delayed inputs.

Exercise 15: Volatility (BTC/Forex)

This exercise investigates briefly fully Bayesian estimations of stochastic volatility via Markov chain Monte Carlo methods in the BTC-USD pair compared to other typical Forex currencies. For context only.

Exercise 16: Further NN Investigations (Cryptocurrencies)

This exercises looks at the impact of going from HF minute-data to MF-hour data as well as other simple NN architectures.

Exercise 17: Deep NN Investigations (Cryptocurrencies)

This exercises looks at Deep NN architectures using Keras, TensorFlow & CUDA.

Exercise 18: Hour Granger Causality (Cryptocurrencies)

This exercise investigates Hourly Granger Causality in cryptocurrencies.

Exercise 19: Further DNN Investigations (Cryptocurrencies)

This exercises looks at further DNN architectures (up to 20x20 with 2 hidden layers) using Keras, TensorFlow & CUDA.

Exercise 20: Live Algorithmic Trading (Cryptocurrencies)

This proof of concept exercise uses the most performant algorithm developped thus far to trade live on the Poloniex exchange.

2. Mathematical Fundamentals

These equations cover the bare fundamentals of all the models used. This can also be found in the doc directory.

3. Project Progress report

(Complete, graded 80.50%)

4. Final Bachelor Thesis

(Complete, graded 92.00% overall)

Google Custom Search

Wir verwenden Google für unsere Suche. Mit Klick auf „Suche aktivieren“ aktivieren Sie das Suchfeld und akzeptieren die Nutzungsbedingungen.

Hinweise zum Einsatz der Google Suche

• Data Analytics and Machine Learning Group
• TUM School of Computation, Information and Technology
• Technical University of Munich

Open Topics

We offer multiple Bachelor/Master theses, Guided Research projects and IDPs in the area of data mining/machine learning. A  non-exhaustive list of open topics is listed below.

If you are interested in a thesis or a guided research project, please send your CV and transcript of records to Prof. Stephan Günnemann via email and we will arrange a meeting to talk about the potential topics.

Robustness of Large Language Models

Type: Master's Thesis

Prerequisites:

• Strong knowledge in machine learning
• Very good coding skills
• Proficiency with Python and deep learning frameworks (TensorFlow or PyTorch)
• Knowledge about NLP and LLMs

Description:

The success of Large Language Models (LLMs) has precipitated their deployment across a diverse range of applications. With the integration of plugins enhancing their capabilities, it becomes imperative to ensure that the governing rules of these LLMs are foolproof and immune to circumvention. Recent studies have exposed significant vulnerabilities inherent to these models, underlining an urgent need for more rigorous research to fortify their resilience and reliability. A focus in this work will be the understanding of the working mechanisms of these attacks.

We are currently seeking students for the upcoming Summer Semester of 2024, so we welcome prompt applications. This project is in collaboration with  Google Research .

Contact: Tom Wollschläger

References:

• Universal and Transferable Adversarial Attacks on Aligned Language Models
• Attacking Large Language Models with Projected Gradient Descent
• Representation Engineering: A Top-Down Approach to AI Transparency
• Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks

Generative Models for Drug Discovery

Type:  Mater Thesis / Guided Research

• Strong machine learning knowledge
• Proficiency with Python and deep learning frameworks (PyTorch or TensorFlow)
• Knowledge of graph neural networks (e.g. GCN, MPNN)
• No formal education in chemistry, physics or biology needed!

Effectively designing molecular geometries is essential to advancing pharmaceutical innovations, a domain which has experienced great attention through the success of generative models. These models promise a more efficient exploration of the vast chemical space and generation of novel compounds with specific properties by leveraging their learned representations, potentially leading to the discovery of molecules with unique properties that would otherwise go undiscovered. Our topics lie at the intersection of generative models like diffusion/flow matching models and graph representation learning, e.g., graph neural networks. The focus of our projects can be model development with an emphasis on downstream tasks ( e.g., diffusion guidance at inference time ) and a better understanding of the limitations of existing models.

Contact :  Johanna Sommer , Leon Hetzel

Equivariant Diffusion for Molecule Generation in 3D

Equivariant Flow Matching with Hybrid Probability Transport for 3D Molecule Generation

Structure-based Drug Design with Equivariant Diffusion Models

Efficient Machine Learning: Pruning, Quantization, Distillation, and More - DAML x Pruna AI

Type: Master's Thesis / Guided Research / Hiwi

The efficiency of machine learning algorithms is commonly evaluated by looking at target performance, speed and memory footprint metrics. Reduce the costs associated to these metrics is of primary importance for real-world applications with limited ressources (e.g. embedded systems, real-time predictions). In this project, you will work in collaboration with the DAML research group and the Pruna AI startup on investigating solutions to improve the efficiency of machine leanring models by looking at multiple techniques like pruning, quantization, distillation, and more.

Contact: Bertrand Charpentier

• The Efficiency Misnomer
• A Gradient Flow Framework for Analyzing Network Pruning
• Distilling the Knowledge in a Neural Network
• A Survey of Quantization Methods for Efficient Neural Network Inference

Deep Generative Models

Type:  Master Thesis / Guided Research

• Strong machine learning and probability theory knowledge
• Knowledge of generative models and their basics (e.g., Normalizing Flows, Diffusion Models, VAE)
• Optional: Neural ODEs/SDEs, Optimal Transport, Measure Theory

With recent advances, such as Diffusion Models, Transformers, Normalizing Flows, Flow Matching, etc., the field of generative models has gained significant attention in the machine learning and artificial intelligence research community. However, many problems and questions remain open, and the application to complex data domains such as graphs, time series, point processes, and sets is often non-trivial. We are interested in supervising motivated students to explore and extend the capabilities of state-of-the-art generative models for various data domains.

Contact : Marcel Kollovieh , David Lüdke

• Flow Matching for Generative Modeling
• Auto-Encoding Variational Bayes
• Denoising Diffusion Probabilistic Models 
• Structured Denoising Diffusion Models in Discrete State-Spaces

Graph Structure Learning

Type:  Guided Research / Hiwi

• Optional: Knowledge of graph theory and mathematical optimization

Graph deep learning is a powerful ML concept that enables the generalisation of successful deep neural architectures to non-Euclidean structured data. Such methods have shown promising results in a vast range of applications spanning the social sciences, biomedicine, particle physics, computer vision, graphics and chemistry. One of the major limitations of most current graph neural network architectures is that they often rely on the assumption that the underlying graph is known and fixed. However, this assumption is not always true, as the graph may be noisy or partially and even completely unknown. In the case of noisy or partially available graphs, it would be useful to jointly learn an optimised graph structure and the corresponding graph representations for the downstream task. On the other hand, when the graph is completely absent, it would be useful to infer it directly from the data. This is particularly interesting in inductive settings where some of the nodes were not present at training time. Furthermore, learning a graph can become an end in itself, as the inferred structure can provide complementary insights with respect to the downstream task. In this project, we aim to investigate solutions and devise new methods to construct an optimal graph structure based on the available (unstructured) data.

Contact : Filippo Guerranti

• A Survey on Graph Structure Learning: Progress and Opportunities
• Differentiable Graph Module (DGM) for Graph Convolutional Networks
• Learning Discrete Structures for Graph Neural Networks

NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classification

A Machine Learning Perspective on Corner Cases in Autonomous Driving Perception  

Type: Master's Thesis 

Industrial partner: BMW 

Prerequisites: 

• Strong knowledge in machine learning 
• Knowledge of Semantic Segmentation  
• Good programming skills 
• Proficiency with Python and deep learning frameworks (TensorFlow or PyTorch) 

Description: 

In autonomous driving, state-of-the-art deep neural networks are used for perception tasks like for example semantic segmentation. While the environment in datasets is controlled in real world application novel class or unknown disturbances can occur. To provide safe autonomous driving these cased must be identified. 

The objective is to explore novel class segmentation and out of distribution approaches for semantic segmentation in the context of corner cases for autonomous driving. 

Contact: Sebastian Schmidt

References: 

• Segmenting Known Objects and Unseen Unknowns without Prior Knowledge 
• Efficient Uncertainty Estimation for Semantic Segmentation in Videos  
• Natural Posterior Network: Deep Bayesian Uncertainty for Exponential Family  
• Description of Corner Cases in Automated Driving: Goals and Challenges 

Active Learning for Multi Agent 3D Object Detection 

Type: Master's Thesis  Industrial partner: BMW 

• Knowledge in Object Detection 
• Excellent programming skills 

In autonomous driving, state-of-the-art deep neural networks are used for perception tasks like for example 3D object detection. To provide promising results, these networks often require a lot of complex annotation data for training. These annotations are often costly and redundant. Active learning is used to select the most informative samples for annotation and cover a dataset with as less annotated data as possible.   

The objective is to explore active learning approaches for 3D object detection using combined uncertainty and diversity based methods.  

• Exploring Diversity-based Active Learning for 3D Object Detection in Autonomous Driving   
• Efficient Uncertainty Estimation for Semantic Segmentation in Videos   
• KECOR: Kernel Coding Rate Maximization for Active 3D Object Detection
• Towards Open World Active Learning for 3D Object Detection   

Graph Neural Networks

Type:  Master's thesis / Bachelor's thesis / guided research

• Knowledge of graph/network theory

Graph neural networks (GNNs) have recently achieved great successes in a wide variety of applications, such as chemistry, reinforcement learning, knowledge graphs, traffic networks, or computer vision. These models leverage graph data by updating node representations based on messages passed between nodes connected by edges, or by transforming node representation using spectral graph properties. These approaches are very effective, but many theoretical aspects of these models remain unclear and there are many possible extensions to improve GNNs and go beyond the nodes' direct neighbors and simple message aggregation.

Contact: Simon Geisler

• Semi-supervised classification with graph convolutional networks
• Relational inductive biases, deep learning, and graph networks
• Diffusion Improves Graph Learning
• Weisfeiler and leman go neural: Higher-order graph neural networks
• Reliable Graph Neural Networks via Robust Aggregation

Physics-aware Graph Neural Networks

Type:  Master's thesis / guided research

• Proficiency with Python and deep learning frameworks (JAX or PyTorch)
• Knowledge of graph neural networks (e.g. GCN, MPNN, SchNet)
• Optional: Knowledge of machine learning on molecules and quantum chemistry

Deep learning models, especially graph neural networks (GNNs), have recently achieved great successes in predicting quantum mechanical properties of molecules. There is a vast amount of applications for these models, such as finding the best method of chemical synthesis or selecting candidates for drugs, construction materials, batteries, or solar cells. However, GNNs have only been proposed in recent years and there remain many open questions about how to best represent and leverage quantum mechanical properties and methods.

Contact: Nicholas Gao

• Directional Message Passing for Molecular Graphs
• Neural message passing for quantum chemistry
• Learning to Simulate Complex Physics with Graph Network
• Ab initio solution of the many-electron Schrödinger equation with deep neural networks
• Ab-Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functions
• Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds

Robustness Verification for Deep Classifiers

Type: Master's thesis / Guided research

• Strong machine learning knowledge (at least equivalent to IN2064 plus an advanced course on deep learning)
• Strong background in mathematical optimization (preferably combined with Machine Learning setting)
• Proficiency with python and deep learning frameworks (Pytorch or Tensorflow)
• (Preferred) Knowledge of training techniques to obtain classifiers that are robust against small perturbations in data

Description : Recent work shows that deep classifiers suffer under presence of adversarial examples: misclassified points that are very close to the training samples or even visually indistinguishable from them. This undesired behaviour constraints possibilities of deployment in safety critical scenarios for promising classification methods based on neural nets. Therefore, new training methods should be proposed that promote (or preferably ensure) robust behaviour of the classifier around training samples.

Contact: Aleksei Kuvshinov

References (Background):

• Intriguing properties of neural networks
• Explaining and harnessing adversarial examples
• SoK: Certified Robustness for Deep Neural Networks
• Certified Adversarial Robustness via Randomized Smoothing
• Formal guarantees on the robustness of a classifier against adversarial manipulation
• Towards deep learning models resistant to adversarial attacks
• Provable defenses against adversarial examples via the convex outer adversarial polytope
• Certified defenses against adversarial examples
• Lipschitz-margin training: Scalable certification of perturbation invariance for deep neural networks

Uncertainty Estimation in Deep Learning

Type: Master's Thesis / Guided Research

• Strong knowledge in probability theory

Safe prediction is a key feature in many intelligent systems. Classically, Machine Learning models compute output predictions regardless of the underlying uncertainty of the encountered situations. In contrast, aleatoric and epistemic uncertainty bring knowledge about undecidable and uncommon situations. The uncertainty view can be a substantial help to detect and explain unsafe predictions, and therefore make ML systems more robust. The goal of this project is to improve the uncertainty estimation in ML models in various types of task.

Contact: Tom Wollschläger ,   Dominik Fuchsgruber ,   Bertrand Charpentier

• Can You Trust Your Model’s Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift
• Predictive Uncertainty Estimation via Prior Networks
• Posterior Network: Uncertainty Estimation without OOD samples via Density-based Pseudo-Counts
• Evidential Deep Learning to Quantify Classification Uncertainty
• Weight Uncertainty in Neural Networks

Hierarchies in Deep Learning

Type:  Master's Thesis / Guided Research

Multi-scale structures are ubiquitous in real life datasets. As an example, phylogenetic nomenclature naturally reveals a hierarchical classification of species based on their historical evolutions. Learning multi-scale structures can help to exhibit natural and meaningful organizations in the data and also to obtain compact data representation. The goal of this project is to leverage multi-scale structures to improve speed, performances and understanding of Deep Learning models.

Contact: Marcel Kollovieh , Bertrand Charpentier

• Tree Sampling Divergence: An Information-Theoretic Metricfor Hierarchical Graph Clustering
• Hierarchical Graph Representation Learning with Differentiable Pooling
• Gradient-based Hierarchical Clustering
• Gradient-based Hierarchical Clustering using Continuous Representations of Trees in Hyperbolic Space

Department of Economics

Aeasp 2024 fellow darien kearney.

Darien Kearney is a Ph.D. student in economics at Howard University focusing on Behavioral Economics. Darien started his academic journey at Sam Houston State University, earning a Bachelor of Business Administration in Finance and Banking Services (double major) and a Master of Business Administration in Finance. While at Sam Houston State University, he was part of the student leadership boards for the National Association of Black Accountants (NABA) and the Beta Alpha Psi National Honor Society (Kappa Mu Chapter), where he helped develop fundraising opportunities to increase chapter revenue. Darien then pursued a Master of Science degree in applied psychology from the University of Southern California, where he wrote his thesis on the trading behavior of retail traders in relation to the meme stock frenzy. In his thesis, he analyzed how social media, market sentiment, and cognitive biases influenced individual investors' investment decisions under Dr. Jorge Barraza's guidance. Darien also has a Master of Science degree in applied economics from Cornell University, where he wrote his thesis on the relationship between emotional well-being and student loan debt. In his thesis, he examined how different levels of student debt affect the happiness, confidence, and worry of young adults under the guidance of Dr. Vicki Bogan. Darien, a proud native of Houston, Texas, is driven by a deep passion for advancing the field of economics and contributing to the public good. This passion was evident in his participation as a cohort member of the American Economic Association Summer Program (AEASP), where he conducted research on the financial impacts of well-being on young adults under the guidance of Dr. Neil R. Ericsson and Dr. Justin R. Pierce of the Board of Governors of the Federal Reserve System. He also had the privilege of being a mentee of the Research in Color (RIC) 2021 cohort, where he delved into the relationship between performance and player utilization in the NBA under the guidance of Dr. Sarah Jacobson.

Help | Advanced Search

Computer Science > Computer Vision and Pattern Recognition

Title: master's thesis : deep learning for visual recognition.

Abstract: The goal of our research is to develop methods advancing automatic visual recognition. In order to predict the unique or multiple labels associated to an image, we study different kind of Deep Neural Networks architectures and methods for supervised features learning. We first draw up a state-of-the-art review of the Convolutional Neural Networks aiming to understand the history behind this family of statistical models, the limit of modern architectures and the novel techniques currently used to train deep CNNs. The originality of our work lies in our approach focusing on tasks with a low amount of data. We introduce different models and techniques to achieve the best accuracy on several kind of datasets, such as a medium dataset of food recipes (100k images) for building a web API, or a small dataset of satellite images (6,000) for the DSG online challenge that we've won. We also draw up the state-of-the-art in Weakly Supervised Learning, introducing different kind of CNNs able to localize regions of interest. Our last contribution is a framework, build on top of Torch7, for training and testing deep models on any visual recognition tasks and on datasets of any scale.

Submission history

Access paper:.

• Other Formats

References & Citations

• Google Scholar
• Semantic Scholar

DBLP - CS Bibliography

Bibtex formatted citation.

Bibliographic and Citation Tools

Code, data and media associated with this article, recommenders and search tools.

• Institution

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .