Seminar in Deep Neural Networks (FS 2021)
Organization
When & Where: Tuesdays 10:15, online
First seminar: 23.02.2021
Last seminar: 01.06.2021
Coordinators: Roger Wattenhofer & Béni Egressy & Oliver Richter
As a seminar participant, you are invited to attend all the talks and make a presentation. Your presentation should be in English. The presentation should last 35 minutes. Please record a video of your presentation and upload it to the polybox the day before your seminar presentation date. Additionally to the presentation, you should facilitate (together with the other student of the same date) the discussion on zoom, which we will hold from 11.30 -12.00.
Links for the Seminar:
Zoom
Polybox (you should have received the corresponding password per mail)
Moodle
Feedback Form
Disclaimer: This is a seminar, we will focus on reasearch and skip most of the basics. If you feel like you cannot follow the discussions we invite you to check out this lecture and other lectures on deep learning.
Presentation & Discussion
The seminar will be exciting if the presentations are exciting. Here is a 2 page guideline how to do a great scientific presentation. Here are some additional guidelines: 1, 2 and 3. You can find further guidance to structure your talk as well as resources and ideas about what each topic should address here.
We further expect the presentation to motivate a lively discussion. We encourage discussions during and after the presentations as a main objective of this seminar. It may help discussions if you also try to be critical about the presented work. These are all scientific papers, but if you have been in science long enough...
COVID-19 Situation
Due to the COVID-19 outbreak we will hold the seminar in digital form, with discussions over zoom. All talks can be found here (you should have received the corresponding password per mail). Please have your presentation ready as video the day before your assigned presentation date.
Grade
Your grade will mostly depend on your presentation. In addition, we also grade how actively you participate in the discussions throughout the whole semester.
How To Sign Up
There will be two presentation per week, so there is a limited number of slots (topics) which will be assigned based on preference. If you have not received a mail so far, confirming your spot in the seminar, write a sentence regarding your background (courses, projects, ...) in deep learning to Béni Egressy, to get a spot on the waiting list, in case someone cancels.
After You Got Your Topic
We established the following rules to ensure a high quality of the talks and hope that these will result in a good grade for you:- At least 5 weeks before your talk: first meeting with your mentor (you need to read the assigned literature before this meeting).
- At least 3 weeks before your talk: meet your mentor to discuss the structure of your talk.
- At least 1 week before your talk: give the talk in front of your mentor who will provide feedback.
- At the presentation date we expect an electronic copy of your slides.
Schedule
Date | Presenter(s) | Title | Mentor | Slides |
---|---|---|---|---|
23.02.2021 | Béni Egressy, Oliver Richter | Introduction | [pdf] | |
02.03.2021 | Jonas Bokstaller Oliver Richter |
Deep Learning and Neural Architecture Limitations of Deep Learning |
Zhao Meng | [pptx] [pdf] |
09.03.2021 | Neville Walo Pareek Anuj |
NLP: Benchmarks/Tasks/Metrics NLP: Embeddings |
Zhao Meng | [pdf] [pdf] |
16.03.2021 | Fatjon Zogaj, Mihai Zorca | NLP: Attention/BERT/GPT | Damian Pascual | [pdf][pdf] |
23.03.2021 | Peter Müller Rafael Sterzinger |
RL: Planning in games RL: Games with Imperfect Information |
Oliver Richter | [pdf] [pdf] |
30.03.2021 | Arman Raayatsanati, Yu Hong | RL: Model based vs. model free DRL | Lukas Faber | [pdf][pdf] |
13.04.2021 | Andrea Mattei, Edoardo Ghignone | RL: Hierarchical DRL | Béni Egressy | [pdf][pdf] |
20.04.2021 | Tobias Birchler, Davide Plozza | RL: Meta-Learning | Damian Pascual | [pdf][pdf] |
27.04.2021 | Susanne Keller Martin Tschechne |
GNN: Architectures GNN: Algorithmic Alignment / Necessity |
Lukas Faber | [pdf] [pdf] |
04.05.2021 | Ahmadreza Yousefkhani Kei Ishikawa |
GNN: Theoretical Limitations GNN: Oversmoothing |
Karolis Martinkus | [pdf] [pdf] |
11.05.2021 | Harish Rajagopal Haiwei Xie |
GNN: Graph Generation GNN: Simulation |
Karolis Martinkus | [pdf] [pdf] |
18.05.2021 | Maria Eleni Kadoglou Sidharth Ramesh |
ALG: Combining Algorithms and NNs ALG: Math |
Ard Kastrati | [pdf] [pdf] |
25.05.2021 | Batuhan Tömekçe |
ALG: NN architectures for Algorithm Learning | Ard Kastrati | [pdf] |
01.06.2021 | Béni Egressy, Oliver Richter | Review Seminar |