Plans for week 44, October 27-31
Dear all, welcome back to a new exciting week!
This week we plan to wrap up our discussions from last week on how to solve differential equations with neural networks (first lecture). Thereafter we start discussing the whys and hows of convolutional neural networks (CNN) and parts of their mathematical foundations. Next week we will show how we can construct codes for CNNs (relevant for project 3) and how to deal with image classification. Thereafter, for our last weeks of the semester, we will focus on other deep learning methods such as recurrent neural networks (basis of LLMs and studies of timeseries) and finally autoencoders.
The exercises this week mimick those of week 39, that is getting started with the report for project 2.
Here's the detailed plan with reading suggestions plus videos.
Plan for week 44
Material for the lecture Monday October 27, 2025.
-
Solving differential equations, continuation from last week, first lecture
-
Convolutional Neural Networks, second lecture
-
Readings and Videos:
-
These lecture notes at https://github.com/CompPhysics/MachineLearning/blob/master/doc/pub/week44/ipynb/week44.ipynb
-
For a more in depth discussion on neural networks and CCNs we recommend Goodfellow et al chapter 9. See also chapter 11 and 12 on practicalities and applications
-
Reading suggestions for implementation of CNNs see Rashcka et al.'s chapter 14 at https://github.com/rasbt/machine-learning-book/tree/main/ch14.
-
Video on Deep Learning at https://www.youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi
-
Video on Convolutional Neural Networks from MIT at https://www.youtube.com/watch?v=iaSUYvmCekI&ab_channel=AlexanderAmini
-
Video on CNNs from Stanford at https://www.youtube.com/watch?v=bNb2fEVKeEo&list=PLC1qU-LWwrF64f4QKQT-Vg5Wr4qEE1Zxk&index=6&ab_channel=StanfordUniversitySchoolofEngineering
Lab sessions on Tuesday and Wednesday
-
Main focus is discussion of and work on project 2
-
If you did not get time to finish the exercises from weeks 41-42, you can also keep working on them and hand in this coming Friday.
The jupyter-notebook is at https://github.com/CompPhysics/MachineLearning/blob/master/doc/pub/week44/ipynb/week44.ipynb
Best wishes to you all,
Morten et al.