Plans for the week of March 23-27

Dear all, thx to all for great efforts with the first project and/or the status reports.?

This week we will wrap up the discussion on Autoencoders? trying to finalize the discussion of codes we started last week.

After that we will make an excursion into the theory for Transformers. If we get time, we will start our discussion of generative methods. The latter will be the topic for the rest of the semester and we will focus on Boltzmann machines, Variational Autoencoders and Diffusion models.

The jupyter-notebook for this week is at?https://github.com/CompPhysics/AdvancedMachineLearning/blob/main/doc/pub/week10/ipynb/week10.ipynb, alternatively you can use the pdf file at https://github.com/CompPhysics/AdvancedMachineLearning/blob/main/doc/pub/week10/pdf/week10.pdf. The plan is thus

Finalize the discussion on autoencoders and implementing Autoencoders with TensorFlow/Keras and PyTorch

Discussion of Transformers, with reading recommendation: Raschka et al chapter 16 for transformer.

Overview of generative models. Reading recommendation: Goodfellow et al chapters 16 and 18.1 and 18.2 for generative models.

We will also discuss during the lab sessions possible topics for project 2 for those of you who aim at handing two projects.

In the meantime, best wishes to you all.

Morten, Oda and Ruben