Keio University Syllabus and Timetable

This is an introductory course on modern Artificial Intelligence designed for Keio University. We will focus predominantly on theory and fundamental concepts, with implementation of basic techniques in Python. Depending on the level of the students and time constraints, we might also cover more practical engineering topics using modern practices, as well as some of the most influential recent advancements based on a selection of research papers. Additionally, the course also covers some topics in more depth based on the interests of the instructor. One of those topics is Natural Language Processing (NLP) in the era of Deep Learning, as well as advanced methods in representation learning.

Recent years brought a revolution in the field of Artificial Intelligence on an unprecedented scale. Advances in hardware, availability of large data sets, as well as innovation in architectural and algorithmic design, enabled successful application of Machine Learning models based on multi-layered Artificial Neural Networks to a variety of problems of practical interest. The subfield of AI focusing on deep (multi-layered) neural architectures and the associated algorithms is collectively known as Deep Learning. The success of Deep Learning has been so great in recent years, that most of modern AI can be summarized as the study of deep neural architectures. Deep Learning models hold state-of-the-art (SOTA) results on virtually all AI tasks, and new discoveries are made almost daily. In many real world Machine Learning tasks, in particular those with perceptual input, such as vision and speech, the mapping from raw data to the output is often a complicated function with many factors of variation. In past approaches, to achieve decent performance on such tasks, significant effort had to be put to engineer hand-crafted features. Deep Learning algorithms aim to learn feature hierarchies with features at higher levels in the hierarchy formed by the composition of lower level features. This automatic learning of abstraction has been demonstrated to uncover underlying structure in the data (c.f. manifold hypothesis). The first success in this new era of connectionism, came in the fields of vision and speech processing. This was followed by developments in reinforcement learning, generative AI, and NLP (in particular large language models exhibiting surprising emergent properties).

This course aims to introduce students to the field of Artificial Intelligence, focusing on Deep Neural Information Processing Systems. Since this is a rapidly developing field, we will focus on most important trends and core ideas, as it is impossible to cover all recent developments in a single course. We will follow historical trends in AI with a focus on neural networks, and see how the current ideas emerged out of decades of research in the field. We will then discuss current neural architectures and algorithms, and introduce modern perspectives. After completing this course, students should have appreciation and understanding of neural AI systems, and anticipate future developments in research and applications of AI, and Deep Learning in particular. In addition to theory, there will be emphasis on programming skills in Python. Students will implement deep neural AI systems, and train them on standard data sets.

This item will appear when you log in (Keio ID required).

This item will appear when you log in (Keio ID required).

This item will appear when you log in (Keio ID required).

This item will appear when you log in (Keio ID required).

Lecture notes should be sufficient, hence attending every lecture is highly recommended. Reading materials will be provided by the instructor. I expect students to attend all lectures, as part of the grade is based on class discussion, and I will often mention things in class which might be missing from written materials.

Lecture notes should be sufficient, hence attending every lecture is highly recommended. Reading materials will be provided by the instructor. I expect students to attend all lectures, as part of the grade is based on class discussion, and I will often mention things in class which might be missing from written materials.

This item will appear when you log in (Keio ID required).

This item will appear when you log in (Keio ID required).