From the concept of the latest deep learning technology Vision Transformer to Pytorch implementation
This is a lecture that studies Vision Transformer, one of the latest deep learning technologies, and implements a paper using Pytorch. Come experience the new future of the vision field with me!
This is a great lecture that covers everything from the basic concepts and principles of Vision Transformer (ViT) to source implementation. I recommend it to anyone who wants to get started with ViT.
5.0
박성준
31% enrolled
Thank you for explaining so thoroughly. I'm thinking about how to approach reviewing this. ^^
5.0
jb.lee
31% enrolled
I understand the content well because you lecture so well. The material is also interesting!
What you will gain after the course
Pytorch Intermediate Level
Tesla Autonomous Driving and Transformer Concept Based on ChatGPT
A New Paradigm in Image Processing - Vision Transformer
The latest vision transformer, from basics to thesis implementation!
Vision Transformer?
One of the latest trends in image processing is the Vision Transformer . Less than a year after its introduction, improved models have emerged, and even Tesla, a leader in autonomous vehicle development, is building models that combine CNNs and Transformers.
The first half of the lecture explores the current state of the image field, starting with Tesla's story. The second half delves into the concepts of attention and transformers, which form the foundation of vision transformers. The second half delves into the theory of vision transformers and their practical implementation using PyTorch .
A thorough understanding is essential for implementation, allowing you to better understand existing issues. This course will help you understand the concepts and implement them together!
We provide lecture materials.
For actual implementation of the paper , all practical code covered in the lecture is provided( 63 pages of lecture slides + Vision Transformer model file).
Q. Can non-majors also take the course?
Basic understanding of deep learning concepts and experience with PyTorch are required. Studying the following subjects first will greatly enhance your understanding.
Q. Can I understand the latest deep learning technologies with just the basics?
You can certainly do it. This class is designed for those with basic knowledge, and the explanations are very detailed.
Q. What program do you use?
All exercises (Python/PyTorch) are conducted on Google Colab, which requires no separate installation . A free Google account is required, and failure to use Colab may result in disruption to the exercises .
Q. Are there any special advantages to this course?
It's true that models based on convolutional neural networks (CNNs) continue to evolve. However, research into implementing models without convolutions has continued, and results are now surpassing those based on CNNs . This lecture, the first of its kind in Korea, covers both theory and implementation, allowing you to delve into this new image processing paradigm in detail!
( Deep learning paradigm prediction hit the mark ! This is the first domestic vision transformer concept and implementation lecture. As of 2023, the Transformer series models are overwhelmingly used ! ChatGPT, a hot topic these days, also adopts the Transformer structure.)
Experience the new future of computer vision! 👍
Recommended for these people
Who is this course right for?
Anyone who wants to learn the latest deep learning technology
Anyone who wants to further improve their PyTorch skills
Anyone who wants to know about the overall direction in the field of vision
Those preparing for graduate school related to artificial intelligence
I am Deep Learning Ho-hyung, and I run a YouTube channel related to deep learning and machine learning.
I majored in mathematics/data analysis and have completed and am currently working on numerous machine learning/deep learning projects.
I have knowledge that I can share with you, ranging from Artificial Intelligence topics such as machine learning, advanced machine learning, deep learning, optimization theory, and reinforcement learning, to mathematical content including linear algebra, calculus, probability and statistics, analysis, and numerical analysis.
Nice to meet you all!
§ Profile
Research Engineer at a large corporation - Development of smart factory-related models
PhD in Mathematics from Germany
§ Related Experience
Numerous SCI(E) papers and international conference presentations
Multiple university consultations related to artificial intelligence
Doctoral/Post Doctoral Researcher at a German Research Institute
Major Corporation Research Engineer - New Product Development
Author of "Introduction to PyTorch for Deep Learning" (Selected as a 2022 Sejong Book in the Academic Category)
This is a great lecture that covers everything from the basic concepts and principles of Vision Transformer (ViT) to source implementation. I recommend it to anyone who wants to get started with ViT.