inflearn logo

AI Accelerator with FPGA — From Image Processing to CNN Training and Hardware Verification

Many people have learned FPGA and Verilog but get stuck at the question, "So, how do I actually build an AI accelerator?" This course resolves that curiosity. Using just a single entry-level FPGA and free tools, you will start from a hand-designed 3×3 kernel, train a CNN yourself, quantize the trained weights to INT8 to load onto the hardware, and verify that the results are Bit-True—not deviating by even a single bit from the Python model. As a professor with 30 years of experience in the semiconductor industry, I teach only verified content as 'working circuits' on actual FPGAs. By gaining the experience of designing and proving it yourself rather than just learning theory, you will acquire practical skills that are recognized in the fabless design and AI semiconductor fields.

10 learners are taking this course

Level Intermediate

Course period Unlimited

FPGA
FPGA
Verilog HDL
Verilog HDL
vivado
vivado
CNN
CNN
AI
AI
FPGA
FPGA
Verilog HDL
Verilog HDL
vivado
vivado
CNN
CNN
AI
AI

What you will gain after the course

  • The ability to directly design an image recognition accelerator, from 3×3 kernels to CNNs, and run it on an FPGA.

  • Practical ability to quantize trained floating-point weights to INT8 (PTQ/QAT) and deploy them onto hardware.

  • Bit-True verification capability to compare Python reference models and Verilog RTL on a bit-by-bit basis

  • Ability to implement real-time image processing pipelines (pixel filters, 3×3 convolutions) on FPGA

  • The ability to directly design hardware-friendly computational structures such as line buffers, Winner-Take-All, and Argmax.

  • Practical experience in handling two clock domains and meeting timing requirements in FPGA implementation.

  • A working AI accelerator result, completed using only free tools and a single FPGA, that can be used in a portfolio.

■ Course Introduction

This is a hands-on course where you will design, train, and verify an AI accelerator (NPU) using only an entry-level FPGA (Arty S7-25) and free tools (Vivado). Starting from a hand-designed 3×3 kernel, you will train a CNN yourself, quantize the trained floating-point weights to INT8 to load onto the FPGA, and verify that the results are "Bit-True"—matching the Python reference model without a single bit of error. Moving beyond mere conceptual explanations, you will see your designed circuits operate on actual hardware, and all source code is publicly available on GitHub.

■ What this course covers

It spans two tracks, from image processing to AI accelerator design.

· Real-time image processing — Pixel streaming pipeline, 3×3 convolution, line buffer

· Intro to AI Acceleration — Fixed Kernel Classifier → CNN Training & Quantization (PTQ·QAT) → Bit-True Verification of Training Weights

It starts with manual design and progresses all the way to verifying machine-learned weights on hardware.

■ Recommended for the following people

· Junior engineers or students preparing for semiconductor fabless front-end design positions who feel lost because they only know the theory and lack hands-on design experience.

· Junior engineers who have experience with FPGA and Verilog but have not yet reached the level of designing and verifying AI accelerators on their own

· Electronics or Computer Engineering students who need a portfolio demonstrating the physical implementation of AI semiconductors

· Those who wish to transition to the AI system semiconductor field and need a way to prove their practical hardware capabilities

■ After taking this course

· The ability to directly design image recognition accelerators, from 3×3 kernels to CNNs, and run them on FPGAs

· Practical ability to quantize learned floating-point weights to INT8 (PTQ·QAT) and deploy them onto hardware

· Bit-True verification skills to compare Python reference models and Verilog RTL bit-by-bit

· The ability to directly design hardware-friendly computational structures such as line buffers, Winner-Take-All, and Argmax.

· A functional AI accelerator output that can be used immediately in portfolios and interviews

■ Prerequisites

· Basic C programming, basic digital logic circuits

· Experience with Verilog-HDL syntax and FPGA synthesis/implementation

· Basic use of Python

· Basic concepts of CNNs and neural networks

■ Preparation before taking the course (Important)

This course assumes that the Vivado and Python environments are installed and that you are able to run basic simulations. The setup of the basic environment below will not be covered in detail during the lecture, so please prepare it in advance.

- Vivado installation and basic usage

- Python (Anaconda/Jupyter) installation

- Basic Verilog-HDL

The basics mentioned above are covered in free videos on my YouTube channel (@EdgeChipLab), or you may refer to other available resources. This course focuses on "image processing and AI accelerator design, training, and verification" based on those fundamentals.

■ Practice Environment · Requirements

· FPGA Board: Digilent Arty S7-25

· Display: Pmod OLEDrgb (SSD1331, 96×64) — For displaying input and result images

· Tools: Xilinx Vivado (Free), Python (Anaconda/Jupyter)

· Practice Source Code: Fully available on GitHub (RTL·Python·Testbench·.mem)

· Input uses stored images (.mem), and no camera is required.

· Learn everything from video processing to Vivado simulation even without a board or OLED

■ Unique strengths of this course

· A complete loop leading from design → training → hardware verification

· 100% Bit-True Verification — proving it's not just 'working,' but 'exactly the same as Python'

· Complete the course anytime, anywhere with a single entry-level FPGA and free tools.

· Fully public on GitHub for immediate download and reproduction

· A current professor with 30 years of experience in the semiconductor industry delivers only content verified on actual FPGAs.

■ Reference

· All design and implementation content in this lecture was created by the instructor, and the narration (voice) was produced using TTS.

Recommended for
these people

Who is this course right for?

  • Those who are preparing for a job in semiconductor fabless front-end design but feel lost because they only know the theory and have no hands-on design experience.

  • Junior engineers who have experience with FPGA and Verilog but have not yet reached the level of designing and verifying AI accelerators on their own.

  • Electronics and Computer Engineering majors who need a portfolio demonstrating the physical implementation of AI semiconductors.

  • Those who are looking to transition into the AI system semiconductor field and need a way to prove their practical hardware capabilities.

Need to know before starting?

  • C Language Basics

  • Basics of Digital Logic Circuits

  • Verilog-HDL Syntax (Prerequisite learning available through free Level 1 YouTube videos)

  • Vivado · Python (Anaconda/Jupyter) Installation and Basic Simulation Execution

Hello
This is EdgeChipLab

Career Verified

"In the AI era, the surest response is to build AI semiconductors yourself."

This program is neither a theory-focused university course nor the standardized curriculum of a contract department tailored to specific specifications. Nor is it limited to simply gaining experience using EDA tools or leveraging libraries, as in conventional fragmented practical seminars.

It is a one-of-a-kind, hands-on course designed and FPGA-validated by a practicing engineering professor with 30 years of experience, who began as a systems semiconductor researcher in Samsung Electronics’ DS Division, won the Silver Prize (Group Chairman’s Award) at the Samsung Technology Awards in the field of design automation, and went on to serve as a Director at Samsung’s UK and German subsidiaries and as the head of the System LSI Marketing and Sales Group.

[ Key differentiators for working professionals & aspiring engineers ]

  • Overcome the limitations of working engineers: Go beyond simply modifying code or using off-the-shelf IP to acquire practical, architecture-level expertise in designing NPUs and CPUs directly in RTL.

  • Establishing a Full-Flow practical system: Complete the entire value chain, from analyzing AI algorithms to FPGA implementation and Bit-True hardware integration verification, and extending to an AI SoC based on a CPU + NPU + RTOS.

  • Field validation complete: Going beyond theory taught in university classrooms, we deliver proven processes that can be applied immediately in real-world work, distilling design expertise from the front lines of industry.

AI Algorithm → RTL Design → FPGA Implementation → Bit-True Verification → AI SoC

For undergraduates and graduate students, as well as working professionals seeking to advance as next-generation AI semiconductor/SoC designers, it provides an unparalleled, top-tier practical guide.

 

Beyond theory to actual AI hardware implementation

It is difficult to develop system-level AI semiconductor design capabilities with only scattered, fragmented knowledge.

Students do not stop at using completed black-box IP. The goal is to progressively develop the system design skills needed to design an AI NPU and RISC-V CPU themselves, integrate memory and peripherals, port an RTOS on top of them, and ultimately build their own AI SoC.

Starting with the fundamentals of transistors and digital circuits, this course connects FPGA, CPU, and NPU technologies to hardware for accelerating Transformers and LLMs.

 

We validate the research results on actual FPGA hardware.

This is not a lecture you only watch. Rather than stopping at theory or simple simulations, you will run AI semiconductor circuits you designed yourself on an actual FPGA and perform Bit-True verification, confirming that the Python model and RTL results match down to the last bit.

The instructor also connects research results, including four KCI-indexed papers on AI semiconductors, FPGAs, and RISC-V, to the educational content, taking technologies validated through research into actual design and FPGA implementation. The source code needed for the exercises—including a self-developed RISC-V CPU, Python code for image training, and Verilog RTL—is made available.

Built around the affordable Arty S7-25 FPGA board and the free Vivado design tool, this course enables learners to reproduce the entire process of designing, implementing, and verifying their own work. It can also be used with Digilent FPGA boards, including the Zybo Z7. Simply modify the XDC pin mapping (board) and clock division parameters (RTL) to match your board. The 'MNIST NPU with FPGA' course only requires modifying the XDC pin mapping, while courses that use an OLED and camera require modifying the clock division parameters (RTL).

→The lecture exercises are configured with divider parameters based on Arty S7’s 100 MHz input clock. Since other boards have different input clocks (e.g., Zybo Z7 uses 125 MHz), you will need to recalculate the divider values so that the target frequency remains the same. If you overlook this, the screen or video may not display properly,so please check, as it can easily be mistaken for a code error.

 

A seamless full-stack roadmap: from the basics to a mini LLM accelerator

Every lecture is not an isolated fragment, but part of a journey toward completing one vast system.

  • Step 1: AI Theory and Image Processing Fundamentals (including Machine Learning)

  • Step 2: AI Accelerator (NPU) Design and Verification (Including Machine Learning)

  • Step 3: RISC-V CPU Design and System Integration

  • Step 4: Advanced AI SoC Implementation and Expansion into a mini LLM Acceleration Platform (Continuous Content Updates)

     

 

Objective verification metrics

All design deliverables from this course have undergone rigorous validation against global standards and by the academic community.

  • RISC-V Architecture Verification: In-house developed RISC-V CPU, passed the International Foundation’s official compliance test (ACT), and source code released (GitHub)

  • Academic Authority: Four Sole-Author Academic Papers (published in the prestigious KCI A-ranked journal IJIBC)

  • Global Recognition: Published four global Amazon technology books (reached #1 bestseller status)


    Published books: Roger Kim: books, biography, latest update

  • Real-World Operation Verification Complete: Core IPs, including the RV32I CPU, NPU, vision system, GPS, Transformer, and AURA-Edge SoC, operate flawlessly in the Arty S7 environment.

     

Take on the challenge. By the time you complete this process of uploading code to the board yourself and checking the results, you will have leveled up into a hardware engineer with a completely different perspective than before.

More

Curriculum

All

5 lectures ∙ (3hr 6min)

Published: 
Last updated: 

Reviews

Not enough reviews.
Please write a valuable review that helps everyone!

EdgeChipLab's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!

25% off for new members

$129.40

25%

$169.40