inflearn logo

Mastering Local LLMs with a Silicon Valley Engineer (LM Studio & Ollama & Ollaya)

Your AI is no longer in the cloud. It runs directly on your laptop. Learn how to build a completely local Private AI environment using LM Studio and Ollama—for everything from data processing and document analysis to code generation. With no security concerns, no costs, and greater speed— move from simply “using” AI to “putting it to work” yourself.

(4.8) 42 reviews

690 learners

Level Beginner

Course period Unlimited

AI
AI
LLM
LLM
AI Agent
AI Agent
AI
AI
LLM
LLM
AI Agent
AI Agent

Reviews from Early Learners

4.8

5.0

Reo

100% enrolled

I took this class to build things like Hermes agents or an LLM Wiki. You explained Ollama and LM Studio, but it would be great if you could also add something about Docker Model Runner. It was also fun to see how the responses changed while adjusting the Temperature during translation. Thanks to that, I’ve become interested in LLM parameters as well. Thank you.

5.0

서버지킴이

54% enrolled

I've always wanted to run LLMs locally, but I couldn't because the setup was so difficult...? I was able to run it right away after watching this lecture lol. Thank you so much!

5.0

문석청

32% enrolled

Thank you for the great lecture.

What you will gain after the course

  • The ability to build a Private AI environment that runs AI directly on my computer

  • AI workflows for securely handling company data/personal data

  • The shift from “using AI” to “operating AI” capabilities


Private AI environment,
Build it yourself locally!

A Staff Software Engineer from Silicon Valley will teach you everything you need to know about running AI directly on your laptop and building Private AI with LM Studio and Ollama.
Now, use AI however you want while keeping your data safe—without worrying about API costs or security.


Have you hesitated to use ChatGPT because of your company’s security concerns?

Have you been spending time on repetitive data processing, document analysis, and code generation tasks every time?

Did you feel that your use of AI was limited due to API usage limits and cost concerns?

Don't worry. Through this course, you can take the next step from merely 'using AI' to 'running it yourself'.
Your laptop will now transform into a powerful AI development environment.


🏛️ How to build a private AI environment
to run LLMs directly on your laptop
with LM Studio and Ollama


Become a 'developer who operates AI' without worrying about security or costs.






By the end of this course, you will be able to


You can freely use AI without worrying about personal information leaks.

  • Have you ever hesitated to use ChatGPT because of your company’s security policies? Through this course, you’ll learn how to run AI models directly on your laptop using LM Studio and Ollama, and safely analyze and use sensitive company data or personal information without worrying about transmitting it externally. You’ll no longer feel restricted when using AI.

Automate repetitive development tasks and maximize work efficiency.

  • If you are a developer or data professional who has struggled with a lack of time due to repetitive data processing, document summarization, and code generation tasks, you can now automate these tasks with a Private AI environment you build yourself. Without the burden of API costs or usage limits, turn your laptop into a powerful AI development tool.

Become an expert at freely running AI models without the burden of API costs.

  • You’ll go beyond simply installing LM Studio and Ollama to master everything from detailed model settings (Top K, Top P, Temperature, etc.) to using GGUF and MLX Runtime, configuring system prompts and presets, and integrating REST APIs. This will take you from merely “using” AI to “running it yourself,” equipping you with the ability to leverage AI cost-effectively.






✔️

The fastest way to run AI directly on your personal laptop

Build Private AI with Silicon Valley Engineers

Now your AI runs directly on your laptop, not in the cloud. Using LM Studio and Ollama, you will learn how to build Private AI that handles data processing, document analysis, and code generation directly in a local environment. You can take your AI use from simply “using it” to “leveraging it directly” without worrying about security or costs.

Building Practical AI Workflows with LM Studio and Ollama

In this course, you will install LM Studio and Ollama yourself, adjust various model parameters and settings, and build a local AI environment. You will practice every process essential for real-world development, including system prompt configuration, Top K/P sampling, and structured output generation, enabling you to complete AI workflows that safely process company or personal data.

Core code and resources for building
Private AI

We provide the LM Studio and Ollama installation files used in the course, essential configuration guides, and example code for adjusting various model parameters. You will also receive all the materials needed to develop Private AI, including information on Hugging Face’s open LLM models, license comparisons, and how to use GGUF and MLX runtimes.


📚

Run AI directly on your local machine
Master building a private AI environment

Section 1

Overview of Open LLMs and Local Execution

Learn about the concept of open LLMs, the types of open-source models, and the importance of model parameters and weights. You will also explore running and customizing models in a local environment, as well as the benefits in terms of privacy and control.


Section 2

Setting Up a Local AI Environment with LM Studio

Install LM Studio and learn its user interface, settings, system prompts, and sampling techniques. Learn how to use the GGUF and MLX runtimes, configure hardware, manage context length, and utilize the REST API to operate local AI models effectively.


Section 3

Deploying and Using LLMs with Ollama

Learn how to install Ollama and use it basically, as well as how to find useful open LLMs. This section covers multimodality support, system messages and model parameter adjustments, session management, creating models with Modelfile, and using the Ollama server (API) with code examples.


🧐 We can help solve the concerns of people like this!


📌

Developers hesitant to use ChatGPT due to company security concerns

Those who feel constrained in automating their work because they are concerned about sending sensitive company data to external APIs

📌

Junior developers who spend too much time on repetitive development tasks

For those who find it difficult to focus on core development work because repetitive code generation or document analysis tasks take up their time every day

📌

AI learners who have difficulty using LM Studio/Ollama after installation

Those who have installed LM Studio or Ollama but feel overwhelmed by the complex settings and parameters
when it comes to actually building and using Private AI




Notes Before Taking the Course


Practice Environment

  • Operating systems: Windows, macOS, and Linux are all supported.

  • Required tools: You will install and use LM Studio and Ollama.

  • Recommended specifications: A GPU (8GB VRAM or more recommended) and a PC with at least 16GB of RAM will help ensure smooth hands-on practice.

Prerequisite Knowledge and Notes

  • Developer or data-related experience is a plus.

  • Suitable for those who want to run AI models directly on their local machines.

  • If you’re hesitant to use cloud AI due to personal privacy or company security concerns, this is a good choice.

Learning materials

  • The lecture slide PDF materials are provided.

  • All the code examples needed for the hands-on exercises are included.

  • It is also helpful to refer to the official LM Studio and Ollama documentation.


Recommended for
these people

Who is this course right for?

  • Those frustrated because company security prevents them from using ChatGPT freely

  • Developers/data professionals who lack time because they have to perform repetitive tasks manually every time

  • Those who feel limited in using AI due to API costs and usage restrictions

  • Those who have installed LM Studio, Ollama, or Ollaya but haven't been able to make proper use of them.

Need to know before starting?

  • Basic computer skills — the ability to use a terminal (execute commands) and experience installing programs are required.

  • Basic understanding of development or data-related work

  • Experience using AI tools (such as ChatGPT) at least once (recommended)

Hello
This is altoformula

Inflearn Verified

28,027

Learners

1,653

Reviews

383

Answers

4.7

Rating

34

Courses

Are you going to finish in Korea? Penetrate the global market with English! 🌍🚀

Hello. I majored in Computer Science (EECS) at UC Berkeley 💻, have worked as a software engineer in Silicon Valley for over 15 years, and am currently a Staff Software Engineer working with Big Data and DevOps at a Big Tech headquarters in Silicon Valley.

  • 🧭 I would now like to share the technologies and know-how I learned firsthand at the forefront of innovation in Silicon Valley with all of you through online lectures.

  • 🚀 Join me, having learned and grown at the forefront of technological innovation, and develop the skills to compete on the global stage!

  • 🫡 I may not be the smartest, but I want to emphasize that you can achieve anything if you stay consistent and never give up. I will always be by your side, supporting you with great resources.

 

More

Curriculum

All

39 lectures ∙ (4hr 30min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

42 reviews

4.8

42 reviews

  • reogride3237님의 프로필 이미지
    reogride3237

    Reviews 19

    ∙

    Average Rating 5.0

    5

    100% enrolled

    I took this class to build things like Hermes agents or an LLM Wiki. You explained Ollama and LM Studio, but it would be great if you could also add something about Docker Model Runner. It was also fun to see how the responses changed while adjusting the Temperature during translation. Thanks to that, I’ve become interested in LLM parameters as well. Thank you.

    • altoformula
      Instructor

      Hello Reo, 🙂 Thank you so much for the great review! I see you've registered for this course following the Claude course. I'm glad to hear that the course direction aligns well with your goals of building a Hermes Agent or an LLM Wiki. I'm especially happy that the sections on Ollama and LM Studio were helpful to you. The Docker Model Runner you mentioned is also an excellent point. Since it's an increasingly important area in practical applications, I will consider covering it in a future course update or through additional materials. The fact that you personally experienced how results change by adjusting the Temperature shows that you've really grasped a core concept. Experiencing the principles of how LLMs operate through these kinds of experiments is the fastest way to understand them 👍 Thanks to your great feedback, I believe I can further improve the course. I have updated the content regarding the LLM Wiki in the Claude course, so it would be good to check that out. I will continue to provide updates moving forward. Thank you! 🚀

  • knocktea님의 프로필 이미지
    knocktea

    Reviews 3

    ∙

    Average Rating 5.0

    5

    100% enrolled

    Now that I've finished the course, I feel confident that I can work with LLMs! I want to get more comfortable with it bit by bit and try building something.

    • altoformula
      Instructor

      Hello Brown Rice Green Tea, Thank you so much for leaving such a great review! 😊 It is the most rewarding feedback to hear that you gained the confidence that "I can handle LLMs too" through the lecture. Rather than trying to build a grand project from the start, your skills will improve quickly if you start building small automations or personal projects one by one. I will be rooting for you to continue enjoying your use of AI in the future! 🚀

  • seukchungmoon8847님의 프로필 이미지
    seukchungmoon8847

    Reviews 42

    ∙

    Average Rating 5.0

    5

    32% enrolled

    Thank you for the great lecture.

    • altoformula
      Instructor

      Hello Seok-cheong Moon, Thank you for taking the time to leave such a great review.

  • abandonship님의 프로필 이미지
    abandonship

    Reviews 6

    ∙

    Average Rating 5.0

    5

    61% enrolled

    I had been using LM Studio and Ollama just by turning them on without much thought, so it was great to have a lecture where I could overall learn about all their features and purposes.

    • altoformula
      Instructor

      Hello Abandon Ship (Abandon the Ship), Thank you for leaving such a great review! 😊 More people than expected only use the basic features after installing LM Studio or Ollama. In reality, there are many features that significantly increase utility once you know them, such as model management, API servers, context settings, GPU utilization, and comparing various models. Now that you have the foundational knowledge, I believe you'll have even more fun utilizing local LLMs by linking them with AI Agents, MCP, and development tools. Thank you for your valuable feedback!

  • hbsong257864님의 프로필 이미지
    hbsong257864

    Reviews 1

    ∙

    Average Rating 5.0

    Edited

    5

    100% enrolled

    I took this course because I needed to implement a Local LLM, and it helped me establish a clear direction. Although I cannot apply it directly to the specific problem I was trying to solve, it was great to learn how to use LMStudio and Ollama, and to gain other useful information.

    • altoformula
      Instructor

      Hello hbsong25, Thank you for taking the time to leave such a great review!!

altoformula's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!

25% off for new members

$32.90

25%

$42.90