강의

멘토링

커뮤니티

Programming

/

Back-end

Create automation using Google Authenticator, QR, and Cron

In this lecture, we aim to create a Web Scraping API server using the Naver Shopping site. We will show you how to configure a managed API server by connecting MySQL and configuring a 3-tier architecture!!

(5.0) 3 reviews

102 learners

  • July
서버강의
자동화
웹 스크래핑
웹크롤링
실무적용
Go
MySQL
Web Scraping
cron
google-authenticator

Reviews from Early Learners

What you will gain after the course

  • scrapping

  • HTTP

  • MYSQL

  • Golang

What is web scraping and why should you do it? 🤔


You may be familiar with the word scraping , or you may be more familiar with the word crawling .
Scraping is not a common method used to build actual services.


This method carries many legal issues and can even trigger denial-of-service attacks . So why do we still proceed with scraping ?


By using scraping , I can scrape various information that I could not manage, such as marketing and personal business information.

Where will this data be primarily used?? 🤔

Data can be used in so many different ways.

Because it's a way for me to collect the data I need, you can collect the data you want and build the business you want.


The most representative and common method is

The most common method is to collect data through crawling and then provide the data to eCommerce platforms such as Coupang and Naver to support commission transactions .

Is there any legal problem?? 🤔

Scraping isn't legally problematic, as it involves exposing information already externally on the platform.


But basically, because it accesses the server to get information from external platforms,
As I mentioned earlier, if you attempt to retrieve information indiscriminately, the traffic will be sent in the form of what is commonly referred to as a DDoS attack.


In this situation, if there is a loss on the platform, it could be a problem.
So please keep in mind that you need to control the amount of traffic!!


Even if you send traffic using a test tool like wrk , you don't have to be afraid because various preventive measures such as Gateway, Throttling, and FrontDoor are configured.

What else can I learn?? 🤔

Most of the lectures I create focus on things I use and apply in my own practice, or things that students might not be familiar with, rather than things they generally know.


  1. In this lecture, I'm going to teach you about a QR code authentication method, not the JWT Token authentication method you're generally familiar with.

Let me tell you about Google Authenticator , which is the method I actually use in my practice to set up managed pages.

So, you can learn about authentication methods using QR codes by using the Chrome extension according to my curriculum !! 😁

  1. In this lecture, we will additionally explain how to manage large amounts of data in the background using service logic .

Aren't you just bored and uninterested in how to receive and process API requests in general?? 🥲

It is very important to automate the processing of large amounts of data .

In this lecture, you will learn more about how to run this service logic in the background using Cron !! 😁

After taking the lecture, you will be able to create results like this.

Data Management with MySQL

This course is about creating a managed API that supports scraping.

That's why you need a database to store the information, and that's where MySQL comes in.

Automating Scraping with Cron

Do you know anything about background automation??

In this lecture, we will learn how to run logic in the background at regular intervals using a method called Cron !!

Structure for a practical managed API

Aren't you curious about how IT company employees in Pangyo structure their server operations?

We'll answer all your questions and give you detailed information on how to create an actual server structure.

Implementing TTL-based authentication via Google Authenticator

We will show you how to create and register a QR code using the code and use it for authentication.

Let me say this again, this is a method I have personally used and applied in my practice.

Learning Content

Let me tell you in detail about the server structure I use in my practice.

A fluid structure is very important.

Besides me, I will also tell you what structure is easy to see and work with.

Implementing QR authentication using Secret values

There are many ways to authenticate.

In this lecture, we will learn about TTL limited authentication method using QR code.

Data Management with MySQL

We'll cover everything from schema design to automated data management through scraping using MySQL.

Automated processing via Cron

The ultimate destination for developers is always automation.

We will explain how to run background logic and utilize Cron, which are essential for this type of automation.

💁 I am this kind of developer. 💁

I think that being a developer is a very attractive and promising job.


I can do the work I want, and if I want, I can make money from it.

You can make a living by working for a company or as a freelancer.

I basically like to pursue different approaches and apply new tools.


As a result, I am an employee and developer who applies various tools for the first time at work and causes many errors in actual operating environments .


Of course, I might receive negative feedback within the company, but I really enjoyed this approach and found it enjoyable. And through this process, I gained a lot of expertise.

I started the Inflearn lectures with the hope that I could share this know-how with you and help you avoid these issues .

I've prepared this lecture with the hope that, as much as possible, you won't act like I did in similar situations.


I hope that my lectures will be of great help to the students and that they will take away a lot from me .

Things to note before taking the course

Practice environment

  • We are working on a MacBook M1 environment.

Player Knowledge and Precautions

  • The primary language used for the course is Go. However, Node or Java are also acceptable. Understanding the general structure and applying it will be very helpful.

Recommended for
these people

Who is this course right for?

  • If you are curious about the scrapping method

  • Those who want to set up their own business

  • If you want to create a managed API through MYSQL

Need to know before starting?

  • Golang [This is the language of the lecture. You can write the same structure using a different language.]

Hello
This is

3,689

Learners

174

Reviews

88

Answers

4.5

Rating

15

Courses

자기 소개

비전공자 출신으로 판교에서 플랫폼 서버 개발을 담당하여 진행하고 있습니다.

서버 최적화와 다양한 쿼리 튜닝을 좋아합니다.

 

경력

[前] 샌드박스 블록체인 개발자

[前] 넥슨 자회사 백엔드 개발자

[前] 판교 대기업 플랫폼 서버 개발자

[] 판교 모회사 서버 개발자

Curriculum

All

27 lectures ∙ (3hr 30min)

Published: 
Last updated: 

Reviews

All

3 reviews

5.0

3 reviews

  • dkstmdwn176216님의 프로필 이미지
    dkstmdwn176216

    Reviews 37

    Average Rating 4.8

    5

    100% enrolled

    First of all, it is written in the Go language, but it can be implemented in other languages and frameworks. In the case of Spring, even cron can be processed using the Quartz library. For the crawling part, you can use the Jsoup library. The only regret is that the font is too small. If I get a chance later, I want to learn the Go language.

    • july
      Instructor

      I don't know much about Java, so I lacked knowledge about that part, but thank you for explaining it in detail. As a resident of the Republic of Korea who lives in Java, I think it will be helpful for me to learn Java. ㅎㅎ The reason the lecture size is small is because I am used to using dual monitors, so I always proceed with the screen I am used to, so it seems small. ㅠㅠ Thank you for your feedback, and I will consider that part in the future to provide better lectures. Thank you!!

  • jukas5985 [DEL] 250815201525님의 프로필 이미지
    jukas5985 [DEL] 250815201525

    Reviews 14

    Average Rating 4.9

    5

    63% enrolled

    I took the course because I was interested in the topic of authentication using QR codes. I learned a lot by simply seeing how to implement it. Thank you for providing such a great and innovative lecture this time!! 😁😁

    • july
      Instructor

      I hope you guys have fun with coding by always preparing new lectures. Thank you for your review.

  • jukascrow6433님의 프로필 이미지
    jukascrow6433

    Reviews 7

    Average Rating 5.0

    5

    96% enrolled

    I am a student who often listens to the instructor's lectures. It seems that the lectures are not general lectures but mainly deal with methods used in actual practice. That is why most of the lectures are not general topics like other lectures, but they are more helpful and I think coding becomes more fun when I listen to them. 🤣🤣 Thank you for the great lecture again!!

    • july
      Instructor

      I'm preparing the lecture with the hope that the students will try out some new developments and to record the parts I've experienced. I'm glad that this part seems to have been applied well. 🤩 Thank you for the good review!! I hope you have fun developing~!

$27.50

July's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!