강의

멘토링

로드맵

Programming

/

Back-end

Create automation using Google Authenticator, QR, and Cron

In this lecture, we aim to create a Web Scraping API server using the Naver Shopping site. We will show you how to configure a managed API server by connecting MySQL and configuring a 3-tier architecture!!

(5.0) 3 reviews

100 learners

  • July
서버강의
자동화
웹 스크래핑
웹크롤링
실무적용
Go
MySQL
Web Scraping
cron
google-authenticator

Reviews from Early Learners

What you will learn!

  • scrapping

  • HTTP

  • MYSQL

  • Golang

What is web scraping and why should you do it? 🤔


You may be familiar with the word scraping , or you may be more familiar with the word crawling .
Scraping is not a common method used to build actual services.


This method carries many legal issues and can even trigger denial-of-service attacks . So why do we still proceed with scraping ?


By using scraping , I can scrape various information that I could not manage, such as marketing and personal business information.

Where will this data be primarily used?? 🤔

Data can be used in so many different ways.

Because it's a way for me to collect the data I need, you can collect the data you want and build the business you want.


The most representative and common method is

The most common method is to collect data through crawling and then provide the data to eCommerce platforms such as Coupang and Naver to support commission transactions .

Is there any legal problem?? 🤔

Scraping isn't legally problematic, as it involves exposing information already externally on the platform.


But basically, because it accesses the server to get information from external platforms,
As I mentioned earlier, if you attempt to retrieve information indiscriminately, the traffic will be sent in the form of what is commonly referred to as a DDoS attack.


In this situation, if there is a loss on the platform, it could be a problem.
So please keep in mind that you need to control the amount of traffic!!


Even if you send traffic using a test tool like wrk , you don't have to be afraid because various preventive measures such as Gateway, Throttling, and FrontDoor are configured.

What else can I learn?? 🤔

Most of the lectures I create focus on things I use and apply in my own practice, or things that students might not be familiar with, rather than things they generally know.


  1. In this lecture, I'm going to teach you about a QR code authentication method, not the JWT Token authentication method you're generally familiar with.

Let me tell you about Google Authenticator , which is the method I actually use in my practice to set up managed pages.

So, you can learn about authentication methods using QR codes by using the Chrome extension according to my curriculum !! 😁

  1. In this lecture, we will additionally explain how to manage large amounts of data in the background using service logic .

Aren't you just bored and uninterested in how to receive and process API requests in general?? 🥲

It is very important to automate the processing of large amounts of data .

In this lecture, you will learn more about how to run this service logic in the background using Cron !! 😁

After taking the lecture, you will be able to create results like this.

Data Management with MySQL

This course is about creating a managed API that supports scraping.

That's why you need a database to store the information, and that's where MySQL comes in.

Automating Scraping with Cron

Do you know anything about background automation??

In this lecture, we will learn how to run logic in the background at regular intervals using a method called Cron !!

Structure for a practical managed API

Aren't you curious about how IT company employees in Pangyo structure their server operations?

We'll answer all your questions and give you detailed information on how to create an actual server structure.

Implementing TTL-based authentication via Google Authenticator

We will show you how to create and register a QR code using the code and use it for authentication.

Let me say this again, this is a method I have personally used and applied in my practice.

Learning Content

Let me tell you in detail about the server structure I use in my practice.

A fluid structure is very important.

Besides me, I will also tell you what structure is easy to see and work with.

Implementing QR authentication using Secret values

There are many ways to authenticate.

In this lecture, we will learn about TTL limited authentication method using QR code.

Data Management with MySQL

We'll cover everything from schema design to automated data management through scraping using MySQL.

Automated processing via Cron

The ultimate destination for developers is always automation.

We will explain how to run background logic and utilize Cron, which are essential for this type of automation.

💁 I am this kind of developer. 💁

I think that being a developer is a very attractive and promising job.


I can do the work I want, and if I want, I can make money from it.

You can make a living by working for a company or as a freelancer.

I basically like to pursue different approaches and apply new tools.


As a result, I am an employee and developer who applies various tools for the first time at work and causes many errors in actual operating environments .


Of course, I might receive negative feedback within the company, but I really enjoyed this approach and found it enjoyable. And through this process, I gained a lot of expertise.

I started the Inflearn lectures with the hope that I could share this know-how with you and help you avoid these issues .

I've prepared this lecture with the hope that, as much as possible, you won't act like I did in similar situations.


I hope that my lectures will be of great help to the students and that they will take away a lot from me .

Things to note before taking the course

Practice environment

  • We are working on a MacBook M1 environment.

Player Knowledge and Precautions

  • The primary language used for the course is Go. However, Node or Java are also acceptable. Understanding the general structure and applying it will be very helpful.

Recommended for
these people

Who is this course right for?

  • If you are curious about the scrapping method

  • Those who want to set up their own business

  • If you want to create a managed API through MYSQL

Need to know before starting?

  • Golang [This is the language of the lecture. You can write the same structure using a different language.]

Hello
This is

3,586

Learners

169

Reviews

88

Answers

4.5

Rating

15

Courses

자기 소개

비전공자 출신으로 판교에서 플랫폼 서버 개발을 담당하여 진행하고 있습니다.

서버 최적화와 다양한 쿼리 튜닝을 좋아합니다.

 

경력

[前] 샌드박스 블록체인 개발자

[前] 넥슨 자회사 백엔드 개발자

[前] 판교 대기업 플랫폼 서버 개발자

[] 판교 모회사 서버 개발자

Curriculum

All

27 lectures ∙ (3hr 30min)

Published: 
Last updated: 

Reviews

All

3 reviews

5.0

3 reviews

  • Anfield님의 프로필 이미지
    Anfield

    Reviews 37

    Average Rating 4.8

    5

    100% enrolled

    일단 go라는 언어로 작성되었을 뿐이지, 충분히 다른 언어, 프레임워크로 구현 가능합니다. spring의 경우 cron같은 것도 quartz 라이브러리를 써서 처리할 수 있습니다. 크롤링하는 부분은 Jsoup 라이브러리를 가져다가 쓰면 됩니다. 아쉬운 점은 글씨가 너무 작았다는 점이였습니다. 나중에 기회가 된다면 go언어를 배워보고싶네요.

    • July
      Instructor

      Java에 대해 잘 몰라서 해당 부분에 대한 지식이 부족하였는데 상세하게 알려주셔서 감사합니다. 자바의 민국 거주자로써 저도 자바를 배워가는데 도움이 될 꺼 같네요 ㅎㅎ 강의 사이즈가 작은 이유는 제가 듀얼모니터를 사용하는데에 익숙해서인지 항상 제가 익숙한 화면으로 진행해서 작은거 같습니다 ㅠㅠ 피드백 감사드리며 앞으로 해당 부분을 고려해 더 양질의 강의를 제공해 드리도록 하겠습니다. 감사합니다!!

  • 유쾌한 캥거루님의 프로필 이미지
    유쾌한 캥거루

    Reviews 14

    Average Rating 4.9

    5

    63% enrolled

    QR코드를 사용하는 인증방식이라는 주제가 흥미로워서 수강을 하게 되었습니다. 간단하게 실제 구현 하는것을 보며 많이 배웠습니다. 이번에도 신박하고 좋은 강의 제공해 주셔서 감사합니다!! 😁😁

    • July
      Instructor

      항상 새로운 강의를 준비함으로써 여러분들이 코딩에 재미를 가지면 좋겠습니다. 수강평 감사드립니다.

  • Deck님의 프로필 이미지
    Deck

    Reviews 7

    Average Rating 5.0

    5

    96% enrolled

    강사님의 강의를 자주 듣는 수강생입니다. 항상 일반적인 강의가 아니라 실제 실무에서 사용하시는 방법을 주로 다루시는거 같아요 그래서 대부분의 강의가 다른 강의처럼 일반적인 주제가 아니라 더욱더 많은 도움이 되고 들으면 코딩이 더욱더 재미있어지는거 같습니다. 🤣🤣 이번에도 좋은 강의 감사합니다!!

    • July
      Instructor

      저는 수강하시는 분들이 좀 새로운 개발을 해보셨으면 하는 마음이랑, 제가 경험했던 부분을 녹이려고 강의를 준비하고 있습니다. 이런 부분이 잘 적용이 된 거 같아 기쁘네요 . 🤩 좋은 평 감사드리고!! 재미있는 개발 하시길 바라겠습니다~!

$27.50

July's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!