Web Crawling and Web Page Automation with Practical Applications
With easy explanations and various practical exercises, you can learn web crawling and website automation, and learn various applications such as website creation and ChatGPT usage.
Ways to use it, such as creating a website that can be monetized
Python BeautifulSoup
Python Selenium
Python Requests
OpenAI API(chatgpt)
Telegram API
AWS Lambda
Python + AWS Lambda Create a Telegram chatbot that works in real time Update complete!
The course on creating a Telegram chatbot that works in real time using Python and AWS Lambda has been updated! You can learn how to crawl and send results by entering the desired keyword. How to create a Telegram chatbot using AWS Lambda can be used in many ways beyond crawling.
Once you know how to crawl and automate the web, Instead of having 10 employees, you only need one computer. My salary is enough to cover the electricity bill for one computer.
Even if you are new to Python, we have added an introductory Python basics course as an appendix in the last section so that you can take the course. Even if you do not take this course, you can learn everything from installing Python and VScode to basic class concepts for free.
Python Web Crawling + ChatGPT!!
Automatically create ChatGPT blog posts with Naver Shopping crawling product information!
Crawl the desired product from Naver Shopping. Create a chatbot like ChatGPT using OpenAI's API with only basic information about the product and automatically generate text that can be used for blog posts, etc.
The article below is one of the articles automatically generated when searching on a laptop.
"Samsung Galaxy Book 2 NT750XEW-A51A with great cost-effectiveness, starting at 956,410 won!"
These days, as mobile work increases, the demand for laptops is increasing, but if the price is high, people hesitate to buy them. However, the Samsung Galaxy Book 2 NT750XEW-A51A that I will introduce to you today is popular because of its excellent cost-effectiveness and low price. Now, let's take a look at its detailed functions and pros and cons.
【screen】 This product has a 15-inch screen size, making it more convenient to work on a computer. It also has a slim bezel design, making it smaller and easier to carry around.
【Performance】 The Galaxy Book 2 NT750XEW-A51A is equipped with Intel's 10-core 12th generation Core i5-1235U CPU, which allows for fast and stable work. And it can turbo boost up to 4.4GHz, so even users who work a lot per hour can use it with confidence.
【Graphics】 You can see Intel's Iris Xe Graphics has been passed over, and I would highly recommend it for fast gaming or graphics work.
【Memory, storage device】 This product is equipped with 16GB of RAM and uses the LPDDR4x formula, so the memory load is small and the operation speed is fast. In addition, it adopts NVMe as the SSD interface, enabling the user to save and load data at high speed. Users who need more space than before can install a MicroSD card to expand the storage space.
【Wireless, other functions】 Equipped with 802.11ax Wi-Fi6 and Bluetooth 5.1, it enables fast Internet connection via Wi-Fi and can be used in conjunction with various devices via Bluetooth. In addition, additional features such as a keyboard light and front webcam improve users' working environment.
【battery】 The battery capacity is 54Wh, so it can be used for a long time. Fast charging is possible using the USB Type-C terminal.
【Size, Weight】 This product is 1.54cm thick and has a volume of 356.6 x 229.1 x 15.4mm. It weighs 1.57kg, making it easy to carry around wherever you go.
With such a wide range of features, the Samsung Galaxy Book 2 NT750XEW-A51A is truly the best choice for this price range.
Equipped with the latest technology, Samsung Galaxy Book 2 NT750XEW-A51A shows amazing results in many aspects such as performance, design, and cost-effectiveness. It is currently being sold at the lowest price of 956,410 won, so it will be difficult to find another laptop that can enjoy these features at this price. You will not regret choosing this product with powerful, stable performance, convenient features, etc.
After watching this course, you will be able to automatically generate dozens of product introductions for your blog, website, etc.Don't worry about duplication. Even if you input the same content, a different article will be generated each time.
Update complete! Stay tuned for the next update!
Python Web Crawling, Any Example with Confidence! We introduce you to the most realistic and practical web crawling and automation.
Python web crawling, From start to finish, with practice!
🤔 I want to do web crawling with Python, but I don't know how to do it.
😥 I've learned some crawling, but I can't seem to apply it to the site I want.
😮 I learned the basics of Python , but what should I do now?
🫤 We're preparing a new service, so we need to collect the information we want quickly .
Developing 'real' crawling skills that you can apply
If I can store a large amount of necessary information from web pages through web crawling , I can easily collect the information I want, and it will be a great help in creating my service.
This course is a hands-on web crawling course for those who want to start web crawling with Python, or those who have started but are still struggling. We will help you gain the power to apply it to any site by crawling various sites in various ways.
I hope that you will gain confidence in web crawling through this lecture.
Lectures available only at Inflearn! I promise the easiest explanation.
I receive numerous requests for lectures and various offers, including book writing, through my programming YouTube channel and free Inflearn lectures. But this course is only available at Inflearn . And it explains it more easily than anyone else!
Experience required for web crawling I'll give you some inspiration.
Search the Naver VIEW tab with your desired keyword and crawl in order of ranking
1️⃣ This is a lecture focused on practical training similar to real-life situations . You will learn how to collect data from various examples such as search engines, shopping malls, and music sites.
Collect Melon chart singer name, album name, and link
2️⃣ This is not a lecture that only teaches you limited methods. We will teach you various web crawling methods that can produce the same results so that you can adapt to various situations and conditions.
Crawling the following news pages: Collecting news organizations, categories, article titles, and links
3️⃣ The course is structured from a beginner's perspective . It is explained very easily so that even those who only know the basics of Python can follow the content.
Crawling the ssg.com event page
4️⃣ The curriculum is structured so that you will naturally acquire the ability to crawl any site as you follow it.
CGV Cinema Movie Chart Crawling
5️⃣ We will provide you with practical experience by providing various examples so that you can crawl various websites that you actually encounter.
Thank you so much for teaching with beginners in mind. I can understand it very well. ^^ When I watch other crawling lectures, I am busy following along and not understanding them well, so thank you so much.
★★★★★
I didn't know crawling, but I was able to understand it up to the source level in a very short time. Is this a free lecture? ^^ It's the best.
★★★★★
I always studied on my own, looked for videos, and wondered where I could really use them in reality, but now that you explain it in an easy way, I can understand it better and feel like my problems have been solved. Thank you.
★★★★★
I only knew a little bit about Python and HTML, but you explained it so easily that I was able to follow along well. Now I think I'll be able to work comfortably while automating tasks~ It's the best!
Q&A 💭
Q. What are the benefits of being able to do web crawling?
Most of the services we encounter basically collect information by crawling and provide it. If you can do web crawling, it will be a great help when planning and creating new web/apps.
Q. How much Python do I need to know?
It's good to know the basics of Python, but even if you don't, you can learn it with the appendix's introductory Python basics lecture.
✅ Please check before taking the class!
The lecture was created based on Python 3.10, so please use the corresponding version or higher. The operating system is Windows 10, and VSCode is used for the code editing key, but other operating systems (Linux, macOS) or the code editor you used before are also fine. You can take the course on a PC where VSCode and Python run smoothly.
Since this is a practice-oriented lecture, the actual time it takes to complete the course through practice is more than twice the time it takes to watch the video.
The website crawling practice and usage example classes are updated periodically. Accordingly, the course price may increase unexpectedly, but there will be no additional cost for existing students.
Python basics course is not included.
Questions/answers for sites where you practice privately are not provided.
Recommended for these people
Who is this course right for?
Anyone who wants to start web crawling with Python
People who want to make money using crawling
People who have studied the basics of Python and are now wondering what to do next
People who are struggling with web crawling
Need to know before starting?
Some knowledge of HTML/CSS and how to identify tags
It would be good to know the basics of Python, but if you don't, we will teach you the basics in the Python Introduction Supplement.
Hello This is
13,052
Learners
553
Reviews
122
Answers
4.8
Rating
3
Courses
프로그래머 김플입니다. 파이썬 기초 강의, 웹 크롤링, OpenAI API(챗gpt 인공지능)를 사용한 프로그래밍 등을 주제로 프로그래밍 초보자, 입문자를 위한 프로그래밍 채널을 운영하고 있습니다.
제 강의를 보신 분들의 가장 많은 댓글은 너무 쉽게 설명한다는 것입니다. 누구보다 쉽게 설명하고 이해시켜 드리겠습니다.
I feel confident because you explained it so well and made it easy to understand. I think it is really cost-effective since updates are also provided. I want to give it 10 out of 5.
I'm not really a person who writes reviews often, but I want to say thank you to the instructor, so I'm writing this. I've been studying crawling and wandering around here and there, and I've gotten a lot of help from the instructor's YouTube. So I came here after hearing about the lecture opening, and as expected, it's really great that you explained it so well that I could understand it. Now I think I can make what I want.
The more I go into the lecture, the more I feel like this is a lecture worth the money.
He answers questions well and his voice is gruff but tsundere,,
I first encountered Python crawling on YouTube and it was very helpful, but I haven't done it for a long time so I don't remember it well, so I bought the course. As expected, it was explained well from a beginner's perspective, and although it was the same method, it was slightly different, and it was repeated through examples (from various sites) so that I could master it repeatedly, which was very helpful. In addition to crawling, if there are other courses related to Python, I will buy them. Thank you.
I applied for the course because I needed crawling. I'm currently at about 30% progress, and I think it was a good decision to apply. There will be a new update in May, and it's great. Thank you.