동시성 프로그래밍으로 웹 크롤링, 스크래핑 성능 극대화 - 강좌 코드 에러

제공해주신 url에 접근시 ssl에러가 나오는데 원인을 잘 모르겠습니다.

 

다음은 터미널에 찍힌 전문 입니다.

 

(venv) dhkim@dhkimui-MacBookPro Collection % python3 scraping_2.py 1 2 3 4 5 6 7 8 9 Traceback (most recent call last): File "/Users/dhkim/Source/venv/lib/python3.10/site-packages/aiohttp/connector.py", line 986, in _wrap_create_connection return await self._loop.create_connection(*args, **kwargs) # type: ignore[return-value] # noqa File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/base_events.py", line 1089, in create_connection transport, protocol = await self._create_connection_transport( File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/base_events.py", line 1119, in _create_connection_transport await waiter File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/sslproto.py", line 534, in data_received ssldata, appdata = self._sslpipe.feed_ssldata(data) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/sslproto.py", line 188, in feed_ssldata self._sslobj.do_handshake() File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/ssl.py", line 974, in do_handshake self._sslobj.do_handshake() ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:997) The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/Users/dhkim/Source/venv/Collection/scraping_2.py", line 35, in <module> asyncio.run(main()) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/base_events.py", line 646, in run_until_complete return future.result() File "/Users/dhkim/Source/venv/Collection/scraping_2.py", line 31, in main await asyncio.gather(*[fetch(session, url, i) for i, url in enumerate(urls)]) File "/Users/dhkim/Source/venv/Collection/scraping_2.py", line 17, in fetch async with session.get(url) as response: File "/Users/dhkim/Source/venv/lib/python3.10/site-packages/aiohttp/client.py", line 1138, in __aenter__ self._resp = await self._coro File "/Users/dhkim/Source/venv/lib/python3.10/site-packages/aiohttp/client.py", line 535, in _request conn = await self._connector.connect( File "/Users/dhkim/Source/venv/lib/python3.10/site-packages/aiohttp/connector.py", line 542, in connect proto = await self._create_connection(req, traces, timeout) File "/Users/dhkim/Source/venv/lib/python3.10/site-packages/aiohttp/connector.py", line 907, in _create_connection _, proto = await self._create_direct_connection(req, traces, timeout) File "/Users/dhkim/Source/venv/lib/python3.10/site-packages/aiohttp/connector.py", line 1206, in _create_direct_connection raise last_exc File "/Users/dhkim/Source/venv/lib/python3.10/site-packages/aiohttp/connector.py", line 1175, in _create_direct_connection transp, proto = await self._wrap_create_connection( File "/Users/dhkim/Source/venv/lib/python3.10/site-packages/aiohttp/connector.py", line 988, in _wrap_create_connection raise ClientConnectorCertificateError(req.connection_key, exc) from exc aiohttp.client_exceptions.ClientConnectorCertificateError: Cannot connect to host bjpublic.tistory.com:443 ssl:True [SSLCertVerificationError: (1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:997)')]