cluejws9714

<p>그렇다면 elb를 통해 트래픽을 받아서 로드밸런싱후 ec2가 응답할때 nat gateway가 사용되는것인가요?&nbsp;</p>
<p>근데 수업중에 data또는 query문으로 이루어진 request가 internet gateway > elb > ec2 > RDS 로 요청이 오고 응답은 RDS > EC2 >ELB > internet gateway로 반대방향으로 응답이 전송된다고 하셨는데</p>
<p>nat gateway의 정확한 역할이 어떤것인가요?</p>

lab-web-srv-sg 보안그룹설정

nat gateway의 용도와 public subnet에 연결된 ALB

<p>혹시 죄송하지만&nbsp; tar파일의 내용이 보이게할려면 어떻게 해야되나요?</p>
<p></p>

putty를 통한 ec2 접속

<div style="color: #d4d4d4; background-color: #1e1e1e; font-family: Consolas, 'Courier New', monospace; font-size: 14px; line-height: 19px; white-space: pre;">
<div><span style="color: #569cd6;">const</span>&nbsp;<span style="color: #dcdcaa;">parse</span>&nbsp;=&nbsp;<span style="color: #dcdcaa;">require</span>(<span style="color: #ce9178;">"csv-parse/lib/sync"</span>);</div>
<div><span style="color: #569cd6;">const</span>&nbsp;<span style="color: #dcdcaa;">stringify</span>&nbsp;=&nbsp;<span style="color: #dcdcaa;">require</span>(<span style="color: #ce9178;">"csv-stringify/lib/sync"</span>);</div>
<div><span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4ec9b0;">fs</span>&nbsp;=&nbsp;<span style="color: #dcdcaa;">require</span>(<span style="color: #ce9178;">"fs"</span>);</div>
<div><span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4fc1ff;">puppeteer</span>&nbsp;=&nbsp;<span style="color: #dcdcaa;">require</span>(<span style="color: #ce9178;">"puppeteer"</span>);</div>
<br />
<div><span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4fc1ff;">csv</span>&nbsp;=&nbsp;<span style="color: #4ec9b0;">fs</span>.<span style="color: #dcdcaa;">readFileSync</span>(<span style="color: #ce9178;">"csv/data.csv"</span>);</div>
<div><span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4fc1ff;">records</span>&nbsp;=&nbsp;<span style="color: #dcdcaa;">parse</span>(<span style="color: #4fc1ff;">csv</span>.<span style="color: #dcdcaa;">toString</span>(<span style="color: #ce9178;">"utf-8"</span>));</div>
<div><span style="color: #6a9955;">//csv의&nbsp;형식이&nbsp;버퍼(0,1로&nbsp;이루어진&nbsp;컴퓨터&nbsp;친화적인&nbsp;데이터)임&nbsp;>&nbsp;문자열로&nbsp;바꿈</span></div>
<div><span style="color: #6a9955;">//csv-parse의&nbsp;parse메서드가&nbsp;문자열을&nbsp;2차원&nbsp;배열로&nbsp;바꿔줌</span></div>
<br />
<div><span style="color: #569cd6;">const</span>&nbsp;<span style="color: #dcdcaa;">crawler</span>&nbsp;=&nbsp;<span style="color: #569cd6;">async</span>&nbsp;()&nbsp;<span style="color: #569cd6;">=></span>&nbsp;{</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">try</span>{</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4fc1ff;">result</span>&nbsp;=&nbsp;[];</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4fc1ff;">browser</span>&nbsp;=&nbsp;&nbsp;<span style="color: #c586c0;">await</span>&nbsp;<span style="color: #9cdcfe;">puppeteer</span>.<span style="color: #dcdcaa;">launch</span>({<span style="color: #9cdcfe;">headless</span><span style="color: #9cdcfe;">&nbsp;:</span>&nbsp;<span style="color: #569cd6;">false</span>});</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4fc1ff;">page</span>&nbsp;=&nbsp;<span style="color: #c586c0;">await</span>&nbsp;<span style="color: #4fc1ff;">browser</span>.<span style="color: #dcdcaa;">newPage</span>();&nbsp;</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #6a9955;">//사람은&nbsp;보통&nbsp;한페이지를&nbsp;열어서&nbsp;다음페이지&nbsp;감&nbsp;(봇이&nbsp;아닌&nbsp;작업)</span></div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">await</span>&nbsp;<span style="color: #4fc1ff;">page</span>.<span style="color: #dcdcaa;">setUserAgent</span>(<span style="color: #ce9178;">"Mozilla/5.0&nbsp;(Linux;&nbsp;Android&nbsp;6.0;&nbsp;Nexus&nbsp;5&nbsp;Build/MRA58N)&nbsp;AppleWebKit/537.36&nbsp;(KHTML,&nbsp;like&nbsp;Gecko)&nbsp;Chrome/89.0.4389.90&nbsp;Mobile&nbsp;Safari/537.36"</span>);</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #6a9955;">//나의&nbsp;크롬브라우저로&nbsp;접속한것처럼&nbsp;사랑흉내를&nbsp;냄(navigator.userAgent로확인!)&nbsp;&nbsp;</span></div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #6a9955;">//그래서&nbsp;10번을&nbsp;넘나듬</span></div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">for</span>(<span style="color: #569cd6;">const</span>&nbsp;[<span style="color: #4fc1ff;">i</span>,<span style="color: #4fc1ff;">r</span>]&nbsp;<span style="color: #569cd6;">of</span>&nbsp;<span style="color: #4fc1ff;">records</span>.<span style="color: #dcdcaa;">entries</span>()){&nbsp;</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">await</span>&nbsp;<span style="color: #4fc1ff;">page</span>.<span style="color: #dcdcaa;">goto</span>(<span style="color: #4fc1ff;">r</span>[<span style="color: #b5cea8;">1</span>]);</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #9cdcfe;">console</span>.<span style="color: #dcdcaa;">log</span>(<span style="color: #c586c0;">await</span>&nbsp;<span style="color: #4fc1ff;">page</span>.<span style="color: #dcdcaa;">evaluate</span>(<span style="color: #ce9178;">"navigator.userAgent"</span>));</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4fc1ff;">text</span>&nbsp;=&nbsp;<span style="color: #c586c0;">await</span>&nbsp;<span style="color: #4fc1ff;">page</span>.<span style="color: #dcdcaa;">evaluate</span>(()<span style="color: #569cd6;">=></span>{&nbsp;<span style="color: #6a9955;">//개중요!!!!!!!!!!!!!!!!!&nbsp;evaluate를&nbsp;받음!!!!!!!!!!!!!!</span></div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4fc1ff;">score</span>&nbsp;=&nbsp;<span style="color: #9cdcfe;">document</span>.<span style="color: #dcdcaa;">querySelector</span>(<span style="color: #ce9178;">".score.score_left&nbsp;.star_score"</span>);</div>
<br />
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">if</span>(<span style="color: #4fc1ff;">score</span>){</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">return</span>&nbsp;<span style="color: #4fc1ff;">score</span>.<span style="color: #9cdcfe;">textContent</span>;</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;});</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">if</span>(<span style="color: #4fc1ff;">text</span>){</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #9cdcfe;">console</span>.<span style="color: #dcdcaa;">log</span>(<span style="color: #4fc1ff;">r</span>[<span style="color: #b5cea8;">0</span>],<span style="color: #ce9178;">"평점"</span>,<span style="color: #4fc1ff;">text</span>.<span style="color: #dcdcaa;">trim</span>());</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #4fc1ff;">result</span>[<span style="color: #4fc1ff;">i</span>]&nbsp;=&nbsp;[<span style="color: #4fc1ff;">r</span>[<span style="color: #b5cea8;">0</span>],<span style="color: #4fc1ff;">r</span>[<span style="color: #b5cea8;">1</span>],<span style="color: #4fc1ff;">text</span>.<span style="color: #dcdcaa;">trim</span>()];&nbsp;<span style="color: #6a9955;">//result[i]&nbsp;async(i)를&nbsp;통해&nbsp;순서대로&nbsp;2차원배열생성!!</span></div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}</div>
<br />
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">await</span>&nbsp;<span style="color: #4fc1ff;">page</span>.<span style="color: #dcdcaa;">waitForTimeout</span>(<span style="color: #b5cea8;">2000</span>);&nbsp;<span style="color: #6a9955;">//어떤&nbsp;웹에서&nbsp;자동화작업을&nbsp;막을수도있으므로&nbsp;시간차!!&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</span></div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">await</span>&nbsp;<span style="color: #4fc1ff;">page</span>.<span style="color: #dcdcaa;">close</span>();</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #c586c0;">await</span>&nbsp;<span style="color: #4fc1ff;">browser</span>.<span style="color: #dcdcaa;">close</span>();</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #569cd6;">const</span>&nbsp;<span style="color: #4fc1ff;">str</span>&nbsp;=&nbsp;<span style="color: #dcdcaa;">stringify</span>(<span style="color: #4fc1ff;">result</span>);</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #4ec9b0;">fs</span>.<span style="color: #dcdcaa;">writeFileSync</span>(<span style="color: #ce9178;">"csv/result.csv"</span>,<span style="color: #4fc1ff;">str</span>);</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #6a9955;">//csv-stringify의&nbsp;stringify메서드가&nbsp;2차원배열을&nbsp;다시&nbsp;문자열로&nbsp;바꿔줌</span></div>
<br />
<div>&nbsp;&nbsp;&nbsp;&nbsp;}<span style="color: #c586c0;">catch</span>(<span style="color: #9cdcfe;">e</span>){</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="color: #9cdcfe;">console</span>.<span style="color: #dcdcaa;">error</span>(<span style="color: #9cdcfe;">e</span>);</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;}</div>
<div>&nbsp;&nbsp;&nbsp;&nbsp;</div>
<div>};</div>
<br />
<div><span style="color: #dcdcaa;">crawler</span>();</div>
<img src="https://cdn.inflearn.com/public/comments/aca52009-6307-4c4d-a31b-5d160e89305a/blob" alt="" /></div>

2장 useragent를 이용하여 한탭으로 크롤링

<p>그럼 저 got부분은 실제 라우터를 실행했을때의 결과값으로 알면되는것인가요?</p>

11.4 통합테스트 관련

<p>그렇군요... 공부하면 할 수록 할 게 많아 지는 것 같네요 ㅠㅠ 감사합니다!</p>

10장 nodebird-api/routes/index.js

<p>근데 앞 코드들에서는 몇 개씩 그냥 신경 안 쓰고 짜신 것도 있는데 보통은 저렇게 undefined를 신경쓰고 해야하나요?</p>

<p>근데 토큰의 유효기간이 지나면 api를 끌어올 수 없지 않나요? 그래서 토큰을 다시 발급받을때 api를 받을때 정상적으로 못받지 않나요?</p>

10장3,4절

<p>그렇군요! 아 그리고 이 예제에서&nbsp; 토큰의 유효기간은 1분안에 API를 다 끌어와야된다는 의미인가요?</p>

<p>아 저렇게 표현하니 확 이해가되네요 감사합니다!</p>

cluejws9714

Posts