chul kim

ㅠㅠ..rdate 명령어를 통해 server01 과 server02 의 시간을 맞춰줌으로 해결했습니다..

seq2sparse 실행 오류 관련

안녕하세요 선생님!어찌저찌 해서 문제는 해결 되었습니다보내주신 workflow 로 교체를 해도 이전 내용으로 원복되는 현상이 있었어요그래서 생성했던 workflow 와 예약을 제거하고 재생성해서 해결을 했습니다....어리둥절 하네요문제 해결에 고민 같이 해주셔서 감사드립니다남은 주말 즐겁게 보내세요!!

예약 및 workflow 실행 불가 관련

선생님 안녕하세요!workflow-app 태그에 name 속성에 특수문자가 있는 것은 요 에디터로 붙여넣기 하면서 생긴 것 같습니다실제 파일에는 특수문자가 없습니다..ㅠㅠ그래도 혹시나 싶어서 xml 파일의 name 속성의 값을 완전히 지우고 다시 입력한 뒤에실행읋 해보았지만 동일한 에러가 나타나네요...ㅠㅠ다른 방법이 있을까요...??좋은하루 보내세요~!감사합니다.

안녕하세요 선생님!말씀해주신 내용들 보내드립니다다만 .sql 파일이 2개가 아닌 3개가 생성되어 있어서.. 일단은 다 보내드립니다!(workflow.xml 을 보면 2개만 사용하는 거 같긴 하지만 혹시 몰라서요ㅎㅎ)좋은 밤 되세요!workflow.xml<pre><code><workflow-app name="Subject3 - Workflow" xmlns="uri:oozie:workflow:0.5">
 <start to="hive-a283"/>
 <kill name="Kill">
 <message>작업 실패, 오류 메시지[${wf:errorMessage(wf:lastErrorNode())}]</message>
 </kill>
 <action name="hive-a283" cred="hive2">
 <hive2 xmlns="uri:oozie:hive2-action:0.1">
 <job-tracker>${jobTracker}</job-tracker>
 <name-node>${nameNode}</name-node>
 <jdbc-url>jdbc:hive2://server02.hadoop.com:10000/default</jdbc-url>
 <script>${wf:appPath()}/hive-a283.sql</script>
 </hive2>
 <ok to="hive-340f"/>
 <error to="Kill"/>
 </action>
 <action name="hive-340f" cred="hive2">
 <hive2 xmlns="uri:oozie:hive2-action:0.1">
 <job-tracker>${jobTracker}</job-tracker>
 <name-node>${nameNode}</name-node>
 <jdbc-url>jdbc:hive2://server02.hadoop.com:10000/default</jdbc-url>
 <script>${wf:appPath()}/hive-340f.sql</script>
 <param>working_day=20200322</param>
 </hive2>
 <ok to="End"/>
 <error to="Kill"/>
 </action>
 <end name="End"/>
</workflow-app></code></pre>hive-207f.sql<pre><code>USE default;

insert into table Managed_SmartCar_Symptom_Info
select
 t1.car_number,
 t1.speed_p_avg_by_carnum,
 case
 when (abs((t1.speed_p_avg_by_carnum - t3.speed_p_avg) / t4.speed_p_std)) > 2
 then 'abnormal'
 else 'normal'
 end
 as speed_p_symptom_score,
 t1.break_p_avg_by_carnum,
 case
 when (abs((t1.break_p_avg_by_carnum - t3.break_p_avg) / t4.break_p_std)) > 2
 then 'abnormal'
 else 'normal'
 end
 as break_p_symptom_score,
 t2.steer_a_count,
 case
 when (t2.steer_a_count) > 2000
 then 'abnormal'
 else 'normal'
 end
 as steer_p_symptom_score,
 t1.biz_date
from 
 (select car_number,
 biz_date,
 avg(speed_pedal) as speed_p_avg_by_carnum,
 avg(break_pedal) as break_p_avg_by_carnum
 from managed_smartcar_drive_info
 where biz_date = '${working_day}'
 group by car_number, biz_date) t1
join
 (select car_number,
 count(*) as steer_a_count
 from managed_smartcar_drive_info
 where steer_angle in ('L2', 'L3', 'R2', 'R3') and
 biz_date = '${working_day}'
 group by car_number) t2
on
 t1.car_number = t2.car_number,
 (select avg(speed_pedal) as speed_p_avg,
 avg(break_pedal) as break_p_avg
 from managed_smartcar_drive_info) t3,
 (select stddev_pop(s.speed_p_avg_by_carnum) as speed_p_std,
 stddev_pop(s.break_p_avg_by_carnum) as break_p_std
 from (select car_number,
 avg(speed_pedal) as speed_p_avg_by_carnum,
 avg(break_pedal) as break_p_avg_by_carnum
 from managed_smartcar_drive_info
 group by car_number) s) t4</code></pre>hive-340f.sql<pre><code>USE default;

insert into table Managed_SmartCar_Symptom_Info
select
 t1.car_number,
 t1.speed_p_avg_by_carnum,
 case
 when (abs((t1.speed_p_avg_by_carnum - t3.speed_p_avg) / t4.speed_p_std)) > 2
 then 'abnormal'
 else 'normal'
 end
 as speed_p_symptom_score,
 t1.break_p_avg_by_carnum,
 case
 when (abs((t1.break_p_avg_by_carnum - t3.break_p_avg) / t4.break_p_std)) > 2
 then 'abnormal'
 else 'normal'
 end
 as break_p_symptom_score,
 t2.steer_a_count,
 case
 when (t2.steer_a_count) > 2000
 then 'abnormal'
 else 'normal'
 end
 as steer_p_symptom_score,
 t1.biz_date
from 
 (select car_number,
 biz_date,
 avg(speed_pedal) as speed_p_avg_by_carnum,
 avg(break_pedal) as break_p_avg_by_carnum
 from managed_smartcar_drive_info
 where biz_date = '${working_day}'
 group by car_number, biz_date) t1
join
 (select car_number,
 count(*) as steer_a_count
 from managed_smartcar_drive_info
 where steer_angle in ('L2', 'L3', 'R2', 'R3') and
 biz_date = '${working_day}'
 group by car_number) t2
on
 t1.car_number = t2.car_number,
 (select avg(speed_pedal) as speed_p_avg,
 avg(break_pedal) as break_p_avg
 from managed_smartcar_drive_info) t3,
 (select stddev_pop(s.speed_p_avg_by_carnum) as speed_p_std,
 stddev_pop(s.break_p_avg_by_carnum) as break_p_std
 from (select car_number,
 avg(speed_pedal) as speed_p_avg_by_carnum,
 avg(break_pedal) as break_p_avg_by_carnum
 from managed_smartcar_drive_info
 group by car_number) s) t4;</code></pre>hive-a283.sql<pre><code>USE default;

create table if not exists Managed_SmartCar_Symptom_Info (
 car_number string,
 speed_p_avg string,
 speed_p_symptom string,
 break_p_avg string,
 break_p_symptom string,
 steer_a_cnt string,
 steer_p_symptom string,
 biz_date string
)
row format delimited
fields terminated by ','
stored as textfile;</code></pre>

안녕하세요 선생님!요청해주신 워크플로우 스샷을 캡쳐해서 보내드립니다!좋은 하루 보내세요!감사합니다<img src="https://cdn.inflearn.com/public/files/posts/9ab39bea-22ab-46df-a44c-8c56a6ff3584/image.png">

으아!! 선생님!!
해결했습니다!!
아래 블로그 글을 보고 해결했어요....ㅠㅠ
검색 능력이 부족했나 봅니다ㅎㅎ
감사합니다~!! (TMI 드리자면 저는 고사양으로 진행하다가 컴터가 너무 멈추는 바람에 다시 저사양으로 따라가구 있어요ㅎㅎ)
http://blog.plura.io/?p=15881

선생님 질문이 있습니다!

안녕하세요 선생님!
말씀하신대로 3개의 파일을 vi 통해서 열람한 파일 + 명령어 실행 후 스샷을 첨부 드립니다
감사합니다
좋은 하루 되세요~!
&nbsp;
base/mirrorlist.txt
<img src="https://cdn.inflearn.com/public/comments/e4fe7453-f82b-47fb-ab9e-1dca333b2974/스크린샷 2022-08-09 오전 7.22.02.png" />
extras/mirrorlist.txt
<img src="https://cdn.inflearn.com/public/comments/28f2e225-2c11-4d30-87d1-19ac156ef74a/스크린샷 2022-08-09 오전 7.22.18.png" />
updates/mirror/list
<img src="https://cdn.inflearn.com/public/comments/351b9770-eb73-4e2f-b97c-9c325a44e835/스크린샷 2022-08-09 오전 7.22.33.png" />
&nbsp;
yum install -y gcc* 명령어 실행 후
<img src="https://cdn.inflearn.com/public/comments/6ffbd5c2-7608-4f8a-952e-ac6d87160f9c/스크린샷 2022-08-09 오전 7.25.23.png" />

네.. 아마도 해당 강좌의 웹팩 설정은 많은 것을 바꾸셔야 할겁니다.
쉽지 않겠지만 화이팅입니다!

chul kim

Posts