Posts
Q&A
seq2sparse ์คํ ์ค๋ฅ ๊ด๋ จ
ใ ใ ..rdate ๋ช ๋ น์ด๋ฅผ ํตํด server01 ๊ณผ server02 ์ ์๊ฐ์ ๋ง์ถฐ์ค์ผ๋ก ํด๊ฒฐํ์ต๋๋ค..
- 0
- 1
- 302
Q&A
์์ฝ ๋ฐ workflow ์คํ ๋ถ๊ฐ ๊ด๋ จ
์๋ ํ์ธ์ ์ ์๋!์ด์ฐ์ ์ฐ ํด์ ๋ฌธ์ ๋ ํด๊ฒฐ ๋์์ต๋๋ค๋ณด๋ด์ฃผ์ workflow ๋ก ๊ต์ฒด๋ฅผ ํด๋ ์ด์ ๋ด์ฉ์ผ๋ก ์๋ณต๋๋ ํ์์ด ์์์ด์๊ทธ๋์ ์์ฑํ๋ workflow ์ ์์ฝ์ ์ ๊ฑฐํ๊ณ ์ฌ์์ฑํด์ ํด๊ฒฐ์ ํ์ต๋๋ค....์ด๋ฆฌ๋ฅ์ ํ๋ค์๋ฌธ์ ํด๊ฒฐ์ ๊ณ ๋ฏผ ๊ฐ์ด ํด์ฃผ์ ์ ๊ฐ์ฌ๋๋ฆฝ๋๋ค๋จ์ ์ฃผ๋ง ์ฆ๊ฒ๊ฒ ๋ณด๋ด์ธ์!!
- 0
- 5
- 431
Q&A
์์ฝ ๋ฐ workflow ์คํ ๋ถ๊ฐ ๊ด๋ จ
์ ์๋ ์๋ ํ์ธ์!workflow-app ํ๊ทธ์ name ์์ฑ์ ํน์๋ฌธ์๊ฐ ์๋ ๊ฒ์ ์ ์๋ํฐ๋ก ๋ถ์ฌ๋ฃ๊ธฐ ํ๋ฉด์ ์๊ธด ๊ฒ ๊ฐ์ต๋๋ค์ค์ ํ์ผ์๋ ํน์๋ฌธ์๊ฐ ์์ต๋๋ค..ใ ใ ๊ทธ๋๋ ํน์๋ ์ถ์ด์ xml ํ์ผ์ name ์์ฑ์ ๊ฐ์ ์์ ํ ์ง์ฐ๊ณ ๋ค์ ์ ๋ ฅํ ๋ค์์คํ์ ํด๋ณด์์ง๋ง ๋์ผํ ์๋ฌ๊ฐ ๋ํ๋๋ค์...ใ ใ ๋ค๋ฅธ ๋ฐฉ๋ฒ์ด ์์๊น์...??์ข์ํ๋ฃจ ๋ณด๋ด์ธ์~!๊ฐ์ฌํฉ๋๋ค.
- 0
- 5
- 431
Q&A
์์ฝ ๋ฐ workflow ์คํ ๋ถ๊ฐ ๊ด๋ จ
์๋ ํ์ธ์ ์ ์๋!๋ง์ํด์ฃผ์ ๋ด์ฉ๋ค ๋ณด๋ด๋๋ฆฝ๋๋ค๋ค๋ง .sql ํ์ผ์ด 2๊ฐ๊ฐ ์๋ 3๊ฐ๊ฐ ์์ฑ๋์ด ์์ด์.. ์ผ๋จ์ ๋ค ๋ณด๋ด๋๋ฆฝ๋๋ค!(workflow.xml ์ ๋ณด๋ฉด 2๊ฐ๋ง ์ฌ์ฉํ๋ ๊ฑฐ ๊ฐ๊ธด ํ์ง๋ง ํน์ ๋ชฐ๋ผ์์ใ ใ )์ข์ ๋ฐค ๋์ธ์!workflow.xml ์์ ์คํจ, ์ค๋ฅ ๋ฉ์์ง[${wf:errorMessage(wf:lastErrorNode())}] ${jobTracker} ${nameNode} jdbc:hive2://server02.hadoop.com:10000/default ${wf:appPath()}/hive-a283.sql ${jobTracker} ${nameNode} jdbc:hive2://server02.hadoop.com:10000/default ${wf:appPath()}/hive-340f.sql working_day=20200322 hive-207f.sqlUSE default; insert into table Managed_SmartCar_Symptom_Info select t1.car_number, t1.speed_p_avg_by_carnum, case when (abs((t1.speed_p_avg_by_carnum - t3.speed_p_avg) / t4.speed_p_std)) > 2 then 'abnormal' else 'normal' end as speed_p_symptom_score, t1.break_p_avg_by_carnum, case when (abs((t1.break_p_avg_by_carnum - t3.break_p_avg) / t4.break_p_std)) > 2 then 'abnormal' else 'normal' end as break_p_symptom_score, t2.steer_a_count, case when (t2.steer_a_count) > 2000 then 'abnormal' else 'normal' end as steer_p_symptom_score, t1.biz_date from (select car_number, biz_date, avg(speed_pedal) as speed_p_avg_by_carnum, avg(break_pedal) as break_p_avg_by_carnum from managed_smartcar_drive_info where biz_date = '${working_day}' group by car_number, biz_date) t1 join (select car_number, count(*) as steer_a_count from managed_smartcar_drive_info where steer_angle in ('L2', 'L3', 'R2', 'R3') and biz_date = '${working_day}' group by car_number) t2 on t1.car_number = t2.car_number, (select avg(speed_pedal) as speed_p_avg, avg(break_pedal) as break_p_avg from managed_smartcar_drive_info) t3, (select stddev_pop(s.speed_p_avg_by_carnum) as speed_p_std, stddev_pop(s.break_p_avg_by_carnum) as break_p_std from (select car_number, avg(speed_pedal) as speed_p_avg_by_carnum, avg(break_pedal) as break_p_avg_by_carnum from managed_smartcar_drive_info group by car_number) s) t4hive-340f.sqlUSE default; insert into table Managed_SmartCar_Symptom_Info select t1.car_number, t1.speed_p_avg_by_carnum, case when (abs((t1.speed_p_avg_by_carnum - t3.speed_p_avg) / t4.speed_p_std)) > 2 then 'abnormal' else 'normal' end as speed_p_symptom_score, t1.break_p_avg_by_carnum, case when (abs((t1.break_p_avg_by_carnum - t3.break_p_avg) / t4.break_p_std)) > 2 then 'abnormal' else 'normal' end as break_p_symptom_score, t2.steer_a_count, case when (t2.steer_a_count) > 2000 then 'abnormal' else 'normal' end as steer_p_symptom_score, t1.biz_date from (select car_number, biz_date, avg(speed_pedal) as speed_p_avg_by_carnum, avg(break_pedal) as break_p_avg_by_carnum from managed_smartcar_drive_info where biz_date = '${working_day}' group by car_number, biz_date) t1 join (select car_number, count(*) as steer_a_count from managed_smartcar_drive_info where steer_angle in ('L2', 'L3', 'R2', 'R3') and biz_date = '${working_day}' group by car_number) t2 on t1.car_number = t2.car_number, (select avg(speed_pedal) as speed_p_avg, avg(break_pedal) as break_p_avg from managed_smartcar_drive_info) t3, (select stddev_pop(s.speed_p_avg_by_carnum) as speed_p_std, stddev_pop(s.break_p_avg_by_carnum) as break_p_std from (select car_number, avg(speed_pedal) as speed_p_avg_by_carnum, avg(break_pedal) as break_p_avg_by_carnum from managed_smartcar_drive_info group by car_number) s) t4;hive-a283.sqlUSE default; create table if not exists Managed_SmartCar_Symptom_Info ( car_number string, speed_p_avg string, speed_p_symptom string, break_p_avg string, break_p_symptom string, steer_a_cnt string, steer_p_symptom string, biz_date string ) row format delimited fields terminated by ',' stored as textfile;
- 0
- 5
- 431
Q&A
์์ฝ ๋ฐ workflow ์คํ ๋ถ๊ฐ ๊ด๋ จ
์๋ ํ์ธ์ ์ ์๋!์์ฒญํด์ฃผ์ ์ํฌํ๋ก์ฐ ์ค์ท์ ์บก์ณํด์ ๋ณด๋ด๋๋ฆฝ๋๋ค!์ข์ ํ๋ฃจ ๋ณด๋ด์ธ์!๊ฐ์ฌํฉ๋๋ค(์ฌ์ง)
- 0
- 5
- 431
Q&A
์ ์๋ ์ง๋ฌธ์ด ์์ต๋๋ค!
์ผ์!! ์ ์๋!! ํด๊ฒฐํ์ต๋๋ค!! ์๋ ๋ธ๋ก๊ทธ ๊ธ์ ๋ณด๊ณ ํด๊ฒฐํ์ด์....ใ ใ ๊ฒ์ ๋ฅ๋ ฅ์ด ๋ถ์กฑํ๋ ๋ด ๋๋คใ ใ ๊ฐ์ฌํฉ๋๋ค~!!(TMI ๋๋ฆฌ์๋ฉด ์ ๋ ๊ณ ์ฌ์์ผ๋ก ์งํํ๋ค๊ฐ ์ปดํฐ๊ฐ ๋๋ฌด ๋ฉ์ถ๋ ๋ฐ๋์ ๋ค์ ์ ์ฌ์์ผ๋ก ๋ฐ๋ผ๊ฐ๊ตฌ ์์ด์ใ ใ ) http://blog.plura.io/?p=15881
- 0
- 5
- 4K
Q&A
์ ์๋ ์ง๋ฌธ์ด ์์ต๋๋ค!
์๋ ํ์ธ์ ์ ์๋! ๋ง์ํ์ ๋๋ก 3๊ฐ์ ํ์ผ์ vi ํตํด์ ์ด๋ํ ํ์ผ + ๋ช ๋ น์ด ์คํ ํ ์ค์ท์ ์ฒจ๋ถ ๋๋ฆฝ๋๋ค ๊ฐ์ฌํฉ๋๋ค ์ข์ ํ๋ฃจ ๋์ธ์~! base/mirrorlist.txt (์ฌ์ง) extras/mirrorlist.txt (์ฌ์ง) updates/mirror/list (์ฌ์ง) yum install -y gcc* ๋ช ๋ น์ด ์คํ ํ (์ฌ์ง)
- 0
- 5
- 4K
Q&A
์์ ์ด ๊ฐ์๋ฅผ ๋ณด์๋ ๋ถ๊ป..webpack.config.js์ ๊ดํด์
๋ค.. ์๋ง๋ ํด๋น ๊ฐ์ข์ ์นํฉ ์ค์ ์ ๋ง์ ๊ฒ์ ๋ฐ๊พธ์ ์ผ ํ ๊ฒ๋๋ค. ์ฝ์ง ์๊ฒ ์ง๋ง ํ์ดํ ์ ๋๋ค!
- 4
- 7
- 762