inflearn logo
강의

강의

N
챌린지

챌린지

멘토링

멘토링

N
클립

클립

로드맵

로드맵

지식공유

15일간의 빅데이터 파일럿 프로젝트

탐색 파일럿 실행 주제영역 5 관련 에러

198

cksl1220

작성한 질문수 9

0

안녕하세요.

주제영역 1~4는 다 완성해서 테스트까지 문제가 없었는데,

Workflow 5 실행을 하면 첫번째 사진처럼 오류가 납니다.

(Main Class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2])

그래서 재실행하려고 하면 두번째 사진같이 hive-8943, hive-f7c0 이 두개가 나오는데,

선택 후 재실행해도 같은 에러만 계속 뜹니다.

로그

2022-10-18 10:37:56,725 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[] No results found
2022-10-18 10:37:57,018 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] Start action [0000000-221018103111060-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:37:57,038 INFO org.apache.oozie.action.control.StartActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] Starting action
2022-10-18 10:37:57,071 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] [***0000000-221018103111060-oozie-oozi-W@:start:***]Action status=DONE
2022-10-18 10:37:57,073 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] [***0000000-221018103111060-oozie-oozi-W@:start:***]Action updated in DB!
2022-10-18 10:37:57,644 INFO org.apache.oozie.action.control.StartActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] Action ended with external status [OK]
2022-10-18 10:37:57,869 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] No results found
2022-10-18 10:37:57,924 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@:start:
2022-10-18 10:37:57,931 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W
2022-10-18 10:37:58,198 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Start action [0000000-221018103111060-oozie-oozi-W@hive-8943] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:37:58,251 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Starting action. Getting Action File System
2022-10-18 10:37:58,335 INFO org.apache.oozie.service.HadoopAccessorService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Processing configuration file [/var/run/cloudera-scm-agent/process/158-oozie-OOZIE_SERVER/action-conf/default.xml] for action [default] and hostPort [*]
2022-10-18 10:37:58,740 INFO org.apache.oozie.service.HadoopAccessorService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Processing configuration file [/var/run/cloudera-scm-agent/process/158-oozie-OOZIE_SERVER/action-conf/hive2.xml] for action [hive2] and hostPort [*]
2022-10-18 10:38:08,426 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Invalid configuration value [null] defined for launcher max attempts count, using default [2].
2022-10-18 10:38:08,450 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false
2022-10-18 10:38:11,291 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] checking action, hadoop job ID [application_1666056618933_0001] status [RUNNING]
2022-10-18 10:38:11,308 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] [***0000000-221018103111060-oozie-oozi-W@hive-8943***]Action status=RUNNING
2022-10-18 10:38:11,308 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] [***0000000-221018103111060-oozie-oozi-W@hive-8943***]Action updated in DB!
2022-10-18 10:38:11,319 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-8943
2022-10-18 10:38:36,625 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] callback for action [0000000-221018103111060-oozie-oozi-W@hive-8943]
2022-10-18 10:38:37,942 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] action completed, external ID [application_1666056618933_0001]
2022-10-18 10:38:38,033 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Action ended with external status [SUCCEEDED]
2022-10-18 10:38:38,152 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] No results found
2022-10-18 10:38:38,761 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Start action [0000000-221018103111060-oozie-oozi-W@hive-f7c0] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:38:38,776 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Starting action. Getting Action File System
2022-10-18 10:38:41,091 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Invalid configuration value [null] defined for launcher max attempts count, using default [2].
2022-10-18 10:38:41,094 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false
2022-10-18 10:38:42,746 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] checking action, hadoop job ID [application_1666056618933_0002] status [RUNNING]
2022-10-18 10:38:42,757 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] [***0000000-221018103111060-oozie-oozi-W@hive-f7c0***]Action status=RUNNING
2022-10-18 10:38:42,765 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] [***0000000-221018103111060-oozie-oozi-W@hive-f7c0***]Action updated in DB!
2022-10-18 10:38:42,785 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-f7c0
2022-10-18 10:38:42,791 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-8943
2022-10-18 10:40:18,663 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] callback for action [0000000-221018103111060-oozie-oozi-W@hive-f7c0]
2022-10-18 10:40:18,971 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] External Child IDs  : [job_1666056618933_0003]
2022-10-18 10:40:18,987 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] action completed, external ID [application_1666056618933_0002]
2022-10-18 10:40:19,226 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Action ended with external status [SUCCEEDED]
2022-10-18 10:40:19,417 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] No results found
2022-10-18 10:40:19,883 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Start action [0000000-221018103111060-oozie-oozi-W@hive-1ff1] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:40:19,905 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Starting action. Getting Action File System
2022-10-18 10:40:22,772 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Invalid configuration value [null] defined for launcher max attempts count, using default [2].
2022-10-18 10:40:22,776 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false
2022-10-18 10:40:24,036 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] checking action, hadoop job ID [application_1666056618933_0004] status [RUNNING]
2022-10-18 10:40:24,041 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] [***0000000-221018103111060-oozie-oozi-W@hive-1ff1***]Action status=RUNNING
2022-10-18 10:40:24,041 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] [***0000000-221018103111060-oozie-oozi-W@hive-1ff1***]Action updated in DB!
2022-10-18 10:40:24,066 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-1ff1
2022-10-18 10:40:24,069 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-f7c0
2022-10-18 10:41:29,401 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] callback for action [0000000-221018103111060-oozie-oozi-W@hive-1ff1]
2022-10-18 10:41:29,597 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] External Child IDs  : [job_1666056618933_0005]
2022-10-18 10:41:29,603 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] action completed, external ID [application_1666056618933_0004]
2022-10-18 10:41:29,603 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Launcher ERROR, reason: Main Class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]
2022-10-18 10:41:29,665 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Action ended with external status [FAILED/KILLED]
2022-10-18 10:41:29,674 INFO org.apache.oozie.command.wf.ActionEndXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] ERROR is considered as FAILED for SLA
2022-10-18 10:41:29,976 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] No results found
2022-10-18 10:41:30,035 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] Start action [0000000-221018103111060-oozie-oozi-W@Kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:41:30,058 INFO org.apache.oozie.action.control.KillActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] Starting action
2022-10-18 10:41:30,065 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] [***0000000-221018103111060-oozie-oozi-W@Kill***]Action status=DONE
2022-10-18 10:41:30,066 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] [***0000000-221018103111060-oozie-oozi-W@Kill***]Action updated in DB!
2022-10-18 10:41:30,093 INFO org.apache.oozie.action.control.KillActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] Action ended with external status [OK]
2022-10-18 10:41:30,250 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@Kill
2022-10-18 10:41:30,252 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W
2022-10-18 10:41:30,253 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-1ff1

+CM를 보면 HDFS만 경고창 하나가 떠있는데 그게 혹시 문제가 되는건가 싶어서 같이 첨부합니다.

++ 다른 질문글에 있는 권한은 이미 해보았습니다

 

데이터 엔지니어링 ZooKeeper Flume Kafka redis Impala bigdata Hadoop

답변 1

0

Big.D

안녕하세요! 빅디 입니다.

복제계수 미달(Under Replicated)은, 불안정한 파일럿 환경에서 자주 발생하는 현상입니다.

데이터노드가 1~3대인 파일럿 환경에선 복제계수 미달시 곧바로 문제가 됩니다. TT

혹시 고사양 환경에서 2~3대의 데이터 노드를 사용중 이신지요?!

그리고 복제계수를 몇개로 사용하고 계신지요?!

만약~ 2개의 복제계수를 사용하고 계신다면..

아래의 명령으로 복제계수를 맞춰 주고, 테스트를 진행해 보시기 바랍니다.

$ hadoop fs -setrep 2  /

-빅디 드림

주제영역3 데이타 조회 문의

0

40

2

환경 세팅 후 클라우데라매니저 삭제시

0

65

2

수강 기간 연장 부탁드립니다ㅠ

0

60

2

클라우데라 매니저 접속 불가 및 로그인 정보 문의

0

89

2

gcc 설치 에러

0

117

3

클러스터 설정 오류

0

91

2

클라우데라 클러스터 설치로 안넘어가짐

0

120

2

버추어박스 5.0 설치

0

141

2

워크플로우 예약 실행시 테이블은 생성되는데 데이터가 들어가지지 않습니다.

0

79

2

Hue 500 Error 어떻게 해결할 수 있나요?

0

151

3

환경세팅 질문있습니다.

0

107

2

버쥬얼박스

0

76

2

호스트 불량 문제에 관하여

0

110

2

하이브쿼리에서 에러가 나요...

0

169

3

하이브쿼리에서 에러

0

120

1

Hbase에 적재된 데이터 확인시 에러

0

147

2

파이썬 설치 시 에러

0

159

2

redis-cli 데이터 적재 확인

0

143

2

카프카 토픽 생성에서 에러

0

139

2

HDFS 명령어를 치는데 오류가 납니다

0

135

2

가상환경 내보내기

0

109

1

SpoolDIR 폴더로 옮기

0

104

2

cpu usage 에러

0

114

2

쿼리 실행시 10000 에러

0

122

2