• 카테고리

    질문 & 답변
  • 세부 분야

    데이터 엔지니어링

  • 해결 여부

    미해결

탐색 파일럿 실행 주제영역 5 관련 에러

22.10.18 10:44 작성 조회수 89

0

안녕하세요.

주제영역 1~4는 다 완성해서 테스트까지 문제가 없었는데,

Workflow 5 실행을 하면 첫번째 사진처럼 오류가 납니다.

(Main Class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2])

그래서 재실행하려고 하면 두번째 사진같이 hive-8943, hive-f7c0 이 두개가 나오는데,

선택 후 재실행해도 같은 에러만 계속 뜹니다.

로그

2022-10-18 10:37:56,725 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[] No results found
2022-10-18 10:37:57,018 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] Start action [0000000-221018103111060-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:37:57,038 INFO org.apache.oozie.action.control.StartActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] Starting action
2022-10-18 10:37:57,071 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] [***0000000-221018103111060-oozie-oozi-W@:start:***]Action status=DONE
2022-10-18 10:37:57,073 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] [***0000000-221018103111060-oozie-oozi-W@:start:***]Action updated in DB!
2022-10-18 10:37:57,644 INFO org.apache.oozie.action.control.StartActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] Action ended with external status [OK]
2022-10-18 10:37:57,869 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] No results found
2022-10-18 10:37:57,924 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@:start:
2022-10-18 10:37:57,931 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W
2022-10-18 10:37:58,198 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Start action [0000000-221018103111060-oozie-oozi-W@hive-8943] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:37:58,251 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Starting action. Getting Action File System
2022-10-18 10:37:58,335 INFO org.apache.oozie.service.HadoopAccessorService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Processing configuration file [/var/run/cloudera-scm-agent/process/158-oozie-OOZIE_SERVER/action-conf/default.xml] for action [default] and hostPort [*]
2022-10-18 10:37:58,740 INFO org.apache.oozie.service.HadoopAccessorService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Processing configuration file [/var/run/cloudera-scm-agent/process/158-oozie-OOZIE_SERVER/action-conf/hive2.xml] for action [hive2] and hostPort [*]
2022-10-18 10:38:08,426 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Invalid configuration value [null] defined for launcher max attempts count, using default [2].
2022-10-18 10:38:08,450 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false
2022-10-18 10:38:11,291 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] checking action, hadoop job ID [application_1666056618933_0001] status [RUNNING]
2022-10-18 10:38:11,308 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] [***0000000-221018103111060-oozie-oozi-W@hive-8943***]Action status=RUNNING
2022-10-18 10:38:11,308 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] [***0000000-221018103111060-oozie-oozi-W@hive-8943***]Action updated in DB!
2022-10-18 10:38:11,319 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-8943
2022-10-18 10:38:36,625 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] callback for action [0000000-221018103111060-oozie-oozi-W@hive-8943]
2022-10-18 10:38:37,942 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] action completed, external ID [application_1666056618933_0001]
2022-10-18 10:38:38,033 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] Action ended with external status [SUCCEEDED]
2022-10-18 10:38:38,152 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] No results found
2022-10-18 10:38:38,761 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Start action [0000000-221018103111060-oozie-oozi-W@hive-f7c0] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:38:38,776 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Starting action. Getting Action File System
2022-10-18 10:38:41,091 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Invalid configuration value [null] defined for launcher max attempts count, using default [2].
2022-10-18 10:38:41,094 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false
2022-10-18 10:38:42,746 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] checking action, hadoop job ID [application_1666056618933_0002] status [RUNNING]
2022-10-18 10:38:42,757 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] [***0000000-221018103111060-oozie-oozi-W@hive-f7c0***]Action status=RUNNING
2022-10-18 10:38:42,765 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] [***0000000-221018103111060-oozie-oozi-W@hive-f7c0***]Action updated in DB!
2022-10-18 10:38:42,785 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-f7c0
2022-10-18 10:38:42,791 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-8943] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-8943
2022-10-18 10:40:18,663 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] callback for action [0000000-221018103111060-oozie-oozi-W@hive-f7c0]
2022-10-18 10:40:18,971 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] External Child IDs  : [job_1666056618933_0003]
2022-10-18 10:40:18,987 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] action completed, external ID [application_1666056618933_0002]
2022-10-18 10:40:19,226 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] Action ended with external status [SUCCEEDED]
2022-10-18 10:40:19,417 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] No results found
2022-10-18 10:40:19,883 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Start action [0000000-221018103111060-oozie-oozi-W@hive-1ff1] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:40:19,905 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Starting action. Getting Action File System
2022-10-18 10:40:22,772 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Invalid configuration value [null] defined for launcher max attempts count, using default [2].
2022-10-18 10:40:22,776 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false
2022-10-18 10:40:24,036 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] checking action, hadoop job ID [application_1666056618933_0004] status [RUNNING]
2022-10-18 10:40:24,041 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] [***0000000-221018103111060-oozie-oozi-W@hive-1ff1***]Action status=RUNNING
2022-10-18 10:40:24,041 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] [***0000000-221018103111060-oozie-oozi-W@hive-1ff1***]Action updated in DB!
2022-10-18 10:40:24,066 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-1ff1
2022-10-18 10:40:24,069 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-f7c0] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-f7c0
2022-10-18 10:41:29,401 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] callback for action [0000000-221018103111060-oozie-oozi-W@hive-1ff1]
2022-10-18 10:41:29,597 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] External Child IDs  : [job_1666056618933_0005]
2022-10-18 10:41:29,603 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] action completed, external ID [application_1666056618933_0004]
2022-10-18 10:41:29,603 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Launcher ERROR, reason: Main Class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]
2022-10-18 10:41:29,665 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] Action ended with external status [FAILED/KILLED]
2022-10-18 10:41:29,674 INFO org.apache.oozie.command.wf.ActionEndXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] ERROR is considered as FAILED for SLA
2022-10-18 10:41:29,976 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] No results found
2022-10-18 10:41:30,035 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] Start action [0000000-221018103111060-oozie-oozi-W@Kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-10-18 10:41:30,058 INFO org.apache.oozie.action.control.KillActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] Starting action
2022-10-18 10:41:30,065 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] [***0000000-221018103111060-oozie-oozi-W@Kill***]Action status=DONE
2022-10-18 10:41:30,066 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] [***0000000-221018103111060-oozie-oozi-W@Kill***]Action updated in DB!
2022-10-18 10:41:30,093 INFO org.apache.oozie.action.control.KillActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] Action ended with external status [OK]
2022-10-18 10:41:30,250 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@Kill] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@Kill
2022-10-18 10:41:30,252 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W
2022-10-18 10:41:30,253 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221018103111060-oozie-oozi-W] ACTION[0000000-221018103111060-oozie-oozi-W@hive-1ff1] No Notification URL is defined. Therefore nothing to notify for job 0000000-221018103111060-oozie-oozi-W@hive-1ff1

+CM를 보면 HDFS만 경고창 하나가 떠있는데 그게 혹시 문제가 되는건가 싶어서 같이 첨부합니다.

++ 다른 질문글에 있는 권한은 이미 해보았습니다

 

답변 1

답변을 작성해보세요.

0

안녕하세요! 빅디 입니다.

복제계수 미달(Under Replicated)은, 불안정한 파일럿 환경에서 자주 발생하는 현상입니다.

데이터노드가 1~3대인 파일럿 환경에선 복제계수 미달시 곧바로 문제가 됩니다. TT

혹시 고사양 환경에서 2~3대의 데이터 노드를 사용중 이신지요?!

그리고 복제계수를 몇개로 사용하고 계신지요?!

만약~ 2개의 복제계수를 사용하고 계신다면..

아래의 명령으로 복제계수를 맞춰 주고, 테스트를 진행해 보시기 바랍니다.

$ hadoop fs -setrep 2  /

-빅디 드림