• 카테고리

    질문 & 답변
  • 세부 분야

    데이터 엔지니어링

  • 해결 여부

    미해결

Subject5 실행 에러

22.12.15 22:03 작성 조회수 258

0

Subject5 워크플로우 실행을 하는데 계속 에러가 떠서 질문드립니다. 아래 로그 첨부 하겠습니다.

2022-12-15 21:56:37,147 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[] No results found
2022-12-15 21:56:37,282 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@:start:] Start action [0000000-221215213607619-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-12-15 21:56:37,310 INFO org.apache.oozie.action.control.StartActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@:start:] Starting action
2022-12-15 21:56:37,344 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@:start:] [***0000000-221215213607619-oozie-oozi-W@:start:***]Action status=DONE
2022-12-15 21:56:37,349 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@:start:] [***0000000-221215213607619-oozie-oozi-W@:start:***]Action updated in DB!
2022-12-15 21:56:37,974 INFO org.apache.oozie.action.control.StartActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@:start:] Action ended with external status [OK]
2022-12-15 21:56:38,364 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@:start:] No results found
2022-12-15 21:56:38,433 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W@:start:
2022-12-15 21:56:38,438 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W
2022-12-15 21:56:38,606 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] Start action [0000000-221215213607619-oozie-oozi-W@hive-293c] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-12-15 21:56:38,654 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] Starting action. Getting Action File System
2022-12-15 21:56:38,792 INFO org.apache.oozie.service.HadoopAccessorService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] Processing configuration file [/var/run/cloudera-scm-agent/process/188-oozie-OOZIE_SERVER/action-conf/default.xml] for action [default] and hostPort [*]
2022-12-15 21:56:38,853 INFO org.apache.oozie.service.HadoopAccessorService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] Processing configuration file [/var/run/cloudera-scm-agent/process/188-oozie-OOZIE_SERVER/action-conf/hive2.xml] for action [hive2] and hostPort [*]
2022-12-15 21:56:49,747 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] Invalid configuration value [null] defined for launcher max attempts count, using default [2].
2022-12-15 21:56:49,788 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false
2022-12-15 21:56:55,853 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] checking action, hadoop job ID [application_1671108107598_0001] status [RUNNING]
2022-12-15 21:56:55,874 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] [***0000000-221215213607619-oozie-oozi-W@hive-293c***]Action status=RUNNING
2022-12-15 21:56:55,875 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] [***0000000-221215213607619-oozie-oozi-W@hive-293c***]Action updated in DB!
2022-12-15 21:56:55,891 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W@hive-293c
2022-12-15 21:57:24,238 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] callback for action [0000000-221215213607619-oozie-oozi-W@hive-293c]
2022-12-15 21:57:25,832 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] action completed, external ID [application_1671108107598_0001]
2022-12-15 21:57:26,337 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] Action ended with external status [SUCCEEDED]
2022-12-15 21:57:26,437 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] No results found
2022-12-15 21:57:26,530 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] Start action [0000000-221215213607619-oozie-oozi-W@hive-a4af] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-12-15 21:57:26,557 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] Starting action. Getting Action File System
2022-12-15 21:57:28,919 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] Invalid configuration value [null] defined for launcher max attempts count, using default [2].
2022-12-15 21:57:28,922 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false
2022-12-15 21:57:30,931 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] checking action, hadoop job ID [application_1671108107598_0002] status [RUNNING]
2022-12-15 21:57:30,959 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] [***0000000-221215213607619-oozie-oozi-W@hive-a4af***]Action status=RUNNING
2022-12-15 21:57:30,967 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] [***0000000-221215213607619-oozie-oozi-W@hive-a4af***]Action updated in DB!
2022-12-15 21:57:30,997 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W@hive-a4af
2022-12-15 21:57:31,001 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-293c] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W@hive-293c
2022-12-15 21:59:31,062 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] callback for action [0000000-221215213607619-oozie-oozi-W@hive-a4af]
2022-12-15 21:59:31,474 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] External Child IDs  : [job_1671108107598_0003]
2022-12-15 21:59:31,485 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] action completed, external ID [application_1671108107598_0002]
2022-12-15 21:59:31,641 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] Action ended with external status [SUCCEEDED]
2022-12-15 21:59:32,144 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] No results found
2022-12-15 21:59:32,298 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] Start action [0000000-221215213607619-oozie-oozi-W@hive-fd33] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-12-15 21:59:32,316 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] Starting action. Getting Action File System
2022-12-15 21:59:35,810 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] Invalid configuration value [null] defined for launcher max attempts count, using default [2].
2022-12-15 21:59:35,834 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false
2022-12-15 21:59:37,976 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] checking action, hadoop job ID [application_1671108107598_0004] status [RUNNING]
2022-12-15 21:59:37,997 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] [***0000000-221215213607619-oozie-oozi-W@hive-fd33***]Action status=RUNNING
2022-12-15 21:59:38,016 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] [***0000000-221215213607619-oozie-oozi-W@hive-fd33***]Action updated in DB!
2022-12-15 21:59:38,061 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W@hive-fd33
2022-12-15 21:59:38,068 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-a4af] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W@hive-a4af
2022-12-15 22:01:01,194 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] callback for action [0000000-221215213607619-oozie-oozi-W@hive-fd33]
2022-12-15 22:01:01,552 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] External Child IDs  : [job_1671108107598_0005]
2022-12-15 22:01:01,556 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] action completed, external ID [application_1671108107598_0004]
2022-12-15 22:01:01,558 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] Launcher ERROR, reason: Main Class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]
2022-12-15 22:01:01,645 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] Action ended with external status [FAILED/KILLED]
2022-12-15 22:01:01,734 INFO org.apache.oozie.command.wf.ActionEndXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] ERROR is considered as FAILED for SLA
2022-12-15 22:01:02,263 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] No results found
2022-12-15 22:01:02,310 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@Kill] Start action [0000000-221215213607619-oozie-oozi-W@Kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2022-12-15 22:01:02,323 INFO org.apache.oozie.action.control.KillActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@Kill] Starting action
2022-12-15 22:01:02,335 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@Kill] [***0000000-221215213607619-oozie-oozi-W@Kill***]Action status=DONE
2022-12-15 22:01:02,336 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@Kill] [***0000000-221215213607619-oozie-oozi-W@Kill***]Action updated in DB!
2022-12-15 22:01:02,373 INFO org.apache.oozie.action.control.KillActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@Kill] Action ended with external status [OK]
2022-12-15 22:01:02,867 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@Kill] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W@Kill
2022-12-15 22:01:02,873 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W
2022-12-15 22:01:02,873 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-221215213607619-oozie-oozi-W] ACTION[0000000-221215213607619-oozie-oozi-W@hive-fd33] No Notification URL is defined. Therefore nothing to notify for job 0000000-221215213607619-oozie-oozi-W@hive-fd33

답변 1

답변을 작성해보세요.

0

안녕하세요! "cks1220"님!

파일럿 프로젝트 후반에 갈수록...복잡도가 높아지면서 다양한 문제들이 발생해 어려워 합니다. ^^;;;

하지만 빅데이터의 실환경서도 이러한 다양한 문제들이 발생하고, 이때 문제를 해결하는 경험과 능력이 매우 중요합니다~

보내주신 로그를 봤을때 우지 Workflow 실행은 문제가 없어 보입니다.

하지민 워크플로우에서 실행한 Action에 매핑된 Job들에서 문제가 발생한 것으로 보이는데요...

워크플로우Job > 하이브 > 얀의 M/R Job 순으로 실행 됐을겁니다.

지금 보여주신 로그는 우지의 워크플로우Job 로그 이고요, 휴의 Job 브라우져에서 실행 시점에 발생한 Job의 로그를 보실 수 있습니다.

그곳의 Job 로그를 보시고, 문제 원인을 찾아 보시고요...어려우시면 관련로그와 함께 올려주세요~

참고로 파일럿 프로젝트 후반부에 발생한 대부분의 문제는,

실습 PC의 자원 문제 또는 특정 서버가 셧다운/정지 되어 있어서 발생하는 문제들입니다.

실행전 요 두가지도 점검해봐 주세요~

-빅디 드림