탐색4단계 -주제5 단계 질문있습니다.
390
작성한 질문수 8
주제 5 workflow를 실행했는데 진행률이 저렇게 빨간색으로 뜨네요;
일단 위와 같이 select문은 잘 실행되어서 무시하고 계속 진행했는데
위와 같이 more /home/pilot-pjt/item-buy-list/000000_0 가 실행되지 않습니다.
그럼 workflow 과정에서 문제가 있었다고 보면 될까요?
혹시 주제 2~4단계에서는 working_day=20200322 를 입력했지만, 주제 5 에서는 저걸 입력하라는 말이 없어서 안 넣었는데 그 문제일까요?
일단 쿼리들은 보시면 아시겠지만 잘 복붙했습니다!
답변 1
0
안녕하세요! 빅디 입니다.
워크플로우는 잘 작성이 된것 같습니다.
참고로 주제영역5에서는 working_day 입력은 안하셔도 됩니다.
마지막 노드인 local_save_managed_smartcar_item_buylist_info.hql 에서 문제가 발생 한 것으로 보입니다.
워크플로우가 실패된 원인을 찾기 위해 로그를 확인해 보셔야는데요..
실패된 워크플로우의 상단에 로그탭이 있습니다. 여기에 Error 로그의 내용을 볼 수 있을까요?!
- 빅디 드림
0
넵! warn 이랑 error 부분에 표시해뒀습니다!
2021-09-28 09:07:27,078 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[] No results found 2021-09-28 09:07:27,276 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@:start:] Start action [0000000-210928090537188-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2021-09-28 09:07:27,286 INFO org.apache.oozie.action.control.StartActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@:start:] Starting action 2021-09-28 09:07:27,305 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@:start:] [***0000000-210928090537188-oozie-oozi-W@:start:***]Action status=DONE 2021-09-28 09:07:27,307 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@:start:] [***0000000-210928090537188-oozie-oozi-W@:start:***]Action updated in DB! 2021-09-28 09:07:27,499 INFO org.apache.oozie.action.control.StartActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@:start:] Action ended with external status [OK] 2021-09-28 09:07:27,752 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@:start:] No results found 2021-09-28 09:07:27,793 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W@:start: 2021-09-28 09:07:27,794 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W 2021-09-28 09:07:27,962 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] Start action [0000000-210928090537188-oozie-oozi-W@hive-70e7] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2021-09-28 09:07:27,981 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] Starting action. Getting Action File System 2021-09-28 09:07:28,095 INFO org.apache.oozie.service.HadoopAccessorService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] Processing configuration file [/var/run/cloudera-scm-agent/process/257-oozie-OOZIE_SERVER/action-conf/default.xml] for action [default] and hostPort [*] 2021-09-28 09:07:28,109 INFO org.apache.oozie.service.HadoopAccessorService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] Processing configuration file [/var/run/cloudera-scm-agent/process/257-oozie-OOZIE_SERVER/action-conf/hive2.xml] for action [hive2] and hostPort [*] 2021-09-28 09:07:34,361 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] Invalid configuration value [null] defined for launcher max attempts count, using default [2]. 2021-09-28 09:07:34,375 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false 2021-09-28 09:07:36,838 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] checking action, hadoop job ID [application_1632787465714_0001] status [RUNNING] 2021-09-28 09:07:36,847 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] [***0000000-210928090537188-oozie-oozi-W@hive-70e7***]Action status=RUNNING 2021-09-28 09:07:36,851 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] [***0000000-210928090537188-oozie-oozi-W@hive-70e7***]Action updated in DB! 2021-09-28 09:07:36,865 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W@hive-70e7 2021-09-28 09:07:50,499 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] callback for action [0000000-210928090537188-oozie-oozi-W@hive-70e7] 2021-09-28 09:07:51,425 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] action completed, external ID [application_1632787465714_0001] 2021-09-28 09:07:51,468 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] Action ended with external status [SUCCEEDED] 2021-09-28 09:07:51,539 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] No results found 2021-09-28 09:07:51,612 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] Start action [0000000-210928090537188-oozie-oozi-W@hive-7874] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2021-09-28 09:07:51,620 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] Starting action. Getting Action File System 2021-09-28 09:07:52,920 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] Invalid configuration value [null] defined for launcher max attempts count, using default [2]. 2021-09-28 09:07:52,920 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false 2021-09-28 09:07:53,834 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] checking action, hadoop job ID [application_1632787465714_0002] status [RUNNING] 2021-09-28 09:07:53,840 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] [***0000000-210928090537188-oozie-oozi-W@hive-7874***]Action status=RUNNING 2021-09-28 09:07:53,840 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] [***0000000-210928090537188-oozie-oozi-W@hive-7874***]Action updated in DB! 2021-09-28 09:07:53,853 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W@hive-7874 2021-09-28 09:07:53,856 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-70e7] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W@hive-70e7 2021-09-28 09:08:50,969 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] callback for action [0000000-210928090537188-oozie-oozi-W@hive-7874] 2021-09-28 09:08:51,126 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] External Child IDs : [job_1632787465714_0003] 2021-09-28 09:08:51,128 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] action completed, external ID [application_1632787465714_0002] 2021-09-28 09:08:51,183 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] Action ended with external status [SUCCEEDED] 2021-09-28 09:08:51,256 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] No results found 2021-09-28 09:08:51,430 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] Start action [0000000-210928090537188-oozie-oozi-W@hive-0f32] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2021-09-28 09:08:51,441 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] Starting action. Getting Action File System 2021-09-28 09:08:53,110 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] Invalid configuration value [null] defined for launcher max attempts count, using default [2]. 2021-09-28 09:08:53,115 INFO org.apache.oozie.action.hadoop.YarnACLHandler: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] Not setting ACLs because mapreduce.cluster.acls.enabled is set to false 2021-09-28 09:08:53,968 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] checking action, hadoop job ID [application_1632787465714_0004] status [RUNNING] 2021-09-28 09:08:53,972 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] [***0000000-210928090537188-oozie-oozi-W@hive-0f32***]Action status=RUNNING 2021-09-28 09:08:53,972 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] [***0000000-210928090537188-oozie-oozi-W@hive-0f32***]Action updated in DB! 2021-09-28 09:08:53,992 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W@hive-0f32 2021-09-28 09:08:53,995 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-7874] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W@hive-7874 2021-09-28 09:09:35,573 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] callback for action [0000000-210928090537188-oozie-oozi-W@hive-0f32] 2021-09-28 09:09:35,711 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] External Child IDs : [job_1632787465714_0005] 2021-09-28 09:09:35,715 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] action completed, external ID [application_1632787465714_0004] 2021-09-28 09:09:35,716 WARN org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] Launcher ERROR, reason: Main Class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2] 2021-09-28 09:09:35,759 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] Action ended with external status [FAILED/KILLED] 2021-09-28 09:09:35,767 INFO org.apache.oozie.command.wf.ActionEndXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] ERROR is considered as FAILED for SLA 2021-09-28 09:09:35,839 INFO org.apache.oozie.service.JPAService: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] No results found 2021-09-28 09:09:35,973 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@Kill] Start action [0000000-210928090537188-oozie-oozi-W@Kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2021-09-28 09:09:35,977 INFO org.apache.oozie.action.control.KillActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@Kill] Starting action 2021-09-28 09:09:35,980 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@Kill] [***0000000-210928090537188-oozie-oozi-W@Kill***]Action status=DONE 2021-09-28 09:09:35,980 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@Kill] [***0000000-210928090537188-oozie-oozi-W@Kill***]Action updated in DB! 2021-09-28 09:09:36,008 INFO org.apache.oozie.action.control.KillActionExecutor: SERVER[server02.hadoop.com] USER[admin] GROUP[-] TOKEN[] APP[Subject 5 - Workflow] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@Kill] Action ended with external status [OK] 2021-09-28 09:09:36,128 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@Kill] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W@Kill 2021-09-28 09:09:36,131 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W 2021-09-28 09:09:36,131 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[server02.hadoop.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-210928090537188-oozie-oozi-W] ACTION[0000000-210928090537188-oozie-oozi-W@hive-0f32] No Notification URL is defined. Therefore nothing to notify for job 0000000-210928090537188-oozie-oozi-W@hive-0f32
0
네~ 아래 쿼리만 복사해서 하이브 에디터에 붙여넣고 실행결과 확인해 주세요!! - 빅디 드림
select car_number, concat_ws("," , collect_set(item))
from managed_smartcar_item_buylist_info
group by car_number
0
네~ 잘실행 되는걸로 봐서는 메모리 문제 같지는 않고요..
그럼 파일까지 생성하는 풀쿼리도 실행 부탁 드립니다. - 빅디 드림
insert overwrite local directory '/home/pilot-pjt/item-buy-list'
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ','
select car_number, concat_ws("," , collect_set(item))
from managed_smartcar_item_buylist_info
group by car_number
0
Server02의 /home/pilot-pjt/item-buy-list 경로에 파일 생성 권한이 의심 스러워 보입니다.
우선 putty로 접속해 아래 명령을 실행하고, 앞선 하이브 쿼리를 다시 실행 시켜봐 주세요!! - 빅디 드림
$ chmod 777 -R /home/pilot-pjt
0
오오오! 이제 됩니다! 모두 다 잘 되네요!
빠르고 세심한 답변 정말 감사합니다ㅠㅠ
생각해보니 이런 에러 대응 방법도 추가적인 강의를 통해 배울 수 있으면 좋겠네요!
지금은 로그나 에러 메시지를 봐도 무슨 말인지 전혀...ㅎ
어쨌든 답변 감사합니다!♥
주제영역3 데이타 조회 문의
0
56
2
환경 세팅 후 클라우데라매니저 삭제시
0
81
2
수강 기간 연장 부탁드립니다ㅠ
0
79
2
클라우데라 매니저 접속 불가 및 로그인 정보 문의
0
99
2
gcc 설치 에러
0
137
3
클러스터 설정 오류
0
107
2
클라우데라 클러스터 설치로 안넘어가짐
0
126
2
버추어박스 5.0 설치
0
155
2
워크플로우 예약 실행시 테이블은 생성되는데 데이터가 들어가지지 않습니다.
0
92
2
Hue 500 Error 어떻게 해결할 수 있나요?
0
161
3
환경세팅 질문있습니다.
0
114
2
버쥬얼박스
0
83
2
호스트 불량 문제에 관하여
0
113
2
하이브쿼리에서 에러가 나요...
0
184
3
하이브쿼리에서 에러
0
129
1
Hbase에 적재된 데이터 확인시 에러
0
159
2
파이썬 설치 시 에러
0
170
2
redis-cli 데이터 적재 확인
0
144
2
카프카 토픽 생성에서 에러
0
146
2
HDFS 명령어를 치는데 오류가 납니다
0
139
2
가상환경 내보내기
0
113
1
SpoolDIR 폴더로 옮기
0
112
2
cpu usage 에러
0
114
2
쿼리 실행시 10000 에러
0
129
2





