hkjung

car-batch-log&nbsp; 폴더에&nbsp;SmartCarStatusInfo_20160101.txt 를 mv 하면 삭제되는데 왜 그럴까요?

kafka consumer에서 데이터를 못 읽는데요.

왜 반복해서 mv 해도 삭제가 될까요?
----------------------------------------------------
[root@server02 driver-realtime-log]# mv /home/pilot-pjt/working/SmartCar/SmartCarStatusInfo_20160101.txt /home/pilot-pjt/working/car-batch-log/
[root@server02 driver-realtime-log]# cd /home/pilot-pjt/working/car-batch-log/
[root@server02 car-batch-log]# ls -ltr
total 0

<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">위에 가이드대로 진행해보면
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">---------------------------------------------------
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">$ zookeeper-client&nbsp;
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">[zk: ...]&nbsp; ls /brokers/topics/SmartCar-Topic/partitions/
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">위 SmartCar-Topic Z노드가 확인이 되었으면 큰 문제는 없습니다. 그냥 아래 순서대로 스톰 토폴로지를 재배포 후 테스트 해보시기 바랍니다.
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">&nbsp;
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">=> 아래와 같이 메시지 나옵니다.
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">[zk: localhost:2181(CONNECTED) 0] ls /brokers/topics/SmartCar-Topic/partitions/
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">Command failed: java.lang.IllegalArgumentException: Path must not end with / character
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">---------------------------------------------------------
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">8. 스톰 토폴로지 배포
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">=> 아래와 같이 메시지 나옵니다.
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">[root@server02 working]# storm jar bigdata.smartcar.storm-1.0.jar com.wikibook.bigdata.smartcar.storm.SmartCarTopology DriverCarInfo
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">SLF4J: Class path contains multiple SLF4J bindings.
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">SLF4J: Found binding in [jar:file:/home/pilot-pjt/apache-storm-1.2.3/lib/log4j-slf4j-impl-2.8.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">SLF4J: Found binding in [jar:file:/home/pilot-pjt/working/bigdata.smartcar.storm-1.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">Running: java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/home/pilot-pjt/apache-storm-1.2.3 -Dstorm.log.dir=/home/pilot-pjt/apache-storm-1.2.3/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /home/pilot-pjt/apache-storm-1.2.3/*:/home/pilot-pjt/apache-storm-1.2.3/lib/*:/home/pilot-pjt/apache-storm-1.2.3/extlib/*:bigdata.smartcar.storm-1.0.jar:/home/pilot-pjt/storm/conf:/home/pilot-pjt/apache-storm-1.2.3/bin -Dstorm.jar=bigdata.smartcar.storm-1.0.jar -Dstorm.dependency.jars= -Dstorm.dependency.artifacts={} com.wikibook.bigdata.smartcar.storm.SmartCarTopology DriverCarInfo
<span style="color: #212529; font-family: Noto Sans KR, -apple-system, system-ui, BlinkMacSystemFont, Apple SD Gothic Neo, Segoe UI, Roboto, Helvetica Neue, Arial, sans-serif, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, Helvetica;">Error: Could not find or load main class com.wikibook.bigdata.smartcar.storm.SmartCarTopology

Hbase에 데이터 적재가 되지 않습니다...

저도 동일 증상인데 위에 가이드
3번의 Storm UI 에서 보면 카운트가 증가하지 않는것 같고
4번의 데이터도 안들어오는것 같습니다.

교육자료의 아래 내용을 실행해도 동일합니다.

Tip. yum install 명령시 "removing mirrorlist with no valid mirrors:.." 발생하면 아래 명령 실행
$ rm /etc/yum.repos.d/cloudera-manager.repo
$ echo "http://vault.centos.org/6.10/os/x86_64/" > /var/cache/yum/x86_64/6/base/mirrorlist.txt
$ echo "http://vault.centos.org/6.10/extras/x86_64/" > /var/cache/yum/x86_64/6/extras/mirrorlist.txt
$ echo "http://vault.centos.org/6.10/updates/x86_64/" > /var/cache/yum/x86_64/6/updates/mirrorlist.txt

install: cannot stat `redis-server': No such file or directory

Redis 설치시 오류납니다.

-----------------------------------------------------
login as: root
root@192.168.56.102's password:
Last login: Wed Aug 11 17:04:22 2021 from 192.168.56.1
[root@server02 ~]# yum install -y gcc*
Loaded plugins: fastestmirror, refresh-packagekit, security
Setting up Install Process
Determining fastest mirrors
YumRepo Error: All mirror URLs are not using ftp, http[s] or file.
&nbsp;Eg. Invalid release/repo/arch combination/
removing mirrorlist with no valid mirrors: /var/cache/yum/x86_64/6/updates/mirrorlist.txt
Error: Cannot find a valid baseurl for repo: updates
[root@server02 ~]#

hkjung

投稿