• 카테고리

    질문 & 답변
  • 세부 분야

    데브옵스 · 인프라

  • 해결 여부

    해결됨

volume 강의중에 스토리지 설치시 문제가 있어 도움 요청드려요

23.04.25 23:49 작성 23.04.25 23:57 수정 조회수 336

1

스크린샷 2023-04-25 오후 11.56.49.png스크린샷 2023-04-25 오후 11.45.52.pngVolume (1.22) longhorn storage설치시 해당 가이드대로 진행시 502가 계속 나오는데요 혹시 이부분 도움 받을 수 있을까요??

답변 2

·

답변을 작성해보세요.

1

답변이 늦어 죄송합니다. 원인 확인하는데 시간이 좀 걸렸네요.

이전엔 문제 없었으나, 현재는 해당 버전에 문제가 있다고 보시면 됩니다. 오픈소스가 월래 좀 그렇습니다..

아래 명령으로 삭제하시고요

kubectl delete -f https://raw.githubusercontent.com/kubetm/kubetm.github.io/master/yamls/longhorn/longhorn.yaml

 

아래 명령으로 다시 설치하시기 바랍니다.

kubectl apply -f https://raw.githubusercontent.com/kubetm/kubetm.github.io/master/yamls/longhorn/longhorn-1.3.3.yaml

 

0

안녕하세요.

가이드대로 하셨으면 일단 전체 워커노드에 [1-1) iscsi 설치]는 하셨을꺼고요.

한번 pod 상세 로그를 볼까요?

kubectl describe pods -n longhorn-system 

위 명령어 결과를 올려주시면 같이 확인해보겠습니다.

ogh2022님의 프로필

ogh2022

질문자

2023.04.29

안녕하세요 강사님. 질문에 대한 답변을 주셔서 감사합니다. 강사님께서 말씀하신대로 명령어를 치고 나오는 로그 공유드리겠습니다. 내용이 많아서 텍스트 파일로 전달드리고 싶었는데.,.. 제가 전달드릴 방법을 찾지 못해서 코드 블록으로 드린 점 양해 부탁드립니다.

 

Name:         longhorn-admission-webhook-84457896d6-h78ch
Namespace:    longhorn-system
Priority:     0
Node:         k8s-node1/192.168.56.31
Start Time:   Tue, 25 Apr 2023 14:39:34 +0000
Labels:       app=longhorn-admission-webhook
              app.kubernetes.io/instance=longhorn
              app.kubernetes.io/name=longhorn
              app.kubernetes.io/version=v1.3.0-dev
              pod-template-hash=84457896d6
Annotations:  cni.projectcalico.org/containerID: b52618fd71f0596a00564b7f77ee2eeaab1eb58afd6528900ca19816b11f12a5
              cni.projectcalico.org/podIP: 20.111.156.70/32
              cni.projectcalico.org/podIPs: 20.111.156.70/32
Status:       Running
IP:           20.111.156.70
IPs:
  IP:           20.111.156.70
Controlled By:  ReplicaSet/longhorn-admission-webhook-84457896d6
Init Containers:
  wait-longhorn-conversion-webhook:
    Container ID:  docker://7ef5d6cc996c5eef9a10e662b628a92801760a1400f6f206dbff25c29a4dc32c
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      docker-pullable://longhornio/longhorn-manager@sha256:d7462205ed4cc837be069f03d0b2feadbcad115fa82af9d47ba34ee74bfa7c89
    Port:          <none>
    Host Port:     <none>
    Command:
      sh
      -c
      while [ $(curl -m 1 -s -o /dev/null -w "%{http_code}" -k https://longhorn-conversion-webhook:9443/v1/healthz) != "200" ]; do echo waiting; sleep 2; done
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Sat, 29 Apr 2023 04:08:03 +0000
      Finished:     Sat, 29 Apr 2023 04:08:06 +0000
    Ready:          True
    Restart Count:  1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-x56pq (ro)
Containers:
  longhorn-admission-webhook:
    Container ID:  docker://2efe590a8434d8f2d1ca6227ac83c70701ab34e5e916998e4e9bc6e71ed078b8
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      docker-pullable://longhornio/longhorn-manager@sha256:d7462205ed4cc837be069f03d0b2feadbcad115fa82af9d47ba34ee74bfa7c89
    Port:          9443/TCP
    Host Port:     0/TCP
    Command:
      longhorn-manager
      admission-webhook
      --service-account
      longhorn-service-account
    State:          Running
      Started:      Sat, 29 Apr 2023 04:08:07 +0000
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Tue, 25 Apr 2023 14:40:24 +0000
      Finished:     Tue, 25 Apr 2023 15:07:20 +0000
    Ready:          False
    Restart Count:  1
    Readiness:      tcp-socket :9443 delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment:
      POD_NAMESPACE:  longhorn-system (v1:metadata.namespace)
      NODE_NAME:       (v1:spec.nodeName)
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-x56pq (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  kube-api-access-x56pq:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason          Age                      From               Message
  ----     ------          ----                     ----               -------
  Normal   Scheduled       3d13h                    default-scheduler  Successfully assigned longhorn-system/longhorn-admission-webhook-84457896d6-h78ch to k8s-node1
  Normal   Pulling         3d13h                    kubelet            Pulling image "longhornio/longhorn-manager:master-head"
  Normal   Pulled          3d13h                    kubelet            Successfully pulled image "longhornio/longhorn-manager:master-head" in 40.598621418s
  Normal   Created         3d13h                    kubelet            Created container wait-longhorn-conversion-webhook
  Normal   Started         3d13h                    kubelet            Started container wait-longhorn-conversion-webhook
  Normal   Pulled          3d13h                    kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal   Created         3d13h                    kubelet            Created container longhorn-admission-webhook
  Normal   Started         3d13h                    kubelet            Started container longhorn-admission-webhook
  Warning  Unhealthy       3d13h (x166 over 3d13h)  kubelet            Readiness probe failed: dial tcp 20.111.156.114:9443: connect: connection refused
  Normal   SandboxChanged  8m3s (x4 over 9m45s)     kubelet            Pod sandbox changed, it will be killed and re-created.
  Normal   Pulled          7m59s                    kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal   Created         7m57s                    kubelet            Created container wait-longhorn-conversion-webhook
  Normal   Started         7m55s                    kubelet            Started container wait-longhorn-conversion-webhook
  Normal   Pulled          7m51s                    kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal   Created         7m51s                    kubelet            Created container longhorn-admission-webhook
  Normal   Started         7m51s                    kubelet            Started container longhorn-admission-webhook
  Warning  Unhealthy       4m41s (x23 over 7m50s)   kubelet            Readiness probe failed: dial tcp 20.111.156.70:9443: connect: connection refused


Name:         longhorn-admission-webhook-84457896d6-zl2mj
Namespace:    longhorn-system
Priority:     0
Node:         k8s-node1/192.168.56.31
Start Time:   Tue, 25 Apr 2023 14:39:34 +0000
Labels:       app=longhorn-admission-webhook
              app.kubernetes.io/instance=longhorn
              app.kubernetes.io/name=longhorn
              app.kubernetes.io/version=v1.3.0-dev
              pod-template-hash=84457896d6
Annotations:  cni.projectcalico.org/containerID: e921ec2fd17c67613001e72ac89138c74e2e578a2b4c1ad08b62cb9bb7846c89
              cni.projectcalico.org/podIP: 20.111.156.65/32
              cni.projectcalico.org/podIPs: 20.111.156.65/32
Status:       Running
IP:           20.111.156.65
IPs:
  IP:           20.111.156.65
Controlled By:  ReplicaSet/longhorn-admission-webhook-84457896d6
Init Containers:
  wait-longhorn-conversion-webhook:
    Container ID:  docker://e3640e8e8744af1326a81a78db83291e4177b1c078001a188af0fd04c956aff2
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      docker-pullable://longhornio/longhorn-manager@sha256:d7462205ed4cc837be069f03d0b2feadbcad115fa82af9d47ba34ee74bfa7c89
    Port:          <none>
    Host Port:     <none>
    Command:
      sh
      -c
      while [ $(curl -m 1 -s -o /dev/null -w "%{http_code}" -k https://longhorn-conversion-webhook:9443/v1/healthz) != "200" ]; do echo waiting; sleep 2; done
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Sat, 29 Apr 2023 04:08:03 +0000
      Finished:     Sat, 29 Apr 2023 04:08:06 +0000
    Ready:          True
    Restart Count:  1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-9vhjc (ro)
Containers:
  longhorn-admission-webhook:
    Container ID:  docker://a08d6a8bbd6cd60de2001b422e6ba4f276541d99fe731ca9018aacc8615037bc
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      docker-pullable://longhornio/longhorn-manager@sha256:d7462205ed4cc837be069f03d0b2feadbcad115fa82af9d47ba34ee74bfa7c89
    Port:          9443/TCP
    Host Port:     0/TCP
    Command:
      longhorn-manager
      admission-webhook
      --service-account
      longhorn-service-account
    State:          Running
      Started:      Sat, 29 Apr 2023 04:08:07 +0000
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Tue, 25 Apr 2023 14:40:26 +0000
      Finished:     Tue, 25 Apr 2023 15:07:20 +0000
    Ready:          False
    Restart Count:  1
    Readiness:      tcp-socket :9443 delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment:
      POD_NAMESPACE:  longhorn-system (v1:metadata.namespace)
      NODE_NAME:       (v1:spec.nodeName)
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-9vhjc (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  kube-api-access-9vhjc:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason          Age                      From               Message
  ----     ------          ----                     ----               -------
  Normal   Scheduled       3d13h                    default-scheduler  Successfully assigned longhorn-system/longhorn-admission-webhook-84457896d6-zl2mj to k8s-node1
  Normal   Pulling         3d13h                    kubelet            Pulling image "longhornio/longhorn-manager:master-head"
  Normal   Pulled          3d13h                    kubelet            Successfully pulled image "longhornio/longhorn-manager:master-head" in 48.789314963s
  Normal   Created         3d13h                    kubelet            Created container wait-longhorn-conversion-webhook
  Normal   Started         3d13h                    kubelet            Started container wait-longhorn-conversion-webhook
  Normal   Pulled          3d13h                    kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal   Created         3d13h                    kubelet            Created container longhorn-admission-webhook
  Normal   Started         3d13h                    kubelet            Started container longhorn-admission-webhook
  Warning  Unhealthy       3d13h (x168 over 3d13h)  kubelet            Readiness probe failed: dial tcp 20.111.156.95:9443: connect: connection refused
  Normal   SandboxChanged  8m3s (x4 over 9m47s)     kubelet            Pod sandbox changed, it will be killed and re-created.
  Normal   Pulled          7m59s                    kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal   Created         7m59s                    kubelet            Created container wait-longhorn-conversion-webhook
  Normal   Started         7m55s                    kubelet            Started container wait-longhorn-conversion-webhook
  Normal   Pulled          7m51s                    kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal   Created         7m51s                    kubelet            Created container longhorn-admission-webhook
  Normal   Started         7m51s                    kubelet            Started container longhorn-admission-webhook
  Warning  Unhealthy       4m41s (x23 over 7m50s)   kubelet            Readiness probe failed: dial tcp 20.111.156.65:9443: connect: connection refused


Name:         longhorn-conversion-webhook-5c8c644b67-wvskn
Namespace:    longhorn-system
Priority:     0
Node:         k8s-node1/192.168.56.31
Start Time:   Tue, 25 Apr 2023 14:39:34 +0000
Labels:       app=longhorn-conversion-webhook
              app.kubernetes.io/instance=longhorn
              app.kubernetes.io/name=longhorn
              app.kubernetes.io/version=v1.3.0-dev
              pod-template-hash=5c8c644b67
Annotations:  cni.projectcalico.org/containerID: 6c5c1f46f1c51dc72d5f5b861e7c3499f4e37932f77dfb922fe9db1d712e7beb
              cni.projectcalico.org/podIP: 20.111.156.123/32
              cni.projectcalico.org/podIPs: 20.111.156.123/32
Status:       Running
IP:           20.111.156.123
IPs:
  IP:           20.111.156.123
Controlled By:  ReplicaSet/longhorn-conversion-webhook-5c8c644b67
Containers:
  longhorn-conversion-webhook:
    Container ID:  docker://8d1d723491cf6b3bf1839a2c1f7778515d15e5a4718654ac6d5367e78de43dc7
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      docker-pullable://longhornio/longhorn-manager@sha256:d7462205ed4cc837be069f03d0b2feadbcad115fa82af9d47ba34ee74bfa7c89
    Port:          9443/TCP
    Host Port:     0/TCP
    Command:
      longhorn-manager
      conversion-webhook
      --service-account
      longhorn-service-account
    State:          Running
      Started:      Sat, 29 Apr 2023 04:08:03 +0000
    Last State:     Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Tue, 25 Apr 2023 14:40:28 +0000
      Finished:     Tue, 25 Apr 2023 15:07:20 +0000
    Ready:          True
    Restart Count:  1
    Readiness:      tcp-socket :9443 delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment:
      POD_NAMESPACE:  longhorn-system (v1:metadata.namespace)
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-xx4f2 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  kube-api-access-xx4f2:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason          Age                   From               Message
  ----    ------          ----                  ----               -------
  Normal  Scheduled       3d13h                 default-scheduler  Successfully assigned longhorn-system/longhorn-conversion-webhook-5c8c644b67-wvskn to k8s-node1
  Normal  Pulling         3d13h                 kubelet            Pulling image "longhornio/longhorn-manager:master-head"
  Normal  Pulled          3d13h                 kubelet            Successfully pulled image "longhornio/longhorn-manager:master-head" in 51.702709899s
  Normal  Created         3d13h                 kubelet            Created container longhorn-conversion-webhook
  Normal  Started         3d13h                 kubelet            Started container longhorn-conversion-webhook
  Normal  SandboxChanged  8m2s (x4 over 9m45s)  kubelet            Pod sandbox changed, it will be killed and re-created.
  Normal  Pulled          7m57s                 kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal  Created         7m56s                 kubelet            Created container longhorn-conversion-webhook
  Normal  Started         7m55s                 kubelet            Started container longhorn-conversion-webhook


Name:         longhorn-conversion-webhook-5c8c644b67-zlhfz
Namespace:    longhorn-system
Priority:     0
Node:         k8s-node1/192.168.56.31
Start Time:   Tue, 25 Apr 2023 14:39:34 +0000
Labels:       app=longhorn-conversion-webhook
              app.kubernetes.io/instance=longhorn
              app.kubernetes.io/name=longhorn
              app.kubernetes.io/version=v1.3.0-dev
              pod-template-hash=5c8c644b67
Annotations:  cni.projectcalico.org/containerID: 4ac5b7b9dc32fa174c7352d64f0931cd690aa41334e63b603eabf477fe34d3e3
              cni.projectcalico.org/podIP: 20.111.156.116/32
              cni.projectcalico.org/podIPs: 20.111.156.116/32
Status:       Running
IP:           20.111.156.116
IPs:
  IP:           20.111.156.116
Controlled By:  ReplicaSet/longhorn-conversion-webhook-5c8c644b67
Containers:
  longhorn-conversion-webhook:
    Container ID:  docker://93861eb8ce5db22cba61f6645554a810a5be584713405d3be1f845f24d7c4450
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      docker-pullable://longhornio/longhorn-manager@sha256:d7462205ed4cc837be069f03d0b2feadbcad115fa82af9d47ba34ee74bfa7c89
    Port:          9443/TCP
    Host Port:     0/TCP
    Command:
      longhorn-manager
      conversion-webhook
      --service-account
      longhorn-service-account
    State:          Running
      Started:      Sat, 29 Apr 2023 04:07:59 +0000
    Last State:     Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Tue, 25 Apr 2023 14:40:21 +0000
      Finished:     Tue, 25 Apr 2023 15:07:20 +0000
    Ready:          True
    Restart Count:  1
    Readiness:      tcp-socket :9443 delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment:
      POD_NAMESPACE:  longhorn-system (v1:metadata.namespace)
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tlg48 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  kube-api-access-tlg48:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason          Age                   From               Message
  ----    ------          ----                  ----               -------
  Normal  Scheduled       3d13h                 default-scheduler  Successfully assigned longhorn-system/longhorn-conversion-webhook-5c8c644b67-zlhfz to k8s-node1
  Normal  Pulling         3d13h                 kubelet            Pulling image "longhornio/longhorn-manager:master-head"
  Normal  Pulled          3d13h                 kubelet            Successfully pulled image "longhornio/longhorn-manager:master-head" in 44.697668848s
  Normal  Created         3d13h                 kubelet            Created container longhorn-conversion-webhook
  Normal  Started         3d13h                 kubelet            Started container longhorn-conversion-webhook
  Normal  SandboxChanged  8m4s (x4 over 9m49s)  kubelet            Pod sandbox changed, it will be killed and re-created.
  Normal  Pulled          8m                    kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal  Created         7m59s                 kubelet            Created container longhorn-conversion-webhook
  Normal  Started         7m59s                 kubelet            Started container longhorn-conversion-webhook


Name:         longhorn-driver-deployer-5bcb6c4bbc-rgtt5
Namespace:    longhorn-system
Priority:     0
Node:         k8s-node1/192.168.56.31
Start Time:   Tue, 25 Apr 2023 14:39:34 +0000
Labels:       app=longhorn-driver-deployer
              app.kubernetes.io/instance=longhorn
              app.kubernetes.io/name=longhorn
              app.kubernetes.io/version=v1.3.0-dev
              pod-template-hash=5bcb6c4bbc
Annotations:  cni.projectcalico.org/containerID: f140237af509ee8dbf6418d6294aec222969d455e14c4b14eda2a522455e9f1a
              cni.projectcalico.org/podIP: 20.111.156.68/32
              cni.projectcalico.org/podIPs: 20.111.156.68/32
Status:       Pending
IP:           20.111.156.68
IPs:
  IP:           20.111.156.68
Controlled By:  ReplicaSet/longhorn-driver-deployer-5bcb6c4bbc
Init Containers:
  wait-longhorn-manager:
    Container ID:  docker://817d16bd261d57421413b6f5ee40c39d6b0700127bc54c6497ddc2f0e68c5200
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      docker-pullable://longhornio/longhorn-manager@sha256:d7462205ed4cc837be069f03d0b2feadbcad115fa82af9d47ba34ee74bfa7c89
    Port:          <none>
    Host Port:     <none>
    Command:
      sh
      -c
      while [ $(curl -m 1 -s -o /dev/null -w "%{http_code}" http://longhorn-backend:9500/v1) != "200" ]; do echo waiting; sleep 2; done
    State:          Running
      Started:      Sat, 29 Apr 2023 04:08:03 +0000
    Ready:          False
    Restart Count:  1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-j6jpw (ro)
Containers:
  longhorn-driver-deployer:
    Container ID:  
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      
    Port:          <none>
    Host Port:     <none>
    Command:
      longhorn-manager
      -d
      deploy-driver
      --manager-image
      longhornio/longhorn-manager:master-head
      --manager-url
      http://longhorn-backend:9500/v1
    State:          Waiting
      Reason:       PodInitializing
    Ready:          False
    Restart Count:  0
    Environment:
      POD_NAMESPACE:                    longhorn-system (v1:metadata.namespace)
      NODE_NAME:                         (v1:spec.nodeName)
      SERVICE_ACCOUNT:                   (v1:spec.serviceAccountName)
      CSI_ATTACHER_IMAGE:               longhornio/csi-attacher:v3.2.1
      CSI_PROVISIONER_IMAGE:            longhornio/csi-provisioner:v2.1.2
      CSI_NODE_DRIVER_REGISTRAR_IMAGE:  longhornio/csi-node-driver-registrar:v2.3.0
      CSI_RESIZER_IMAGE:                longhornio/csi-resizer:v1.2.0
      CSI_SNAPSHOTTER_IMAGE:            longhornio/csi-snapshotter:v3.0.3
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-j6jpw (ro)
Conditions:
  Type              Status
  Initialized       False 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  kube-api-access-j6jpw:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason          Age                   From               Message
  ----    ------          ----                  ----               -------
  Normal  Scheduled       3d13h                 default-scheduler  Successfully assigned longhorn-system/longhorn-driver-deployer-5bcb6c4bbc-rgtt5 to k8s-node1
  Normal  Pulling         3d13h                 kubelet            Pulling image "longhornio/longhorn-manager:master-head"
  Normal  Pulled          3d13h                 kubelet            Successfully pulled image "longhornio/longhorn-manager:master-head" in 21.179941209s
  Normal  Created         3d13h                 kubelet            Created container wait-longhorn-manager
  Normal  Started         3d13h                 kubelet            Started container wait-longhorn-manager
  Normal  SandboxChanged  8m4s (x3 over 9m49s)  kubelet            Pod sandbox changed, it will be killed and re-created.
  Normal  Pulled          7m59s                 kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal  Created         7m59s                 kubelet            Created container wait-longhorn-manager
  Normal  Started         7m55s                 kubelet            Started container wait-longhorn-manager


Name:         longhorn-manager-75pfm
Namespace:    longhorn-system
Priority:     0
Node:         k8s-node1/192.168.56.31
Start Time:   Tue, 25 Apr 2023 14:39:34 +0000
Labels:       app=longhorn-manager
              app.kubernetes.io/instance=longhorn
              app.kubernetes.io/name=longhorn
              app.kubernetes.io/version=v1.3.0-dev
              controller-revision-hash=55448869f5
              pod-template-generation=1
Annotations:  cni.projectcalico.org/containerID: 9dc266a3c0270e82de23d39ef0b2909b8b0ebc79c3475ba11cf3c3e4ef23c02e
              cni.projectcalico.org/podIP: 20.111.156.122/32
              cni.projectcalico.org/podIPs: 20.111.156.122/32
Status:       Pending
IP:           20.111.156.122
IPs:
  IP:           20.111.156.122
Controlled By:  DaemonSet/longhorn-manager
Init Containers:
  wait-longhorn-admission-webhook:
    Container ID:  docker://0583e67ab70574d9644444de24cc7626a1d19c1703450018073679d6083be457
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      docker-pullable://longhornio/longhorn-manager@sha256:d7462205ed4cc837be069f03d0b2feadbcad115fa82af9d47ba34ee74bfa7c89
    Port:          <none>
    Host Port:     <none>
    Command:
      sh
      -c
      while [ $(curl -m 1 -s -o /dev/null -w "%{http_code}" -k https://longhorn-admission-webhook:9443/v1/healthz) != "200" ]; do echo waiting; sleep 2; done
    State:          Running
      Started:      Sat, 29 Apr 2023 04:08:04 +0000
    Ready:          False
    Restart Count:  1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-z9tws (ro)
Containers:
  longhorn-manager:
    Container ID:  
    Image:         longhornio/longhorn-manager:master-head
    Image ID:      
    Port:          9500/TCP
    Host Port:     0/TCP
    Command:
      longhorn-manager
      -d
      daemon
      --engine-image
      longhornio/longhorn-engine:master-head
      --instance-manager-image
      longhornio/longhorn-instance-manager:v1_20220303
      --share-manager-image
      longhornio/longhorn-share-manager:v1_20211020
      --backing-image-manager-image
      longhornio/backing-image-manager:v3_20220318
      --manager-image
      longhornio/longhorn-manager:master-head
      --service-account
      longhorn-service-account
    State:          Waiting
      Reason:       PodInitializing
    Ready:          False
    Restart Count:  0
    Readiness:      tcp-socket :9500 delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment:
      POD_NAMESPACE:         longhorn-system (v1:metadata.namespace)
      POD_IP:                 (v1:status.podIP)
      NODE_NAME:              (v1:spec.nodeName)
      DEFAULT_SETTING_PATH:  /var/lib/longhorn-setting/default-setting.yaml
    Mounts:
      /host/dev/ from dev (rw)
      /host/proc/ from proc (rw)
      /var/lib/longhorn-setting/ from longhorn-default-setting (rw)
      /var/lib/longhorn/ from longhorn (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-z9tws (ro)
Conditions:
  Type              Status
  Initialized       False 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  dev:
    Type:          HostPath (bare host directory volume)
    Path:          /dev/
    HostPathType:  
  proc:
    Type:          HostPath (bare host directory volume)
    Path:          /proc/
    HostPathType:  
  longhorn:
    Type:          HostPath (bare host directory volume)
    Path:          /var/lib/longhorn/
    HostPathType:  
  longhorn-default-setting:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      longhorn-default-setting
    Optional:  false
  kube-api-access-z9tws:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/disk-pressure:NoSchedule op=Exists
                             node.kubernetes.io/memory-pressure:NoSchedule op=Exists
                             node.kubernetes.io/not-ready:NoExecute op=Exists
                             node.kubernetes.io/pid-pressure:NoSchedule op=Exists
                             node.kubernetes.io/unreachable:NoExecute op=Exists
                             node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
  Type    Reason          Age                   From               Message
  ----    ------          ----                  ----               -------
  Normal  Scheduled       3d13h                 default-scheduler  Successfully assigned longhorn-system/longhorn-manager-75pfm to k8s-node1
  Normal  Pulling         3d13h                 kubelet            Pulling image "longhornio/longhorn-manager:master-head"
  Normal  Pulled          3d13h                 kubelet            Successfully pulled image "longhornio/longhorn-manager:master-head" in 37.941082914s
  Normal  Created         3d13h                 kubelet            Created container wait-longhorn-admission-webhook
  Normal  Started         3d13h                 kubelet            Started container wait-longhorn-admission-webhook
  Normal  SandboxChanged  8m2s (x4 over 9m45s)  kubelet            Pod sandbox changed, it will be killed and re-created.
  Normal  Pulled          7m55s                 kubelet            Container image "longhornio/longhorn-manager:master-head" already present on machine
  Normal  Created         7m54s                 kubelet            Created container wait-longhorn-admission-webhook
  Normal  Started         7m54s                 kubelet            Started container wait-longhorn-admission-webhook


Name:         longhorn-ui-6d887468fd-kzb6j
Namespace:    longhorn-system
Priority:     0
Node:         k8s-node1/192.168.56.31
Start Time:   Tue, 25 Apr 2023 14:39:34 +0000
Labels:       app=longhorn-ui
              app.kubernetes.io/instance=longhorn
              app.kubernetes.io/name=longhorn
              app.kubernetes.io/version=v1.3.0-dev
              pod-template-hash=6d887468fd
Annotations:  cni.projectcalico.org/containerID: 0d1c77c4c66416bc7bc3d263db4ea883e51f084990c84d17d6fa16c988f5da33
              cni.projectcalico.org/podIP: 20.111.156.124/32
              cni.projectcalico.org/podIPs: 20.111.156.124/32
Status:       Running
IP:           20.111.156.124
IPs:
  IP:           20.111.156.124
Controlled By:  ReplicaSet/longhorn-ui-6d887468fd
Containers:
  longhorn-ui:
    Container ID:   docker://a7e4a683d43171e38503fb7998a7b0ba8f441a7d8933cd1e27c15b775699708d
    Image:          longhornio/longhorn-ui:master-head
    Image ID:       docker-pullable://longhornio/longhorn-ui@sha256:d9a208d3aaad41e99f86f4f570d8c1da5173fe4fb6f0273672f8c150ba76e66b
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Sat, 29 Apr 2023 04:08:04 +0000
    Last State:     Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Tue, 25 Apr 2023 14:40:11 +0000
      Finished:     Tue, 25 Apr 2023 15:07:20 +0000
    Ready:          True
    Restart Count:  1
    Environment:
      LONGHORN_MANAGER_IP:  http://longhorn-backend:9500
    Mounts:
      /var/cache/nginx/ from nginx-cache (rw)
      /var/config/nginx/ from nginx-config (rw)
      /var/run/ from var-run (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-v2q2n (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  nginx-cache:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:     
    SizeLimit:  <unset>
  nginx-config:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:     
    SizeLimit:  <unset>
  var-run:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:     
    SizeLimit:  <unset>
  kube-api-access-v2q2n:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason          Age                   From               Message
  ----    ------          ----                  ----               -------
  Normal  Scheduled       3d13h                 default-scheduler  Successfully assigned longhorn-system/longhorn-ui-6d887468fd-kzb6j to k8s-node1
  Normal  Pulling         3d13h                 kubelet            Pulling image "longhornio/longhorn-ui:master-head"
  Normal  Pulled          3d13h                 kubelet            Successfully pulled image "longhornio/longhorn-ui:master-head" in 35.621554496s
  Normal  Created         3d13h                 kubelet            Created container longhorn-ui
  Normal  Started         3d13h                 kubelet            Started container longhorn-ui
  Normal  SandboxChanged  8m2s (x3 over 9m46s)  kubelet            Pod sandbox changed, it will be killed and re-created.
  Normal  Pulled          7m55s                 kubelet            Container image "longhornio/longhorn-ui:master-head" already present on machine
  Normal  Created         7m54s                 kubelet            Created container longhorn-ui
  Normal  Started         7m54s                 kubelet            Started container longhorn-ui