docker-compose up 이후 웹서버가 뜨지 않습니다

Question

안녕하세요

도커&에어플로우 설치 부분 강사님 강의보며 실습하던 중에 크롬창에서 웹서버 접속이 되지 않아 문의드립니다.

환경은 mac os 입니다.

sudo docker-compose up airflow-init

sudo docker-compose up

명령어 사용해서 진행했습니다.

로그 중에 permission denied가 나는 부분이 있는데 이 부분 때문일까요?

airflow-init-1  | chown: changing ownership of '/sources/logs': Permission denied
airflow-init-1  | chown: changing ownership of '/sources/dags': Permission denied
airflow-init-1  | chown: changing ownership of '/sources/plugins': Permission denied

로그 전문 공유드립니다.

(airflow-dockercompose)  jeremy 😹   ~/dev/airflow-dockercompose  sudo docker-compose up airflow-init
Password:
[+] Running 44/3
 ✔ postgres 13 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                         72.8s
 ✔ redis 6 layers [⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                                    84.6s
 ✔ airflow-init 22 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                            68.5s
[+] Running 3/3
 ✔ Container airflow-dockercompose-redis-1         Created                                                                                                            0.3s
 ✔ Container airflow-dockercompose-postgres-1      Created                                                                                                            0.3s
 ✔ Container airflow-dockercompose-airflow-init-1  Created                                                                                                            0.0s
Attaching to airflow-init-1
airflow-init-1  | chown: changing ownership of '/sources/logs': Permission denied
airflow-init-1  | chown: changing ownership of '/sources/dags': Permission denied
airflow-init-1  | chown: changing ownership of '/sources/plugins': Permission denied
airflow-init-1  | The container is run as root user. For security, consider using a regular user account.
airflow-init-1  |
airflow-init-1  | DB: postgresql+psycopg2://airflow:***@postgres/airflow
airflow-init-1  | Performing upgrade to the metadata database postgresql+psycopg2://airflow:***@postgres/airflow
airflow-init-1  | [2024-02-13T12:36:11.330+0000] {migration.py:216} INFO - Context impl PostgresqlImpl.
airflow-init-1  | [2024-02-13T12:36:11.332+0000] {migration.py:219} INFO - Will assume transactional DDL.
airflow-init-1  | [2024-02-13T12:36:11.344+0000] {db.py:1616} INFO - Creating tables
airflow-init-1  | INFO  [alembic.runtime.migration] Context impl PostgresqlImpl.
airflow-init-1  | INFO  [alembic.runtime.migration] Will assume transactional DDL.
airflow-init-1  | OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k
airflow-init-1  | Database migrating done!
airflow-init-1  | /home/airflow/.local/lib/python3.8/site-packages/flask_limiter/extension.py:336 UserWarning: Using the in-memory storage for tracking rate limits as no storage was explicitly specified. This is not recommended for production use. See: https://flask-limiter.readthedocs.io#configuring-a-storage-backend for documentation about configuring the storage backend.
airflow-init-1  | OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k
airflow-init-1  | airflow already exist in the db
airflow-init-1  | 2.8.1
airflow-init-1 exited with code 0
(airflow-dockercompose)  jeremy 😹   ~/dev/airflow-dockercompose  sudo docker-compose up
[+] Running 7/7
 ✔ Container airflow-dockercompose-postgres-1           Running                                                                                                       0.0s
 ✔ Container airflow-dockercompose-redis-1              Running                                                                                                       0.0s
 ✔ Container airflow-dockercompose-airflow-init-1       Created                                                                                                       0.0s
 ✔ Container airflow-dockercompose-airflow-worker-1     Created                                                                                                       0.1s
 ✔ Container airflow-dockercompose-airflow-scheduler-1  Created                                                                                                       0.1s
 ✔ Container airflow-dockercompose-airflow-triggerer-1  Created                                                                                                       0.1s
 ✔ Container airflow-dockercompose-airflow-webserver-1  Created                                                                                                       0.1s
Attaching to airflow-init-1, airflow-scheduler-1, airflow-triggerer-1, airflow-webserver-1, airflow-worker-1, postgres-1, redis-1
airflow-init-1       | chown: changing ownership of '/sources/logs': Permission denied
airflow-init-1       | chown: changing ownership of '/sources/dags': Permission denied
airflow-init-1       | chown: changing ownership of '/sources/plugins': Permission denied
airflow-init-1       | The container is run as root user. For security, consider using a regular user account.
airflow-init-1       |
airflow-init-1       | DB: postgresql+psycopg2://airflow:***@postgres/airflow
airflow-init-1       | Performing upgrade to the metadata database postgresql+psycopg2://airflow:***@postgres/airflow
airflow-init-1       | [2024-02-13T12:37:00.495+0000] {migration.py:216} INFO - Context impl PostgresqlImpl.
airflow-init-1       | [2024-02-13T12:37:00.496+0000] {migration.py:219} INFO - Will assume transactional DDL.
airflow-init-1       | [2024-02-13T12:37:00.509+0000] {db.py:1616} INFO - Creating tables
airflow-init-1       | INFO  [alembic.runtime.migration] Context impl PostgresqlImpl.
airflow-init-1       | INFO  [alembic.runtime.migration] Will assume transactional DDL.
airflow-init-1       | OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k
airflow-init-1       | Database migrating done!
airflow-init-1       | /home/airflow/.local/lib/python3.8/site-packages/flask_limiter/extension.py:336 UserWarning: Using the in-memory storage for tracking rate limits as no storage was explicitly specified. This is not recommended for production use. See: https://flask-limiter.readthedocs.io#configuring-a-storage-backend for documentation about configuring the storage backend.
airflow-init-1       | OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k
airflow-init-1       | airflow already exist in the db
airflow-init-1       | 2.8.1
airflow-init-1 exited with code 0
airflow-triggerer-1  |
airflow-worker-1     |
airflow-webserver-1  |
airflow-scheduler-1  |
airflow-webserver-1  | [2024-02-13T12:37:28.080+0000] {configuration.py:2065} INFO - Creating new FAB webserver config file in: /opt/airflow/webserver_config.py
airflow-triggerer-1  |   ____________       _____________
airflow-triggerer-1  |  ____    |__( )_________  __/__  /________      __
airflow-triggerer-1  | ____  /| |_  /__  ___/_  /_ __  /_  __ \_ | /| / /
airflow-triggerer-1  | ___  ___ |  / _  /   _  __/ _  / / /_/ /_ |/ |/ /
airflow-triggerer-1  |  _/_/  |_/_/  /_/    /_/    /_/  \____/____/|__/

Answer

airflow-scheduler-1  | [2024-02-13T12:37:38.821+0000] {task_context_logger.py:63} INFO - Task context logging is enabled airflow-scheduler-1  | [2024-02-13T12:37:38.822+0000] {executor_loader.py:115} INFO - Loaded executor: CeleryExecutor airflow-scheduler-1  | [2024-02-13T12:37:39.321+0000] {scheduler_job_runner.py:808} INFO - Starting the scheduler airflow-scheduler-1  | [2024-02-13T12:37:39.337+0000] {scheduler_job_runner.py:815} INFO - Processing each file at most -1 times airflow-scheduler-1  | [2024-02-13T12:37:39.343+0000] {manager.py:169} INFO - Launched DagFileProcessorManager with pid: 28 airflow-scheduler-1  | [2024-02-13T12:37:39.345+0000] {scheduler_job_runner.py:1619} INFO - Adopting or resetting orphaned tasks for active dag runs airflow-scheduler-1  | [2024-02-13T12:37:39.361+0000] {settings.py:60} INFO - Configured default timezone UTC airflow-worker-1     | OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k airflow-worker-1     | airflow-worker-1     |  -------------- celery@4f4dfc593d9d v5.3.6 (emerald-rush) airflow-worker-1     | --- ***** ----- airflow-worker-1     | -- ******* ---- Linux-5.15.96-0-virt-x86_64-with-glibc2.34 2024-02-13 12:37:40 airflow-worker-1     | - *** --- * --- airflow-worker-1     | - ** ---------- [config] airflow-worker-1     | - ** ---------- .> app:         airflow.providers.celery.executors.celery_executor:0x7ff49d2ff640 airflow-worker-1     | - ** ---------- .> transport:   redis://redis:6379/0 airflow-worker-1     | - ** ---------- .> results:     postgresql://airflow:**@postgres/airflow airflow-worker-1     | - *** --- * --- .> concurrency: 16 (prefork) airflow-worker-1     | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) airflow-worker-1     | --- ***** ----- airflow-worker-1     |  -------------- [queues] airflow-worker-1     |                 .> default          exchange=default(direct) key=default airflow-worker-1     | airflow-worker-1     | airflow-worker-1     | [tasks] airflow-worker-1     |   . airflow.providers.celery.executors.celery_executor_utils.execute_command airflow-worker-1     | airflow-triggerer-1  | [2024-02-13T12:37:46.699+0000] {triggerer_job_runner.py:576} INFO - Triggerer's async thread was blocked for 0.20 seconds, likely by a badly-written trigger. Set PYTHONASYNCIODEBUG=1 to get more information on overrunning coroutines. airflow-worker-1     | [2024-02-13 12:37:52,175: WARNING/MainProcess] /home/airflow/.local/lib/python3.8/site-packages/celery/worker/consumer/consumer.py:507: CPendingDeprecationWarning: The broker_connection_retry configuration setting will no longer determine airflow-worker-1     | whether broker connection retries are made during startup in Celery 6.0 and above. airflow-worker-1     | If you wish to retain the existing behavior for retrying connections on startup, airflow-worker-1     | you should set broker_connection_retry_on_startup to True. airflow-worker-1     |   warnings.warn( airflow-worker-1     | airflow-worker-1     | [2024-02-13 12:37:52,258: INFO/MainProcess] Connected to redis://redis:6379/0 airflow-worker-1     | [2024-02-13 12:37:52,259: WARNING/MainProcess] /home/airflow/.local/lib/python3.8/site-packages/celery/worker/consumer/consumer.py:507: CPendingDeprecationWarning: The broker_connection_retry configuration setting will no longer determine airflow-worker-1     | whether broker connection retries are made during startup in Celery 6.0 and above. airflow-worker-1     | If you wish to retain the existing behavior for retrying connections on startup, airflow-worker-1     | you should set broker_connection_retry_on_startup to True. airflow-worker-1     |   warnings.warn( airflow-worker-1     | airflow-webserver-1  | [2024-02-13T12:37:52.263+0000] {providers_manager.py:280} INFO - Optional provider feature disabled when importing 'airflow.providers.google.leveldb.hooks.leveldb.LevelDBHook' from 'apache-airflow-providers-google' package airflow-worker-1     | [2024-02-13 12:37:52,268: INFO/MainProcess] mingle: searching for neighbors airflow-worker-1     | [2024-02-13 12:37:53,308: INFO/MainProcess] mingle: all alone airflow-worker-1     | [2024-02-13 12:37:53,441: INFO/MainProcess] celery@4f4dfc593d9d ready. airflow-webserver-1  | [2024-02-13 12:37:57 +0000] [16] [INFO] Listening at: http://0.0.0.0:8080 (16) airflow-webserver-1  | [2024-02-13 12:37:57 +0000] [16] [INFO] Using worker: sync airflow-webserver-1  | [2024-02-13 12:37:57 +0000] [27] [INFO] Booting worker with pid: 27 airflow-webserver-1  | [2024-02-13 12:37:57 +0000] [28] [INFO] Booting worker with pid: 28 airflow-webserver-1  | [2024-02-13 12:37:57 +0000] [29] [INFO] Booting worker with pid: 29 airflow-webserver-1  | [2024-02-13 12:37:57 +0000] [30] [INFO] Booting worker with pid: 30 airflow-webserver-1  | 127.0.0.1 - - [13/Feb/2024:12:38:11 +0000] 'GET /health HTTP/1.1' 200 318 '-' 'curl/7.88.1' airflow-triggerer-1  | [2024-02-13T12:38:30.979+0000] {triggerer_job_runner.py:481} INFO - 0 triggers currently running airflow-webserver-1  | 127.0.0.1 - - [13/Feb/2024:12:38:41 +0000] 'GET /health HTTP/1.1' 200 318 '-' 'curl/7.88.1' airflow-webserver-1  | 127.0.0.1 - - [13/Feb/2024:12:39:11 +0000] 'GET /health HTTP/1.1' 200 318 '-' 'curl/7.88.1' airflow-triggerer-1  | [2024-02-13T12:39:31.176+0000] {triggerer_job_runner.py:481} INFO - 0 triggers currently running airflow-webserver-1  | 127.0.0.1 - - [13/Feb/2024:12:39:41 +0000] 'GET /health HTTP/1.1' 200 318 '-' 'curl/7.88.1' airflow-webserver-1  | 127.0.0.1 - - [13/Feb/2024:12:40:12 +0000] 'GET /health HTTP/1.1' 200 318 '-' 'curl/7.88.1' airflow-triggerer-1  | [2024-02-13T12:40:31.368+0000] {triggerer_job_runner.py:481} INFO - 0 triggers currently running airflow-webserver-1  | 127.0.0.1 - - [13/Feb/2024:12:40:42 +0000] 'GET /health HTTP/1.1' 200 318 '-' 'curl/7.88.1' airflow-webserver-1  | 127.0.0.1 - - [13/Feb/2024:12:41:12 +0000] 'GET /health HTTP/1.1' 200 318 '-' 'curl/7.88.1' airflow-triggerer-1  | [2024-02-13T12:41:31.550+0000] {triggerer_job_runner.py:481} INFO - 0 triggers currently running airflow-webserver-1  | 127.0.0.1 - - [13/Feb/2024:12:41:42 +0000] 'GET /health HTTP/1.1' 200 318 '-' 'curl/7.88.1' airflow-webserver-1  | 127.0.0.1 - - [13/Feb/2024:12:42:12 +0000] 'GET /health HTTP/1.1' 200 318 '-' 'curl/7.88.1' airflow-triggerer-1  | [2024-02-13T12:42:31.748+0000] {triggerer_job_runner.py:481} INFO - 0 triggers currently running

Answer

10000자 제한이 있어 답글로 나머지 로그 공유드려요airflow-triggerer-1 | [2024-02-13 12:37:29 +0000] [15] [INFO] Starting gunicorn 21.2.0 airflow-triggerer-1 | [2024-02-13 12:37:29 +0000] [15] [INFO] Listening at: http://[::]:8794 (15) airflow-triggerer-1 | [2024-02-13 12:37:29 +0000] [15] [INFO] Using worker: sync airflow-triggerer-1 | [2024-02-13 12:37:29 +0000] [16] [INFO] Booting worker with pid: 16 airflow-triggerer-1 | [2024-02-13 12:37:29 +0000] [17] [INFO] Booting worker with pid: 17 airflow-triggerer-1 | OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k airflow-triggerer-1 | [2024-02-13T12:37:30.689+0000] {triggerer_job_runner.py:174} INFO - Setting up TriggererHandlerWrapper with handler airflow-triggerer-1 | [2024-02-13T12:37:30.700+0000] {triggerer_job_runner.py:230} INFO - Setting up logging queue listener with handlers [ (NOTSET)>, ] airflow-triggerer-1 | [2024-02-13T12:37:30.726+0000] {triggerer_job_runner.py:331} INFO - Starting the triggerer airflow-webserver-1 | /home/airflow/.local/lib/python3.8/site-packages/flask_limiter/extension.py:336 UserWarning: Using the in-memory storage for tracking rate limits as no storage was explicitly specified. This is not recommended for production use. See: https://flask-limiter.readthedocs.io#configuring-a-storage-backend for documentation about configuring the storage backend. airflow-worker-1 | BACKEND=redis airflow-worker-1 | DB_HOST=redis airflow-worker-1 | DB_PORT=6379 airflow-worker-1 | airflow-scheduler-1 | BACKEND=redis airflow-scheduler-1 | DB_HOST=redis airflow-scheduler-1 | DB_PORT=6379 airflow-scheduler-1 | airflow-webserver-1 | OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k airflow-worker-1 | [2024-02-13T12:37:36.823+0000] {configuration.py:2065} INFO - Creating new FAB webserver config file in: /opt/airflow/webserver_config.py airflow-webserver-1 | [2024-02-13T12:37:37.571+0000] {options.py:83} WARNING - The swagger_ui directory could not be found. airflow-webserver-1 | Please install connexion with extra install: pip install connexion[swagger-ui] airflow-webserver-1 | or provide the path to your local installation by passing swagger_path= airflow-webserver-1 | airflow-webserver-1 | [2024-02-13T12:37:37.577+0000] {options.py:83} WARNING - The swagger_ui directory could not be found. airflow-webserver-1 | Please install connexion with extra install: pip install connexion[swagger-ui] airflow-webserver-1 | or provide the path to your local installation by passing swagger_path= airflow-webserver-1 | airflow-webserver-1 | [2024-02-13 12:37:37 +0000] [16] [INFO] Starting gunicorn 21.2.0 airflow-scheduler-1 | OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k airflow-worker-1 | [2024-02-13 12:37:38 +0000] [26] [INFO] Starting gunicorn 21.2.0 airflow-worker-1 | [2024-02-13 12:37:38 +0000] [26] [INFO] Listening at: http://[::]:8793 (26) airflow-worker-1 | [2024-02-13 12:37:38 +0000] [26] [INFO] Using worker: sync airflow-worker-1 | [2024-02-13 12:37:38 +0000] [27] [INFO] Booting worker with pid: 27 airflow-worker-1 | [2024-02-13 12:37:38 +0000] [28] [INFO] Booting worker with pid: 28 airflow-scheduler-1 | ____________ _____________ airflow-scheduler-1 | ____ |__( )_________ __/__ /________ __ airflow-scheduler-1 | ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / airflow-scheduler-1 | ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / airflow-scheduler-1 | _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/

신윤철

docker-compose up 이후 웹서버가 뜨지 않습니다

이 글과 비슷한 Q&A

3회 기출유형(작업형2)

predict, predict_proba 차이

RootModel에 대한 질문

lst = lst50 + lst100 이거 대신에