Getting "in-process.invalid." when accessing variables which exists #52576

ibardarov-fms · 2025-06-30T15:15:15Z

ibardarov-fms
Jun 30, 2025

Hello,
What is the reason I am getting those INFO messages? Why it is code 200 if it is in-process.invalid - is this real problem or just warning masked as INFO ?

dag-processor | [2025-06-30T18:09:28.910+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/airflow_base_url "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:28.920+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/airflow_base_url "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.402+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ecr_aws_account "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.412+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ecr_aws_region_name "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.422+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/environment "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.430+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/aws_region_name "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.439+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/releases_to_keep "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.443+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ecr_aws_account "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.452+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ANOTHER_VARIABLE5 "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.457+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ecr_aws_region_name "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.465+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./connections/ANOTHER_VARIABLE4 "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.470+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/environment "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.478+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ANOTHER_VARIABLE "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.481+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/aws_region_name "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.490+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./connections/snowflake_development "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.494+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/releases_to_keep "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.503+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./connections/ANOTHER_VARIABLE2 "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.507+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ANOTHER_VARIABLE5 "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.514+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.519+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./connections/ANOTHER_VARIABLE4 "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.527+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.530+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ANOTHER_VARIABLE "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.539+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.543+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./connections/snowflake_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.552+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.555+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.563+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.566+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.575+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.578+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.587+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.590+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.598+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.602+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.610+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.613+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.622+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.626+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.634+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.638+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.646+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.650+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.659+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.662+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.671+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.674+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.683+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.687+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.694+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.698+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.706+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.710+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.719+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.729+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.756+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/insights_release_test "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.842+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/airflow_base_url "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:30.919+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/airflow_base_url "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.465+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/environment "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.480+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/airflow_base_url "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.489+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ecr_aws_account "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.498+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ecr_aws_region_name "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.507+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/environment "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.515+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/aws_region_name "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.523+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/releases_to_keep "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.532+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ANOTHER_VARIABLE5 "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.543+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./connections/ANOTHER_VARIABLE4 "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.552+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/ANOTHER_VARIABLE "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.562+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./connections/ANOTHER_VARIABLE1 "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.571+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./connections/ANOTHER_VARIABLE2 "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.580+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.600+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.613+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.622+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.632+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.641+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.663+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.674+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.682+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.690+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.698+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.702+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/airflow_base_url "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.712+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.723+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.732+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.743+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.752+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"
dag-processor | [2025-06-30T18:09:32.762+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/VARIABLE_NAME "HTTP/1.1 200 OK"

ibardarov-fms · 2025-07-01T15:49:58Z

ibardarov-fms
Jul 1, 2025
Author

The message dag-processor | [2025-07-01T18:29:21.447+0300] {_client.py:1025} INFO - HTTP Request: GET http://in-process.invalid./variables/mmmmmm "HTTP/1.1 200 OK" is
normal and not an error. Here's a breakdown of why it appears:

Internal Communication: The Airflow DAG processor uses an internal, in-memory API server to efficiently fetch information like variables and connections without making actual
network calls.
"in-process.invalid" URL: To communicate with this internal server, the code uses the special URL http://in-process.invalid. This is a reserved, non-routable domain name,
ensuring that the request is handled internally and never sent to the external network.
INFO Level Logging: The HTTP client library that Airflow uses for this internal communication logs all requests at the INFO level by default. This is why you see the "INFO"
message.

In short, the log entry is simply a record of the DAG processor successfully fetching the insights_release variable from its internal cache. The "invalid" in the URL is
intentional and indicates that the request was handled within the Airflow process itself.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Getting "in-process.invalid." when accessing variables which exists #52576

Uh oh!

{{title}}

Uh oh!

Replies: 1 comment

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Getting "in-process.invalid." when accessing variables which exists #52576

Uh oh!

ibardarov-fms Jun 30, 2025

Replies: 1 comment

Uh oh!

ibardarov-fms Jul 1, 2025 Author

ibardarov-fms
Jun 30, 2025

ibardarov-fms
Jul 1, 2025
Author