-
Notifications
You must be signed in to change notification settings - Fork 7.5k
Closed
Labels
potential bugTo be reviewed by developers and confirmed/rejected.To be reviewed by developers and confirmed/rejected.🍃 green ci 🌿Fixing flaky tests in CIFixing flaky tests in CI
Description
Describe the bug
Happened on master six times since first occurrence on first of July 2025 on any of the stress tests.
How to reproduce
No response
Error message and/or stacktrace
[ 61054 ] {1971f1f4-553f-4587-b012-5ef73c1cebb2} <Fatal> : Logical error: \'ReadBuffer is canceled. Can\'t read from it.\'.
[ 61054 ] {1971f1f4-553f-4587-b012-5ef73c1cebb2} <Fatal> : Stack trace (when copying this message, always include the lines below):
[ 166687 ] {} <Fatal> BaseDaemon: ########## Short fault info ############
[ 166687 ] {} <Fatal> BaseDaemon: (version 25.7.1.3652 (official build), build id: A0E0B32C697D53E2D75E3088824F3B58DDF71C0A, git hash: 8ff2f02e58c8bd7cffe840cba37112dfb52325a0, architecture: x86_64) (from thread 61054) Received signal 6
[ 166687 ] {} <Fatal> BaseDaemon: Signal description: Aborted
[ 166687 ] {} <Fatal> BaseDaemon:
[ 166687 ] {} <Fatal> BaseDaemon: Stack trace: 0x00007f22396b89fd 0x00007f2239664476 0x00007f223964a7f3 0x000055eb341d36dd 0x000055eb341d3a2c 0x000055eb2d312d82 0x000055eb3e29dc5e 0x000055eb3e292d40 0x000055eb3e2879c3 0x000055eb3e2a0d84 0x000055eb4611d487 0x000055eb4611d985 0x000055eb460c5f5f 0x000055eb460c3af1 0x00007f22396b6ac3 0x00007f2239748850
[ 166687 ] {} <Fatal> BaseDaemon: ########################################
[ 166687 ] {} <Fatal> BaseDaemon: (version 25.7.1.3652 (official build), build id: A0E0B32C697D53E2D75E3088824F3B58DDF71C0A, git hash: 8ff2f02e58c8bd7cffe840cba37112dfb52325a0) (from thread 61054) (query_id: 1971f1f4-553f-4587-b012-5ef73c1cebb2) (query: SELECT `__table1`.`_part_granule_offset` AS `_part_granule_offset` FROM `test_9`.`test_part_granule_offset` AS `__table1` WHERE `__table1`.`n` < 10 ORDER BY `__table1`.`_part_granule_offset` ASC) Received signal Aborted (6)
[ 166687 ] {} <Fatal> BaseDaemon:
[ 166687 ] {} <Fatal> BaseDaemon: Stack trace: 0x00007f22396b89fd 0x00007f2239664476 0x00007f223964a7f3 0x000055eb341d36dd 0x000055eb341d3a2c 0x000055eb2d312d82 0x000055eb3e29dc5e 0x000055eb3e292d40 0x000055eb3e2879c3 0x000055eb3e2a0d84 0x000055eb4611d487 0x000055eb4611d985 0x000055eb460c5f5f 0x000055eb460c3af1 0x00007f22396b6ac3 0x00007f2239748850
[ 166687 ] {} <Fatal> BaseDaemon: 3. ? @ 0x00000000000969fd
[ 166687 ] {} <Fatal> BaseDaemon: 4. ? @ 0x0000000000042476
[ 166687 ] {} <Fatal> BaseDaemon: 5. ? @ 0x00000000000287f3
[ 166687 ] {} <Fatal> BaseDaemon: 6. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/src/Common/Exception.cpp:50: DB::abortOnFailedAssertion(String const&, void* const*, unsigned long, unsigned long) @ 0x0000000013d596dd
[ 166687 ] {} <Fatal> BaseDaemon: 7. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/src/Common/Exception.cpp:56: ? @ 0x0000000013d59a2c
[ 166687 ] {} <Fatal> BaseDaemon: 8. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/src/IO/ReadBuffer.h:58: DB::ReadBuffer::next() @ 0x000000000ce98d82
[ 166687 ] {} <Fatal> BaseDaemon: 9.0. inlined from /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/src/IO/ReadBuffer.h:114: DB::ReadBuffer::eof()
[ 166687 ] {} <Fatal> BaseDaemon: 9. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/src/Server/TCPHandler.cpp:2525: DB::TCPHandler::receivePacketsExpectCancel(DB::QueryState&) @ 0x000000001de23c5e
[ 166687 ] {} <Fatal> BaseDaemon: 10. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/src/Server/TCPHandler.cpp:1305: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001de18d40
[ 166687 ] {} <Fatal> BaseDaemon: 11. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/src/Server/TCPHandler.cpp:737: DB::TCPHandler::runImpl() @ 0x000000001de0d9c3
[ 166687 ] {} <Fatal> BaseDaemon: 12. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/src/Server/TCPHandler.cpp:2730: DB::TCPHandler::run() @ 0x000000001de26d84
[ 166687 ] {} <Fatal> BaseDaemon: 13. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000025ca3487
[ 166687 ] {} <Fatal> BaseDaemon: 14. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000025ca3985
[ 166687 ] {} <Fatal> BaseDaemon: 15. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000025c4bf5f
[ 166687 ] {} <Fatal> BaseDaemon: 16. /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/base/poco/Foundation/src/Thread_POSIX.cpp:341: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000025c49af1
[ 166687 ] {} <Fatal> BaseDaemon: 17. ? @ 0x0000000000094ac3
[ 166687 ] {} <Fatal> BaseDaemon: 18. ? @ 0x0000000000126850
[ 166687 ] {} <Fatal> BaseDaemon: Integrity check of the executable successfully passed (checksum: 4C4CE21EBF6F9AA40EB10EC2712FB303)
[ 166687 ] {} <Fatal> BaseDaemon: Report this error to https://github.com/ClickHouse/ClickHouse/issues
[ 166687 ] {} <Fatal> BaseDaemon: Changed settings: min_compress_block_size = 2891115, max_compress_block_size = 2809065, min_external_table_block_size_bytes = 1, max_joined_block_size_rows = 42294, max_insert_threads = 1, max_threads = 32, max_read_buffer_size = 930214, connect_timeout_with_failover_ms = 2000, connect_timeout_with_failover_secure_ms = 3000, use_hedged_requests = false, idle_connection_timeout = 36000, s3_max_get_rps = 1000000, s3_max_get_burst = 2000000, s3_max_put_rps = 1000000, s3_max_put_burst = 2000000, s3_check_objects_after_upload = true, use_uncompressed_cache = true, max_remote_read_network_bandwidth = 1000000000000, max_remote_write_network_bandwidth = 1000000000000, max_local_read_bandwidth = 1000000000000, max_local_write_bandwidth = 1000000000000, stream_like_engine_allow_direct_select = true, enable_multiple_prewhere_read_steps = false, replication_wait_for_inactive_replica_timeout = 30, compile_expressions = false, compile_aggregate_expressions = false, min_count_to_compile_aggregate_expression = 0, group_by_two_level_threshold = 1, group_by_two_level_threshold_bytes = 21118288, distributed_aggregation_memory_efficient = false, allow_nonconst_timezone_arguments = true, group_by_use_nulls = true, input_format_parallel_parsing = false, min_chunk_bytes_for_parallel_parsing = 10799197, output_format_parallel_formatting = false, merge_tree_coarse_index_granularity = 17, min_bytes_to_use_direct_io = 1, min_bytes_to_use_mmap_io = 10737418240, secondary_indices_enable_bulk_filtering = false, log_queries = true, insert_quorum_timeout = 60000, table_function_remote_max_addresses = 200, merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability = 0.5899999737739563, http_wait_end_of_query = true, http_response_buffer_size = 517887, fsync_metadata = false, http_send_timeout = 60., http_receive_timeout = 60., use_index_for_in_with_subqueries_max_values = 1000000000, opentelemetry_start_trace_probability = 0.10000000149011612, enable_vertical_final = false, max_rows_to_read = 20000000, max_bytes_to_read = 1000000000000, max_bytes_to_read_leaf = 1000000000000, max_rows_to_group_by = 10000000000, max_bytes_ratio_before_external_group_by = 0., max_rows_to_sort = 10000000000, max_bytes_to_sort = 10000000000, prefer_external_sort_block_bytes = 0, max_bytes_before_external_sort = 6399833279, max_bytes_ratio_before_external_sort = 0., max_bytes_before_remerge_sort = 1944042785, max_result_rows = 1000000000, max_result_bytes = 1000000000, max_execution_time = 60., max_execution_speed = 100000000000, max_execution_speed_bytes = 10000000000000, timeout_before_checking_execution_speed = 300., max_estimated_execution_time = 600., max_columns_to_read = 20000, max_temporary_columns = 20000, max_temporary_non_const_columns = 20000, max_rows_in_set = 10000000000, max_bytes_in_set = 10000000000, max_rows_in_join = 1000, max_bytes_in_join = 10000000000, join_algorithm = \'auto\', cross_join_min_rows_to_compress = 100
[ 7612 ] {} <Fatal> Application: Child process was terminated by signal 6.
Metadata
Metadata
Assignees
Labels
potential bugTo be reviewed by developers and confirmed/rejected.To be reviewed by developers and confirmed/rejected.🍃 green ci 🌿Fixing flaky tests in CIFixing flaky tests in CI