[2022-02-19 15:53:02.623] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.3.1-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2022-02-19 15:53:02.623] [local ee] [info] initializing LLVM backend
[2022-02-19 15:53:02.623] [local ee] [warning] init JIT compiler also only in local mode
[2022-02-19 15:53:02.623] [LLVM] [info] compiling code for skylake-avx512
[2022-02-19 15:53:02.623] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.624] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.624] [E/1] [info] starting detached process queue
[2022-02-19 15:53:02.624] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.624] [E/2] [info] starting detached process queue
[2022-02-19 15:53:02.624] [E/1] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.624] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.624] [E/2] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.624] [E/3] [info] starting detached process queue
[2022-02-19 15:53:02.624] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.624] [E/4] [info] starting detached process queue
[2022-02-19 15:53:02.624] [E/3] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.624] [E/4] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.624] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.624] [E/5] [info] starting detached process queue
[2022-02-19 15:53:02.624] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.624] [E/5] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.624] [E/6] [info] starting detached process queue
[2022-02-19 15:53:02.624] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.624] [E/7] [info] starting detached process queue
[2022-02-19 15:53:02.624] [E/6] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.624] [E/7] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.624] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.624] [E/8] [info] starting detached process queue
[2022-02-19 15:53:02.624] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.624] [E/8] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.625] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.625] [E/9] [info] starting detached process queue
[2022-02-19 15:53:02.625] [E/10] [info] starting detached process queue
[2022-02-19 15:53:02.625] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.625] [E/9] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.625] [E/11] [info] starting detached process queue
[2022-02-19 15:53:02.625] [E/10] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.625] [E/11] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.625] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.625] [E/12] [info] starting detached process queue
[2022-02-19 15:53:02.625] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.625] [E/12] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.625] [E/13] [info] starting detached process queue
[2022-02-19 15:53:02.625] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.625] [E/14] [info] starting detached process queue
[2022-02-19 15:53:02.625] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.625] [E/14] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.625] [E/13] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.625] [E/15] [info] starting detached process queue
[2022-02-19 15:53:02.625] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2022-02-19 15:53:02.625] [E/15] [info] initialized runtime memory (4.00 MB)
[2022-02-19 15:53:02.625] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
[2022-02-19 15:53:02.625] [fileinputoperator] [info] found 1 file (1.57 GB) to process.
[2022-02-19 15:53:02.625] [global] [info] sampled file:///data/tpch/q19_preprocessed/lineitem-sf-10.tbl on 256.00 KB
[2022-02-19 15:53:02.798] [fileinputoperator] [info] found 1 file (30.54 MB) to process.
[2022-02-19 15:53:02.799] [global] [info] sampled file:///data/tpch/q19_preprocessed/part-sf-10.tbl on 256.00 KB
[2022-02-19 15:53:03.078] [global] [info] combiner output-schema is: (f64)
[2022-02-19 15:53:03.078] [global] [info] aggregator output-schema is: (f64)
[2022-02-19 15:53:03.078] [global] [info] aggregate operator yields: (f64)
[2022-02-19 15:53:03.086] [global] [info] combiner output-schema is: (f64)
[2022-02-19 15:53:03.086] [global] [info] aggregator output-schema is: (f64)
[2022-02-19 15:53:03.086] [global] [info] aggregate operator yields: (f64)
[2022-02-19 15:53:03.094] [global] [info] combiner output-schema is: (f64)
[2022-02-19 15:53:03.094] [global] [info] aggregator output-schema is: (f64)
[2022-02-19 15:53:03.094] [global] [info] aggregate operator yields: (f64)
[2022-02-19 15:53:03.103] [global] [info] combiner output-schema is: (f64)
[2022-02-19 15:53:03.103] [global] [info] aggregator output-schema is: (f64)
[2022-02-19 15:53:03.103] [global] [info] aggregate operator yields: (f64)
[2022-02-19 15:53:03.657] [logical planner] [info] logical optimization took 0.571014ms
[2022-02-19 15:53:03.657] [codegen] [info] generating pipeline for (Option[i64],Option[i64],Option[i64],Option[i64]) -> (Option[i64],Option[i64],Option[i64],Option[i64]) (3 operators pipelined)
[2022-02-19 15:53:03.657] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[i64],Option[i64])) -> boolean
[2022-02-19 15:53:03.658] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[i64],Option[i64])) -> boolean
[2022-02-19 15:53:03.659] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[i64],Option[i64])) -> boolean
[2022-02-19 15:53:03.681] [codegen] [info] generating pipeline for (Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64]) -> (f64) (6 operators pipelined)
[2022-02-19 15:53:03.681] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> boolean
[2022-02-19 15:53:03.681] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> boolean
[2022-02-19 15:53:03.682] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> boolean
[2022-02-19 15:53:03.682] [codegen] [info] generating function Q19_filter_weld for ((Option[i64],Option[i64],Option[i64],Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> boolean
[2022-02-19 15:53:03.684] [codegen] [info] generating lambda function for (f64,f64) -> f64
[2022-02-19 15:53:03.684] [codegen] [info] generating lambda function for (f64,(Option[i64],Option[i64],Option[i64],Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> f64
[2022-02-19 15:53:03.709] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2022-02-19 15:53:03.710] [global] [info] retrieved metrics object
[2022-02-19 15:53:03.770] [global] [info] Optimization via LLVM passes took 0.060792 ms
[2022-02-19 15:53:03.770] [global] [info] starting code compilation
[2022-02-19 15:53:03.770] [global] [info] first compile done
[2022-02-19 15:53:03.799] [global] [info] functor Stage_0 retrieved from llvm
[2022-02-19 15:53:03.799] [global] [info] retrieving init/release stage functors
[2022-02-19 15:53:03.799] [global] [info] Compiled code paths for stage 0 in 0.03 ms
[2022-02-19 15:53:03.799] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0923825s
[2022-02-19 15:53:03.799] [local ee] [info] split /data/tpch/q19_preprocessed/part-sf-10.tbl into 1 task
[2022-02-19 15:53:04.130] [E/1] [info] [Task Finished] Transform to in-memory hash table in 0.330501s (21592 normal rows, 0 exceptions, 21592 buckets)
[2022-02-19 15:53:04.130] [global] [info] [Transform Stage] Stage 0 completed 1 load&transform tasks in 0.331151s
[2022-02-19 15:53:04.130] [global] [info] [Transform Stage] Stage 0 total wall clock time: 0.330501s, 2000000 input rows, time to process 1 row via fast path: 0.00016525ms
[2022-02-19 15:53:04.130] [global] [info] [Transform Stage] Stage 0 completed 1 sink tasks in 3.442e-06s
[2022-02-19 15:53:04.130] [global] [info] [Transform Stage] Stage 0 took 0.423569s
[2022-02-19 15:53:04.136] [global] [info] retrieved metrics object
[2022-02-19 15:53:04.235] [global] [info] Optimization via LLVM passes took 0.101025 ms
[2022-02-19 15:53:04.235] [global] [info] starting code compilation
[2022-02-19 15:53:04.235] [global] [info] first compile done
[2022-02-19 15:53:04.277] [global] [info] functor Stage_1 retrieved from llvm
[2022-02-19 15:53:04.277] [global] [info] retrieving init/release stage functors
[2022-02-19 15:53:04.277] [global] [info] Compiled code paths for stage 1 in 0.04 ms
[2022-02-19 15:53:04.277] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.146943s
[2022-02-19 15:53:04.278] [local ee] [info] split /data/tpch/q19_preprocessed/lineitem-sf-10.tbl into 25 tasks
[2022-02-19 15:53:04.822] [E/1] [info] [Task Finished] Transform to mem in 0.543965s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [driver] [info] [Task Finished] Transform to mem in 0.545918s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/15] [info] [Task Finished] Transform to mem in 0.546137s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/13] [info] [Task Finished] Transform to mem in 0.546180s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/12] [info] [Task Finished] Transform to mem in 0.546468s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/9] [info] [Task Finished] Transform to mem in 0.546480s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/8] [info] [Task Finished] Transform to mem in 0.546577s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/5] [info] [Task Finished] Transform to mem in 0.546601s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/14] [info] [Task Finished] Transform to mem in 0.546613s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/11] [info] [Task Finished] Transform to mem in 0.546625s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/3] [info] [Task Finished] Transform to mem in 0.546628s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/2] [info] [Task Finished] Transform to mem in 0.546663s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/10] [info] [Task Finished] Transform to mem in 0.546721s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.824] [E/4] [info] [Task Finished] Transform to mem in 0.546739s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.825] [E/7] [info] [Task Finished] Transform to mem in 0.547145s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:04.825] [E/6] [info] [Task Finished] Transform to mem in 0.547848s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.365] [E/1] [info] [Task Finished] Transform to mem in 0.543095s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.367] [driver] [info] [Task Finished] Transform to mem in 0.543045s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.367] [E/15] [info] [Task Finished] Transform to mem in 0.543042s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.367] [E/13] [info] [Task Finished] Transform to mem in 0.543120s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.367] [E/8] [info] [Task Finished] Transform to mem in 0.543115s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.367] [E/9] [info] [Task Finished] Transform to mem in 0.543335s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.368] [E/12] [info] [Task Finished] Transform to mem in 0.543451s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.368] [E/5] [info] [Task Finished] Transform to mem in 0.543346s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.448] [E/14] [info] [Task Finished] Transform to mem in 0.624205s (0 normal rows, 0 exceptions)
[2022-02-19 15:53:05.448] [global] [info] [Transform Stage] Stage 1 completed 25 load&transform tasks in 1.17099s
[2022-02-19 15:53:05.448] [global] [info] [Transform Stage] Stage 1 total wall clock time: 13.7131s, 59986052 input rows, time to process 1 row via fast path: 0.000228604ms
[2022-02-19 15:53:05.449] [global] [info] [Transform Stage] Stage 1 completed 25 sink tasks in 3.5137e-05s
[2022-02-19 15:53:05.449] [global] [info] [Transform Stage] Stage 1 took 1.31802s
[2022-02-19 15:53:05.449] [global] [info] [Transform Stage] skipped stage 2 because there is nothing todo here.
[2022-02-19 15:53:05.449] [global] [info] Query Execution took 2.3701s. (planning: 0.628445s, execution: 1.74165s)
[2022-02-19 15:53:05.454] [python] [info] Data transfer back to Python took 0.000024 seconds
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.3.1
            |_|
    
using Python 3.6.9 (default, Feb  8 2022, 16:30:43) 
[GCC 9.3.0] on linux
end-to-end took: 2.8380281925201416s
Result::
[30104438.091100004]
framework,version,load,query,result
tuplex,0.1.6,0,2.8380281925201416,[30104438.091100004]
[2022-02-19 15:53:05.469] [local execution engine] [info] Stopped local executor E/1
[2022-02-19 15:53:05.469] [local execution engine] [info] Stopped local executor E/2
[2022-02-19 15:53:05.470] [local execution engine] [info] Stopped local executor E/3
[2022-02-19 15:53:05.470] [local execution engine] [info] Stopped local executor E/4
[2022-02-19 15:53:05.470] [local execution engine] [info] Stopped local executor E/5
[2022-02-19 15:53:05.471] [local execution engine] [info] Stopped local executor E/6
[2022-02-19 15:53:05.471] [local execution engine] [info] Stopped local executor E/7
[2022-02-19 15:53:05.471] [local execution engine] [info] Stopped local executor E/8
[2022-02-19 15:53:05.472] [local execution engine] [info] Stopped local executor E/9
[2022-02-19 15:53:05.472] [local execution engine] [info] Stopped local executor E/10
[2022-02-19 15:53:05.472] [local execution engine] [info] Stopped local executor E/11
[2022-02-19 15:53:05.473] [local execution engine] [info] Stopped local executor E/12
[2022-02-19 15:53:05.473] [local execution engine] [info] Stopped local executor E/13
[2022-02-19 15:53:05.473] [local execution engine] [info] Stopped local executor E/14
[2022-02-19 15:53:05.473] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 2 active partitions
