[2021-03-30 22:31:43.821] [global] [error] could not find backend, defaulting to local
[2021-03-30 22:31:43.822] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-30 22:31:43.822] [local ee] [info] initializing LLVM backend
[2021-03-30 22:31:43.822] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-30 22:31:43.822] [LLVM] [info] compiling code for skylake-avx512
[2021-03-30 22:31:43.823] [memory] [info] allocated bitmap managed memory region (100.00 GB, 32.00 MB block size)
[2021-03-30 22:31:43.823] [local execution engine] [info] started driver (100.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-30 22:31:43.823] [fileinputoperator] [info] found 1 file (1.57 GB) to process.
[2021-03-30 22:31:43.823] [global] [info] sampled file:///data/tpch/q19/integer/lineitem.tbl on 256.00 KB
[2021-03-30 22:31:43.987] [fileinputoperator] [info] found 1 file (30.54 MB) to process.
[2021-03-30 22:31:43.987] [global] [info] sampled file:///data/tpch/q19/integer/part.tbl on 256.00 KB
[2021-03-30 22:31:44.203] [global] [info] combiner output-schema is: (f64)
[2021-03-30 22:31:44.203] [global] [info] aggregator output-schema is: (f64)
[2021-03-30 22:31:44.203] [global] [info] aggregate operator yields: (f64)
[2021-03-30 22:31:44.210] [global] [info] combiner output-schema is: (f64)
[2021-03-30 22:31:44.210] [global] [info] aggregator output-schema is: (f64)
[2021-03-30 22:31:44.210] [global] [info] aggregate operator yields: (f64)
[2021-03-30 22:31:44.219] [global] [info] combiner output-schema is: (f64)
[2021-03-30 22:31:44.219] [global] [info] aggregator output-schema is: (f64)
[2021-03-30 22:31:44.219] [global] [info] aggregate operator yields: (f64)
[2021-03-30 22:31:44.227] [global] [info] combiner output-schema is: (f64)
[2021-03-30 22:31:44.227] [global] [info] aggregator output-schema is: (f64)
[2021-03-30 22:31:44.227] [global] [info] aggregate operator yields: (f64)
[2021-03-30 22:31:44.752] [logical planner] [info] logical optimization took 0.541783ms
output type of specialized pipeline is: (Option[i64],Option[i64],Option[i64],Option[i64])
is this the most outer stage?: 0
need to upgrade output type to (Option[i64],Option[i64],Option[i64],Option[i64])
[2021-03-30 22:31:44.752] [codegen] [info] generating pipeline for (Option[i64],Option[i64],Option[i64],Option[i64]) -> (Option[i64],Option[i64],Option[i64],Option[i64]) (3 operators pipelined)
[2021-03-30 22:31:44.753] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[i64],Option[i64])) -> boolean
[2021-03-30 22:31:44.753] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[i64],Option[i64])) -> boolean
[2021-03-30 22:31:44.754] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[i64],Option[i64])) -> boolean
output type of specialized pipeline is: (f64)
is this the most outer stage?: 0
need to upgrade output type to (f64)
[2021-03-30 22:31:44.775] [codegen] [info] generating pipeline for (Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64]) -> (f64) (6 operators pipelined)
[2021-03-30 22:31:44.776] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> boolean
[2021-03-30 22:31:44.776] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> boolean
[2021-03-30 22:31:44.777] [codegen] [info] generating lambda function for ((Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> boolean
[2021-03-30 22:31:44.777] [codegen] [info] generating function Q19_filter_weld for ((Option[i64],Option[i64],Option[i64],Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> boolean
[2021-03-30 22:31:44.778] [codegen] [info] generating lambda function for (f64,f64) -> f64
[2021-03-30 22:31:44.779] [codegen] [info] generating lambda function for (f64,(Option[i64],Option[i64],Option[i64],Option[i64],Option[i64],Option[f64],Option[f64],Option[i64],Option[i64])) -> f64
[2021-03-30 22:31:44.801] [global] [info] Stage2 depends on: Stage1 
[2021-03-30 22:31:44.801] [global] [info] Stage1 depends on: Stage0 
[2021-03-30 22:31:44.801] [global] [info] Stage0 depends on: 
[2021-03-30 22:31:44.804] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2021-03-30 22:31:44.863] [global] [info] Optimization via LLVM passes took 0.059375 ms
[2021-03-30 22:31:44.891] [global] [info] Compiled code paths for stage 0 in 0.03 ms
[2021-03-30 22:31:44.891] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0902s
[2021-03-30 22:31:44.891] [local ee] [info] split /data/tpch/q19/integer/part.tbl into 1 task
[2021-03-30 22:31:45.193] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.301076s (21592 normal rows, 0 exceptions, 21592 buckets)
[2021-03-30 22:31:45.193] [global] [info] [Transform Stage] Stage 0 completed 1 load&transform tasks in 0.301604s
[2021-03-30 22:31:45.193] [global] [info] [Transform Stage] Stage 0 total wall clock time: 0.301076s, 2000000 input rows, time to process 1 row via fast path: 0.000150538ms
[2021-03-30 22:31:45.193] [global] [info] [Transform Stage] Stage 0 completed 1 sink tasks in 3.82e-06s
[2021-03-30 22:31:45.193] [global] [info] [Transform Stage] Stage 0 took 0.39183s
[2021-03-30 22:31:45.296] [global] [info] Optimization via LLVM passes took 0.098537 ms
[2021-03-30 22:31:45.336] [global] [info] Compiled code paths for stage 1 in 0.04 ms
[2021-03-30 22:31:45.337] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.143564s
[2021-03-30 22:31:45.337] [local ee] [info] split /data/tpch/q19/integer/lineitem.tbl into 25 tasks
[2021-03-30 22:31:45.884] [driver] [info] [Task Finished] Transform to mem in 0.547054s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:46.431] [driver] [info] [Task Finished] Transform to mem in 0.547233s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:46.978] [driver] [info] [Task Finished] Transform to mem in 0.546590s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:47.524] [driver] [info] [Task Finished] Transform to mem in 0.546699s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:48.071] [driver] [info] [Task Finished] Transform to mem in 0.546516s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:48.618] [driver] [info] [Task Finished] Transform to mem in 0.546742s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:49.164] [driver] [info] [Task Finished] Transform to mem in 0.546279s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:49.711] [driver] [info] [Task Finished] Transform to mem in 0.546794s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:50.257] [driver] [info] [Task Finished] Transform to mem in 0.546707s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:50.804] [driver] [info] [Task Finished] Transform to mem in 0.546703s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:51.351] [driver] [info] [Task Finished] Transform to mem in 0.546475s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:51.897] [driver] [info] [Task Finished] Transform to mem in 0.546434s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:52.443] [driver] [info] [Task Finished] Transform to mem in 0.546261s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:52.990] [driver] [info] [Task Finished] Transform to mem in 0.546353s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:53.536] [driver] [info] [Task Finished] Transform to mem in 0.546104s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:54.082] [driver] [info] [Task Finished] Transform to mem in 0.546580s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:54.629] [driver] [info] [Task Finished] Transform to mem in 0.546264s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:55.175] [driver] [info] [Task Finished] Transform to mem in 0.546402s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:55.721] [driver] [info] [Task Finished] Transform to mem in 0.546104s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:56.267] [driver] [info] [Task Finished] Transform to mem in 0.546112s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:56.813] [driver] [info] [Task Finished] Transform to mem in 0.546054s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:57.360] [driver] [info] [Task Finished] Transform to mem in 0.546125s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:57.906] [driver] [info] [Task Finished] Transform to mem in 0.546179s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:58.453] [driver] [info] [Task Finished] Transform to mem in 0.546828s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:59.081] [driver] [info] [Task Finished] Transform to mem in 0.628337s (0 normal rows, 0 exceptions)
[2021-03-30 22:31:59.081] [global] [info] [Transform Stage] Stage 1 completed 25 load&transform tasks in 13.7444s
[2021-03-30 22:31:59.081] [global] [info] [Transform Stage] Stage 1 total wall clock time: 13.7439s, 59986052 input rows, time to process 1 row via fast path: 0.000229119ms
[2021-03-30 22:31:59.081] [global] [info] [Transform Stage] Stage 1 completed 25 sink tasks in 3.0287e-05s
[2021-03-30 22:31:59.081] [global] [info] [Transform Stage] Stage 1 took 13.888s
[2021-03-30 22:31:59.081] [global] [info] [Transform Stage] skipped stage 2 because there is nothing todo here.
[2021-03-30 22:31:59.081] [global] [info] Query Execution took 14.8777s. (planning: 0.597818s, execution: 14.2799s)
[2021-03-30 22:31:59.086] [python] [info] Data transfer back to Python took 0.000022 seconds
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 29 2021, 06:12:46) 
[GCC 10.2.0] on linux
end-to-end took: 15.268869400024414s
Result::
[30104438.091100037]
framework,version,load,query,result
tuplex,0.1.6,0,15.268869400024414,[30104438.091100037]
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 2 active partitions
