[2021-03-31 03:42:02.439] [global] [error] could not find backend, defaulting to local
[2021-03-31 03:42:02.440] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 03:42:02.440] [local ee] [info] initializing LLVM backend
[2021-03-31 03:42:02.440] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 03:42:02.440] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 03:42:02.441] [memory] [info] allocated bitmap managed memory region (100.00 GB, 32.00 MB block size)
[2021-03-31 03:42:02.441] [local execution engine] [info] started driver (100.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 03:42:02.441] [fileinputoperator] [info] found 1 file (1.10 GB) to process.
[2021-03-31 03:42:02.441] [global] [info] sampled file:///data/311/311_preprocessed.csv on 256.00 KB
[2021-03-31 03:42:02.581] [logical planner] [info] logical optimization took 0.007534ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:42:02.581] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:42:02.600] [global] [info] Stage0 depends on: 
[2021-03-31 03:42:02.612] [global] [info] Optimization via LLVM passes took 0.011724 ms
[2021-03-31 03:42:02.618] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:42:02.618] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0183326s
[2021-03-31 03:42:02.618] [local ee] [info] split /data/311/311_preprocessed.csv into 17 tasks
[2021-03-31 03:42:03.505] [driver] [info] [Task Finished] Transform to mem in 0.886752s (11184809 normal rows, 0 exceptions)
[2021-03-31 03:42:04.390] [driver] [info] [Task Finished] Transform to mem in 0.884921s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:42:05.275] [driver] [info] [Task Finished] Transform to mem in 0.885235s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:42:06.158] [driver] [info] [Task Finished] Transform to mem in 0.882592s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:42:07.040] [driver] [info] [Task Finished] Transform to mem in 0.881849s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:42:07.921] [driver] [info] [Task Finished] Transform to mem in 0.881677s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:42:08.804] [driver] [info] [Task Finished] Transform to mem in 0.882219s (11184478 normal rows, 0 exceptions)
[2021-03-31 03:42:09.686] [driver] [info] [Task Finished] Transform to mem in 0.881868s (11184144 normal rows, 0 exceptions)
[2021-03-31 03:42:10.567] [driver] [info] [Task Finished] Transform to mem in 0.881827s (11184810 normal rows, 0 exceptions)
[2021-03-31 03:42:11.450] [driver] [info] [Task Finished] Transform to mem in 0.882411s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:42:12.331] [driver] [info] [Task Finished] Transform to mem in 0.881513s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:42:13.212] [driver] [info] [Task Finished] Transform to mem in 0.880661s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:42:14.093] [driver] [info] [Task Finished] Transform to mem in 0.880768s (11187144 normal rows, 0 exceptions)
[2021-03-31 03:42:14.973] [driver] [info] [Task Finished] Transform to mem in 0.880479s (11183810 normal rows, 0 exceptions)
[2021-03-31 03:42:15.854] [driver] [info] [Task Finished] Transform to mem in 0.880647s (11183811 normal rows, 0 exceptions)
[2021-03-31 03:42:16.735] [driver] [info] [Task Finished] Transform to mem in 0.880860s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:42:18.205] [driver] [info] [Task Finished] Transform to mem in 1.470318s (18675364 normal rows, 0 exceptions)
[2021-03-31 03:42:18.205] [global] [info] [Transform Stage] Stage 0 completed 17 load&transform tasks in 15.5873s
[2021-03-31 03:42:18.205] [global] [info] [Transform Stage] Stage 0 total wall clock time: 15.5866s, 197628000 input rows, time to process 1 row via fast path: 7.88684e-05ms
[2021-03-31 03:42:18.205] [global] [info] [Transform Stage] Stage 0 completed 17 sink tasks in 7.3121e-05s
[2021-03-31 03:42:18.205] [global] [info] [Transform Stage] Stage 0 took 15.6057s
[2021-03-31 03:42:18.205] [global] [info] Query Execution took 15.6354s. (planning: 0.0296804s, execution: 15.6057s)
[2021-03-31 03:42:18.208] [global] [info] Cached 197628000 common rows (0 general rows), memory usage: 5.52 GB/5.81 GB (0.00 B/0.00 B)
[2021-03-31 03:42:18.224] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:42:18.227] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:42:18.232] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:42:18.236] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:42:18.236] [logical planner] [info] logical optimization took 0.008794ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 0
need to upgrade output type to (Option[str])
[2021-03-31 03:42:18.236] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (3 operators pipelined)
[2021-03-31 03:42:18.237] [codegen] [info] generating function fix_zip_codes for (Option[str]) -> Option[str]
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:42:18.238] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:42:18.238] [global] [info] Stage1 depends on: Stage0 
[2021-03-31 03:42:18.238] [global] [info] Stage0 depends on: 
[2021-03-31 03:42:18.239] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2021-03-31 03:42:18.261] [global] [info] Optimization via LLVM passes took 0.022189 ms
[2021-03-31 03:42:18.268] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:42:18.268] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0300288s
[2021-03-31 03:42:18.337] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068935s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:42:18.406] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068839s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:42:18.475] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069127s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:18.544] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068626s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:42:18.613] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069345s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:42:18.682] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068703s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:42:18.751] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068719s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:42:18.820] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069119s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:42:18.889] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068830s (0 normal rows, 0 exceptions, 146 buckets)
[2021-03-31 03:42:18.958] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069190s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:42:18.958] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000025s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:42:19.027] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068770s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:19.096] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068821s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:42:19.165] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068813s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:42:19.233] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068876s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:42:19.302] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068517s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:42:19.371] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068695s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:42:19.439] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068489s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:42:19.508] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068861s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:42:19.577] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068945s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:42:19.646] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068901s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:19.646] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000084s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:42:19.715] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068794s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:19.784] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068910s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:19.853] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069075s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:42:19.922] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069074s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:42:19.991] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068910s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:42:20.060] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069110s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:42:20.129] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069397s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:20.198] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068860s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:42:20.267] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068731s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:42:20.336] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069083s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:42:20.336] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:42:20.405] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068684s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:42:20.474] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068851s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:20.543] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068964s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:20.612] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068704s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:42:20.680] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068755s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:42:20.749] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068586s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:42:20.817] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068497s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:42:20.886] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068943s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:42:20.956] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069101s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:42:21.025] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069164s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:42:21.025] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000061s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:42:21.094] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069159s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:21.163] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068935s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:42:21.233] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069593s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:42:21.302] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069045s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:42:21.371] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069007s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:42:21.440] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069010s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:42:21.509] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069485s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:42:21.578] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068974s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:42:21.647] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068918s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:42:21.716] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068635s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:42:21.785] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068917s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:42:21.854] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069024s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:42:21.922] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068423s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:42:21.991] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068395s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:42:22.059] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068937s (0 normal rows, 0 exceptions, 110 buckets)
[2021-03-31 03:42:22.128] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068809s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:42:22.197] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068915s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:42:22.266] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068805s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:42:22.335] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069225s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:42:22.404] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068881s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:42:22.473] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069040s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:22.543] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069245s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:22.611] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068756s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:42:22.680] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068999s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:42:22.750] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069271s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:42:22.821] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071267s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:42:22.893] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071695s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:42:22.961] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068306s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:42:23.029] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068526s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:23.098] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068422s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:23.167] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068658s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:42:23.236] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069372s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:23.305] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069153s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:42:23.374] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069217s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:42:23.443] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068891s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:42:23.512] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068838s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:23.581] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068982s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:23.650] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069033s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:23.719] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068673s (0 normal rows, 0 exceptions, 161 buckets)
[2021-03-31 03:42:23.788] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068676s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:42:23.856] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068867s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:42:23.925] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069016s (0 normal rows, 0 exceptions, 106 buckets)
[2021-03-31 03:42:23.994] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068910s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:42:24.063] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068958s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:42:24.132] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068742s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:42:24.201] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068947s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:42:24.270] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068908s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:42:24.339] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069102s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:42:24.408] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069064s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:24.477] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068301s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:24.477] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000024s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:42:24.545] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068713s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:42:24.614] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068805s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:42:24.683] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068888s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:42:24.752] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068749s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:42:24.821] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068787s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:42:24.890] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069208s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:42:24.959] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068862s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:42:25.028] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068766s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:42:25.097] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069095s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:25.166] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069135s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:42:25.166] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:42:25.235] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068858s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:42:25.304] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069194s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:42:25.373] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068869s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:42:25.442] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068761s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:42:25.510] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068667s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:42:25.579] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068972s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:42:25.648] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068868s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:42:25.717] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069335s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:42:25.786] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068818s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:42:25.855] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068885s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:42:25.855] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000049s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:42:25.926] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070944s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:42:25.997] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070855s (0 normal rows, 0 exceptions, 105 buckets)
[2021-03-31 03:42:26.068] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070848s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:26.139] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070971s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:42:26.210] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071064s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:42:26.281] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070794s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:26.352] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071166s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:42:26.423] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070747s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:42:26.494] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070920s (0 normal rows, 0 exceptions, 104 buckets)
[2021-03-31 03:42:26.564] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070621s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:42:26.637] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072633s (0 normal rows, 0 exceptions, 164 buckets)
[2021-03-31 03:42:26.710] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072762s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:42:26.783] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073518s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:42:26.857] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073907s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:42:26.930] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073097s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:42:27.003] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072717s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:42:27.076] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072773s (0 normal rows, 0 exceptions, 132 buckets)
[2021-03-31 03:42:27.149] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072870s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:27.222] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072890s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:27.295] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072965s (0 normal rows, 0 exceptions, 129 buckets)
[2021-03-31 03:42:27.295] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000183s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:42:27.368] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072755s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:27.441] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072826s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:27.514] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073161s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:42:27.588] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074491s (0 normal rows, 0 exceptions, 99 buckets)
[2021-03-31 03:42:27.661] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072672s (0 normal rows, 0 exceptions, 94 buckets)
[2021-03-31 03:42:27.734] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072907s (0 normal rows, 0 exceptions, 141 buckets)
[2021-03-31 03:42:27.807] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072842s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:42:27.880] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073157s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:42:27.953] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072902s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:42:28.025] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072590s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:42:28.098] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072799s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:42:28.171] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072871s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:42:28.244] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073284s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:42:28.318] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073709s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:42:28.391] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073088s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:42:28.464] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073028s (0 normal rows, 0 exceptions, 160 buckets)
[2021-03-31 03:42:28.537] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072717s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:42:28.610] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072846s (0 normal rows, 0 exceptions, 96 buckets)
[2021-03-31 03:42:28.683] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072713s (0 normal rows, 0 exceptions, 107 buckets)
[2021-03-31 03:42:28.755] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072715s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:42:28.828] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072773s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:42:28.901] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072690s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:28.974] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072963s (0 normal rows, 0 exceptions, 163 buckets)
[2021-03-31 03:42:29.047] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073235s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:42:29.120] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072944s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:42:29.193] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073206s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:42:29.262] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068945s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:42:29.331] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068839s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:42:29.400] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069007s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:42:29.469] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068746s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:42:29.469] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000051s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:42:29.538] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068946s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:29.607] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068994s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:42:29.675] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068068s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:42:29.743] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067600s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:42:29.811] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068832s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:42:29.880] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068865s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:29.949] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069022s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:30.019] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069246s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:42:30.088] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068945s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:42:30.156] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068764s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:42:30.225] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068977s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:42:30.295] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069191s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:42:30.363] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068304s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:42:30.431] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068202s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:42:30.500] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069313s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:42:30.569] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068650s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:42:30.617] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.047916s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:42:30.617] [global] [info] [Transform Stage] Stage 0 completed 186 load&transform tasks in 12.3488s
[2021-03-31 03:42:30.617] [global] [info] [Transform Stage] Stage 0 total wall clock time: 12.3454s, 197628000 input rows, time to process 1 row via fast path: 6.24677e-05ms
[2021-03-31 03:42:30.621] [global] [info] [Transform Stage] Stage 0 completed 186 sink tasks in 0.00356244s
[2021-03-31 03:42:30.621] [global] [info] [Transform Stage] Stage 0 took 12.3824s
[2021-03-31 03:42:30.633] [global] [info] Optimization via LLVM passes took 0.012006 ms
[2021-03-31 03:42:30.638] [global] [info] Compiled code paths for stage 1 in 0.00 ms
[2021-03-31 03:42:30.638] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.0168331s
[2021-03-31 03:42:30.638] [driver] [info] [Task Finished] Transform to mem in 0.000043s (246 normal rows, 0 exceptions)
[2021-03-31 03:42:30.638] [global] [info] [Transform Stage] Stage 1 completed 1 load&transform tasks in 6.2745e-05s
[2021-03-31 03:42:30.638] [global] [info] [Transform Stage] Stage 1 total wall clock time: 4.3381e-05s, 246 input rows, time to process 1 row via fast path: 0.000176346ms
[2021-03-31 03:42:30.638] [global] [info] [Transform Stage] Stage 1 completed 1 sink tasks in 4.179e-06s
[2021-03-31 03:42:30.638] [global] [info] [Transform Stage] Stage 1 took 0.0169181s
[2021-03-31 03:42:30.638] [global] [info] Query Execution took 12.4136s. (planning: 0.0141385s, execution: 12.3994s)
[2021-03-31 03:42:30.640] [global] [info] Cached 246 common rows (0 general rows), memory usage: 7.20 KB/32.00 MB (0.00 B/0.00 B)
[2021-03-31 03:42:30.643] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:42:30.646] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:42:30.648] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:42:30.648] [logical planner] [info] logical optimization took 0.005306ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 03:42:30.648] [codegen] [info] generating pipeline for (Option[str]) -> (str) (1 operator pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str])
[2021-03-31 03:42:30.649] [global] [info] Stage0 depends on: 
[2021-03-31 03:42:30.662] [global] [info] Optimization via LLVM passes took 0.012710 ms
[2021-03-31 03:42:30.667] [global] [info] Compiled code paths for stage 0 in 0.00 ms
[2021-03-31 03:42:30.667] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0177799s
[2021-03-31 03:42:30.667] [driver] [info] [Task Finished] Transform to mem in 0.000032s (246 normal rows, 0 exceptions)
[2021-03-31 03:42:30.667] [global] [info] [Transform Stage] Stage 0 completed 1 load&transform tasks in 5.157e-05s
[2021-03-31 03:42:30.667] [global] [info] [Transform Stage] Stage 0 total wall clock time: 3.1763e-05s, 246 input rows, time to process 1 row via fast path: 0.000129118ms

[2021-03-31 03:42:30.667] [global] [info] Writing 246 rows as output to file (1.44 KB)
[2021-03-31 03:42:30.667] [driver] [info] [Task Finished] write to file in 0.000061s (246 rows, 1.44 KB)
[2021-03-31 03:42:30.667] [global] [info] writing output took 0.000270s
[2021-03-31 03:42:30.667] [global] [info] [Transform Stage] Stage 0 completed 1 sink tasks in 0.000278496s
[2021-03-31 03:42:30.667] [global] [info] [Transform Stage] Stage 0 took 0.0181274s
[2021-03-31 03:42:30.667] [global] [info] Query Execution took 0.0268101s. (planning: 0.00864909s, execution: 0.018161s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 29 2021, 06:12:46) 
[GCC 10.2.0] on linux
Tuplex startup time: 0.27002882957458496
{"startupTime": 0.27002882957458496, "readTime": 15.767089128494263, "jobTime": 12.432373523712158, "writeTime": 0.02915668487548828}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 188 active partitions
