[2021-03-31 03:40:35.686] [global] [error] could not find backend, defaulting to local
[2021-03-31 03:40:35.686] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 03:40:35.686] [local ee] [info] initializing LLVM backend
[2021-03-31 03:40:35.686] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 03:40:35.686] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 03:40:35.687] [memory] [info] allocated bitmap managed memory region (100.00 GB, 32.00 MB block size)
[2021-03-31 03:40:35.687] [local execution engine] [info] started driver (100.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 03:40:35.687] [fileinputoperator] [info] found 1 file (1.10 GB) to process.
[2021-03-31 03:40:35.687] [global] [info] sampled file:///data/311/311_preprocessed.csv on 256.00 KB
[2021-03-31 03:40:35.828] [logical planner] [info] logical optimization took 0.007608ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:40:35.828] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:40:35.847] [global] [info] Stage0 depends on: 
[2021-03-31 03:40:35.860] [global] [info] Optimization via LLVM passes took 0.011716 ms
[2021-03-31 03:40:35.866] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:40:35.866] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0183916s
[2021-03-31 03:40:35.866] [local ee] [info] split /data/311/311_preprocessed.csv into 17 tasks
[2021-03-31 03:40:36.754] [driver] [info] [Task Finished] Transform to mem in 0.887978s (11184809 normal rows, 0 exceptions)
[2021-03-31 03:40:37.639] [driver] [info] [Task Finished] Transform to mem in 0.885189s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:40:38.525] [driver] [info] [Task Finished] Transform to mem in 0.886084s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:40:39.409] [driver] [info] [Task Finished] Transform to mem in 0.883899s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:40:40.292] [driver] [info] [Task Finished] Transform to mem in 0.882952s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:40:41.175] [driver] [info] [Task Finished] Transform to mem in 0.883164s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:40:42.059] [driver] [info] [Task Finished] Transform to mem in 0.883382s (11184478 normal rows, 0 exceptions)
[2021-03-31 03:40:42.942] [driver] [info] [Task Finished] Transform to mem in 0.882949s (11184144 normal rows, 0 exceptions)
[2021-03-31 03:40:43.824] [driver] [info] [Task Finished] Transform to mem in 0.882686s (11184810 normal rows, 0 exceptions)
[2021-03-31 03:40:44.708] [driver] [info] [Task Finished] Transform to mem in 0.883723s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:40:45.591] [driver] [info] [Task Finished] Transform to mem in 0.882453s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:40:46.473] [driver] [info] [Task Finished] Transform to mem in 0.881847s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:40:47.355] [driver] [info] [Task Finished] Transform to mem in 0.882009s (11187144 normal rows, 0 exceptions)
[2021-03-31 03:40:48.236] [driver] [info] [Task Finished] Transform to mem in 0.881617s (11183810 normal rows, 0 exceptions)
[2021-03-31 03:40:49.118] [driver] [info] [Task Finished] Transform to mem in 0.881883s (11183811 normal rows, 0 exceptions)
[2021-03-31 03:40:50.000] [driver] [info] [Task Finished] Transform to mem in 0.882115s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:40:51.472] [driver] [info] [Task Finished] Transform to mem in 1.471729s (18675364 normal rows, 0 exceptions)
[2021-03-31 03:40:51.472] [global] [info] [Transform Stage] Stage 0 completed 17 load&transform tasks in 15.6063s
[2021-03-31 03:40:51.472] [global] [info] [Transform Stage] Stage 0 total wall clock time: 15.6057s, 197628000 input rows, time to process 1 row via fast path: 7.89648e-05ms
[2021-03-31 03:40:51.472] [global] [info] [Transform Stage] Stage 0 completed 17 sink tasks in 7.0161e-05s
[2021-03-31 03:40:51.472] [global] [info] [Transform Stage] Stage 0 took 15.6248s
[2021-03-31 03:40:51.472] [global] [info] Query Execution took 15.6546s. (planning: 0.0296975s, execution: 15.6249s)
[2021-03-31 03:40:51.474] [global] [info] Cached 197628000 common rows (0 general rows), memory usage: 5.52 GB/5.81 GB (0.00 B/0.00 B)
[2021-03-31 03:40:51.491] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:51.494] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:51.498] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:51.503] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:51.503] [logical planner] [info] logical optimization took 0.008836ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 0
need to upgrade output type to (Option[str])
[2021-03-31 03:40:51.503] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (3 operators pipelined)
[2021-03-31 03:40:51.504] [codegen] [info] generating function fix_zip_codes for (Option[str]) -> Option[str]
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:40:51.505] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:40:51.505] [global] [info] Stage1 depends on: Stage0 
[2021-03-31 03:40:51.505] [global] [info] Stage0 depends on: 
[2021-03-31 03:40:51.506] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2021-03-31 03:40:51.528] [global] [info] Optimization via LLVM passes took 0.022253 ms
[2021-03-31 03:40:51.535] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:40:51.535] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0300772s
[2021-03-31 03:40:51.606] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070701s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:40:51.677] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070801s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:40:51.748] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070757s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:51.819] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071381s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:51.890] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071162s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:51.962] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071739s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:40:52.033] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070907s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:40:52.105] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071679s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:40:52.176] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071018s (0 normal rows, 0 exceptions, 146 buckets)
[2021-03-31 03:40:52.246] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070900s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:52.247] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000026s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:52.317] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070805s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:52.388] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070943s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:52.459] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070951s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:40:52.530] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070846s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:40:52.601] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070805s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:40:52.672] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070983s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:40:52.743] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071018s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:40:52.815] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071695s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:40:52.886] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071455s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:52.958] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071595s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:52.958] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000085s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:40:53.029] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070753s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:53.100] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071168s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:53.171] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071609s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:40:53.243] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071094s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:40:53.313] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070809s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:40:53.384] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071031s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:40:53.455] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070983s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:53.526] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070658s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:53.597] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070770s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:40:53.675] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.077801s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:40:53.675] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000062s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:53.746] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070790s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:40:53.817] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070925s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:53.887] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070819s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:53.958] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070848s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:40:54.029] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070772s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:40:54.100] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070996s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:40:54.171] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070445s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:40:54.241] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070787s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:54.312] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071109s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:40:54.383] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070684s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:40:54.383] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000061s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:54.454] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070989s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:54.526] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071241s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:40:54.597] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071026s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:40:54.667] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070804s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:40:54.738] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070923s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:40:54.809] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070758s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:40:54.880] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071062s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:40:54.951] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070762s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:55.023] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071744s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:55.094] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070782s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:40:55.165] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071863s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:40:55.236] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071007s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:40:55.308] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071379s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:40:55.379] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071133s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:40:55.450] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070939s (0 normal rows, 0 exceptions, 110 buckets)
[2021-03-31 03:40:55.521] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070755s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:40:55.592] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070854s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:40:55.662] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070689s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:40:55.733] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071157s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:55.804] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070418s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:55.875] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070784s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:55.946] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071378s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:56.017] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070758s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:40:56.088] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070845s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:40:56.159] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070993s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:40:56.230] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071249s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:40:56.301] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071218s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:40:56.372] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070743s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:40:56.443] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071130s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:56.514] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070866s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:56.585] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070838s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:56.656] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071155s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:56.727] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070879s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:40:56.798] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071244s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:40:56.869] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070878s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:40:56.941] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071557s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:57.011] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070748s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:57.082] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070937s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:57.154] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071205s (0 normal rows, 0 exceptions, 161 buckets)
[2021-03-31 03:40:57.225] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071103s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:40:57.296] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071133s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:40:57.367] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071255s (0 normal rows, 0 exceptions, 106 buckets)
[2021-03-31 03:40:57.438] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071126s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:40:57.509] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070920s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:57.580] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070819s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:40:57.651] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070633s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:40:57.722] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071134s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:40:57.793] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070931s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:57.864] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070861s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:57.935] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070867s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:57.935] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000026s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:58.006] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070974s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:40:58.076] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070379s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:40:58.147] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070986s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:58.218] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070907s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:40:58.289] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070966s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:58.361] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071545s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:40:58.431] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070942s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:40:58.502] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070966s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:40:58.574] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071034s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:58.645] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071097s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:58.645] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000051s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:58.716] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070808s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:40:58.787] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071753s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:40:58.859] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071242s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:40:58.929] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070801s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:40:59.000] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070808s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:40:59.071] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070865s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:40:59.142] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070865s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:59.213] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071237s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:59.284] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070859s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:40:59.355] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071139s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:40:59.355] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000052s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:59.426] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070657s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:40:59.497] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070789s (0 normal rows, 0 exceptions, 105 buckets)
[2021-03-31 03:40:59.568] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070883s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:59.639] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071719s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:59.711] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071508s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:40:59.781] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070522s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:59.852] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070969s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:40:59.923] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070877s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:40:59.997] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073234s (0 normal rows, 0 exceptions, 104 buckets)
[2021-03-31 03:41:00.067] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070569s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:41:00.138] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070996s (0 normal rows, 0 exceptions, 164 buckets)
[2021-03-31 03:41:00.209] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070952s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:41:00.282] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072449s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:41:00.353] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070899s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:41:00.424] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071546s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:41:00.496] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072239s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:41:00.567] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070942s (0 normal rows, 0 exceptions, 132 buckets)
[2021-03-31 03:41:00.639] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071413s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:41:00.710] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070721s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:41:00.780] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070718s (0 normal rows, 0 exceptions, 129 buckets)
[2021-03-31 03:41:00.780] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000175s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:41:00.851] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070802s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:41:00.922] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070772s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:41:00.994] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071685s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:41:01.065] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070828s (0 normal rows, 0 exceptions, 99 buckets)
[2021-03-31 03:41:01.135] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070797s (0 normal rows, 0 exceptions, 94 buckets)
[2021-03-31 03:41:01.208] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072185s (0 normal rows, 0 exceptions, 141 buckets)
[2021-03-31 03:41:01.279] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070901s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:41:01.350] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071518s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:41:01.421] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070836s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:41:01.492] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070573s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:41:01.562] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070886s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:41:01.633] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070924s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:41:01.705] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071355s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:41:01.776] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071173s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:41:01.847] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071518s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:41:01.919] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071510s (0 normal rows, 0 exceptions, 160 buckets)
[2021-03-31 03:41:01.990] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070992s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:41:02.064] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073842s (0 normal rows, 0 exceptions, 96 buckets)
[2021-03-31 03:41:02.135] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070925s (0 normal rows, 0 exceptions, 107 buckets)
[2021-03-31 03:41:02.206] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070914s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:41:02.277] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071311s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:41:02.348] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070749s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:41:02.419] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071082s (0 normal rows, 0 exceptions, 163 buckets)
[2021-03-31 03:41:02.490] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070995s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:41:02.562] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071662s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:41:02.633] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070995s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:41:02.704] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071037s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:41:02.775] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071292s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:41:02.846] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070914s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:41:02.917] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071159s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:41:02.917] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000049s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:41:02.988] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070841s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:41:03.059] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070649s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:41:03.130] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071488s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:41:03.201] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070613s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:41:03.272] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071270s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:41:03.343] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071148s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:41:03.414] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071116s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:41:03.488] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073072s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:41:03.558] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070822s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:41:03.630] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071278s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:41:03.701] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070933s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:41:03.772] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071311s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:41:03.844] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071600s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:41:03.915] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071042s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:41:03.986] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070979s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:41:04.057] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071705s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:41:04.107] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.049478s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:41:04.107] [global] [info] [Transform Stage] Stage 0 completed 186 load&transform tasks in 12.5718s
[2021-03-31 03:41:04.107] [global] [info] [Transform Stage] Stage 0 total wall clock time: 12.5683s, 197628000 input rows, time to process 1 row via fast path: 6.35958e-05ms
[2021-03-31 03:41:04.110] [global] [info] [Transform Stage] Stage 0 completed 186 sink tasks in 0.00356313s
[2021-03-31 03:41:04.110] [global] [info] [Transform Stage] Stage 0 took 12.6055s
[2021-03-31 03:41:04.123] [global] [info] Optimization via LLVM passes took 0.012133 ms
[2021-03-31 03:41:04.128] [global] [info] Compiled code paths for stage 1 in 0.00 ms
[2021-03-31 03:41:04.128] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.0170413s
[2021-03-31 03:41:04.128] [driver] [info] [Task Finished] Transform to mem in 0.000044s (246 normal rows, 0 exceptions)
[2021-03-31 03:41:04.128] [global] [info] [Transform Stage] Stage 1 completed 1 load&transform tasks in 6.315e-05s
[2021-03-31 03:41:04.128] [global] [info] [Transform Stage] Stage 1 total wall clock time: 4.353e-05s, 246 input rows, time to process 1 row via fast path: 0.000176951ms
[2021-03-31 03:41:04.128] [global] [info] [Transform Stage] Stage 1 completed 1 sink tasks in 4.155e-06s
[2021-03-31 03:41:04.128] [global] [info] [Transform Stage] Stage 1 took 0.0171263s
[2021-03-31 03:41:04.128] [global] [info] Query Execution took 12.637s. (planning: 0.0142637s, execution: 12.6227s)
[2021-03-31 03:41:04.130] [global] [info] Cached 246 common rows (0 general rows), memory usage: 7.20 KB/32.00 MB (0.00 B/0.00 B)
[2021-03-31 03:41:04.133] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:41:04.136] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:41:04.138] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:41:04.138] [logical planner] [info] logical optimization took 0.005323ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 03:41:04.138] [codegen] [info] generating pipeline for (Option[str]) -> (str) (1 operator pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str])
[2021-03-31 03:41:04.139] [global] [info] Stage0 depends on: 
[2021-03-31 03:41:04.152] [global] [info] Optimization via LLVM passes took 0.012729 ms
[2021-03-31 03:41:04.157] [global] [info] Compiled code paths for stage 0 in 0.00 ms
[2021-03-31 03:41:04.157] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0178058s
[2021-03-31 03:41:04.157] [driver] [info] [Task Finished] Transform to mem in 0.000034s (246 normal rows, 0 exceptions)
[2021-03-31 03:41:04.157] [global] [info] [Transform Stage] Stage 0 completed 1 load&transform tasks in 5.4409e-05s
[2021-03-31 03:41:04.157] [global] [info] [Transform Stage] Stage 0 total wall clock time: 3.394e-05s, 246 input rows, time to process 1 row via fast path: 0.000137967ms

[2021-03-31 03:41:04.157] [global] [info] Writing 246 rows as output to file (1.44 KB)
[2021-03-31 03:41:04.157] [driver] [info] [Task Finished] write to file in 0.000060s (246 rows, 1.44 KB)
[2021-03-31 03:41:04.157] [global] [info] writing output took 0.000250s
[2021-03-31 03:41:04.157] [global] [info] [Transform Stage] Stage 0 completed 1 sink tasks in 0.000258485s
[2021-03-31 03:41:04.157] [global] [info] [Transform Stage] Stage 0 took 0.0181365s
[2021-03-31 03:41:04.157] [global] [info] Query Execution took 0.0268815s. (planning: 0.00871076s, execution: 0.0181707s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 29 2021, 06:12:46) 
[GCC 10.2.0] on linux
Tuplex startup time: 0.27146100997924805
{"startupTime": 0.27146100997924805, "readTime": 15.787410974502563, "jobTime": 12.655651569366455, "writeTime": 0.029330730438232422}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 188 active partitions
