[2021-03-31 03:40:07.033] [global] [error] could not find backend, defaulting to local
[2021-03-31 03:40:07.033] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 03:40:07.033] [local ee] [info] initializing LLVM backend
[2021-03-31 03:40:07.033] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 03:40:07.033] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 03:40:07.034] [memory] [info] allocated bitmap managed memory region (100.00 GB, 32.00 MB block size)
[2021-03-31 03:40:07.034] [local execution engine] [info] started driver (100.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 03:40:07.034] [fileinputoperator] [info] found 1 file (1.10 GB) to process.
[2021-03-31 03:40:07.035] [global] [info] sampled file:///data/311/311_preprocessed.csv on 256.00 KB
[2021-03-31 03:40:07.176] [logical planner] [info] logical optimization took 0.007592ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:40:07.176] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:40:07.195] [global] [info] Stage0 depends on: 
[2021-03-31 03:40:07.207] [global] [info] Optimization via LLVM passes took 0.011714 ms
[2021-03-31 03:40:07.213] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:40:07.213] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.01839s
[2021-03-31 03:40:07.213] [local ee] [info] split /data/311/311_preprocessed.csv into 17 tasks
[2021-03-31 03:40:08.099] [driver] [info] [Task Finished] Transform to mem in 0.885826s (11184809 normal rows, 0 exceptions)
[2021-03-31 03:40:08.984] [driver] [info] [Task Finished] Transform to mem in 0.884298s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:40:09.868] [driver] [info] [Task Finished] Transform to mem in 0.884223s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:40:10.750] [driver] [info] [Task Finished] Transform to mem in 0.882049s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:40:11.631] [driver] [info] [Task Finished] Transform to mem in 0.881209s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:40:12.512] [driver] [info] [Task Finished] Transform to mem in 0.881289s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:40:13.394] [driver] [info] [Task Finished] Transform to mem in 0.881544s (11184478 normal rows, 0 exceptions)
[2021-03-31 03:40:14.276] [driver] [info] [Task Finished] Transform to mem in 0.881532s (11184144 normal rows, 0 exceptions)
[2021-03-31 03:40:15.157] [driver] [info] [Task Finished] Transform to mem in 0.881200s (11184810 normal rows, 0 exceptions)
[2021-03-31 03:40:16.039] [driver] [info] [Task Finished] Transform to mem in 0.881823s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:40:16.920] [driver] [info] [Task Finished] Transform to mem in 0.880999s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:40:17.800] [driver] [info] [Task Finished] Transform to mem in 0.880271s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:40:18.681] [driver] [info] [Task Finished] Transform to mem in 0.880472s (11187144 normal rows, 0 exceptions)
[2021-03-31 03:40:19.561] [driver] [info] [Task Finished] Transform to mem in 0.880158s (11183810 normal rows, 0 exceptions)
[2021-03-31 03:40:20.441] [driver] [info] [Task Finished] Transform to mem in 0.880236s (11183811 normal rows, 0 exceptions)
[2021-03-31 03:40:21.321] [driver] [info] [Task Finished] Transform to mem in 0.880433s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:40:22.791] [driver] [info] [Task Finished] Transform to mem in 1.469793s (18675364 normal rows, 0 exceptions)
[2021-03-31 03:40:22.791] [global] [info] [Transform Stage] Stage 0 completed 17 load&transform tasks in 15.578s
[2021-03-31 03:40:22.791] [global] [info] [Transform Stage] Stage 0 total wall clock time: 15.5774s, 197628000 input rows, time to process 1 row via fast path: 7.88216e-05ms
[2021-03-31 03:40:22.791] [global] [info] [Transform Stage] Stage 0 completed 17 sink tasks in 7.6985e-05s
[2021-03-31 03:40:22.791] [global] [info] [Transform Stage] Stage 0 took 15.5966s
[2021-03-31 03:40:22.791] [global] [info] Query Execution took 15.6263s. (planning: 0.0296718s, execution: 15.5966s)
[2021-03-31 03:40:22.794] [global] [info] Cached 197628000 common rows (0 general rows), memory usage: 5.52 GB/5.81 GB (0.00 B/0.00 B)
[2021-03-31 03:40:22.810] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:22.814] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:22.818] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:22.822] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:22.822] [logical planner] [info] logical optimization took 0.008780ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 0
need to upgrade output type to (Option[str])
[2021-03-31 03:40:22.822] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (3 operators pipelined)
[2021-03-31 03:40:22.823] [codegen] [info] generating function fix_zip_codes for (Option[str]) -> Option[str]
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:40:22.824] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:40:22.824] [global] [info] Stage1 depends on: Stage0 
[2021-03-31 03:40:22.824] [global] [info] Stage0 depends on: 
[2021-03-31 03:40:22.825] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2021-03-31 03:40:22.847] [global] [info] Optimization via LLVM passes took 0.022232 ms
[2021-03-31 03:40:22.854] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:40:22.854] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0300287s
[2021-03-31 03:40:22.923] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068636s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:40:22.992] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068693s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:40:23.061] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068817s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:23.130] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069010s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:23.199] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069179s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:23.268] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069122s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:40:23.337] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068670s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:40:23.406] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068815s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:40:23.475] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068920s (0 normal rows, 0 exceptions, 146 buckets)
[2021-03-31 03:40:23.544] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068953s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:23.544] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000025s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:23.612] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068457s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:23.681] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068594s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:23.749] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068670s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:40:23.818] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069013s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:40:23.888] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069148s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:40:23.957] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068897s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:40:24.025] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068510s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:40:24.094] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069100s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:40:24.164] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069339s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:24.232] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068936s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:24.233] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000087s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:40:24.301] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068828s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:24.370] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068891s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:24.440] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069301s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:40:24.509] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069019s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:40:24.578] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069618s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:40:24.647] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068996s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:40:24.717] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069292s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:24.786] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069028s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:24.855] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068870s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:40:24.924] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069150s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:40:24.924] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:24.993] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068938s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:40:25.062] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069048s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:25.131] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068858s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:25.199] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068491s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:40:25.268] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068643s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:40:25.337] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068670s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:40:25.405] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068648s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:40:25.474] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068859s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:25.544] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069399s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:40:25.613] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068985s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:40:25.613] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000060s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:25.682] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069069s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:25.751] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068877s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:40:25.820] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069268s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:40:25.889] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068751s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:40:25.958] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069094s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:40:26.027] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068806s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:40:26.096] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069030s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:40:26.165] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069040s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:26.233] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068612s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:26.302] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068457s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:40:26.371] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069069s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:40:26.440] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068716s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:40:26.508] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068705s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:40:26.577] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068560s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:40:26.646] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069528s (0 normal rows, 0 exceptions, 110 buckets)
[2021-03-31 03:40:26.715] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068818s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:40:26.784] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068733s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:40:26.853] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068856s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:40:26.922] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068977s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:26.991] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068609s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:27.059] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068792s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:27.128] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068783s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:27.197] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068621s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:40:27.265] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068558s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:40:27.334] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068884s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:40:27.403] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068855s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:40:27.472] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068963s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:40:27.542] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069445s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:40:27.611] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069379s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:27.680] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068930s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:27.749] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068881s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:27.818] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069003s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:27.887] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069144s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:40:27.955] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068103s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:40:28.024] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068979s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:40:28.093] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069237s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:28.162] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068606s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:28.231] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068813s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:28.300] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068698s (0 normal rows, 0 exceptions, 161 buckets)
[2021-03-31 03:40:28.368] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068880s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:40:28.437] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069006s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:40:28.507] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069054s (0 normal rows, 0 exceptions, 106 buckets)
[2021-03-31 03:40:28.575] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068832s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:40:28.644] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068884s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:40:28.713] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068731s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:40:28.782] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068464s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:40:28.851] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069060s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:40:28.920] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068918s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:28.988] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068841s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:29.058] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069113s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:29.058] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000025s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:29.126] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068662s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:40:29.195] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068986s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:40:29.264] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068666s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:29.333] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068929s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:40:29.401] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068595s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:29.471] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069149s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:40:29.540] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068981s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:40:29.608] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068726s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:40:29.677] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068932s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:29.747] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069181s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:29.747] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:29.816] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069030s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:40:29.885] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069046s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:40:29.953] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068628s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:40:30.022] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069095s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:40:30.091] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068855s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:40:30.160] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068973s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:40:30.229] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068884s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:30.299] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069334s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:30.367] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068539s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:40:30.436] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068941s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:40:30.436] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:30.505] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068755s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:40:30.574] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069299s (0 normal rows, 0 exceptions, 105 buckets)
[2021-03-31 03:40:30.643] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069032s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:30.712] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068993s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:40:30.781] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068851s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:40:30.850] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068913s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:30.919] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069084s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:40:30.988] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068977s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:40:31.056] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068174s (0 normal rows, 0 exceptions, 104 buckets)
[2021-03-31 03:40:31.126] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069481s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:40:31.195] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068727s (0 normal rows, 0 exceptions, 164 buckets)
[2021-03-31 03:40:31.264] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068966s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:31.333] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069008s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:40:31.401] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068815s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:40:31.470] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068914s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:40:31.539] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068806s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:40:31.608] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068667s (0 normal rows, 0 exceptions, 132 buckets)
[2021-03-31 03:40:31.677] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069160s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:31.746] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068780s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:31.815] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068687s (0 normal rows, 0 exceptions, 129 buckets)
[2021-03-31 03:40:31.815] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000179s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:40:31.884] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069015s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:31.953] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068683s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:32.022] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069159s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:32.090] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068762s (0 normal rows, 0 exceptions, 99 buckets)
[2021-03-31 03:40:32.159] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068791s (0 normal rows, 0 exceptions, 94 buckets)
[2021-03-31 03:40:32.228] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068810s (0 normal rows, 0 exceptions, 141 buckets)
[2021-03-31 03:40:32.297] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069003s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:40:32.366] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069256s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:40:32.436] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069665s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:40:32.505] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068571s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:40:32.574] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069039s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:40:32.643] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069275s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:40:32.712] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068867s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:40:32.781] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069005s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:40:32.850] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069012s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:40:32.919] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069199s (0 normal rows, 0 exceptions, 160 buckets)
[2021-03-31 03:40:32.988] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068994s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:40:33.057] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069048s (0 normal rows, 0 exceptions, 96 buckets)
[2021-03-31 03:40:33.128] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070315s (0 normal rows, 0 exceptions, 107 buckets)
[2021-03-31 03:40:33.196] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068664s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:40:33.265] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068932s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:40:33.334] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069246s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:33.403] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068850s (0 normal rows, 0 exceptions, 163 buckets)
[2021-03-31 03:40:33.472] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068835s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:40:33.541] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068702s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:40:33.610] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068773s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:40:33.679] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068896s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:40:33.748] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069503s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:40:33.818] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069833s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:40:33.887] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068695s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:40:33.887] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:40:33.956] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069367s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:34.025] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068758s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:40:34.094] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068802s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:40:34.163] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068973s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:40:34.231] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068602s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:40:34.300] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068847s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:34.369] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069066s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:34.439] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069211s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:40:34.509] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069980s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:40:34.577] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068673s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:40:34.646] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069076s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:40:34.715] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069165s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:40:34.785] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069138s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:40:34.854] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068911s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:40:34.923] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069678s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:40:34.992] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068843s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:40:35.040] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.047924s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:40:35.040] [global] [info] [Transform Stage] Stage 0 completed 186 load&transform tasks in 12.1857s
[2021-03-31 03:40:35.040] [global] [info] [Transform Stage] Stage 0 total wall clock time: 12.1823s, 197628000 input rows, time to process 1 row via fast path: 6.16423e-05ms
[2021-03-31 03:40:35.044] [global] [info] [Transform Stage] Stage 0 completed 186 sink tasks in 0.00365041s
[2021-03-31 03:40:35.044] [global] [info] [Transform Stage] Stage 0 took 12.2194s
[2021-03-31 03:40:35.056] [global] [info] Optimization via LLVM passes took 0.011936 ms
[2021-03-31 03:40:35.061] [global] [info] Compiled code paths for stage 1 in 0.00 ms
[2021-03-31 03:40:35.061] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.0167262s
[2021-03-31 03:40:35.061] [driver] [info] [Task Finished] Transform to mem in 0.000043s (246 normal rows, 0 exceptions)
[2021-03-31 03:40:35.061] [global] [info] [Transform Stage] Stage 1 completed 1 load&transform tasks in 6.2165e-05s
[2021-03-31 03:40:35.061] [global] [info] [Transform Stage] Stage 1 total wall clock time: 4.3184e-05s, 246 input rows, time to process 1 row via fast path: 0.000175545ms
[2021-03-31 03:40:35.061] [global] [info] [Transform Stage] Stage 1 completed 1 sink tasks in 4.052e-06s
[2021-03-31 03:40:35.061] [global] [info] [Transform Stage] Stage 1 took 0.0168107s
[2021-03-31 03:40:35.061] [global] [info] Query Execution took 12.2505s. (planning: 0.0142275s, execution: 12.2363s)
[2021-03-31 03:40:35.063] [global] [info] Cached 246 common rows (0 general rows), memory usage: 7.20 KB/32.00 MB (0.00 B/0.00 B)
[2021-03-31 03:40:35.066] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:35.069] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:35.071] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:40:35.071] [logical planner] [info] logical optimization took 0.005304ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 03:40:35.071] [codegen] [info] generating pipeline for (Option[str]) -> (str) (1 operator pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str])
[2021-03-31 03:40:35.072] [global] [info] Stage0 depends on: 
[2021-03-31 03:40:35.085] [global] [info] Optimization via LLVM passes took 0.012687 ms
[2021-03-31 03:40:35.089] [global] [info] Compiled code paths for stage 0 in 0.00 ms
[2021-03-31 03:40:35.090] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0176983s
[2021-03-31 03:40:35.090] [driver] [info] [Task Finished] Transform to mem in 0.000033s (246 normal rows, 0 exceptions)
[2021-03-31 03:40:35.090] [global] [info] [Transform Stage] Stage 0 completed 1 load&transform tasks in 5.2193e-05s
[2021-03-31 03:40:35.090] [global] [info] [Transform Stage] Stage 0 total wall clock time: 3.2726e-05s, 246 input rows, time to process 1 row via fast path: 0.000133033ms

[2021-03-31 03:40:35.090] [global] [info] Writing 246 rows as output to file (1.44 KB)
[2021-03-31 03:40:35.090] [driver] [info] [Task Finished] write to file in 0.000059s (246 rows, 1.44 KB)
[2021-03-31 03:40:35.090] [global] [info] writing output took 0.000245s
[2021-03-31 03:40:35.090] [global] [info] [Transform Stage] Stage 0 completed 1 sink tasks in 0.000253348s
[2021-03-31 03:40:35.090] [global] [info] [Transform Stage] Stage 0 took 0.0180217s
[2021-03-31 03:40:35.090] [global] [info] Query Execution took 0.0266535s. (planning: 0.00859708s, execution: 0.0180564s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 29 2021, 06:12:46) 
[GCC 10.2.0] on linux
Tuplex startup time: 0.2697327136993408
{"startupTime": 0.2697327136993408, "readTime": 15.759746074676514, "jobTime": 12.269351482391357, "writeTime": 0.029059886932373047}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 188 active partitions
