[2021-03-31 03:42:59.900] [global] [error] could not find backend, defaulting to local
[2021-03-31 03:42:59.901] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 03:42:59.901] [local ee] [info] initializing LLVM backend
[2021-03-31 03:42:59.901] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 03:42:59.901] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 03:42:59.902] [memory] [info] allocated bitmap managed memory region (100.00 GB, 32.00 MB block size)
[2021-03-31 03:42:59.902] [local execution engine] [info] started driver (100.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 03:42:59.902] [fileinputoperator] [info] found 1 file (1.10 GB) to process.
[2021-03-31 03:42:59.902] [global] [info] sampled file:///data/311/311_preprocessed.csv on 256.00 KB
[2021-03-31 03:43:00.043] [logical planner] [info] logical optimization took 0.007554ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:43:00.043] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:43:00.062] [global] [info] Stage0 depends on: 
[2021-03-31 03:43:00.074] [global] [info] Optimization via LLVM passes took 0.011715 ms
[2021-03-31 03:43:00.080] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:43:00.080] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0183266s
[2021-03-31 03:43:00.080] [local ee] [info] split /data/311/311_preprocessed.csv into 17 tasks
[2021-03-31 03:43:00.966] [driver] [info] [Task Finished] Transform to mem in 0.885312s (11184809 normal rows, 0 exceptions)
[2021-03-31 03:43:01.850] [driver] [info] [Task Finished] Transform to mem in 0.884469s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:43:02.734] [driver] [info] [Task Finished] Transform to mem in 0.883455s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:43:03.615] [driver] [info] [Task Finished] Transform to mem in 0.880989s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:43:04.495] [driver] [info] [Task Finished] Transform to mem in 0.880375s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:43:05.376] [driver] [info] [Task Finished] Transform to mem in 0.880537s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:43:06.257] [driver] [info] [Task Finished] Transform to mem in 0.881048s (11184478 normal rows, 0 exceptions)
[2021-03-31 03:43:07.137] [driver] [info] [Task Finished] Transform to mem in 0.880176s (11184144 normal rows, 0 exceptions)
[2021-03-31 03:43:08.018] [driver] [info] [Task Finished] Transform to mem in 0.880802s (11184810 normal rows, 0 exceptions)
[2021-03-31 03:43:08.899] [driver] [info] [Task Finished] Transform to mem in 0.881262s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:43:09.779] [driver] [info] [Task Finished] Transform to mem in 0.880063s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:43:10.659] [driver] [info] [Task Finished] Transform to mem in 0.879868s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:43:11.539] [driver] [info] [Task Finished] Transform to mem in 0.880009s (11187144 normal rows, 0 exceptions)
[2021-03-31 03:43:12.418] [driver] [info] [Task Finished] Transform to mem in 0.879052s (11183810 normal rows, 0 exceptions)
[2021-03-31 03:43:13.297] [driver] [info] [Task Finished] Transform to mem in 0.879332s (11183811 normal rows, 0 exceptions)
[2021-03-31 03:43:14.177] [driver] [info] [Task Finished] Transform to mem in 0.879743s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:43:15.645] [driver] [info] [Task Finished] Transform to mem in 1.467527s (18675364 normal rows, 0 exceptions)
[2021-03-31 03:43:15.645] [global] [info] [Transform Stage] Stage 0 completed 17 load&transform tasks in 15.5647s
[2021-03-31 03:43:15.645] [global] [info] [Transform Stage] Stage 0 total wall clock time: 15.564s, 197628000 input rows, time to process 1 row via fast path: 7.87541e-05ms
[2021-03-31 03:43:15.645] [global] [info] [Transform Stage] Stage 0 completed 17 sink tasks in 7.3039e-05s
[2021-03-31 03:43:15.645] [global] [info] [Transform Stage] Stage 0 took 15.5831s
[2021-03-31 03:43:15.645] [global] [info] Query Execution took 15.6128s. (planning: 0.0296632s, execution: 15.5831s)
[2021-03-31 03:43:15.647] [global] [info] Cached 197628000 common rows (0 general rows), memory usage: 5.52 GB/5.81 GB (0.00 B/0.00 B)
[2021-03-31 03:43:15.664] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:43:15.667] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:43:15.671] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:43:15.676] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:43:15.676] [logical planner] [info] logical optimization took 0.008778ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 0
need to upgrade output type to (Option[str])
[2021-03-31 03:43:15.676] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (3 operators pipelined)
[2021-03-31 03:43:15.676] [codegen] [info] generating function fix_zip_codes for (Option[str]) -> Option[str]
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:43:15.677] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:43:15.678] [global] [info] Stage1 depends on: Stage0 
[2021-03-31 03:43:15.678] [global] [info] Stage0 depends on: 
[2021-03-31 03:43:15.678] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2021-03-31 03:43:15.701] [global] [info] Optimization via LLVM passes took 0.022349 ms
[2021-03-31 03:43:15.708] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:43:15.708] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0301786s
[2021-03-31 03:43:15.778] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069463s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:43:15.847] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069409s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:43:15.916] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069321s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:15.986] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069534s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:43:16.055] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069069s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:43:16.124] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069156s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:43:16.193] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068826s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:43:16.262] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069174s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:43:16.332] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070130s (0 normal rows, 0 exceptions, 146 buckets)
[2021-03-31 03:43:16.402] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069232s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:43:16.402] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000055s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:43:16.471] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069121s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:16.540] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069685s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:43:16.610] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069365s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:43:16.679] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069191s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:43:16.748] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069073s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:43:16.818] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069832s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:43:16.887] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068842s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:43:16.956] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069130s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:43:17.026] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069456s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:43:17.094] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068921s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:17.095] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000061s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:43:17.164] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069021s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:17.233] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069454s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:17.304] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070595s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:43:17.373] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069564s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:43:17.445] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071903s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:43:17.514] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069074s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:43:17.584] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069308s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:17.653] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069044s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:43:17.722] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069265s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:43:17.791] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069315s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:43:17.791] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000049s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:43:17.861] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069288s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:43:17.930] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069088s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:17.998] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068189s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:18.067] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069083s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:43:18.136] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069243s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:43:18.206] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069852s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:43:18.276] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069499s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:43:18.344] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068702s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:43:18.413] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068618s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:43:18.483] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070282s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:43:18.483] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000082s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:43:18.553] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069310s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:18.622] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069099s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:43:18.694] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072061s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:43:18.764] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069516s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:43:18.833] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069043s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:43:18.903] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070829s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:43:18.973] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069581s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:43:19.043] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069554s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:43:19.112] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069113s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:43:19.180] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068590s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:43:19.250] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069591s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:43:19.321] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070634s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:43:19.390] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069250s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:43:19.459] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068861s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:43:19.528] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069100s (0 normal rows, 0 exceptions, 110 buckets)
[2021-03-31 03:43:19.597] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069061s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:43:19.666] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069307s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:43:19.736] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069517s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:43:19.805] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069188s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:43:19.874] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069039s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:43:19.943] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069006s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:20.012] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069292s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:20.081] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068571s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:43:20.149] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068331s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:43:20.219] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069324s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:43:20.288] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069046s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:43:20.357] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069288s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:43:20.426] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069031s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:43:20.495] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069232s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:20.564] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068911s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:20.634] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069479s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:43:20.706] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072210s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:20.775] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069302s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:43:20.845] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069258s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:43:20.914] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069646s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:43:20.983] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068982s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:21.053] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069440s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:21.124] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071647s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:21.196] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071356s (0 normal rows, 0 exceptions, 161 buckets)
[2021-03-31 03:43:21.265] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069296s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:43:21.334] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069423s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:43:21.404] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069275s (0 normal rows, 0 exceptions, 106 buckets)
[2021-03-31 03:43:21.473] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069448s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:43:21.543] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069395s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:43:21.612] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069504s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:43:21.681] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069115s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:43:21.751] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069959s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:43:21.820] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069161s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:43:21.890] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069679s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:21.960] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069725s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:21.960] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000051s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:43:22.028] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068168s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:43:22.097] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068420s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:43:22.165] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068452s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:43:22.235] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069448s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:43:22.304] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069158s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:43:22.373] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069717s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:43:22.442] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069037s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:43:22.512] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069036s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:43:22.581] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069158s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:22.650] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069149s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:43:22.650] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000024s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:43:22.719] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068919s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:43:22.790] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070981s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:43:22.859] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069341s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:43:22.929] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069339s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:43:22.998] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069226s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:43:23.068] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069696s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:43:23.137] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069448s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:43:23.207] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069696s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:43:23.276] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069410s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:43:23.346] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069661s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:43:23.346] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:43:23.415] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068998s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:43:23.485] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069789s (0 normal rows, 0 exceptions, 105 buckets)
[2021-03-31 03:43:23.555] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069887s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:23.626] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071340s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:43:23.696] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069831s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:43:23.765] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069298s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:23.835] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069949s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:43:23.904] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069128s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:43:23.974] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069553s (0 normal rows, 0 exceptions, 104 buckets)
[2021-03-31 03:43:24.043] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069276s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:43:24.113] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069462s (0 normal rows, 0 exceptions, 164 buckets)
[2021-03-31 03:43:24.182] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069550s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:43:24.254] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.072295s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:43:24.325] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070661s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:43:24.395] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069418s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:43:24.465] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069975s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:43:24.534] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069865s (0 normal rows, 0 exceptions, 132 buckets)
[2021-03-31 03:43:24.604] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069377s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:24.672] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068586s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:24.741] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068945s (0 normal rows, 0 exceptions, 129 buckets)
[2021-03-31 03:43:24.742] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000176s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:43:24.811] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069296s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:24.880] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069279s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:24.952] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071637s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:43:25.021] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069053s (0 normal rows, 0 exceptions, 99 buckets)
[2021-03-31 03:43:25.090] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068761s (0 normal rows, 0 exceptions, 94 buckets)
[2021-03-31 03:43:25.159] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069741s (0 normal rows, 0 exceptions, 141 buckets)
[2021-03-31 03:43:25.230] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070572s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:43:25.300] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069921s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:43:25.369] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068784s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:43:25.438] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069111s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:43:25.507] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069360s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:43:25.577] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069442s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:43:25.648] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071120s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:43:25.719] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071316s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:43:25.788] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069101s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:43:25.858] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069925s (0 normal rows, 0 exceptions, 160 buckets)
[2021-03-31 03:43:25.928] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069412s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:43:25.997] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069602s (0 normal rows, 0 exceptions, 96 buckets)
[2021-03-31 03:43:26.068] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070728s (0 normal rows, 0 exceptions, 107 buckets)
[2021-03-31 03:43:26.137] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069070s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:43:26.207] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069827s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:43:26.276] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069346s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:26.348] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071461s (0 normal rows, 0 exceptions, 163 buckets)
[2021-03-31 03:43:26.417] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069128s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:43:26.486] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068575s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:43:26.555] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069798s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:43:26.625] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069938s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:43:26.694] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068516s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:43:26.762] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068445s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:43:26.830] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067870s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:43:26.830] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:43:26.900] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069574s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:26.970] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070186s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:43:27.042] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071400s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:43:27.111] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069809s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:43:27.180] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069120s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:43:27.250] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069286s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:27.319] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069219s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:27.389] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069564s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:43:27.457] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068777s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:43:27.526] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068873s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:43:27.596] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069486s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:43:27.666] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070036s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:43:27.737] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071560s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:43:27.806] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069064s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:43:27.876] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069611s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:43:27.946] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069817s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:43:27.994] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.048382s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:43:27.994] [global] [info] [Transform Stage] Stage 0 completed 186 load&transform tasks in 12.2865s
[2021-03-31 03:43:27.994] [global] [info] [Transform Stage] Stage 0 total wall clock time: 12.283s, 197628000 input rows, time to process 1 row via fast path: 6.21523e-05ms
[2021-03-31 03:43:27.998] [global] [info] [Transform Stage] Stage 0 completed 186 sink tasks in 0.00355753s
[2021-03-31 03:43:27.998] [global] [info] [Transform Stage] Stage 0 took 12.3203s
[2021-03-31 03:43:28.010] [global] [info] Optimization via LLVM passes took 0.011909 ms
[2021-03-31 03:43:28.015] [global] [info] Compiled code paths for stage 1 in 0.00 ms
[2021-03-31 03:43:28.015] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.0168108s
[2021-03-31 03:43:28.015] [driver] [info] [Task Finished] Transform to mem in 0.000042s (246 normal rows, 0 exceptions)
[2021-03-31 03:43:28.015] [global] [info] [Transform Stage] Stage 1 completed 1 load&transform tasks in 6.0008e-05s
[2021-03-31 03:43:28.015] [global] [info] [Transform Stage] Stage 1 total wall clock time: 4.1624e-05s, 246 input rows, time to process 1 row via fast path: 0.000169203ms
[2021-03-31 03:43:28.015] [global] [info] [Transform Stage] Stage 1 completed 1 sink tasks in 3.945e-06s
[2021-03-31 03:43:28.015] [global] [info] [Transform Stage] Stage 1 took 0.0168925s
[2021-03-31 03:43:28.015] [global] [info] Query Execution took 12.3514s. (planning: 0.0141192s, execution: 12.3373s)
[2021-03-31 03:43:28.017] [global] [info] Cached 246 common rows (0 general rows), memory usage: 7.20 KB/32.00 MB (0.00 B/0.00 B)
[2021-03-31 03:43:28.020] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:43:28.023] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:43:28.025] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:43:28.025] [logical planner] [info] logical optimization took 0.005400ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 03:43:28.026] [codegen] [info] generating pipeline for (Option[str]) -> (str) (1 operator pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str])
[2021-03-31 03:43:28.026] [global] [info] Stage0 depends on: 
[2021-03-31 03:43:28.039] [global] [info] Optimization via LLVM passes took 0.012639 ms
[2021-03-31 03:43:28.044] [global] [info] Compiled code paths for stage 0 in 0.00 ms
[2021-03-31 03:43:28.044] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0177199s
[2021-03-31 03:43:28.044] [driver] [info] [Task Finished] Transform to mem in 0.000032s (246 normal rows, 0 exceptions)
[2021-03-31 03:43:28.044] [global] [info] [Transform Stage] Stage 0 completed 1 load&transform tasks in 4.9148e-05s
[2021-03-31 03:43:28.044] [global] [info] [Transform Stage] Stage 0 total wall clock time: 3.1881e-05s, 246 input rows, time to process 1 row via fast path: 0.000129598ms

[2021-03-31 03:43:28.044] [global] [info] Writing 246 rows as output to file (1.44 KB)
[2021-03-31 03:43:28.044] [driver] [info] [Task Finished] write to file in 0.000060s (246 rows, 1.44 KB)
[2021-03-31 03:43:28.044] [global] [info] writing output took 0.000250s
[2021-03-31 03:43:28.044] [global] [info] [Transform Stage] Stage 0 completed 1 sink tasks in 0.000258517s
[2021-03-31 03:43:28.044] [global] [info] [Transform Stage] Stage 0 took 0.0180449s
[2021-03-31 03:43:28.044] [global] [info] Query Execution took 0.0267599s. (planning: 0.00868176s, execution: 0.0180781s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 29 2021, 06:12:46) 
[GCC 10.2.0] on linux
Tuplex startup time: 0.2703053951263428
{"startupTime": 0.2703053951263428, "readTime": 15.745469808578491, "jobTime": 12.370096445083618, "writeTime": 0.029122114181518555}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 188 active partitions
