[2021-03-31 03:39:09.453] [global] [error] could not find backend, defaulting to local
[2021-03-31 03:39:09.453] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 03:39:09.453] [local ee] [info] initializing LLVM backend
[2021-03-31 03:39:09.453] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 03:39:09.453] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 03:39:09.454] [memory] [info] allocated bitmap managed memory region (100.00 GB, 32.00 MB block size)
[2021-03-31 03:39:09.454] [local execution engine] [info] started driver (100.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 03:39:09.454] [fileinputoperator] [info] found 1 file (1.10 GB) to process.
[2021-03-31 03:39:09.454] [global] [info] sampled file:///data/311/311_preprocessed.csv on 256.00 KB
[2021-03-31 03:39:09.595] [logical planner] [info] logical optimization took 0.007609ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:39:09.595] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:39:09.614] [global] [info] Stage0 depends on: 
[2021-03-31 03:39:09.626] [global] [info] Optimization via LLVM passes took 0.011714 ms
[2021-03-31 03:39:09.633] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:39:09.633] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0183859s
[2021-03-31 03:39:09.633] [local ee] [info] split /data/311/311_preprocessed.csv into 17 tasks
[2021-03-31 03:39:10.520] [driver] [info] [Task Finished] Transform to mem in 0.887636s (11184809 normal rows, 0 exceptions)
[2021-03-31 03:39:11.406] [driver] [info] [Task Finished] Transform to mem in 0.885791s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:39:12.292] [driver] [info] [Task Finished] Transform to mem in 0.886088s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:39:13.176] [driver] [info] [Task Finished] Transform to mem in 0.883550s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:39:14.059] [driver] [info] [Task Finished] Transform to mem in 0.883250s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:39:14.942] [driver] [info] [Task Finished] Transform to mem in 0.882982s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:39:15.825] [driver] [info] [Task Finished] Transform to mem in 0.883252s (11184478 normal rows, 0 exceptions)
[2021-03-31 03:39:16.708] [driver] [info] [Task Finished] Transform to mem in 0.882962s (11184144 normal rows, 0 exceptions)
[2021-03-31 03:39:17.591] [driver] [info] [Task Finished] Transform to mem in 0.883012s (11184810 normal rows, 0 exceptions)
[2021-03-31 03:39:18.475] [driver] [info] [Task Finished] Transform to mem in 0.883369s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:39:19.357] [driver] [info] [Task Finished] Transform to mem in 0.882563s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:39:20.239] [driver] [info] [Task Finished] Transform to mem in 0.881848s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:39:21.121] [driver] [info] [Task Finished] Transform to mem in 0.881984s (11187144 normal rows, 0 exceptions)
[2021-03-31 03:39:22.004] [driver] [info] [Task Finished] Transform to mem in 0.882131s (11183810 normal rows, 0 exceptions)
[2021-03-31 03:39:22.885] [driver] [info] [Task Finished] Transform to mem in 0.881934s (11183811 normal rows, 0 exceptions)
[2021-03-31 03:39:23.767] [driver] [info] [Task Finished] Transform to mem in 0.881867s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:39:25.239] [driver] [info] [Task Finished] Transform to mem in 1.471971s (18675364 normal rows, 0 exceptions)
[2021-03-31 03:39:25.239] [global] [info] [Transform Stage] Stage 0 completed 17 load&transform tasks in 15.6069s
[2021-03-31 03:39:25.239] [global] [info] [Transform Stage] Stage 0 total wall clock time: 15.6062s, 197628000 input rows, time to process 1 row via fast path: 7.89675e-05ms
[2021-03-31 03:39:25.240] [global] [info] [Transform Stage] Stage 0 completed 17 sink tasks in 7.3116e-05s
[2021-03-31 03:39:25.240] [global] [info] [Transform Stage] Stage 0 took 15.6254s
[2021-03-31 03:39:25.240] [global] [info] Query Execution took 15.6553s. (planning: 0.0298778s, execution: 15.6254s)
[2021-03-31 03:39:25.242] [global] [info] Cached 197628000 common rows (0 general rows), memory usage: 5.52 GB/5.81 GB (0.00 B/0.00 B)
[2021-03-31 03:39:25.258] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:25.262] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:25.266] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:25.270] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:25.270] [logical planner] [info] logical optimization took 0.008832ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 0
need to upgrade output type to (Option[str])
[2021-03-31 03:39:25.271] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (3 operators pipelined)
[2021-03-31 03:39:25.271] [codegen] [info] generating function fix_zip_codes for (Option[str]) -> Option[str]
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:39:25.272] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:39:25.272] [global] [info] Stage1 depends on: Stage0 
[2021-03-31 03:39:25.272] [global] [info] Stage0 depends on: 
[2021-03-31 03:39:25.273] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2021-03-31 03:39:25.295] [global] [info] Optimization via LLVM passes took 0.022120 ms
[2021-03-31 03:39:25.302] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:39:25.302] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0299237s
[2021-03-31 03:39:25.374] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071104s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:39:25.445] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071190s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:39:25.516] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071011s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:25.587] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071218s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:25.658] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070594s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:25.729] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071014s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:39:25.800] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071124s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:39:25.870] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070097s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:39:25.941] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071162s (0 normal rows, 0 exceptions, 146 buckets)
[2021-03-31 03:39:26.013] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071447s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:26.013] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000052s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:26.084] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071176s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:26.155] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070866s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:39:26.226] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071335s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:39:26.298] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071246s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:39:26.369] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071254s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:39:26.440] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071185s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:39:26.511] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070806s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:39:26.581] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070393s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:39:26.652] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071158s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:39:26.724] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071373s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:26.724] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000062s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:39:26.795] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071359s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:26.865] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069291s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:26.934] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069214s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:39:27.003] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068688s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:39:27.072] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069457s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:39:27.141] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069051s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:39:27.210] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069266s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:27.280] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069288s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:27.348] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068798s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:39:27.418] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069027s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:39:27.418] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000056s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:27.486] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068820s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:39:27.556] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069081s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:27.625] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069229s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:27.694] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068933s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:39:27.762] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068675s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:39:27.831] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068417s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:39:27.900] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069375s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:39:27.969] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068995s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:39:28.038] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068677s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:28.107] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069102s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:39:28.107] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000087s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:28.177] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069767s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:28.246] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068835s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:39:28.315] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069065s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:39:28.384] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068841s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:39:28.453] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069649s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:39:28.522] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068838s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:39:28.591] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068944s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:39:28.660] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068935s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:39:28.728] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067805s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:28.797] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068692s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:28.866] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069064s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:39:28.935] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068815s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:39:29.003] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068768s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:39:29.072] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068602s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:39:29.141] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069192s (0 normal rows, 0 exceptions, 110 buckets)
[2021-03-31 03:39:29.210] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068625s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:39:29.279] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068722s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:39:29.346] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067825s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:39:29.416] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069434s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:29.485] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068849s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:29.554] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069418s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:29.623] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068885s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:29.692] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069064s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:39:29.761] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068710s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:39:29.830] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068936s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:39:29.899] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069246s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:39:29.969] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069735s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:39:30.038] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068850s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:39:30.107] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069278s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:30.176] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069367s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:30.245] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068755s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:30.314] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069181s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:30.383] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068797s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:39:30.452] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068551s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:39:30.525] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073304s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:39:30.598] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073248s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:30.672] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073305s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:30.745] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073345s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:30.818] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073143s (0 normal rows, 0 exceptions, 161 buckets)
[2021-03-31 03:39:30.891] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.073209s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:39:30.960] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068256s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:39:31.029] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069696s (0 normal rows, 0 exceptions, 106 buckets)
[2021-03-31 03:39:31.099] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069850s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:39:31.168] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069070s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:39:31.237] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068760s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:31.306] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069096s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:39:31.376] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069333s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:39:31.445] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069013s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:31.513] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068205s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:31.582] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068851s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:31.582] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000055s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:31.651] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068751s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:39:31.720] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069076s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:31.789] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068883s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:31.857] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068645s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:39:31.926] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068857s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:31.995] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068635s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:39:32.063] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068647s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:39:32.133] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069049s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:39:32.202] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069068s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:32.271] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069043s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:32.271] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000053s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:32.340] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068836s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:39:32.409] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069334s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:39:32.477] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068498s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:39:32.546] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068842s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:39:32.616] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069274s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:39:32.685] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068916s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:39:32.753] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068821s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:32.822] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069060s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:32.891] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068878s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:39:32.961] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069122s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:39:32.961] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000051s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:33.029] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068300s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:39:33.098] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068755s (0 normal rows, 0 exceptions, 105 buckets)
[2021-03-31 03:39:33.166] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068813s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:33.236] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069151s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:33.304] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068764s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:33.373] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068631s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:33.442] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068998s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:39:33.511] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068739s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:39:33.580] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068844s (0 normal rows, 0 exceptions, 104 buckets)
[2021-03-31 03:39:33.649] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069033s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:33.717] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067982s (0 normal rows, 0 exceptions, 164 buckets)
[2021-03-31 03:39:33.785] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068406s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:33.855] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069430s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:39:33.924] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068981s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:39:33.993] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068917s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:39:34.061] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068808s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:39:34.129] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067954s (0 normal rows, 0 exceptions, 132 buckets)
[2021-03-31 03:39:34.199] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069099s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:34.268] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069027s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:34.337] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069232s (0 normal rows, 0 exceptions, 129 buckets)
[2021-03-31 03:39:34.337] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000170s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:39:34.406] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068834s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:34.475] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068794s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:34.544] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069394s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:34.613] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068727s (0 normal rows, 0 exceptions, 99 buckets)
[2021-03-31 03:39:34.682] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068948s (0 normal rows, 0 exceptions, 94 buckets)
[2021-03-31 03:39:34.751] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069056s (0 normal rows, 0 exceptions, 141 buckets)
[2021-03-31 03:39:34.820] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068922s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:39:34.889] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068851s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:34.958] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069073s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:35.026] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068083s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:39:35.094] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068625s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:39:35.163] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068763s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:39:35.232] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068909s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:35.301] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069042s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:35.370] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068619s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:35.439] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068869s (0 normal rows, 0 exceptions, 160 buckets)
[2021-03-31 03:39:35.507] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068633s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:39:35.576] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068891s (0 normal rows, 0 exceptions, 96 buckets)
[2021-03-31 03:39:35.645] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068739s (0 normal rows, 0 exceptions, 107 buckets)
[2021-03-31 03:39:35.713] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068316s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:35.782] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068996s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:35.851] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068574s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:35.920] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068931s (0 normal rows, 0 exceptions, 163 buckets)
[2021-03-31 03:39:35.988] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068400s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:39:36.057] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068870s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:39:36.126] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068863s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:39:36.195] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068879s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:39:36.264] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068764s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:39:36.333] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068753s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:39:36.402] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069720s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:39:36.402] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000052s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:36.471] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068707s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:36.540] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068504s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:39:36.609] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068818s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:39:36.677] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068366s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:39:36.746] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069079s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:39:36.815] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069016s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:36.884] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069020s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:36.953] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068991s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:39:37.022] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069054s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:37.090] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068223s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:39:37.159] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068283s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:37.228] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069291s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:39:37.297] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069242s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:37.366] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068701s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:37.436] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069578s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:39:37.504] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068656s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:39:37.552] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.047755s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:39:37.552] [global] [info] [Transform Stage] Stage 0 completed 186 load&transform tasks in 12.2496s
[2021-03-31 03:39:37.552] [global] [info] [Transform Stage] Stage 0 total wall clock time: 12.2461s, 197628000 input rows, time to process 1 row via fast path: 6.19653e-05ms
[2021-03-31 03:39:37.556] [global] [info] [Transform Stage] Stage 0 completed 186 sink tasks in 0.00359131s
[2021-03-31 03:39:37.556] [global] [info] [Transform Stage] Stage 0 took 12.2832s
[2021-03-31 03:39:37.568] [global] [info] Optimization via LLVM passes took 0.011876 ms
[2021-03-31 03:39:37.572] [global] [info] Compiled code paths for stage 1 in 0.00 ms
[2021-03-31 03:39:37.572] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.0167558s
[2021-03-31 03:39:37.573] [driver] [info] [Task Finished] Transform to mem in 0.000046s (246 normal rows, 0 exceptions)
[2021-03-31 03:39:37.573] [global] [info] [Transform Stage] Stage 1 completed 1 load&transform tasks in 6.6358e-05s
[2021-03-31 03:39:37.573] [global] [info] [Transform Stage] Stage 1 total wall clock time: 4.6053e-05s, 246 input rows, time to process 1 row via fast path: 0.000187207ms
[2021-03-31 03:39:37.573] [global] [info] [Transform Stage] Stage 1 completed 1 sink tasks in 4.053e-06s
[2021-03-31 03:39:37.573] [global] [info] [Transform Stage] Stage 1 took 0.0168444s
[2021-03-31 03:39:37.573] [global] [info] Query Execution took 12.3144s. (planning: 0.0142714s, execution: 12.3001s)
[2021-03-31 03:39:37.575] [global] [info] Cached 246 common rows (0 general rows), memory usage: 7.20 KB/32.00 MB (0.00 B/0.00 B)
[2021-03-31 03:39:37.578] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:37.580] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:37.583] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:37.583] [logical planner] [info] logical optimization took 0.005374ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 03:39:37.583] [codegen] [info] generating pipeline for (Option[str]) -> (str) (1 operator pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str])
[2021-03-31 03:39:37.584] [global] [info] Stage0 depends on: 
[2021-03-31 03:39:37.597] [global] [info] Optimization via LLVM passes took 0.012570 ms
[2021-03-31 03:39:37.601] [global] [info] Compiled code paths for stage 0 in 0.00 ms
[2021-03-31 03:39:37.601] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0175727s
[2021-03-31 03:39:37.601] [driver] [info] [Task Finished] Transform to mem in 0.000033s (246 normal rows, 0 exceptions)
[2021-03-31 03:39:37.601] [global] [info] [Transform Stage] Stage 0 completed 1 load&transform tasks in 5.3269e-05s
[2021-03-31 03:39:37.601] [global] [info] [Transform Stage] Stage 0 total wall clock time: 3.349e-05s, 246 input rows, time to process 1 row via fast path: 0.000136138ms

[2021-03-31 03:39:37.602] [global] [info] Writing 246 rows as output to file (1.44 KB)
[2021-03-31 03:39:37.602] [driver] [info] [Task Finished] write to file in 0.000092s (246 rows, 1.44 KB)
[2021-03-31 03:39:37.602] [global] [info] writing output took 0.000277s
[2021-03-31 03:39:37.602] [global] [info] [Transform Stage] Stage 0 completed 1 sink tasks in 0.000285457s
[2021-03-31 03:39:37.602] [global] [info] [Transform Stage] Stage 0 took 0.0179456s
[2021-03-31 03:39:37.602] [global] [info] Query Execution took 0.0266086s. (planning: 0.00864558s, execution: 0.017963s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 29 2021, 06:12:46) 
[GCC 10.2.0] on linux
Tuplex startup time: 0.27025651931762695
{"startupTime": 0.27025651931762695, "readTime": 15.787986278533936, "jobTime": 12.33323049545288, "writeTime": 0.0290524959564209}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 188 active partitions
