[2021-03-31 03:38:40.805] [global] [error] could not find backend, defaulting to local
[2021-03-31 03:38:40.805] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 03:38:40.805] [local ee] [info] initializing LLVM backend
[2021-03-31 03:38:40.805] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 03:38:40.805] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 03:38:40.806] [memory] [info] allocated bitmap managed memory region (100.00 GB, 32.00 MB block size)
[2021-03-31 03:38:40.806] [local execution engine] [info] started driver (100.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 03:38:40.806] [fileinputoperator] [info] found 1 file (1.10 GB) to process.
[2021-03-31 03:38:40.806] [global] [info] sampled file:///data/311/311_preprocessed.csv on 256.00 KB
[2021-03-31 03:38:40.947] [logical planner] [info] logical optimization took 0.007566ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:38:40.947] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:38:40.966] [global] [info] Stage0 depends on: 
[2021-03-31 03:38:40.978] [global] [info] Optimization via LLVM passes took 0.011642 ms
[2021-03-31 03:38:40.984] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:38:40.984] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0183248s
[2021-03-31 03:38:40.984] [local ee] [info] split /data/311/311_preprocessed.csv into 17 tasks
[2021-03-31 03:38:41.870] [driver] [info] [Task Finished] Transform to mem in 0.886189s (11184809 normal rows, 0 exceptions)
[2021-03-31 03:38:42.755] [driver] [info] [Task Finished] Transform to mem in 0.884436s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:38:43.643] [driver] [info] [Task Finished] Transform to mem in 0.887995s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:38:44.524] [driver] [info] [Task Finished] Transform to mem in 0.881460s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:38:45.406] [driver] [info] [Task Finished] Transform to mem in 0.881081s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:38:46.288] [driver] [info] [Task Finished] Transform to mem in 0.882520s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:38:47.170] [driver] [info] [Task Finished] Transform to mem in 0.881439s (11184478 normal rows, 0 exceptions)
[2021-03-31 03:38:48.051] [driver] [info] [Task Finished] Transform to mem in 0.881571s (11184144 normal rows, 0 exceptions)
[2021-03-31 03:38:48.933] [driver] [info] [Task Finished] Transform to mem in 0.881387s (11184810 normal rows, 0 exceptions)
[2021-03-31 03:38:49.814] [driver] [info] [Task Finished] Transform to mem in 0.881495s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:38:50.695] [driver] [info] [Task Finished] Transform to mem in 0.881123s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:38:51.575] [driver] [info] [Task Finished] Transform to mem in 0.879864s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:38:52.456] [driver] [info] [Task Finished] Transform to mem in 0.880365s (11187144 normal rows, 0 exceptions)
[2021-03-31 03:38:53.336] [driver] [info] [Task Finished] Transform to mem in 0.880488s (11183810 normal rows, 0 exceptions)
[2021-03-31 03:38:54.216] [driver] [info] [Task Finished] Transform to mem in 0.880130s (11183811 normal rows, 0 exceptions)
[2021-03-31 03:38:55.096] [driver] [info] [Task Finished] Transform to mem in 0.880118s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:38:56.567] [driver] [info] [Task Finished] Transform to mem in 1.470608s (18675364 normal rows, 0 exceptions)
[2021-03-31 03:38:56.567] [global] [info] [Transform Stage] Stage 0 completed 17 load&transform tasks in 15.5829s
[2021-03-31 03:38:56.567] [global] [info] [Transform Stage] Stage 0 total wall clock time: 15.5823s, 197628000 input rows, time to process 1 row via fast path: 7.88465e-05ms
[2021-03-31 03:38:56.567] [global] [info] [Transform Stage] Stage 0 completed 17 sink tasks in 7.2761e-05s
[2021-03-31 03:38:56.567] [global] [info] [Transform Stage] Stage 0 took 15.6014s
[2021-03-31 03:38:56.567] [global] [info] Query Execution took 15.631s. (planning: 0.0296174s, execution: 15.6014s)
[2021-03-31 03:38:56.569] [global] [info] Cached 197628000 common rows (0 general rows), memory usage: 5.52 GB/5.81 GB (0.00 B/0.00 B)
[2021-03-31 03:38:56.586] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:56.589] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:56.594] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:56.598] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:56.598] [logical planner] [info] logical optimization took 0.008760ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 0
need to upgrade output type to (Option[str])
[2021-03-31 03:38:56.598] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (3 operators pipelined)
[2021-03-31 03:38:56.599] [codegen] [info] generating function fix_zip_codes for (Option[str]) -> Option[str]
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:38:56.600] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:38:56.600] [global] [info] Stage1 depends on: Stage0 
[2021-03-31 03:38:56.600] [global] [info] Stage0 depends on: 
[2021-03-31 03:38:56.601] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2021-03-31 03:38:56.623] [global] [info] Optimization via LLVM passes took 0.022316 ms
[2021-03-31 03:38:56.630] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:38:56.630] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0300412s
[2021-03-31 03:38:56.699] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068753s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:38:56.767] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067987s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:38:56.835] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068277s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:56.904] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068591s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:56.973] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069039s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:57.041] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068243s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:38:57.109] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067993s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:38:57.177] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068170s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:38:57.246] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068344s (0 normal rows, 0 exceptions, 146 buckets)
[2021-03-31 03:38:57.316] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070538s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:57.316] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000030s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:57.385] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068456s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:57.456] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070946s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:38:57.524] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068335s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:38:57.593] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068537s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:38:57.661] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067944s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:38:57.730] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069126s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:38:57.798] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068099s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:38:57.866] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068348s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:38:57.936] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069545s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:38:58.005] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068967s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:58.005] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000083s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:38:58.073] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068357s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:58.141] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068050s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:58.210] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068909s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:38:58.279] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068282s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:38:58.347] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068116s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:38:58.415] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068435s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:38:58.484] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068398s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:58.552] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068137s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:38:58.620] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067851s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:38:58.688] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068284s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:38:58.688] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000051s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:58.759] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071217s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:38:58.829] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069761s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:58.898] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068408s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:58.966] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068908s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:38:59.035] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068916s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:38:59.105] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069202s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:38:59.173] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067947s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:38:59.241] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068445s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:38:59.310] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068430s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:38:59.379] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069887s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:38:59.380] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000056s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:59.448] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068871s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:59.519] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070164s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:38:59.590] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071497s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:38:59.658] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068220s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:38:59.727] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068283s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:38:59.795] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067899s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:38:59.864] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069781s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:38:59.933] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068156s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:39:00.001] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068111s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:00.069] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067923s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:00.138] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069092s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:39:00.206] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068127s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:39:00.275] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069270s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:39:00.344] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068580s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:39:00.412] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068034s (0 normal rows, 0 exceptions, 110 buckets)
[2021-03-31 03:39:00.481] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069534s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:39:00.550] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068371s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:39:00.618] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068008s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:39:00.686] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068100s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:00.754] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068345s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:00.823] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069271s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:00.892] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068827s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:00.961] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068738s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:39:01.029] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067984s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:39:01.097] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067948s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:39:01.166] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068579s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:39:01.235] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069049s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:39:01.304] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068887s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:39:01.373] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069417s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:01.441] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068409s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:01.510] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068456s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:01.578] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068498s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:01.647] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068139s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:39:01.716] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069081s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:39:01.785] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068807s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:39:01.853] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068692s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:01.922] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069032s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:01.994] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071697s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:02.066] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071593s (0 normal rows, 0 exceptions, 161 buckets)
[2021-03-31 03:39:02.134] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068793s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:39:02.203] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068835s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:39:02.272] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068947s (0 normal rows, 0 exceptions, 106 buckets)
[2021-03-31 03:39:02.340] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067546s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:39:02.409] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068732s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:39:02.477] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068488s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:02.546] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068607s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:39:02.615] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068797s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:39:02.683] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068801s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:02.751] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067521s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:02.819] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068167s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:02.819] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000027s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:02.888] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068423s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:39:02.956] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068577s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:03.025] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068416s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:03.093] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068382s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:39:03.161] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068248s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:03.230] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069015s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:39:03.299] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068784s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:39:03.367] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068274s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:39:03.435] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068007s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:03.504] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068900s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:03.504] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:03.573] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068916s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:39:03.642] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068965s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:39:03.711] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068552s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:39:03.779] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068598s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:39:03.849] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069054s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:39:03.917] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068874s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:39:03.986] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068974s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:04.056] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069437s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:04.125] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069308s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:39:04.194] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069078s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:39:04.194] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:04.263] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069024s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:39:04.333] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069881s (0 normal rows, 0 exceptions, 105 buckets)
[2021-03-31 03:39:04.402] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068280s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:04.471] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068956s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:39:04.540] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069044s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:04.608] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068679s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:04.678] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069287s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:39:04.747] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069503s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:39:04.816] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068448s (0 normal rows, 0 exceptions, 104 buckets)
[2021-03-31 03:39:04.884] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068643s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:04.953] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069186s (0 normal rows, 0 exceptions, 164 buckets)
[2021-03-31 03:39:05.023] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069876s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:05.093] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069279s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:39:05.162] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069479s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:39:05.231] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069118s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:39:05.300] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069117s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:39:05.369] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068888s (0 normal rows, 0 exceptions, 132 buckets)
[2021-03-31 03:39:05.441] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071374s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:05.509] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068343s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:05.577] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.067996s (0 normal rows, 0 exceptions, 129 buckets)
[2021-03-31 03:39:05.577] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000161s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:39:05.647] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069811s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:05.715] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068085s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:05.784] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069272s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:05.853] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068945s (0 normal rows, 0 exceptions, 99 buckets)
[2021-03-31 03:39:05.922] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068378s (0 normal rows, 0 exceptions, 94 buckets)
[2021-03-31 03:39:05.990] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068364s (0 normal rows, 0 exceptions, 141 buckets)
[2021-03-31 03:39:06.059] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068660s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:39:06.130] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071127s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:39:06.199] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068769s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:06.268] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069272s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:39:06.338] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069686s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:39:06.408] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069884s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:39:06.477] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069306s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:39:06.546] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069372s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:39:06.616] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069266s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:39:06.685] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069335s (0 normal rows, 0 exceptions, 160 buckets)
[2021-03-31 03:39:06.754] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069370s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:39:06.825] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070605s (0 normal rows, 0 exceptions, 96 buckets)
[2021-03-31 03:39:06.894] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069202s (0 normal rows, 0 exceptions, 107 buckets)
[2021-03-31 03:39:06.964] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069886s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:07.034] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069288s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:07.103] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068981s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:07.171] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068965s (0 normal rows, 0 exceptions, 163 buckets)
[2021-03-31 03:39:07.241] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069044s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:39:07.309] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068359s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:39:07.377] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068094s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:39:07.446] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069182s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:39:07.517] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070702s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:39:07.585] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068461s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:39:07.654] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068730s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:39:07.654] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000049s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:39:07.724] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069976s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:07.793] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068815s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:39:07.862] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068631s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:39:07.931] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068881s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:39:08.000] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068892s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:39:08.069] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069206s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:08.138] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069427s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:08.207] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069151s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:39:08.277] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069687s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:08.346] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068717s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:39:08.416] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070172s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:39:08.485] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069177s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:39:08.554] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068814s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:39:08.623] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069000s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:39:08.692] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069037s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:39:08.761] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068660s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:39:08.809] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.048182s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:39:08.809] [global] [info] [Transform Stage] Stage 0 completed 186 load&transform tasks in 12.1789s
[2021-03-31 03:39:08.809] [global] [info] [Transform Stage] Stage 0 total wall clock time: 12.1754s, 197628000 input rows, time to process 1 row via fast path: 6.16079e-05ms
[2021-03-31 03:39:08.813] [global] [info] [Transform Stage] Stage 0 completed 186 sink tasks in 0.00361206s
[2021-03-31 03:39:08.813] [global] [info] [Transform Stage] Stage 0 took 12.2126s
[2021-03-31 03:39:08.825] [global] [info] Optimization via LLVM passes took 0.011904 ms
[2021-03-31 03:39:08.829] [global] [info] Compiled code paths for stage 1 in 0.00 ms
[2021-03-31 03:39:08.829] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.0167087s
[2021-03-31 03:39:08.829] [driver] [info] [Task Finished] Transform to mem in 0.000043s (246 normal rows, 0 exceptions)
[2021-03-31 03:39:08.829] [global] [info] [Transform Stage] Stage 1 completed 1 load&transform tasks in 6.196e-05s
[2021-03-31 03:39:08.829] [global] [info] [Transform Stage] Stage 1 total wall clock time: 4.2955e-05s, 246 input rows, time to process 1 row via fast path: 0.000174614ms
[2021-03-31 03:39:08.829] [global] [info] [Transform Stage] Stage 1 completed 1 sink tasks in 4e-06s
[2021-03-31 03:39:08.829] [global] [info] [Transform Stage] Stage 1 took 0.0167931s
[2021-03-31 03:39:08.829] [global] [info] Query Execution took 12.2437s. (planning: 0.0141395s, execution: 12.2295s)
[2021-03-31 03:39:08.832] [global] [info] Cached 246 common rows (0 general rows), memory usage: 7.20 KB/32.00 MB (0.00 B/0.00 B)
[2021-03-31 03:39:08.835] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:08.837] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:08.840] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:39:08.840] [logical planner] [info] logical optimization took 0.005323ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 03:39:08.840] [codegen] [info] generating pipeline for (Option[str]) -> (str) (1 operator pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str])
[2021-03-31 03:39:08.841] [global] [info] Stage0 depends on: 
[2021-03-31 03:39:08.854] [global] [info] Optimization via LLVM passes took 0.012640 ms
[2021-03-31 03:39:08.858] [global] [info] Compiled code paths for stage 0 in 0.00 ms
[2021-03-31 03:39:08.858] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0176111s
[2021-03-31 03:39:08.858] [driver] [info] [Task Finished] Transform to mem in 0.000032s (246 normal rows, 0 exceptions)
[2021-03-31 03:39:08.858] [global] [info] [Transform Stage] Stage 0 completed 1 load&transform tasks in 4.9676e-05s
[2021-03-31 03:39:08.858] [global] [info] [Transform Stage] Stage 0 total wall clock time: 3.1941e-05s, 246 input rows, time to process 1 row via fast path: 0.000129841ms

[2021-03-31 03:39:08.858] [global] [info] Writing 246 rows as output to file (1.44 KB)
[2021-03-31 03:39:08.859] [driver] [info] [Task Finished] write to file in 0.000061s (246 rows, 1.44 KB)
[2021-03-31 03:39:08.859] [global] [info] writing output took 0.000257s
[2021-03-31 03:39:08.859] [global] [info] [Transform Stage] Stage 0 completed 1 sink tasks in 0.000265403s
[2021-03-31 03:39:08.859] [global] [info] [Transform Stage] Stage 0 took 0.0179603s
[2021-03-31 03:39:08.859] [global] [info] Query Execution took 0.0265813s. (planning: 0.00860327s, execution: 0.017978s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 29 2021, 06:12:46) 
[GCC 10.2.0] on linux
Tuplex startup time: 0.26952219009399414
{"startupTime": 0.26952219009399414, "readTime": 15.763610601425171, "jobTime": 12.262477397918701, "writeTime": 0.028970718383789062}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 188 active partitions
