[2021-03-31 03:38:11.770] [global] [error] could not find backend, defaulting to local
[2021-03-31 03:38:11.770] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 03:38:11.770] [local ee] [info] initializing LLVM backend
[2021-03-31 03:38:11.770] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 03:38:11.770] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 03:38:11.771] [memory] [info] allocated bitmap managed memory region (100.00 GB, 32.00 MB block size)
[2021-03-31 03:38:11.771] [local execution engine] [info] started driver (100.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 03:38:11.771] [fileinputoperator] [info] found 1 file (1.10 GB) to process.
[2021-03-31 03:38:11.772] [global] [info] sampled file:///data/311/311_preprocessed.csv on 256.00 KB
[2021-03-31 03:38:11.916] [logical planner] [info] logical optimization took 0.007593ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:38:11.916] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:38:11.935] [global] [info] Stage0 depends on: 
[2021-03-31 03:38:11.948] [global] [info] Optimization via LLVM passes took 0.011732 ms
[2021-03-31 03:38:11.954] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:38:11.954] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0183946s
[2021-03-31 03:38:11.954] [local ee] [info] split /data/311/311_preprocessed.csv into 17 tasks
[2021-03-31 03:38:12.841] [driver] [info] [Task Finished] Transform to mem in 0.886721s (11184809 normal rows, 0 exceptions)
[2021-03-31 03:38:13.726] [driver] [info] [Task Finished] Transform to mem in 0.884934s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:38:14.611] [driver] [info] [Task Finished] Transform to mem in 0.885300s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:38:15.492] [driver] [info] [Task Finished] Transform to mem in 0.881536s (11185477 normal rows, 0 exceptions)
[2021-03-31 03:38:16.374] [driver] [info] [Task Finished] Transform to mem in 0.881746s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:38:17.256] [driver] [info] [Task Finished] Transform to mem in 0.881774s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:38:18.138] [driver] [info] [Task Finished] Transform to mem in 0.882202s (11184478 normal rows, 0 exceptions)
[2021-03-31 03:38:19.021] [driver] [info] [Task Finished] Transform to mem in 0.882335s (11184144 normal rows, 0 exceptions)
[2021-03-31 03:38:19.903] [driver] [info] [Task Finished] Transform to mem in 0.881832s (11184810 normal rows, 0 exceptions)
[2021-03-31 03:38:20.784] [driver] [info] [Task Finished] Transform to mem in 0.881618s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:38:21.666] [driver] [info] [Task Finished] Transform to mem in 0.881433s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:38:22.546] [driver] [info] [Task Finished] Transform to mem in 0.880315s (11183144 normal rows, 0 exceptions)
[2021-03-31 03:38:23.427] [driver] [info] [Task Finished] Transform to mem in 0.880865s (11187144 normal rows, 0 exceptions)
[2021-03-31 03:38:24.307] [driver] [info] [Task Finished] Transform to mem in 0.880227s (11183810 normal rows, 0 exceptions)
[2021-03-31 03:38:25.188] [driver] [info] [Task Finished] Transform to mem in 0.880568s (11183811 normal rows, 0 exceptions)
[2021-03-31 03:38:26.068] [driver] [info] [Task Finished] Transform to mem in 0.880585s (11184811 normal rows, 0 exceptions)
[2021-03-31 03:38:27.539] [driver] [info] [Task Finished] Transform to mem in 1.470288s (18675364 normal rows, 0 exceptions)
[2021-03-31 03:38:27.539] [global] [info] [Transform Stage] Stage 0 completed 17 load&transform tasks in 15.5849s
[2021-03-31 03:38:27.539] [global] [info] [Transform Stage] Stage 0 total wall clock time: 15.5843s, 197628000 input rows, time to process 1 row via fast path: 7.88566e-05ms
[2021-03-31 03:38:27.539] [global] [info] [Transform Stage] Stage 0 completed 17 sink tasks in 8.7914e-05s
[2021-03-31 03:38:27.539] [global] [info] [Transform Stage] Stage 0 took 15.6035s
[2021-03-31 03:38:27.539] [global] [info] Query Execution took 15.6331s. (planning: 0.029653s, execution: 15.6035s)
[2021-03-31 03:38:27.541] [global] [info] Cached 197628000 common rows (0 general rows), memory usage: 5.52 GB/5.81 GB (0.00 B/0.00 B)
[2021-03-31 03:38:27.557] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:27.561] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:27.565] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:27.570] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:27.570] [logical planner] [info] logical optimization took 0.008799ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 0
need to upgrade output type to (Option[str])
[2021-03-31 03:38:27.570] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (3 operators pipelined)
[2021-03-31 03:38:27.570] [codegen] [info] generating function fix_zip_codes for (Option[str]) -> Option[str]
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 1
[2021-03-31 03:38:27.571] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (1 operator pipelined)
[2021-03-31 03:38:27.572] [global] [info] Stage1 depends on: Stage0 
[2021-03-31 03:38:27.572] [global] [info] Stage0 depends on: 
[2021-03-31 03:38:27.572] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2021-03-31 03:38:27.595] [global] [info] Optimization via LLVM passes took 0.022263 ms
[2021-03-31 03:38:27.602] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:38:27.602] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0300639s
[2021-03-31 03:38:27.672] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069872s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:38:27.741] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069082s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:38:27.810] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069192s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:27.880] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069339s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:27.949] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069568s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:28.018] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069147s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:38:28.088] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069293s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:38:28.157] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069268s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:38:28.226] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069118s (0 normal rows, 0 exceptions, 146 buckets)
[2021-03-31 03:38:28.295] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069320s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:28.295] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000025s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:28.364] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069065s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:28.433] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068924s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:38:28.503] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069246s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:38:28.573] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069877s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:38:28.644] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071217s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:38:28.714] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070017s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:38:28.783] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068977s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:38:28.852] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069450s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:38:28.922] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069421s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:38:28.992] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069727s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:28.992] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000083s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:38:29.061] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069199s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:29.130] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068916s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:29.199] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069438s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:38:29.269] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069292s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:38:29.338] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069280s (0 normal rows, 0 exceptions, 115 buckets)
[2021-03-31 03:38:29.407] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069288s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:38:29.477] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069391s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:29.547] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070720s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:38:29.616] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068962s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:38:29.686] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069424s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:38:29.686] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000049s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:29.755] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069136s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:38:29.824] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069186s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:29.895] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070715s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:29.964] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069220s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:38:30.033] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069292s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:38:30.103] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069260s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:38:30.172] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068870s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:38:30.241] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069457s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:38:30.310] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069104s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:38:30.379] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069059s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:38:30.379] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000058s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:30.449] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069520s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:30.519] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069907s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:38:30.588] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069536s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:38:30.658] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069677s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:38:30.728] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069595s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:38:30.797] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069287s (0 normal rows, 0 exceptions, 121 buckets)
[2021-03-31 03:38:30.868] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071018s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:38:30.937] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069282s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:38:31.006] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068935s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:38:31.075] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068953s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:38:31.146] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070378s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:38:31.215] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069437s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:38:31.285] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069642s (0 normal rows, 0 exceptions, 122 buckets)
[2021-03-31 03:38:31.356] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070916s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:38:31.426] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070060s (0 normal rows, 0 exceptions, 110 buckets)
[2021-03-31 03:38:31.495] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069162s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:38:31.564] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069216s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:38:31.633] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069104s (0 normal rows, 0 exceptions, 134 buckets)
[2021-03-31 03:38:31.702] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069209s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:31.771] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068872s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:31.840] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069017s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:31.911] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070631s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:31.980] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069165s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:38:32.049] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069093s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:38:32.119] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069623s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:38:32.188] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069070s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:38:32.257] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069185s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:38:32.331] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074118s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:38:32.407] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.075345s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:32.476] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069077s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:32.545] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069019s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:38:32.615] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070406s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:32.686] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070201s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:38:32.756] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070165s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:38:32.825] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069306s (0 normal rows, 0 exceptions, 116 buckets)
[2021-03-31 03:38:32.895] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070100s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:32.965] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070158s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:33.036] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070264s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:33.106] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070616s (0 normal rows, 0 exceptions, 161 buckets)
[2021-03-31 03:38:33.175] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069223s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:38:33.246] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070331s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:38:33.316] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070249s (0 normal rows, 0 exceptions, 106 buckets)
[2021-03-31 03:38:33.386] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070076s (0 normal rows, 0 exceptions, 119 buckets)
[2021-03-31 03:38:33.457] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070547s (0 normal rows, 0 exceptions, 148 buckets)
[2021-03-31 03:38:33.527] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070258s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:38:33.597] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070218s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:38:33.668] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070359s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:38:33.738] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070116s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:38:33.808] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070036s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:33.878] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070003s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:33.878] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000023s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:33.948] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070238s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:38:34.019] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070421s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:38:34.087] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068867s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:38:34.158] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070183s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:38:34.228] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070081s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:38:34.297] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069538s (0 normal rows, 0 exceptions, 135 buckets)
[2021-03-31 03:38:34.367] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069333s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:38:34.436] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068850s (0 normal rows, 0 exceptions, 127 buckets)
[2021-03-31 03:38:34.507] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071426s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:34.578] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.071261s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:38:34.578] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000049s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:34.647] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069054s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:38:34.717] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069366s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:38:34.787] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069749s (0 normal rows, 0 exceptions, 120 buckets)
[2021-03-31 03:38:34.855] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068756s (0 normal rows, 0 exceptions, 103 buckets)
[2021-03-31 03:38:34.924] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068818s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:38:34.994] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069374s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:38:35.062] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068902s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:38:35.132] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069275s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:38:35.201] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068880s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:38:35.270] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069159s (0 normal rows, 0 exceptions, 112 buckets)
[2021-03-31 03:38:35.270] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000050s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:35.339] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069405s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:38:35.417] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.078027s (0 normal rows, 0 exceptions, 105 buckets)
[2021-03-31 03:38:35.492] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074966s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:35.567] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074554s (0 normal rows, 0 exceptions, 157 buckets)
[2021-03-31 03:38:35.645] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.077934s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:38:35.719] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074197s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:35.794] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074489s (0 normal rows, 0 exceptions, 124 buckets)
[2021-03-31 03:38:35.868] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074225s (0 normal rows, 0 exceptions, 113 buckets)
[2021-03-31 03:38:35.942] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074131s (0 normal rows, 0 exceptions, 104 buckets)
[2021-03-31 03:38:36.016] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074233s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:38:36.092] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.075565s (0 normal rows, 0 exceptions, 164 buckets)
[2021-03-31 03:38:36.169] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.077371s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:38:36.244] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074388s (0 normal rows, 0 exceptions, 136 buckets)
[2021-03-31 03:38:36.319] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074909s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:38:36.395] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.076647s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:38:36.470] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074448s (0 normal rows, 0 exceptions, 156 buckets)
[2021-03-31 03:38:36.544] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074453s (0 normal rows, 0 exceptions, 132 buckets)
[2021-03-31 03:38:36.619] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074509s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:36.693] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074394s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:36.768] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074575s (0 normal rows, 0 exceptions, 129 buckets)
[2021-03-31 03:38:36.768] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000172s (0 normal rows, 0 exceptions, 2 buckets)
[2021-03-31 03:38:36.845] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.076651s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:36.920] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.075235s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:36.995] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.075026s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:37.074] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.079583s (0 normal rows, 0 exceptions, 99 buckets)
[2021-03-31 03:38:37.150] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.075230s (0 normal rows, 0 exceptions, 94 buckets)
[2021-03-31 03:38:37.224] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074564s (0 normal rows, 0 exceptions, 141 buckets)
[2021-03-31 03:38:37.299] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074528s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:38:37.374] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074765s (0 normal rows, 0 exceptions, 153 buckets)
[2021-03-31 03:38:37.448] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074698s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:38:37.523] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074614s (0 normal rows, 0 exceptions, 125 buckets)
[2021-03-31 03:38:37.601] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.077707s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:38:37.676] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.075819s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:38:37.751] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074357s (0 normal rows, 0 exceptions, 149 buckets)
[2021-03-31 03:38:37.826] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.075047s (0 normal rows, 0 exceptions, 154 buckets)
[2021-03-31 03:38:37.901] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074572s (0 normal rows, 0 exceptions, 152 buckets)
[2021-03-31 03:38:37.975] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074598s (0 normal rows, 0 exceptions, 160 buckets)
[2021-03-31 03:38:38.050] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074558s (0 normal rows, 0 exceptions, 139 buckets)
[2021-03-31 03:38:38.126] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.076395s (0 normal rows, 0 exceptions, 96 buckets)
[2021-03-31 03:38:38.200] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074246s (0 normal rows, 0 exceptions, 107 buckets)
[2021-03-31 03:38:38.275] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074480s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:38:38.352] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.076869s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:38:38.427] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.075164s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:38.501] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074416s (0 normal rows, 0 exceptions, 163 buckets)
[2021-03-31 03:38:38.576] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074969s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:38:38.651] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074427s (0 normal rows, 0 exceptions, 109 buckets)
[2021-03-31 03:38:38.726] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.074673s (0 normal rows, 0 exceptions, 108 buckets)
[2021-03-31 03:38:38.795] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069122s (0 normal rows, 0 exceptions, 126 buckets)
[2021-03-31 03:38:38.864] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068972s (0 normal rows, 0 exceptions, 155 buckets)
[2021-03-31 03:38:38.933] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069150s (0 normal rows, 0 exceptions, 159 buckets)
[2021-03-31 03:38:39.003] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070533s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:38:39.003] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.000053s (0 normal rows, 0 exceptions, 1 bucket)
[2021-03-31 03:38:39.073] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069837s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:39.142] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068713s (0 normal rows, 0 exceptions, 140 buckets)
[2021-03-31 03:38:39.211] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068751s (0 normal rows, 0 exceptions, 101 buckets)
[2021-03-31 03:38:39.280] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069490s (0 normal rows, 0 exceptions, 111 buckets)
[2021-03-31 03:38:39.350] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069349s (0 normal rows, 0 exceptions, 143 buckets)
[2021-03-31 03:38:39.419] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068965s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:39.488] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069180s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:39.556] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068629s (0 normal rows, 0 exceptions, 117 buckets)
[2021-03-31 03:38:39.625] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069010s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:38:39.695] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069163s (0 normal rows, 0 exceptions, 150 buckets)
[2021-03-31 03:38:39.765] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069968s (0 normal rows, 0 exceptions, 145 buckets)
[2021-03-31 03:38:39.834] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069350s (0 normal rows, 0 exceptions, 118 buckets)
[2021-03-31 03:38:39.903] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068907s (0 normal rows, 0 exceptions, 147 buckets)
[2021-03-31 03:38:39.974] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.070920s (0 normal rows, 0 exceptions, 151 buckets)
[2021-03-31 03:38:40.043] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.069236s (0 normal rows, 0 exceptions, 142 buckets)
[2021-03-31 03:38:40.112] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.068800s (0 normal rows, 0 exceptions, 144 buckets)
[2021-03-31 03:38:40.160] [driver] [info] [Task Finished] Transform to in-memory hash table in 0.048129s (0 normal rows, 0 exceptions, 123 buckets)
[2021-03-31 03:38:40.160] [global] [info] [Transform Stage] Stage 0 completed 186 load&transform tasks in 12.5584s
[2021-03-31 03:38:40.160] [global] [info] [Transform Stage] Stage 0 total wall clock time: 12.5549s, 197628000 input rows, time to process 1 row via fast path: 6.35279e-05ms
[2021-03-31 03:38:40.164] [global] [info] [Transform Stage] Stage 0 completed 186 sink tasks in 0.00366756s
[2021-03-31 03:38:40.164] [global] [info] [Transform Stage] Stage 0 took 12.5921s
[2021-03-31 03:38:40.176] [global] [info] Optimization via LLVM passes took 0.011983 ms
[2021-03-31 03:38:40.181] [global] [info] Compiled code paths for stage 1 in 0.00 ms
[2021-03-31 03:38:40.181] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.0168181s
[2021-03-31 03:38:40.181] [driver] [info] [Task Finished] Transform to mem in 0.000043s (246 normal rows, 0 exceptions)
[2021-03-31 03:38:40.181] [global] [info] [Transform Stage] Stage 1 completed 1 load&transform tasks in 6.234e-05s
[2021-03-31 03:38:40.181] [global] [info] [Transform Stage] Stage 1 total wall clock time: 4.3369e-05s, 246 input rows, time to process 1 row via fast path: 0.000176297ms
[2021-03-31 03:38:40.181] [global] [info] [Transform Stage] Stage 1 completed 1 sink tasks in 4.313e-06s
[2021-03-31 03:38:40.181] [global] [info] [Transform Stage] Stage 1 took 0.0169025s
[2021-03-31 03:38:40.181] [global] [info] Query Execution took 12.6233s. (planning: 0.0142089s, execution: 12.6091s)
[2021-03-31 03:38:40.183] [global] [info] Cached 246 common rows (0 general rows), memory usage: 7.20 KB/32.00 MB (0.00 B/0.00 B)
[2021-03-31 03:38:40.186] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:40.189] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:40.191] [physical planner] [warning] sampling mapColumn operator lead to 100 exceptions
[2021-03-31 03:38:40.191] [logical planner] [info] logical optimization took 0.005351ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 03:38:40.192] [codegen] [info] generating pipeline for (Option[str]) -> (str) (1 operator pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str])
[2021-03-31 03:38:40.192] [global] [info] Stage0 depends on: 
[2021-03-31 03:38:40.205] [global] [info] Optimization via LLVM passes took 0.012727 ms
[2021-03-31 03:38:40.210] [global] [info] Compiled code paths for stage 0 in 0.00 ms
[2021-03-31 03:38:40.210] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0177519s
[2021-03-31 03:38:40.210] [driver] [info] [Task Finished] Transform to mem in 0.000032s (246 normal rows, 0 exceptions)
[2021-03-31 03:38:40.210] [global] [info] [Transform Stage] Stage 0 completed 1 load&transform tasks in 5.2638e-05s
[2021-03-31 03:38:40.210] [global] [info] [Transform Stage] Stage 0 total wall clock time: 3.2343e-05s, 246 input rows, time to process 1 row via fast path: 0.000131476ms

[2021-03-31 03:38:40.210] [global] [info] Writing 246 rows as output to file (1.44 KB)
[2021-03-31 03:38:40.210] [driver] [info] [Task Finished] write to file in 0.000059s (246 rows, 1.44 KB)
[2021-03-31 03:38:40.210] [global] [info] writing output took 0.000245s
[2021-03-31 03:38:40.210] [global] [info] [Transform Stage] Stage 0 completed 1 sink tasks in 0.000254063s
[2021-03-31 03:38:40.210] [global] [info] [Transform Stage] Stage 0 took 0.0180761s
[2021-03-31 03:38:40.210] [global] [info] Query Execution took 0.0267841s. (planning: 0.00867346s, execution: 0.0181106s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 29 2021, 06:12:46) 
[GCC 10.2.0] on linux
Tuplex startup time: 0.2688138484954834
{"startupTime": 0.2688138484954834, "readTime": 15.769986629486084, "jobTime": 12.642232656478882, "writeTime": 0.029203176498413086}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 188 active partitions
