[2021-03-31 03:37:28.521] [global] [error] could not find backend, defaulting to local
[2021-03-31 03:37:28.521] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 03:37:28.521] [local ee] [info] initializing LLVM backend
[2021-03-31 03:37:28.521] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 03:37:28.521] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 03:37:28.522] [memory] [info] allocated bitmap managed memory region (100.00 GB, 32.00 MB block size)
[2021-03-31 03:37:28.522] [local execution engine] [info] started driver (100.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 03:37:28.522] [fileinputoperator] [info] found 1 file (1.10 GB) to process.
[2021-03-31 03:37:28.523] [global] [info] sampled file:///data/311/311_preprocessed.csv on 256.00 KB
[2021-03-31 03:37:28.680] [logical planner] [info] logical optimization took 0.008377ms
output type of specialized pipeline is: (Option[str])
is this the most outer stage?: 0
need to upgrade output type to (Option[str])
[2021-03-31 03:37:28.681] [codegen] [info] generating pipeline for (Option[str]) -> (Option[str]) (2 operators pipelined)
[2021-03-31 03:37:28.681] [codegen] [info] generating function fix_zip_codes for (Option[str]) -> Option[str]
[2021-03-31 03:37:28.701] [codegen] [info] generating pipeline for (Option[str]) -> (str) (0 operators pipelined)
[2021-03-31 03:37:28.701] [global] [info] Stage1 depends on: Stage0 
[2021-03-31 03:37:28.701] [global] [info] Stage0 depends on: 
[2021-03-31 03:37:28.702] [global] [info] provided option to explicitly merge bad rows in order back, however rows will be hashed. Disabling option. To silence this warning, set
tuplex.optimizer.mergeExceptionsInOrder=false
[2021-03-31 03:37:28.722] [global] [info] Optimization via LLVM passes took 0.019981 ms
[2021-03-31 03:37:28.730] [global] [info] Compiled code paths for stage 0 in 0.01 ms
[2021-03-31 03:37:28.730] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.0287672s
[2021-03-31 03:37:28.730] [local ee] [info] split /data/311/311_preprocessed.csv into 17 tasks
[2021-03-31 03:37:29.921] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.190985s (0 normal rows, 0 exceptions, 184 buckets)
[2021-03-31 03:37:31.088] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.166710s (0 normal rows, 0 exceptions, 180 buckets)
[2021-03-31 03:37:32.251] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.163241s (0 normal rows, 0 exceptions, 184 buckets)
[2021-03-31 03:37:33.417] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.166030s (0 normal rows, 0 exceptions, 179 buckets)
[2021-03-31 03:37:34.591] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.174146s (0 normal rows, 0 exceptions, 181 buckets)
[2021-03-31 03:37:35.763] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.171503s (0 normal rows, 0 exceptions, 183 buckets)
[2021-03-31 03:37:36.934] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.171032s (0 normal rows, 0 exceptions, 178 buckets)
[2021-03-31 03:37:38.101] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.167467s (0 normal rows, 0 exceptions, 186 buckets)
[2021-03-31 03:37:39.274] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.172733s (0 normal rows, 0 exceptions, 183 buckets)
[2021-03-31 03:37:40.445] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.170795s (0 normal rows, 0 exceptions, 186 buckets)
[2021-03-31 03:37:41.647] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.202357s (0 normal rows, 0 exceptions, 183 buckets)
[2021-03-31 03:37:42.834] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.187093s (0 normal rows, 0 exceptions, 185 buckets)
[2021-03-31 03:37:44.004] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.169940s (0 normal rows, 0 exceptions, 191 buckets)
[2021-03-31 03:37:45.174] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.170084s (0 normal rows, 0 exceptions, 186 buckets)
[2021-03-31 03:37:46.367] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.192240s (0 normal rows, 0 exceptions, 188 buckets)
[2021-03-31 03:37:47.544] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.176843s (0 normal rows, 0 exceptions, 188 buckets)
[2021-03-31 03:37:49.501] [driver] [info] [Task Finished] Transform to in-memory hash table in 1.957664s (0 normal rows, 0 exceptions, 188 buckets)
[2021-03-31 03:37:49.501] [global] [info] [Transform Stage] Stage 0 completed 17 load&transform tasks in 20.7713s
[2021-03-31 03:37:49.501] [global] [info] [Transform Stage] Stage 0 total wall clock time: 20.7709s, 197628000 input rows, time to process 1 row via fast path: 0.000105101ms
[2021-03-31 03:37:49.502] [global] [info] [Transform Stage] Stage 0 completed 17 sink tasks in 0.000453363s
[2021-03-31 03:37:49.502] [global] [info] [Transform Stage] Stage 0 took 20.8006s
[2021-03-31 03:37:49.515] [global] [info] Optimization via LLVM passes took 0.012894 ms
[2021-03-31 03:37:49.520] [global] [info] Compiled code paths for stage 1 in 0.00 ms
[2021-03-31 03:37:49.520] [global] [info] [Transform Stage] Stage 1 compiled to x86 in 0.0183379s
[2021-03-31 03:37:49.520] [driver] [info] [Task Finished] Transform to mem in 0.000037s (246 normal rows, 0 exceptions)
[2021-03-31 03:37:49.520] [global] [info] [Transform Stage] Stage 1 completed 1 load&transform tasks in 5.5229e-05s
[2021-03-31 03:37:49.520] [global] [info] [Transform Stage] Stage 1 total wall clock time: 3.7169e-05s, 246 input rows, time to process 1 row via fast path: 0.000151093ms

[2021-03-31 03:37:49.520] [global] [info] Writing 246 rows as output to file (1.44 KB)
[2021-03-31 03:37:49.520] [driver] [info] [Task Finished] write to file in 0.000052s (246 rows, 1.44 KB)
[2021-03-31 03:37:49.520] [global] [info] writing output took 0.000227s
[2021-03-31 03:37:49.520] [global] [info] [Transform Stage] Stage 1 completed 1 sink tasks in 0.000236765s
[2021-03-31 03:37:49.520] [global] [info] [Transform Stage] Stage 1 took 0.0186488s
[2021-03-31 03:37:49.521] [global] [info] Query Execution took 20.8517s. (planning: 0.0323404s, execution: 20.8193s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 29 2021, 06:12:46) 
[GCC 10.2.0] on linux
Tuplex startup time: 0.26840710639953613
{"startupTime": 0.26840710639953613, "jobTime": 21.000521183013916}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
