[2021-03-24 07:27:59.664] [global] [error] could not find backend, defaulting to local
[2021-03-24 07:27:59.665] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-24 07:27:59.665] [local ee] [info] initializing LLVM backend
[2021-03-24 07:27:59.665] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-24 07:27:59.665] [LLVM] [info] compiling code for skylake-avx512
[2021-03-24 07:27:59.666] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-24 07:27:59.666] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-24 07:27:59.666] [fileinputoperator] [info] found 1 file (9.31 GB) to process.
[2021-03-24 07:27:59.666] [global] [info] sampled file:///data/zillow/Z1_preprocessed/zillow_Z1_10G.csv on 256.00 KB
[2021-03-24 07:27:59.803] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:27:59.818] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:27:59.826] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:27:59.849] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:27:59.868] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:27:59.881] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:27:59.912] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:27:59.927] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:27:59.929] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:27:59.932] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:27:59.934] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:27:59.939] [logical planner] [info] logical optimization took 0.009033ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-24 07:27:59.939] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (12 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,i64,i64,str,str,i64)
[2021-03-24 07:27:59.939] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-24 07:27:59.940] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-24 07:27:59.941] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-24 07:27:59.941] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-24 07:27:59.942] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-24 07:27:59.942] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-24 07:27:59.943] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> i64
[2021-03-24 07:27:59.944] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64)) -> i64
[2021-03-24 07:27:59.945] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64)) -> str
[2021-03-24 07:27:59.945] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64,str)) -> i64
[2021-03-24 07:27:59.947] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> boolean
[2021-03-24 07:27:59.947] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,i64,i64,str,str,i64)
[2021-03-24 07:27:59.973] [global] [info] Stage0 depends on: 
[2021-03-24 07:28:00.113] [global] [info] Optimization via LLVM passes took 0.133520 ms
[2021-03-24 07:28:00.174] [global] [info] Compiled code paths for stage 0 in 0.06 ms
[2021-03-24 07:28:00.174] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.201265s
[2021-03-24 07:28:00.174] [local ee] [info] split /data/zillow/Z1_preprocessed/zillow_Z1_10G.csv into 149 tasks
[2021-03-24 07:28:00.391] [driver] [info] [Task Finished] Transform to mem in 0.216760s (5710 normal rows, 0 exceptions)
[2021-03-24 07:28:00.605] [driver] [info] [Task Finished] Transform to mem in 0.214386s (5758 normal rows, 0 exceptions)
[2021-03-24 07:28:00.820] [driver] [info] [Task Finished] Transform to mem in 0.214028s (5772 normal rows, 0 exceptions)
[2021-03-24 07:28:01.034] [driver] [info] [Task Finished] Transform to mem in 0.214900s (5744 normal rows, 0 exceptions)
[2021-03-24 07:28:01.249] [driver] [info] [Task Finished] Transform to mem in 0.214354s (5860 normal rows, 0 exceptions)
[2021-03-24 07:28:01.463] [driver] [info] [Task Finished] Transform to mem in 0.214148s (5864 normal rows, 0 exceptions)
[2021-03-24 07:28:01.677] [driver] [info] [Task Finished] Transform to mem in 0.214469s (5799 normal rows, 0 exceptions)
[2021-03-24 07:28:01.891] [driver] [info] [Task Finished] Transform to mem in 0.213545s (5663 normal rows, 0 exceptions)
[2021-03-24 07:28:02.105] [driver] [info] [Task Finished] Transform to mem in 0.213903s (5796 normal rows, 0 exceptions)
[2021-03-24 07:28:02.319] [driver] [info] [Task Finished] Transform to mem in 0.213829s (5770 normal rows, 0 exceptions)
[2021-03-24 07:28:02.533] [driver] [info] [Task Finished] Transform to mem in 0.213781s (5748 normal rows, 0 exceptions)
[2021-03-24 07:28:02.747] [driver] [info] [Task Finished] Transform to mem in 0.213917s (5779 normal rows, 0 exceptions)
[2021-03-24 07:28:02.960] [driver] [info] [Task Finished] Transform to mem in 0.213779s (5802 normal rows, 0 exceptions)
[2021-03-24 07:28:03.174] [driver] [info] [Task Finished] Transform to mem in 0.213779s (5706 normal rows, 0 exceptions)
[2021-03-24 07:28:03.388] [driver] [info] [Task Finished] Transform to mem in 0.213975s (5882 normal rows, 0 exceptions)
[2021-03-24 07:28:03.602] [driver] [info] [Task Finished] Transform to mem in 0.213897s (5883 normal rows, 0 exceptions)
[2021-03-24 07:28:03.816] [driver] [info] [Task Finished] Transform to mem in 0.214411s (6027 normal rows, 0 exceptions)
[2021-03-24 07:28:04.030] [driver] [info] [Task Finished] Transform to mem in 0.213871s (5766 normal rows, 0 exceptions)
[2021-03-24 07:28:04.244] [driver] [info] [Task Finished] Transform to mem in 0.213870s (5706 normal rows, 0 exceptions)
[2021-03-24 07:28:04.458] [driver] [info] [Task Finished] Transform to mem in 0.213778s (5709 normal rows, 0 exceptions)
[2021-03-24 07:28:04.672] [driver] [info] [Task Finished] Transform to mem in 0.213571s (5678 normal rows, 0 exceptions)
[2021-03-24 07:28:04.886] [driver] [info] [Task Finished] Transform to mem in 0.214231s (5821 normal rows, 0 exceptions)
[2021-03-24 07:28:05.100] [driver] [info] [Task Finished] Transform to mem in 0.213700s (5752 normal rows, 0 exceptions)
[2021-03-24 07:28:05.313] [driver] [info] [Task Finished] Transform to mem in 0.213597s (5761 normal rows, 0 exceptions)
[2021-03-24 07:28:05.527] [driver] [info] [Task Finished] Transform to mem in 0.214063s (5882 normal rows, 0 exceptions)
[2021-03-24 07:28:05.741] [driver] [info] [Task Finished] Transform to mem in 0.213418s (5651 normal rows, 0 exceptions)
[2021-03-24 07:28:05.955] [driver] [info] [Task Finished] Transform to mem in 0.213942s (5772 normal rows, 0 exceptions)
[2021-03-24 07:28:06.168] [driver] [info] [Task Finished] Transform to mem in 0.213642s (5665 normal rows, 0 exceptions)
[2021-03-24 07:28:06.382] [driver] [info] [Task Finished] Transform to mem in 0.213670s (5716 normal rows, 0 exceptions)
[2021-03-24 07:28:06.596] [driver] [info] [Task Finished] Transform to mem in 0.213814s (5723 normal rows, 0 exceptions)
[2021-03-24 07:28:06.810] [driver] [info] [Task Finished] Transform to mem in 0.213717s (5792 normal rows, 0 exceptions)
[2021-03-24 07:28:07.023] [driver] [info] [Task Finished] Transform to mem in 0.213683s (5781 normal rows, 0 exceptions)
[2021-03-24 07:28:07.237] [driver] [info] [Task Finished] Transform to mem in 0.213726s (5622 normal rows, 0 exceptions)
[2021-03-24 07:28:07.451] [driver] [info] [Task Finished] Transform to mem in 0.213921s (5781 normal rows, 0 exceptions)
[2021-03-24 07:28:07.665] [driver] [info] [Task Finished] Transform to mem in 0.214024s (5842 normal rows, 0 exceptions)
[2021-03-24 07:28:07.879] [driver] [info] [Task Finished] Transform to mem in 0.214038s (5926 normal rows, 0 exceptions)
[2021-03-24 07:28:08.093] [driver] [info] [Task Finished] Transform to mem in 0.213761s (5860 normal rows, 0 exceptions)
[2021-03-24 07:28:08.308] [driver] [info] [Task Finished] Transform to mem in 0.214925s (5749 normal rows, 0 exceptions)
[2021-03-24 07:28:08.521] [driver] [info] [Task Finished] Transform to mem in 0.213599s (5696 normal rows, 0 exceptions)
[2021-03-24 07:28:08.735] [driver] [info] [Task Finished] Transform to mem in 0.214045s (5821 normal rows, 0 exceptions)
[2021-03-24 07:28:08.949] [driver] [info] [Task Finished] Transform to mem in 0.213673s (5831 normal rows, 0 exceptions)
[2021-03-24 07:28:09.163] [driver] [info] [Task Finished] Transform to mem in 0.214086s (5915 normal rows, 0 exceptions)
[2021-03-24 07:28:09.377] [driver] [info] [Task Finished] Transform to mem in 0.213836s (5721 normal rows, 0 exceptions)
[2021-03-24 07:28:09.591] [driver] [info] [Task Finished] Transform to mem in 0.213711s (5839 normal rows, 0 exceptions)
[2021-03-24 07:28:09.804] [driver] [info] [Task Finished] Transform to mem in 0.213608s (5750 normal rows, 0 exceptions)
[2021-03-24 07:28:10.019] [driver] [info] [Task Finished] Transform to mem in 0.214109s (5878 normal rows, 0 exceptions)
[2021-03-24 07:28:10.233] [driver] [info] [Task Finished] Transform to mem in 0.214385s (5861 normal rows, 0 exceptions)
[2021-03-24 07:28:10.447] [driver] [info] [Task Finished] Transform to mem in 0.214174s (5810 normal rows, 0 exceptions)
[2021-03-24 07:28:10.662] [driver] [info] [Task Finished] Transform to mem in 0.214995s (5662 normal rows, 0 exceptions)
[2021-03-24 07:28:10.876] [driver] [info] [Task Finished] Transform to mem in 0.214277s (5777 normal rows, 0 exceptions)
[2021-03-24 07:28:11.090] [driver] [info] [Task Finished] Transform to mem in 0.213643s (5657 normal rows, 0 exceptions)
[2021-03-24 07:28:11.304] [driver] [info] [Task Finished] Transform to mem in 0.213709s (5731 normal rows, 0 exceptions)
[2021-03-24 07:28:11.518] [driver] [info] [Task Finished] Transform to mem in 0.213758s (5694 normal rows, 0 exceptions)
[2021-03-24 07:28:11.733] [driver] [info] [Task Finished] Transform to mem in 0.215383s (5813 normal rows, 0 exceptions)
[2021-03-24 07:28:11.947] [driver] [info] [Task Finished] Transform to mem in 0.214219s (5893 normal rows, 0 exceptions)
[2021-03-24 07:28:12.161] [driver] [info] [Task Finished] Transform to mem in 0.214100s (5850 normal rows, 0 exceptions)
[2021-03-24 07:28:12.376] [driver] [info] [Task Finished] Transform to mem in 0.214176s (5742 normal rows, 0 exceptions)
[2021-03-24 07:28:12.589] [driver] [info] [Task Finished] Transform to mem in 0.213796s (5795 normal rows, 0 exceptions)
[2021-03-24 07:28:12.803] [driver] [info] [Task Finished] Transform to mem in 0.213767s (5714 normal rows, 0 exceptions)
[2021-03-24 07:28:13.017] [driver] [info] [Task Finished] Transform to mem in 0.214312s (5709 normal rows, 0 exceptions)
[2021-03-24 07:28:13.231] [driver] [info] [Task Finished] Transform to mem in 0.213713s (5750 normal rows, 0 exceptions)
[2021-03-24 07:28:13.445] [driver] [info] [Task Finished] Transform to mem in 0.213995s (5750 normal rows, 0 exceptions)
[2021-03-24 07:28:13.659] [driver] [info] [Task Finished] Transform to mem in 0.213693s (5759 normal rows, 0 exceptions)
[2021-03-24 07:28:13.873] [driver] [info] [Task Finished] Transform to mem in 0.214069s (5734 normal rows, 0 exceptions)
[2021-03-24 07:28:14.087] [driver] [info] [Task Finished] Transform to mem in 0.214447s (5881 normal rows, 0 exceptions)
[2021-03-24 07:28:14.302] [driver] [info] [Task Finished] Transform to mem in 0.214039s (5807 normal rows, 0 exceptions)
[2021-03-24 07:28:14.516] [driver] [info] [Task Finished] Transform to mem in 0.214217s (5797 normal rows, 0 exceptions)
[2021-03-24 07:28:14.730] [driver] [info] [Task Finished] Transform to mem in 0.213889s (5786 normal rows, 0 exceptions)
[2021-03-24 07:28:14.943] [driver] [info] [Task Finished] Transform to mem in 0.213662s (5826 normal rows, 0 exceptions)
[2021-03-24 07:28:15.157] [driver] [info] [Task Finished] Transform to mem in 0.213955s (5722 normal rows, 0 exceptions)
[2021-03-24 07:28:15.371] [driver] [info] [Task Finished] Transform to mem in 0.213791s (5746 normal rows, 0 exceptions)
[2021-03-24 07:28:15.585] [driver] [info] [Task Finished] Transform to mem in 0.214045s (5775 normal rows, 0 exceptions)
[2021-03-24 07:28:15.799] [driver] [info] [Task Finished] Transform to mem in 0.213737s (5766 normal rows, 0 exceptions)
[2021-03-24 07:28:16.013] [driver] [info] [Task Finished] Transform to mem in 0.213927s (5877 normal rows, 0 exceptions)
[2021-03-24 07:28:16.227] [driver] [info] [Task Finished] Transform to mem in 0.213867s (5677 normal rows, 0 exceptions)
[2021-03-24 07:28:16.441] [driver] [info] [Task Finished] Transform to mem in 0.213909s (5846 normal rows, 0 exceptions)
[2021-03-24 07:28:16.655] [driver] [info] [Task Finished] Transform to mem in 0.214138s (5851 normal rows, 0 exceptions)
[2021-03-24 07:28:16.869] [driver] [info] [Task Finished] Transform to mem in 0.213926s (5820 normal rows, 0 exceptions)
[2021-03-24 07:28:17.083] [driver] [info] [Task Finished] Transform to mem in 0.213899s (5726 normal rows, 0 exceptions)
[2021-03-24 07:28:17.297] [driver] [info] [Task Finished] Transform to mem in 0.214044s (5684 normal rows, 0 exceptions)
[2021-03-24 07:28:17.511] [driver] [info] [Task Finished] Transform to mem in 0.213962s (5744 normal rows, 0 exceptions)
[2021-03-24 07:28:17.725] [driver] [info] [Task Finished] Transform to mem in 0.214430s (5606 normal rows, 0 exceptions)
[2021-03-24 07:28:17.939] [driver] [info] [Task Finished] Transform to mem in 0.213783s (5707 normal rows, 0 exceptions)
[2021-03-24 07:28:18.153] [driver] [info] [Task Finished] Transform to mem in 0.213632s (5831 normal rows, 0 exceptions)
[2021-03-24 07:28:18.367] [driver] [info] [Task Finished] Transform to mem in 0.213913s (5742 normal rows, 0 exceptions)
[2021-03-24 07:28:18.580] [driver] [info] [Task Finished] Transform to mem in 0.213651s (5546 normal rows, 0 exceptions)
[2021-03-24 07:28:18.794] [driver] [info] [Task Finished] Transform to mem in 0.213650s (5744 normal rows, 0 exceptions)
[2021-03-24 07:28:19.008] [driver] [info] [Task Finished] Transform to mem in 0.214150s (5879 normal rows, 0 exceptions)
[2021-03-24 07:28:19.222] [driver] [info] [Task Finished] Transform to mem in 0.214179s (5865 normal rows, 0 exceptions)
[2021-03-24 07:28:19.436] [driver] [info] [Task Finished] Transform to mem in 0.213917s (5776 normal rows, 0 exceptions)
[2021-03-24 07:28:19.650] [driver] [info] [Task Finished] Transform to mem in 0.213654s (5632 normal rows, 0 exceptions)
[2021-03-24 07:28:19.863] [driver] [info] [Task Finished] Transform to mem in 0.213495s (5766 normal rows, 0 exceptions)
[2021-03-24 07:28:20.077] [driver] [info] [Task Finished] Transform to mem in 0.214139s (5851 normal rows, 0 exceptions)
[2021-03-24 07:28:20.292] [driver] [info] [Task Finished] Transform to mem in 0.214340s (5842 normal rows, 0 exceptions)
[2021-03-24 07:28:20.506] [driver] [info] [Task Finished] Transform to mem in 0.214006s (5844 normal rows, 0 exceptions)
[2021-03-24 07:28:20.720] [driver] [info] [Task Finished] Transform to mem in 0.214357s (5911 normal rows, 0 exceptions)
[2021-03-24 07:28:20.935] [driver] [info] [Task Finished] Transform to mem in 0.214450s (5907 normal rows, 0 exceptions)
[2021-03-24 07:28:21.149] [driver] [info] [Task Finished] Transform to mem in 0.213981s (5866 normal rows, 0 exceptions)
[2021-03-24 07:28:21.363] [driver] [info] [Task Finished] Transform to mem in 0.213932s (5743 normal rows, 0 exceptions)
[2021-03-24 07:28:21.577] [driver] [info] [Task Finished] Transform to mem in 0.213985s (5720 normal rows, 0 exceptions)
[2021-03-24 07:28:21.790] [driver] [info] [Task Finished] Transform to mem in 0.213803s (5685 normal rows, 0 exceptions)
[2021-03-24 07:28:22.004] [driver] [info] [Task Finished] Transform to mem in 0.213951s (5883 normal rows, 0 exceptions)
[2021-03-24 07:28:22.219] [driver] [info] [Task Finished] Transform to mem in 0.214097s (5706 normal rows, 0 exceptions)
[2021-03-24 07:28:22.433] [driver] [info] [Task Finished] Transform to mem in 0.214052s (5929 normal rows, 0 exceptions)
[2021-03-24 07:28:22.647] [driver] [info] [Task Finished] Transform to mem in 0.214212s (5872 normal rows, 0 exceptions)
[2021-03-24 07:28:22.861] [driver] [info] [Task Finished] Transform to mem in 0.214047s (5847 normal rows, 0 exceptions)
[2021-03-24 07:28:23.075] [driver] [info] [Task Finished] Transform to mem in 0.214282s (5816 normal rows, 0 exceptions)
[2021-03-24 07:28:23.289] [driver] [info] [Task Finished] Transform to mem in 0.213474s (5649 normal rows, 0 exceptions)
[2021-03-24 07:28:23.503] [driver] [info] [Task Finished] Transform to mem in 0.213873s (5873 normal rows, 0 exceptions)
[2021-03-24 07:28:23.716] [driver] [info] [Task Finished] Transform to mem in 0.213714s (5686 normal rows, 0 exceptions)
[2021-03-24 07:28:23.931] [driver] [info] [Task Finished] Transform to mem in 0.214264s (5806 normal rows, 0 exceptions)
[2021-03-24 07:28:24.145] [driver] [info] [Task Finished] Transform to mem in 0.214426s (5765 normal rows, 0 exceptions)
[2021-03-24 07:28:24.360] [driver] [info] [Task Finished] Transform to mem in 0.214645s (5770 normal rows, 0 exceptions)
[2021-03-24 07:28:24.574] [driver] [info] [Task Finished] Transform to mem in 0.214389s (5643 normal rows, 0 exceptions)
[2021-03-24 07:28:24.789] [driver] [info] [Task Finished] Transform to mem in 0.214912s (5951 normal rows, 0 exceptions)
[2021-03-24 07:28:25.004] [driver] [info] [Task Finished] Transform to mem in 0.214776s (5759 normal rows, 0 exceptions)
[2021-03-24 07:28:25.219] [driver] [info] [Task Finished] Transform to mem in 0.215097s (5698 normal rows, 0 exceptions)
[2021-03-24 07:28:25.434] [driver] [info] [Task Finished] Transform to mem in 0.215057s (5955 normal rows, 0 exceptions)
[2021-03-24 07:28:25.649] [driver] [info] [Task Finished] Transform to mem in 0.214632s (5768 normal rows, 0 exceptions)
[2021-03-24 07:28:25.864] [driver] [info] [Task Finished] Transform to mem in 0.215108s (5772 normal rows, 0 exceptions)
[2021-03-24 07:28:26.079] [driver] [info] [Task Finished] Transform to mem in 0.215226s (5802 normal rows, 0 exceptions)
[2021-03-24 07:28:26.294] [driver] [info] [Task Finished] Transform to mem in 0.215340s (5799 normal rows, 0 exceptions)
[2021-03-24 07:28:26.509] [driver] [info] [Task Finished] Transform to mem in 0.214901s (5862 normal rows, 0 exceptions)
[2021-03-24 07:28:26.724] [driver] [info] [Task Finished] Transform to mem in 0.215128s (5856 normal rows, 0 exceptions)
[2021-03-24 07:28:26.939] [driver] [info] [Task Finished] Transform to mem in 0.214635s (5685 normal rows, 0 exceptions)
[2021-03-24 07:28:27.154] [driver] [info] [Task Finished] Transform to mem in 0.214423s (5751 normal rows, 0 exceptions)
[2021-03-24 07:28:27.368] [driver] [info] [Task Finished] Transform to mem in 0.214605s (5891 normal rows, 0 exceptions)
[2021-03-24 07:28:27.583] [driver] [info] [Task Finished] Transform to mem in 0.214731s (5852 normal rows, 0 exceptions)
[2021-03-24 07:28:27.798] [driver] [info] [Task Finished] Transform to mem in 0.214983s (5722 normal rows, 0 exceptions)
[2021-03-24 07:28:28.013] [driver] [info] [Task Finished] Transform to mem in 0.214680s (5645 normal rows, 0 exceptions)
[2021-03-24 07:28:28.228] [driver] [info] [Task Finished] Transform to mem in 0.215446s (5788 normal rows, 0 exceptions)
[2021-03-24 07:28:28.442] [driver] [info] [Task Finished] Transform to mem in 0.214138s (5813 normal rows, 0 exceptions)
[2021-03-24 07:28:28.657] [driver] [info] [Task Finished] Transform to mem in 0.214654s (5674 normal rows, 0 exceptions)
[2021-03-24 07:28:28.872] [driver] [info] [Task Finished] Transform to mem in 0.214715s (5853 normal rows, 0 exceptions)
[2021-03-24 07:28:29.088] [driver] [info] [Task Finished] Transform to mem in 0.216294s (5848 normal rows, 0 exceptions)
[2021-03-24 07:28:29.303] [driver] [info] [Task Finished] Transform to mem in 0.214536s (5811 normal rows, 0 exceptions)
[2021-03-24 07:28:29.517] [driver] [info] [Task Finished] Transform to mem in 0.214714s (5732 normal rows, 0 exceptions)
[2021-03-24 07:28:29.732] [driver] [info] [Task Finished] Transform to mem in 0.214896s (5801 normal rows, 0 exceptions)
[2021-03-24 07:28:29.947] [driver] [info] [Task Finished] Transform to mem in 0.214614s (5827 normal rows, 0 exceptions)
[2021-03-24 07:28:30.161] [driver] [info] [Task Finished] Transform to mem in 0.214536s (5868 normal rows, 0 exceptions)
[2021-03-24 07:28:30.376] [driver] [info] [Task Finished] Transform to mem in 0.214446s (5794 normal rows, 0 exceptions)
[2021-03-24 07:28:30.590] [driver] [info] [Task Finished] Transform to mem in 0.214333s (5817 normal rows, 0 exceptions)
[2021-03-24 07:28:30.805] [driver] [info] [Task Finished] Transform to mem in 0.214382s (5696 normal rows, 0 exceptions)
[2021-03-24 07:28:31.019] [driver] [info] [Task Finished] Transform to mem in 0.214536s (5732 normal rows, 0 exceptions)
[2021-03-24 07:28:31.233] [driver] [info] [Task Finished] Transform to mem in 0.214286s (5629 normal rows, 0 exceptions)
[2021-03-24 07:28:31.448] [driver] [info] [Task Finished] Transform to mem in 0.214751s (5789 normal rows, 0 exceptions)
[2021-03-24 07:28:31.663] [driver] [info] [Task Finished] Transform to mem in 0.214919s (5740 normal rows, 0 exceptions)
[2021-03-24 07:28:31.878] [driver] [info] [Task Finished] Transform to mem in 0.214920s (5841 normal rows, 0 exceptions)
[2021-03-24 07:28:32.096] [driver] [info] [Task Finished] Transform to mem in 0.217486s (5857 normal rows, 0 exceptions)
[2021-03-24 07:28:32.096] [global] [info] [Transform Stage] Stage 0 completed 149 load&transform tasks in 31.9215s
[2021-03-24 07:28:32.096] [global] [info] [Transform Stage] Stage 0 total wall clock time: 31.9188s, 48740298 input rows, time to process 1 row via fast path: 0.000654875ms

[2021-03-24 07:28:32.110] [global] [info] Writing 861387 rows as output to file (116.34 MB)
[2021-03-24 07:28:32.242] [driver] [info] [Task Finished] write to file in 0.132021s (861387 rows, 116.34 MB)
[2021-03-24 07:28:32.243] [global] [info] writing output took 0.146828s
[2021-03-24 07:28:32.243] [global] [info] [Transform Stage] Stage 0 completed 149 sink tasks in 0.146909s
[2021-03-24 07:28:32.243] [global] [info] [Transform Stage] Stage 0 took 32.2698s
[2021-03-24 07:28:32.243] [global] [info] Query Execution took 32.3152s. (planning: 0.0453977s, execution: 32.2698s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z1_preprocessed/zillow_Z1_10G.csv']
Tuplex startup time: 0.005007743835449219
Tuplex job time: 32.57810425758362 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0090327,"llvm_optimization_time_s":0.13352,"llvm_compilation_time_s":0.0606976,"total_compilation_time_s":0.201263,"sampling_time_s":0.112817,"stages":[{"stage_no":0,"fast_path_wall_time_s":31.9188,"fast_path_time_s":31.9215,"fast_path_per_row_time_ns":654.875,"slow_path_wall_time_s":0,"slow_path_time_s":0,"slow_path_per_row_time_ns":0}]}
{"startupTime": 0.005007743835449219, "jobTime": 32.57810425758362}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
