[2021-03-31 18:05:27.673] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:05:27.673] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:05:27.673] [local ee] [info] initializing LLVM backend
[2021-03-31 18:05:27.673] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:05:27.674] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:05:27.674] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-31 18:05:27.674] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:05:27.674] [fileinputoperator] [info] found 1 file (9.31 GB) to process.
[2021-03-31 18:05:27.675] [global] [info] sampled file:///data/zillow/Z1_preprocessed/zillow_Z1_10G.csv on 256.00 KB
[2021-03-31 18:05:27.813] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.829] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.837] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.860] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.880] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.893] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.924] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.938] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:05:27.941] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:05:27.943] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:05:27.946] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:05:27.950] [logical planner] [info] logical optimization took 0.009096ms
[2021-03-31 18:05:27.951] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.955] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.958] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.962] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.964] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.966] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.969] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:05:27.973] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:05:27.974] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,i64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:05:27.974] [codegen] [info] generating pipeline for (str,str,str,str,f64,str,str,str) -> (str,str,str,str,str,i64,i64,i64,str,str,i64) (12 operators pipelined)
[2021-03-31 18:05:27.975] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,str,str,str)) -> i64
[2021-03-31 18:05:27.975] [codegen] [info] generating lambda function for ((str,str,str,str,f64,str,str,str,i64)) -> boolean
[2021-03-31 18:05:27.976] [codegen] [info] generating function extractType for ((str,str,str,str,f64,str,str,str,i64)) -> str
[2021-03-31 18:05:27.976] [codegen] [info] generating lambda function for ((str,str,str,str,f64,str,str,str,i64,str)) -> boolean
[2021-03-31 18:05:27.977] [codegen] [info] generating lambda function for ((str,str,str,str,f64,str,str,str,i64,str)) -> str
[2021-03-31 18:05:27.977] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:05:27.978] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,str,str,str,i64,str,str)) -> i64
[2021-03-31 18:05:27.979] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,str,str,str,i64,str,str,i64)) -> i64
[2021-03-31 18:05:27.980] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,str,str,str,i64,str,str,i64,i64)) -> str
[2021-03-31 18:05:27.980] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,str,str,str,i64,str,str,i64,i64,str)) -> i64
[2021-03-31 18:05:27.981] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,i64,i64,str)) -> boolean
[2021-03-31 18:05:27.982] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,i64,i64,str)) -> (str,str,str,str,str,i64,i64,i64,str,str,i64)
[2021-03-31 18:05:27.983] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:05:27.984] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:05:27.985] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:05:27.985] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:05:27.986] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:05:27.986] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:05:27.987] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> i64
[2021-03-31 18:05:27.988] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64)) -> i64
[2021-03-31 18:05:27.988] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64)) -> str
[2021-03-31 18:05:27.989] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64,str)) -> i64
[2021-03-31 18:05:27.990] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> boolean
[2021-03-31 18:05:27.991] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,i64,i64,str,str,i64)
[2021-03-31 18:05:28.020] [global] [info] Stage0 depends on: 
[2021-03-31 18:05:28.323] [global] [info] Optimization via LLVM passes took 0.287974 ms
[2021-03-31 18:05:28.455] [global] [info] Compiled code paths for stage 0 in 0.13 ms
[2021-03-31 18:05:28.455] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.434377s
[2021-03-31 18:05:28.455] [local ee] [info] split /data/zillow/Z1_preprocessed/zillow_Z1_10G.csv into 149 tasks
[2021-03-31 18:05:28.678] [driver] [info] [Task Finished] Transform to mem in 0.223449s (5710 normal rows, 0 exceptions)
[2021-03-31 18:05:28.903] [driver] [info] [Task Finished] Transform to mem in 0.224103s (5758 normal rows, 0 exceptions)
[2021-03-31 18:05:29.127] [driver] [info] [Task Finished] Transform to mem in 0.224333s (5772 normal rows, 0 exceptions)
[2021-03-31 18:05:29.348] [driver] [info] [Task Finished] Transform to mem in 0.220895s (5744 normal rows, 0 exceptions)
[2021-03-31 18:05:29.569] [driver] [info] [Task Finished] Transform to mem in 0.221015s (5860 normal rows, 0 exceptions)
[2021-03-31 18:05:29.790] [driver] [info] [Task Finished] Transform to mem in 0.221103s (5864 normal rows, 0 exceptions)
[2021-03-31 18:05:30.011] [driver] [info] [Task Finished] Transform to mem in 0.221120s (5799 normal rows, 0 exceptions)
[2021-03-31 18:05:30.232] [driver] [info] [Task Finished] Transform to mem in 0.220996s (5663 normal rows, 0 exceptions)
[2021-03-31 18:05:30.453] [driver] [info] [Task Finished] Transform to mem in 0.221125s (5796 normal rows, 0 exceptions)
[2021-03-31 18:05:30.674] [driver] [info] [Task Finished] Transform to mem in 0.221064s (5770 normal rows, 0 exceptions)
[2021-03-31 18:05:30.896] [driver] [info] [Task Finished] Transform to mem in 0.221150s (5748 normal rows, 0 exceptions)
[2021-03-31 18:05:31.117] [driver] [info] [Task Finished] Transform to mem in 0.221072s (5779 normal rows, 0 exceptions)
[2021-03-31 18:05:31.338] [driver] [info] [Task Finished] Transform to mem in 0.221131s (5802 normal rows, 0 exceptions)
[2021-03-31 18:05:31.559] [driver] [info] [Task Finished] Transform to mem in 0.220942s (5706 normal rows, 0 exceptions)
[2021-03-31 18:05:31.780] [driver] [info] [Task Finished] Transform to mem in 0.221073s (5882 normal rows, 0 exceptions)
[2021-03-31 18:05:32.001] [driver] [info] [Task Finished] Transform to mem in 0.220989s (5883 normal rows, 0 exceptions)
[2021-03-31 18:05:32.222] [driver] [info] [Task Finished] Transform to mem in 0.221282s (6027 normal rows, 0 exceptions)
[2021-03-31 18:05:32.448] [driver] [info] [Task Finished] Transform to mem in 0.225578s (5766 normal rows, 0 exceptions)
[2021-03-31 18:05:32.671] [driver] [info] [Task Finished] Transform to mem in 0.223645s (5706 normal rows, 0 exceptions)
[2021-03-31 18:05:32.896] [driver] [info] [Task Finished] Transform to mem in 0.224377s (5709 normal rows, 0 exceptions)
[2021-03-31 18:05:33.117] [driver] [info] [Task Finished] Transform to mem in 0.220881s (5678 normal rows, 0 exceptions)
[2021-03-31 18:05:33.338] [driver] [info] [Task Finished] Transform to mem in 0.221146s (5821 normal rows, 0 exceptions)
[2021-03-31 18:05:33.559] [driver] [info] [Task Finished] Transform to mem in 0.221055s (5752 normal rows, 0 exceptions)
[2021-03-31 18:05:33.780] [driver] [info] [Task Finished] Transform to mem in 0.221094s (5761 normal rows, 0 exceptions)
[2021-03-31 18:05:34.001] [driver] [info] [Task Finished] Transform to mem in 0.221205s (5882 normal rows, 0 exceptions)
[2021-03-31 18:05:34.222] [driver] [info] [Task Finished] Transform to mem in 0.220860s (5651 normal rows, 0 exceptions)
[2021-03-31 18:05:34.443] [driver] [info] [Task Finished] Transform to mem in 0.221180s (5772 normal rows, 0 exceptions)
[2021-03-31 18:05:34.664] [driver] [info] [Task Finished] Transform to mem in 0.221049s (5665 normal rows, 0 exceptions)
[2021-03-31 18:05:34.886] [driver] [info] [Task Finished] Transform to mem in 0.221272s (5716 normal rows, 0 exceptions)
[2021-03-31 18:05:35.107] [driver] [info] [Task Finished] Transform to mem in 0.220977s (5723 normal rows, 0 exceptions)
[2021-03-31 18:05:35.328] [driver] [info] [Task Finished] Transform to mem in 0.221034s (5792 normal rows, 0 exceptions)
[2021-03-31 18:05:35.549] [driver] [info] [Task Finished] Transform to mem in 0.221094s (5781 normal rows, 0 exceptions)
[2021-03-31 18:05:35.770] [driver] [info] [Task Finished] Transform to mem in 0.220741s (5622 normal rows, 0 exceptions)
[2021-03-31 18:05:35.991] [driver] [info] [Task Finished] Transform to mem in 0.221003s (5781 normal rows, 0 exceptions)
[2021-03-31 18:05:36.215] [driver] [info] [Task Finished] Transform to mem in 0.224285s (5842 normal rows, 0 exceptions)
[2021-03-31 18:05:36.439] [driver] [info] [Task Finished] Transform to mem in 0.224500s (5926 normal rows, 0 exceptions)
[2021-03-31 18:05:36.660] [driver] [info] [Task Finished] Transform to mem in 0.221021s (5860 normal rows, 0 exceptions)
[2021-03-31 18:05:36.882] [driver] [info] [Task Finished] Transform to mem in 0.221272s (5749 normal rows, 0 exceptions)
[2021-03-31 18:05:37.104] [driver] [info] [Task Finished] Transform to mem in 0.222207s (5696 normal rows, 0 exceptions)
[2021-03-31 18:05:37.325] [driver] [info] [Task Finished] Transform to mem in 0.221444s (5821 normal rows, 0 exceptions)
[2021-03-31 18:05:37.547] [driver] [info] [Task Finished] Transform to mem in 0.221320s (5831 normal rows, 0 exceptions)
[2021-03-31 18:05:37.768] [driver] [info] [Task Finished] Transform to mem in 0.221486s (5915 normal rows, 0 exceptions)
[2021-03-31 18:05:37.989] [driver] [info] [Task Finished] Transform to mem in 0.221083s (5721 normal rows, 0 exceptions)
[2021-03-31 18:05:38.211] [driver] [info] [Task Finished] Transform to mem in 0.221275s (5839 normal rows, 0 exceptions)
[2021-03-31 18:05:38.432] [driver] [info] [Task Finished] Transform to mem in 0.220949s (5750 normal rows, 0 exceptions)
[2021-03-31 18:05:38.653] [driver] [info] [Task Finished] Transform to mem in 0.221293s (5878 normal rows, 0 exceptions)
[2021-03-31 18:05:38.874] [driver] [info] [Task Finished] Transform to mem in 0.221466s (5861 normal rows, 0 exceptions)
[2021-03-31 18:05:39.096] [driver] [info] [Task Finished] Transform to mem in 0.221373s (5810 normal rows, 0 exceptions)
[2021-03-31 18:05:39.317] [driver] [info] [Task Finished] Transform to mem in 0.220731s (5662 normal rows, 0 exceptions)
[2021-03-31 18:05:39.538] [driver] [info] [Task Finished] Transform to mem in 0.221056s (5777 normal rows, 0 exceptions)
[2021-03-31 18:05:39.760] [driver] [info] [Task Finished] Transform to mem in 0.222060s (5657 normal rows, 0 exceptions)
[2021-03-31 18:05:39.983] [driver] [info] [Task Finished] Transform to mem in 0.222982s (5731 normal rows, 0 exceptions)
[2021-03-31 18:05:40.207] [driver] [info] [Task Finished] Transform to mem in 0.224404s (5694 normal rows, 0 exceptions)
[2021-03-31 18:05:40.428] [driver] [info] [Task Finished] Transform to mem in 0.221171s (5813 normal rows, 0 exceptions)
[2021-03-31 18:05:40.654] [driver] [info] [Task Finished] Transform to mem in 0.225509s (5893 normal rows, 0 exceptions)
[2021-03-31 18:05:40.875] [driver] [info] [Task Finished] Transform to mem in 0.221620s (5850 normal rows, 0 exceptions)
[2021-03-31 18:05:41.097] [driver] [info] [Task Finished] Transform to mem in 0.221134s (5742 normal rows, 0 exceptions)
[2021-03-31 18:05:41.318] [driver] [info] [Task Finished] Transform to mem in 0.221196s (5795 normal rows, 0 exceptions)
[2021-03-31 18:05:41.539] [driver] [info] [Task Finished] Transform to mem in 0.221189s (5714 normal rows, 0 exceptions)
[2021-03-31 18:05:41.760] [driver] [info] [Task Finished] Transform to mem in 0.221234s (5709 normal rows, 0 exceptions)
[2021-03-31 18:05:41.982] [driver] [info] [Task Finished] Transform to mem in 0.221393s (5750 normal rows, 0 exceptions)
[2021-03-31 18:05:42.203] [driver] [info] [Task Finished] Transform to mem in 0.221182s (5750 normal rows, 0 exceptions)
[2021-03-31 18:05:42.424] [driver] [info] [Task Finished] Transform to mem in 0.221144s (5759 normal rows, 0 exceptions)
[2021-03-31 18:05:42.645] [driver] [info] [Task Finished] Transform to mem in 0.221465s (5734 normal rows, 0 exceptions)
[2021-03-31 18:05:42.867] [driver] [info] [Task Finished] Transform to mem in 0.221257s (5881 normal rows, 0 exceptions)
[2021-03-31 18:05:43.088] [driver] [info] [Task Finished] Transform to mem in 0.221060s (5807 normal rows, 0 exceptions)
[2021-03-31 18:05:43.309] [driver] [info] [Task Finished] Transform to mem in 0.220894s (5797 normal rows, 0 exceptions)
[2021-03-31 18:05:43.533] [driver] [info] [Task Finished] Transform to mem in 0.224195s (5786 normal rows, 0 exceptions)
[2021-03-31 18:05:43.755] [driver] [info] [Task Finished] Transform to mem in 0.222086s (5826 normal rows, 0 exceptions)
[2021-03-31 18:05:43.978] [driver] [info] [Task Finished] Transform to mem in 0.223431s (5722 normal rows, 0 exceptions)
[2021-03-31 18:05:44.199] [driver] [info] [Task Finished] Transform to mem in 0.220927s (5746 normal rows, 0 exceptions)
[2021-03-31 18:05:44.421] [driver] [info] [Task Finished] Transform to mem in 0.221153s (5775 normal rows, 0 exceptions)
[2021-03-31 18:05:44.642] [driver] [info] [Task Finished] Transform to mem in 0.221211s (5766 normal rows, 0 exceptions)
[2021-03-31 18:05:44.863] [driver] [info] [Task Finished] Transform to mem in 0.221609s (5877 normal rows, 0 exceptions)
[2021-03-31 18:05:45.085] [driver] [info] [Task Finished] Transform to mem in 0.221222s (5677 normal rows, 0 exceptions)
[2021-03-31 18:05:45.306] [driver] [info] [Task Finished] Transform to mem in 0.221241s (5846 normal rows, 0 exceptions)
[2021-03-31 18:05:45.527] [driver] [info] [Task Finished] Transform to mem in 0.221376s (5851 normal rows, 0 exceptions)
[2021-03-31 18:05:45.749] [driver] [info] [Task Finished] Transform to mem in 0.221386s (5820 normal rows, 0 exceptions)
[2021-03-31 18:05:45.970] [driver] [info] [Task Finished] Transform to mem in 0.221417s (5726 normal rows, 0 exceptions)
[2021-03-31 18:05:46.191] [driver] [info] [Task Finished] Transform to mem in 0.221112s (5684 normal rows, 0 exceptions)
[2021-03-31 18:05:46.413] [driver] [info] [Task Finished] Transform to mem in 0.221223s (5744 normal rows, 0 exceptions)
[2021-03-31 18:05:46.633] [driver] [info] [Task Finished] Transform to mem in 0.220731s (5606 normal rows, 0 exceptions)
[2021-03-31 18:05:46.855] [driver] [info] [Task Finished] Transform to mem in 0.221286s (5707 normal rows, 0 exceptions)
[2021-03-31 18:05:47.076] [driver] [info] [Task Finished] Transform to mem in 0.221115s (5831 normal rows, 0 exceptions)
[2021-03-31 18:05:47.300] [driver] [info] [Task Finished] Transform to mem in 0.224238s (5742 normal rows, 0 exceptions)
[2021-03-31 18:05:47.521] [driver] [info] [Task Finished] Transform to mem in 0.220802s (5546 normal rows, 0 exceptions)
[2021-03-31 18:05:47.742] [driver] [info] [Task Finished] Transform to mem in 0.220962s (5744 normal rows, 0 exceptions)
[2021-03-31 18:05:47.963] [driver] [info] [Task Finished] Transform to mem in 0.221286s (5879 normal rows, 0 exceptions)
[2021-03-31 18:05:48.184] [driver] [info] [Task Finished] Transform to mem in 0.221344s (5865 normal rows, 0 exceptions)
[2021-03-31 18:05:48.406] [driver] [info] [Task Finished] Transform to mem in 0.221170s (5776 normal rows, 0 exceptions)
[2021-03-31 18:05:48.631] [driver] [info] [Task Finished] Transform to mem in 0.225148s (5632 normal rows, 0 exceptions)
[2021-03-31 18:05:48.852] [driver] [info] [Task Finished] Transform to mem in 0.220914s (5766 normal rows, 0 exceptions)
[2021-03-31 18:05:49.073] [driver] [info] [Task Finished] Transform to mem in 0.221041s (5851 normal rows, 0 exceptions)
[2021-03-31 18:05:49.294] [driver] [info] [Task Finished] Transform to mem in 0.221376s (5842 normal rows, 0 exceptions)
[2021-03-31 18:05:49.515] [driver] [info] [Task Finished] Transform to mem in 0.221307s (5844 normal rows, 0 exceptions)
[2021-03-31 18:05:49.737] [driver] [info] [Task Finished] Transform to mem in 0.221323s (5911 normal rows, 0 exceptions)
[2021-03-31 18:05:49.958] [driver] [info] [Task Finished] Transform to mem in 0.221366s (5907 normal rows, 0 exceptions)
[2021-03-31 18:05:50.180] [driver] [info] [Task Finished] Transform to mem in 0.221331s (5866 normal rows, 0 exceptions)
[2021-03-31 18:05:50.401] [driver] [info] [Task Finished] Transform to mem in 0.221090s (5743 normal rows, 0 exceptions)
[2021-03-31 18:05:50.622] [driver] [info] [Task Finished] Transform to mem in 0.221012s (5720 normal rows, 0 exceptions)
[2021-03-31 18:05:50.846] [driver] [info] [Task Finished] Transform to mem in 0.224317s (5685 normal rows, 0 exceptions)
[2021-03-31 18:05:51.067] [driver] [info] [Task Finished] Transform to mem in 0.221009s (5883 normal rows, 0 exceptions)
[2021-03-31 18:05:51.288] [driver] [info] [Task Finished] Transform to mem in 0.220814s (5706 normal rows, 0 exceptions)
[2021-03-31 18:05:51.509] [driver] [info] [Task Finished] Transform to mem in 0.221177s (5929 normal rows, 0 exceptions)
[2021-03-31 18:05:51.730] [driver] [info] [Task Finished] Transform to mem in 0.221163s (5872 normal rows, 0 exceptions)
[2021-03-31 18:05:51.952] [driver] [info] [Task Finished] Transform to mem in 0.221373s (5847 normal rows, 0 exceptions)
[2021-03-31 18:05:52.176] [driver] [info] [Task Finished] Transform to mem in 0.224791s (5816 normal rows, 0 exceptions)
[2021-03-31 18:05:52.397] [driver] [info] [Task Finished] Transform to mem in 0.221015s (5649 normal rows, 0 exceptions)
[2021-03-31 18:05:52.619] [driver] [info] [Task Finished] Transform to mem in 0.221380s (5873 normal rows, 0 exceptions)
[2021-03-31 18:05:52.840] [driver] [info] [Task Finished] Transform to mem in 0.221310s (5686 normal rows, 0 exceptions)
[2021-03-31 18:05:53.061] [driver] [info] [Task Finished] Transform to mem in 0.221186s (5806 normal rows, 0 exceptions)
[2021-03-31 18:05:53.283] [driver] [info] [Task Finished] Transform to mem in 0.221157s (5765 normal rows, 0 exceptions)
[2021-03-31 18:05:53.504] [driver] [info] [Task Finished] Transform to mem in 0.220956s (5770 normal rows, 0 exceptions)
[2021-03-31 18:05:53.725] [driver] [info] [Task Finished] Transform to mem in 0.221074s (5643 normal rows, 0 exceptions)
[2021-03-31 18:05:53.946] [driver] [info] [Task Finished] Transform to mem in 0.221340s (5951 normal rows, 0 exceptions)
[2021-03-31 18:05:54.167] [driver] [info] [Task Finished] Transform to mem in 0.221046s (5759 normal rows, 0 exceptions)
[2021-03-31 18:05:54.388] [driver] [info] [Task Finished] Transform to mem in 0.220948s (5698 normal rows, 0 exceptions)
[2021-03-31 18:05:54.613] [driver] [info] [Task Finished] Transform to mem in 0.224545s (5955 normal rows, 0 exceptions)
[2021-03-31 18:05:54.834] [driver] [info] [Task Finished] Transform to mem in 0.221000s (5768 normal rows, 0 exceptions)
[2021-03-31 18:05:55.058] [driver] [info] [Task Finished] Transform to mem in 0.224432s (5772 normal rows, 0 exceptions)
[2021-03-31 18:05:55.279] [driver] [info] [Task Finished] Transform to mem in 0.221226s (5802 normal rows, 0 exceptions)
[2021-03-31 18:05:55.500] [driver] [info] [Task Finished] Transform to mem in 0.221123s (5799 normal rows, 0 exceptions)
[2021-03-31 18:05:55.725] [driver] [info] [Task Finished] Transform to mem in 0.224643s (5862 normal rows, 0 exceptions)
[2021-03-31 18:05:55.946] [driver] [info] [Task Finished] Transform to mem in 0.221389s (5856 normal rows, 0 exceptions)
[2021-03-31 18:05:56.167] [driver] [info] [Task Finished] Transform to mem in 0.220997s (5685 normal rows, 0 exceptions)
[2021-03-31 18:05:56.389] [driver] [info] [Task Finished] Transform to mem in 0.221139s (5751 normal rows, 0 exceptions)
[2021-03-31 18:05:56.614] [driver] [info] [Task Finished] Transform to mem in 0.225463s (5891 normal rows, 0 exceptions)
[2021-03-31 18:05:56.836] [driver] [info] [Task Finished] Transform to mem in 0.221656s (5852 normal rows, 0 exceptions)
[2021-03-31 18:05:57.058] [driver] [info] [Task Finished] Transform to mem in 0.221831s (5722 normal rows, 0 exceptions)
[2021-03-31 18:05:57.279] [driver] [info] [Task Finished] Transform to mem in 0.220869s (5645 normal rows, 0 exceptions)
[2021-03-31 18:05:57.500] [driver] [info] [Task Finished] Transform to mem in 0.221126s (5788 normal rows, 0 exceptions)
[2021-03-31 18:05:57.721] [driver] [info] [Task Finished] Transform to mem in 0.221098s (5813 normal rows, 0 exceptions)
[2021-03-31 18:05:57.942] [driver] [info] [Task Finished] Transform to mem in 0.220928s (5674 normal rows, 0 exceptions)
[2021-03-31 18:05:58.165] [driver] [info] [Task Finished] Transform to mem in 0.222809s (5853 normal rows, 0 exceptions)
[2021-03-31 18:05:58.387] [driver] [info] [Task Finished] Transform to mem in 0.222813s (5848 normal rows, 0 exceptions)
[2021-03-31 18:05:58.611] [driver] [info] [Task Finished] Transform to mem in 0.223223s (5811 normal rows, 0 exceptions)
[2021-03-31 18:05:58.833] [driver] [info] [Task Finished] Transform to mem in 0.222026s (5732 normal rows, 0 exceptions)
[2021-03-31 18:05:59.054] [driver] [info] [Task Finished] Transform to mem in 0.221133s (5801 normal rows, 0 exceptions)
[2021-03-31 18:05:59.275] [driver] [info] [Task Finished] Transform to mem in 0.221326s (5827 normal rows, 0 exceptions)
[2021-03-31 18:05:59.500] [driver] [info] [Task Finished] Transform to mem in 0.224657s (5868 normal rows, 0 exceptions)
[2021-03-31 18:05:59.721] [driver] [info] [Task Finished] Transform to mem in 0.221261s (5794 normal rows, 0 exceptions)
[2021-03-31 18:05:59.942] [driver] [info] [Task Finished] Transform to mem in 0.221298s (5817 normal rows, 0 exceptions)
[2021-03-31 18:06:00.163] [driver] [info] [Task Finished] Transform to mem in 0.220993s (5696 normal rows, 0 exceptions)
[2021-03-31 18:06:00.385] [driver] [info] [Task Finished] Transform to mem in 0.221207s (5732 normal rows, 0 exceptions)
[2021-03-31 18:06:00.606] [driver] [info] [Task Finished] Transform to mem in 0.220985s (5629 normal rows, 0 exceptions)
[2021-03-31 18:06:00.827] [driver] [info] [Task Finished] Transform to mem in 0.221235s (5789 normal rows, 0 exceptions)
[2021-03-31 18:06:01.048] [driver] [info] [Task Finished] Transform to mem in 0.221263s (5740 normal rows, 0 exceptions)
[2021-03-31 18:06:01.269] [driver] [info] [Task Finished] Transform to mem in 0.221157s (5841 normal rows, 0 exceptions)
[2021-03-31 18:06:01.493] [driver] [info] [Task Finished] Transform to mem in 0.223868s (5857 normal rows, 0 exceptions)
[2021-03-31 18:06:01.493] [global] [info] [Transform Stage] Stage 0 completed 149 load&transform tasks in 33.0385s
[2021-03-31 18:06:01.493] [global] [info] [Transform Stage] Stage 0 total wall clock time: 33.0359s, 48740298 input rows, time to process 1 row via fast path: 0.000677794ms

[2021-03-31 18:06:01.507] [global] [info] Writing 861387 rows as output to file (116.34 MB)
[2021-03-31 18:06:01.636] [driver] [info] [Task Finished] write to file in 0.129083s (861387 rows, 116.34 MB)
[2021-03-31 18:06:01.636] [global] [info] writing output took 0.142936s
[2021-03-31 18:06:01.636] [global] [info] [Transform Stage] Stage 0 completed 149 sink tasks in 0.143033s
[2021-03-31 18:06:01.636] [global] [info] [Transform Stage] Stage 0 took 33.6159s
[2021-03-31 18:06:01.636] [global] [info] Query Execution took 33.6974s. (planning: 0.0814266s, execution: 33.6159s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 12:55:20) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z1_preprocessed/zillow_Z1_10G.csv']
Tuplex startup time: 0.0050275325775146484
Tuplex job time: 33.96315360069275 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '499bbd619a75', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.00909582,"llvm_optimization_time_s":0.287974,"llvm_compilation_time_s":0.131793,"total_compilation_time_s":0.434375,"sampling_time_s":0.114674,"stages":[{"stage_no":0,"fast_path_wall_time_s":33.0359,"fast_path_time_s":33.0385,"fast_path_per_row_time_ns":677.794,"slow_path_wall_time_s":0,"slow_path_time_s":0,"slow_path_per_row_time_ns":0}]}
{"startupTime": 0.0050275325775146484, "jobTime": 33.96315360069275}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
