[2021-03-31 18:09:16.402] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:09:16.402] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:09:16.402] [local ee] [info] initializing LLVM backend
[2021-03-31 18:09:16.402] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:09:16.403] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:09:16.403] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-31 18:09:16.403] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:09:16.403] [fileinputoperator] [info] found 1 file (9.31 GB) to process.
[2021-03-31 18:09:16.404] [global] [info] sampled file:///data/zillow/Z1_preprocessed/zillow_Z1_10G.csv on 256.00 KB
[2021-03-31 18:09:16.543] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.559] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.567] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.590] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.609] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.623] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.654] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.668] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:09:16.671] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:09:16.673] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:09:16.675] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:09:16.680] [logical planner] [info] logical optimization took 0.008917ms
[2021-03-31 18:09:16.681] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.684] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.688] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.692] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.694] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.696] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.698] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:09:16.703] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:09:16.703] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,i64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:09:16.703] [codegen] [info] generating pipeline for (str,str,str,str,f64,str,str,str) -> (str,str,str,str,str,i64,i64,i64,str,str,i64) (12 operators pipelined)
[2021-03-31 18:09:16.704] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,str,str,str)) -> i64
[2021-03-31 18:09:16.705] [codegen] [info] generating lambda function for ((str,str,str,str,f64,str,str,str,i64)) -> boolean
[2021-03-31 18:09:16.705] [codegen] [info] generating function extractType for ((str,str,str,str,f64,str,str,str,i64)) -> str
[2021-03-31 18:09:16.706] [codegen] [info] generating lambda function for ((str,str,str,str,f64,str,str,str,i64,str)) -> boolean
[2021-03-31 18:09:16.706] [codegen] [info] generating lambda function for ((str,str,str,str,f64,str,str,str,i64,str)) -> str
[2021-03-31 18:09:16.707] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:09:16.707] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,str,str,str,i64,str,str)) -> i64
[2021-03-31 18:09:16.708] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,str,str,str,i64,str,str,i64)) -> i64
[2021-03-31 18:09:16.709] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,str,str,str,i64,str,str,i64,i64)) -> str
[2021-03-31 18:09:16.709] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,str,str,str,i64,str,str,i64,i64,str)) -> i64
[2021-03-31 18:09:16.711] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,i64,i64,str)) -> boolean
[2021-03-31 18:09:16.711] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,i64,i64,str)) -> (str,str,str,str,str,i64,i64,i64,str,str,i64)
[2021-03-31 18:09:16.712] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:09:16.713] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:09:16.714] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:09:16.714] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:09:16.715] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:09:16.715] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:09:16.716] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> i64
[2021-03-31 18:09:16.717] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64)) -> i64
[2021-03-31 18:09:16.717] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64)) -> str
[2021-03-31 18:09:16.718] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64,str)) -> i64
[2021-03-31 18:09:16.719] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> boolean
[2021-03-31 18:09:16.720] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,i64,i64,str,str,i64)
[2021-03-31 18:09:16.749] [global] [info] Stage0 depends on: 
[2021-03-31 18:09:17.049] [global] [info] Optimization via LLVM passes took 0.285948 ms
[2021-03-31 18:09:17.180] [global] [info] Compiled code paths for stage 0 in 0.13 ms
[2021-03-31 18:09:17.180] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.430984s
[2021-03-31 18:09:17.180] [local ee] [info] split /data/zillow/Z1_preprocessed/zillow_Z1_10G.csv into 149 tasks
[2021-03-31 18:09:17.393] [driver] [info] [Task Finished] Transform to mem in 0.212656s (5710 normal rows, 0 exceptions)
[2021-03-31 18:09:17.607] [driver] [info] [Task Finished] Transform to mem in 0.213634s (5758 normal rows, 0 exceptions)
[2021-03-31 18:09:17.817] [driver] [info] [Task Finished] Transform to mem in 0.210320s (5772 normal rows, 0 exceptions)
[2021-03-31 18:09:18.027] [driver] [info] [Task Finished] Transform to mem in 0.210251s (5744 normal rows, 0 exceptions)
[2021-03-31 18:09:18.238] [driver] [info] [Task Finished] Transform to mem in 0.210625s (5860 normal rows, 0 exceptions)
[2021-03-31 18:09:18.448] [driver] [info] [Task Finished] Transform to mem in 0.210479s (5864 normal rows, 0 exceptions)
[2021-03-31 18:09:18.659] [driver] [info] [Task Finished] Transform to mem in 0.210532s (5799 normal rows, 0 exceptions)
[2021-03-31 18:09:18.869] [driver] [info] [Task Finished] Transform to mem in 0.209911s (5663 normal rows, 0 exceptions)
[2021-03-31 18:09:19.079] [driver] [info] [Task Finished] Transform to mem in 0.210341s (5796 normal rows, 0 exceptions)
[2021-03-31 18:09:19.290] [driver] [info] [Task Finished] Transform to mem in 0.210534s (5770 normal rows, 0 exceptions)
[2021-03-31 18:09:19.500] [driver] [info] [Task Finished] Transform to mem in 0.210699s (5748 normal rows, 0 exceptions)
[2021-03-31 18:09:19.711] [driver] [info] [Task Finished] Transform to mem in 0.210289s (5779 normal rows, 0 exceptions)
[2021-03-31 18:09:19.921] [driver] [info] [Task Finished] Transform to mem in 0.210561s (5802 normal rows, 0 exceptions)
[2021-03-31 18:09:20.131] [driver] [info] [Task Finished] Transform to mem in 0.209837s (5706 normal rows, 0 exceptions)
[2021-03-31 18:09:20.342] [driver] [info] [Task Finished] Transform to mem in 0.210382s (5882 normal rows, 0 exceptions)
[2021-03-31 18:09:20.551] [driver] [info] [Task Finished] Transform to mem in 0.209739s (5883 normal rows, 0 exceptions)
[2021-03-31 18:09:20.761] [driver] [info] [Task Finished] Transform to mem in 0.210089s (6027 normal rows, 0 exceptions)
[2021-03-31 18:09:20.975] [driver] [info] [Task Finished] Transform to mem in 0.213295s (5766 normal rows, 0 exceptions)
[2021-03-31 18:09:21.185] [driver] [info] [Task Finished] Transform to mem in 0.210238s (5706 normal rows, 0 exceptions)
[2021-03-31 18:09:21.395] [driver] [info] [Task Finished] Transform to mem in 0.209606s (5709 normal rows, 0 exceptions)
[2021-03-31 18:09:21.605] [driver] [info] [Task Finished] Transform to mem in 0.210329s (5678 normal rows, 0 exceptions)
[2021-03-31 18:09:21.815] [driver] [info] [Task Finished] Transform to mem in 0.210549s (5821 normal rows, 0 exceptions)
[2021-03-31 18:09:22.026] [driver] [info] [Task Finished] Transform to mem in 0.210566s (5752 normal rows, 0 exceptions)
[2021-03-31 18:09:22.236] [driver] [info] [Task Finished] Transform to mem in 0.210245s (5761 normal rows, 0 exceptions)
[2021-03-31 18:09:22.446] [driver] [info] [Task Finished] Transform to mem in 0.210016s (5882 normal rows, 0 exceptions)
[2021-03-31 18:09:22.657] [driver] [info] [Task Finished] Transform to mem in 0.210147s (5651 normal rows, 0 exceptions)
[2021-03-31 18:09:22.867] [driver] [info] [Task Finished] Transform to mem in 0.210829s (5772 normal rows, 0 exceptions)
[2021-03-31 18:09:23.079] [driver] [info] [Task Finished] Transform to mem in 0.211537s (5665 normal rows, 0 exceptions)
[2021-03-31 18:09:23.289] [driver] [info] [Task Finished] Transform to mem in 0.210538s (5716 normal rows, 0 exceptions)
[2021-03-31 18:09:23.500] [driver] [info] [Task Finished] Transform to mem in 0.210357s (5723 normal rows, 0 exceptions)
[2021-03-31 18:09:23.710] [driver] [info] [Task Finished] Transform to mem in 0.210256s (5792 normal rows, 0 exceptions)
[2021-03-31 18:09:23.920] [driver] [info] [Task Finished] Transform to mem in 0.210003s (5781 normal rows, 0 exceptions)
[2021-03-31 18:09:24.130] [driver] [info] [Task Finished] Transform to mem in 0.209675s (5622 normal rows, 0 exceptions)
[2021-03-31 18:09:24.340] [driver] [info] [Task Finished] Transform to mem in 0.209858s (5781 normal rows, 0 exceptions)
[2021-03-31 18:09:24.556] [driver] [info] [Task Finished] Transform to mem in 0.215951s (5842 normal rows, 0 exceptions)
[2021-03-31 18:09:24.766] [driver] [info] [Task Finished] Transform to mem in 0.210409s (5926 normal rows, 0 exceptions)
[2021-03-31 18:09:24.977] [driver] [info] [Task Finished] Transform to mem in 0.210663s (5860 normal rows, 0 exceptions)
[2021-03-31 18:09:25.187] [driver] [info] [Task Finished] Transform to mem in 0.210460s (5749 normal rows, 0 exceptions)
[2021-03-31 18:09:25.397] [driver] [info] [Task Finished] Transform to mem in 0.210123s (5696 normal rows, 0 exceptions)
[2021-03-31 18:09:25.608] [driver] [info] [Task Finished] Transform to mem in 0.210433s (5821 normal rows, 0 exceptions)
[2021-03-31 18:09:25.818] [driver] [info] [Task Finished] Transform to mem in 0.210245s (5831 normal rows, 0 exceptions)
[2021-03-31 18:09:26.028] [driver] [info] [Task Finished] Transform to mem in 0.210221s (5915 normal rows, 0 exceptions)
[2021-03-31 18:09:26.238] [driver] [info] [Task Finished] Transform to mem in 0.209982s (5721 normal rows, 0 exceptions)
[2021-03-31 18:09:26.448] [driver] [info] [Task Finished] Transform to mem in 0.210113s (5839 normal rows, 0 exceptions)
[2021-03-31 18:09:26.659] [driver] [info] [Task Finished] Transform to mem in 0.210778s (5750 normal rows, 0 exceptions)
[2021-03-31 18:09:26.870] [driver] [info] [Task Finished] Transform to mem in 0.210947s (5878 normal rows, 0 exceptions)
[2021-03-31 18:09:27.080] [driver] [info] [Task Finished] Transform to mem in 0.210271s (5861 normal rows, 0 exceptions)
[2021-03-31 18:09:27.291] [driver] [info] [Task Finished] Transform to mem in 0.210537s (5810 normal rows, 0 exceptions)
[2021-03-31 18:09:27.501] [driver] [info] [Task Finished] Transform to mem in 0.210166s (5662 normal rows, 0 exceptions)
[2021-03-31 18:09:27.712] [driver] [info] [Task Finished] Transform to mem in 0.210477s (5777 normal rows, 0 exceptions)
[2021-03-31 18:09:27.922] [driver] [info] [Task Finished] Transform to mem in 0.210237s (5657 normal rows, 0 exceptions)
[2021-03-31 18:09:28.133] [driver] [info] [Task Finished] Transform to mem in 0.210794s (5731 normal rows, 0 exceptions)
[2021-03-31 18:09:28.346] [driver] [info] [Task Finished] Transform to mem in 0.213613s (5694 normal rows, 0 exceptions)
[2021-03-31 18:09:28.557] [driver] [info] [Task Finished] Transform to mem in 0.210415s (5813 normal rows, 0 exceptions)
[2021-03-31 18:09:28.767] [driver] [info] [Task Finished] Transform to mem in 0.210251s (5893 normal rows, 0 exceptions)
[2021-03-31 18:09:28.978] [driver] [info] [Task Finished] Transform to mem in 0.210920s (5850 normal rows, 0 exceptions)
[2021-03-31 18:09:29.188] [driver] [info] [Task Finished] Transform to mem in 0.210349s (5742 normal rows, 0 exceptions)
[2021-03-31 18:09:29.399] [driver] [info] [Task Finished] Transform to mem in 0.210651s (5795 normal rows, 0 exceptions)
[2021-03-31 18:09:29.610] [driver] [info] [Task Finished] Transform to mem in 0.210587s (5714 normal rows, 0 exceptions)
[2021-03-31 18:09:29.820] [driver] [info] [Task Finished] Transform to mem in 0.210332s (5709 normal rows, 0 exceptions)
[2021-03-31 18:09:30.031] [driver] [info] [Task Finished] Transform to mem in 0.210978s (5750 normal rows, 0 exceptions)
[2021-03-31 18:09:30.242] [driver] [info] [Task Finished] Transform to mem in 0.210736s (5750 normal rows, 0 exceptions)
[2021-03-31 18:09:30.453] [driver] [info] [Task Finished] Transform to mem in 0.210904s (5759 normal rows, 0 exceptions)
[2021-03-31 18:09:30.664] [driver] [info] [Task Finished] Transform to mem in 0.211573s (5734 normal rows, 0 exceptions)
[2021-03-31 18:09:30.875] [driver] [info] [Task Finished] Transform to mem in 0.211041s (5881 normal rows, 0 exceptions)
[2021-03-31 18:09:31.085] [driver] [info] [Task Finished] Transform to mem in 0.209804s (5807 normal rows, 0 exceptions)
[2021-03-31 18:09:31.296] [driver] [info] [Task Finished] Transform to mem in 0.210908s (5797 normal rows, 0 exceptions)
[2021-03-31 18:09:31.506] [driver] [info] [Task Finished] Transform to mem in 0.210125s (5786 normal rows, 0 exceptions)
[2021-03-31 18:09:31.716] [driver] [info] [Task Finished] Transform to mem in 0.210038s (5826 normal rows, 0 exceptions)
[2021-03-31 18:09:31.930] [driver] [info] [Task Finished] Transform to mem in 0.213461s (5722 normal rows, 0 exceptions)
[2021-03-31 18:09:32.140] [driver] [info] [Task Finished] Transform to mem in 0.210199s (5746 normal rows, 0 exceptions)
[2021-03-31 18:09:32.354] [driver] [info] [Task Finished] Transform to mem in 0.213900s (5775 normal rows, 0 exceptions)
[2021-03-31 18:09:32.569] [driver] [info] [Task Finished] Transform to mem in 0.215067s (5766 normal rows, 0 exceptions)
[2021-03-31 18:09:32.779] [driver] [info] [Task Finished] Transform to mem in 0.210147s (5877 normal rows, 0 exceptions)
[2021-03-31 18:09:32.990] [driver] [info] [Task Finished] Transform to mem in 0.210732s (5677 normal rows, 0 exceptions)
[2021-03-31 18:09:33.203] [driver] [info] [Task Finished] Transform to mem in 0.213316s (5846 normal rows, 0 exceptions)
[2021-03-31 18:09:33.414] [driver] [info] [Task Finished] Transform to mem in 0.210664s (5851 normal rows, 0 exceptions)
[2021-03-31 18:09:33.625] [driver] [info] [Task Finished] Transform to mem in 0.210827s (5820 normal rows, 0 exceptions)
[2021-03-31 18:09:33.835] [driver] [info] [Task Finished] Transform to mem in 0.210176s (5726 normal rows, 0 exceptions)
[2021-03-31 18:09:34.045] [driver] [info] [Task Finished] Transform to mem in 0.209879s (5684 normal rows, 0 exceptions)
[2021-03-31 18:09:34.256] [driver] [info] [Task Finished] Transform to mem in 0.210884s (5744 normal rows, 0 exceptions)
[2021-03-31 18:09:34.467] [driver] [info] [Task Finished] Transform to mem in 0.210863s (5606 normal rows, 0 exceptions)
[2021-03-31 18:09:34.677] [driver] [info] [Task Finished] Transform to mem in 0.210576s (5707 normal rows, 0 exceptions)
[2021-03-31 18:09:34.888] [driver] [info] [Task Finished] Transform to mem in 0.210699s (5831 normal rows, 0 exceptions)
[2021-03-31 18:09:35.098] [driver] [info] [Task Finished] Transform to mem in 0.210638s (5742 normal rows, 0 exceptions)
[2021-03-31 18:09:35.308] [driver] [info] [Task Finished] Transform to mem in 0.209731s (5546 normal rows, 0 exceptions)
[2021-03-31 18:09:35.522] [driver] [info] [Task Finished] Transform to mem in 0.213538s (5744 normal rows, 0 exceptions)
[2021-03-31 18:09:35.732] [driver] [info] [Task Finished] Transform to mem in 0.210457s (5879 normal rows, 0 exceptions)
[2021-03-31 18:09:35.944] [driver] [info] [Task Finished] Transform to mem in 0.211968s (5865 normal rows, 0 exceptions)
[2021-03-31 18:09:36.156] [driver] [info] [Task Finished] Transform to mem in 0.211914s (5776 normal rows, 0 exceptions)
[2021-03-31 18:09:36.367] [driver] [info] [Task Finished] Transform to mem in 0.210429s (5632 normal rows, 0 exceptions)
[2021-03-31 18:09:36.577] [driver] [info] [Task Finished] Transform to mem in 0.210224s (5766 normal rows, 0 exceptions)
[2021-03-31 18:09:36.791] [driver] [info] [Task Finished] Transform to mem in 0.213963s (5851 normal rows, 0 exceptions)
[2021-03-31 18:09:37.003] [driver] [info] [Task Finished] Transform to mem in 0.211737s (5842 normal rows, 0 exceptions)
[2021-03-31 18:09:37.214] [driver] [info] [Task Finished] Transform to mem in 0.210906s (5844 normal rows, 0 exceptions)
[2021-03-31 18:09:37.424] [driver] [info] [Task Finished] Transform to mem in 0.210449s (5911 normal rows, 0 exceptions)
[2021-03-31 18:09:37.634] [driver] [info] [Task Finished] Transform to mem in 0.210291s (5907 normal rows, 0 exceptions)
[2021-03-31 18:09:37.845] [driver] [info] [Task Finished] Transform to mem in 0.210441s (5866 normal rows, 0 exceptions)
[2021-03-31 18:09:38.056] [driver] [info] [Task Finished] Transform to mem in 0.210764s (5743 normal rows, 0 exceptions)
[2021-03-31 18:09:38.266] [driver] [info] [Task Finished] Transform to mem in 0.210468s (5720 normal rows, 0 exceptions)
[2021-03-31 18:09:38.477] [driver] [info] [Task Finished] Transform to mem in 0.210823s (5685 normal rows, 0 exceptions)
[2021-03-31 18:09:38.687] [driver] [info] [Task Finished] Transform to mem in 0.210421s (5883 normal rows, 0 exceptions)
[2021-03-31 18:09:38.897] [driver] [info] [Task Finished] Transform to mem in 0.210133s (5706 normal rows, 0 exceptions)
[2021-03-31 18:09:39.108] [driver] [info] [Task Finished] Transform to mem in 0.210279s (5929 normal rows, 0 exceptions)
[2021-03-31 18:09:39.321] [driver] [info] [Task Finished] Transform to mem in 0.213446s (5872 normal rows, 0 exceptions)
[2021-03-31 18:09:39.531] [driver] [info] [Task Finished] Transform to mem in 0.209608s (5847 normal rows, 0 exceptions)
[2021-03-31 18:09:39.745] [driver] [info] [Task Finished] Transform to mem in 0.214373s (5816 normal rows, 0 exceptions)
[2021-03-31 18:09:39.956] [driver] [info] [Task Finished] Transform to mem in 0.210565s (5649 normal rows, 0 exceptions)
[2021-03-31 18:09:40.167] [driver] [info] [Task Finished] Transform to mem in 0.211231s (5873 normal rows, 0 exceptions)
[2021-03-31 18:09:40.377] [driver] [info] [Task Finished] Transform to mem in 0.210183s (5686 normal rows, 0 exceptions)
[2021-03-31 18:09:40.596] [driver] [info] [Task Finished] Transform to mem in 0.218456s (5806 normal rows, 0 exceptions)
[2021-03-31 18:09:40.806] [driver] [info] [Task Finished] Transform to mem in 0.210481s (5765 normal rows, 0 exceptions)
[2021-03-31 18:09:41.017] [driver] [info] [Task Finished] Transform to mem in 0.210902s (5770 normal rows, 0 exceptions)
[2021-03-31 18:09:41.228] [driver] [info] [Task Finished] Transform to mem in 0.210458s (5643 normal rows, 0 exceptions)
[2021-03-31 18:09:41.438] [driver] [info] [Task Finished] Transform to mem in 0.210598s (5951 normal rows, 0 exceptions)
[2021-03-31 18:09:41.648] [driver] [info] [Task Finished] Transform to mem in 0.209947s (5759 normal rows, 0 exceptions)
[2021-03-31 18:09:41.858] [driver] [info] [Task Finished] Transform to mem in 0.210085s (5698 normal rows, 0 exceptions)
[2021-03-31 18:09:42.069] [driver] [info] [Task Finished] Transform to mem in 0.210293s (5955 normal rows, 0 exceptions)
[2021-03-31 18:09:42.279] [driver] [info] [Task Finished] Transform to mem in 0.210814s (5768 normal rows, 0 exceptions)
[2021-03-31 18:09:42.490] [driver] [info] [Task Finished] Transform to mem in 0.210202s (5772 normal rows, 0 exceptions)
[2021-03-31 18:09:42.700] [driver] [info] [Task Finished] Transform to mem in 0.210704s (5802 normal rows, 0 exceptions)
[2021-03-31 18:09:42.914] [driver] [info] [Task Finished] Transform to mem in 0.214020s (5799 normal rows, 0 exceptions)
[2021-03-31 18:09:43.125] [driver] [info] [Task Finished] Transform to mem in 0.210200s (5862 normal rows, 0 exceptions)
[2021-03-31 18:09:43.338] [driver] [info] [Task Finished] Transform to mem in 0.212951s (5856 normal rows, 0 exceptions)
[2021-03-31 18:09:43.548] [driver] [info] [Task Finished] Transform to mem in 0.210735s (5685 normal rows, 0 exceptions)
[2021-03-31 18:09:43.758] [driver] [info] [Task Finished] Transform to mem in 0.209973s (5751 normal rows, 0 exceptions)
[2021-03-31 18:09:43.969] [driver] [info] [Task Finished] Transform to mem in 0.210921s (5891 normal rows, 0 exceptions)
[2021-03-31 18:09:44.183] [driver] [info] [Task Finished] Transform to mem in 0.214084s (5852 normal rows, 0 exceptions)
[2021-03-31 18:09:44.394] [driver] [info] [Task Finished] Transform to mem in 0.210399s (5722 normal rows, 0 exceptions)
[2021-03-31 18:09:44.604] [driver] [info] [Task Finished] Transform to mem in 0.209971s (5645 normal rows, 0 exceptions)
[2021-03-31 18:09:44.814] [driver] [info] [Task Finished] Transform to mem in 0.210073s (5788 normal rows, 0 exceptions)
[2021-03-31 18:09:45.025] [driver] [info] [Task Finished] Transform to mem in 0.210878s (5813 normal rows, 0 exceptions)
[2021-03-31 18:09:45.235] [driver] [info] [Task Finished] Transform to mem in 0.210048s (5674 normal rows, 0 exceptions)
[2021-03-31 18:09:45.445] [driver] [info] [Task Finished] Transform to mem in 0.210471s (5853 normal rows, 0 exceptions)
[2021-03-31 18:09:45.656] [driver] [info] [Task Finished] Transform to mem in 0.210954s (5848 normal rows, 0 exceptions)
[2021-03-31 18:09:45.867] [driver] [info] [Task Finished] Transform to mem in 0.210360s (5811 normal rows, 0 exceptions)
[2021-03-31 18:09:46.077] [driver] [info] [Task Finished] Transform to mem in 0.210298s (5732 normal rows, 0 exceptions)
[2021-03-31 18:09:46.287] [driver] [info] [Task Finished] Transform to mem in 0.210193s (5801 normal rows, 0 exceptions)
[2021-03-31 18:09:46.498] [driver] [info] [Task Finished] Transform to mem in 0.210726s (5827 normal rows, 0 exceptions)
[2021-03-31 18:09:46.712] [driver] [info] [Task Finished] Transform to mem in 0.213949s (5868 normal rows, 0 exceptions)
[2021-03-31 18:09:46.922] [driver] [info] [Task Finished] Transform to mem in 0.210359s (5794 normal rows, 0 exceptions)
[2021-03-31 18:09:47.136] [driver] [info] [Task Finished] Transform to mem in 0.213581s (5817 normal rows, 0 exceptions)
[2021-03-31 18:09:47.346] [driver] [info] [Task Finished] Transform to mem in 0.209792s (5696 normal rows, 0 exceptions)
[2021-03-31 18:09:47.555] [driver] [info] [Task Finished] Transform to mem in 0.209804s (5732 normal rows, 0 exceptions)
[2021-03-31 18:09:47.768] [driver] [info] [Task Finished] Transform to mem in 0.212476s (5629 normal rows, 0 exceptions)
[2021-03-31 18:09:47.978] [driver] [info] [Task Finished] Transform to mem in 0.210401s (5789 normal rows, 0 exceptions)
[2021-03-31 18:09:48.189] [driver] [info] [Task Finished] Transform to mem in 0.210217s (5740 normal rows, 0 exceptions)
[2021-03-31 18:09:48.399] [driver] [info] [Task Finished] Transform to mem in 0.209943s (5841 normal rows, 0 exceptions)
[2021-03-31 18:09:48.616] [driver] [info] [Task Finished] Transform to mem in 0.217050s (5857 normal rows, 0 exceptions)
[2021-03-31 18:09:48.616] [global] [info] [Transform Stage] Stage 0 completed 149 load&transform tasks in 31.4356s
[2021-03-31 18:09:48.616] [global] [info] [Transform Stage] Stage 0 total wall clock time: 31.4331s, 48740298 input rows, time to process 1 row via fast path: 0.00064491ms

[2021-03-31 18:09:48.629] [global] [info] Writing 861387 rows as output to file (116.34 MB)
[2021-03-31 18:09:48.759] [driver] [info] [Task Finished] write to file in 0.129085s (861387 rows, 116.34 MB)
[2021-03-31 18:09:48.759] [global] [info] writing output took 0.142856s
[2021-03-31 18:09:48.759] [global] [info] [Transform Stage] Stage 0 completed 149 sink tasks in 0.142937s
[2021-03-31 18:09:48.759] [global] [info] [Transform Stage] Stage 0 took 32.0096s
[2021-03-31 18:09:48.759] [global] [info] Query Execution took 32.0898s. (planning: 0.0801166s, execution: 32.0096s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 12:55:20) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z1_preprocessed/zillow_Z1_10G.csv']
Tuplex startup time: 0.005045652389526367
Tuplex job time: 32.35654830932617 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '499bbd619a75', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.00891694,"llvm_optimization_time_s":0.285948,"llvm_compilation_time_s":0.130691,"total_compilation_time_s":0.430981,"sampling_time_s":0.115712,"stages":[{"stage_no":0,"fast_path_wall_time_s":31.4331,"fast_path_time_s":31.4357,"fast_path_per_row_time_ns":644.91,"slow_path_wall_time_s":0,"slow_path_time_s":0,"slow_path_per_row_time_ns":0}]}
{"startupTime": 0.005045652389526367, "jobTime": 32.35654830932617}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
