[2021-03-24 07:25:46.378] [global] [error] could not find backend, defaulting to local
[2021-03-24 07:25:46.378] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-24 07:25:46.378] [local ee] [info] initializing LLVM backend
[2021-03-24 07:25:46.378] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-24 07:25:46.378] [LLVM] [info] compiling code for skylake-avx512
[2021-03-24 07:25:46.379] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-24 07:25:46.379] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-24 07:25:46.379] [fileinputoperator] [info] found 1 file (9.31 GB) to process.
[2021-03-24 07:25:46.380] [global] [info] sampled file:///data/zillow/Z1_preprocessed/zillow_Z1_10G.csv on 256.00 KB
[2021-03-24 07:25:46.517] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:25:46.532] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:25:46.540] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:25:46.563] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:25:46.582] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:25:46.595] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:25:46.626] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:25:46.641] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:25:46.644] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:25:46.646] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:25:46.648] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:25:46.653] [logical planner] [info] logical optimization took 0.008978ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-24 07:25:46.653] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (12 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,i64,i64,str,str,i64)
[2021-03-24 07:25:46.654] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-24 07:25:46.654] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-24 07:25:46.655] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-24 07:25:46.656] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-24 07:25:46.656] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-24 07:25:46.657] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-24 07:25:46.657] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> i64
[2021-03-24 07:25:46.658] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64)) -> i64
[2021-03-24 07:25:46.659] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64)) -> str
[2021-03-24 07:25:46.660] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64,str)) -> i64
[2021-03-24 07:25:46.661] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> boolean
[2021-03-24 07:25:46.661] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,i64,i64,str,str,i64)
[2021-03-24 07:25:46.687] [global] [info] Stage0 depends on: 
[2021-03-24 07:25:46.828] [global] [info] Optimization via LLVM passes took 0.134279 ms
[2021-03-24 07:25:46.889] [global] [info] Compiled code paths for stage 0 in 0.06 ms
[2021-03-24 07:25:46.889] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.202229s
[2021-03-24 07:25:46.890] [local ee] [info] split /data/zillow/Z1_preprocessed/zillow_Z1_10G.csv into 149 tasks
[2021-03-24 07:25:47.106] [driver] [info] [Task Finished] Transform to mem in 0.216723s (5710 normal rows, 0 exceptions)
[2021-03-24 07:25:47.320] [driver] [info] [Task Finished] Transform to mem in 0.213775s (5758 normal rows, 0 exceptions)
[2021-03-24 07:25:47.543] [driver] [info] [Task Finished] Transform to mem in 0.222614s (5772 normal rows, 0 exceptions)
[2021-03-24 07:25:47.757] [driver] [info] [Task Finished] Transform to mem in 0.214524s (5744 normal rows, 0 exceptions)
[2021-03-24 07:25:47.971] [driver] [info] [Task Finished] Transform to mem in 0.213980s (5860 normal rows, 0 exceptions)
[2021-03-24 07:25:48.186] [driver] [info] [Task Finished] Transform to mem in 0.214234s (5864 normal rows, 0 exceptions)
[2021-03-24 07:25:48.400] [driver] [info] [Task Finished] Transform to mem in 0.214146s (5799 normal rows, 0 exceptions)
[2021-03-24 07:25:48.613] [driver] [info] [Task Finished] Transform to mem in 0.213484s (5663 normal rows, 0 exceptions)
[2021-03-24 07:25:48.827] [driver] [info] [Task Finished] Transform to mem in 0.213632s (5796 normal rows, 0 exceptions)
[2021-03-24 07:25:49.040] [driver] [info] [Task Finished] Transform to mem in 0.213436s (5770 normal rows, 0 exceptions)
[2021-03-24 07:25:49.254] [driver] [info] [Task Finished] Transform to mem in 0.213751s (5748 normal rows, 0 exceptions)
[2021-03-24 07:25:49.468] [driver] [info] [Task Finished] Transform to mem in 0.213550s (5779 normal rows, 0 exceptions)
[2021-03-24 07:25:49.681] [driver] [info] [Task Finished] Transform to mem in 0.213459s (5802 normal rows, 0 exceptions)
[2021-03-24 07:25:49.895] [driver] [info] [Task Finished] Transform to mem in 0.213578s (5706 normal rows, 0 exceptions)
[2021-03-24 07:25:50.109] [driver] [info] [Task Finished] Transform to mem in 0.213918s (5882 normal rows, 0 exceptions)
[2021-03-24 07:25:50.322] [driver] [info] [Task Finished] Transform to mem in 0.213771s (5883 normal rows, 0 exceptions)
[2021-03-24 07:25:50.536] [driver] [info] [Task Finished] Transform to mem in 0.213969s (6027 normal rows, 0 exceptions)
[2021-03-24 07:25:50.750] [driver] [info] [Task Finished] Transform to mem in 0.213898s (5766 normal rows, 0 exceptions)
[2021-03-24 07:25:50.964] [driver] [info] [Task Finished] Transform to mem in 0.213988s (5706 normal rows, 0 exceptions)
[2021-03-24 07:25:51.178] [driver] [info] [Task Finished] Transform to mem in 0.213738s (5709 normal rows, 0 exceptions)
[2021-03-24 07:25:51.391] [driver] [info] [Task Finished] Transform to mem in 0.213269s (5678 normal rows, 0 exceptions)
[2021-03-24 07:25:51.605] [driver] [info] [Task Finished] Transform to mem in 0.213917s (5821 normal rows, 0 exceptions)
[2021-03-24 07:25:51.819] [driver] [info] [Task Finished] Transform to mem in 0.213576s (5752 normal rows, 0 exceptions)
[2021-03-24 07:25:52.032] [driver] [info] [Task Finished] Transform to mem in 0.213277s (5761 normal rows, 0 exceptions)
[2021-03-24 07:25:52.246] [driver] [info] [Task Finished] Transform to mem in 0.213777s (5882 normal rows, 0 exceptions)
[2021-03-24 07:25:52.459] [driver] [info] [Task Finished] Transform to mem in 0.213270s (5651 normal rows, 0 exceptions)
[2021-03-24 07:25:52.673] [driver] [info] [Task Finished] Transform to mem in 0.213791s (5772 normal rows, 0 exceptions)
[2021-03-24 07:25:52.887] [driver] [info] [Task Finished] Transform to mem in 0.213582s (5665 normal rows, 0 exceptions)
[2021-03-24 07:25:53.100] [driver] [info] [Task Finished] Transform to mem in 0.213778s (5716 normal rows, 0 exceptions)
[2021-03-24 07:25:53.314] [driver] [info] [Task Finished] Transform to mem in 0.213772s (5723 normal rows, 0 exceptions)
[2021-03-24 07:25:53.528] [driver] [info] [Task Finished] Transform to mem in 0.213679s (5792 normal rows, 0 exceptions)
[2021-03-24 07:25:53.742] [driver] [info] [Task Finished] Transform to mem in 0.213583s (5781 normal rows, 0 exceptions)
[2021-03-24 07:25:53.955] [driver] [info] [Task Finished] Transform to mem in 0.213581s (5622 normal rows, 0 exceptions)
[2021-03-24 07:25:54.169] [driver] [info] [Task Finished] Transform to mem in 0.213791s (5781 normal rows, 0 exceptions)
[2021-03-24 07:25:54.383] [driver] [info] [Task Finished] Transform to mem in 0.213676s (5842 normal rows, 0 exceptions)
[2021-03-24 07:25:54.597] [driver] [info] [Task Finished] Transform to mem in 0.213996s (5926 normal rows, 0 exceptions)
[2021-03-24 07:25:54.810] [driver] [info] [Task Finished] Transform to mem in 0.213706s (5860 normal rows, 0 exceptions)
[2021-03-24 07:25:55.025] [driver] [info] [Task Finished] Transform to mem in 0.214339s (5749 normal rows, 0 exceptions)
[2021-03-24 07:25:55.238] [driver] [info] [Task Finished] Transform to mem in 0.213525s (5696 normal rows, 0 exceptions)
[2021-03-24 07:25:55.452] [driver] [info] [Task Finished] Transform to mem in 0.213776s (5821 normal rows, 0 exceptions)
[2021-03-24 07:25:55.666] [driver] [info] [Task Finished] Transform to mem in 0.213633s (5831 normal rows, 0 exceptions)
[2021-03-24 07:25:55.879] [driver] [info] [Task Finished] Transform to mem in 0.213735s (5915 normal rows, 0 exceptions)
[2021-03-24 07:25:56.093] [driver] [info] [Task Finished] Transform to mem in 0.213424s (5721 normal rows, 0 exceptions)
[2021-03-24 07:25:56.307] [driver] [info] [Task Finished] Transform to mem in 0.214003s (5839 normal rows, 0 exceptions)
[2021-03-24 07:25:56.520] [driver] [info] [Task Finished] Transform to mem in 0.213448s (5750 normal rows, 0 exceptions)
[2021-03-24 07:25:56.735] [driver] [info] [Task Finished] Transform to mem in 0.214172s (5878 normal rows, 0 exceptions)
[2021-03-24 07:25:56.949] [driver] [info] [Task Finished] Transform to mem in 0.214407s (5861 normal rows, 0 exceptions)
[2021-03-24 07:25:57.163] [driver] [info] [Task Finished] Transform to mem in 0.213636s (5810 normal rows, 0 exceptions)
[2021-03-24 07:25:57.377] [driver] [info] [Task Finished] Transform to mem in 0.214156s (5662 normal rows, 0 exceptions)
[2021-03-24 07:25:57.591] [driver] [info] [Task Finished] Transform to mem in 0.213811s (5777 normal rows, 0 exceptions)
[2021-03-24 07:25:57.804] [driver] [info] [Task Finished] Transform to mem in 0.213619s (5657 normal rows, 0 exceptions)
[2021-03-24 07:25:58.018] [driver] [info] [Task Finished] Transform to mem in 0.213410s (5731 normal rows, 0 exceptions)
[2021-03-24 07:25:58.232] [driver] [info] [Task Finished] Transform to mem in 0.213794s (5694 normal rows, 0 exceptions)
[2021-03-24 07:25:58.445] [driver] [info] [Task Finished] Transform to mem in 0.213767s (5813 normal rows, 0 exceptions)
[2021-03-24 07:25:58.659] [driver] [info] [Task Finished] Transform to mem in 0.213910s (5893 normal rows, 0 exceptions)
[2021-03-24 07:25:58.873] [driver] [info] [Task Finished] Transform to mem in 0.214207s (5850 normal rows, 0 exceptions)
[2021-03-24 07:25:59.087] [driver] [info] [Task Finished] Transform to mem in 0.213637s (5742 normal rows, 0 exceptions)
[2021-03-24 07:25:59.300] [driver] [info] [Task Finished] Transform to mem in 0.213327s (5795 normal rows, 0 exceptions)
[2021-03-24 07:25:59.514] [driver] [info] [Task Finished] Transform to mem in 0.213619s (5714 normal rows, 0 exceptions)
[2021-03-24 07:25:59.728] [driver] [info] [Task Finished] Transform to mem in 0.213677s (5709 normal rows, 0 exceptions)
[2021-03-24 07:25:59.941] [driver] [info] [Task Finished] Transform to mem in 0.213309s (5750 normal rows, 0 exceptions)
[2021-03-24 07:26:00.155] [driver] [info] [Task Finished] Transform to mem in 0.213627s (5750 normal rows, 0 exceptions)
[2021-03-24 07:26:00.368] [driver] [info] [Task Finished] Transform to mem in 0.213305s (5759 normal rows, 0 exceptions)
[2021-03-24 07:26:00.581] [driver] [info] [Task Finished] Transform to mem in 0.213349s (5734 normal rows, 0 exceptions)
[2021-03-24 07:26:00.795] [driver] [info] [Task Finished] Transform to mem in 0.214013s (5881 normal rows, 0 exceptions)
[2021-03-24 07:26:01.009] [driver] [info] [Task Finished] Transform to mem in 0.213673s (5807 normal rows, 0 exceptions)
[2021-03-24 07:26:01.223] [driver] [info] [Task Finished] Transform to mem in 0.213709s (5797 normal rows, 0 exceptions)
[2021-03-24 07:26:01.437] [driver] [info] [Task Finished] Transform to mem in 0.213795s (5786 normal rows, 0 exceptions)
[2021-03-24 07:26:01.650] [driver] [info] [Task Finished] Transform to mem in 0.213287s (5826 normal rows, 0 exceptions)
[2021-03-24 07:26:01.864] [driver] [info] [Task Finished] Transform to mem in 0.213698s (5722 normal rows, 0 exceptions)
[2021-03-24 07:26:02.078] [driver] [info] [Task Finished] Transform to mem in 0.213943s (5746 normal rows, 0 exceptions)
[2021-03-24 07:26:02.291] [driver] [info] [Task Finished] Transform to mem in 0.213649s (5775 normal rows, 0 exceptions)
[2021-03-24 07:26:02.505] [driver] [info] [Task Finished] Transform to mem in 0.213753s (5766 normal rows, 0 exceptions)
[2021-03-24 07:26:02.719] [driver] [info] [Task Finished] Transform to mem in 0.213643s (5877 normal rows, 0 exceptions)
[2021-03-24 07:26:02.932] [driver] [info] [Task Finished] Transform to mem in 0.213459s (5677 normal rows, 0 exceptions)
[2021-03-24 07:26:03.146] [driver] [info] [Task Finished] Transform to mem in 0.213691s (5846 normal rows, 0 exceptions)
[2021-03-24 07:26:03.360] [driver] [info] [Task Finished] Transform to mem in 0.214004s (5851 normal rows, 0 exceptions)
[2021-03-24 07:26:03.574] [driver] [info] [Task Finished] Transform to mem in 0.213635s (5820 normal rows, 0 exceptions)
[2021-03-24 07:26:03.787] [driver] [info] [Task Finished] Transform to mem in 0.213730s (5726 normal rows, 0 exceptions)
[2021-03-24 07:26:04.001] [driver] [info] [Task Finished] Transform to mem in 0.213431s (5684 normal rows, 0 exceptions)
[2021-03-24 07:26:04.214] [driver] [info] [Task Finished] Transform to mem in 0.213657s (5744 normal rows, 0 exceptions)
[2021-03-24 07:26:04.428] [driver] [info] [Task Finished] Transform to mem in 0.213748s (5606 normal rows, 0 exceptions)
[2021-03-24 07:26:04.642] [driver] [info] [Task Finished] Transform to mem in 0.213550s (5707 normal rows, 0 exceptions)
[2021-03-24 07:26:04.856] [driver] [info] [Task Finished] Transform to mem in 0.213930s (5831 normal rows, 0 exceptions)
[2021-03-24 07:26:05.069] [driver] [info] [Task Finished] Transform to mem in 0.213481s (5742 normal rows, 0 exceptions)
[2021-03-24 07:26:05.283] [driver] [info] [Task Finished] Transform to mem in 0.213345s (5546 normal rows, 0 exceptions)
[2021-03-24 07:26:05.496] [driver] [info] [Task Finished] Transform to mem in 0.213473s (5744 normal rows, 0 exceptions)
[2021-03-24 07:26:05.710] [driver] [info] [Task Finished] Transform to mem in 0.213727s (5879 normal rows, 0 exceptions)
[2021-03-24 07:26:05.924] [driver] [info] [Task Finished] Transform to mem in 0.213735s (5865 normal rows, 0 exceptions)
[2021-03-24 07:26:06.138] [driver] [info] [Task Finished] Transform to mem in 0.213948s (5776 normal rows, 0 exceptions)
[2021-03-24 07:26:06.351] [driver] [info] [Task Finished] Transform to mem in 0.213564s (5632 normal rows, 0 exceptions)
[2021-03-24 07:26:06.565] [driver] [info] [Task Finished] Transform to mem in 0.213736s (5766 normal rows, 0 exceptions)
[2021-03-24 07:26:06.779] [driver] [info] [Task Finished] Transform to mem in 0.213899s (5851 normal rows, 0 exceptions)
[2021-03-24 07:26:06.993] [driver] [info] [Task Finished] Transform to mem in 0.213872s (5842 normal rows, 0 exceptions)
[2021-03-24 07:26:07.207] [driver] [info] [Task Finished] Transform to mem in 0.214007s (5844 normal rows, 0 exceptions)
[2021-03-24 07:26:07.421] [driver] [info] [Task Finished] Transform to mem in 0.213818s (5911 normal rows, 0 exceptions)
[2021-03-24 07:26:07.635] [driver] [info] [Task Finished] Transform to mem in 0.214234s (5907 normal rows, 0 exceptions)
[2021-03-24 07:26:07.849] [driver] [info] [Task Finished] Transform to mem in 0.213832s (5866 normal rows, 0 exceptions)
[2021-03-24 07:26:08.062] [driver] [info] [Task Finished] Transform to mem in 0.213598s (5743 normal rows, 0 exceptions)
[2021-03-24 07:26:08.276] [driver] [info] [Task Finished] Transform to mem in 0.213836s (5720 normal rows, 0 exceptions)
[2021-03-24 07:26:08.490] [driver] [info] [Task Finished] Transform to mem in 0.213449s (5685 normal rows, 0 exceptions)
[2021-03-24 07:26:08.703] [driver] [info] [Task Finished] Transform to mem in 0.213819s (5883 normal rows, 0 exceptions)
[2021-03-24 07:26:08.917] [driver] [info] [Task Finished] Transform to mem in 0.213911s (5706 normal rows, 0 exceptions)
[2021-03-24 07:26:09.131] [driver] [info] [Task Finished] Transform to mem in 0.213533s (5929 normal rows, 0 exceptions)
[2021-03-24 07:26:09.345] [driver] [info] [Task Finished] Transform to mem in 0.213734s (5872 normal rows, 0 exceptions)
[2021-03-24 07:26:09.558] [driver] [info] [Task Finished] Transform to mem in 0.213524s (5847 normal rows, 0 exceptions)
[2021-03-24 07:26:09.772] [driver] [info] [Task Finished] Transform to mem in 0.213543s (5816 normal rows, 0 exceptions)
[2021-03-24 07:26:09.985] [driver] [info] [Task Finished] Transform to mem in 0.213399s (5649 normal rows, 0 exceptions)
[2021-03-24 07:26:10.203] [driver] [info] [Task Finished] Transform to mem in 0.217515s (5873 normal rows, 0 exceptions)
[2021-03-24 07:26:10.417] [driver] [info] [Task Finished] Transform to mem in 0.213850s (5686 normal rows, 0 exceptions)
[2021-03-24 07:26:10.630] [driver] [info] [Task Finished] Transform to mem in 0.213696s (5806 normal rows, 0 exceptions)
[2021-03-24 07:26:10.844] [driver] [info] [Task Finished] Transform to mem in 0.214087s (5765 normal rows, 0 exceptions)
[2021-03-24 07:26:11.059] [driver] [info] [Task Finished] Transform to mem in 0.214236s (5770 normal rows, 0 exceptions)
[2021-03-24 07:26:11.273] [driver] [info] [Task Finished] Transform to mem in 0.214249s (5643 normal rows, 0 exceptions)
[2021-03-24 07:26:11.488] [driver] [info] [Task Finished] Transform to mem in 0.214882s (5951 normal rows, 0 exceptions)
[2021-03-24 07:26:11.702] [driver] [info] [Task Finished] Transform to mem in 0.214253s (5759 normal rows, 0 exceptions)
[2021-03-24 07:26:11.917] [driver] [info] [Task Finished] Transform to mem in 0.214668s (5698 normal rows, 0 exceptions)
[2021-03-24 07:26:12.131] [driver] [info] [Task Finished] Transform to mem in 0.214689s (5955 normal rows, 0 exceptions)
[2021-03-24 07:26:12.346] [driver] [info] [Task Finished] Transform to mem in 0.214724s (5768 normal rows, 0 exceptions)
[2021-03-24 07:26:12.561] [driver] [info] [Task Finished] Transform to mem in 0.214751s (5772 normal rows, 0 exceptions)
[2021-03-24 07:26:12.776] [driver] [info] [Task Finished] Transform to mem in 0.215154s (5802 normal rows, 0 exceptions)
[2021-03-24 07:26:12.991] [driver] [info] [Task Finished] Transform to mem in 0.214900s (5799 normal rows, 0 exceptions)
[2021-03-24 07:26:13.206] [driver] [info] [Task Finished] Transform to mem in 0.214693s (5862 normal rows, 0 exceptions)
[2021-03-24 07:26:13.420] [driver] [info] [Task Finished] Transform to mem in 0.214659s (5856 normal rows, 0 exceptions)
[2021-03-24 07:26:13.635] [driver] [info] [Task Finished] Transform to mem in 0.214523s (5685 normal rows, 0 exceptions)
[2021-03-24 07:26:13.849] [driver] [info] [Task Finished] Transform to mem in 0.214248s (5751 normal rows, 0 exceptions)
[2021-03-24 07:26:14.064] [driver] [info] [Task Finished] Transform to mem in 0.214661s (5891 normal rows, 0 exceptions)
[2021-03-24 07:26:14.279] [driver] [info] [Task Finished] Transform to mem in 0.214553s (5852 normal rows, 0 exceptions)
[2021-03-24 07:26:14.493] [driver] [info] [Task Finished] Transform to mem in 0.214551s (5722 normal rows, 0 exceptions)
[2021-03-24 07:26:14.707] [driver] [info] [Task Finished] Transform to mem in 0.214301s (5645 normal rows, 0 exceptions)
[2021-03-24 07:26:14.922] [driver] [info] [Task Finished] Transform to mem in 0.214885s (5788 normal rows, 0 exceptions)
[2021-03-24 07:26:15.136] [driver] [info] [Task Finished] Transform to mem in 0.213747s (5813 normal rows, 0 exceptions)
[2021-03-24 07:26:15.350] [driver] [info] [Task Finished] Transform to mem in 0.214206s (5674 normal rows, 0 exceptions)
[2021-03-24 07:26:15.565] [driver] [info] [Task Finished] Transform to mem in 0.214696s (5853 normal rows, 0 exceptions)
[2021-03-24 07:26:15.779] [driver] [info] [Task Finished] Transform to mem in 0.214427s (5848 normal rows, 0 exceptions)
[2021-03-24 07:26:15.993] [driver] [info] [Task Finished] Transform to mem in 0.213999s (5811 normal rows, 0 exceptions)
[2021-03-24 07:26:16.208] [driver] [info] [Task Finished] Transform to mem in 0.214243s (5732 normal rows, 0 exceptions)
[2021-03-24 07:26:16.422] [driver] [info] [Task Finished] Transform to mem in 0.214065s (5801 normal rows, 0 exceptions)
[2021-03-24 07:26:16.636] [driver] [info] [Task Finished] Transform to mem in 0.214409s (5827 normal rows, 0 exceptions)
[2021-03-24 07:26:16.850] [driver] [info] [Task Finished] Transform to mem in 0.213893s (5868 normal rows, 0 exceptions)
[2021-03-24 07:26:17.064] [driver] [info] [Task Finished] Transform to mem in 0.214203s (5794 normal rows, 0 exceptions)
[2021-03-24 07:26:17.278] [driver] [info] [Task Finished] Transform to mem in 0.214122s (5817 normal rows, 0 exceptions)
[2021-03-24 07:26:17.493] [driver] [info] [Task Finished] Transform to mem in 0.214243s (5696 normal rows, 0 exceptions)
[2021-03-24 07:26:17.707] [driver] [info] [Task Finished] Transform to mem in 0.214342s (5732 normal rows, 0 exceptions)
[2021-03-24 07:26:17.921] [driver] [info] [Task Finished] Transform to mem in 0.213670s (5629 normal rows, 0 exceptions)
[2021-03-24 07:26:18.135] [driver] [info] [Task Finished] Transform to mem in 0.214654s (5789 normal rows, 0 exceptions)
[2021-03-24 07:26:18.350] [driver] [info] [Task Finished] Transform to mem in 0.214702s (5740 normal rows, 0 exceptions)
[2021-03-24 07:26:18.565] [driver] [info] [Task Finished] Transform to mem in 0.214697s (5841 normal rows, 0 exceptions)
[2021-03-24 07:26:18.782] [driver] [info] [Task Finished] Transform to mem in 0.216849s (5857 normal rows, 0 exceptions)
[2021-03-24 07:26:18.782] [global] [info] [Transform Stage] Stage 0 completed 149 load&transform tasks in 31.8924s
[2021-03-24 07:26:18.782] [global] [info] [Transform Stage] Stage 0 total wall clock time: 31.8897s, 48740298 input rows, time to process 1 row via fast path: 0.000654278ms

[2021-03-24 07:26:18.797] [global] [info] Writing 861387 rows as output to file (116.34 MB)
[2021-03-24 07:26:18.929] [driver] [info] [Task Finished] write to file in 0.132340s (861387 rows, 116.34 MB)
[2021-03-24 07:26:18.929] [global] [info] writing output took 0.147599s
[2021-03-24 07:26:18.930] [global] [info] [Transform Stage] Stage 0 completed 149 sink tasks in 0.147726s
[2021-03-24 07:26:18.930] [global] [info] [Transform Stage] Stage 0 took 32.2424s
[2021-03-24 07:26:18.930] [global] [info] Query Execution took 32.2881s. (planning: 0.0456056s, execution: 32.2425s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z1_preprocessed/zillow_Z1_10G.csv']
Tuplex startup time: 0.004955291748046875
Tuplex job time: 32.551560401916504 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.00897805,"llvm_optimization_time_s":0.134279,"llvm_compilation_time_s":0.0608981,"total_compilation_time_s":0.202227,"sampling_time_s":0.113133,"stages":[{"stage_no":0,"fast_path_wall_time_s":31.8897,"fast_path_time_s":31.8925,"fast_path_per_row_time_ns":654.278,"slow_path_wall_time_s":0,"slow_path_time_s":0,"slow_path_per_row_time_ns":0}]}
{"startupTime": 0.004955291748046875, "jobTime": 32.551560401916504}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
