[2021-03-24 07:26:19.300] [global] [error] could not find backend, defaulting to local
[2021-03-24 07:26:19.301] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-24 07:26:19.301] [local ee] [info] initializing LLVM backend
[2021-03-24 07:26:19.301] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-24 07:26:19.301] [LLVM] [info] compiling code for skylake-avx512
[2021-03-24 07:26:19.302] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-24 07:26:19.302] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-24 07:26:19.302] [fileinputoperator] [info] found 1 file (9.31 GB) to process.
[2021-03-24 07:26:19.302] [global] [info] sampled file:///data/zillow/Z1_preprocessed/zillow_Z1_10G.csv on 256.00 KB
[2021-03-24 07:26:19.446] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:26:19.462] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:26:19.469] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:26:19.492] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:26:19.512] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:26:19.525] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:26:19.556] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-24 07:26:19.570] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:26:19.573] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:26:19.575] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:26:19.578] [global] [info] performing static typing for UDF in operator map
[2021-03-24 07:26:19.582] [logical planner] [info] logical optimization took 0.009016ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-24 07:26:19.582] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (12 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,i64,i64,str,str,i64)
[2021-03-24 07:26:19.583] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-24 07:26:19.584] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-24 07:26:19.584] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-24 07:26:19.585] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-24 07:26:19.585] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-24 07:26:19.586] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-24 07:26:19.586] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> i64
[2021-03-24 07:26:19.587] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64)) -> i64
[2021-03-24 07:26:19.588] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64)) -> str
[2021-03-24 07:26:19.589] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,i64,i64,str)) -> i64
[2021-03-24 07:26:19.590] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> boolean
[2021-03-24 07:26:19.590] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,i64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,i64,i64,str,str,i64)
[2021-03-24 07:26:19.616] [global] [info] Stage0 depends on: 
[2021-03-24 07:26:19.757] [global] [info] Optimization via LLVM passes took 0.133776 ms
[2021-03-24 07:26:19.818] [global] [info] Compiled code paths for stage 0 in 0.06 ms
[2021-03-24 07:26:19.818] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.201575s
[2021-03-24 07:26:19.818] [local ee] [info] split /data/zillow/Z1_preprocessed/zillow_Z1_10G.csv into 149 tasks
[2021-03-24 07:26:20.034] [driver] [info] [Task Finished] Transform to mem in 0.216057s (5710 normal rows, 0 exceptions)
[2021-03-24 07:26:20.248] [driver] [info] [Task Finished] Transform to mem in 0.213695s (5758 normal rows, 0 exceptions)
[2021-03-24 07:26:20.462] [driver] [info] [Task Finished] Transform to mem in 0.214067s (5772 normal rows, 0 exceptions)
[2021-03-24 07:26:20.678] [driver] [info] [Task Finished] Transform to mem in 0.216063s (5744 normal rows, 0 exceptions)
[2021-03-24 07:26:20.892] [driver] [info] [Task Finished] Transform to mem in 0.214069s (5860 normal rows, 0 exceptions)
[2021-03-24 07:26:21.106] [driver] [info] [Task Finished] Transform to mem in 0.213978s (5864 normal rows, 0 exceptions)
[2021-03-24 07:26:21.320] [driver] [info] [Task Finished] Transform to mem in 0.214051s (5799 normal rows, 0 exceptions)
[2021-03-24 07:26:21.534] [driver] [info] [Task Finished] Transform to mem in 0.213398s (5663 normal rows, 0 exceptions)
[2021-03-24 07:26:21.747] [driver] [info] [Task Finished] Transform to mem in 0.213610s (5796 normal rows, 0 exceptions)
[2021-03-24 07:26:21.962] [driver] [info] [Task Finished] Transform to mem in 0.214423s (5770 normal rows, 0 exceptions)
[2021-03-24 07:26:22.176] [driver] [info] [Task Finished] Transform to mem in 0.213951s (5748 normal rows, 0 exceptions)
[2021-03-24 07:26:22.389] [driver] [info] [Task Finished] Transform to mem in 0.213506s (5779 normal rows, 0 exceptions)
[2021-03-24 07:26:22.603] [driver] [info] [Task Finished] Transform to mem in 0.213533s (5802 normal rows, 0 exceptions)
[2021-03-24 07:26:22.816] [driver] [info] [Task Finished] Transform to mem in 0.213549s (5706 normal rows, 0 exceptions)
[2021-03-24 07:26:23.030] [driver] [info] [Task Finished] Transform to mem in 0.213879s (5882 normal rows, 0 exceptions)
[2021-03-24 07:26:23.246] [driver] [info] [Task Finished] Transform to mem in 0.215923s (5883 normal rows, 0 exceptions)
[2021-03-24 07:26:23.462] [driver] [info] [Task Finished] Transform to mem in 0.215911s (6027 normal rows, 0 exceptions)
[2021-03-24 07:26:23.678] [driver] [info] [Task Finished] Transform to mem in 0.215845s (5766 normal rows, 0 exceptions)
[2021-03-24 07:26:23.892] [driver] [info] [Task Finished] Transform to mem in 0.214306s (5706 normal rows, 0 exceptions)
[2021-03-24 07:26:24.107] [driver] [info] [Task Finished] Transform to mem in 0.214584s (5709 normal rows, 0 exceptions)
[2021-03-24 07:26:24.321] [driver] [info] [Task Finished] Transform to mem in 0.214066s (5678 normal rows, 0 exceptions)
[2021-03-24 07:26:24.535] [driver] [info] [Task Finished] Transform to mem in 0.213818s (5821 normal rows, 0 exceptions)
[2021-03-24 07:26:24.748] [driver] [info] [Task Finished] Transform to mem in 0.213368s (5752 normal rows, 0 exceptions)
[2021-03-24 07:26:24.962] [driver] [info] [Task Finished] Transform to mem in 0.213411s (5761 normal rows, 0 exceptions)
[2021-03-24 07:26:25.175] [driver] [info] [Task Finished] Transform to mem in 0.213959s (5882 normal rows, 0 exceptions)
[2021-03-24 07:26:25.389] [driver] [info] [Task Finished] Transform to mem in 0.213202s (5651 normal rows, 0 exceptions)
[2021-03-24 07:26:25.602] [driver] [info] [Task Finished] Transform to mem in 0.213517s (5772 normal rows, 0 exceptions)
[2021-03-24 07:26:25.816] [driver] [info] [Task Finished] Transform to mem in 0.213266s (5665 normal rows, 0 exceptions)
[2021-03-24 07:26:26.029] [driver] [info] [Task Finished] Transform to mem in 0.213372s (5716 normal rows, 0 exceptions)
[2021-03-24 07:26:26.243] [driver] [info] [Task Finished] Transform to mem in 0.213619s (5723 normal rows, 0 exceptions)
[2021-03-24 07:26:26.456] [driver] [info] [Task Finished] Transform to mem in 0.213577s (5792 normal rows, 0 exceptions)
[2021-03-24 07:26:26.670] [driver] [info] [Task Finished] Transform to mem in 0.213500s (5781 normal rows, 0 exceptions)
[2021-03-24 07:26:26.883] [driver] [info] [Task Finished] Transform to mem in 0.213010s (5622 normal rows, 0 exceptions)
[2021-03-24 07:26:27.096] [driver] [info] [Task Finished] Transform to mem in 0.213395s (5781 normal rows, 0 exceptions)
[2021-03-24 07:26:27.311] [driver] [info] [Task Finished] Transform to mem in 0.214540s (5842 normal rows, 0 exceptions)
[2021-03-24 07:26:27.526] [driver] [info] [Task Finished] Transform to mem in 0.215199s (5926 normal rows, 0 exceptions)
[2021-03-24 07:26:27.740] [driver] [info] [Task Finished] Transform to mem in 0.214626s (5860 normal rows, 0 exceptions)
[2021-03-24 07:26:27.955] [driver] [info] [Task Finished] Transform to mem in 0.214980s (5749 normal rows, 0 exceptions)
[2021-03-24 07:26:28.170] [driver] [info] [Task Finished] Transform to mem in 0.214705s (5696 normal rows, 0 exceptions)
[2021-03-24 07:26:28.384] [driver] [info] [Task Finished] Transform to mem in 0.213586s (5821 normal rows, 0 exceptions)
[2021-03-24 07:26:28.598] [driver] [info] [Task Finished] Transform to mem in 0.213859s (5831 normal rows, 0 exceptions)
[2021-03-24 07:26:28.812] [driver] [info] [Task Finished] Transform to mem in 0.214719s (5915 normal rows, 0 exceptions)
[2021-03-24 07:26:29.027] [driver] [info] [Task Finished] Transform to mem in 0.214496s (5721 normal rows, 0 exceptions)
[2021-03-24 07:26:29.242] [driver] [info] [Task Finished] Transform to mem in 0.214563s (5839 normal rows, 0 exceptions)
[2021-03-24 07:26:29.455] [driver] [info] [Task Finished] Transform to mem in 0.213780s (5750 normal rows, 0 exceptions)
[2021-03-24 07:26:29.669] [driver] [info] [Task Finished] Transform to mem in 0.214149s (5878 normal rows, 0 exceptions)
[2021-03-24 07:26:29.884] [driver] [info] [Task Finished] Transform to mem in 0.214442s (5861 normal rows, 0 exceptions)
[2021-03-24 07:26:30.098] [driver] [info] [Task Finished] Transform to mem in 0.213870s (5810 normal rows, 0 exceptions)
[2021-03-24 07:26:30.311] [driver] [info] [Task Finished] Transform to mem in 0.213446s (5662 normal rows, 0 exceptions)
[2021-03-24 07:26:30.526] [driver] [info] [Task Finished] Transform to mem in 0.214345s (5777 normal rows, 0 exceptions)
[2021-03-24 07:26:30.741] [driver] [info] [Task Finished] Transform to mem in 0.215488s (5657 normal rows, 0 exceptions)
[2021-03-24 07:26:30.955] [driver] [info] [Task Finished] Transform to mem in 0.213387s (5731 normal rows, 0 exceptions)
[2021-03-24 07:26:31.169] [driver] [info] [Task Finished] Transform to mem in 0.213972s (5694 normal rows, 0 exceptions)
[2021-03-24 07:26:31.384] [driver] [info] [Task Finished] Transform to mem in 0.214988s (5813 normal rows, 0 exceptions)
[2021-03-24 07:26:31.597] [driver] [info] [Task Finished] Transform to mem in 0.213813s (5893 normal rows, 0 exceptions)
[2021-03-24 07:26:31.811] [driver] [info] [Task Finished] Transform to mem in 0.213232s (5850 normal rows, 0 exceptions)
[2021-03-24 07:26:32.024] [driver] [info] [Task Finished] Transform to mem in 0.213289s (5742 normal rows, 0 exceptions)
[2021-03-24 07:26:32.239] [driver] [info] [Task Finished] Transform to mem in 0.215067s (5795 normal rows, 0 exceptions)
[2021-03-24 07:26:32.455] [driver] [info] [Task Finished] Transform to mem in 0.215760s (5714 normal rows, 0 exceptions)
[2021-03-24 07:26:32.671] [driver] [info] [Task Finished] Transform to mem in 0.215708s (5709 normal rows, 0 exceptions)
[2021-03-24 07:26:32.885] [driver] [info] [Task Finished] Transform to mem in 0.214232s (5750 normal rows, 0 exceptions)
[2021-03-24 07:26:33.098] [driver] [info] [Task Finished] Transform to mem in 0.213335s (5750 normal rows, 0 exceptions)
[2021-03-24 07:26:33.311] [driver] [info] [Task Finished] Transform to mem in 0.213362s (5759 normal rows, 0 exceptions)
[2021-03-24 07:26:33.525] [driver] [info] [Task Finished] Transform to mem in 0.213638s (5734 normal rows, 0 exceptions)
[2021-03-24 07:26:33.739] [driver] [info] [Task Finished] Transform to mem in 0.213771s (5881 normal rows, 0 exceptions)
[2021-03-24 07:26:33.953] [driver] [info] [Task Finished] Transform to mem in 0.213790s (5807 normal rows, 0 exceptions)
[2021-03-24 07:26:34.167] [driver] [info] [Task Finished] Transform to mem in 0.214043s (5797 normal rows, 0 exceptions)
[2021-03-24 07:26:34.380] [driver] [info] [Task Finished] Transform to mem in 0.213638s (5786 normal rows, 0 exceptions)
[2021-03-24 07:26:34.595] [driver] [info] [Task Finished] Transform to mem in 0.214970s (5826 normal rows, 0 exceptions)
[2021-03-24 07:26:34.810] [driver] [info] [Task Finished] Transform to mem in 0.214332s (5722 normal rows, 0 exceptions)
[2021-03-24 07:26:35.024] [driver] [info] [Task Finished] Transform to mem in 0.214527s (5746 normal rows, 0 exceptions)
[2021-03-24 07:26:35.238] [driver] [info] [Task Finished] Transform to mem in 0.213873s (5775 normal rows, 0 exceptions)
[2021-03-24 07:26:35.452] [driver] [info] [Task Finished] Transform to mem in 0.213570s (5766 normal rows, 0 exceptions)
[2021-03-24 07:26:35.667] [driver] [info] [Task Finished] Transform to mem in 0.215346s (5877 normal rows, 0 exceptions)
[2021-03-24 07:26:35.882] [driver] [info] [Task Finished] Transform to mem in 0.214772s (5677 normal rows, 0 exceptions)
[2021-03-24 07:26:36.097] [driver] [info] [Task Finished] Transform to mem in 0.214873s (5846 normal rows, 0 exceptions)
[2021-03-24 07:26:36.311] [driver] [info] [Task Finished] Transform to mem in 0.213955s (5851 normal rows, 0 exceptions)
[2021-03-24 07:26:36.525] [driver] [info] [Task Finished] Transform to mem in 0.213710s (5820 normal rows, 0 exceptions)
[2021-03-24 07:26:36.738] [driver] [info] [Task Finished] Transform to mem in 0.213453s (5726 normal rows, 0 exceptions)
[2021-03-24 07:26:36.952] [driver] [info] [Task Finished] Transform to mem in 0.213514s (5684 normal rows, 0 exceptions)
[2021-03-24 07:26:37.165] [driver] [info] [Task Finished] Transform to mem in 0.213585s (5744 normal rows, 0 exceptions)
[2021-03-24 07:26:37.379] [driver] [info] [Task Finished] Transform to mem in 0.213637s (5606 normal rows, 0 exceptions)
[2021-03-24 07:26:37.592] [driver] [info] [Task Finished] Transform to mem in 0.213529s (5707 normal rows, 0 exceptions)
[2021-03-24 07:26:37.806] [driver] [info] [Task Finished] Transform to mem in 0.213565s (5831 normal rows, 0 exceptions)
[2021-03-24 07:26:38.020] [driver] [info] [Task Finished] Transform to mem in 0.213662s (5742 normal rows, 0 exceptions)
[2021-03-24 07:26:38.234] [driver] [info] [Task Finished] Transform to mem in 0.214146s (5546 normal rows, 0 exceptions)
[2021-03-24 07:26:38.447] [driver] [info] [Task Finished] Transform to mem in 0.213285s (5744 normal rows, 0 exceptions)
[2021-03-24 07:26:38.662] [driver] [info] [Task Finished] Transform to mem in 0.215378s (5879 normal rows, 0 exceptions)
[2021-03-24 07:26:38.877] [driver] [info] [Task Finished] Transform to mem in 0.214555s (5865 normal rows, 0 exceptions)
[2021-03-24 07:26:39.091] [driver] [info] [Task Finished] Transform to mem in 0.213555s (5776 normal rows, 0 exceptions)
[2021-03-24 07:26:39.304] [driver] [info] [Task Finished] Transform to mem in 0.213465s (5632 normal rows, 0 exceptions)
[2021-03-24 07:26:39.518] [driver] [info] [Task Finished] Transform to mem in 0.213540s (5766 normal rows, 0 exceptions)
[2021-03-24 07:26:39.731] [driver] [info] [Task Finished] Transform to mem in 0.213517s (5851 normal rows, 0 exceptions)
[2021-03-24 07:26:39.945] [driver] [info] [Task Finished] Transform to mem in 0.213742s (5842 normal rows, 0 exceptions)
[2021-03-24 07:26:40.158] [driver] [info] [Task Finished] Transform to mem in 0.213398s (5844 normal rows, 0 exceptions)
[2021-03-24 07:26:40.372] [driver] [info] [Task Finished] Transform to mem in 0.213740s (5911 normal rows, 0 exceptions)
[2021-03-24 07:26:40.586] [driver] [info] [Task Finished] Transform to mem in 0.214140s (5907 normal rows, 0 exceptions)
[2021-03-24 07:26:40.800] [driver] [info] [Task Finished] Transform to mem in 0.213784s (5866 normal rows, 0 exceptions)
[2021-03-24 07:26:41.014] [driver] [info] [Task Finished] Transform to mem in 0.213787s (5743 normal rows, 0 exceptions)
[2021-03-24 07:26:41.228] [driver] [info] [Task Finished] Transform to mem in 0.213831s (5720 normal rows, 0 exceptions)
[2021-03-24 07:26:41.441] [driver] [info] [Task Finished] Transform to mem in 0.213550s (5685 normal rows, 0 exceptions)
[2021-03-24 07:26:41.655] [driver] [info] [Task Finished] Transform to mem in 0.214171s (5883 normal rows, 0 exceptions)
[2021-03-24 07:26:41.869] [driver] [info] [Task Finished] Transform to mem in 0.213671s (5706 normal rows, 0 exceptions)
[2021-03-24 07:26:42.083] [driver] [info] [Task Finished] Transform to mem in 0.213664s (5929 normal rows, 0 exceptions)
[2021-03-24 07:26:42.296] [driver] [info] [Task Finished] Transform to mem in 0.213673s (5872 normal rows, 0 exceptions)
[2021-03-24 07:26:42.510] [driver] [info] [Task Finished] Transform to mem in 0.213758s (5847 normal rows, 0 exceptions)
[2021-03-24 07:26:42.724] [driver] [info] [Task Finished] Transform to mem in 0.213949s (5816 normal rows, 0 exceptions)
[2021-03-24 07:26:42.937] [driver] [info] [Task Finished] Transform to mem in 0.213174s (5649 normal rows, 0 exceptions)
[2021-03-24 07:26:43.151] [driver] [info] [Task Finished] Transform to mem in 0.213618s (5873 normal rows, 0 exceptions)
[2021-03-24 07:26:43.364] [driver] [info] [Task Finished] Transform to mem in 0.213404s (5686 normal rows, 0 exceptions)
[2021-03-24 07:26:43.578] [driver] [info] [Task Finished] Transform to mem in 0.213854s (5806 normal rows, 0 exceptions)
[2021-03-24 07:26:43.792] [driver] [info] [Task Finished] Transform to mem in 0.213840s (5765 normal rows, 0 exceptions)
[2021-03-24 07:26:44.008] [driver] [info] [Task Finished] Transform to mem in 0.215445s (5770 normal rows, 0 exceptions)
[2021-03-24 07:26:44.224] [driver] [info] [Task Finished] Transform to mem in 0.216334s (5643 normal rows, 0 exceptions)
[2021-03-24 07:26:44.440] [driver] [info] [Task Finished] Transform to mem in 0.215488s (5951 normal rows, 0 exceptions)
[2021-03-24 07:26:44.654] [driver] [info] [Task Finished] Transform to mem in 0.214394s (5759 normal rows, 0 exceptions)
[2021-03-24 07:26:44.868] [driver] [info] [Task Finished] Transform to mem in 0.214464s (5698 normal rows, 0 exceptions)
[2021-03-24 07:26:45.083] [driver] [info] [Task Finished] Transform to mem in 0.214400s (5955 normal rows, 0 exceptions)
[2021-03-24 07:26:45.297] [driver] [info] [Task Finished] Transform to mem in 0.214424s (5768 normal rows, 0 exceptions)
[2021-03-24 07:26:45.512] [driver] [info] [Task Finished] Transform to mem in 0.214711s (5772 normal rows, 0 exceptions)
[2021-03-24 07:26:45.727] [driver] [info] [Task Finished] Transform to mem in 0.215315s (5802 normal rows, 0 exceptions)
[2021-03-24 07:26:45.942] [driver] [info] [Task Finished] Transform to mem in 0.214884s (5799 normal rows, 0 exceptions)
[2021-03-24 07:26:46.157] [driver] [info] [Task Finished] Transform to mem in 0.214984s (5862 normal rows, 0 exceptions)
[2021-03-24 07:26:46.372] [driver] [info] [Task Finished] Transform to mem in 0.214756s (5856 normal rows, 0 exceptions)
[2021-03-24 07:26:46.587] [driver] [info] [Task Finished] Transform to mem in 0.214637s (5685 normal rows, 0 exceptions)
[2021-03-24 07:26:46.802] [driver] [info] [Task Finished] Transform to mem in 0.215676s (5751 normal rows, 0 exceptions)
[2021-03-24 07:26:47.018] [driver] [info] [Task Finished] Transform to mem in 0.215727s (5891 normal rows, 0 exceptions)
[2021-03-24 07:26:47.233] [driver] [info] [Task Finished] Transform to mem in 0.214485s (5852 normal rows, 0 exceptions)
[2021-03-24 07:26:47.449] [driver] [info] [Task Finished] Transform to mem in 0.216822s (5722 normal rows, 0 exceptions)
[2021-03-24 07:26:47.664] [driver] [info] [Task Finished] Transform to mem in 0.214798s (5645 normal rows, 0 exceptions)
[2021-03-24 07:26:47.880] [driver] [info] [Task Finished] Transform to mem in 0.215663s (5788 normal rows, 0 exceptions)
[2021-03-24 07:26:48.093] [driver] [info] [Task Finished] Transform to mem in 0.213494s (5813 normal rows, 0 exceptions)
[2021-03-24 07:26:48.308] [driver] [info] [Task Finished] Transform to mem in 0.214616s (5674 normal rows, 0 exceptions)
[2021-03-24 07:26:48.524] [driver] [info] [Task Finished] Transform to mem in 0.215652s (5853 normal rows, 0 exceptions)
[2021-03-24 07:26:48.739] [driver] [info] [Task Finished] Transform to mem in 0.214884s (5848 normal rows, 0 exceptions)
[2021-03-24 07:26:48.953] [driver] [info] [Task Finished] Transform to mem in 0.214018s (5811 normal rows, 0 exceptions)
[2021-03-24 07:26:49.167] [driver] [info] [Task Finished] Transform to mem in 0.214190s (5732 normal rows, 0 exceptions)
[2021-03-24 07:26:49.381] [driver] [info] [Task Finished] Transform to mem in 0.214288s (5801 normal rows, 0 exceptions)
[2021-03-24 07:26:49.596] [driver] [info] [Task Finished] Transform to mem in 0.214391s (5827 normal rows, 0 exceptions)
[2021-03-24 07:26:49.809] [driver] [info] [Task Finished] Transform to mem in 0.213768s (5868 normal rows, 0 exceptions)
[2021-03-24 07:26:50.024] [driver] [info] [Task Finished] Transform to mem in 0.214462s (5794 normal rows, 0 exceptions)
[2021-03-24 07:26:50.240] [driver] [info] [Task Finished] Transform to mem in 0.216036s (5817 normal rows, 0 exceptions)
[2021-03-24 07:26:50.454] [driver] [info] [Task Finished] Transform to mem in 0.214361s (5696 normal rows, 0 exceptions)
[2021-03-24 07:26:50.670] [driver] [info] [Task Finished] Transform to mem in 0.215257s (5732 normal rows, 0 exceptions)
[2021-03-24 07:26:50.885] [driver] [info] [Task Finished] Transform to mem in 0.215067s (5629 normal rows, 0 exceptions)
[2021-03-24 07:26:51.099] [driver] [info] [Task Finished] Transform to mem in 0.214106s (5789 normal rows, 0 exceptions)
[2021-03-24 07:26:51.313] [driver] [info] [Task Finished] Transform to mem in 0.214410s (5740 normal rows, 0 exceptions)
[2021-03-24 07:26:51.527] [driver] [info] [Task Finished] Transform to mem in 0.214244s (5841 normal rows, 0 exceptions)
[2021-03-24 07:26:51.744] [driver] [info] [Task Finished] Transform to mem in 0.216841s (5857 normal rows, 0 exceptions)
[2021-03-24 07:26:51.744] [global] [info] [Transform Stage] Stage 0 completed 149 load&transform tasks in 31.9265s
[2021-03-24 07:26:51.744] [global] [info] [Transform Stage] Stage 0 total wall clock time: 31.9238s, 48740298 input rows, time to process 1 row via fast path: 0.000654978ms

[2021-03-24 07:26:51.759] [global] [info] Writing 861387 rows as output to file (116.34 MB)
[2021-03-24 07:26:51.890] [driver] [info] [Task Finished] write to file in 0.130609s (861387 rows, 116.34 MB)
[2021-03-24 07:26:51.890] [global] [info] writing output took 0.145404s
[2021-03-24 07:26:51.890] [global] [info] [Transform Stage] Stage 0 completed 149 sink tasks in 0.145543s
[2021-03-24 07:26:51.890] [global] [info] [Transform Stage] Stage 0 took 32.2737s
[2021-03-24 07:26:51.890] [global] [info] Query Execution took 32.3192s. (planning: 0.0454332s, execution: 32.2737s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z1_preprocessed/zillow_Z1_10G.csv']
Tuplex startup time: 0.004904031753540039
Tuplex job time: 32.589476108551025 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0090159,"llvm_optimization_time_s":0.133776,"llvm_compilation_time_s":0.060693,"total_compilation_time_s":0.201573,"sampling_time_s":0.120416,"stages":[{"stage_no":0,"fast_path_wall_time_s":31.9238,"fast_path_time_s":31.9265,"fast_path_per_row_time_ns":654.978,"slow_path_wall_time_s":0,"slow_path_time_s":0,"slow_path_per_row_time_ns":0}]}
{"startupTime": 0.004904031753540039, "jobTime": 32.589476108551025}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
