[2021-03-31 18:18:59.995] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:18:59.996] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:18:59.996] [local ee] [info] initializing LLVM backend
[2021-03-31 18:18:59.996] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:18:59.996] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:18:59.997] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-31 18:18:59.997] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:18:59.997] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 18:18:59.997] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2021-03-31 18:19:00.129] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.144] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.152] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.178] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.198] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.211] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.242] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.258] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:19:00.260] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:19:00.263] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:19:00.265] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:19:00.280] [logical planner] [info] logical optimization took 0.019661ms
[2021-03-31 18:19:00.281] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.285] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.288] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.292] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.295] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.297] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.299] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:19:00.306] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:19:00.307] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,f64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:19:00.307] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2021-03-31 18:19:00.308] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2021-03-31 18:19:00.308] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2021-03-31 18:19:00.309] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2021-03-31 18:19:00.309] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2021-03-31 18:19:00.310] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2021-03-31 18:19:00.311] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:19:00.311] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2021-03-31 18:19:00.312] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2021-03-31 18:19:00.313] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2021-03-31 18:19:00.314] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:19:00.315] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:19:00.315] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:19:00.316] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2021-03-31 18:19:00.317] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:19:00.318] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:19:00.318] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:19:00.319] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:19:00.320] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:19:00.320] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:19:00.321] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 18:19:00.322] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 18:19:00.323] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 18:19:00.323] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:19:00.325] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:19:00.325] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:19:00.326] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 18:19:00.355] [global] [info] Stage0 depends on: 
[2021-03-31 18:19:00.662] [global] [info] Optimization via LLVM passes took 0.292161 ms
[2021-03-31 18:19:00.796] [global] [info] Compiled code paths for stage 0 in 0.13 ms
[2021-03-31 18:19:00.796] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.441058s
[2021-03-31 18:19:00.796] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2021-03-31 18:19:01.049] [driver] [info] [Task Finished] Transform to mem in 0.252473s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:19:01.302] [driver] [info] [Task Finished] Transform to mem in 0.253413s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:19:01.555] [driver] [info] [Task Finished] Transform to mem in 0.252598s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:19:01.805] [driver] [info] [Task Finished] Transform to mem in 0.250466s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:19:02.057] [driver] [info] [Task Finished] Transform to mem in 0.251081s (14217 normal rows, 10015 exceptions)
[2021-03-31 18:19:02.307] [driver] [info] [Task Finished] Transform to mem in 0.250546s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:19:02.559] [driver] [info] [Task Finished] Transform to mem in 0.251807s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:19:02.810] [driver] [info] [Task Finished] Transform to mem in 0.251267s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:19:03.061] [driver] [info] [Task Finished] Transform to mem in 0.250843s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:19:03.313] [driver] [info] [Task Finished] Transform to mem in 0.251589s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:19:03.565] [driver] [info] [Task Finished] Transform to mem in 0.252446s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:19:03.819] [driver] [info] [Task Finished] Transform to mem in 0.254033s (13988 normal rows, 9938 exceptions)
[2021-03-31 18:19:04.071] [driver] [info] [Task Finished] Transform to mem in 0.251582s (14177 normal rows, 10036 exceptions)
[2021-03-31 18:19:04.322] [driver] [info] [Task Finished] Transform to mem in 0.251286s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:19:04.573] [driver] [info] [Task Finished] Transform to mem in 0.250641s (14020 normal rows, 9982 exceptions)
[2021-03-31 18:19:04.827] [driver] [info] [Task Finished] Transform to mem in 0.253854s (14162 normal rows, 9952 exceptions)
[2021-03-31 18:19:05.078] [driver] [info] [Task Finished] Transform to mem in 0.251816s (14241 normal rows, 10100 exceptions)
[2021-03-31 18:19:05.333] [driver] [info] [Task Finished] Transform to mem in 0.254102s (14059 normal rows, 9985 exceptions)
[2021-03-31 18:19:05.584] [driver] [info] [Task Finished] Transform to mem in 0.251028s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:19:05.835] [driver] [info] [Task Finished] Transform to mem in 0.251118s (14238 normal rows, 10030 exceptions)
[2021-03-31 18:19:06.085] [driver] [info] [Task Finished] Transform to mem in 0.250666s (14081 normal rows, 9995 exceptions)
[2021-03-31 18:19:06.336] [driver] [info] [Task Finished] Transform to mem in 0.251017s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:19:06.588] [driver] [info] [Task Finished] Transform to mem in 0.251385s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:19:06.839] [driver] [info] [Task Finished] Transform to mem in 0.250876s (14086 normal rows, 9989 exceptions)
[2021-03-31 18:19:07.090] [driver] [info] [Task Finished] Transform to mem in 0.251065s (14097 normal rows, 10002 exceptions)
[2021-03-31 18:19:07.340] [driver] [info] [Task Finished] Transform to mem in 0.249971s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:19:07.591] [driver] [info] [Task Finished] Transform to mem in 0.250756s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:19:07.841] [driver] [info] [Task Finished] Transform to mem in 0.249963s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:19:08.090] [driver] [info] [Task Finished] Transform to mem in 0.249926s (14212 normal rows, 10032 exceptions)
[2021-03-31 18:19:08.340] [driver] [info] [Task Finished] Transform to mem in 0.249185s (14099 normal rows, 10008 exceptions)
[2021-03-31 18:19:08.593] [driver] [info] [Task Finished] Transform to mem in 0.252932s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:19:08.846] [driver] [info] [Task Finished] Transform to mem in 0.253030s (14223 normal rows, 10035 exceptions)
[2021-03-31 18:19:09.095] [driver] [info] [Task Finished] Transform to mem in 0.249619s (14089 normal rows, 10008 exceptions)
[2021-03-31 18:19:09.345] [driver] [info] [Task Finished] Transform to mem in 0.249532s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:19:09.597] [driver] [info] [Task Finished] Transform to mem in 0.252531s (14235 normal rows, 10062 exceptions)
[2021-03-31 18:19:09.851] [driver] [info] [Task Finished] Transform to mem in 0.253218s (14170 normal rows, 9994 exceptions)
[2021-03-31 18:19:10.102] [driver] [info] [Task Finished] Transform to mem in 0.251358s (14002 normal rows, 9940 exceptions)
[2021-03-31 18:19:10.353] [driver] [info] [Task Finished] Transform to mem in 0.250478s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:19:10.602] [driver] [info] [Task Finished] Transform to mem in 0.249654s (14206 normal rows, 9991 exceptions)
[2021-03-31 18:19:10.852] [driver] [info] [Task Finished] Transform to mem in 0.249572s (13961 normal rows, 9925 exceptions)
[2021-03-31 18:19:11.102] [driver] [info] [Task Finished] Transform to mem in 0.250119s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:19:11.352] [driver] [info] [Task Finished] Transform to mem in 0.249896s (14233 normal rows, 10011 exceptions)
[2021-03-31 18:19:11.601] [driver] [info] [Task Finished] Transform to mem in 0.249187s (13915 normal rows, 9900 exceptions)
[2021-03-31 18:19:11.853] [driver] [info] [Task Finished] Transform to mem in 0.251496s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:19:12.104] [driver] [info] [Task Finished] Transform to mem in 0.251105s (14267 normal rows, 10030 exceptions)
[2021-03-31 18:19:12.357] [driver] [info] [Task Finished] Transform to mem in 0.253554s (13892 normal rows, 9882 exceptions)
[2021-03-31 18:19:12.612] [driver] [info] [Task Finished] Transform to mem in 0.254773s (14245 normal rows, 10101 exceptions)
[2021-03-31 18:19:12.863] [driver] [info] [Task Finished] Transform to mem in 0.251120s (14260 normal rows, 10025 exceptions)
[2021-03-31 18:19:13.114] [driver] [info] [Task Finished] Transform to mem in 0.250412s (13978 normal rows, 9907 exceptions)
[2021-03-31 18:19:13.369] [driver] [info] [Task Finished] Transform to mem in 0.254988s (14181 normal rows, 10067 exceptions)
[2021-03-31 18:19:13.620] [driver] [info] [Task Finished] Transform to mem in 0.251045s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:19:13.871] [driver] [info] [Task Finished] Transform to mem in 0.251088s (14015 normal rows, 9982 exceptions)
[2021-03-31 18:19:14.122] [driver] [info] [Task Finished] Transform to mem in 0.251104s (14142 normal rows, 9989 exceptions)
[2021-03-31 18:19:14.373] [driver] [info] [Task Finished] Transform to mem in 0.251182s (14280 normal rows, 10094 exceptions)
[2021-03-31 18:19:14.624] [driver] [info] [Task Finished] Transform to mem in 0.250732s (13982 normal rows, 9975 exceptions)
[2021-03-31 18:19:14.875] [driver] [info] [Task Finished] Transform to mem in 0.251281s (14173 normal rows, 10006 exceptions)
[2021-03-31 18:19:15.126] [driver] [info] [Task Finished] Transform to mem in 0.251066s (14235 normal rows, 10040 exceptions)
[2021-03-31 18:19:15.377] [driver] [info] [Task Finished] Transform to mem in 0.251182s (14054 normal rows, 9984 exceptions)
[2021-03-31 18:19:15.628] [driver] [info] [Task Finished] Transform to mem in 0.250918s (14129 normal rows, 10004 exceptions)
[2021-03-31 18:19:15.883] [driver] [info] [Task Finished] Transform to mem in 0.254271s (14223 normal rows, 10033 exceptions)
[2021-03-31 18:19:16.132] [driver] [info] [Task Finished] Transform to mem in 0.249444s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:19:16.386] [driver] [info] [Task Finished] Transform to mem in 0.253519s (14108 normal rows, 10010 exceptions)
[2021-03-31 18:19:16.635] [driver] [info] [Task Finished] Transform to mem in 0.249779s (14208 normal rows, 10008 exceptions)
[2021-03-31 18:19:16.885] [driver] [info] [Task Finished] Transform to mem in 0.249713s (14089 normal rows, 10031 exceptions)
[2021-03-31 18:19:17.138] [driver] [info] [Task Finished] Transform to mem in 0.252902s (14094 normal rows, 9960 exceptions)
[2021-03-31 18:19:17.388] [driver] [info] [Task Finished] Transform to mem in 0.249849s (14232 normal rows, 10017 exceptions)
[2021-03-31 18:19:17.639] [driver] [info] [Task Finished] Transform to mem in 0.251155s (14088 normal rows, 10027 exceptions)
[2021-03-31 18:19:17.890] [driver] [info] [Task Finished] Transform to mem in 0.251114s (14106 normal rows, 9955 exceptions)
[2021-03-31 18:19:18.142] [driver] [info] [Task Finished] Transform to mem in 0.251766s (14211 normal rows, 10043 exceptions)
[2021-03-31 18:19:18.391] [driver] [info] [Task Finished] Transform to mem in 0.249313s (14113 normal rows, 9997 exceptions)
[2021-03-31 18:19:18.641] [driver] [info] [Task Finished] Transform to mem in 0.249951s (14075 normal rows, 9965 exceptions)
[2021-03-31 18:19:18.892] [driver] [info] [Task Finished] Transform to mem in 0.250838s (14223 normal rows, 10049 exceptions)
[2021-03-31 18:19:19.142] [driver] [info] [Task Finished] Transform to mem in 0.250042s (14095 normal rows, 9995 exceptions)
[2021-03-31 18:19:19.392] [driver] [info] [Task Finished] Transform to mem in 0.249586s (14086 normal rows, 9952 exceptions)
[2021-03-31 18:19:19.645] [driver] [info] [Task Finished] Transform to mem in 0.253058s (14226 normal rows, 10069 exceptions)
[2021-03-31 18:19:19.898] [driver] [info] [Task Finished] Transform to mem in 0.252871s (14170 normal rows, 9996 exceptions)
[2021-03-31 18:19:20.147] [driver] [info] [Task Finished] Transform to mem in 0.249202s (14002 normal rows, 9931 exceptions)
[2021-03-31 18:19:20.397] [driver] [info] [Task Finished] Transform to mem in 0.249985s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:19:20.650] [driver] [info] [Task Finished] Transform to mem in 0.252954s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:19:20.899] [driver] [info] [Task Finished] Transform to mem in 0.249064s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:19:21.150] [driver] [info] [Task Finished] Transform to mem in 0.251440s (14237 normal rows, 10084 exceptions)
[2021-03-31 18:19:21.402] [driver] [info] [Task Finished] Transform to mem in 0.251141s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:19:21.652] [driver] [info] [Task Finished] Transform to mem in 0.250307s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:19:21.903] [driver] [info] [Task Finished] Transform to mem in 0.250995s (14267 normal rows, 10099 exceptions)
[2021-03-31 18:19:22.155] [driver] [info] [Task Finished] Transform to mem in 0.251700s (14248 normal rows, 10030 exceptions)
[2021-03-31 18:19:22.405] [driver] [info] [Task Finished] Transform to mem in 0.250453s (13912 normal rows, 9882 exceptions)
[2021-03-31 18:19:22.657] [driver] [info] [Task Finished] Transform to mem in 0.251459s (14248 normal rows, 10094 exceptions)
[2021-03-31 18:19:22.907] [driver] [info] [Task Finished] Transform to mem in 0.250811s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:19:23.158] [driver] [info] [Task Finished] Transform to mem in 0.250525s (13988 normal rows, 9922 exceptions)
[2021-03-31 18:19:23.412] [driver] [info] [Task Finished] Transform to mem in 0.254482s (14171 normal rows, 10052 exceptions)
[2021-03-31 18:19:23.667] [driver] [info] [Task Finished] Transform to mem in 0.254353s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:19:23.917] [driver] [info] [Task Finished] Transform to mem in 0.250595s (14015 normal rows, 9985 exceptions)
[2021-03-31 18:19:24.169] [driver] [info] [Task Finished] Transform to mem in 0.251196s (14176 normal rows, 9997 exceptions)
[2021-03-31 18:19:24.420] [driver] [info] [Task Finished] Transform to mem in 0.251176s (14246 normal rows, 10108 exceptions)
[2021-03-31 18:19:24.671] [driver] [info] [Task Finished] Transform to mem in 0.251024s (14059 normal rows, 9978 exceptions)
[2021-03-31 18:19:24.922] [driver] [info] [Task Finished] Transform to mem in 0.251039s (14114 normal rows, 10011 exceptions)
[2021-03-31 18:19:25.173] [driver] [info] [Task Finished] Transform to mem in 0.251026s (14238 normal rows, 10007 exceptions)
[2021-03-31 18:19:25.424] [driver] [info] [Task Finished] Transform to mem in 0.250802s (14081 normal rows, 10003 exceptions)
[2021-03-31 18:19:25.675] [driver] [info] [Task Finished] Transform to mem in 0.251083s (14095 normal rows, 10024 exceptions)
[2021-03-31 18:19:25.926] [driver] [info] [Task Finished] Transform to mem in 0.251373s (14221 normal rows, 9998 exceptions)
[2021-03-31 18:19:26.177] [driver] [info] [Task Finished] Transform to mem in 0.251074s (14086 normal rows, 9998 exceptions)
[2021-03-31 18:19:26.428] [driver] [info] [Task Finished] Transform to mem in 0.250945s (14091 normal rows, 10001 exceptions)
[2021-03-31 18:19:26.679] [driver] [info] [Task Finished] Transform to mem in 0.250952s (14218 normal rows, 10016 exceptions)
[2021-03-31 18:19:26.933] [driver] [info] [Task Finished] Transform to mem in 0.254141s (14095 normal rows, 10026 exceptions)
[2021-03-31 18:19:27.184] [driver] [info] [Task Finished] Transform to mem in 0.250879s (14113 normal rows, 9960 exceptions)
[2021-03-31 18:19:27.439] [driver] [info] [Task Finished] Transform to mem in 0.254313s (14197 normal rows, 10028 exceptions)
[2021-03-31 18:19:27.689] [driver] [info] [Task Finished] Transform to mem in 0.250693s (14114 normal rows, 10012 exceptions)
[2021-03-31 18:19:27.940] [driver] [info] [Task Finished] Transform to mem in 0.251103s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:19:28.195] [driver] [info] [Task Finished] Transform to mem in 0.254604s (14197 normal rows, 10033 exceptions)
[2021-03-31 18:19:28.446] [driver] [info] [Task Finished] Transform to mem in 0.250729s (14115 normal rows, 10010 exceptions)
[2021-03-31 18:19:28.697] [driver] [info] [Task Finished] Transform to mem in 0.250938s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:19:28.948] [driver] [info] [Task Finished] Transform to mem in 0.251150s (14235 normal rows, 10048 exceptions)
[2021-03-31 18:19:29.199] [driver] [info] [Task Finished] Transform to mem in 0.250947s (14144 normal rows, 9995 exceptions)
[2021-03-31 18:19:29.450] [driver] [info] [Task Finished] Transform to mem in 0.250619s (14015 normal rows, 9952 exceptions)
[2021-03-31 18:19:29.702] [driver] [info] [Task Finished] Transform to mem in 0.252067s (14237 normal rows, 10069 exceptions)
[2021-03-31 18:19:29.953] [driver] [info] [Task Finished] Transform to mem in 0.250992s (14159 normal rows, 9996 exceptions)
[2021-03-31 18:19:30.203] [driver] [info] [Task Finished] Transform to mem in 0.250640s (14010 normal rows, 9932 exceptions)
[2021-03-31 18:19:30.454] [driver] [info] [Task Finished] Transform to mem in 0.251183s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:19:30.708] [driver] [info] [Task Finished] Transform to mem in 0.253880s (14178 normal rows, 10009 exceptions)
[2021-03-31 18:19:30.962] [driver] [info] [Task Finished] Transform to mem in 0.253865s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:19:31.214] [driver] [info] [Task Finished] Transform to mem in 0.251612s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:19:31.465] [driver] [info] [Task Finished] Transform to mem in 0.250956s (14236 normal rows, 10015 exceptions)
[2021-03-31 18:19:31.715] [driver] [info] [Task Finished] Transform to mem in 0.250447s (13901 normal rows, 9892 exceptions)
[2021-03-31 18:19:31.967] [driver] [info] [Task Finished] Transform to mem in 0.251514s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:19:32.218] [driver] [info] [Task Finished] Transform to mem in 0.251139s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:19:32.468] [driver] [info] [Task Finished] Transform to mem in 0.250354s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:19:32.720] [driver] [info] [Task Finished] Transform to mem in 0.251589s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:19:32.971] [driver] [info] [Task Finished] Transform to mem in 0.251210s (14245 normal rows, 10024 exceptions)
[2021-03-31 18:19:33.222] [driver] [info] [Task Finished] Transform to mem in 0.250960s (13999 normal rows, 9935 exceptions)
[2021-03-31 18:19:33.474] [driver] [info] [Task Finished] Transform to mem in 0.251560s (14158 normal rows, 10036 exceptions)
[2021-03-31 18:19:33.725] [driver] [info] [Task Finished] Transform to mem in 0.251010s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:19:33.976] [driver] [info] [Task Finished] Transform to mem in 0.250906s (14020 normal rows, 9989 exceptions)
[2021-03-31 18:19:34.227] [driver] [info] [Task Finished] Transform to mem in 0.251034s (14173 normal rows, 10004 exceptions)
[2021-03-31 18:19:34.481] [driver] [info] [Task Finished] Transform to mem in 0.254217s (14235 normal rows, 10041 exceptions)
[2021-03-31 18:19:34.735] [driver] [info] [Task Finished] Transform to mem in 0.253987s (14054 normal rows, 9985 exceptions)
[2021-03-31 18:19:34.986] [driver] [info] [Task Finished] Transform to mem in 0.251007s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:19:35.237] [driver] [info] [Task Finished] Transform to mem in 0.251160s (14238 normal rows, 10033 exceptions)
[2021-03-31 18:19:35.488] [driver] [info] [Task Finished] Transform to mem in 0.251270s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:19:35.740] [driver] [info] [Task Finished] Transform to mem in 0.251049s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:19:35.991] [driver] [info] [Task Finished] Transform to mem in 0.251315s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:19:36.242] [driver] [info] [Task Finished] Transform to mem in 0.250858s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:19:36.493] [driver] [info] [Task Finished] Transform to mem in 0.251096s (14094 normal rows, 9996 exceptions)
[2021-03-31 18:19:36.744] [driver] [info] [Task Finished] Transform to mem in 0.250909s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:19:36.995] [driver] [info] [Task Finished] Transform to mem in 0.251000s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:19:37.246] [driver] [info] [Task Finished] Transform to mem in 0.250925s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:19:37.497] [driver] [info] [Task Finished] Transform to mem in 0.251327s (14217 normal rows, 10042 exceptions)
[2021-03-31 18:19:37.747] [driver] [info] [Task Finished] Transform to mem in 0.249497s (14094 normal rows, 9998 exceptions)
[2021-03-31 18:19:38.000] [driver] [info] [Task Finished] Transform to mem in 0.252979s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:19:38.250] [driver] [info] [Task Finished] Transform to mem in 0.250832s (14223 normal rows, 10048 exceptions)
[2021-03-31 18:19:38.502] [driver] [info] [Task Finished] Transform to mem in 0.251703s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:19:38.752] [driver] [info] [Task Finished] Transform to mem in 0.249461s (14086 normal rows, 9953 exceptions)
[2021-03-31 18:19:39.002] [driver] [info] [Task Finished] Transform to mem in 0.250248s (14232 normal rows, 10069 exceptions)
[2021-03-31 18:19:39.252] [driver] [info] [Task Finished] Transform to mem in 0.249862s (14170 normal rows, 9995 exceptions)
[2021-03-31 18:19:39.501] [driver] [info] [Task Finished] Transform to mem in 0.249210s (14002 normal rows, 9932 exceptions)
[2021-03-31 18:19:39.751] [driver] [info] [Task Finished] Transform to mem in 0.250153s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:19:40.001] [driver] [info] [Task Finished] Transform to mem in 0.249746s (14206 normal rows, 10009 exceptions)
[2021-03-31 18:19:40.250] [driver] [info] [Task Finished] Transform to mem in 0.249209s (13961 normal rows, 9907 exceptions)
[2021-03-31 18:19:40.500] [driver] [info] [Task Finished] Transform to mem in 0.250176s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:19:40.751] [driver] [info] [Task Finished] Transform to mem in 0.250940s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:19:41.043] [driver] [info] [Task Finished] Transform to mem in 0.291431s (16320 normal rows, 11605 exceptions)
[2021-03-31 18:19:41.043] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 40.2466s
[2021-03-31 18:19:41.043] [global] [info] [Transform Stage] Stage 0 total wall clock time: 40.2439s, 54108450 input rows, time to process 1 row via fast path: 0.000743764ms
[2021-03-31 18:19:41.043] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2021-03-31 18:19:41.047] [local ee] [info] compiled pure python pipeline in 0.003741s
[2021-03-31 18:19:41.047] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 18:19:41.048] [local ee] [info] Created 160 resolve tasks in 0.001149s
[2021-03-31 18:19:41.048] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 18:19:41.055] [driver] [info] [Task Finished] Resolve in 0.007133s
[2021-03-31 18:19:41.062] [driver] [info] [Task Finished] Resolve in 0.007203s
[2021-03-31 18:19:41.069] [driver] [info] [Task Finished] Resolve in 0.006933s
[2021-03-31 18:19:41.076] [driver] [info] [Task Finished] Resolve in 0.007237s
[2021-03-31 18:19:41.084] [driver] [info] [Task Finished] Resolve in 0.007201s
[2021-03-31 18:19:41.091] [driver] [info] [Task Finished] Resolve in 0.007078s
[2021-03-31 18:19:41.098] [driver] [info] [Task Finished] Resolve in 0.007184s
[2021-03-31 18:19:41.105] [driver] [info] [Task Finished] Resolve in 0.007234s
[2021-03-31 18:19:41.112] [driver] [info] [Task Finished] Resolve in 0.007112s
[2021-03-31 18:19:41.119] [driver] [info] [Task Finished] Resolve in 0.007037s
[2021-03-31 18:19:41.127] [driver] [info] [Task Finished] Resolve in 0.007207s
[2021-03-31 18:19:41.134] [driver] [info] [Task Finished] Resolve in 0.007101s
[2021-03-31 18:19:41.141] [driver] [info] [Task Finished] Resolve in 0.007182s
[2021-03-31 18:19:41.148] [driver] [info] [Task Finished] Resolve in 0.007036s
[2021-03-31 18:19:41.155] [driver] [info] [Task Finished] Resolve in 0.007206s
[2021-03-31 18:19:41.162] [driver] [info] [Task Finished] Resolve in 0.007153s
[2021-03-31 18:19:41.169] [driver] [info] [Task Finished] Resolve in 0.007056s
[2021-03-31 18:19:41.177] [driver] [info] [Task Finished] Resolve in 0.007160s
[2021-03-31 18:19:41.184] [driver] [info] [Task Finished] Resolve in 0.007160s
[2021-03-31 18:19:41.191] [driver] [info] [Task Finished] Resolve in 0.007183s
[2021-03-31 18:19:41.198] [driver] [info] [Task Finished] Resolve in 0.006978s
[2021-03-31 18:19:41.205] [driver] [info] [Task Finished] Resolve in 0.007159s
[2021-03-31 18:19:41.212] [driver] [info] [Task Finished] Resolve in 0.007327s
[2021-03-31 18:19:41.219] [driver] [info] [Task Finished] Resolve in 0.006966s
[2021-03-31 18:19:41.227] [driver] [info] [Task Finished] Resolve in 0.007150s
[2021-03-31 18:19:41.234] [driver] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:19:41.241] [driver] [info] [Task Finished] Resolve in 0.007160s
[2021-03-31 18:19:41.248] [driver] [info] [Task Finished] Resolve in 0.006972s
[2021-03-31 18:19:41.255] [driver] [info] [Task Finished] Resolve in 0.007182s
[2021-03-31 18:19:41.262] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:19:41.269] [driver] [info] [Task Finished] Resolve in 0.006972s
[2021-03-31 18:19:41.277] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:19:41.284] [driver] [info] [Task Finished] Resolve in 0.007141s
[2021-03-31 18:19:41.291] [driver] [info] [Task Finished] Resolve in 0.007120s
[2021-03-31 18:19:41.298] [driver] [info] [Task Finished] Resolve in 0.007037s
[2021-03-31 18:19:41.305] [driver] [info] [Task Finished] Resolve in 0.007185s
[2021-03-31 18:19:41.312] [driver] [info] [Task Finished] Resolve in 0.007109s
[2021-03-31 18:19:41.319] [driver] [info] [Task Finished] Resolve in 0.007159s
[2021-03-31 18:19:41.327] [driver] [info] [Task Finished] Resolve in 0.007192s
[2021-03-31 18:19:41.334] [driver] [info] [Task Finished] Resolve in 0.007095s
[2021-03-31 18:19:41.341] [driver] [info] [Task Finished] Resolve in 0.007213s
[2021-03-31 18:19:41.348] [driver] [info] [Task Finished] Resolve in 0.007017s
[2021-03-31 18:19:41.355] [driver] [info] [Task Finished] Resolve in 0.007064s
[2021-03-31 18:19:41.362] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:19:41.369] [driver] [info] [Task Finished] Resolve in 0.007040s
[2021-03-31 18:19:41.376] [driver] [info] [Task Finished] Resolve in 0.007133s
[2021-03-31 18:19:41.384] [driver] [info] [Task Finished] Resolve in 0.007218s
[2021-03-31 18:19:41.391] [driver] [info] [Task Finished] Resolve in 0.007192s
[2021-03-31 18:19:41.398] [driver] [info] [Task Finished] Resolve in 0.006923s
[2021-03-31 18:19:41.405] [driver] [info] [Task Finished] Resolve in 0.007198s
[2021-03-31 18:19:41.412] [driver] [info] [Task Finished] Resolve in 0.007191s
[2021-03-31 18:19:41.419] [driver] [info] [Task Finished] Resolve in 0.006937s
[2021-03-31 18:19:41.426] [driver] [info] [Task Finished] Resolve in 0.007301s
[2021-03-31 18:19:41.434] [driver] [info] [Task Finished] Resolve in 0.007235s
[2021-03-31 18:19:41.441] [driver] [info] [Task Finished] Resolve in 0.007108s
[2021-03-31 18:19:41.448] [driver] [info] [Task Finished] Resolve in 0.006996s
[2021-03-31 18:19:41.455] [driver] [info] [Task Finished] Resolve in 0.007193s
[2021-03-31 18:19:41.462] [driver] [info] [Task Finished] Resolve in 0.007147s
[2021-03-31 18:19:41.469] [driver] [info] [Task Finished] Resolve in 0.006989s
[2021-03-31 18:19:41.476] [driver] [info] [Task Finished] Resolve in 0.007218s
[2021-03-31 18:19:41.484] [driver] [info] [Task Finished] Resolve in 0.007178s
[2021-03-31 18:19:41.491] [driver] [info] [Task Finished] Resolve in 0.007138s
[2021-03-31 18:19:41.498] [driver] [info] [Task Finished] Resolve in 0.007015s
[2021-03-31 18:19:41.505] [driver] [info] [Task Finished] Resolve in 0.007197s
[2021-03-31 18:19:41.512] [driver] [info] [Task Finished] Resolve in 0.007130s
[2021-03-31 18:19:41.519] [driver] [info] [Task Finished] Resolve in 0.007011s
[2021-03-31 18:19:41.526] [driver] [info] [Task Finished] Resolve in 0.007169s
[2021-03-31 18:19:41.533] [driver] [info] [Task Finished] Resolve in 0.007158s
[2021-03-31 18:19:41.541] [driver] [info] [Task Finished] Resolve in 0.007335s
[2021-03-31 18:19:41.548] [driver] [info] [Task Finished] Resolve in 0.006978s
[2021-03-31 18:19:41.555] [driver] [info] [Task Finished] Resolve in 0.007127s
[2021-03-31 18:19:41.562] [driver] [info] [Task Finished] Resolve in 0.007204s
[2021-03-31 18:19:41.569] [driver] [info] [Task Finished] Resolve in 0.006981s
[2021-03-31 18:19:41.576] [driver] [info] [Task Finished] Resolve in 0.007139s
[2021-03-31 18:19:41.584] [driver] [info] [Task Finished] Resolve in 0.007197s
[2021-03-31 18:19:41.591] [driver] [info] [Task Finished] Resolve in 0.007153s
[2021-03-31 18:19:41.598] [driver] [info] [Task Finished] Resolve in 0.007618s
[2021-03-31 18:19:41.606] [driver] [info] [Task Finished] Resolve in 0.007831s
[2021-03-31 18:19:41.614] [driver] [info] [Task Finished] Resolve in 0.007798s
[2021-03-31 18:19:41.622] [driver] [info] [Task Finished] Resolve in 0.007695s
[2021-03-31 18:19:41.629] [driver] [info] [Task Finished] Resolve in 0.007740s
[2021-03-31 18:19:41.637] [driver] [info] [Task Finished] Resolve in 0.007238s
[2021-03-31 18:19:41.644] [driver] [info] [Task Finished] Resolve in 0.007058s
[2021-03-31 18:19:41.651] [driver] [info] [Task Finished] Resolve in 0.007335s
[2021-03-31 18:19:41.658] [driver] [info] [Task Finished] Resolve in 0.007039s
[2021-03-31 18:19:41.665] [driver] [info] [Task Finished] Resolve in 0.007083s
[2021-03-31 18:19:41.672] [driver] [info] [Task Finished] Resolve in 0.007210s
[2021-03-31 18:19:41.679] [driver] [info] [Task Finished] Resolve in 0.007026s
[2021-03-31 18:19:41.687] [driver] [info] [Task Finished] Resolve in 0.007084s
[2021-03-31 18:19:41.694] [driver] [info] [Task Finished] Resolve in 0.007198s
[2021-03-31 18:19:41.701] [driver] [info] [Task Finished] Resolve in 0.007217s
[2021-03-31 18:19:41.708] [driver] [info] [Task Finished] Resolve in 0.006950s
[2021-03-31 18:19:41.715] [driver] [info] [Task Finished] Resolve in 0.007169s
[2021-03-31 18:19:41.722] [driver] [info] [Task Finished] Resolve in 0.007207s
[2021-03-31 18:19:41.729] [driver] [info] [Task Finished] Resolve in 0.006975s
[2021-03-31 18:19:41.737] [driver] [info] [Task Finished] Resolve in 0.007174s
[2021-03-31 18:19:41.744] [driver] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:19:41.751] [driver] [info] [Task Finished] Resolve in 0.007138s
[2021-03-31 18:19:41.758] [driver] [info] [Task Finished] Resolve in 0.007111s
[2021-03-31 18:19:41.765] [driver] [info] [Task Finished] Resolve in 0.007210s
[2021-03-31 18:19:41.772] [driver] [info] [Task Finished] Resolve in 0.007142s
[2021-03-31 18:19:41.779] [driver] [info] [Task Finished] Resolve in 0.006962s
[2021-03-31 18:19:41.787] [driver] [info] [Task Finished] Resolve in 0.007197s
[2021-03-31 18:19:41.794] [driver] [info] [Task Finished] Resolve in 0.007162s
[2021-03-31 18:19:41.801] [driver] [info] [Task Finished] Resolve in 0.007158s
[2021-03-31 18:19:41.808] [driver] [info] [Task Finished] Resolve in 0.007009s
[2021-03-31 18:19:41.815] [driver] [info] [Task Finished] Resolve in 0.007176s
[2021-03-31 18:19:41.822] [driver] [info] [Task Finished] Resolve in 0.007138s
[2021-03-31 18:19:41.829] [driver] [info] [Task Finished] Resolve in 0.007015s
[2021-03-31 18:19:41.837] [driver] [info] [Task Finished] Resolve in 0.007187s
[2021-03-31 18:19:41.844] [driver] [info] [Task Finished] Resolve in 0.007132s
[2021-03-31 18:19:41.851] [driver] [info] [Task Finished] Resolve in 0.007196s
[2021-03-31 18:19:41.858] [driver] [info] [Task Finished] Resolve in 0.007010s
[2021-03-31 18:19:41.865] [driver] [info] [Task Finished] Resolve in 0.007202s
[2021-03-31 18:19:41.872] [driver] [info] [Task Finished] Resolve in 0.007255s
[2021-03-31 18:19:41.879] [driver] [info] [Task Finished] Resolve in 0.006989s
[2021-03-31 18:19:41.886] [driver] [info] [Task Finished] Resolve in 0.007123s
[2021-03-31 18:19:41.894] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:19:41.901] [driver] [info] [Task Finished] Resolve in 0.007178s
[2021-03-31 18:19:41.908] [driver] [info] [Task Finished] Resolve in 0.006917s
[2021-03-31 18:19:41.915] [driver] [info] [Task Finished] Resolve in 0.007204s
[2021-03-31 18:19:41.922] [driver] [info] [Task Finished] Resolve in 0.007394s
[2021-03-31 18:19:41.930] [driver] [info] [Task Finished] Resolve in 0.007758s
[2021-03-31 18:19:41.938] [driver] [info] [Task Finished] Resolve in 0.007785s
[2021-03-31 18:19:41.946] [driver] [info] [Task Finished] Resolve in 0.007824s
[2021-03-31 18:19:41.953] [driver] [info] [Task Finished] Resolve in 0.007415s
[2021-03-31 18:19:41.960] [driver] [info] [Task Finished] Resolve in 0.007154s
[2021-03-31 18:19:41.968] [driver] [info] [Task Finished] Resolve in 0.007062s
[2021-03-31 18:19:41.975] [driver] [info] [Task Finished] Resolve in 0.007138s
[2021-03-31 18:19:41.982] [driver] [info] [Task Finished] Resolve in 0.007251s
[2021-03-31 18:19:41.989] [driver] [info] [Task Finished] Resolve in 0.007050s
[2021-03-31 18:19:41.996] [driver] [info] [Task Finished] Resolve in 0.007139s
[2021-03-31 18:19:42.003] [driver] [info] [Task Finished] Resolve in 0.007168s
[2021-03-31 18:19:42.011] [driver] [info] [Task Finished] Resolve in 0.007157s
[2021-03-31 18:19:42.018] [driver] [info] [Task Finished] Resolve in 0.007034s
[2021-03-31 18:19:42.025] [driver] [info] [Task Finished] Resolve in 0.007165s
[2021-03-31 18:19:42.032] [driver] [info] [Task Finished] Resolve in 0.007371s
[2021-03-31 18:19:42.040] [driver] [info] [Task Finished] Resolve in 0.007705s
[2021-03-31 18:19:42.048] [driver] [info] [Task Finished] Resolve in 0.007712s
[2021-03-31 18:19:42.055] [driver] [info] [Task Finished] Resolve in 0.007808s
[2021-03-31 18:19:42.063] [driver] [info] [Task Finished] Resolve in 0.007763s
[2021-03-31 18:19:42.071] [driver] [info] [Task Finished] Resolve in 0.007734s
[2021-03-31 18:19:42.078] [driver] [info] [Task Finished] Resolve in 0.007027s
[2021-03-31 18:19:42.085] [driver] [info] [Task Finished] Resolve in 0.007301s
[2021-03-31 18:19:42.092] [driver] [info] [Task Finished] Resolve in 0.007145s
[2021-03-31 18:19:42.099] [driver] [info] [Task Finished] Resolve in 0.007023s
[2021-03-31 18:19:42.107] [driver] [info] [Task Finished] Resolve in 0.007140s
[2021-03-31 18:19:42.114] [driver] [info] [Task Finished] Resolve in 0.007149s
[2021-03-31 18:19:42.121] [driver] [info] [Task Finished] Resolve in 0.007202s
[2021-03-31 18:19:42.128] [driver] [info] [Task Finished] Resolve in 0.006971s
[2021-03-31 18:19:42.135] [driver] [info] [Task Finished] Resolve in 0.007144s
[2021-03-31 18:19:42.142] [driver] [info] [Task Finished] Resolve in 0.007260s
[2021-03-31 18:19:42.149] [driver] [info] [Task Finished] Resolve in 0.007014s
[2021-03-31 18:19:42.157] [driver] [info] [Task Finished] Resolve in 0.007117s
[2021-03-31 18:19:42.164] [driver] [info] [Task Finished] Resolve in 0.007217s
[2021-03-31 18:19:42.171] [driver] [info] [Task Finished] Resolve in 0.007172s
[2021-03-31 18:19:42.178] [driver] [info] [Task Finished] Resolve in 0.006930s
[2021-03-31 18:19:42.185] [driver] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:19:42.192] [driver] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:19:42.201] [driver] [info] [Task Finished] Resolve in 0.008365s
[2021-03-31 18:19:42.201] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 1.15802s
[2021-03-31 18:19:42.201] [local ee] [info] slow path for Stage 0: total wall clock time: 1.15105s, time to process 1 row via slow path: 0.000718245ms
[2021-03-31 18:19:42.201] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.15804s

[2021-03-31 18:19:42.238] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2021-03-31 18:19:42.648] [driver] [info] [Task Finished] write to file in 0.409771s (2264570 rows, 344.74 MB)
[2021-03-31 18:19:42.648] [global] [info] writing output took 0.447060s
[2021-03-31 18:19:42.648] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.447146s
[2021-03-31 18:19:42.648] [global] [info] [Transform Stage] Stage 0 took 42.2929s
[2021-03-31 18:19:42.648] [global] [info] Query Execution took 42.3897s. (planning: 0.0967559s, execution: 42.2929s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 05:47:10) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.004927396774291992
Tuplex job time: 42.652363777160645 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '6bcf8f6a24af', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0196606,"llvm_optimization_time_s":0.292161,"llvm_compilation_time_s":0.133618,"total_compilation_time_s":0.441055,"sampling_time_s":0.108341,"stages":[{"stage_no":0,"fast_path_wall_time_s":40.2439,"fast_path_time_s":40.2466,"fast_path_per_row_time_ns":743.764,"slow_path_wall_time_s":1.15105,"slow_path_time_s":1.15802,"slow_path_per_row_time_ns":718.245}]}
{"startupTime": 0.004927396774291992, "jobTime": 42.652363777160645}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 321 active partitions
