[2021-03-31 18:20:28.120] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:20:28.120] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:20:28.120] [local ee] [info] initializing LLVM backend
[2021-03-31 18:20:28.120] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:20:28.121] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:20:28.121] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-31 18:20:28.121] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:20:28.122] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 18:20:28.122] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2021-03-31 18:20:28.254] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.270] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.277] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.304] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.323] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.336] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.367] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.383] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:20:28.386] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:20:28.388] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:20:28.391] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:20:28.406] [logical planner] [info] logical optimization took 0.019681ms
[2021-03-31 18:20:28.407] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.410] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.414] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.418] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.420] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.422] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.424] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:20:28.432] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:20:28.432] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,f64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:20:28.433] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2021-03-31 18:20:28.433] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2021-03-31 18:20:28.434] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2021-03-31 18:20:28.435] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2021-03-31 18:20:28.435] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2021-03-31 18:20:28.436] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2021-03-31 18:20:28.436] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:20:28.437] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2021-03-31 18:20:28.438] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2021-03-31 18:20:28.439] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2021-03-31 18:20:28.439] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:20:28.440] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:20:28.441] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:20:28.441] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2021-03-31 18:20:28.443] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:20:28.444] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:20:28.444] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:20:28.445] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:20:28.445] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:20:28.446] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:20:28.447] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 18:20:28.448] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 18:20:28.448] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 18:20:28.449] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:20:28.450] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:20:28.451] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:20:28.451] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 18:20:28.481] [global] [info] Stage0 depends on: 
[2021-03-31 18:20:28.791] [global] [info] Optimization via LLVM passes took 0.294747 ms
[2021-03-31 18:20:28.926] [global] [info] Compiled code paths for stage 0 in 0.13 ms
[2021-03-31 18:20:28.926] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.444655s
[2021-03-31 18:20:28.926] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2021-03-31 18:20:29.179] [driver] [info] [Task Finished] Transform to mem in 0.253252s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:20:29.430] [driver] [info] [Task Finished] Transform to mem in 0.250271s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:20:29.683] [driver] [info] [Task Finished] Transform to mem in 0.253193s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:20:29.937] [driver] [info] [Task Finished] Transform to mem in 0.254362s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:20:30.188] [driver] [info] [Task Finished] Transform to mem in 0.251222s (14217 normal rows, 10015 exceptions)
[2021-03-31 18:20:30.438] [driver] [info] [Task Finished] Transform to mem in 0.250049s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:20:30.689] [driver] [info] [Task Finished] Transform to mem in 0.250998s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:20:30.940] [driver] [info] [Task Finished] Transform to mem in 0.250870s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:20:31.190] [driver] [info] [Task Finished] Transform to mem in 0.250085s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:20:31.442] [driver] [info] [Task Finished] Transform to mem in 0.251638s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:20:31.693] [driver] [info] [Task Finished] Transform to mem in 0.251343s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:20:31.944] [driver] [info] [Task Finished] Transform to mem in 0.250041s (13988 normal rows, 9938 exceptions)
[2021-03-31 18:20:32.195] [driver] [info] [Task Finished] Transform to mem in 0.251037s (14177 normal rows, 10036 exceptions)
[2021-03-31 18:20:32.445] [driver] [info] [Task Finished] Transform to mem in 0.250466s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:20:32.695] [driver] [info] [Task Finished] Transform to mem in 0.250265s (14020 normal rows, 9982 exceptions)
[2021-03-31 18:20:32.946] [driver] [info] [Task Finished] Transform to mem in 0.250735s (14162 normal rows, 9952 exceptions)
[2021-03-31 18:20:33.200] [driver] [info] [Task Finished] Transform to mem in 0.254144s (14241 normal rows, 10100 exceptions)
[2021-03-31 18:20:33.450] [driver] [info] [Task Finished] Transform to mem in 0.250010s (14059 normal rows, 9985 exceptions)
[2021-03-31 18:20:33.704] [driver] [info] [Task Finished] Transform to mem in 0.253728s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:20:33.955] [driver] [info] [Task Finished] Transform to mem in 0.250497s (14238 normal rows, 10030 exceptions)
[2021-03-31 18:20:34.206] [driver] [info] [Task Finished] Transform to mem in 0.251048s (14081 normal rows, 9995 exceptions)
[2021-03-31 18:20:34.456] [driver] [info] [Task Finished] Transform to mem in 0.250660s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:20:34.708] [driver] [info] [Task Finished] Transform to mem in 0.251350s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:20:34.958] [driver] [info] [Task Finished] Transform to mem in 0.250154s (14086 normal rows, 9989 exceptions)
[2021-03-31 18:20:35.212] [driver] [info] [Task Finished] Transform to mem in 0.253865s (14097 normal rows, 10002 exceptions)
[2021-03-31 18:20:35.462] [driver] [info] [Task Finished] Transform to mem in 0.250429s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:20:35.713] [driver] [info] [Task Finished] Transform to mem in 0.251272s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:20:35.964] [driver] [info] [Task Finished] Transform to mem in 0.250193s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:20:36.214] [driver] [info] [Task Finished] Transform to mem in 0.250747s (14212 normal rows, 10032 exceptions)
[2021-03-31 18:20:36.465] [driver] [info] [Task Finished] Transform to mem in 0.250172s (14099 normal rows, 10008 exceptions)
[2021-03-31 18:20:36.715] [driver] [info] [Task Finished] Transform to mem in 0.250217s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:20:36.966] [driver] [info] [Task Finished] Transform to mem in 0.251245s (14223 normal rows, 10035 exceptions)
[2021-03-31 18:20:37.216] [driver] [info] [Task Finished] Transform to mem in 0.250006s (14089 normal rows, 10008 exceptions)
[2021-03-31 18:20:37.470] [driver] [info] [Task Finished] Transform to mem in 0.253467s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:20:37.720] [driver] [info] [Task Finished] Transform to mem in 0.250886s (14235 normal rows, 10062 exceptions)
[2021-03-31 18:20:37.972] [driver] [info] [Task Finished] Transform to mem in 0.251467s (14170 normal rows, 9994 exceptions)
[2021-03-31 18:20:38.223] [driver] [info] [Task Finished] Transform to mem in 0.250609s (14002 normal rows, 9940 exceptions)
[2021-03-31 18:20:38.473] [driver] [info] [Task Finished] Transform to mem in 0.250754s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:20:38.724] [driver] [info] [Task Finished] Transform to mem in 0.250721s (14206 normal rows, 9991 exceptions)
[2021-03-31 18:20:38.974] [driver] [info] [Task Finished] Transform to mem in 0.250013s (13961 normal rows, 9925 exceptions)
[2021-03-31 18:20:39.225] [driver] [info] [Task Finished] Transform to mem in 0.251062s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:20:39.476] [driver] [info] [Task Finished] Transform to mem in 0.250414s (14233 normal rows, 10011 exceptions)
[2021-03-31 18:20:39.726] [driver] [info] [Task Finished] Transform to mem in 0.250331s (13915 normal rows, 9900 exceptions)
[2021-03-31 18:20:39.977] [driver] [info] [Task Finished] Transform to mem in 0.251333s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:20:40.229] [driver] [info] [Task Finished] Transform to mem in 0.251353s (14267 normal rows, 10030 exceptions)
[2021-03-31 18:20:40.478] [driver] [info] [Task Finished] Transform to mem in 0.249726s (13892 normal rows, 9882 exceptions)
[2021-03-31 18:20:40.735] [driver] [info] [Task Finished] Transform to mem in 0.256310s (14245 normal rows, 10101 exceptions)
[2021-03-31 18:20:40.989] [driver] [info] [Task Finished] Transform to mem in 0.253806s (14260 normal rows, 10025 exceptions)
[2021-03-31 18:20:41.238] [driver] [info] [Task Finished] Transform to mem in 0.249784s (13978 normal rows, 9907 exceptions)
[2021-03-31 18:20:41.489] [driver] [info] [Task Finished] Transform to mem in 0.250979s (14181 normal rows, 10067 exceptions)
[2021-03-31 18:20:41.740] [driver] [info] [Task Finished] Transform to mem in 0.250801s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:20:41.991] [driver] [info] [Task Finished] Transform to mem in 0.250883s (14015 normal rows, 9982 exceptions)
[2021-03-31 18:20:42.242] [driver] [info] [Task Finished] Transform to mem in 0.250597s (14142 normal rows, 9989 exceptions)
[2021-03-31 18:20:42.492] [driver] [info] [Task Finished] Transform to mem in 0.250474s (14280 normal rows, 10094 exceptions)
[2021-03-31 18:20:42.742] [driver] [info] [Task Finished] Transform to mem in 0.250209s (13982 normal rows, 9975 exceptions)
[2021-03-31 18:20:42.993] [driver] [info] [Task Finished] Transform to mem in 0.250623s (14173 normal rows, 10006 exceptions)
[2021-03-31 18:20:43.244] [driver] [info] [Task Finished] Transform to mem in 0.251420s (14235 normal rows, 10040 exceptions)
[2021-03-31 18:20:43.496] [driver] [info] [Task Finished] Transform to mem in 0.251059s (14054 normal rows, 9984 exceptions)
[2021-03-31 18:20:43.746] [driver] [info] [Task Finished] Transform to mem in 0.250848s (14129 normal rows, 10004 exceptions)
[2021-03-31 18:20:43.997] [driver] [info] [Task Finished] Transform to mem in 0.250541s (14223 normal rows, 10033 exceptions)
[2021-03-31 18:20:44.247] [driver] [info] [Task Finished] Transform to mem in 0.250079s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:20:44.497] [driver] [info] [Task Finished] Transform to mem in 0.250243s (14108 normal rows, 10010 exceptions)
[2021-03-31 18:20:44.751] [driver] [info] [Task Finished] Transform to mem in 0.253958s (14208 normal rows, 10008 exceptions)
[2021-03-31 18:20:45.002] [driver] [info] [Task Finished] Transform to mem in 0.250212s (14089 normal rows, 10031 exceptions)
[2021-03-31 18:20:45.252] [driver] [info] [Task Finished] Transform to mem in 0.250390s (14094 normal rows, 9960 exceptions)
[2021-03-31 18:20:45.502] [driver] [info] [Task Finished] Transform to mem in 0.250271s (14232 normal rows, 10017 exceptions)
[2021-03-31 18:20:45.753] [driver] [info] [Task Finished] Transform to mem in 0.250366s (14088 normal rows, 10027 exceptions)
[2021-03-31 18:20:46.003] [driver] [info] [Task Finished] Transform to mem in 0.250530s (14106 normal rows, 9955 exceptions)
[2021-03-31 18:20:46.254] [driver] [info] [Task Finished] Transform to mem in 0.250751s (14211 normal rows, 10043 exceptions)
[2021-03-31 18:20:46.504] [driver] [info] [Task Finished] Transform to mem in 0.249979s (14113 normal rows, 9997 exceptions)
[2021-03-31 18:20:46.754] [driver] [info] [Task Finished] Transform to mem in 0.250510s (14075 normal rows, 9965 exceptions)
[2021-03-31 18:20:47.005] [driver] [info] [Task Finished] Transform to mem in 0.250502s (14223 normal rows, 10049 exceptions)
[2021-03-31 18:20:47.255] [driver] [info] [Task Finished] Transform to mem in 0.250261s (14095 normal rows, 9995 exceptions)
[2021-03-31 18:20:47.506] [driver] [info] [Task Finished] Transform to mem in 0.250348s (14086 normal rows, 9952 exceptions)
[2021-03-31 18:20:47.757] [driver] [info] [Task Finished] Transform to mem in 0.251005s (14226 normal rows, 10069 exceptions)
[2021-03-31 18:20:48.007] [driver] [info] [Task Finished] Transform to mem in 0.250326s (14170 normal rows, 9996 exceptions)
[2021-03-31 18:20:48.257] [driver] [info] [Task Finished] Transform to mem in 0.249632s (14002 normal rows, 9931 exceptions)
[2021-03-31 18:20:48.511] [driver] [info] [Task Finished] Transform to mem in 0.254213s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:20:48.761] [driver] [info] [Task Finished] Transform to mem in 0.250367s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:20:49.011] [driver] [info] [Task Finished] Transform to mem in 0.249877s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:20:49.262] [driver] [info] [Task Finished] Transform to mem in 0.250845s (14237 normal rows, 10084 exceptions)
[2021-03-31 18:20:49.513] [driver] [info] [Task Finished] Transform to mem in 0.251114s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:20:49.763] [driver] [info] [Task Finished] Transform to mem in 0.249993s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:20:50.014] [driver] [info] [Task Finished] Transform to mem in 0.251128s (14267 normal rows, 10099 exceptions)
[2021-03-31 18:20:50.265] [driver] [info] [Task Finished] Transform to mem in 0.250534s (14248 normal rows, 10030 exceptions)
[2021-03-31 18:20:50.515] [driver] [info] [Task Finished] Transform to mem in 0.249924s (13912 normal rows, 9882 exceptions)
[2021-03-31 18:20:50.766] [driver] [info] [Task Finished] Transform to mem in 0.251177s (14248 normal rows, 10094 exceptions)
[2021-03-31 18:20:51.016] [driver] [info] [Task Finished] Transform to mem in 0.250545s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:20:51.268] [driver] [info] [Task Finished] Transform to mem in 0.251143s (13988 normal rows, 9922 exceptions)
[2021-03-31 18:20:51.518] [driver] [info] [Task Finished] Transform to mem in 0.250709s (14171 normal rows, 10052 exceptions)
[2021-03-31 18:20:51.773] [driver] [info] [Task Finished] Transform to mem in 0.254660s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:20:52.027] [driver] [info] [Task Finished] Transform to mem in 0.254042s (14015 normal rows, 9985 exceptions)
[2021-03-31 18:20:52.278] [driver] [info] [Task Finished] Transform to mem in 0.250511s (14176 normal rows, 9997 exceptions)
[2021-03-31 18:20:52.528] [driver] [info] [Task Finished] Transform to mem in 0.250559s (14246 normal rows, 10108 exceptions)
[2021-03-31 18:20:52.779] [driver] [info] [Task Finished] Transform to mem in 0.250368s (14059 normal rows, 9978 exceptions)
[2021-03-31 18:20:53.029] [driver] [info] [Task Finished] Transform to mem in 0.250418s (14114 normal rows, 10011 exceptions)
[2021-03-31 18:20:53.280] [driver] [info] [Task Finished] Transform to mem in 0.251430s (14238 normal rows, 10007 exceptions)
[2021-03-31 18:20:53.532] [driver] [info] [Task Finished] Transform to mem in 0.251088s (14081 normal rows, 10003 exceptions)
[2021-03-31 18:20:53.783] [driver] [info] [Task Finished] Transform to mem in 0.251429s (14095 normal rows, 10024 exceptions)
[2021-03-31 18:20:54.034] [driver] [info] [Task Finished] Transform to mem in 0.250683s (14221 normal rows, 9998 exceptions)
[2021-03-31 18:20:54.284] [driver] [info] [Task Finished] Transform to mem in 0.250271s (14086 normal rows, 9998 exceptions)
[2021-03-31 18:20:54.534] [driver] [info] [Task Finished] Transform to mem in 0.250466s (14091 normal rows, 10001 exceptions)
[2021-03-31 18:20:54.786] [driver] [info] [Task Finished] Transform to mem in 0.251509s (14218 normal rows, 10016 exceptions)
[2021-03-31 18:20:55.036] [driver] [info] [Task Finished] Transform to mem in 0.250317s (14095 normal rows, 10026 exceptions)
[2021-03-31 18:20:55.286] [driver] [info] [Task Finished] Transform to mem in 0.250146s (14113 normal rows, 9960 exceptions)
[2021-03-31 18:20:55.540] [driver] [info] [Task Finished] Transform to mem in 0.253771s (14197 normal rows, 10028 exceptions)
[2021-03-31 18:20:55.794] [driver] [info] [Task Finished] Transform to mem in 0.253709s (14114 normal rows, 10012 exceptions)
[2021-03-31 18:20:56.045] [driver] [info] [Task Finished] Transform to mem in 0.251156s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:20:56.296] [driver] [info] [Task Finished] Transform to mem in 0.250505s (14197 normal rows, 10033 exceptions)
[2021-03-31 18:20:56.547] [driver] [info] [Task Finished] Transform to mem in 0.251480s (14115 normal rows, 10010 exceptions)
[2021-03-31 18:20:56.798] [driver] [info] [Task Finished] Transform to mem in 0.250456s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:20:57.048] [driver] [info] [Task Finished] Transform to mem in 0.250673s (14235 normal rows, 10048 exceptions)
[2021-03-31 18:20:57.299] [driver] [info] [Task Finished] Transform to mem in 0.250575s (14144 normal rows, 9995 exceptions)
[2021-03-31 18:20:57.549] [driver] [info] [Task Finished] Transform to mem in 0.250027s (14015 normal rows, 9952 exceptions)
[2021-03-31 18:20:57.800] [driver] [info] [Task Finished] Transform to mem in 0.251107s (14237 normal rows, 10069 exceptions)
[2021-03-31 18:20:58.051] [driver] [info] [Task Finished] Transform to mem in 0.251205s (14159 normal rows, 9996 exceptions)
[2021-03-31 18:20:58.302] [driver] [info] [Task Finished] Transform to mem in 0.250194s (14010 normal rows, 9932 exceptions)
[2021-03-31 18:20:58.552] [driver] [info] [Task Finished] Transform to mem in 0.250767s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:20:58.803] [driver] [info] [Task Finished] Transform to mem in 0.250273s (14178 normal rows, 10009 exceptions)
[2021-03-31 18:20:59.056] [driver] [info] [Task Finished] Transform to mem in 0.253106s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:20:59.306] [driver] [info] [Task Finished] Transform to mem in 0.250594s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:20:59.560] [driver] [info] [Task Finished] Transform to mem in 0.253779s (14236 normal rows, 10015 exceptions)
[2021-03-31 18:20:59.811] [driver] [info] [Task Finished] Transform to mem in 0.250879s (13901 normal rows, 9892 exceptions)
[2021-03-31 18:21:00.062] [driver] [info] [Task Finished] Transform to mem in 0.250968s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:21:00.316] [driver] [info] [Task Finished] Transform to mem in 0.254268s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:21:00.566] [driver] [info] [Task Finished] Transform to mem in 0.249736s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:21:00.818] [driver] [info] [Task Finished] Transform to mem in 0.251512s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:21:01.068] [driver] [info] [Task Finished] Transform to mem in 0.250442s (14245 normal rows, 10024 exceptions)
[2021-03-31 18:21:01.318] [driver] [info] [Task Finished] Transform to mem in 0.249801s (13999 normal rows, 9935 exceptions)
[2021-03-31 18:21:01.569] [driver] [info] [Task Finished] Transform to mem in 0.250711s (14158 normal rows, 10036 exceptions)
[2021-03-31 18:21:01.819] [driver] [info] [Task Finished] Transform to mem in 0.250617s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:21:02.069] [driver] [info] [Task Finished] Transform to mem in 0.250310s (14020 normal rows, 9989 exceptions)
[2021-03-31 18:21:02.320] [driver] [info] [Task Finished] Transform to mem in 0.250585s (14173 normal rows, 10004 exceptions)
[2021-03-31 18:21:02.570] [driver] [info] [Task Finished] Transform to mem in 0.250275s (14235 normal rows, 10041 exceptions)
[2021-03-31 18:21:02.824] [driver] [info] [Task Finished] Transform to mem in 0.254009s (14054 normal rows, 9985 exceptions)
[2021-03-31 18:21:03.078] [driver] [info] [Task Finished] Transform to mem in 0.253656s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:21:03.328] [driver] [info] [Task Finished] Transform to mem in 0.250386s (14238 normal rows, 10033 exceptions)
[2021-03-31 18:21:03.579] [driver] [info] [Task Finished] Transform to mem in 0.250148s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:21:03.833] [driver] [info] [Task Finished] Transform to mem in 0.254213s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:21:04.084] [driver] [info] [Task Finished] Transform to mem in 0.250706s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:21:04.334] [driver] [info] [Task Finished] Transform to mem in 0.250257s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:21:04.584] [driver] [info] [Task Finished] Transform to mem in 0.250423s (14094 normal rows, 9996 exceptions)
[2021-03-31 18:21:04.835] [driver] [info] [Task Finished] Transform to mem in 0.250693s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:21:05.085] [driver] [info] [Task Finished] Transform to mem in 0.250427s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:21:05.336] [driver] [info] [Task Finished] Transform to mem in 0.250325s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:21:05.587] [driver] [info] [Task Finished] Transform to mem in 0.250747s (14217 normal rows, 10042 exceptions)
[2021-03-31 18:21:05.837] [driver] [info] [Task Finished] Transform to mem in 0.250156s (14094 normal rows, 9998 exceptions)
[2021-03-31 18:21:06.087] [driver] [info] [Task Finished] Transform to mem in 0.250351s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:21:06.338] [driver] [info] [Task Finished] Transform to mem in 0.250849s (14223 normal rows, 10048 exceptions)
[2021-03-31 18:21:06.591] [driver] [info] [Task Finished] Transform to mem in 0.253428s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:21:06.845] [driver] [info] [Task Finished] Transform to mem in 0.253568s (14086 normal rows, 9953 exceptions)
[2021-03-31 18:21:07.096] [driver] [info] [Task Finished] Transform to mem in 0.250910s (14232 normal rows, 10069 exceptions)
[2021-03-31 18:21:07.347] [driver] [info] [Task Finished] Transform to mem in 0.251302s (14170 normal rows, 9995 exceptions)
[2021-03-31 18:21:07.601] [driver] [info] [Task Finished] Transform to mem in 0.253560s (14002 normal rows, 9932 exceptions)
[2021-03-31 18:21:07.853] [driver] [info] [Task Finished] Transform to mem in 0.251770s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:21:08.103] [driver] [info] [Task Finished] Transform to mem in 0.250466s (14206 normal rows, 10009 exceptions)
[2021-03-31 18:21:08.353] [driver] [info] [Task Finished] Transform to mem in 0.249809s (13961 normal rows, 9907 exceptions)
[2021-03-31 18:21:08.604] [driver] [info] [Task Finished] Transform to mem in 0.250775s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:21:08.854] [driver] [info] [Task Finished] Transform to mem in 0.250763s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:21:09.146] [driver] [info] [Task Finished] Transform to mem in 0.291878s (16320 normal rows, 11605 exceptions)
[2021-03-31 18:21:09.146] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 40.2206s
[2021-03-31 18:21:09.146] [global] [info] [Transform Stage] Stage 0 total wall clock time: 40.2179s, 54108450 input rows, time to process 1 row via fast path: 0.000743284ms
[2021-03-31 18:21:09.147] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2021-03-31 18:21:09.150] [local ee] [info] compiled pure python pipeline in 0.003886s
[2021-03-31 18:21:09.150] [local ee] [info] creating hybrid intermediates took 0.000004s
[2021-03-31 18:21:09.152] [local ee] [info] Created 160 resolve tasks in 0.001213s
[2021-03-31 18:21:09.152] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 18:21:09.159] [driver] [info] [Task Finished] Resolve in 0.006977s
[2021-03-31 18:21:09.166] [driver] [info] [Task Finished] Resolve in 0.007244s
[2021-03-31 18:21:09.173] [driver] [info] [Task Finished] Resolve in 0.007128s
[2021-03-31 18:21:09.180] [driver] [info] [Task Finished] Resolve in 0.007151s
[2021-03-31 18:21:09.187] [driver] [info] [Task Finished] Resolve in 0.007110s
[2021-03-31 18:21:09.194] [driver] [info] [Task Finished] Resolve in 0.007061s
[2021-03-31 18:21:09.202] [driver] [info] [Task Finished] Resolve in 0.007370s
[2021-03-31 18:21:09.209] [driver] [info] [Task Finished] Resolve in 0.007055s
[2021-03-31 18:21:09.216] [driver] [info] [Task Finished] Resolve in 0.007119s
[2021-03-31 18:21:09.223] [driver] [info] [Task Finished] Resolve in 0.007191s
[2021-03-31 18:21:09.230] [driver] [info] [Task Finished] Resolve in 0.007147s
[2021-03-31 18:21:09.237] [driver] [info] [Task Finished] Resolve in 0.007011s
[2021-03-31 18:21:09.245] [driver] [info] [Task Finished] Resolve in 0.007205s
[2021-03-31 18:21:09.252] [driver] [info] [Task Finished] Resolve in 0.007329s
[2021-03-31 18:21:09.259] [driver] [info] [Task Finished] Resolve in 0.006966s
[2021-03-31 18:21:09.266] [driver] [info] [Task Finished] Resolve in 0.007191s
[2021-03-31 18:21:09.273] [driver] [info] [Task Finished] Resolve in 0.007233s
[2021-03-31 18:21:09.281] [driver] [info] [Task Finished] Resolve in 0.007112s
[2021-03-31 18:21:09.288] [driver] [info] [Task Finished] Resolve in 0.007030s
[2021-03-31 18:21:09.295] [driver] [info] [Task Finished] Resolve in 0.007197s
[2021-03-31 18:21:09.302] [driver] [info] [Task Finished] Resolve in 0.007162s
[2021-03-31 18:21:09.309] [driver] [info] [Task Finished] Resolve in 0.007124s
[2021-03-31 18:21:09.316] [driver] [info] [Task Finished] Resolve in 0.007221s
[2021-03-31 18:21:09.323] [driver] [info] [Task Finished] Resolve in 0.007156s
[2021-03-31 18:21:09.331] [driver] [info] [Task Finished] Resolve in 0.007115s
[2021-03-31 18:21:09.338] [driver] [info] [Task Finished] Resolve in 0.007070s
[2021-03-31 18:21:09.345] [driver] [info] [Task Finished] Resolve in 0.007180s
[2021-03-31 18:21:09.352] [driver] [info] [Task Finished] Resolve in 0.007147s
[2021-03-31 18:21:09.359] [driver] [info] [Task Finished] Resolve in 0.007025s
[2021-03-31 18:21:09.366] [driver] [info] [Task Finished] Resolve in 0.007328s
[2021-03-31 18:21:09.374] [driver] [info] [Task Finished] Resolve in 0.007163s
[2021-03-31 18:21:09.381] [driver] [info] [Task Finished] Resolve in 0.007222s
[2021-03-31 18:21:09.388] [driver] [info] [Task Finished] Resolve in 0.006986s
[2021-03-31 18:21:09.395] [driver] [info] [Task Finished] Resolve in 0.007145s
[2021-03-31 18:21:09.402] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:21:09.409] [driver] [info] [Task Finished] Resolve in 0.007028s
[2021-03-31 18:21:09.417] [driver] [info] [Task Finished] Resolve in 0.007250s
[2021-03-31 18:21:09.424] [driver] [info] [Task Finished] Resolve in 0.007251s
[2021-03-31 18:21:09.431] [driver] [info] [Task Finished] Resolve in 0.007183s
[2021-03-31 18:21:09.438] [driver] [info] [Task Finished] Resolve in 0.006937s
[2021-03-31 18:21:09.445] [driver] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:21:09.452] [driver] [info] [Task Finished] Resolve in 0.007209s
[2021-03-31 18:21:09.459] [driver] [info] [Task Finished] Resolve in 0.006903s
[2021-03-31 18:21:09.467] [driver] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:21:09.474] [driver] [info] [Task Finished] Resolve in 0.007344s
[2021-03-31 18:21:09.481] [driver] [info] [Task Finished] Resolve in 0.007077s
[2021-03-31 18:21:09.488] [driver] [info] [Task Finished] Resolve in 0.007061s
[2021-03-31 18:21:09.495] [driver] [info] [Task Finished] Resolve in 0.007243s
[2021-03-31 18:21:09.502] [driver] [info] [Task Finished] Resolve in 0.007115s
[2021-03-31 18:21:09.509] [driver] [info] [Task Finished] Resolve in 0.007037s
[2021-03-31 18:21:09.517] [driver] [info] [Task Finished] Resolve in 0.007242s
[2021-03-31 18:21:09.524] [driver] [info] [Task Finished] Resolve in 0.007142s
[2021-03-31 18:21:09.531] [driver] [info] [Task Finished] Resolve in 0.007280s
[2021-03-31 18:21:09.538] [driver] [info] [Task Finished] Resolve in 0.007072s
[2021-03-31 18:21:09.545] [driver] [info] [Task Finished] Resolve in 0.007156s
[2021-03-31 18:21:09.553] [driver] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:21:09.560] [driver] [info] [Task Finished] Resolve in 0.007076s
[2021-03-31 18:21:09.567] [driver] [info] [Task Finished] Resolve in 0.007111s
[2021-03-31 18:21:09.574] [driver] [info] [Task Finished] Resolve in 0.007178s
[2021-03-31 18:21:09.581] [driver] [info] [Task Finished] Resolve in 0.007262s
[2021-03-31 18:21:09.588] [driver] [info] [Task Finished] Resolve in 0.007015s
[2021-03-31 18:21:09.596] [driver] [info] [Task Finished] Resolve in 0.007176s
[2021-03-31 18:21:09.603] [driver] [info] [Task Finished] Resolve in 0.007178s
[2021-03-31 18:21:09.610] [driver] [info] [Task Finished] Resolve in 0.007045s
[2021-03-31 18:21:09.617] [driver] [info] [Task Finished] Resolve in 0.007124s
[2021-03-31 18:21:09.624] [driver] [info] [Task Finished] Resolve in 0.007213s
[2021-03-31 18:21:09.631] [driver] [info] [Task Finished] Resolve in 0.007162s
[2021-03-31 18:21:09.638] [driver] [info] [Task Finished] Resolve in 0.007090s
[2021-03-31 18:21:09.646] [driver] [info] [Task Finished] Resolve in 0.007231s
[2021-03-31 18:21:09.653] [driver] [info] [Task Finished] Resolve in 0.007176s
[2021-03-31 18:21:09.660] [driver] [info] [Task Finished] Resolve in 0.007034s
[2021-03-31 18:21:09.667] [driver] [info] [Task Finished] Resolve in 0.007152s
[2021-03-31 18:21:09.674] [driver] [info] [Task Finished] Resolve in 0.007167s
[2021-03-31 18:21:09.681] [driver] [info] [Task Finished] Resolve in 0.007149s
[2021-03-31 18:21:09.689] [driver] [info] [Task Finished] Resolve in 0.007191s
[2021-03-31 18:21:09.696] [driver] [info] [Task Finished] Resolve in 0.007263s
[2021-03-31 18:21:09.703] [driver] [info] [Task Finished] Resolve in 0.007094s
[2021-03-31 18:21:09.710] [driver] [info] [Task Finished] Resolve in 0.007148s
[2021-03-31 18:21:09.717] [driver] [info] [Task Finished] Resolve in 0.007122s
[2021-03-31 18:21:09.724] [driver] [info] [Task Finished] Resolve in 0.007102s
[2021-03-31 18:21:09.732] [driver] [info] [Task Finished] Resolve in 0.007234s
[2021-03-31 18:21:09.739] [driver] [info] [Task Finished] Resolve in 0.007028s
[2021-03-31 18:21:09.746] [driver] [info] [Task Finished] Resolve in 0.007186s
[2021-03-31 18:21:09.753] [driver] [info] [Task Finished] Resolve in 0.007299s
[2021-03-31 18:21:09.760] [driver] [info] [Task Finished] Resolve in 0.007151s
[2021-03-31 18:21:09.767] [driver] [info] [Task Finished] Resolve in 0.006969s
[2021-03-31 18:21:09.775] [driver] [info] [Task Finished] Resolve in 0.007223s
[2021-03-31 18:21:09.782] [driver] [info] [Task Finished] Resolve in 0.007219s
[2021-03-31 18:21:09.789] [driver] [info] [Task Finished] Resolve in 0.006957s
[2021-03-31 18:21:09.796] [driver] [info] [Task Finished] Resolve in 0.007222s
[2021-03-31 18:21:09.803] [driver] [info] [Task Finished] Resolve in 0.007267s
[2021-03-31 18:21:09.810] [driver] [info] [Task Finished] Resolve in 0.007067s
[2021-03-31 18:21:09.817] [driver] [info] [Task Finished] Resolve in 0.007089s
[2021-03-31 18:21:09.825] [driver] [info] [Task Finished] Resolve in 0.007237s
[2021-03-31 18:21:09.832] [driver] [info] [Task Finished] Resolve in 0.007146s
[2021-03-31 18:21:09.839] [driver] [info] [Task Finished] Resolve in 0.006979s
[2021-03-31 18:21:09.846] [driver] [info] [Task Finished] Resolve in 0.007232s
[2021-03-31 18:21:09.853] [driver] [info] [Task Finished] Resolve in 0.007171s
[2021-03-31 18:21:09.861] [driver] [info] [Task Finished] Resolve in 0.007243s
[2021-03-31 18:21:09.868] [driver] [info] [Task Finished] Resolve in 0.007058s
[2021-03-31 18:21:09.875] [driver] [info] [Task Finished] Resolve in 0.007146s
[2021-03-31 18:21:09.882] [driver] [info] [Task Finished] Resolve in 0.007157s
[2021-03-31 18:21:09.889] [driver] [info] [Task Finished] Resolve in 0.007042s
[2021-03-31 18:21:09.896] [driver] [info] [Task Finished] Resolve in 0.007188s
[2021-03-31 18:21:09.903] [driver] [info] [Task Finished] Resolve in 0.007159s
[2021-03-31 18:21:09.911] [driver] [info] [Task Finished] Resolve in 0.007151s
[2021-03-31 18:21:09.918] [driver] [info] [Task Finished] Resolve in 0.007091s
[2021-03-31 18:21:09.925] [driver] [info] [Task Finished] Resolve in 0.007393s
[2021-03-31 18:21:09.932] [driver] [info] [Task Finished] Resolve in 0.007261s
[2021-03-31 18:21:09.939] [driver] [info] [Task Finished] Resolve in 0.006992s
[2021-03-31 18:21:09.946] [driver] [info] [Task Finished] Resolve in 0.007151s
[2021-03-31 18:21:09.954] [driver] [info] [Task Finished] Resolve in 0.007221s
[2021-03-31 18:21:09.961] [driver] [info] [Task Finished] Resolve in 0.007183s
[2021-03-31 18:21:09.968] [driver] [info] [Task Finished] Resolve in 0.007083s
[2021-03-31 18:21:09.975] [driver] [info] [Task Finished] Resolve in 0.007222s
[2021-03-31 18:21:09.982] [driver] [info] [Task Finished] Resolve in 0.007182s
[2021-03-31 18:21:09.989] [driver] [info] [Task Finished] Resolve in 0.006962s
[2021-03-31 18:21:09.997] [driver] [info] [Task Finished] Resolve in 0.007252s
[2021-03-31 18:21:10.004] [driver] [info] [Task Finished] Resolve in 0.007184s
[2021-03-31 18:21:10.011] [driver] [info] [Task Finished] Resolve in 0.007101s
[2021-03-31 18:21:10.018] [driver] [info] [Task Finished] Resolve in 0.007066s
[2021-03-31 18:21:10.026] [driver] [info] [Task Finished] Resolve in 0.007677s
[2021-03-31 18:21:10.033] [driver] [info] [Task Finished] Resolve in 0.007687s
[2021-03-31 18:21:10.041] [driver] [info] [Task Finished] Resolve in 0.007860s
[2021-03-31 18:21:10.049] [driver] [info] [Task Finished] Resolve in 0.007762s
[2021-03-31 18:21:10.057] [driver] [info] [Task Finished] Resolve in 0.007715s
[2021-03-31 18:21:10.064] [driver] [info] [Task Finished] Resolve in 0.007480s
[2021-03-31 18:21:10.072] [driver] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:21:10.079] [driver] [info] [Task Finished] Resolve in 0.007062s
[2021-03-31 18:21:10.086] [driver] [info] [Task Finished] Resolve in 0.007219s
[2021-03-31 18:21:10.093] [driver] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:21:10.100] [driver] [info] [Task Finished] Resolve in 0.007047s
[2021-03-31 18:21:10.107] [driver] [info] [Task Finished] Resolve in 0.007092s
[2021-03-31 18:21:10.114] [driver] [info] [Task Finished] Resolve in 0.007190s
[2021-03-31 18:21:10.122] [driver] [info] [Task Finished] Resolve in 0.007157s
[2021-03-31 18:21:10.129] [driver] [info] [Task Finished] Resolve in 0.007009s
[2021-03-31 18:21:10.136] [driver] [info] [Task Finished] Resolve in 0.007244s
[2021-03-31 18:21:10.143] [driver] [info] [Task Finished] Resolve in 0.007145s
[2021-03-31 18:21:10.150] [driver] [info] [Task Finished] Resolve in 0.007076s
[2021-03-31 18:21:10.157] [driver] [info] [Task Finished] Resolve in 0.007137s
[2021-03-31 18:21:10.164] [driver] [info] [Task Finished] Resolve in 0.007158s
[2021-03-31 18:21:10.172] [driver] [info] [Task Finished] Resolve in 0.007158s
[2021-03-31 18:21:10.179] [driver] [info] [Task Finished] Resolve in 0.007023s
[2021-03-31 18:21:10.186] [driver] [info] [Task Finished] Resolve in 0.007323s
[2021-03-31 18:21:10.193] [driver] [info] [Task Finished] Resolve in 0.007163s
[2021-03-31 18:21:10.200] [driver] [info] [Task Finished] Resolve in 0.007137s
[2021-03-31 18:21:10.207] [driver] [info] [Task Finished] Resolve in 0.007063s
[2021-03-31 18:21:10.215] [driver] [info] [Task Finished] Resolve in 0.007140s
[2021-03-31 18:21:10.222] [driver] [info] [Task Finished] Resolve in 0.007217s
[2021-03-31 18:21:10.229] [driver] [info] [Task Finished] Resolve in 0.007008s
[2021-03-31 18:21:10.236] [driver] [info] [Task Finished] Resolve in 0.007206s
[2021-03-31 18:21:10.243] [driver] [info] [Task Finished] Resolve in 0.007241s
[2021-03-31 18:21:10.250] [driver] [info] [Task Finished] Resolve in 0.007124s
[2021-03-31 18:21:10.257] [driver] [info] [Task Finished] Resolve in 0.007009s
[2021-03-31 18:21:10.265] [driver] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:21:10.272] [driver] [info] [Task Finished] Resolve in 0.007221s
[2021-03-31 18:21:10.279] [driver] [info] [Task Finished] Resolve in 0.006921s
[2021-03-31 18:21:10.286] [driver] [info] [Task Finished] Resolve in 0.007251s
[2021-03-31 18:21:10.293] [driver] [info] [Task Finished] Resolve in 0.007239s
[2021-03-31 18:21:10.302] [driver] [info] [Task Finished] Resolve in 0.008399s
[2021-03-31 18:21:10.302] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 1.15541s
[2021-03-31 18:21:10.302] [local ee] [info] slow path for Stage 0: total wall clock time: 1.14818s, time to process 1 row via slow path: 0.000716455ms
[2021-03-31 18:21:10.302] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.15544s

[2021-03-31 18:21:10.339] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2021-03-31 18:21:10.789] [driver] [info] [Task Finished] write to file in 0.449376s (2264570 rows, 344.74 MB)
[2021-03-31 18:21:10.789] [global] [info] writing output took 0.486849s
[2021-03-31 18:21:10.789] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.486932s
[2021-03-31 18:21:10.789] [global] [info] [Transform Stage] Stage 0 took 42.3077s
[2021-03-31 18:21:10.789] [global] [info] Query Execution took 42.4049s. (planning: 0.0971716s, execution: 42.3077s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 05:47:10) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.005076169967651367
Tuplex job time: 42.66843938827515 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '6bcf8f6a24af', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.019681,"llvm_optimization_time_s":0.294747,"llvm_compilation_time_s":0.134455,"total_compilation_time_s":0.444653,"sampling_time_s":0.108927,"stages":[{"stage_no":0,"fast_path_wall_time_s":40.2179,"fast_path_time_s":40.2207,"fast_path_per_row_time_ns":743.284,"slow_path_wall_time_s":1.14818,"slow_path_time_s":1.15541,"slow_path_per_row_time_ns":716.455}]}
{"startupTime": 0.005076169967651367, "jobTime": 42.66843938827515}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 321 active partitions
