[2021-03-31 18:18:17.074] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:18:17.074] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:18:17.074] [local ee] [info] initializing LLVM backend
[2021-03-31 18:18:17.074] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:18:17.074] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:18:17.075] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-31 18:18:17.075] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:18:17.075] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 18:18:17.076] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2021-03-31 18:18:17.207] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.223] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.231] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.257] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.276] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.289] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.320] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.337] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:18:17.339] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:18:17.341] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:18:17.344] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:18:17.359] [logical planner] [info] logical optimization took 0.019694ms
[2021-03-31 18:18:17.360] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.363] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.367] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.371] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.373] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.375] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.377] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:18:17.385] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:18:17.386] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,f64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:18:17.386] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2021-03-31 18:18:17.386] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2021-03-31 18:18:17.387] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2021-03-31 18:18:17.388] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2021-03-31 18:18:17.388] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2021-03-31 18:18:17.389] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2021-03-31 18:18:17.389] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:18:17.390] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2021-03-31 18:18:17.391] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2021-03-31 18:18:17.392] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2021-03-31 18:18:17.393] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:18:17.394] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:18:17.394] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:18:17.395] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2021-03-31 18:18:17.396] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:18:17.397] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:18:17.397] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:18:17.398] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:18:17.398] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:18:17.399] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:18:17.400] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 18:18:17.401] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 18:18:17.402] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 18:18:17.402] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:18:17.403] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:18:17.404] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:18:17.405] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 18:18:17.434] [global] [info] Stage0 depends on: 
[2021-03-31 18:18:17.744] [global] [info] Optimization via LLVM passes took 0.294569 ms
[2021-03-31 18:18:17.878] [global] [info] Compiled code paths for stage 0 in 0.13 ms
[2021-03-31 18:18:17.879] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.444244s
[2021-03-31 18:18:17.879] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2021-03-31 18:18:18.132] [driver] [info] [Task Finished] Transform to mem in 0.253092s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:18:18.382] [driver] [info] [Task Finished] Transform to mem in 0.250285s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:18:18.632] [driver] [info] [Task Finished] Transform to mem in 0.249565s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:18:18.885] [driver] [info] [Task Finished] Transform to mem in 0.253568s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:18:19.136] [driver] [info] [Task Finished] Transform to mem in 0.250786s (14217 normal rows, 10015 exceptions)
[2021-03-31 18:18:19.386] [driver] [info] [Task Finished] Transform to mem in 0.249800s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:18:19.637] [driver] [info] [Task Finished] Transform to mem in 0.250657s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:18:19.887] [driver] [info] [Task Finished] Transform to mem in 0.250070s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:18:20.136] [driver] [info] [Task Finished] Transform to mem in 0.249607s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:18:20.387] [driver] [info] [Task Finished] Transform to mem in 0.250299s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:18:20.640] [driver] [info] [Task Finished] Transform to mem in 0.253149s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:18:20.889] [driver] [info] [Task Finished] Transform to mem in 0.249252s (13988 normal rows, 9938 exceptions)
[2021-03-31 18:18:21.143] [driver] [info] [Task Finished] Transform to mem in 0.253722s (14177 normal rows, 10036 exceptions)
[2021-03-31 18:18:21.393] [driver] [info] [Task Finished] Transform to mem in 0.249810s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:18:21.643] [driver] [info] [Task Finished] Transform to mem in 0.249871s (14020 normal rows, 9982 exceptions)
[2021-03-31 18:18:21.893] [driver] [info] [Task Finished] Transform to mem in 0.250272s (14162 normal rows, 9952 exceptions)
[2021-03-31 18:18:22.143] [driver] [info] [Task Finished] Transform to mem in 0.250591s (14241 normal rows, 10100 exceptions)
[2021-03-31 18:18:22.393] [driver] [info] [Task Finished] Transform to mem in 0.249905s (14059 normal rows, 9985 exceptions)
[2021-03-31 18:18:22.644] [driver] [info] [Task Finished] Transform to mem in 0.250117s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:18:22.894] [driver] [info] [Task Finished] Transform to mem in 0.250082s (14238 normal rows, 10030 exceptions)
[2021-03-31 18:18:23.144] [driver] [info] [Task Finished] Transform to mem in 0.249863s (14081 normal rows, 9995 exceptions)
[2021-03-31 18:18:23.394] [driver] [info] [Task Finished] Transform to mem in 0.250125s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:18:23.644] [driver] [info] [Task Finished] Transform to mem in 0.250032s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:18:23.893] [driver] [info] [Task Finished] Transform to mem in 0.249792s (14086 normal rows, 9989 exceptions)
[2021-03-31 18:18:24.144] [driver] [info] [Task Finished] Transform to mem in 0.249994s (14097 normal rows, 10002 exceptions)
[2021-03-31 18:18:24.397] [driver] [info] [Task Finished] Transform to mem in 0.253140s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:18:24.647] [driver] [info] [Task Finished] Transform to mem in 0.250204s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:18:24.900] [driver] [info] [Task Finished] Transform to mem in 0.252886s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:18:25.150] [driver] [info] [Task Finished] Transform to mem in 0.250252s (14212 normal rows, 10032 exceptions)
[2021-03-31 18:18:25.400] [driver] [info] [Task Finished] Transform to mem in 0.249552s (14099 normal rows, 10008 exceptions)
[2021-03-31 18:18:25.650] [driver] [info] [Task Finished] Transform to mem in 0.250229s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:18:25.900] [driver] [info] [Task Finished] Transform to mem in 0.250022s (14223 normal rows, 10035 exceptions)
[2021-03-31 18:18:26.150] [driver] [info] [Task Finished] Transform to mem in 0.249814s (14089 normal rows, 10008 exceptions)
[2021-03-31 18:18:26.400] [driver] [info] [Task Finished] Transform to mem in 0.249936s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:18:26.650] [driver] [info] [Task Finished] Transform to mem in 0.250482s (14235 normal rows, 10062 exceptions)
[2021-03-31 18:18:26.900] [driver] [info] [Task Finished] Transform to mem in 0.249804s (14170 normal rows, 9994 exceptions)
[2021-03-31 18:18:27.150] [driver] [info] [Task Finished] Transform to mem in 0.249897s (14002 normal rows, 9940 exceptions)
[2021-03-31 18:18:27.400] [driver] [info] [Task Finished] Transform to mem in 0.250422s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:18:27.650] [driver] [info] [Task Finished] Transform to mem in 0.249819s (14206 normal rows, 9991 exceptions)
[2021-03-31 18:18:27.902] [driver] [info] [Task Finished] Transform to mem in 0.251678s (13961 normal rows, 9925 exceptions)
[2021-03-31 18:18:28.154] [driver] [info] [Task Finished] Transform to mem in 0.251895s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:18:28.407] [driver] [info] [Task Finished] Transform to mem in 0.253186s (14233 normal rows, 10011 exceptions)
[2021-03-31 18:18:28.656] [driver] [info] [Task Finished] Transform to mem in 0.249473s (13915 normal rows, 9900 exceptions)
[2021-03-31 18:18:28.907] [driver] [info] [Task Finished] Transform to mem in 0.250248s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:18:29.157] [driver] [info] [Task Finished] Transform to mem in 0.250482s (14267 normal rows, 10030 exceptions)
[2021-03-31 18:18:29.406] [driver] [info] [Task Finished] Transform to mem in 0.249245s (13892 normal rows, 9882 exceptions)
[2021-03-31 18:18:29.657] [driver] [info] [Task Finished] Transform to mem in 0.250639s (14245 normal rows, 10101 exceptions)
[2021-03-31 18:18:29.907] [driver] [info] [Task Finished] Transform to mem in 0.249845s (14260 normal rows, 10025 exceptions)
[2021-03-31 18:18:30.157] [driver] [info] [Task Finished] Transform to mem in 0.249989s (13978 normal rows, 9907 exceptions)
[2021-03-31 18:18:30.407] [driver] [info] [Task Finished] Transform to mem in 0.250431s (14181 normal rows, 10067 exceptions)
[2021-03-31 18:18:30.657] [driver] [info] [Task Finished] Transform to mem in 0.249989s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:18:30.908] [driver] [info] [Task Finished] Transform to mem in 0.250123s (14015 normal rows, 9982 exceptions)
[2021-03-31 18:18:31.158] [driver] [info] [Task Finished] Transform to mem in 0.250204s (14142 normal rows, 9989 exceptions)
[2021-03-31 18:18:31.408] [driver] [info] [Task Finished] Transform to mem in 0.250067s (14280 normal rows, 10094 exceptions)
[2021-03-31 18:18:31.661] [driver] [info] [Task Finished] Transform to mem in 0.252890s (13982 normal rows, 9975 exceptions)
[2021-03-31 18:18:31.911] [driver] [info] [Task Finished] Transform to mem in 0.249970s (14173 normal rows, 10006 exceptions)
[2021-03-31 18:18:32.164] [driver] [info] [Task Finished] Transform to mem in 0.253448s (14235 normal rows, 10040 exceptions)
[2021-03-31 18:18:32.414] [driver] [info] [Task Finished] Transform to mem in 0.249628s (14054 normal rows, 9984 exceptions)
[2021-03-31 18:18:32.664] [driver] [info] [Task Finished] Transform to mem in 0.250174s (14129 normal rows, 10004 exceptions)
[2021-03-31 18:18:32.914] [driver] [info] [Task Finished] Transform to mem in 0.249935s (14223 normal rows, 10033 exceptions)
[2021-03-31 18:18:33.164] [driver] [info] [Task Finished] Transform to mem in 0.250025s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:18:33.414] [driver] [info] [Task Finished] Transform to mem in 0.250000s (14108 normal rows, 10010 exceptions)
[2021-03-31 18:18:33.664] [driver] [info] [Task Finished] Transform to mem in 0.250152s (14208 normal rows, 10008 exceptions)
[2021-03-31 18:18:33.914] [driver] [info] [Task Finished] Transform to mem in 0.249717s (14089 normal rows, 10031 exceptions)
[2021-03-31 18:18:34.164] [driver] [info] [Task Finished] Transform to mem in 0.250087s (14094 normal rows, 9960 exceptions)
[2021-03-31 18:18:34.414] [driver] [info] [Task Finished] Transform to mem in 0.249991s (14232 normal rows, 10017 exceptions)
[2021-03-31 18:18:34.664] [driver] [info] [Task Finished] Transform to mem in 0.249891s (14088 normal rows, 10027 exceptions)
[2021-03-31 18:18:34.916] [driver] [info] [Task Finished] Transform to mem in 0.251967s (14106 normal rows, 9955 exceptions)
[2021-03-31 18:18:35.166] [driver] [info] [Task Finished] Transform to mem in 0.250086s (14211 normal rows, 10043 exceptions)
[2021-03-31 18:18:35.419] [driver] [info] [Task Finished] Transform to mem in 0.252645s (14113 normal rows, 9997 exceptions)
[2021-03-31 18:18:35.668] [driver] [info] [Task Finished] Transform to mem in 0.249607s (14075 normal rows, 9965 exceptions)
[2021-03-31 18:18:35.922] [driver] [info] [Task Finished] Transform to mem in 0.253495s (14223 normal rows, 10049 exceptions)
[2021-03-31 18:18:36.171] [driver] [info] [Task Finished] Transform to mem in 0.249591s (14095 normal rows, 9995 exceptions)
[2021-03-31 18:18:36.421] [driver] [info] [Task Finished] Transform to mem in 0.249885s (14086 normal rows, 9952 exceptions)
[2021-03-31 18:18:36.672] [driver] [info] [Task Finished] Transform to mem in 0.250332s (14226 normal rows, 10069 exceptions)
[2021-03-31 18:18:36.921] [driver] [info] [Task Finished] Transform to mem in 0.249639s (14170 normal rows, 9996 exceptions)
[2021-03-31 18:18:37.171] [driver] [info] [Task Finished] Transform to mem in 0.249695s (14002 normal rows, 9931 exceptions)
[2021-03-31 18:18:37.421] [driver] [info] [Task Finished] Transform to mem in 0.250213s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:18:37.671] [driver] [info] [Task Finished] Transform to mem in 0.250044s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:18:37.921] [driver] [info] [Task Finished] Transform to mem in 0.249361s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:18:38.172] [driver] [info] [Task Finished] Transform to mem in 0.250845s (14237 normal rows, 10084 exceptions)
[2021-03-31 18:18:38.422] [driver] [info] [Task Finished] Transform to mem in 0.249875s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:18:38.671] [driver] [info] [Task Finished] Transform to mem in 0.249457s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:18:38.921] [driver] [info] [Task Finished] Transform to mem in 0.250395s (14267 normal rows, 10099 exceptions)
[2021-03-31 18:18:39.175] [driver] [info] [Task Finished] Transform to mem in 0.253105s (14248 normal rows, 10030 exceptions)
[2021-03-31 18:18:39.427] [driver] [info] [Task Finished] Transform to mem in 0.252657s (13912 normal rows, 9882 exceptions)
[2021-03-31 18:18:39.678] [driver] [info] [Task Finished] Transform to mem in 0.250481s (14248 normal rows, 10094 exceptions)
[2021-03-31 18:18:39.928] [driver] [info] [Task Finished] Transform to mem in 0.249977s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:18:40.177] [driver] [info] [Task Finished] Transform to mem in 0.249598s (13988 normal rows, 9922 exceptions)
[2021-03-31 18:18:40.428] [driver] [info] [Task Finished] Transform to mem in 0.250297s (14171 normal rows, 10052 exceptions)
[2021-03-31 18:18:40.678] [driver] [info] [Task Finished] Transform to mem in 0.249955s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:18:40.927] [driver] [info] [Task Finished] Transform to mem in 0.249640s (14015 normal rows, 9985 exceptions)
[2021-03-31 18:18:41.178] [driver] [info] [Task Finished] Transform to mem in 0.250611s (14176 normal rows, 9997 exceptions)
[2021-03-31 18:18:41.428] [driver] [info] [Task Finished] Transform to mem in 0.249986s (14246 normal rows, 10108 exceptions)
[2021-03-31 18:18:41.678] [driver] [info] [Task Finished] Transform to mem in 0.249881s (14059 normal rows, 9978 exceptions)
[2021-03-31 18:18:41.928] [driver] [info] [Task Finished] Transform to mem in 0.250115s (14114 normal rows, 10011 exceptions)
[2021-03-31 18:18:42.178] [driver] [info] [Task Finished] Transform to mem in 0.250136s (14238 normal rows, 10007 exceptions)
[2021-03-31 18:18:42.428] [driver] [info] [Task Finished] Transform to mem in 0.249583s (14081 normal rows, 10003 exceptions)
[2021-03-31 18:18:42.681] [driver] [info] [Task Finished] Transform to mem in 0.253501s (14095 normal rows, 10024 exceptions)
[2021-03-31 18:18:42.931] [driver] [info] [Task Finished] Transform to mem in 0.249722s (14221 normal rows, 9998 exceptions)
[2021-03-31 18:18:43.184] [driver] [info] [Task Finished] Transform to mem in 0.253077s (14086 normal rows, 9998 exceptions)
[2021-03-31 18:18:43.434] [driver] [info] [Task Finished] Transform to mem in 0.249997s (14091 normal rows, 10001 exceptions)
[2021-03-31 18:18:43.684] [driver] [info] [Task Finished] Transform to mem in 0.250385s (14218 normal rows, 10016 exceptions)
[2021-03-31 18:18:43.934] [driver] [info] [Task Finished] Transform to mem in 0.249879s (14095 normal rows, 10026 exceptions)
[2021-03-31 18:18:44.184] [driver] [info] [Task Finished] Transform to mem in 0.249980s (14113 normal rows, 9960 exceptions)
[2021-03-31 18:18:44.434] [driver] [info] [Task Finished] Transform to mem in 0.250148s (14197 normal rows, 10028 exceptions)
[2021-03-31 18:18:44.684] [driver] [info] [Task Finished] Transform to mem in 0.249783s (14114 normal rows, 10012 exceptions)
[2021-03-31 18:18:44.934] [driver] [info] [Task Finished] Transform to mem in 0.249900s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:18:45.185] [driver] [info] [Task Finished] Transform to mem in 0.250401s (14197 normal rows, 10033 exceptions)
[2021-03-31 18:18:45.434] [driver] [info] [Task Finished] Transform to mem in 0.249696s (14115 normal rows, 10010 exceptions)
[2021-03-31 18:18:45.684] [driver] [info] [Task Finished] Transform to mem in 0.249868s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:18:45.934] [driver] [info] [Task Finished] Transform to mem in 0.250233s (14235 normal rows, 10048 exceptions)
[2021-03-31 18:18:46.184] [driver] [info] [Task Finished] Transform to mem in 0.249683s (14144 normal rows, 9995 exceptions)
[2021-03-31 18:18:46.433] [driver] [info] [Task Finished] Transform to mem in 0.249367s (14015 normal rows, 9952 exceptions)
[2021-03-31 18:18:46.684] [driver] [info] [Task Finished] Transform to mem in 0.250555s (14237 normal rows, 10069 exceptions)
[2021-03-31 18:18:46.937] [driver] [info] [Task Finished] Transform to mem in 0.252921s (14159 normal rows, 9996 exceptions)
[2021-03-31 18:18:47.187] [driver] [info] [Task Finished] Transform to mem in 0.249785s (14010 normal rows, 9932 exceptions)
[2021-03-31 18:18:47.437] [driver] [info] [Task Finished] Transform to mem in 0.250369s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:18:47.687] [driver] [info] [Task Finished] Transform to mem in 0.249926s (14178 normal rows, 10009 exceptions)
[2021-03-31 18:18:47.937] [driver] [info] [Task Finished] Transform to mem in 0.249579s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:18:48.187] [driver] [info] [Task Finished] Transform to mem in 0.250510s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:18:48.437] [driver] [info] [Task Finished] Transform to mem in 0.250038s (14236 normal rows, 10015 exceptions)
[2021-03-31 18:18:48.687] [driver] [info] [Task Finished] Transform to mem in 0.249277s (13901 normal rows, 9892 exceptions)
[2021-03-31 18:18:48.939] [driver] [info] [Task Finished] Transform to mem in 0.252116s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:18:49.189] [driver] [info] [Task Finished] Transform to mem in 0.250117s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:18:49.438] [driver] [info] [Task Finished] Transform to mem in 0.249418s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:18:49.689] [driver] [info] [Task Finished] Transform to mem in 0.250432s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:18:49.939] [driver] [info] [Task Finished] Transform to mem in 0.249782s (14245 normal rows, 10024 exceptions)
[2021-03-31 18:18:50.192] [driver] [info] [Task Finished] Transform to mem in 0.253022s (13999 normal rows, 9935 exceptions)
[2021-03-31 18:18:50.445] [driver] [info] [Task Finished] Transform to mem in 0.253531s (14158 normal rows, 10036 exceptions)
[2021-03-31 18:18:50.695] [driver] [info] [Task Finished] Transform to mem in 0.250348s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:18:50.945] [driver] [info] [Task Finished] Transform to mem in 0.249528s (14020 normal rows, 9989 exceptions)
[2021-03-31 18:18:51.196] [driver] [info] [Task Finished] Transform to mem in 0.250485s (14173 normal rows, 10004 exceptions)
[2021-03-31 18:18:51.446] [driver] [info] [Task Finished] Transform to mem in 0.250043s (14235 normal rows, 10041 exceptions)
[2021-03-31 18:18:51.695] [driver] [info] [Task Finished] Transform to mem in 0.249862s (14054 normal rows, 9985 exceptions)
[2021-03-31 18:18:51.946] [driver] [info] [Task Finished] Transform to mem in 0.250192s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:18:52.196] [driver] [info] [Task Finished] Transform to mem in 0.250280s (14238 normal rows, 10033 exceptions)
[2021-03-31 18:18:52.446] [driver] [info] [Task Finished] Transform to mem in 0.249742s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:18:52.696] [driver] [info] [Task Finished] Transform to mem in 0.249986s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:18:52.946] [driver] [info] [Task Finished] Transform to mem in 0.250098s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:18:53.196] [driver] [info] [Task Finished] Transform to mem in 0.249990s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:18:53.446] [driver] [info] [Task Finished] Transform to mem in 0.249966s (14094 normal rows, 9996 exceptions)
[2021-03-31 18:18:53.696] [driver] [info] [Task Finished] Transform to mem in 0.249887s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:18:53.945] [driver] [info] [Task Finished] Transform to mem in 0.249711s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:18:54.199] [driver] [info] [Task Finished] Transform to mem in 0.253507s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:18:54.449] [driver] [info] [Task Finished] Transform to mem in 0.250139s (14217 normal rows, 10042 exceptions)
[2021-03-31 18:18:54.699] [driver] [info] [Task Finished] Transform to mem in 0.249769s (14094 normal rows, 9998 exceptions)
[2021-03-31 18:18:54.949] [driver] [info] [Task Finished] Transform to mem in 0.250039s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:18:55.200] [driver] [info] [Task Finished] Transform to mem in 0.250619s (14223 normal rows, 10048 exceptions)
[2021-03-31 18:18:55.449] [driver] [info] [Task Finished] Transform to mem in 0.249531s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:18:55.699] [driver] [info] [Task Finished] Transform to mem in 0.250168s (14086 normal rows, 9953 exceptions)
[2021-03-31 18:18:55.950] [driver] [info] [Task Finished] Transform to mem in 0.250438s (14232 normal rows, 10069 exceptions)
[2021-03-31 18:18:56.199] [driver] [info] [Task Finished] Transform to mem in 0.249641s (14170 normal rows, 9995 exceptions)
[2021-03-31 18:18:56.449] [driver] [info] [Task Finished] Transform to mem in 0.249631s (14002 normal rows, 9932 exceptions)
[2021-03-31 18:18:56.700] [driver] [info] [Task Finished] Transform to mem in 0.250557s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:18:56.949] [driver] [info] [Task Finished] Transform to mem in 0.249769s (14206 normal rows, 10009 exceptions)
[2021-03-31 18:18:57.199] [driver] [info] [Task Finished] Transform to mem in 0.249423s (13961 normal rows, 9907 exceptions)
[2021-03-31 18:18:57.451] [driver] [info] [Task Finished] Transform to mem in 0.251948s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:18:57.702] [driver] [info] [Task Finished] Transform to mem in 0.251486s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:18:57.997] [driver] [info] [Task Finished] Transform to mem in 0.294411s (16320 normal rows, 11605 exceptions)
[2021-03-31 18:18:57.997] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 40.1183s
[2021-03-31 18:18:57.997] [global] [info] [Transform Stage] Stage 0 total wall clock time: 40.1155s, 54108450 input rows, time to process 1 row via fast path: 0.000741391ms
[2021-03-31 18:18:57.997] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2021-03-31 18:18:58.001] [local ee] [info] compiled pure python pipeline in 0.003911s
[2021-03-31 18:18:58.001] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 18:18:58.002] [local ee] [info] Created 160 resolve tasks in 0.001146s
[2021-03-31 18:18:58.002] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 18:18:58.009] [driver] [info] [Task Finished] Resolve in 0.007038s
[2021-03-31 18:18:58.016] [driver] [info] [Task Finished] Resolve in 0.007269s
[2021-03-31 18:18:58.024] [driver] [info] [Task Finished] Resolve in 0.007154s
[2021-03-31 18:18:58.031] [driver] [info] [Task Finished] Resolve in 0.007256s
[2021-03-31 18:18:58.038] [driver] [info] [Task Finished] Resolve in 0.007214s
[2021-03-31 18:18:58.045] [driver] [info] [Task Finished] Resolve in 0.007134s
[2021-03-31 18:18:58.052] [driver] [info] [Task Finished] Resolve in 0.007273s
[2021-03-31 18:18:58.060] [driver] [info] [Task Finished] Resolve in 0.007128s
[2021-03-31 18:18:58.067] [driver] [info] [Task Finished] Resolve in 0.007093s
[2021-03-31 18:18:58.074] [driver] [info] [Task Finished] Resolve in 0.007254s
[2021-03-31 18:18:58.081] [driver] [info] [Task Finished] Resolve in 0.007262s
[2021-03-31 18:18:58.088] [driver] [info] [Task Finished] Resolve in 0.006995s
[2021-03-31 18:18:58.096] [driver] [info] [Task Finished] Resolve in 0.007330s
[2021-03-31 18:18:58.103] [driver] [info] [Task Finished] Resolve in 0.007258s
[2021-03-31 18:18:58.110] [driver] [info] [Task Finished] Resolve in 0.007094s
[2021-03-31 18:18:58.117] [driver] [info] [Task Finished] Resolve in 0.007148s
[2021-03-31 18:18:58.124] [driver] [info] [Task Finished] Resolve in 0.007271s
[2021-03-31 18:18:58.132] [driver] [info] [Task Finished] Resolve in 0.007201s
[2021-03-31 18:18:58.139] [driver] [info] [Task Finished] Resolve in 0.007023s
[2021-03-31 18:18:58.146] [driver] [info] [Task Finished] Resolve in 0.007414s
[2021-03-31 18:18:58.153] [driver] [info] [Task Finished] Resolve in 0.007197s
[2021-03-31 18:18:58.160] [driver] [info] [Task Finished] Resolve in 0.007172s
[2021-03-31 18:18:58.168] [driver] [info] [Task Finished] Resolve in 0.007097s
[2021-03-31 18:18:58.175] [driver] [info] [Task Finished] Resolve in 0.007202s
[2021-03-31 18:18:58.182] [driver] [info] [Task Finished] Resolve in 0.007207s
[2021-03-31 18:18:58.189] [driver] [info] [Task Finished] Resolve in 0.007073s
[2021-03-31 18:18:58.196] [driver] [info] [Task Finished] Resolve in 0.007226s
[2021-03-31 18:18:58.204] [driver] [info] [Task Finished] Resolve in 0.007282s
[2021-03-31 18:18:58.211] [driver] [info] [Task Finished] Resolve in 0.007227s
[2021-03-31 18:18:58.218] [driver] [info] [Task Finished] Resolve in 0.007037s
[2021-03-31 18:18:58.225] [driver] [info] [Task Finished] Resolve in 0.007213s
[2021-03-31 18:18:58.232] [driver] [info] [Task Finished] Resolve in 0.007239s
[2021-03-31 18:18:58.239] [driver] [info] [Task Finished] Resolve in 0.007038s
[2021-03-31 18:18:58.247] [driver] [info] [Task Finished] Resolve in 0.007177s
[2021-03-31 18:18:58.254] [driver] [info] [Task Finished] Resolve in 0.007333s
[2021-03-31 18:18:58.261] [driver] [info] [Task Finished] Resolve in 0.007313s
[2021-03-31 18:18:58.268] [driver] [info] [Task Finished] Resolve in 0.007010s
[2021-03-31 18:18:58.276] [driver] [info] [Task Finished] Resolve in 0.007289s
[2021-03-31 18:18:58.283] [driver] [info] [Task Finished] Resolve in 0.007223s
[2021-03-31 18:18:58.290] [driver] [info] [Task Finished] Resolve in 0.007063s
[2021-03-31 18:18:58.297] [driver] [info] [Task Finished] Resolve in 0.007192s
[2021-03-31 18:18:58.304] [driver] [info] [Task Finished] Resolve in 0.007246s
[2021-03-31 18:18:58.312] [driver] [info] [Task Finished] Resolve in 0.007227s
[2021-03-31 18:18:58.319] [driver] [info] [Task Finished] Resolve in 0.007081s
[2021-03-31 18:18:58.326] [driver] [info] [Task Finished] Resolve in 0.007293s
[2021-03-31 18:18:58.333] [driver] [info] [Task Finished] Resolve in 0.007114s
[2021-03-31 18:18:58.340] [driver] [info] [Task Finished] Resolve in 0.007228s
[2021-03-31 18:18:58.348] [driver] [info] [Task Finished] Resolve in 0.007142s
[2021-03-31 18:18:58.355] [driver] [info] [Task Finished] Resolve in 0.007160s
[2021-03-31 18:18:58.362] [driver] [info] [Task Finished] Resolve in 0.007246s
[2021-03-31 18:18:58.369] [driver] [info] [Task Finished] Resolve in 0.007230s
[2021-03-31 18:18:58.376] [driver] [info] [Task Finished] Resolve in 0.007212s
[2021-03-31 18:18:58.384] [driver] [info] [Task Finished] Resolve in 0.007221s
[2021-03-31 18:18:58.391] [driver] [info] [Task Finished] Resolve in 0.007283s
[2021-03-31 18:18:58.398] [driver] [info] [Task Finished] Resolve in 0.007000s
[2021-03-31 18:18:58.405] [driver] [info] [Task Finished] Resolve in 0.007250s
[2021-03-31 18:18:58.413] [driver] [info] [Task Finished] Resolve in 0.007270s
[2021-03-31 18:18:58.420] [driver] [info] [Task Finished] Resolve in 0.007190s
[2021-03-31 18:18:58.427] [driver] [info] [Task Finished] Resolve in 0.007159s
[2021-03-31 18:18:58.434] [driver] [info] [Task Finished] Resolve in 0.007267s
[2021-03-31 18:18:58.441] [driver] [info] [Task Finished] Resolve in 0.007209s
[2021-03-31 18:18:58.448] [driver] [info] [Task Finished] Resolve in 0.007040s
[2021-03-31 18:18:58.456] [driver] [info] [Task Finished] Resolve in 0.007262s
[2021-03-31 18:18:58.463] [driver] [info] [Task Finished] Resolve in 0.007207s
[2021-03-31 18:18:58.470] [driver] [info] [Task Finished] Resolve in 0.007133s
[2021-03-31 18:18:58.477] [driver] [info] [Task Finished] Resolve in 0.007291s
[2021-03-31 18:18:58.485] [driver] [info] [Task Finished] Resolve in 0.007212s
[2021-03-31 18:18:58.492] [driver] [info] [Task Finished] Resolve in 0.007189s
[2021-03-31 18:18:58.499] [driver] [info] [Task Finished] Resolve in 0.007072s
[2021-03-31 18:18:58.506] [driver] [info] [Task Finished] Resolve in 0.007230s
[2021-03-31 18:18:58.513] [driver] [info] [Task Finished] Resolve in 0.007197s
[2021-03-31 18:18:58.521] [driver] [info] [Task Finished] Resolve in 0.007256s
[2021-03-31 18:18:58.528] [driver] [info] [Task Finished] Resolve in 0.007029s
[2021-03-31 18:18:58.535] [driver] [info] [Task Finished] Resolve in 0.007318s
[2021-03-31 18:18:58.542] [driver] [info] [Task Finished] Resolve in 0.007263s
[2021-03-31 18:18:58.549] [driver] [info] [Task Finished] Resolve in 0.007065s
[2021-03-31 18:18:58.557] [driver] [info] [Task Finished] Resolve in 0.007178s
[2021-03-31 18:18:58.564] [driver] [info] [Task Finished] Resolve in 0.007256s
[2021-03-31 18:18:58.571] [driver] [info] [Task Finished] Resolve in 0.007221s
[2021-03-31 18:18:58.578] [driver] [info] [Task Finished] Resolve in 0.006974s
[2021-03-31 18:18:58.585] [driver] [info] [Task Finished] Resolve in 0.007401s
[2021-03-31 18:18:58.593] [driver] [info] [Task Finished] Resolve in 0.007281s
[2021-03-31 18:18:58.600] [driver] [info] [Task Finished] Resolve in 0.006999s
[2021-03-31 18:18:58.607] [driver] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:18:58.614] [driver] [info] [Task Finished] Resolve in 0.007261s
[2021-03-31 18:18:58.621] [driver] [info] [Task Finished] Resolve in 0.007132s
[2021-03-31 18:18:58.628] [driver] [info] [Task Finished] Resolve in 0.007104s
[2021-03-31 18:18:58.636] [driver] [info] [Task Finished] Resolve in 0.007267s
[2021-03-31 18:18:58.643] [driver] [info] [Task Finished] Resolve in 0.007284s
[2021-03-31 18:18:58.650] [driver] [info] [Task Finished] Resolve in 0.007191s
[2021-03-31 18:18:58.657] [driver] [info] [Task Finished] Resolve in 0.007156s
[2021-03-31 18:18:58.665] [driver] [info] [Task Finished] Resolve in 0.007196s
[2021-03-31 18:18:58.672] [driver] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:18:58.679] [driver] [info] [Task Finished] Resolve in 0.007092s
[2021-03-31 18:18:58.686] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:18:58.694] [driver] [info] [Task Finished] Resolve in 0.007284s
[2021-03-31 18:18:58.701] [driver] [info] [Task Finished] Resolve in 0.007319s
[2021-03-31 18:18:58.708] [driver] [info] [Task Finished] Resolve in 0.007030s
[2021-03-31 18:18:58.715] [driver] [info] [Task Finished] Resolve in 0.007201s
[2021-03-31 18:18:58.722] [driver] [info] [Task Finished] Resolve in 0.007255s
[2021-03-31 18:18:58.729] [driver] [info] [Task Finished] Resolve in 0.007041s
[2021-03-31 18:18:58.737] [driver] [info] [Task Finished] Resolve in 0.007218s
[2021-03-31 18:18:58.744] [driver] [info] [Task Finished] Resolve in 0.007235s
[2021-03-31 18:18:58.751] [driver] [info] [Task Finished] Resolve in 0.007319s
[2021-03-31 18:18:58.758] [driver] [info] [Task Finished] Resolve in 0.007028s
[2021-03-31 18:18:58.766] [driver] [info] [Task Finished] Resolve in 0.007278s
[2021-03-31 18:18:58.773] [driver] [info] [Task Finished] Resolve in 0.007228s
[2021-03-31 18:18:58.780] [driver] [info] [Task Finished] Resolve in 0.007091s
[2021-03-31 18:18:58.787] [driver] [info] [Task Finished] Resolve in 0.007161s
[2021-03-31 18:18:58.794] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:18:58.802] [driver] [info] [Task Finished] Resolve in 0.007190s
[2021-03-31 18:18:58.809] [driver] [info] [Task Finished] Resolve in 0.007239s
[2021-03-31 18:18:58.816] [driver] [info] [Task Finished] Resolve in 0.007244s
[2021-03-31 18:18:58.823] [driver] [info] [Task Finished] Resolve in 0.007143s
[2021-03-31 18:18:58.830] [driver] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:18:58.838] [driver] [info] [Task Finished] Resolve in 0.007092s
[2021-03-31 18:18:58.845] [driver] [info] [Task Finished] Resolve in 0.007163s
[2021-03-31 18:18:58.852] [driver] [info] [Task Finished] Resolve in 0.007266s
[2021-03-31 18:18:58.859] [driver] [info] [Task Finished] Resolve in 0.007176s
[2021-03-31 18:18:58.866] [driver] [info] [Task Finished] Resolve in 0.007156s
[2021-03-31 18:18:58.874] [driver] [info] [Task Finished] Resolve in 0.007273s
[2021-03-31 18:18:58.881] [driver] [info] [Task Finished] Resolve in 0.007267s
[2021-03-31 18:18:58.888] [driver] [info] [Task Finished] Resolve in 0.006943s
[2021-03-31 18:18:58.895] [driver] [info] [Task Finished] Resolve in 0.007278s
[2021-03-31 18:18:58.902] [driver] [info] [Task Finished] Resolve in 0.007272s
[2021-03-31 18:18:58.909] [driver] [info] [Task Finished] Resolve in 0.006970s
[2021-03-31 18:18:58.917] [driver] [info] [Task Finished] Resolve in 0.007414s
[2021-03-31 18:18:58.924] [driver] [info] [Task Finished] Resolve in 0.007251s
[2021-03-31 18:18:58.931] [driver] [info] [Task Finished] Resolve in 0.007146s
[2021-03-31 18:18:58.938] [driver] [info] [Task Finished] Resolve in 0.007039s
[2021-03-31 18:18:58.946] [driver] [info] [Task Finished] Resolve in 0.007289s
[2021-03-31 18:18:58.953] [driver] [info] [Task Finished] Resolve in 0.007191s
[2021-03-31 18:18:58.960] [driver] [info] [Task Finished] Resolve in 0.007126s
[2021-03-31 18:18:58.967] [driver] [info] [Task Finished] Resolve in 0.007174s
[2021-03-31 18:18:58.974] [driver] [info] [Task Finished] Resolve in 0.007323s
[2021-03-31 18:18:58.982] [driver] [info] [Task Finished] Resolve in 0.007211s
[2021-03-31 18:18:58.989] [driver] [info] [Task Finished] Resolve in 0.007088s
[2021-03-31 18:18:58.996] [driver] [info] [Task Finished] Resolve in 0.007221s
[2021-03-31 18:18:59.003] [driver] [info] [Task Finished] Resolve in 0.007181s
[2021-03-31 18:18:59.010] [driver] [info] [Task Finished] Resolve in 0.007203s
[2021-03-31 18:18:59.018] [driver] [info] [Task Finished] Resolve in 0.007071s
[2021-03-31 18:18:59.025] [driver] [info] [Task Finished] Resolve in 0.007333s
[2021-03-31 18:18:59.032] [driver] [info] [Task Finished] Resolve in 0.007244s
[2021-03-31 18:18:59.039] [driver] [info] [Task Finished] Resolve in 0.007048s
[2021-03-31 18:18:59.046] [driver] [info] [Task Finished] Resolve in 0.007205s
[2021-03-31 18:18:59.054] [driver] [info] [Task Finished] Resolve in 0.007256s
[2021-03-31 18:18:59.061] [driver] [info] [Task Finished] Resolve in 0.007205s
[2021-03-31 18:18:59.068] [driver] [info] [Task Finished] Resolve in 0.007019s
[2021-03-31 18:18:59.075] [driver] [info] [Task Finished] Resolve in 0.007250s
[2021-03-31 18:18:59.082] [driver] [info] [Task Finished] Resolve in 0.007316s
[2021-03-31 18:18:59.090] [driver] [info] [Task Finished] Resolve in 0.007058s
[2021-03-31 18:18:59.097] [driver] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:18:59.104] [driver] [info] [Task Finished] Resolve in 0.007232s
[2021-03-31 18:18:59.111] [driver] [info] [Task Finished] Resolve in 0.007152s
[2021-03-31 18:18:59.118] [driver] [info] [Task Finished] Resolve in 0.007088s
[2021-03-31 18:18:59.126] [driver] [info] [Task Finished] Resolve in 0.007262s
[2021-03-31 18:18:59.133] [driver] [info] [Task Finished] Resolve in 0.007193s
[2021-03-31 18:18:59.140] [driver] [info] [Task Finished] Resolve in 0.007260s
[2021-03-31 18:18:59.147] [driver] [info] [Task Finished] Resolve in 0.007145s
[2021-03-31 18:18:59.156] [driver] [info] [Task Finished] Resolve in 0.008314s
[2021-03-31 18:18:59.156] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 1.15879s
[2021-03-31 18:18:59.156] [local ee] [info] slow path for Stage 0: total wall clock time: 1.15161s, time to process 1 row via slow path: 0.000718592ms
[2021-03-31 18:18:59.156] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.15882s

[2021-03-31 18:18:59.193] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2021-03-31 18:18:59.590] [driver] [info] [Task Finished] write to file in 0.396663s (2264570 rows, 344.74 MB)
[2021-03-31 18:18:59.590] [global] [info] writing output took 0.434410s
[2021-03-31 18:18:59.590] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.434495s
[2021-03-31 18:18:59.590] [global] [info] [Transform Stage] Stage 0 took 42.1559s
[2021-03-31 18:18:59.590] [global] [info] Query Execution took 42.2531s. (planning: 0.097221s, execution: 42.1559s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 05:47:10) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.005026340484619141
Tuplex job time: 42.51634955406189 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '6bcf8f6a24af', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0196938,"llvm_optimization_time_s":0.294569,"llvm_compilation_time_s":0.134234,"total_compilation_time_s":0.444241,"sampling_time_s":0.108127,"stages":[{"stage_no":0,"fast_path_wall_time_s":40.1155,"fast_path_time_s":40.1183,"fast_path_per_row_time_ns":741.391,"slow_path_wall_time_s":1.15161,"slow_path_time_s":1.15879,"slow_path_per_row_time_ns":718.592}]}
{"startupTime": 0.005026340484619141, "jobTime": 42.51634955406189}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 321 active partitions
