[2021-03-31 18:13:57.931] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:13:57.931] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:13:57.931] [local ee] [info] initializing LLVM backend
[2021-03-31 18:13:57.931] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:13:57.932] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:13:57.932] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-31 18:13:57.932] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:13:57.933] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 18:13:57.933] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2021-03-31 18:13:58.064] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.080] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.088] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.114] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.133] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.146] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.177] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.193] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:58.196] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:58.198] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:58.200] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:58.216] [logical planner] [info] logical optimization took 0.019655ms
[2021-03-31 18:13:58.217] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.220] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.224] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.228] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.230] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.232] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.234] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:58.242] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:58.242] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,f64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:13:58.243] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2021-03-31 18:13:58.243] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2021-03-31 18:13:58.244] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2021-03-31 18:13:58.244] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2021-03-31 18:13:58.245] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2021-03-31 18:13:58.245] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2021-03-31 18:13:58.246] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:13:58.247] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2021-03-31 18:13:58.248] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2021-03-31 18:13:58.249] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2021-03-31 18:13:58.249] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:13:58.250] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:58.251] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:58.251] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2021-03-31 18:13:58.253] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:13:58.254] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:13:58.254] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:13:58.255] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:13:58.255] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:13:58.256] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:13:58.257] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 18:13:58.257] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 18:13:58.258] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 18:13:58.259] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:13:58.260] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:58.261] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:58.261] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 18:13:58.291] [global] [info] Stage0 depends on: 
[2021-03-31 18:13:58.599] [global] [info] Optimization via LLVM passes took 0.292747 ms
[2021-03-31 18:13:58.732] [global] [info] Compiled code paths for stage 0 in 0.13 ms
[2021-03-31 18:13:58.732] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.441657s
[2021-03-31 18:13:58.733] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2021-03-31 18:13:58.986] [driver] [info] [Task Finished] Transform to mem in 0.252813s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:13:59.239] [driver] [info] [Task Finished] Transform to mem in 0.253315s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:13:59.492] [driver] [info] [Task Finished] Transform to mem in 0.253133s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:13:59.743] [driver] [info] [Task Finished] Transform to mem in 0.250625s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:13:59.993] [driver] [info] [Task Finished] Transform to mem in 0.250169s (14217 normal rows, 10015 exceptions)
[2021-03-31 18:14:00.243] [driver] [info] [Task Finished] Transform to mem in 0.249664s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:14:00.493] [driver] [info] [Task Finished] Transform to mem in 0.250752s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:14:00.745] [driver] [info] [Task Finished] Transform to mem in 0.251520s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:14:00.995] [driver] [info] [Task Finished] Transform to mem in 0.249701s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:14:01.245] [driver] [info] [Task Finished] Transform to mem in 0.250673s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:14:01.496] [driver] [info] [Task Finished] Transform to mem in 0.250379s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:14:01.746] [driver] [info] [Task Finished] Transform to mem in 0.249896s (13988 normal rows, 9938 exceptions)
[2021-03-31 18:14:01.996] [driver] [info] [Task Finished] Transform to mem in 0.250710s (14177 normal rows, 10036 exceptions)
[2021-03-31 18:14:02.246] [driver] [info] [Task Finished] Transform to mem in 0.250214s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:14:02.496] [driver] [info] [Task Finished] Transform to mem in 0.249690s (14020 normal rows, 9982 exceptions)
[2021-03-31 18:14:02.750] [driver] [info] [Task Finished] Transform to mem in 0.253582s (14162 normal rows, 9952 exceptions)
[2021-03-31 18:14:03.000] [driver] [info] [Task Finished] Transform to mem in 0.250355s (14241 normal rows, 10100 exceptions)
[2021-03-31 18:14:03.254] [driver] [info] [Task Finished] Transform to mem in 0.253491s (14059 normal rows, 9985 exceptions)
[2021-03-31 18:14:03.504] [driver] [info] [Task Finished] Transform to mem in 0.250054s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:14:03.754] [driver] [info] [Task Finished] Transform to mem in 0.250528s (14238 normal rows, 10030 exceptions)
[2021-03-31 18:14:04.004] [driver] [info] [Task Finished] Transform to mem in 0.249904s (14081 normal rows, 9995 exceptions)
[2021-03-31 18:14:04.254] [driver] [info] [Task Finished] Transform to mem in 0.250258s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:14:04.505] [driver] [info] [Task Finished] Transform to mem in 0.250329s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:14:04.755] [driver] [info] [Task Finished] Transform to mem in 0.250243s (14086 normal rows, 9989 exceptions)
[2021-03-31 18:14:05.005] [driver] [info] [Task Finished] Transform to mem in 0.250062s (14097 normal rows, 10002 exceptions)
[2021-03-31 18:14:05.255] [driver] [info] [Task Finished] Transform to mem in 0.250272s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:14:05.505] [driver] [info] [Task Finished] Transform to mem in 0.250065s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:14:05.756] [driver] [info] [Task Finished] Transform to mem in 0.250242s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:14:06.006] [driver] [info] [Task Finished] Transform to mem in 0.250666s (14212 normal rows, 10032 exceptions)
[2021-03-31 18:14:06.256] [driver] [info] [Task Finished] Transform to mem in 0.250025s (14099 normal rows, 10008 exceptions)
[2021-03-31 18:14:06.510] [driver] [info] [Task Finished] Transform to mem in 0.253483s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:14:06.764] [driver] [info] [Task Finished] Transform to mem in 0.253655s (14223 normal rows, 10035 exceptions)
[2021-03-31 18:14:07.014] [driver] [info] [Task Finished] Transform to mem in 0.250084s (14089 normal rows, 10008 exceptions)
[2021-03-31 18:14:07.264] [driver] [info] [Task Finished] Transform to mem in 0.250077s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:14:07.514] [driver] [info] [Task Finished] Transform to mem in 0.250480s (14235 normal rows, 10062 exceptions)
[2021-03-31 18:14:07.765] [driver] [info] [Task Finished] Transform to mem in 0.250272s (14170 normal rows, 9994 exceptions)
[2021-03-31 18:14:08.015] [driver] [info] [Task Finished] Transform to mem in 0.249995s (14002 normal rows, 9940 exceptions)
[2021-03-31 18:14:08.265] [driver] [info] [Task Finished] Transform to mem in 0.250657s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:14:08.515] [driver] [info] [Task Finished] Transform to mem in 0.249951s (14206 normal rows, 9991 exceptions)
[2021-03-31 18:14:08.765] [driver] [info] [Task Finished] Transform to mem in 0.249851s (13961 normal rows, 9925 exceptions)
[2021-03-31 18:14:09.016] [driver] [info] [Task Finished] Transform to mem in 0.250504s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:14:09.266] [driver] [info] [Task Finished] Transform to mem in 0.250341s (14233 normal rows, 10011 exceptions)
[2021-03-31 18:14:09.516] [driver] [info] [Task Finished] Transform to mem in 0.249938s (13915 normal rows, 9900 exceptions)
[2021-03-31 18:14:09.767] [driver] [info] [Task Finished] Transform to mem in 0.250680s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:14:10.017] [driver] [info] [Task Finished] Transform to mem in 0.250262s (14267 normal rows, 10030 exceptions)
[2021-03-31 18:14:10.270] [driver] [info] [Task Finished] Transform to mem in 0.252809s (13892 normal rows, 9882 exceptions)
[2021-03-31 18:14:10.526] [driver] [info] [Task Finished] Transform to mem in 0.255963s (14245 normal rows, 10101 exceptions)
[2021-03-31 18:14:10.777] [driver] [info] [Task Finished] Transform to mem in 0.251602s (14260 normal rows, 10025 exceptions)
[2021-03-31 18:14:11.027] [driver] [info] [Task Finished] Transform to mem in 0.249687s (13978 normal rows, 9907 exceptions)
[2021-03-31 18:14:11.278] [driver] [info] [Task Finished] Transform to mem in 0.250834s (14181 normal rows, 10067 exceptions)
[2021-03-31 18:14:11.528] [driver] [info] [Task Finished] Transform to mem in 0.250175s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:14:11.778] [driver] [info] [Task Finished] Transform to mem in 0.249930s (14015 normal rows, 9982 exceptions)
[2021-03-31 18:14:12.028] [driver] [info] [Task Finished] Transform to mem in 0.250205s (14142 normal rows, 9989 exceptions)
[2021-03-31 18:14:12.279] [driver] [info] [Task Finished] Transform to mem in 0.250532s (14280 normal rows, 10094 exceptions)
[2021-03-31 18:14:12.529] [driver] [info] [Task Finished] Transform to mem in 0.249718s (13982 normal rows, 9975 exceptions)
[2021-03-31 18:14:12.780] [driver] [info] [Task Finished] Transform to mem in 0.251232s (14173 normal rows, 10006 exceptions)
[2021-03-31 18:14:13.030] [driver] [info] [Task Finished] Transform to mem in 0.250348s (14235 normal rows, 10040 exceptions)
[2021-03-31 18:14:13.280] [driver] [info] [Task Finished] Transform to mem in 0.250115s (14054 normal rows, 9984 exceptions)
[2021-03-31 18:14:13.531] [driver] [info] [Task Finished] Transform to mem in 0.250339s (14129 normal rows, 10004 exceptions)
[2021-03-31 18:14:13.784] [driver] [info] [Task Finished] Transform to mem in 0.253631s (14223 normal rows, 10033 exceptions)
[2021-03-31 18:14:14.036] [driver] [info] [Task Finished] Transform to mem in 0.251582s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:14:14.286] [driver] [info] [Task Finished] Transform to mem in 0.250149s (14108 normal rows, 10010 exceptions)
[2021-03-31 18:14:14.536] [driver] [info] [Task Finished] Transform to mem in 0.250233s (14208 normal rows, 10008 exceptions)
[2021-03-31 18:14:14.786] [driver] [info] [Task Finished] Transform to mem in 0.250163s (14089 normal rows, 10031 exceptions)
[2021-03-31 18:14:15.036] [driver] [info] [Task Finished] Transform to mem in 0.249993s (14094 normal rows, 9960 exceptions)
[2021-03-31 18:14:15.287] [driver] [info] [Task Finished] Transform to mem in 0.250406s (14232 normal rows, 10017 exceptions)
[2021-03-31 18:14:15.537] [driver] [info] [Task Finished] Transform to mem in 0.249929s (14088 normal rows, 10027 exceptions)
[2021-03-31 18:14:15.787] [driver] [info] [Task Finished] Transform to mem in 0.250368s (14106 normal rows, 9955 exceptions)
[2021-03-31 18:14:16.038] [driver] [info] [Task Finished] Transform to mem in 0.250449s (14211 normal rows, 10043 exceptions)
[2021-03-31 18:14:16.288] [driver] [info] [Task Finished] Transform to mem in 0.250613s (14113 normal rows, 9997 exceptions)
[2021-03-31 18:14:16.539] [driver] [info] [Task Finished] Transform to mem in 0.250320s (14075 normal rows, 9965 exceptions)
[2021-03-31 18:14:16.789] [driver] [info] [Task Finished] Transform to mem in 0.250721s (14223 normal rows, 10049 exceptions)
[2021-03-31 18:14:17.039] [driver] [info] [Task Finished] Transform to mem in 0.249888s (14095 normal rows, 9995 exceptions)
[2021-03-31 18:14:17.289] [driver] [info] [Task Finished] Transform to mem in 0.249706s (14086 normal rows, 9952 exceptions)
[2021-03-31 18:14:17.543] [driver] [info] [Task Finished] Transform to mem in 0.253845s (14226 normal rows, 10069 exceptions)
[2021-03-31 18:14:17.793] [driver] [info] [Task Finished] Transform to mem in 0.249776s (14170 normal rows, 9996 exceptions)
[2021-03-31 18:14:18.046] [driver] [info] [Task Finished] Transform to mem in 0.252951s (14002 normal rows, 9931 exceptions)
[2021-03-31 18:14:18.296] [driver] [info] [Task Finished] Transform to mem in 0.250413s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:14:18.546] [driver] [info] [Task Finished] Transform to mem in 0.250109s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:14:18.797] [driver] [info] [Task Finished] Transform to mem in 0.250761s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:14:19.048] [driver] [info] [Task Finished] Transform to mem in 0.250575s (14237 normal rows, 10084 exceptions)
[2021-03-31 18:14:19.298] [driver] [info] [Task Finished] Transform to mem in 0.250417s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:14:19.548] [driver] [info] [Task Finished] Transform to mem in 0.249845s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:14:19.799] [driver] [info] [Task Finished] Transform to mem in 0.250841s (14267 normal rows, 10099 exceptions)
[2021-03-31 18:14:20.049] [driver] [info] [Task Finished] Transform to mem in 0.250152s (14248 normal rows, 10030 exceptions)
[2021-03-31 18:14:20.299] [driver] [info] [Task Finished] Transform to mem in 0.249713s (13912 normal rows, 9882 exceptions)
[2021-03-31 18:14:20.549] [driver] [info] [Task Finished] Transform to mem in 0.250548s (14248 normal rows, 10094 exceptions)
[2021-03-31 18:14:20.799] [driver] [info] [Task Finished] Transform to mem in 0.250209s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:14:21.050] [driver] [info] [Task Finished] Transform to mem in 0.250440s (13988 normal rows, 9922 exceptions)
[2021-03-31 18:14:21.304] [driver] [info] [Task Finished] Transform to mem in 0.253699s (14171 normal rows, 10052 exceptions)
[2021-03-31 18:14:21.555] [driver] [info] [Task Finished] Transform to mem in 0.251283s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:14:21.807] [driver] [info] [Task Finished] Transform to mem in 0.251741s (14015 normal rows, 9985 exceptions)
[2021-03-31 18:14:22.059] [driver] [info] [Task Finished] Transform to mem in 0.252810s (14176 normal rows, 9997 exceptions)
[2021-03-31 18:14:22.310] [driver] [info] [Task Finished] Transform to mem in 0.250543s (14246 normal rows, 10108 exceptions)
[2021-03-31 18:14:22.560] [driver] [info] [Task Finished] Transform to mem in 0.250069s (14059 normal rows, 9978 exceptions)
[2021-03-31 18:14:22.810] [driver] [info] [Task Finished] Transform to mem in 0.250419s (14114 normal rows, 10011 exceptions)
[2021-03-31 18:14:23.061] [driver] [info] [Task Finished] Transform to mem in 0.250228s (14238 normal rows, 10007 exceptions)
[2021-03-31 18:14:23.311] [driver] [info] [Task Finished] Transform to mem in 0.250055s (14081 normal rows, 10003 exceptions)
[2021-03-31 18:14:23.561] [driver] [info] [Task Finished] Transform to mem in 0.250241s (14095 normal rows, 10024 exceptions)
[2021-03-31 18:14:23.811] [driver] [info] [Task Finished] Transform to mem in 0.250248s (14221 normal rows, 9998 exceptions)
[2021-03-31 18:14:24.062] [driver] [info] [Task Finished] Transform to mem in 0.250586s (14086 normal rows, 9998 exceptions)
[2021-03-31 18:14:24.312] [driver] [info] [Task Finished] Transform to mem in 0.250304s (14091 normal rows, 10001 exceptions)
[2021-03-31 18:14:24.563] [driver] [info] [Task Finished] Transform to mem in 0.250305s (14218 normal rows, 10016 exceptions)
[2021-03-31 18:14:24.815] [driver] [info] [Task Finished] Transform to mem in 0.252864s (14095 normal rows, 10026 exceptions)
[2021-03-31 18:14:25.066] [driver] [info] [Task Finished] Transform to mem in 0.250396s (14113 normal rows, 9960 exceptions)
[2021-03-31 18:14:25.319] [driver] [info] [Task Finished] Transform to mem in 0.253461s (14197 normal rows, 10028 exceptions)
[2021-03-31 18:14:25.569] [driver] [info] [Task Finished] Transform to mem in 0.249827s (14114 normal rows, 10012 exceptions)
[2021-03-31 18:14:25.819] [driver] [info] [Task Finished] Transform to mem in 0.250158s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:14:26.070] [driver] [info] [Task Finished] Transform to mem in 0.250712s (14197 normal rows, 10033 exceptions)
[2021-03-31 18:14:26.320] [driver] [info] [Task Finished] Transform to mem in 0.250182s (14115 normal rows, 10010 exceptions)
[2021-03-31 18:14:26.570] [driver] [info] [Task Finished] Transform to mem in 0.250204s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:14:26.821] [driver] [info] [Task Finished] Transform to mem in 0.250834s (14235 normal rows, 10048 exceptions)
[2021-03-31 18:14:27.071] [driver] [info] [Task Finished] Transform to mem in 0.250143s (14144 normal rows, 9995 exceptions)
[2021-03-31 18:14:27.322] [driver] [info] [Task Finished] Transform to mem in 0.250168s (14015 normal rows, 9952 exceptions)
[2021-03-31 18:14:27.572] [driver] [info] [Task Finished] Transform to mem in 0.250550s (14237 normal rows, 10069 exceptions)
[2021-03-31 18:14:27.822] [driver] [info] [Task Finished] Transform to mem in 0.250195s (14159 normal rows, 9996 exceptions)
[2021-03-31 18:14:28.072] [driver] [info] [Task Finished] Transform to mem in 0.249776s (14010 normal rows, 9932 exceptions)
[2021-03-31 18:14:28.323] [driver] [info] [Task Finished] Transform to mem in 0.250486s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:14:28.576] [driver] [info] [Task Finished] Transform to mem in 0.253354s (14178 normal rows, 10009 exceptions)
[2021-03-31 18:14:28.826] [driver] [info] [Task Finished] Transform to mem in 0.249444s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:14:29.080] [driver] [info] [Task Finished] Transform to mem in 0.254349s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:14:29.330] [driver] [info] [Task Finished] Transform to mem in 0.250152s (14236 normal rows, 10015 exceptions)
[2021-03-31 18:14:29.580] [driver] [info] [Task Finished] Transform to mem in 0.249862s (13901 normal rows, 9892 exceptions)
[2021-03-31 18:14:29.831] [driver] [info] [Task Finished] Transform to mem in 0.250677s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:14:30.081] [driver] [info] [Task Finished] Transform to mem in 0.250684s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:14:30.331] [driver] [info] [Task Finished] Transform to mem in 0.249695s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:14:30.582] [driver] [info] [Task Finished] Transform to mem in 0.250612s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:14:30.832] [driver] [info] [Task Finished] Transform to mem in 0.250323s (14245 normal rows, 10024 exceptions)
[2021-03-31 18:14:31.082] [driver] [info] [Task Finished] Transform to mem in 0.249936s (13999 normal rows, 9935 exceptions)
[2021-03-31 18:14:31.333] [driver] [info] [Task Finished] Transform to mem in 0.250557s (14158 normal rows, 10036 exceptions)
[2021-03-31 18:14:31.583] [driver] [info] [Task Finished] Transform to mem in 0.250360s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:14:31.833] [driver] [info] [Task Finished] Transform to mem in 0.249744s (14020 normal rows, 9989 exceptions)
[2021-03-31 18:14:32.083] [driver] [info] [Task Finished] Transform to mem in 0.250286s (14173 normal rows, 10004 exceptions)
[2021-03-31 18:14:32.337] [driver] [info] [Task Finished] Transform to mem in 0.253644s (14235 normal rows, 10041 exceptions)
[2021-03-31 18:14:32.587] [driver] [info] [Task Finished] Transform to mem in 0.250309s (14054 normal rows, 9985 exceptions)
[2021-03-31 18:14:32.840] [driver] [info] [Task Finished] Transform to mem in 0.252999s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:14:33.091] [driver] [info] [Task Finished] Transform to mem in 0.250525s (14238 normal rows, 10033 exceptions)
[2021-03-31 18:14:33.341] [driver] [info] [Task Finished] Transform to mem in 0.250102s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:14:33.591] [driver] [info] [Task Finished] Transform to mem in 0.250348s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:14:33.841] [driver] [info] [Task Finished] Transform to mem in 0.250202s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:14:34.091] [driver] [info] [Task Finished] Transform to mem in 0.250118s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:14:34.342] [driver] [info] [Task Finished] Transform to mem in 0.250549s (14094 normal rows, 9996 exceptions)
[2021-03-31 18:14:34.592] [driver] [info] [Task Finished] Transform to mem in 0.250328s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:14:34.843] [driver] [info] [Task Finished] Transform to mem in 0.250237s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:14:35.093] [driver] [info] [Task Finished] Transform to mem in 0.250157s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:14:35.343] [driver] [info] [Task Finished] Transform to mem in 0.250490s (14217 normal rows, 10042 exceptions)
[2021-03-31 18:14:35.593] [driver] [info] [Task Finished] Transform to mem in 0.249810s (14094 normal rows, 9998 exceptions)
[2021-03-31 18:14:35.845] [driver] [info] [Task Finished] Transform to mem in 0.252085s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:14:36.097] [driver] [info] [Task Finished] Transform to mem in 0.251636s (14223 normal rows, 10048 exceptions)
[2021-03-31 18:14:36.350] [driver] [info] [Task Finished] Transform to mem in 0.253199s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:14:36.600] [driver] [info] [Task Finished] Transform to mem in 0.249970s (14086 normal rows, 9953 exceptions)
[2021-03-31 18:14:36.851] [driver] [info] [Task Finished] Transform to mem in 0.250553s (14232 normal rows, 10069 exceptions)
[2021-03-31 18:14:37.101] [driver] [info] [Task Finished] Transform to mem in 0.250169s (14170 normal rows, 9995 exceptions)
[2021-03-31 18:14:37.351] [driver] [info] [Task Finished] Transform to mem in 0.249896s (14002 normal rows, 9932 exceptions)
[2021-03-31 18:14:37.601] [driver] [info] [Task Finished] Transform to mem in 0.250671s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:14:37.852] [driver] [info] [Task Finished] Transform to mem in 0.250199s (14206 normal rows, 10009 exceptions)
[2021-03-31 18:14:38.102] [driver] [info] [Task Finished] Transform to mem in 0.250246s (13961 normal rows, 9907 exceptions)
[2021-03-31 18:14:38.352] [driver] [info] [Task Finished] Transform to mem in 0.250572s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:14:38.603] [driver] [info] [Task Finished] Transform to mem in 0.250203s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:14:38.894] [driver] [info] [Task Finished] Transform to mem in 0.291702s (16320 normal rows, 11605 exceptions)
[2021-03-31 18:14:38.894] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 40.1619s
[2021-03-31 18:14:38.894] [global] [info] [Transform Stage] Stage 0 total wall clock time: 40.1592s, 54108450 input rows, time to process 1 row via fast path: 0.000742199ms
[2021-03-31 18:14:38.894] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2021-03-31 18:14:38.898] [local ee] [info] compiled pure python pipeline in 0.003903s
[2021-03-31 18:14:38.898] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 18:14:38.900] [local ee] [info] Created 160 resolve tasks in 0.001208s
[2021-03-31 18:14:38.900] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 18:14:38.907] [driver] [info] [Task Finished] Resolve in 0.007085s
[2021-03-31 18:14:38.914] [driver] [info] [Task Finished] Resolve in 0.007201s
[2021-03-31 18:14:38.921] [driver] [info] [Task Finished] Resolve in 0.007104s
[2021-03-31 18:14:38.928] [driver] [info] [Task Finished] Resolve in 0.007029s
[2021-03-31 18:14:38.935] [driver] [info] [Task Finished] Resolve in 0.007201s
[2021-03-31 18:14:38.942] [driver] [info] [Task Finished] Resolve in 0.007046s
[2021-03-31 18:14:38.950] [driver] [info] [Task Finished] Resolve in 0.007139s
[2021-03-31 18:14:38.957] [driver] [info] [Task Finished] Resolve in 0.007251s
[2021-03-31 18:14:38.964] [driver] [info] [Task Finished] Resolve in 0.007080s
[2021-03-31 18:14:38.971] [driver] [info] [Task Finished] Resolve in 0.007182s
[2021-03-31 18:14:38.978] [driver] [info] [Task Finished] Resolve in 0.007028s
[2021-03-31 18:14:38.985] [driver] [info] [Task Finished] Resolve in 0.007125s
[2021-03-31 18:14:38.992] [driver] [info] [Task Finished] Resolve in 0.007177s
[2021-03-31 18:14:39.000] [driver] [info] [Task Finished] Resolve in 0.007106s
[2021-03-31 18:14:39.007] [driver] [info] [Task Finished] Resolve in 0.007156s
[2021-03-31 18:14:39.014] [driver] [info] [Task Finished] Resolve in 0.007175s
[2021-03-31 18:14:39.021] [driver] [info] [Task Finished] Resolve in 0.007224s
[2021-03-31 18:14:39.028] [driver] [info] [Task Finished] Resolve in 0.006962s
[2021-03-31 18:14:39.035] [driver] [info] [Task Finished] Resolve in 0.007174s
[2021-03-31 18:14:39.043] [driver] [info] [Task Finished] Resolve in 0.007189s
[2021-03-31 18:14:39.050] [driver] [info] [Task Finished] Resolve in 0.007067s
[2021-03-31 18:14:39.057] [driver] [info] [Task Finished] Resolve in 0.007079s
[2021-03-31 18:14:39.064] [driver] [info] [Task Finished] Resolve in 0.007289s
[2021-03-31 18:14:39.071] [driver] [info] [Task Finished] Resolve in 0.007135s
[2021-03-31 18:14:39.078] [driver] [info] [Task Finished] Resolve in 0.006976s
[2021-03-31 18:14:39.085] [driver] [info] [Task Finished] Resolve in 0.007212s
[2021-03-31 18:14:39.092] [driver] [info] [Task Finished] Resolve in 0.007151s
[2021-03-31 18:14:39.100] [driver] [info] [Task Finished] Resolve in 0.007036s
[2021-03-31 18:14:39.107] [driver] [info] [Task Finished] Resolve in 0.007106s
[2021-03-31 18:14:39.114] [driver] [info] [Task Finished] Resolve in 0.007170s
[2021-03-31 18:14:39.121] [driver] [info] [Task Finished] Resolve in 0.007272s
[2021-03-31 18:14:39.128] [driver] [info] [Task Finished] Resolve in 0.007020s
[2021-03-31 18:14:39.135] [driver] [info] [Task Finished] Resolve in 0.007177s
[2021-03-31 18:14:39.142] [driver] [info] [Task Finished] Resolve in 0.007129s
[2021-03-31 18:14:39.150] [driver] [info] [Task Finished] Resolve in 0.007111s
[2021-03-31 18:14:39.157] [driver] [info] [Task Finished] Resolve in 0.007094s
[2021-03-31 18:14:39.164] [driver] [info] [Task Finished] Resolve in 0.007090s
[2021-03-31 18:14:39.171] [driver] [info] [Task Finished] Resolve in 0.007259s
[2021-03-31 18:14:39.178] [driver] [info] [Task Finished] Resolve in 0.007013s
[2021-03-31 18:14:39.185] [driver] [info] [Task Finished] Resolve in 0.007108s
[2021-03-31 18:14:39.192] [driver] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:14:39.200] [driver] [info] [Task Finished] Resolve in 0.007082s
[2021-03-31 18:14:39.207] [driver] [info] [Task Finished] Resolve in 0.006979s
[2021-03-31 18:14:39.214] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:14:39.221] [driver] [info] [Task Finished] Resolve in 0.007214s
[2021-03-31 18:14:39.228] [driver] [info] [Task Finished] Resolve in 0.007015s
[2021-03-31 18:14:39.235] [driver] [info] [Task Finished] Resolve in 0.007214s
[2021-03-31 18:14:39.242] [driver] [info] [Task Finished] Resolve in 0.007195s
[2021-03-31 18:14:39.249] [driver] [info] [Task Finished] Resolve in 0.006982s
[2021-03-31 18:14:39.257] [driver] [info] [Task Finished] Resolve in 0.007129s
[2021-03-31 18:14:39.264] [driver] [info] [Task Finished] Resolve in 0.007206s
[2021-03-31 18:14:39.271] [driver] [info] [Task Finished] Resolve in 0.007102s
[2021-03-31 18:14:39.278] [driver] [info] [Task Finished] Resolve in 0.006994s
[2021-03-31 18:14:39.285] [driver] [info] [Task Finished] Resolve in 0.007300s
[2021-03-31 18:14:39.292] [driver] [info] [Task Finished] Resolve in 0.007105s
[2021-03-31 18:14:39.299] [driver] [info] [Task Finished] Resolve in 0.007055s
[2021-03-31 18:14:39.307] [driver] [info] [Task Finished] Resolve in 0.007132s
[2021-03-31 18:14:39.314] [driver] [info] [Task Finished] Resolve in 0.007133s
[2021-03-31 18:14:39.321] [driver] [info] [Task Finished] Resolve in 0.007160s
[2021-03-31 18:14:39.328] [driver] [info] [Task Finished] Resolve in 0.007019s
[2021-03-31 18:14:39.335] [driver] [info] [Task Finished] Resolve in 0.007187s
[2021-03-31 18:14:39.342] [driver] [info] [Task Finished] Resolve in 0.007217s
[2021-03-31 18:14:39.349] [driver] [info] [Task Finished] Resolve in 0.007073s
[2021-03-31 18:14:39.356] [driver] [info] [Task Finished] Resolve in 0.007111s
[2021-03-31 18:14:39.364] [driver] [info] [Task Finished] Resolve in 0.007132s
[2021-03-31 18:14:39.371] [driver] [info] [Task Finished] Resolve in 0.007175s
[2021-03-31 18:14:39.378] [driver] [info] [Task Finished] Resolve in 0.006983s
[2021-03-31 18:14:39.385] [driver] [info] [Task Finished] Resolve in 0.007157s
[2021-03-31 18:14:39.392] [driver] [info] [Task Finished] Resolve in 0.007223s
[2021-03-31 18:14:39.399] [driver] [info] [Task Finished] Resolve in 0.007007s
[2021-03-31 18:14:39.406] [driver] [info] [Task Finished] Resolve in 0.007088s
[2021-03-31 18:14:39.414] [driver] [info] [Task Finished] Resolve in 0.007215s
[2021-03-31 18:14:39.421] [driver] [info] [Task Finished] Resolve in 0.007147s
[2021-03-31 18:14:39.428] [driver] [info] [Task Finished] Resolve in 0.006955s
[2021-03-31 18:14:39.435] [driver] [info] [Task Finished] Resolve in 0.007192s
[2021-03-31 18:14:39.442] [driver] [info] [Task Finished] Resolve in 0.007175s
[2021-03-31 18:14:39.449] [driver] [info] [Task Finished] Resolve in 0.007089s
[2021-03-31 18:14:39.456] [driver] [info] [Task Finished] Resolve in 0.007171s
[2021-03-31 18:14:39.464] [driver] [info] [Task Finished] Resolve in 0.007179s
[2021-03-31 18:14:39.471] [driver] [info] [Task Finished] Resolve in 0.007073s
[2021-03-31 18:14:39.478] [driver] [info] [Task Finished] Resolve in 0.007038s
[2021-03-31 18:14:39.485] [driver] [info] [Task Finished] Resolve in 0.007227s
[2021-03-31 18:14:39.492] [driver] [info] [Task Finished] Resolve in 0.007058s
[2021-03-31 18:14:39.499] [driver] [info] [Task Finished] Resolve in 0.007030s
[2021-03-31 18:14:39.507] [driver] [info] [Task Finished] Resolve in 0.007809s
[2021-03-31 18:14:39.515] [driver] [info] [Task Finished] Resolve in 0.007666s
[2021-03-31 18:14:39.522] [driver] [info] [Task Finished] Resolve in 0.007852s
[2021-03-31 18:14:39.530] [driver] [info] [Task Finished] Resolve in 0.007794s
[2021-03-31 18:14:39.538] [driver] [info] [Task Finished] Resolve in 0.007641s
[2021-03-31 18:14:39.545] [driver] [info] [Task Finished] Resolve in 0.007314s
[2021-03-31 18:14:39.552] [driver] [info] [Task Finished] Resolve in 0.007191s
[2021-03-31 18:14:39.560] [driver] [info] [Task Finished] Resolve in 0.007151s
[2021-03-31 18:14:39.567] [driver] [info] [Task Finished] Resolve in 0.007091s
[2021-03-31 18:14:39.574] [driver] [info] [Task Finished] Resolve in 0.007227s
[2021-03-31 18:14:39.581] [driver] [info] [Task Finished] Resolve in 0.007133s
[2021-03-31 18:14:39.588] [driver] [info] [Task Finished] Resolve in 0.006973s
[2021-03-31 18:14:39.595] [driver] [info] [Task Finished] Resolve in 0.007193s
[2021-03-31 18:14:39.602] [driver] [info] [Task Finished] Resolve in 0.007136s
[2021-03-31 18:14:39.609] [driver] [info] [Task Finished] Resolve in 0.007031s
[2021-03-31 18:14:39.617] [driver] [info] [Task Finished] Resolve in 0.007156s
[2021-03-31 18:14:39.624] [driver] [info] [Task Finished] Resolve in 0.007159s
[2021-03-31 18:14:39.631] [driver] [info] [Task Finished] Resolve in 0.007121s
[2021-03-31 18:14:39.638] [driver] [info] [Task Finished] Resolve in 0.007020s
[2021-03-31 18:14:39.645] [driver] [info] [Task Finished] Resolve in 0.007170s
[2021-03-31 18:14:39.652] [driver] [info] [Task Finished] Resolve in 0.007153s
[2021-03-31 18:14:39.659] [driver] [info] [Task Finished] Resolve in 0.007060s
[2021-03-31 18:14:39.667] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:14:39.674] [driver] [info] [Task Finished] Resolve in 0.007164s
[2021-03-31 18:14:39.681] [driver] [info] [Task Finished] Resolve in 0.007199s
[2021-03-31 18:14:39.688] [driver] [info] [Task Finished] Resolve in 0.006979s
[2021-03-31 18:14:39.695] [driver] [info] [Task Finished] Resolve in 0.007136s
[2021-03-31 18:14:39.702] [driver] [info] [Task Finished] Resolve in 0.007208s
[2021-03-31 18:14:39.709] [driver] [info] [Task Finished] Resolve in 0.007059s
[2021-03-31 18:14:39.716] [driver] [info] [Task Finished] Resolve in 0.007075s
[2021-03-31 18:14:39.724] [driver] [info] [Task Finished] Resolve in 0.007222s
[2021-03-31 18:14:39.731] [driver] [info] [Task Finished] Resolve in 0.007147s
[2021-03-31 18:14:39.738] [driver] [info] [Task Finished] Resolve in 0.006943s
[2021-03-31 18:14:39.745] [driver] [info] [Task Finished] Resolve in 0.007226s
[2021-03-31 18:14:39.752] [driver] [info] [Task Finished] Resolve in 0.007164s
[2021-03-31 18:14:39.759] [driver] [info] [Task Finished] Resolve in 0.006898s
[2021-03-31 18:14:39.766] [driver] [info] [Task Finished] Resolve in 0.007208s
[2021-03-31 18:14:39.774] [driver] [info] [Task Finished] Resolve in 0.007210s
[2021-03-31 18:14:39.781] [driver] [info] [Task Finished] Resolve in 0.007213s
[2021-03-31 18:14:39.788] [driver] [info] [Task Finished] Resolve in 0.007049s
[2021-03-31 18:14:39.795] [driver] [info] [Task Finished] Resolve in 0.007211s
[2021-03-31 18:14:39.802] [driver] [info] [Task Finished] Resolve in 0.007083s
[2021-03-31 18:14:39.809] [driver] [info] [Task Finished] Resolve in 0.007079s
[2021-03-31 18:14:39.816] [driver] [info] [Task Finished] Resolve in 0.007165s
[2021-03-31 18:14:39.824] [driver] [info] [Task Finished] Resolve in 0.007099s
[2021-03-31 18:14:39.831] [driver] [info] [Task Finished] Resolve in 0.007198s
[2021-03-31 18:14:39.838] [driver] [info] [Task Finished] Resolve in 0.007055s
[2021-03-31 18:14:39.845] [driver] [info] [Task Finished] Resolve in 0.007135s
[2021-03-31 18:14:39.852] [driver] [info] [Task Finished] Resolve in 0.007168s
[2021-03-31 18:14:39.859] [driver] [info] [Task Finished] Resolve in 0.007054s
[2021-03-31 18:14:39.866] [driver] [info] [Task Finished] Resolve in 0.007113s
[2021-03-31 18:14:39.874] [driver] [info] [Task Finished] Resolve in 0.007157s
[2021-03-31 18:14:39.881] [driver] [info] [Task Finished] Resolve in 0.007201s
[2021-03-31 18:14:39.888] [driver] [info] [Task Finished] Resolve in 0.007099s
[2021-03-31 18:14:39.895] [driver] [info] [Task Finished] Resolve in 0.007152s
[2021-03-31 18:14:39.902] [driver] [info] [Task Finished] Resolve in 0.007196s
[2021-03-31 18:14:39.909] [driver] [info] [Task Finished] Resolve in 0.007027s
[2021-03-31 18:14:39.916] [driver] [info] [Task Finished] Resolve in 0.007126s
[2021-03-31 18:14:39.924] [driver] [info] [Task Finished] Resolve in 0.007182s
[2021-03-31 18:14:39.931] [driver] [info] [Task Finished] Resolve in 0.007158s
[2021-03-31 18:14:39.938] [driver] [info] [Task Finished] Resolve in 0.006973s
[2021-03-31 18:14:39.945] [driver] [info] [Task Finished] Resolve in 0.007726s
[2021-03-31 18:14:39.953] [driver] [info] [Task Finished] Resolve in 0.007755s
[2021-03-31 18:14:39.961] [driver] [info] [Task Finished] Resolve in 0.007731s
[2021-03-31 18:14:39.969] [driver] [info] [Task Finished] Resolve in 0.007725s
[2021-03-31 18:14:39.976] [driver] [info] [Task Finished] Resolve in 0.007751s
[2021-03-31 18:14:39.984] [driver] [info] [Task Finished] Resolve in 0.007386s
[2021-03-31 18:14:39.991] [driver] [info] [Task Finished] Resolve in 0.007185s
[2021-03-31 18:14:39.998] [driver] [info] [Task Finished] Resolve in 0.007138s
[2021-03-31 18:14:40.005] [driver] [info] [Task Finished] Resolve in 0.007121s
[2021-03-31 18:14:40.013] [driver] [info] [Task Finished] Resolve in 0.007211s
[2021-03-31 18:14:40.020] [driver] [info] [Task Finished] Resolve in 0.007092s
[2021-03-31 18:14:40.027] [driver] [info] [Task Finished] Resolve in 0.006988s
[2021-03-31 18:14:40.034] [driver] [info] [Task Finished] Resolve in 0.007220s
[2021-03-31 18:14:40.041] [driver] [info] [Task Finished] Resolve in 0.007206s
[2021-03-31 18:14:40.049] [driver] [info] [Task Finished] Resolve in 0.008177s
[2021-03-31 18:14:40.049] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 1.15503s
[2021-03-31 18:14:40.049] [local ee] [info] slow path for Stage 0: total wall clock time: 1.14788s, time to process 1 row via slow path: 0.000716263ms
[2021-03-31 18:14:40.049] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.15506s

[2021-03-31 18:14:40.088] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2021-03-31 18:14:40.490] [driver] [info] [Task Finished] write to file in 0.401585s (2264570 rows, 344.74 MB)
[2021-03-31 18:14:40.490] [global] [info] writing output took 0.440203s
[2021-03-31 18:14:40.490] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.440296s
[2021-03-31 18:14:40.490] [global] [info] [Transform Stage] Stage 0 took 42.1989s
[2021-03-31 18:14:40.490] [global] [info] Query Execution took 42.2959s. (planning: 0.0969633s, execution: 42.199s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 05:47:10) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.004990339279174805
Tuplex job time: 42.55840182304382 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '6bcf8f6a24af', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0196553,"llvm_optimization_time_s":0.292747,"llvm_compilation_time_s":0.133555,"total_compilation_time_s":0.441654,"sampling_time_s":0.108195,"stages":[{"stage_no":0,"fast_path_wall_time_s":40.1592,"fast_path_time_s":40.1619,"fast_path_per_row_time_ns":742.199,"slow_path_wall_time_s":1.14788,"slow_path_time_s":1.15503,"slow_path_per_row_time_ns":716.263}]}
{"startupTime": 0.004990339279174805, "jobTime": 42.55840182304382}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 321 active partitions
