[2021-03-31 18:14:40.899] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:14:40.900] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:14:40.900] [local ee] [info] initializing LLVM backend
[2021-03-31 18:14:40.900] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:14:40.900] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:14:40.901] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-31 18:14:40.901] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:14:40.901] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 18:14:40.901] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2021-03-31 18:14:41.033] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.049] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.057] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.083] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.102] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.115] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.146] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.162] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:14:41.165] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:14:41.167] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:14:41.170] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:14:41.185] [logical planner] [info] logical optimization took 0.019683ms
[2021-03-31 18:14:41.186] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.189] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.193] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.197] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.199] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.201] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.203] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:14:41.211] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:14:41.211] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,f64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:14:41.212] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2021-03-31 18:14:41.212] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2021-03-31 18:14:41.213] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2021-03-31 18:14:41.214] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2021-03-31 18:14:41.214] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2021-03-31 18:14:41.215] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2021-03-31 18:14:41.215] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:14:41.216] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2021-03-31 18:14:41.217] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2021-03-31 18:14:41.218] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2021-03-31 18:14:41.218] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:14:41.220] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:14:41.220] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:14:41.221] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2021-03-31 18:14:41.222] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:14:41.223] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:14:41.223] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:14:41.224] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:14:41.224] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:14:41.225] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:14:41.226] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 18:14:41.227] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 18:14:41.228] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 18:14:41.228] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:14:41.229] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:14:41.230] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:14:41.231] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 18:14:41.260] [global] [info] Stage0 depends on: 
[2021-03-31 18:14:41.571] [global] [info] Optimization via LLVM passes took 0.295406 ms
[2021-03-31 18:14:41.705] [global] [info] Compiled code paths for stage 0 in 0.13 ms
[2021-03-31 18:14:41.705] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.445284s
[2021-03-31 18:14:41.706] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2021-03-31 18:14:41.959] [driver] [info] [Task Finished] Transform to mem in 0.253486s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:14:42.210] [driver] [info] [Task Finished] Transform to mem in 0.250900s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:14:42.460] [driver] [info] [Task Finished] Transform to mem in 0.250266s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:14:42.712] [driver] [info] [Task Finished] Transform to mem in 0.251253s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:14:42.962] [driver] [info] [Task Finished] Transform to mem in 0.250523s (14217 normal rows, 10015 exceptions)
[2021-03-31 18:14:43.215] [driver] [info] [Task Finished] Transform to mem in 0.252589s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:14:43.466] [driver] [info] [Task Finished] Transform to mem in 0.251398s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:14:43.720] [driver] [info] [Task Finished] Transform to mem in 0.253972s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:14:43.970] [driver] [info] [Task Finished] Transform to mem in 0.250060s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:14:44.221] [driver] [info] [Task Finished] Transform to mem in 0.250937s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:14:44.472] [driver] [info] [Task Finished] Transform to mem in 0.250726s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:14:44.722] [driver] [info] [Task Finished] Transform to mem in 0.250309s (13988 normal rows, 9938 exceptions)
[2021-03-31 18:14:44.973] [driver] [info] [Task Finished] Transform to mem in 0.250605s (14177 normal rows, 10036 exceptions)
[2021-03-31 18:14:45.224] [driver] [info] [Task Finished] Transform to mem in 0.250764s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:14:45.474] [driver] [info] [Task Finished] Transform to mem in 0.250333s (14020 normal rows, 9982 exceptions)
[2021-03-31 18:14:45.725] [driver] [info] [Task Finished] Transform to mem in 0.250811s (14162 normal rows, 9952 exceptions)
[2021-03-31 18:14:45.976] [driver] [info] [Task Finished] Transform to mem in 0.250973s (14241 normal rows, 10100 exceptions)
[2021-03-31 18:14:46.226] [driver] [info] [Task Finished] Transform to mem in 0.250235s (14059 normal rows, 9985 exceptions)
[2021-03-31 18:14:46.477] [driver] [info] [Task Finished] Transform to mem in 0.250603s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:14:46.728] [driver] [info] [Task Finished] Transform to mem in 0.250769s (14238 normal rows, 10030 exceptions)
[2021-03-31 18:14:46.981] [driver] [info] [Task Finished] Transform to mem in 0.253674s (14081 normal rows, 9995 exceptions)
[2021-03-31 18:14:47.231] [driver] [info] [Task Finished] Transform to mem in 0.250149s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:14:47.485] [driver] [info] [Task Finished] Transform to mem in 0.253786s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:14:47.735] [driver] [info] [Task Finished] Transform to mem in 0.249961s (14086 normal rows, 9989 exceptions)
[2021-03-31 18:14:47.986] [driver] [info] [Task Finished] Transform to mem in 0.250669s (14097 normal rows, 10002 exceptions)
[2021-03-31 18:14:48.237] [driver] [info] [Task Finished] Transform to mem in 0.250692s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:14:48.487] [driver] [info] [Task Finished] Transform to mem in 0.250343s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:14:48.738] [driver] [info] [Task Finished] Transform to mem in 0.250732s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:14:48.989] [driver] [info] [Task Finished] Transform to mem in 0.250803s (14212 normal rows, 10032 exceptions)
[2021-03-31 18:14:49.239] [driver] [info] [Task Finished] Transform to mem in 0.250464s (14099 normal rows, 10008 exceptions)
[2021-03-31 18:14:49.490] [driver] [info] [Task Finished] Transform to mem in 0.250565s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:14:49.740] [driver] [info] [Task Finished] Transform to mem in 0.250856s (14223 normal rows, 10035 exceptions)
[2021-03-31 18:14:49.991] [driver] [info] [Task Finished] Transform to mem in 0.250405s (14089 normal rows, 10008 exceptions)
[2021-03-31 18:14:50.241] [driver] [info] [Task Finished] Transform to mem in 0.250328s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:14:50.492] [driver] [info] [Task Finished] Transform to mem in 0.251046s (14235 normal rows, 10062 exceptions)
[2021-03-31 18:14:50.746] [driver] [info] [Task Finished] Transform to mem in 0.253563s (14170 normal rows, 9994 exceptions)
[2021-03-31 18:14:50.997] [driver] [info] [Task Finished] Transform to mem in 0.251591s (14002 normal rows, 9940 exceptions)
[2021-03-31 18:14:51.250] [driver] [info] [Task Finished] Transform to mem in 0.252770s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:14:51.501] [driver] [info] [Task Finished] Transform to mem in 0.250677s (14206 normal rows, 9991 exceptions)
[2021-03-31 18:14:51.751] [driver] [info] [Task Finished] Transform to mem in 0.250298s (13961 normal rows, 9925 exceptions)
[2021-03-31 18:14:52.002] [driver] [info] [Task Finished] Transform to mem in 0.250968s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:14:52.253] [driver] [info] [Task Finished] Transform to mem in 0.250525s (14233 normal rows, 10011 exceptions)
[2021-03-31 18:14:52.503] [driver] [info] [Task Finished] Transform to mem in 0.249871s (13915 normal rows, 9900 exceptions)
[2021-03-31 18:14:52.754] [driver] [info] [Task Finished] Transform to mem in 0.251193s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:14:53.005] [driver] [info] [Task Finished] Transform to mem in 0.250791s (14267 normal rows, 10030 exceptions)
[2021-03-31 18:14:53.255] [driver] [info] [Task Finished] Transform to mem in 0.250012s (13892 normal rows, 9882 exceptions)
[2021-03-31 18:14:53.506] [driver] [info] [Task Finished] Transform to mem in 0.251200s (14245 normal rows, 10101 exceptions)
[2021-03-31 18:14:53.756] [driver] [info] [Task Finished] Transform to mem in 0.250548s (14260 normal rows, 10025 exceptions)
[2021-03-31 18:14:54.007] [driver] [info] [Task Finished] Transform to mem in 0.250093s (13978 normal rows, 9907 exceptions)
[2021-03-31 18:14:54.261] [driver] [info] [Task Finished] Transform to mem in 0.254173s (14181 normal rows, 10067 exceptions)
[2021-03-31 18:14:54.511] [driver] [info] [Task Finished] Transform to mem in 0.250581s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:14:54.765] [driver] [info] [Task Finished] Transform to mem in 0.253279s (14015 normal rows, 9982 exceptions)
[2021-03-31 18:14:55.015] [driver] [info] [Task Finished] Transform to mem in 0.250685s (14142 normal rows, 9989 exceptions)
[2021-03-31 18:14:55.266] [driver] [info] [Task Finished] Transform to mem in 0.250763s (14280 normal rows, 10094 exceptions)
[2021-03-31 18:14:55.516] [driver] [info] [Task Finished] Transform to mem in 0.250025s (13982 normal rows, 9975 exceptions)
[2021-03-31 18:14:55.767] [driver] [info] [Task Finished] Transform to mem in 0.250874s (14173 normal rows, 10006 exceptions)
[2021-03-31 18:14:56.018] [driver] [info] [Task Finished] Transform to mem in 0.250680s (14235 normal rows, 10040 exceptions)
[2021-03-31 18:14:56.268] [driver] [info] [Task Finished] Transform to mem in 0.250512s (14054 normal rows, 9984 exceptions)
[2021-03-31 18:14:56.519] [driver] [info] [Task Finished] Transform to mem in 0.250905s (14129 normal rows, 10004 exceptions)
[2021-03-31 18:14:56.770] [driver] [info] [Task Finished] Transform to mem in 0.250979s (14223 normal rows, 10033 exceptions)
[2021-03-31 18:14:57.021] [driver] [info] [Task Finished] Transform to mem in 0.250440s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:14:57.272] [driver] [info] [Task Finished] Transform to mem in 0.250847s (14108 normal rows, 10010 exceptions)
[2021-03-31 18:14:57.522] [driver] [info] [Task Finished] Transform to mem in 0.250641s (14208 normal rows, 10008 exceptions)
[2021-03-31 18:14:57.772] [driver] [info] [Task Finished] Transform to mem in 0.250250s (14089 normal rows, 10031 exceptions)
[2021-03-31 18:14:58.026] [driver] [info] [Task Finished] Transform to mem in 0.253536s (14094 normal rows, 9960 exceptions)
[2021-03-31 18:14:58.276] [driver] [info] [Task Finished] Transform to mem in 0.250170s (14232 normal rows, 10017 exceptions)
[2021-03-31 18:14:58.530] [driver] [info] [Task Finished] Transform to mem in 0.253793s (14088 normal rows, 10027 exceptions)
[2021-03-31 18:14:58.781] [driver] [info] [Task Finished] Transform to mem in 0.250493s (14106 normal rows, 9955 exceptions)
[2021-03-31 18:14:59.031] [driver] [info] [Task Finished] Transform to mem in 0.250629s (14211 normal rows, 10043 exceptions)
[2021-03-31 18:14:59.281] [driver] [info] [Task Finished] Transform to mem in 0.250064s (14113 normal rows, 9997 exceptions)
[2021-03-31 18:14:59.532] [driver] [info] [Task Finished] Transform to mem in 0.250535s (14075 normal rows, 9965 exceptions)
[2021-03-31 18:14:59.783] [driver] [info] [Task Finished] Transform to mem in 0.250876s (14223 normal rows, 10049 exceptions)
[2021-03-31 18:15:00.033] [driver] [info] [Task Finished] Transform to mem in 0.250098s (14095 normal rows, 9995 exceptions)
[2021-03-31 18:15:00.283] [driver] [info] [Task Finished] Transform to mem in 0.250229s (14086 normal rows, 9952 exceptions)
[2021-03-31 18:15:00.534] [driver] [info] [Task Finished] Transform to mem in 0.250625s (14226 normal rows, 10069 exceptions)
[2021-03-31 18:15:00.784] [driver] [info] [Task Finished] Transform to mem in 0.250554s (14170 normal rows, 9996 exceptions)
[2021-03-31 18:15:01.035] [driver] [info] [Task Finished] Transform to mem in 0.250259s (14002 normal rows, 9931 exceptions)
[2021-03-31 18:15:01.285] [driver] [info] [Task Finished] Transform to mem in 0.250586s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:15:01.536] [driver] [info] [Task Finished] Transform to mem in 0.250611s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:15:01.789] [driver] [info] [Task Finished] Transform to mem in 0.252844s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:15:02.042] [driver] [info] [Task Finished] Transform to mem in 0.252904s (14237 normal rows, 10084 exceptions)
[2021-03-31 18:15:02.294] [driver] [info] [Task Finished] Transform to mem in 0.251986s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:15:02.544] [driver] [info] [Task Finished] Transform to mem in 0.250683s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:15:02.795] [driver] [info] [Task Finished] Transform to mem in 0.251144s (14267 normal rows, 10099 exceptions)
[2021-03-31 18:15:03.046] [driver] [info] [Task Finished] Transform to mem in 0.250681s (14248 normal rows, 10030 exceptions)
[2021-03-31 18:15:03.296] [driver] [info] [Task Finished] Transform to mem in 0.250241s (13912 normal rows, 9882 exceptions)
[2021-03-31 18:15:03.548] [driver] [info] [Task Finished] Transform to mem in 0.251257s (14248 normal rows, 10094 exceptions)
[2021-03-31 18:15:03.799] [driver] [info] [Task Finished] Transform to mem in 0.251270s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:15:04.049] [driver] [info] [Task Finished] Transform to mem in 0.250157s (13988 normal rows, 9922 exceptions)
[2021-03-31 18:15:04.300] [driver] [info] [Task Finished] Transform to mem in 0.251249s (14171 normal rows, 10052 exceptions)
[2021-03-31 18:15:04.551] [driver] [info] [Task Finished] Transform to mem in 0.250809s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:15:04.801] [driver] [info] [Task Finished] Transform to mem in 0.250183s (14015 normal rows, 9985 exceptions)
[2021-03-31 18:15:05.052] [driver] [info] [Task Finished] Transform to mem in 0.250583s (14176 normal rows, 9997 exceptions)
[2021-03-31 18:15:05.302] [driver] [info] [Task Finished] Transform to mem in 0.250275s (14246 normal rows, 10108 exceptions)
[2021-03-31 18:15:05.553] [driver] [info] [Task Finished] Transform to mem in 0.250280s (14059 normal rows, 9978 exceptions)
[2021-03-31 18:15:05.806] [driver] [info] [Task Finished] Transform to mem in 0.253855s (14114 normal rows, 10011 exceptions)
[2021-03-31 18:15:06.057] [driver] [info] [Task Finished] Transform to mem in 0.250559s (14238 normal rows, 10007 exceptions)
[2021-03-31 18:15:06.307] [driver] [info] [Task Finished] Transform to mem in 0.250414s (14081 normal rows, 10003 exceptions)
[2021-03-31 18:15:06.558] [driver] [info] [Task Finished] Transform to mem in 0.250624s (14095 normal rows, 10024 exceptions)
[2021-03-31 18:15:06.809] [driver] [info] [Task Finished] Transform to mem in 0.250720s (14221 normal rows, 9998 exceptions)
[2021-03-31 18:15:07.059] [driver] [info] [Task Finished] Transform to mem in 0.250610s (14086 normal rows, 9998 exceptions)
[2021-03-31 18:15:07.310] [driver] [info] [Task Finished] Transform to mem in 0.250909s (14091 normal rows, 10001 exceptions)
[2021-03-31 18:15:07.561] [driver] [info] [Task Finished] Transform to mem in 0.250622s (14218 normal rows, 10016 exceptions)
[2021-03-31 18:15:07.811] [driver] [info] [Task Finished] Transform to mem in 0.250362s (14095 normal rows, 10026 exceptions)
[2021-03-31 18:15:08.062] [driver] [info] [Task Finished] Transform to mem in 0.250650s (14113 normal rows, 9960 exceptions)
[2021-03-31 18:15:08.313] [driver] [info] [Task Finished] Transform to mem in 0.250602s (14197 normal rows, 10028 exceptions)
[2021-03-31 18:15:08.563] [driver] [info] [Task Finished] Transform to mem in 0.250560s (14114 normal rows, 10012 exceptions)
[2021-03-31 18:15:08.813] [driver] [info] [Task Finished] Transform to mem in 0.250150s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:15:09.064] [driver] [info] [Task Finished] Transform to mem in 0.250423s (14197 normal rows, 10033 exceptions)
[2021-03-31 18:15:09.314] [driver] [info] [Task Finished] Transform to mem in 0.250199s (14115 normal rows, 10010 exceptions)
[2021-03-31 18:15:09.568] [driver] [info] [Task Finished] Transform to mem in 0.253638s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:15:09.818] [driver] [info] [Task Finished] Transform to mem in 0.250418s (14235 normal rows, 10048 exceptions)
[2021-03-31 18:15:10.069] [driver] [info] [Task Finished] Transform to mem in 0.250581s (14144 normal rows, 9995 exceptions)
[2021-03-31 18:15:10.319] [driver] [info] [Task Finished] Transform to mem in 0.250486s (14015 normal rows, 9952 exceptions)
[2021-03-31 18:15:10.570] [driver] [info] [Task Finished] Transform to mem in 0.251179s (14237 normal rows, 10069 exceptions)
[2021-03-31 18:15:10.821] [driver] [info] [Task Finished] Transform to mem in 0.250537s (14159 normal rows, 9996 exceptions)
[2021-03-31 18:15:11.071] [driver] [info] [Task Finished] Transform to mem in 0.249950s (14010 normal rows, 9932 exceptions)
[2021-03-31 18:15:11.322] [driver] [info] [Task Finished] Transform to mem in 0.250887s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:15:11.574] [driver] [info] [Task Finished] Transform to mem in 0.251642s (14178 normal rows, 10009 exceptions)
[2021-03-31 18:15:11.824] [driver] [info] [Task Finished] Transform to mem in 0.250221s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:15:12.075] [driver] [info] [Task Finished] Transform to mem in 0.250817s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:15:12.325] [driver] [info] [Task Finished] Transform to mem in 0.250514s (14236 normal rows, 10015 exceptions)
[2021-03-31 18:15:12.575] [driver] [info] [Task Finished] Transform to mem in 0.249838s (13901 normal rows, 9892 exceptions)
[2021-03-31 18:15:12.826] [driver] [info] [Task Finished] Transform to mem in 0.250747s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:15:13.078] [driver] [info] [Task Finished] Transform to mem in 0.251851s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:15:13.329] [driver] [info] [Task Finished] Transform to mem in 0.251566s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:15:13.580] [driver] [info] [Task Finished] Transform to mem in 0.251144s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:15:13.831] [driver] [info] [Task Finished] Transform to mem in 0.250721s (14245 normal rows, 10024 exceptions)
[2021-03-31 18:15:14.081] [driver] [info] [Task Finished] Transform to mem in 0.250065s (13999 normal rows, 9935 exceptions)
[2021-03-31 18:15:14.332] [driver] [info] [Task Finished] Transform to mem in 0.250976s (14158 normal rows, 10036 exceptions)
[2021-03-31 18:15:14.583] [driver] [info] [Task Finished] Transform to mem in 0.250582s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:15:14.833] [driver] [info] [Task Finished] Transform to mem in 0.250389s (14020 normal rows, 9989 exceptions)
[2021-03-31 18:15:15.084] [driver] [info] [Task Finished] Transform to mem in 0.250754s (14173 normal rows, 10004 exceptions)
[2021-03-31 18:15:15.335] [driver] [info] [Task Finished] Transform to mem in 0.250756s (14235 normal rows, 10041 exceptions)
[2021-03-31 18:15:15.585] [driver] [info] [Task Finished] Transform to mem in 0.250328s (14054 normal rows, 9985 exceptions)
[2021-03-31 18:15:15.836] [driver] [info] [Task Finished] Transform to mem in 0.250583s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:15:16.086] [driver] [info] [Task Finished] Transform to mem in 0.250496s (14238 normal rows, 10033 exceptions)
[2021-03-31 18:15:16.336] [driver] [info] [Task Finished] Transform to mem in 0.249965s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:15:16.586] [driver] [info] [Task Finished] Transform to mem in 0.250267s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:15:16.840] [driver] [info] [Task Finished] Transform to mem in 0.253956s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:15:17.091] [driver] [info] [Task Finished] Transform to mem in 0.250163s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:15:17.341] [driver] [info] [Task Finished] Transform to mem in 0.250856s (14094 normal rows, 9996 exceptions)
[2021-03-31 18:15:17.592] [driver] [info] [Task Finished] Transform to mem in 0.250785s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:15:17.843] [driver] [info] [Task Finished] Transform to mem in 0.250593s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:15:18.094] [driver] [info] [Task Finished] Transform to mem in 0.250699s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:15:18.344] [driver] [info] [Task Finished] Transform to mem in 0.250835s (14217 normal rows, 10042 exceptions)
[2021-03-31 18:15:18.595] [driver] [info] [Task Finished] Transform to mem in 0.250165s (14094 normal rows, 9998 exceptions)
[2021-03-31 18:15:18.847] [driver] [info] [Task Finished] Transform to mem in 0.252518s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:15:19.098] [driver] [info] [Task Finished] Transform to mem in 0.250993s (14223 normal rows, 10048 exceptions)
[2021-03-31 18:15:19.350] [driver] [info] [Task Finished] Transform to mem in 0.251820s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:15:19.601] [driver] [info] [Task Finished] Transform to mem in 0.250708s (14086 normal rows, 9953 exceptions)
[2021-03-31 18:15:19.852] [driver] [info] [Task Finished] Transform to mem in 0.250935s (14232 normal rows, 10069 exceptions)
[2021-03-31 18:15:20.103] [driver] [info] [Task Finished] Transform to mem in 0.251446s (14170 normal rows, 9995 exceptions)
[2021-03-31 18:15:20.355] [driver] [info] [Task Finished] Transform to mem in 0.252190s (14002 normal rows, 9932 exceptions)
[2021-03-31 18:15:20.610] [driver] [info] [Task Finished] Transform to mem in 0.254344s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:15:20.860] [driver] [info] [Task Finished] Transform to mem in 0.250588s (14206 normal rows, 10009 exceptions)
[2021-03-31 18:15:21.110] [driver] [info] [Task Finished] Transform to mem in 0.250055s (13961 normal rows, 9907 exceptions)
[2021-03-31 18:15:21.361] [driver] [info] [Task Finished] Transform to mem in 0.250869s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:15:21.612] [driver] [info] [Task Finished] Transform to mem in 0.250782s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:15:21.904] [driver] [info] [Task Finished] Transform to mem in 0.292135s (16320 normal rows, 11605 exceptions)
[2021-03-31 18:15:21.904] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 40.1987s
[2021-03-31 18:15:21.904] [global] [info] [Transform Stage] Stage 0 total wall clock time: 40.1959s, 54108450 input rows, time to process 1 row via fast path: 0.000742877ms
[2021-03-31 18:15:21.904] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2021-03-31 18:15:21.908] [local ee] [info] compiled pure python pipeline in 0.003809s
[2021-03-31 18:15:21.908] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 18:15:21.909] [local ee] [info] Created 160 resolve tasks in 0.001182s
[2021-03-31 18:15:21.909] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 18:15:21.917] [driver] [info] [Task Finished] Resolve in 0.007116s
[2021-03-31 18:15:21.924] [driver] [info] [Task Finished] Resolve in 0.007201s
[2021-03-31 18:15:21.931] [driver] [info] [Task Finished] Resolve in 0.007100s
[2021-03-31 18:15:21.938] [driver] [info] [Task Finished] Resolve in 0.007080s
[2021-03-31 18:15:21.945] [driver] [info] [Task Finished] Resolve in 0.007224s
[2021-03-31 18:15:21.952] [driver] [info] [Task Finished] Resolve in 0.007091s
[2021-03-31 18:15:21.960] [driver] [info] [Task Finished] Resolve in 0.007253s
[2021-03-31 18:15:21.967] [driver] [info] [Task Finished] Resolve in 0.007154s
[2021-03-31 18:15:21.974] [driver] [info] [Task Finished] Resolve in 0.007109s
[2021-03-31 18:15:21.981] [driver] [info] [Task Finished] Resolve in 0.007217s
[2021-03-31 18:15:21.988] [driver] [info] [Task Finished] Resolve in 0.007036s
[2021-03-31 18:15:21.995] [driver] [info] [Task Finished] Resolve in 0.007145s
[2021-03-31 18:15:22.002] [driver] [info] [Task Finished] Resolve in 0.007171s
[2021-03-31 18:15:22.010] [driver] [info] [Task Finished] Resolve in 0.007146s
[2021-03-31 18:15:22.017] [driver] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:15:22.024] [driver] [info] [Task Finished] Resolve in 0.007168s
[2021-03-31 18:15:22.031] [driver] [info] [Task Finished] Resolve in 0.007216s
[2021-03-31 18:15:22.038] [driver] [info] [Task Finished] Resolve in 0.006971s
[2021-03-31 18:15:22.045] [driver] [info] [Task Finished] Resolve in 0.007189s
[2021-03-31 18:15:22.053] [driver] [info] [Task Finished] Resolve in 0.007214s
[2021-03-31 18:15:22.060] [driver] [info] [Task Finished] Resolve in 0.007075s
[2021-03-31 18:15:22.067] [driver] [info] [Task Finished] Resolve in 0.007086s
[2021-03-31 18:15:22.074] [driver] [info] [Task Finished] Resolve in 0.007330s
[2021-03-31 18:15:22.081] [driver] [info] [Task Finished] Resolve in 0.007167s
[2021-03-31 18:15:22.088] [driver] [info] [Task Finished] Resolve in 0.006993s
[2021-03-31 18:15:22.096] [driver] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:15:22.103] [driver] [info] [Task Finished] Resolve in 0.007161s
[2021-03-31 18:15:22.110] [driver] [info] [Task Finished] Resolve in 0.007090s
[2021-03-31 18:15:22.117] [driver] [info] [Task Finished] Resolve in 0.007103s
[2021-03-31 18:15:22.124] [driver] [info] [Task Finished] Resolve in 0.007283s
[2021-03-31 18:15:22.131] [driver] [info] [Task Finished] Resolve in 0.007150s
[2021-03-31 18:15:22.138] [driver] [info] [Task Finished] Resolve in 0.007024s
[2021-03-31 18:15:22.146] [driver] [info] [Task Finished] Resolve in 0.007171s
[2021-03-31 18:15:22.153] [driver] [info] [Task Finished] Resolve in 0.007156s
[2021-03-31 18:15:22.160] [driver] [info] [Task Finished] Resolve in 0.007160s
[2021-03-31 18:15:22.167] [driver] [info] [Task Finished] Resolve in 0.007055s
[2021-03-31 18:15:22.174] [driver] [info] [Task Finished] Resolve in 0.007126s
[2021-03-31 18:15:22.182] [driver] [info] [Task Finished] Resolve in 0.007352s
[2021-03-31 18:15:22.189] [driver] [info] [Task Finished] Resolve in 0.007042s
[2021-03-31 18:15:22.196] [driver] [info] [Task Finished] Resolve in 0.007133s
[2021-03-31 18:15:22.203] [driver] [info] [Task Finished] Resolve in 0.007210s
[2021-03-31 18:15:22.210] [driver] [info] [Task Finished] Resolve in 0.007184s
[2021-03-31 18:15:22.217] [driver] [info] [Task Finished] Resolve in 0.006941s
[2021-03-31 18:15:22.224] [driver] [info] [Task Finished] Resolve in 0.007221s
[2021-03-31 18:15:22.232] [driver] [info] [Task Finished] Resolve in 0.007248s
[2021-03-31 18:15:22.239] [driver] [info] [Task Finished] Resolve in 0.006997s
[2021-03-31 18:15:22.246] [driver] [info] [Task Finished] Resolve in 0.007256s
[2021-03-31 18:15:22.253] [driver] [info] [Task Finished] Resolve in 0.007224s
[2021-03-31 18:15:22.260] [driver] [info] [Task Finished] Resolve in 0.007081s
[2021-03-31 18:15:22.267] [driver] [info] [Task Finished] Resolve in 0.007060s
[2021-03-31 18:15:22.275] [driver] [info] [Task Finished] Resolve in 0.007207s
[2021-03-31 18:15:22.282] [driver] [info] [Task Finished] Resolve in 0.007131s
[2021-03-31 18:15:22.289] [driver] [info] [Task Finished] Resolve in 0.007130s
[2021-03-31 18:15:22.296] [driver] [info] [Task Finished] Resolve in 0.007256s
[2021-03-31 18:15:22.303] [driver] [info] [Task Finished] Resolve in 0.007107s
[2021-03-31 18:15:22.310] [driver] [info] [Task Finished] Resolve in 0.007177s
[2021-03-31 18:15:22.317] [driver] [info] [Task Finished] Resolve in 0.007055s
[2021-03-31 18:15:22.325] [driver] [info] [Task Finished] Resolve in 0.007156s
[2021-03-31 18:15:22.332] [driver] [info] [Task Finished] Resolve in 0.007162s
[2021-03-31 18:15:22.339] [driver] [info] [Task Finished] Resolve in 0.007016s
[2021-03-31 18:15:22.346] [driver] [info] [Task Finished] Resolve in 0.007297s
[2021-03-31 18:15:22.353] [driver] [info] [Task Finished] Resolve in 0.007184s
[2021-03-31 18:15:22.361] [driver] [info] [Task Finished] Resolve in 0.007208s
[2021-03-31 18:15:22.368] [driver] [info] [Task Finished] Resolve in 0.006992s
[2021-03-31 18:15:22.375] [driver] [info] [Task Finished] Resolve in 0.007151s
[2021-03-31 18:15:22.382] [driver] [info] [Task Finished] Resolve in 0.007210s
[2021-03-31 18:15:22.389] [driver] [info] [Task Finished] Resolve in 0.006998s
[2021-03-31 18:15:22.396] [driver] [info] [Task Finished] Resolve in 0.007159s
[2021-03-31 18:15:22.403] [driver] [info] [Task Finished] Resolve in 0.007347s
[2021-03-31 18:15:22.411] [driver] [info] [Task Finished] Resolve in 0.007149s
[2021-03-31 18:15:22.418] [driver] [info] [Task Finished] Resolve in 0.006983s
[2021-03-31 18:15:22.425] [driver] [info] [Task Finished] Resolve in 0.007225s
[2021-03-31 18:15:22.432] [driver] [info] [Task Finished] Resolve in 0.007152s
[2021-03-31 18:15:22.439] [driver] [info] [Task Finished] Resolve in 0.006957s
[2021-03-31 18:15:22.446] [driver] [info] [Task Finished] Resolve in 0.007225s
[2021-03-31 18:15:22.454] [driver] [info] [Task Finished] Resolve in 0.007320s
[2021-03-31 18:15:22.461] [driver] [info] [Task Finished] Resolve in 0.007114s
[2021-03-31 18:15:22.468] [driver] [info] [Task Finished] Resolve in 0.007041s
[2021-03-31 18:15:22.475] [driver] [info] [Task Finished] Resolve in 0.007195s
[2021-03-31 18:15:22.482] [driver] [info] [Task Finished] Resolve in 0.007103s
[2021-03-31 18:15:22.489] [driver] [info] [Task Finished] Resolve in 0.007053s
[2021-03-31 18:15:22.496] [driver] [info] [Task Finished] Resolve in 0.007213s
[2021-03-31 18:15:22.503] [driver] [info] [Task Finished] Resolve in 0.007082s
[2021-03-31 18:15:22.511] [driver] [info] [Task Finished] Resolve in 0.007347s
[2021-03-31 18:15:22.518] [driver] [info] [Task Finished] Resolve in 0.007060s
[2021-03-31 18:15:22.525] [driver] [info] [Task Finished] Resolve in 0.007095s
[2021-03-31 18:15:22.532] [driver] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:15:22.539] [driver] [info] [Task Finished] Resolve in 0.007081s
[2021-03-31 18:15:22.546] [driver] [info] [Task Finished] Resolve in 0.007066s
[2021-03-31 18:15:22.554] [driver] [info] [Task Finished] Resolve in 0.007197s
[2021-03-31 18:15:22.561] [driver] [info] [Task Finished] Resolve in 0.007221s
[2021-03-31 18:15:22.568] [driver] [info] [Task Finished] Resolve in 0.007107s
[2021-03-31 18:15:22.575] [driver] [info] [Task Finished] Resolve in 0.007180s
[2021-03-31 18:15:22.582] [driver] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:15:22.589] [driver] [info] [Task Finished] Resolve in 0.007032s
[2021-03-31 18:15:22.597] [driver] [info] [Task Finished] Resolve in 0.007138s
[2021-03-31 18:15:22.604] [driver] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:15:22.611] [driver] [info] [Task Finished] Resolve in 0.007142s
[2021-03-31 18:15:22.618] [driver] [info] [Task Finished] Resolve in 0.007123s
[2021-03-31 18:15:22.625] [driver] [info] [Task Finished] Resolve in 0.007234s
[2021-03-31 18:15:22.632] [driver] [info] [Task Finished] Resolve in 0.007151s
[2021-03-31 18:15:22.640] [driver] [info] [Task Finished] Resolve in 0.007039s
[2021-03-31 18:15:22.647] [driver] [info] [Task Finished] Resolve in 0.007120s
[2021-03-31 18:15:22.654] [driver] [info] [Task Finished] Resolve in 0.007175s
[2021-03-31 18:15:22.661] [driver] [info] [Task Finished] Resolve in 0.007176s
[2021-03-31 18:15:22.668] [driver] [info] [Task Finished] Resolve in 0.007019s
[2021-03-31 18:15:22.675] [driver] [info] [Task Finished] Resolve in 0.007300s
[2021-03-31 18:15:22.683] [driver] [info] [Task Finished] Resolve in 0.007139s
[2021-03-31 18:15:22.690] [driver] [info] [Task Finished] Resolve in 0.007113s
[2021-03-31 18:15:22.697] [driver] [info] [Task Finished] Resolve in 0.007097s
[2021-03-31 18:15:22.704] [driver] [info] [Task Finished] Resolve in 0.007144s
[2021-03-31 18:15:22.711] [driver] [info] [Task Finished] Resolve in 0.007198s
[2021-03-31 18:15:22.718] [driver] [info] [Task Finished] Resolve in 0.007006s
[2021-03-31 18:15:22.725] [driver] [info] [Task Finished] Resolve in 0.007144s
[2021-03-31 18:15:22.733] [driver] [info] [Task Finished] Resolve in 0.007363s
[2021-03-31 18:15:22.740] [driver] [info] [Task Finished] Resolve in 0.007097s
[2021-03-31 18:15:22.747] [driver] [info] [Task Finished] Resolve in 0.007012s
[2021-03-31 18:15:22.754] [driver] [info] [Task Finished] Resolve in 0.007227s
[2021-03-31 18:15:22.761] [driver] [info] [Task Finished] Resolve in 0.007209s
[2021-03-31 18:15:22.768] [driver] [info] [Task Finished] Resolve in 0.006930s
[2021-03-31 18:15:22.775] [driver] [info] [Task Finished] Resolve in 0.007246s
[2021-03-31 18:15:22.783] [driver] [info] [Task Finished] Resolve in 0.007346s
[2021-03-31 18:15:22.790] [driver] [info] [Task Finished] Resolve in 0.007032s
[2021-03-31 18:15:22.797] [driver] [info] [Task Finished] Resolve in 0.007135s
[2021-03-31 18:15:22.804] [driver] [info] [Task Finished] Resolve in 0.007213s
[2021-03-31 18:15:22.811] [driver] [info] [Task Finished] Resolve in 0.007110s
[2021-03-31 18:15:22.818] [driver] [info] [Task Finished] Resolve in 0.007028s
[2021-03-31 18:15:22.826] [driver] [info] [Task Finished] Resolve in 0.007248s
[2021-03-31 18:15:22.833] [driver] [info] [Task Finished] Resolve in 0.007122s
[2021-03-31 18:15:22.840] [driver] [info] [Task Finished] Resolve in 0.007268s
[2021-03-31 18:15:22.847] [driver] [info] [Task Finished] Resolve in 0.007084s
[2021-03-31 18:15:22.854] [driver] [info] [Task Finished] Resolve in 0.007139s
[2021-03-31 18:15:22.862] [driver] [info] [Task Finished] Resolve in 0.007190s
[2021-03-31 18:15:22.869] [driver] [info] [Task Finished] Resolve in 0.007046s
[2021-03-31 18:15:22.876] [driver] [info] [Task Finished] Resolve in 0.007168s
[2021-03-31 18:15:22.883] [driver] [info] [Task Finished] Resolve in 0.007147s
[2021-03-31 18:15:22.890] [driver] [info] [Task Finished] Resolve in 0.007184s
[2021-03-31 18:15:22.897] [driver] [info] [Task Finished] Resolve in 0.007169s
[2021-03-31 18:15:22.904] [driver] [info] [Task Finished] Resolve in 0.007165s
[2021-03-31 18:15:22.912] [driver] [info] [Task Finished] Resolve in 0.007214s
[2021-03-31 18:15:22.919] [driver] [info] [Task Finished] Resolve in 0.006973s
[2021-03-31 18:15:22.926] [driver] [info] [Task Finished] Resolve in 0.007178s
[2021-03-31 18:15:22.933] [driver] [info] [Task Finished] Resolve in 0.007217s
[2021-03-31 18:15:22.940] [driver] [info] [Task Finished] Resolve in 0.007161s
[2021-03-31 18:15:22.947] [driver] [info] [Task Finished] Resolve in 0.007118s
[2021-03-31 18:15:22.955] [driver] [info] [Task Finished] Resolve in 0.007199s
[2021-03-31 18:15:22.962] [driver] [info] [Task Finished] Resolve in 0.007162s
[2021-03-31 18:15:22.969] [driver] [info] [Task Finished] Resolve in 0.006987s
[2021-03-31 18:15:22.976] [driver] [info] [Task Finished] Resolve in 0.007234s
[2021-03-31 18:15:22.983] [driver] [info] [Task Finished] Resolve in 0.007140s
[2021-03-31 18:15:22.990] [driver] [info] [Task Finished] Resolve in 0.007164s
[2021-03-31 18:15:22.997] [driver] [info] [Task Finished] Resolve in 0.007066s
[2021-03-31 18:15:23.005] [driver] [info] [Task Finished] Resolve in 0.007331s
[2021-03-31 18:15:23.012] [driver] [info] [Task Finished] Resolve in 0.007113s
[2021-03-31 18:15:23.019] [driver] [info] [Task Finished] Resolve in 0.007036s
[2021-03-31 18:15:23.026] [driver] [info] [Task Finished] Resolve in 0.007213s
[2021-03-31 18:15:23.033] [driver] [info] [Task Finished] Resolve in 0.007107s
[2021-03-31 18:15:23.041] [driver] [info] [Task Finished] Resolve in 0.007216s
[2021-03-31 18:15:23.048] [driver] [info] [Task Finished] Resolve in 0.007038s
[2021-03-31 18:15:23.056] [driver] [info] [Task Finished] Resolve in 0.008329s
[2021-03-31 18:15:23.056] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 1.15177s
[2021-03-31 18:15:23.056] [local ee] [info] slow path for Stage 0: total wall clock time: 1.14465s, time to process 1 row via slow path: 0.000714249ms
[2021-03-31 18:15:23.056] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.1518s

[2021-03-31 18:15:23.093] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2021-03-31 18:15:23.507] [driver] [info] [Task Finished] write to file in 0.413831s (2264570 rows, 344.74 MB)
[2021-03-31 18:15:23.507] [global] [info] writing output took 0.451148s
[2021-03-31 18:15:23.507] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.451257s
[2021-03-31 18:15:23.507] [global] [info] [Transform Stage] Stage 0 took 42.2471s
[2021-03-31 18:15:23.507] [global] [info] Query Execution took 42.3444s. (planning: 0.0973087s, execution: 42.2471s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 05:47:10) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.005064964294433594
Tuplex job time: 42.607584953308105 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '6bcf8f6a24af', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0196831,"llvm_optimization_time_s":0.295406,"llvm_compilation_time_s":0.134507,"total_compilation_time_s":0.445282,"sampling_time_s":0.108775,"stages":[{"stage_no":0,"fast_path_wall_time_s":40.1959,"fast_path_time_s":40.1987,"fast_path_per_row_time_ns":742.877,"slow_path_wall_time_s":1.14465,"slow_path_time_s":1.15177,"slow_path_per_row_time_ns":714.249}]}
{"startupTime": 0.005064964294433594, "jobTime": 42.607584953308105}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 321 active partitions
