[2021-03-31 18:13:13.288] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:13:13.289] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:13:13.289] [local ee] [info] initializing LLVM backend
[2021-03-31 18:13:13.289] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:13:13.289] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/1] [info] starting detached process queue
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/2] [info] starting detached process queue
[2021-03-31 18:13:13.290] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [E/3] [info] starting detached process queue
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [E/4] [info] starting detached process queue
[2021-03-31 18:13:13.290] [E/5] [info] starting detached process queue
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [E/6] [info] starting detached process queue
[2021-03-31 18:13:13.290] [E/7] [info] starting detached process queue
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [E/8] [info] starting detached process queue
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/9] [info] starting detached process queue
[2021-03-31 18:13:13.290] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [E/10] [info] starting detached process queue
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.290] [E/11] [info] starting detached process queue
[2021-03-31 18:13:13.290] [E/12] [info] starting detached process queue
[2021-03-31 18:13:13.290] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.290] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.291] [E/13] [info] starting detached process queue
[2021-03-31 18:13:13.291] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.291] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.291] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.291] [E/14] [info] starting detached process queue
[2021-03-31 18:13:13.291] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:13.291] [E/15] [info] starting detached process queue
[2021-03-31 18:13:13.291] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.291] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 18:13:13.291] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:13:13.291] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:13.291] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 18:13:13.291] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2021-03-31 18:13:13.425] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.441] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.449] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.476] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.496] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.510] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.542] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.559] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:13.562] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:13.564] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:13.567] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:13.583] [logical planner] [info] logical optimization took 0.020360ms
[2021-03-31 18:13:13.584] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.587] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.591] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.595] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.598] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.600] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.602] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:13.610] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:13.610] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,f64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:13:13.611] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2021-03-31 18:13:13.611] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2021-03-31 18:13:13.612] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2021-03-31 18:13:13.613] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2021-03-31 18:13:13.613] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2021-03-31 18:13:13.614] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2021-03-31 18:13:13.614] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:13:13.615] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2021-03-31 18:13:13.616] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2021-03-31 18:13:13.617] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2021-03-31 18:13:13.618] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:13:13.619] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:13.619] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:13.620] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2021-03-31 18:13:13.621] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:13:13.622] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:13:13.622] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:13:13.623] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:13:13.624] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:13:13.624] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:13:13.625] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 18:13:13.626] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 18:13:13.627] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 18:13:13.628] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:13:13.629] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:13.629] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:13.630] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 18:13:13.660] [global] [info] Stage0 depends on: 
[2021-03-31 18:13:13.972] [global] [info] Optimization via LLVM passes took 0.296391 ms
[2021-03-31 18:13:14.106] [global] [info] Compiled code paths for stage 0 in 0.13 ms
[2021-03-31 18:13:14.106] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.446867s
[2021-03-31 18:13:14.107] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2021-03-31 18:13:14.360] [E/1] [info] [Task Finished] Transform to mem in 0.252711s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:13:14.360] [E/11] [info] [Task Finished] Transform to mem in 0.252801s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:13:14.360] [E/4] [info] [Task Finished] Transform to mem in 0.253129s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:13:14.360] [E/13] [info] [Task Finished] Transform to mem in 0.253234s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:13:14.360] [E/15] [info] [Task Finished] Transform to mem in 0.253298s (14020 normal rows, 9982 exceptions)
[2021-03-31 18:13:14.360] [E/8] [info] [Task Finished] Transform to mem in 0.253314s (13988 normal rows, 9938 exceptions)
[2021-03-31 18:13:14.360] [E/7] [info] [Task Finished] Transform to mem in 0.253432s (14217 normal rows, 10015 exceptions)
[2021-03-31 18:13:14.360] [E/2] [info] [Task Finished] Transform to mem in 0.253595s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:13:14.360] [E/6] [info] [Task Finished] Transform to mem in 0.253711s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:13:14.361] [E/14] [info] [Task Finished] Transform to mem in 0.253802s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:13:14.361] [E/9] [info] [Task Finished] Transform to mem in 0.253829s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:13:14.361] [E/5] [info] [Task Finished] Transform to mem in 0.253979s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:13:14.361] [E/12] [info] [Task Finished] Transform to mem in 0.254050s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:13:14.362] [E/10] [info] [Task Finished] Transform to mem in 0.254752s (14162 normal rows, 9952 exceptions)
[2021-03-31 18:13:14.362] [driver] [info] [Task Finished] Transform to mem in 0.254857s (14177 normal rows, 10036 exceptions)
[2021-03-31 18:13:14.368] [E/3] [info] [Task Finished] Transform to mem in 0.261214s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:13:14.610] [E/1] [info] [Task Finished] Transform to mem in 0.250161s (14241 normal rows, 10100 exceptions)
[2021-03-31 18:13:14.610] [E/11] [info] [Task Finished] Transform to mem in 0.250084s (14059 normal rows, 9985 exceptions)
[2021-03-31 18:13:14.610] [E/2] [info] [Task Finished] Transform to mem in 0.249620s (14086 normal rows, 9989 exceptions)
[2021-03-31 18:13:14.610] [E/4] [info] [Task Finished] Transform to mem in 0.250230s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:13:14.610] [E/15] [info] [Task Finished] Transform to mem in 0.250233s (14081 normal rows, 9995 exceptions)
[2021-03-31 18:13:14.610] [E/13] [info] [Task Finished] Transform to mem in 0.250358s (14238 normal rows, 10030 exceptions)
[2021-03-31 18:13:14.611] [E/8] [info] [Task Finished] Transform to mem in 0.250385s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:13:14.611] [E/7] [info] [Task Finished] Transform to mem in 0.250286s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:13:14.611] [E/6] [info] [Task Finished] Transform to mem in 0.250065s (14097 normal rows, 10002 exceptions)
[2021-03-31 18:13:14.611] [E/9] [info] [Task Finished] Transform to mem in 0.250269s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:13:14.611] [E/5] [info] [Task Finished] Transform to mem in 0.250285s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:13:14.611] [E/14] [info] [Task Finished] Transform to mem in 0.250503s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:13:14.611] [E/12] [info] [Task Finished] Transform to mem in 0.250496s (14212 normal rows, 10032 exceptions)
[2021-03-31 18:13:14.613] [E/10] [info] [Task Finished] Transform to mem in 0.251098s (14099 normal rows, 10008 exceptions)
[2021-03-31 18:13:14.613] [driver] [info] [Task Finished] Transform to mem in 0.251268s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:13:14.626] [E/3] [info] [Task Finished] Transform to mem in 0.258168s (14223 normal rows, 10035 exceptions)
[2021-03-31 18:13:14.859] [E/1] [info] [Task Finished] Transform to mem in 0.249458s (14089 normal rows, 10008 exceptions)
[2021-03-31 18:13:14.860] [E/4] [info] [Task Finished] Transform to mem in 0.249463s (14170 normal rows, 9994 exceptions)
[2021-03-31 18:13:14.860] [E/11] [info] [Task Finished] Transform to mem in 0.249993s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:13:14.860] [E/2] [info] [Task Finished] Transform to mem in 0.249980s (14235 normal rows, 10062 exceptions)
[2021-03-31 18:13:14.860] [E/7] [info] [Task Finished] Transform to mem in 0.249602s (13961 normal rows, 9925 exceptions)
[2021-03-31 18:13:14.860] [E/15] [info] [Task Finished] Transform to mem in 0.249912s (14002 normal rows, 9940 exceptions)
[2021-03-31 18:13:14.861] [E/5] [info] [Task Finished] Transform to mem in 0.249488s (13915 normal rows, 9900 exceptions)
[2021-03-31 18:13:14.861] [E/8] [info] [Task Finished] Transform to mem in 0.250187s (14206 normal rows, 9991 exceptions)
[2021-03-31 18:13:14.861] [E/6] [info] [Task Finished] Transform to mem in 0.250155s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:13:14.861] [E/13] [info] [Task Finished] Transform to mem in 0.250419s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:13:14.861] [E/9] [info] [Task Finished] Transform to mem in 0.250124s (14233 normal rows, 10011 exceptions)
[2021-03-31 18:13:14.862] [E/12] [info] [Task Finished] Transform to mem in 0.250154s (14267 normal rows, 10030 exceptions)
[2021-03-31 18:13:14.862] [E/14] [info] [Task Finished] Transform to mem in 0.250656s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:13:14.863] [E/10] [info] [Task Finished] Transform to mem in 0.250260s (13892 normal rows, 9882 exceptions)
[2021-03-31 18:13:14.864] [driver] [info] [Task Finished] Transform to mem in 0.250980s (14245 normal rows, 10101 exceptions)
[2021-03-31 18:13:14.885] [E/3] [info] [Task Finished] Transform to mem in 0.258389s (14260 normal rows, 10025 exceptions)
[2021-03-31 18:13:15.108] [E/1] [info] [Task Finished] Transform to mem in 0.249050s (13978 normal rows, 9907 exceptions)
[2021-03-31 18:13:15.109] [E/2] [info] [Task Finished] Transform to mem in 0.249202s (14015 normal rows, 9982 exceptions)
[2021-03-31 18:13:15.110] [E/11] [info] [Task Finished] Transform to mem in 0.250053s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:13:15.110] [E/4] [info] [Task Finished] Transform to mem in 0.250154s (14181 normal rows, 10067 exceptions)
[2021-03-31 18:13:15.110] [E/5] [info] [Task Finished] Transform to mem in 0.249491s (13982 normal rows, 9975 exceptions)
[2021-03-31 18:13:15.110] [E/13] [info] [Task Finished] Transform to mem in 0.249290s (14054 normal rows, 9984 exceptions)
[2021-03-31 18:13:15.110] [E/7] [info] [Task Finished] Transform to mem in 0.250180s (14142 normal rows, 9989 exceptions)
[2021-03-31 18:13:15.111] [E/6] [info] [Task Finished] Transform to mem in 0.249796s (14235 normal rows, 10040 exceptions)
[2021-03-31 18:13:15.111] [E/15] [info] [Task Finished] Transform to mem in 0.250334s (14280 normal rows, 10094 exceptions)
[2021-03-31 18:13:15.111] [E/8] [info] [Task Finished] Transform to mem in 0.250272s (14173 normal rows, 10006 exceptions)
[2021-03-31 18:13:15.111] [E/9] [info] [Task Finished] Transform to mem in 0.250038s (14129 normal rows, 10004 exceptions)
[2021-03-31 18:13:15.111] [E/12] [info] [Task Finished] Transform to mem in 0.249879s (14223 normal rows, 10033 exceptions)
[2021-03-31 18:13:15.112] [E/14] [info] [Task Finished] Transform to mem in 0.249876s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:13:15.114] [E/10] [info] [Task Finished] Transform to mem in 0.250797s (14108 normal rows, 10010 exceptions)
[2021-03-31 18:13:15.114] [driver] [info] [Task Finished] Transform to mem in 0.249898s (14208 normal rows, 10008 exceptions)
[2021-03-31 18:13:15.142] [E/3] [info] [Task Finished] Transform to mem in 0.257778s (14089 normal rows, 10031 exceptions)
[2021-03-31 18:13:15.362] [E/1] [info] [Task Finished] Transform to mem in 0.253315s (14094 normal rows, 9960 exceptions)
[2021-03-31 18:13:15.362] [E/2] [info] [Task Finished] Transform to mem in 0.253091s (14232 normal rows, 10017 exceptions)
[2021-03-31 18:13:15.363] [E/11] [info] [Task Finished] Transform to mem in 0.253032s (14088 normal rows, 10027 exceptions)
[2021-03-31 18:13:15.363] [E/4] [info] [Task Finished] Transform to mem in 0.253072s (14106 normal rows, 9955 exceptions)
[2021-03-31 18:13:15.363] [E/13] [info] [Task Finished] Transform to mem in 0.253032s (14113 normal rows, 9997 exceptions)
[2021-03-31 18:13:15.363] [E/15] [info] [Task Finished] Transform to mem in 0.252817s (14095 normal rows, 9995 exceptions)
[2021-03-31 18:13:15.364] [E/7] [info] [Task Finished] Transform to mem in 0.253321s (14075 normal rows, 9965 exceptions)
[2021-03-31 18:13:15.364] [E/5] [info] [Task Finished] Transform to mem in 0.253761s (14211 normal rows, 10043 exceptions)
[2021-03-31 18:13:15.364] [E/6] [info] [Task Finished] Transform to mem in 0.253482s (14223 normal rows, 10049 exceptions)
[2021-03-31 18:13:15.364] [E/8] [info] [Task Finished] Transform to mem in 0.253276s (14086 normal rows, 9952 exceptions)
[2021-03-31 18:13:15.365] [E/12] [info] [Task Finished] Transform to mem in 0.253209s (14170 normal rows, 9996 exceptions)
[2021-03-31 18:13:15.365] [E/9] [info] [Task Finished] Transform to mem in 0.253766s (14226 normal rows, 10069 exceptions)
[2021-03-31 18:13:15.365] [E/14] [info] [Task Finished] Transform to mem in 0.253216s (14002 normal rows, 9931 exceptions)
[2021-03-31 18:13:15.367] [driver] [info] [Task Finished] Transform to mem in 0.253494s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:13:15.368] [E/10] [info] [Task Finished] Transform to mem in 0.254518s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:13:15.403] [E/3] [info] [Task Finished] Transform to mem in 0.260699s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:13:15.612] [E/1] [info] [Task Finished] Transform to mem in 0.250205s (14237 normal rows, 10084 exceptions)
[2021-03-31 18:13:15.612] [E/11] [info] [Task Finished] Transform to mem in 0.249372s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:13:15.613] [E/2] [info] [Task Finished] Transform to mem in 0.250493s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:13:15.613] [E/15] [info] [Task Finished] Transform to mem in 0.249413s (13912 normal rows, 9882 exceptions)
[2021-03-31 18:13:15.613] [E/4] [info] [Task Finished] Transform to mem in 0.250288s (14267 normal rows, 10099 exceptions)
[2021-03-31 18:13:15.613] [E/6] [info] [Task Finished] Transform to mem in 0.249242s (13988 normal rows, 9922 exceptions)
[2021-03-31 18:13:15.613] [E/13] [info] [Task Finished] Transform to mem in 0.250216s (14248 normal rows, 10030 exceptions)
[2021-03-31 18:13:15.614] [E/7] [info] [Task Finished] Transform to mem in 0.250703s (14248 normal rows, 10094 exceptions)
[2021-03-31 18:13:15.615] [E/9] [info] [Task Finished] Transform to mem in 0.249768s (14015 normal rows, 9985 exceptions)
[2021-03-31 18:13:15.615] [E/12] [info] [Task Finished] Transform to mem in 0.250020s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:13:15.615] [E/5] [info] [Task Finished] Transform to mem in 0.250911s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:13:15.615] [E/8] [info] [Task Finished] Transform to mem in 0.250526s (14171 normal rows, 10052 exceptions)
[2021-03-31 18:13:15.616] [E/14] [info] [Task Finished] Transform to mem in 0.250660s (14176 normal rows, 9997 exceptions)
[2021-03-31 18:13:15.618] [driver] [info] [Task Finished] Transform to mem in 0.250207s (14246 normal rows, 10108 exceptions)
[2021-03-31 18:13:15.619] [E/10] [info] [Task Finished] Transform to mem in 0.250389s (14059 normal rows, 9978 exceptions)
[2021-03-31 18:13:15.662] [E/3] [info] [Task Finished] Transform to mem in 0.258616s (14114 normal rows, 10011 exceptions)
[2021-03-31 18:13:15.862] [E/1] [info] [Task Finished] Transform to mem in 0.250192s (14238 normal rows, 10007 exceptions)
[2021-03-31 18:13:15.862] [E/11] [info] [Task Finished] Transform to mem in 0.250029s (14081 normal rows, 10003 exceptions)
[2021-03-31 18:13:15.863] [E/4] [info] [Task Finished] Transform to mem in 0.249945s (14086 normal rows, 9998 exceptions)
[2021-03-31 18:13:15.863] [E/2] [info] [Task Finished] Transform to mem in 0.250400s (14095 normal rows, 10024 exceptions)
[2021-03-31 18:13:15.863] [E/15] [info] [Task Finished] Transform to mem in 0.250377s (14221 normal rows, 9998 exceptions)
[2021-03-31 18:13:15.864] [E/6] [info] [Task Finished] Transform to mem in 0.250236s (14091 normal rows, 10001 exceptions)
[2021-03-31 18:13:15.864] [E/13] [info] [Task Finished] Transform to mem in 0.250320s (14218 normal rows, 10016 exceptions)
[2021-03-31 18:13:15.865] [E/7] [info] [Task Finished] Transform to mem in 0.250532s (14095 normal rows, 10026 exceptions)
[2021-03-31 18:13:15.865] [E/12] [info] [Task Finished] Transform to mem in 0.250397s (14197 normal rows, 10028 exceptions)
[2021-03-31 18:13:15.865] [E/5] [info] [Task Finished] Transform to mem in 0.250481s (14114 normal rows, 10012 exceptions)
[2021-03-31 18:13:15.865] [E/8] [info] [Task Finished] Transform to mem in 0.250603s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:13:15.866] [E/9] [info] [Task Finished] Transform to mem in 0.251657s (14113 normal rows, 9960 exceptions)
[2021-03-31 18:13:15.866] [E/14] [info] [Task Finished] Transform to mem in 0.250784s (14197 normal rows, 10033 exceptions)
[2021-03-31 18:13:15.868] [driver] [info] [Task Finished] Transform to mem in 0.250235s (14115 normal rows, 10010 exceptions)
[2021-03-31 18:13:15.870] [E/10] [info] [Task Finished] Transform to mem in 0.251315s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:13:15.920] [E/3] [info] [Task Finished] Transform to mem in 0.258260s (14235 normal rows, 10048 exceptions)
[2021-03-31 18:13:16.112] [E/11] [info] [Task Finished] Transform to mem in 0.249583s (14015 normal rows, 9952 exceptions)
[2021-03-31 18:13:16.112] [E/1] [info] [Task Finished] Transform to mem in 0.249810s (14144 normal rows, 9995 exceptions)
[2021-03-31 18:13:16.113] [E/15] [info] [Task Finished] Transform to mem in 0.249864s (14010 normal rows, 9932 exceptions)
[2021-03-31 18:13:16.113] [E/2] [info] [Task Finished] Transform to mem in 0.249909s (14159 normal rows, 9996 exceptions)
[2021-03-31 18:13:16.114] [E/4] [info] [Task Finished] Transform to mem in 0.250457s (14237 normal rows, 10069 exceptions)
[2021-03-31 18:13:16.114] [E/13] [info] [Task Finished] Transform to mem in 0.250151s (14178 normal rows, 10009 exceptions)
[2021-03-31 18:13:16.114] [E/6] [info] [Task Finished] Transform to mem in 0.250427s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:13:16.115] [E/7] [info] [Task Finished] Transform to mem in 0.249827s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:13:16.115] [E/8] [info] [Task Finished] Transform to mem in 0.250024s (13901 normal rows, 9892 exceptions)
[2021-03-31 18:13:16.116] [E/12] [info] [Task Finished] Transform to mem in 0.250545s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:13:16.116] [E/5] [info] [Task Finished] Transform to mem in 0.250507s (14236 normal rows, 10015 exceptions)
[2021-03-31 18:13:16.117] [E/14] [info] [Task Finished] Transform to mem in 0.250449s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:13:16.117] [E/9] [info] [Task Finished] Transform to mem in 0.250545s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:13:16.117] [driver] [info] [Task Finished] Transform to mem in 0.249582s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:13:16.122] [E/10] [info] [Task Finished] Transform to mem in 0.251676s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:13:16.178] [E/3] [info] [Task Finished] Transform to mem in 0.257982s (14245 normal rows, 10024 exceptions)
[2021-03-31 18:13:16.362] [E/11] [info] [Task Finished] Transform to mem in 0.249802s (13999 normal rows, 9935 exceptions)
[2021-03-31 18:13:16.362] [E/1] [info] [Task Finished] Transform to mem in 0.250315s (14158 normal rows, 10036 exceptions)
[2021-03-31 18:13:16.363] [E/2] [info] [Task Finished] Transform to mem in 0.249875s (14020 normal rows, 9989 exceptions)
[2021-03-31 18:13:16.364] [E/15] [info] [Task Finished] Transform to mem in 0.250571s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:13:16.364] [E/6] [info] [Task Finished] Transform to mem in 0.249987s (14054 normal rows, 9985 exceptions)
[2021-03-31 18:13:16.364] [E/4] [info] [Task Finished] Transform to mem in 0.250386s (14173 normal rows, 10004 exceptions)
[2021-03-31 18:13:16.364] [E/13] [info] [Task Finished] Transform to mem in 0.250535s (14235 normal rows, 10041 exceptions)
[2021-03-31 18:13:16.365] [E/7] [info] [Task Finished] Transform to mem in 0.250452s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:13:16.366] [E/12] [info] [Task Finished] Transform to mem in 0.250026s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:13:16.366] [E/8] [info] [Task Finished] Transform to mem in 0.250782s (14238 normal rows, 10033 exceptions)
[2021-03-31 18:13:16.366] [E/5] [info] [Task Finished] Transform to mem in 0.250668s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:13:16.367] [E/9] [info] [Task Finished] Transform to mem in 0.250261s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:13:16.368] [driver] [info] [Task Finished] Transform to mem in 0.250225s (14094 normal rows, 9996 exceptions)
[2021-03-31 18:13:16.368] [E/14] [info] [Task Finished] Transform to mem in 0.250856s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:13:16.373] [E/10] [info] [Task Finished] Transform to mem in 0.251502s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:13:16.436] [E/3] [info] [Task Finished] Transform to mem in 0.257899s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:13:16.612] [E/11] [info] [Task Finished] Transform to mem in 0.250092s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:13:16.612] [E/1] [info] [Task Finished] Transform to mem in 0.250139s (14217 normal rows, 10042 exceptions)
[2021-03-31 18:13:16.613] [E/2] [info] [Task Finished] Transform to mem in 0.249745s (14094 normal rows, 9998 exceptions)
[2021-03-31 18:13:16.614] [E/4] [info] [Task Finished] Transform to mem in 0.249673s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:13:16.614] [E/6] [info] [Task Finished] Transform to mem in 0.250058s (14223 normal rows, 10048 exceptions)
[2021-03-31 18:13:16.614] [E/15] [info] [Task Finished] Transform to mem in 0.250377s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:13:16.615] [E/13] [info] [Task Finished] Transform to mem in 0.250119s (14086 normal rows, 9953 exceptions)
[2021-03-31 18:13:16.616] [E/12] [info] [Task Finished] Transform to mem in 0.250092s (14170 normal rows, 9995 exceptions)
[2021-03-31 18:13:16.616] [E/7] [info] [Task Finished] Transform to mem in 0.250709s (14232 normal rows, 10069 exceptions)
[2021-03-31 18:13:16.616] [E/8] [info] [Task Finished] Transform to mem in 0.250149s (14002 normal rows, 9932 exceptions)
[2021-03-31 18:13:16.617] [E/5] [info] [Task Finished] Transform to mem in 0.250877s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:13:16.617] [driver] [info] [Task Finished] Transform to mem in 0.249720s (13961 normal rows, 9907 exceptions)
[2021-03-31 18:13:16.617] [E/9] [info] [Task Finished] Transform to mem in 0.250324s (14206 normal rows, 10009 exceptions)
[2021-03-31 18:13:16.619] [E/14] [info] [Task Finished] Transform to mem in 0.250899s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:13:16.625] [E/10] [info] [Task Finished] Transform to mem in 0.251372s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:13:16.737] [E/3] [info] [Task Finished] Transform to mem in 0.300682s (16320 normal rows, 11605 exceptions)
[2021-03-31 18:13:16.737] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.63017s
[2021-03-31 18:13:16.737] [global] [info] [Transform Stage] Stage 0 total wall clock time: 40.2629s, 54108450 input rows, time to process 1 row via fast path: 0.000744115ms
[2021-03-31 18:13:16.737] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2021-03-31 18:13:16.741] [local ee] [info] compiled pure python pipeline in 0.003801s
[2021-03-31 18:13:16.741] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 18:13:16.742] [local ee] [info] Created 160 resolve tasks in 0.001159s
[2021-03-31 18:13:16.742] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 18:13:16.749] [E/1] [info] [Task Finished] Resolve in 0.007095s
[2021-03-31 18:13:16.749] [E/2] [info] [Task Finished] Resolve in 0.007111s
[2021-03-31 18:13:16.749] [E/13] [info] [Task Finished] Resolve in 0.007094s
[2021-03-31 18:13:16.749] [driver] [info] [Task Finished] Resolve in 0.007184s
[2021-03-31 18:13:16.749] [E/11] [info] [Task Finished] Resolve in 0.007196s
[2021-03-31 18:13:16.749] [E/5] [info] [Task Finished] Resolve in 0.007204s
[2021-03-31 18:13:16.749] [E/8] [info] [Task Finished] Resolve in 0.007231s
[2021-03-31 18:13:16.749] [E/7] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:13:16.749] [E/15] [info] [Task Finished] Resolve in 0.007227s
[2021-03-31 18:13:16.749] [E/4] [info] [Task Finished] Resolve in 0.007256s
[2021-03-31 18:13:16.749] [E/6] [info] [Task Finished] Resolve in 0.007243s
[2021-03-31 18:13:16.749] [E/10] [info] [Task Finished] Resolve in 0.007266s
[2021-03-31 18:13:16.749] [E/9] [info] [Task Finished] Resolve in 0.007318s
[2021-03-31 18:13:16.749] [E/12] [info] [Task Finished] Resolve in 0.007256s
[2021-03-31 18:13:16.749] [E/14] [info] [Task Finished] Resolve in 0.007336s
[2021-03-31 18:13:16.749] [E/3] [info] [Task Finished] Resolve in 0.007310s
[2021-03-31 18:13:16.756] [E/2] [info] [Task Finished] Resolve in 0.007265s
[2021-03-31 18:13:16.756] [E/13] [info] [Task Finished] Resolve in 0.007301s
[2021-03-31 18:13:16.756] [E/1] [info] [Task Finished] Resolve in 0.007329s
[2021-03-31 18:13:16.756] [E/11] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:13:16.756] [driver] [info] [Task Finished] Resolve in 0.007312s
[2021-03-31 18:13:16.756] [E/8] [info] [Task Finished] Resolve in 0.007263s
[2021-03-31 18:13:16.756] [E/15] [info] [Task Finished] Resolve in 0.007244s
[2021-03-31 18:13:16.756] [E/6] [info] [Task Finished] Resolve in 0.007232s
[2021-03-31 18:13:16.756] [E/4] [info] [Task Finished] Resolve in 0.007251s
[2021-03-31 18:13:16.756] [E/7] [info] [Task Finished] Resolve in 0.007299s
[2021-03-31 18:13:16.756] [E/12] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:13:16.756] [E/14] [info] [Task Finished] Resolve in 0.007237s
[2021-03-31 18:13:16.756] [E/10] [info] [Task Finished] Resolve in 0.007271s
[2021-03-31 18:13:16.756] [E/5] [info] [Task Finished] Resolve in 0.007395s
[2021-03-31 18:13:16.756] [E/9] [info] [Task Finished] Resolve in 0.007315s
[2021-03-31 18:13:16.756] [E/3] [info] [Task Finished] Resolve in 0.007304s
[2021-03-31 18:13:16.763] [E/2] [info] [Task Finished] Resolve in 0.007250s
[2021-03-31 18:13:16.764] [E/1] [info] [Task Finished] Resolve in 0.007232s
[2021-03-31 18:13:16.764] [E/15] [info] [Task Finished] Resolve in 0.007196s
[2021-03-31 18:13:16.764] [E/13] [info] [Task Finished] Resolve in 0.007319s
[2021-03-31 18:13:16.764] [E/11] [info] [Task Finished] Resolve in 0.007318s
[2021-03-31 18:13:16.764] [E/8] [info] [Task Finished] Resolve in 0.007263s
[2021-03-31 18:13:16.764] [driver] [info] [Task Finished] Resolve in 0.007285s
[2021-03-31 18:13:16.764] [E/5] [info] [Task Finished] Resolve in 0.007186s
[2021-03-31 18:13:16.764] [E/7] [info] [Task Finished] Resolve in 0.007311s
[2021-03-31 18:13:16.764] [E/6] [info] [Task Finished] Resolve in 0.007311s
[2021-03-31 18:13:16.764] [E/12] [info] [Task Finished] Resolve in 0.007328s
[2021-03-31 18:13:16.764] [E/4] [info] [Task Finished] Resolve in 0.007325s
[2021-03-31 18:13:16.764] [E/14] [info] [Task Finished] Resolve in 0.007323s
[2021-03-31 18:13:16.764] [E/10] [info] [Task Finished] Resolve in 0.007345s
[2021-03-31 18:13:16.764] [E/9] [info] [Task Finished] Resolve in 0.007355s
[2021-03-31 18:13:16.764] [E/3] [info] [Task Finished] Resolve in 0.007333s
[2021-03-31 18:13:16.771] [E/2] [info] [Task Finished] Resolve in 0.007173s
[2021-03-31 18:13:16.771] [E/1] [info] [Task Finished] Resolve in 0.007204s
[2021-03-31 18:13:16.771] [E/11] [info] [Task Finished] Resolve in 0.007196s
[2021-03-31 18:13:16.771] [E/15] [info] [Task Finished] Resolve in 0.007303s
[2021-03-31 18:13:16.771] [E/8] [info] [Task Finished] Resolve in 0.007261s
[2021-03-31 18:13:16.771] [E/13] [info] [Task Finished] Resolve in 0.007311s
[2021-03-31 18:13:16.771] [driver] [info] [Task Finished] Resolve in 0.007302s
[2021-03-31 18:13:16.771] [E/5] [info] [Task Finished] Resolve in 0.007284s
[2021-03-31 18:13:16.771] [E/12] [info] [Task Finished] Resolve in 0.007257s
[2021-03-31 18:13:16.771] [E/6] [info] [Task Finished] Resolve in 0.007278s
[2021-03-31 18:13:16.771] [E/14] [info] [Task Finished] Resolve in 0.007240s
[2021-03-31 18:13:16.771] [E/10] [info] [Task Finished] Resolve in 0.007246s
[2021-03-31 18:13:16.771] [E/7] [info] [Task Finished] Resolve in 0.007348s
[2021-03-31 18:13:16.771] [E/4] [info] [Task Finished] Resolve in 0.007310s
[2021-03-31 18:13:16.771] [E/3] [info] [Task Finished] Resolve in 0.007247s
[2021-03-31 18:13:16.771] [E/9] [info] [Task Finished] Resolve in 0.007304s
[2021-03-31 18:13:16.778] [E/2] [info] [Task Finished] Resolve in 0.007072s
[2021-03-31 18:13:16.778] [E/1] [info] [Task Finished] Resolve in 0.007133s
[2021-03-31 18:13:16.778] [E/11] [info] [Task Finished] Resolve in 0.007097s
[2021-03-31 18:13:16.778] [E/15] [info] [Task Finished] Resolve in 0.007100s
[2021-03-31 18:13:16.778] [E/8] [info] [Task Finished] Resolve in 0.007112s
[2021-03-31 18:13:16.778] [E/13] [info] [Task Finished] Resolve in 0.007116s
[2021-03-31 18:13:16.778] [E/6] [info] [Task Finished] Resolve in 0.007074s
[2021-03-31 18:13:16.778] [driver] [info] [Task Finished] Resolve in 0.007142s
[2021-03-31 18:13:16.778] [E/5] [info] [Task Finished] Resolve in 0.007145s
[2021-03-31 18:13:16.778] [E/7] [info] [Task Finished] Resolve in 0.007071s
[2021-03-31 18:13:16.778] [E/14] [info] [Task Finished] Resolve in 0.007125s
[2021-03-31 18:13:16.778] [E/12] [info] [Task Finished] Resolve in 0.007142s
[2021-03-31 18:13:16.778] [E/9] [info] [Task Finished] Resolve in 0.007048s
[2021-03-31 18:13:16.778] [E/4] [info] [Task Finished] Resolve in 0.007141s
[2021-03-31 18:13:16.778] [E/10] [info] [Task Finished] Resolve in 0.007172s
[2021-03-31 18:13:16.778] [E/3] [info] [Task Finished] Resolve in 0.007163s
[2021-03-31 18:13:16.785] [E/2] [info] [Task Finished] Resolve in 0.007466s
[2021-03-31 18:13:16.785] [E/1] [info] [Task Finished] Resolve in 0.007343s
[2021-03-31 18:13:16.785] [E/15] [info] [Task Finished] Resolve in 0.007350s
[2021-03-31 18:13:16.785] [E/11] [info] [Task Finished] Resolve in 0.007476s
[2021-03-31 18:13:16.785] [E/13] [info] [Task Finished] Resolve in 0.007399s
[2021-03-31 18:13:16.786] [E/8] [info] [Task Finished] Resolve in 0.007502s
[2021-03-31 18:13:16.786] [E/5] [info] [Task Finished] Resolve in 0.007405s
[2021-03-31 18:13:16.786] [E/6] [info] [Task Finished] Resolve in 0.007475s
[2021-03-31 18:13:16.786] [E/12] [info] [Task Finished] Resolve in 0.007452s
[2021-03-31 18:13:16.786] [driver] [info] [Task Finished] Resolve in 0.007532s
[2021-03-31 18:13:16.786] [E/14] [info] [Task Finished] Resolve in 0.007482s
[2021-03-31 18:13:16.786] [E/7] [info] [Task Finished] Resolve in 0.007484s
[2021-03-31 18:13:16.786] [E/10] [info] [Task Finished] Resolve in 0.007421s
[2021-03-31 18:13:16.786] [E/9] [info] [Task Finished] Resolve in 0.007482s
[2021-03-31 18:13:16.786] [E/3] [info] [Task Finished] Resolve in 0.007452s
[2021-03-31 18:13:16.786] [E/4] [info] [Task Finished] Resolve in 0.007509s
[2021-03-31 18:13:16.792] [E/1] [info] [Task Finished] Resolve in 0.007243s
[2021-03-31 18:13:16.793] [E/2] [info] [Task Finished] Resolve in 0.007279s
[2021-03-31 18:13:16.793] [E/15] [info] [Task Finished] Resolve in 0.007254s
[2021-03-31 18:13:16.793] [E/11] [info] [Task Finished] Resolve in 0.007265s
[2021-03-31 18:13:16.793] [E/13] [info] [Task Finished] Resolve in 0.007334s
[2021-03-31 18:13:16.793] [E/8] [info] [Task Finished] Resolve in 0.007287s
[2021-03-31 18:13:16.793] [E/5] [info] [Task Finished] Resolve in 0.007309s
[2021-03-31 18:13:16.793] [E/6] [info] [Task Finished] Resolve in 0.007264s
[2021-03-31 18:13:16.793] [E/14] [info] [Task Finished] Resolve in 0.007269s
[2021-03-31 18:13:16.793] [E/12] [info] [Task Finished] Resolve in 0.007304s
[2021-03-31 18:13:16.793] [E/7] [info] [Task Finished] Resolve in 0.007287s
[2021-03-31 18:13:16.793] [driver] [info] [Task Finished] Resolve in 0.007330s
[2021-03-31 18:13:16.793] [E/10] [info] [Task Finished] Resolve in 0.007314s
[2021-03-31 18:13:16.793] [E/3] [info] [Task Finished] Resolve in 0.007258s
[2021-03-31 18:13:16.793] [E/9] [info] [Task Finished] Resolve in 0.007308s
[2021-03-31 18:13:16.793] [E/4] [info] [Task Finished] Resolve in 0.007329s
[2021-03-31 18:13:16.800] [E/1] [info] [Task Finished] Resolve in 0.007140s
[2021-03-31 18:13:16.800] [E/2] [info] [Task Finished] Resolve in 0.007204s
[2021-03-31 18:13:16.800] [E/15] [info] [Task Finished] Resolve in 0.007167s
[2021-03-31 18:13:16.800] [E/11] [info] [Task Finished] Resolve in 0.007237s
[2021-03-31 18:13:16.800] [E/6] [info] [Task Finished] Resolve in 0.007173s
[2021-03-31 18:13:16.800] [E/14] [info] [Task Finished] Resolve in 0.007180s
[2021-03-31 18:13:16.800] [E/13] [info] [Task Finished] Resolve in 0.007354s
[2021-03-31 18:13:16.800] [E/8] [info] [Task Finished] Resolve in 0.007292s
[2021-03-31 18:13:16.800] [E/5] [info] [Task Finished] Resolve in 0.007337s
[2021-03-31 18:13:16.800] [E/3] [info] [Task Finished] Resolve in 0.007226s
[2021-03-31 18:13:16.800] [E/12] [info] [Task Finished] Resolve in 0.007343s
[2021-03-31 18:13:16.800] [E/7] [info] [Task Finished] Resolve in 0.007346s
[2021-03-31 18:13:16.800] [E/10] [info] [Task Finished] Resolve in 0.007352s
[2021-03-31 18:13:16.800] [driver] [info] [Task Finished] Resolve in 0.007379s
[2021-03-31 18:13:16.800] [E/9] [info] [Task Finished] Resolve in 0.007341s
[2021-03-31 18:13:16.800] [E/4] [info] [Task Finished] Resolve in 0.007322s
[2021-03-31 18:13:16.807] [E/1] [info] [Task Finished] Resolve in 0.007094s
[2021-03-31 18:13:16.807] [E/2] [info] [Task Finished] Resolve in 0.007155s
[2021-03-31 18:13:16.807] [E/15] [info] [Task Finished] Resolve in 0.007107s
[2021-03-31 18:13:16.807] [E/11] [info] [Task Finished] Resolve in 0.007167s
[2021-03-31 18:13:16.807] [E/6] [info] [Task Finished] Resolve in 0.007071s
[2021-03-31 18:13:16.807] [E/14] [info] [Task Finished] Resolve in 0.007114s
[2021-03-31 18:13:16.807] [E/5] [info] [Task Finished] Resolve in 0.007073s
[2021-03-31 18:13:16.807] [E/8] [info] [Task Finished] Resolve in 0.007096s
[2021-03-31 18:13:16.807] [E/13] [info] [Task Finished] Resolve in 0.007155s
[2021-03-31 18:13:16.807] [E/12] [info] [Task Finished] Resolve in 0.007069s
[2021-03-31 18:13:16.807] [E/7] [info] [Task Finished] Resolve in 0.007088s
[2021-03-31 18:13:16.807] [E/3] [info] [Task Finished] Resolve in 0.007136s
[2021-03-31 18:13:16.808] [E/10] [info] [Task Finished] Resolve in 0.007103s
[2021-03-31 18:13:16.808] [E/4] [info] [Task Finished] Resolve in 0.007108s
[2021-03-31 18:13:16.808] [E/9] [info] [Task Finished] Resolve in 0.007161s
[2021-03-31 18:13:16.808] [driver] [info] [Task Finished] Resolve in 0.007182s
[2021-03-31 18:13:16.814] [E/1] [info] [Task Finished] Resolve in 0.007269s
[2021-03-31 18:13:16.814] [E/2] [info] [Task Finished] Resolve in 0.007306s
[2021-03-31 18:13:16.814] [E/15] [info] [Task Finished] Resolve in 0.007300s
[2021-03-31 18:13:16.814] [E/11] [info] [Task Finished] Resolve in 0.007271s
[2021-03-31 18:13:16.814] [E/6] [info] [Task Finished] Resolve in 0.007320s
[2021-03-31 18:13:16.815] [E/14] [info] [Task Finished] Resolve in 0.007271s
[2021-03-31 18:13:16.815] [E/5] [info] [Task Finished] Resolve in 0.007268s
[2021-03-31 18:13:16.815] [E/12] [info] [Task Finished] Resolve in 0.007221s
[2021-03-31 18:13:16.815] [E/8] [info] [Task Finished] Resolve in 0.007319s
[2021-03-31 18:13:16.815] [E/3] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:13:16.815] [E/13] [info] [Task Finished] Resolve in 0.007354s
[2021-03-31 18:13:16.815] [E/7] [info] [Task Finished] Resolve in 0.007347s
[2021-03-31 18:13:16.815] [E/10] [info] [Task Finished] Resolve in 0.007323s
[2021-03-31 18:13:16.815] [E/4] [info] [Task Finished] Resolve in 0.007339s
[2021-03-31 18:13:16.815] [E/9] [info] [Task Finished] Resolve in 0.007346s
[2021-03-31 18:13:16.816] [driver] [info] [Task Finished] Resolve in 0.008420s
[2021-03-31 18:13:16.816] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 0.0794175s
[2021-03-31 18:13:16.816] [local ee] [info] slow path for Stage 0: total wall clock time: 1.16288s, time to process 1 row via slow path: 0.000725626ms
[2021-03-31 18:13:16.816] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.0794408s

[2021-03-31 18:13:16.861] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2021-03-31 18:13:16.886] [E/10] [info] [Task Finished] write to file in 0.025228s (87192 rows, 13.27 MB)
[2021-03-31 18:13:16.901] [E/13] [info] [Task Finished] write to file in 0.040144s (155541 rows, 23.68 MB)
[2021-03-31 18:13:16.902] [E/11] [info] [Task Finished] write to file in 0.040910s (155476 rows, 23.67 MB)
[2021-03-31 18:13:16.902] [E/5] [info] [Task Finished] write to file in 0.041365s (155530 rows, 23.67 MB)
[2021-03-31 18:13:16.903] [driver] [info] [Task Finished] write to file in 0.041530s (155606 rows, 23.69 MB)
[2021-03-31 18:13:16.903] [E/12] [info] [Task Finished] write to file in 0.041763s (155417 rows, 23.66 MB)
[2021-03-31 18:13:16.903] [E/6] [info] [Task Finished] write to file in 0.041776s (155415 rows, 23.66 MB)
[2021-03-31 18:13:16.903] [E/1] [info] [Task Finished] write to file in 0.042072s (155626 rows, 23.69 MB)
[2021-03-31 18:13:16.903] [E/15] [info] [Task Finished] write to file in 0.042125s (155530 rows, 23.67 MB)
[2021-03-31 18:13:16.903] [E/14] [info] [Task Finished] write to file in 0.042171s (155395 rows, 23.66 MB)
[2021-03-31 18:13:16.903] [E/3] [info] [Task Finished] write to file in 0.042220s (155541 rows, 23.68 MB)
[2021-03-31 18:13:16.903] [E/8] [info] [Task Finished] write to file in 0.042408s (155704 rows, 23.70 MB)
[2021-03-31 18:13:16.904] [E/4] [info] [Task Finished] write to file in 0.042432s (155417 rows, 23.66 MB)
[2021-03-31 18:13:16.904] [E/9] [info] [Task Finished] write to file in 0.042494s (155476 rows, 23.67 MB)
[2021-03-31 18:13:16.911] [E/2] [info] [Task Finished] write to file in 0.049802s (155704 rows, 23.70 MB)
[2021-03-31 18:13:16.911] [global] [info] writing output took 0.094697s
[2021-03-31 18:13:16.911] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0947778s
[2021-03-31 18:13:16.911] [global] [info] [Transform Stage] Stage 0 took 3.25129s
[2021-03-31 18:13:16.911] [global] [info] Query Execution took 3.35122s. (planning: 0.0998957s, execution: 3.25132s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 05:47:10) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.005984306335449219
Tuplex job time: 3.6212384700775146 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '6bcf8f6a24af', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0203598,"llvm_optimization_time_s":0.296391,"llvm_compilation_time_s":0.134621,"total_compilation_time_s":0.446864,"sampling_time_s":0.109276,"stages":[{"stage_no":0,"fast_path_wall_time_s":40.2629,"fast_path_time_s":2.63019,"fast_path_per_row_time_ns":744.115,"slow_path_wall_time_s":1.16288,"slow_path_time_s":0.0794175,"slow_path_per_row_time_ns":725.626}]}
{"startupTime": 0.005984306335449219, "jobTime": 3.6212384700775146}
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.935] [local execution engine] [info] Stopped local executor E/1
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.939] [local execution engine] [info] Stopped local executor E/2
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.942] [local execution engine] [info] Stopped local executor E/3
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.945] [local execution engine] [info] Stopped local executor E/4
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.948] [local execution engine] [info] Stopped local executor E/5
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.952] [local execution engine] [info] Stopped local executor E/6
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.955] [local execution engine] [info] Stopped local executor E/7
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.958] [local execution engine] [info] Stopped local executor E/8
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.961] [local execution engine] [info] Stopped local executor E/9
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.964] [local execution engine] [info] Stopped local executor E/10
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.967] [local execution engine] [info] Stopped local executor E/11
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.971] [local execution engine] [info] Stopped local executor E/12
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.974] [local execution engine] [info] Stopped local executor E/13
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.977] [local execution engine] [info] Stopped local executor E/14
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:16.980] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 21 active partitions
