[2021-03-31 18:12:36.892] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:12:36.893] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:12:36.893] [local ee] [info] initializing LLVM backend
[2021-03-31 18:12:36.893] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:12:36.893] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/1] [info] starting detached process queue
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/2] [info] starting detached process queue
[2021-03-31 18:12:36.894] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [E/3] [info] starting detached process queue
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [E/4] [info] starting detached process queue
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/5] [info] starting detached process queue
[2021-03-31 18:12:36.894] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [E/6] [info] starting detached process queue
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/7] [info] starting detached process queue
[2021-03-31 18:12:36.894] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [E/8] [info] starting detached process queue
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [E/9] [info] starting detached process queue
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [E/10] [info] starting detached process queue
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/11] [info] starting detached process queue
[2021-03-31 18:12:36.894] [E/12] [info] starting detached process queue
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.894] [E/13] [info] starting detached process queue
[2021-03-31 18:12:36.894] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.894] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.895] [E/14] [info] starting detached process queue
[2021-03-31 18:12:36.895] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:36.895] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.895] [E/15] [info] starting detached process queue
[2021-03-31 18:12:36.895] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 18:12:36.895] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.895] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:36.895] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:12:36.895] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 18:12:36.895] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2021-03-31 18:12:37.029] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.045] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.053] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.080] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.100] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.114] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.146] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.163] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:37.165] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:37.168] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:37.170] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:37.186] [logical planner] [info] logical optimization took 0.020385ms
[2021-03-31 18:12:37.187] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.191] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.195] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.199] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.202] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.204] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.206] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:37.214] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:37.214] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,f64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:12:37.215] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2021-03-31 18:12:37.215] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2021-03-31 18:12:37.216] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2021-03-31 18:12:37.216] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2021-03-31 18:12:37.217] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2021-03-31 18:12:37.217] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2021-03-31 18:12:37.218] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:12:37.219] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2021-03-31 18:12:37.220] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2021-03-31 18:12:37.221] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2021-03-31 18:12:37.221] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:12:37.222] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:12:37.223] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:12:37.223] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2021-03-31 18:12:37.225] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:12:37.226] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:12:37.226] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:12:37.227] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:12:37.227] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:12:37.228] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:12:37.229] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 18:12:37.230] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 18:12:37.231] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 18:12:37.231] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:12:37.232] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:12:37.233] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:12:37.234] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 18:12:37.263] [global] [info] Stage0 depends on: 
[2021-03-31 18:12:37.575] [global] [info] Optimization via LLVM passes took 0.296034 ms
[2021-03-31 18:12:37.709] [global] [info] Compiled code paths for stage 0 in 0.13 ms
[2021-03-31 18:12:37.709] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.446106s
[2021-03-31 18:12:37.710] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2021-03-31 18:12:37.969] [E/14] [info] [Task Finished] Transform to mem in 0.258997s (13988 normal rows, 9938 exceptions)
[2021-03-31 18:12:37.969] [E/9] [info] [Task Finished] Transform to mem in 0.259314s (14020 normal rows, 9982 exceptions)
[2021-03-31 18:12:37.969] [E/3] [info] [Task Finished] Transform to mem in 0.259372s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:12:37.969] [E/12] [info] [Task Finished] Transform to mem in 0.259427s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:12:37.969] [E/15] [info] [Task Finished] Transform to mem in 0.259612s (14162 normal rows, 9952 exceptions)
[2021-03-31 18:12:37.970] [E/1] [info] [Task Finished] Transform to mem in 0.259873s (14177 normal rows, 10036 exceptions)
[2021-03-31 18:12:37.970] [E/11] [info] [Task Finished] Transform to mem in 0.259875s (14217 normal rows, 10015 exceptions)
[2021-03-31 18:12:37.970] [E/7] [info] [Task Finished] Transform to mem in 0.259938s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:12:37.970] [E/10] [info] [Task Finished] Transform to mem in 0.259998s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:12:37.970] [driver] [info] [Task Finished] Transform to mem in 0.260460s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:12:37.970] [E/2] [info] [Task Finished] Transform to mem in 0.260553s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:12:37.971] [E/6] [info] [Task Finished] Transform to mem in 0.261009s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:12:37.971] [E/5] [info] [Task Finished] Transform to mem in 0.261199s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:12:37.971] [E/13] [info] [Task Finished] Transform to mem in 0.261224s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:12:37.979] [E/4] [info] [Task Finished] Transform to mem in 0.269449s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:12:37.987] [E/8] [info] [Task Finished] Transform to mem in 0.277501s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:12:38.223] [E/14] [info] [Task Finished] Transform to mem in 0.254637s (14241 normal rows, 10100 exceptions)
[2021-03-31 18:12:38.224] [E/12] [info] [Task Finished] Transform to mem in 0.254694s (14238 normal rows, 10030 exceptions)
[2021-03-31 18:12:38.224] [E/9] [info] [Task Finished] Transform to mem in 0.254808s (14059 normal rows, 9985 exceptions)
[2021-03-31 18:12:38.224] [E/7] [info] [Task Finished] Transform to mem in 0.254385s (14086 normal rows, 9989 exceptions)
[2021-03-31 18:12:38.224] [E/11] [info] [Task Finished] Transform to mem in 0.254707s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:12:38.224] [E/15] [info] [Task Finished] Transform to mem in 0.255052s (14081 normal rows, 9995 exceptions)
[2021-03-31 18:12:38.225] [E/3] [info] [Task Finished] Transform to mem in 0.255380s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:12:38.225] [driver] [info] [Task Finished] Transform to mem in 0.254304s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:12:38.225] [E/1] [info] [Task Finished] Transform to mem in 0.255049s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:12:38.225] [E/2] [info] [Task Finished] Transform to mem in 0.254953s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:12:38.225] [E/10] [info] [Task Finished] Transform to mem in 0.255551s (14097 normal rows, 10002 exceptions)
[2021-03-31 18:12:38.226] [E/13] [info] [Task Finished] Transform to mem in 0.255034s (14099 normal rows, 10008 exceptions)
[2021-03-31 18:12:38.227] [E/6] [info] [Task Finished] Transform to mem in 0.255799s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:12:38.227] [E/5] [info] [Task Finished] Transform to mem in 0.255804s (14212 normal rows, 10032 exceptions)
[2021-03-31 18:12:38.243] [E/4] [info] [Task Finished] Transform to mem in 0.263678s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:12:38.256] [E/8] [info] [Task Finished] Transform to mem in 0.268225s (14223 normal rows, 10035 exceptions)
[2021-03-31 18:12:38.480] [E/14] [info] [Task Finished] Transform to mem in 0.256159s (14089 normal rows, 10008 exceptions)
[2021-03-31 18:12:38.480] [E/12] [info] [Task Finished] Transform to mem in 0.256245s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:12:38.480] [E/11] [info] [Task Finished] Transform to mem in 0.255934s (14002 normal rows, 9940 exceptions)
[2021-03-31 18:12:38.481] [driver] [info] [Task Finished] Transform to mem in 0.256018s (13961 normal rows, 9925 exceptions)
[2021-03-31 18:12:38.481] [E/7] [info] [Task Finished] Transform to mem in 0.256901s (14170 normal rows, 9994 exceptions)
[2021-03-31 18:12:38.481] [E/9] [info] [Task Finished] Transform to mem in 0.257272s (14235 normal rows, 10062 exceptions)
[2021-03-31 18:12:38.481] [E/10] [info] [Task Finished] Transform to mem in 0.255882s (13915 normal rows, 9900 exceptions)
[2021-03-31 18:12:38.481] [E/15] [info] [Task Finished] Transform to mem in 0.257028s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:12:38.482] [E/3] [info] [Task Finished] Transform to mem in 0.257289s (14206 normal rows, 9991 exceptions)
[2021-03-31 18:12:38.482] [E/2] [info] [Task Finished] Transform to mem in 0.256788s (14233 normal rows, 10011 exceptions)
[2021-03-31 18:12:38.482] [E/1] [info] [Task Finished] Transform to mem in 0.257725s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:12:38.483] [E/13] [info] [Task Finished] Transform to mem in 0.257297s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:12:38.484] [E/6] [info] [Task Finished] Transform to mem in 0.256951s (14267 normal rows, 10030 exceptions)
[2021-03-31 18:12:38.484] [E/5] [info] [Task Finished] Transform to mem in 0.257109s (13892 normal rows, 9882 exceptions)
[2021-03-31 18:12:38.510] [E/4] [info] [Task Finished] Transform to mem in 0.266774s (14245 normal rows, 10101 exceptions)
[2021-03-31 18:12:38.528] [E/8] [info] [Task Finished] Transform to mem in 0.272030s (14260 normal rows, 10025 exceptions)
[2021-03-31 18:12:38.732] [E/14] [info] [Task Finished] Transform to mem in 0.252402s (13978 normal rows, 9907 exceptions)
[2021-03-31 18:12:38.733] [E/11] [info] [Task Finished] Transform to mem in 0.252837s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:12:38.733] [driver] [info] [Task Finished] Transform to mem in 0.252689s (14015 normal rows, 9982 exceptions)
[2021-03-31 18:12:38.733] [E/12] [info] [Task Finished] Transform to mem in 0.253138s (14181 normal rows, 10067 exceptions)
[2021-03-31 18:12:38.734] [E/10] [info] [Task Finished] Transform to mem in 0.252978s (13982 normal rows, 9975 exceptions)
[2021-03-31 18:12:38.734] [E/9] [info] [Task Finished] Transform to mem in 0.253167s (14280 normal rows, 10094 exceptions)
[2021-03-31 18:12:38.735] [E/7] [info] [Task Finished] Transform to mem in 0.253835s (14142 normal rows, 9989 exceptions)
[2021-03-31 18:12:38.735] [E/15] [info] [Task Finished] Transform to mem in 0.253778s (14173 normal rows, 10006 exceptions)
[2021-03-31 18:12:38.735] [E/2] [info] [Task Finished] Transform to mem in 0.253269s (14054 normal rows, 9984 exceptions)
[2021-03-31 18:12:38.736] [E/3] [info] [Task Finished] Transform to mem in 0.253953s (14235 normal rows, 10040 exceptions)
[2021-03-31 18:12:38.736] [E/1] [info] [Task Finished] Transform to mem in 0.253707s (14129 normal rows, 10004 exceptions)
[2021-03-31 18:12:38.737] [E/6] [info] [Task Finished] Transform to mem in 0.253345s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:12:38.737] [E/13] [info] [Task Finished] Transform to mem in 0.253572s (14223 normal rows, 10033 exceptions)
[2021-03-31 18:12:38.738] [E/5] [info] [Task Finished] Transform to mem in 0.254215s (14108 normal rows, 10010 exceptions)
[2021-03-31 18:12:38.774] [E/4] [info] [Task Finished] Transform to mem in 0.264006s (14208 normal rows, 10008 exceptions)
[2021-03-31 18:12:38.795] [E/8] [info] [Task Finished] Transform to mem in 0.267560s (14089 normal rows, 10031 exceptions)
[2021-03-31 18:12:38.985] [E/14] [info] [Task Finished] Transform to mem in 0.252688s (14094 normal rows, 9960 exceptions)
[2021-03-31 18:12:38.986] [E/11] [info] [Task Finished] Transform to mem in 0.252667s (14232 normal rows, 10017 exceptions)
[2021-03-31 18:12:38.986] [E/12] [info] [Task Finished] Transform to mem in 0.253123s (14106 normal rows, 9955 exceptions)
[2021-03-31 18:12:38.987] [driver] [info] [Task Finished] Transform to mem in 0.253328s (14088 normal rows, 10027 exceptions)
[2021-03-31 18:12:38.987] [E/9] [info] [Task Finished] Transform to mem in 0.252620s (14113 normal rows, 9997 exceptions)
[2021-03-31 18:12:38.988] [E/10] [info] [Task Finished] Transform to mem in 0.253635s (14211 normal rows, 10043 exceptions)
[2021-03-31 18:12:38.988] [E/7] [info] [Task Finished] Transform to mem in 0.253425s (14075 normal rows, 9965 exceptions)
[2021-03-31 18:12:38.988] [E/2] [info] [Task Finished] Transform to mem in 0.252944s (14095 normal rows, 9995 exceptions)
[2021-03-31 18:12:38.989] [E/15] [info] [Task Finished] Transform to mem in 0.253549s (14223 normal rows, 10049 exceptions)
[2021-03-31 18:12:38.990] [E/3] [info] [Task Finished] Transform to mem in 0.253674s (14086 normal rows, 9952 exceptions)
[2021-03-31 18:12:38.990] [E/1] [info] [Task Finished] Transform to mem in 0.253863s (14226 normal rows, 10069 exceptions)
[2021-03-31 18:12:38.990] [E/13] [info] [Task Finished] Transform to mem in 0.253257s (14002 normal rows, 9931 exceptions)
[2021-03-31 18:12:38.991] [E/6] [info] [Task Finished] Transform to mem in 0.254208s (14170 normal rows, 9996 exceptions)
[2021-03-31 18:12:38.993] [E/5] [info] [Task Finished] Transform to mem in 0.254584s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:12:39.038] [E/4] [info] [Task Finished] Transform to mem in 0.264195s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:12:39.062] [E/8] [info] [Task Finished] Transform to mem in 0.267045s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:12:39.238] [E/14] [info] [Task Finished] Transform to mem in 0.253388s (14237 normal rows, 10084 exceptions)
[2021-03-31 18:12:39.240] [E/12] [info] [Task Finished] Transform to mem in 0.253168s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:12:39.240] [E/11] [info] [Task Finished] Transform to mem in 0.254013s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:12:39.240] [E/9] [info] [Task Finished] Transform to mem in 0.253276s (14248 normal rows, 10030 exceptions)
[2021-03-31 18:12:39.241] [E/10] [info] [Task Finished] Transform to mem in 0.252802s (13912 normal rows, 9882 exceptions)
[2021-03-31 18:12:39.241] [driver] [info] [Task Finished] Transform to mem in 0.254183s (14267 normal rows, 10099 exceptions)
[2021-03-31 18:12:39.242] [E/15] [info] [Task Finished] Transform to mem in 0.253129s (13988 normal rows, 9922 exceptions)
[2021-03-31 18:12:39.242] [E/2] [info] [Task Finished] Transform to mem in 0.253681s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:12:39.243] [E/7] [info] [Task Finished] Transform to mem in 0.254264s (14248 normal rows, 10094 exceptions)
[2021-03-31 18:12:39.244] [E/3] [info] [Task Finished] Transform to mem in 0.254260s (14171 normal rows, 10052 exceptions)
[2021-03-31 18:12:39.244] [E/1] [info] [Task Finished] Transform to mem in 0.253831s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:12:39.245] [E/13] [info] [Task Finished] Transform to mem in 0.254579s (14015 normal rows, 9985 exceptions)
[2021-03-31 18:12:39.246] [E/6] [info] [Task Finished] Transform to mem in 0.254484s (14176 normal rows, 9997 exceptions)
[2021-03-31 18:12:39.248] [E/5] [info] [Task Finished] Transform to mem in 0.255068s (14246 normal rows, 10108 exceptions)
[2021-03-31 18:12:39.302] [E/4] [info] [Task Finished] Transform to mem in 0.263934s (14059 normal rows, 9978 exceptions)
[2021-03-31 18:12:39.330] [E/8] [info] [Task Finished] Transform to mem in 0.267598s (14114 normal rows, 10011 exceptions)
[2021-03-31 18:12:39.492] [E/14] [info] [Task Finished] Transform to mem in 0.253334s (14238 normal rows, 10007 exceptions)
[2021-03-31 18:12:39.493] [E/11] [info] [Task Finished] Transform to mem in 0.252922s (14095 normal rows, 10024 exceptions)
[2021-03-31 18:12:39.493] [E/12] [info] [Task Finished] Transform to mem in 0.253617s (14081 normal rows, 10003 exceptions)
[2021-03-31 18:12:39.494] [E/9] [info] [Task Finished] Transform to mem in 0.253553s (14221 normal rows, 9998 exceptions)
[2021-03-31 18:12:39.494] [E/10] [info] [Task Finished] Transform to mem in 0.253213s (14086 normal rows, 9998 exceptions)
[2021-03-31 18:12:39.495] [driver] [info] [Task Finished] Transform to mem in 0.253661s (14091 normal rows, 10001 exceptions)
[2021-03-31 18:12:39.496] [E/15] [info] [Task Finished] Transform to mem in 0.253545s (14218 normal rows, 10016 exceptions)
[2021-03-31 18:12:39.496] [E/2] [info] [Task Finished] Transform to mem in 0.253653s (14095 normal rows, 10026 exceptions)
[2021-03-31 18:12:39.497] [E/7] [info] [Task Finished] Transform to mem in 0.254142s (14113 normal rows, 9960 exceptions)
[2021-03-31 18:12:39.497] [E/1] [info] [Task Finished] Transform to mem in 0.253495s (14114 normal rows, 10012 exceptions)
[2021-03-31 18:12:39.498] [E/3] [info] [Task Finished] Transform to mem in 0.253979s (14197 normal rows, 10028 exceptions)
[2021-03-31 18:12:39.499] [E/13] [info] [Task Finished] Transform to mem in 0.253909s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:12:39.501] [E/6] [info] [Task Finished] Transform to mem in 0.255007s (14197 normal rows, 10033 exceptions)
[2021-03-31 18:12:39.503] [E/5] [info] [Task Finished] Transform to mem in 0.255611s (14115 normal rows, 10010 exceptions)
[2021-03-31 18:12:39.566] [E/4] [info] [Task Finished] Transform to mem in 0.264078s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:12:39.597] [E/8] [info] [Task Finished] Transform to mem in 0.267317s (14235 normal rows, 10048 exceptions)
[2021-03-31 18:12:39.744] [E/14] [info] [Task Finished] Transform to mem in 0.252856s (14144 normal rows, 9995 exceptions)
[2021-03-31 18:12:39.746] [E/11] [info] [Task Finished] Transform to mem in 0.252780s (14015 normal rows, 9952 exceptions)
[2021-03-31 18:12:39.747] [E/12] [info] [Task Finished] Transform to mem in 0.254031s (14237 normal rows, 10069 exceptions)
[2021-03-31 18:12:39.748] [E/9] [info] [Task Finished] Transform to mem in 0.254078s (14159 normal rows, 9996 exceptions)
[2021-03-31 18:12:39.748] [E/10] [info] [Task Finished] Transform to mem in 0.254465s (14010 normal rows, 9932 exceptions)
[2021-03-31 18:12:39.749] [driver] [info] [Task Finished] Transform to mem in 0.254118s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:12:39.749] [E/2] [info] [Task Finished] Transform to mem in 0.253008s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:12:39.750] [E/15] [info] [Task Finished] Transform to mem in 0.254362s (14178 normal rows, 10009 exceptions)
[2021-03-31 18:12:39.751] [E/7] [info] [Task Finished] Transform to mem in 0.254229s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:12:39.751] [E/3] [info] [Task Finished] Transform to mem in 0.253224s (13901 normal rows, 9892 exceptions)
[2021-03-31 18:12:39.751] [E/1] [info] [Task Finished] Transform to mem in 0.253767s (14236 normal rows, 10015 exceptions)
[2021-03-31 18:12:39.753] [E/13] [info] [Task Finished] Transform to mem in 0.254352s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:12:39.755] [E/6] [info] [Task Finished] Transform to mem in 0.254629s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:12:39.757] [E/5] [info] [Task Finished] Transform to mem in 0.253894s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:12:39.831] [E/4] [info] [Task Finished] Transform to mem in 0.265155s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:12:39.864] [E/8] [info] [Task Finished] Transform to mem in 0.267255s (14245 normal rows, 10024 exceptions)
[2021-03-31 18:12:39.997] [E/14] [info] [Task Finished] Transform to mem in 0.252787s (13999 normal rows, 9935 exceptions)
[2021-03-31 18:12:39.999] [E/11] [info] [Task Finished] Transform to mem in 0.253608s (14158 normal rows, 10036 exceptions)
[2021-03-31 18:12:40.001] [E/12] [info] [Task Finished] Transform to mem in 0.253906s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:12:40.002] [E/9] [info] [Task Finished] Transform to mem in 0.253626s (14020 normal rows, 9989 exceptions)
[2021-03-31 18:12:40.002] [E/2] [info] [Task Finished] Transform to mem in 0.253370s (14054 normal rows, 9985 exceptions)
[2021-03-31 18:12:40.003] [E/10] [info] [Task Finished] Transform to mem in 0.254064s (14173 normal rows, 10004 exceptions)
[2021-03-31 18:12:40.003] [driver] [info] [Task Finished] Transform to mem in 0.254755s (14235 normal rows, 10041 exceptions)
[2021-03-31 18:12:40.003] [E/15] [info] [Task Finished] Transform to mem in 0.253554s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:12:40.005] [E/3] [info] [Task Finished] Transform to mem in 0.253603s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:12:40.005] [E/1] [info] [Task Finished] Transform to mem in 0.253552s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:12:40.005] [E/7] [info] [Task Finished] Transform to mem in 0.253776s (14238 normal rows, 10033 exceptions)
[2021-03-31 18:12:40.007] [E/13] [info] [Task Finished] Transform to mem in 0.253821s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:12:40.010] [E/6] [info] [Task Finished] Transform to mem in 0.254612s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:12:40.012] [E/5] [info] [Task Finished] Transform to mem in 0.254531s (14094 normal rows, 9996 exceptions)
[2021-03-31 18:12:40.094] [E/4] [info] [Task Finished] Transform to mem in 0.263058s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:12:40.131] [E/8] [info] [Task Finished] Transform to mem in 0.266971s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:12:40.251] [E/14] [info] [Task Finished] Transform to mem in 0.253962s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:12:40.253] [E/11] [info] [Task Finished] Transform to mem in 0.253902s (14217 normal rows, 10042 exceptions)
[2021-03-31 18:12:40.254] [E/12] [info] [Task Finished] Transform to mem in 0.253140s (14094 normal rows, 9998 exceptions)
[2021-03-31 18:12:40.255] [E/9] [info] [Task Finished] Transform to mem in 0.253622s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:12:40.256] [E/10] [info] [Task Finished] Transform to mem in 0.253280s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:12:40.256] [E/2] [info] [Task Finished] Transform to mem in 0.253706s (14223 normal rows, 10048 exceptions)
[2021-03-31 18:12:40.257] [E/15] [info] [Task Finished] Transform to mem in 0.253928s (14232 normal rows, 10069 exceptions)
[2021-03-31 18:12:40.258] [driver] [info] [Task Finished] Transform to mem in 0.254146s (14086 normal rows, 9953 exceptions)
[2021-03-31 18:12:40.258] [E/1] [info] [Task Finished] Transform to mem in 0.253225s (14002 normal rows, 9932 exceptions)
[2021-03-31 18:12:40.258] [E/3] [info] [Task Finished] Transform to mem in 0.253674s (14170 normal rows, 9995 exceptions)
[2021-03-31 18:12:40.259] [E/7] [info] [Task Finished] Transform to mem in 0.254194s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:12:40.261] [E/13] [info] [Task Finished] Transform to mem in 0.253877s (14206 normal rows, 10009 exceptions)
[2021-03-31 18:12:40.264] [E/6] [info] [Task Finished] Transform to mem in 0.253752s (13961 normal rows, 9907 exceptions)
[2021-03-31 18:12:40.267] [E/5] [info] [Task Finished] Transform to mem in 0.254629s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:12:40.357] [E/4] [info] [Task Finished] Transform to mem in 0.263146s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:12:40.442] [E/8] [info] [Task Finished] Transform to mem in 0.310278s (16320 normal rows, 11605 exceptions)
[2021-03-31 18:12:40.442] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.73226s
[2021-03-31 18:12:40.442] [global] [info] [Transform Stage] Stage 0 total wall clock time: 41.0475s, 54108450 input rows, time to process 1 row via fast path: 0.000758615ms
[2021-03-31 18:12:40.442] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2021-03-31 18:12:40.446] [local ee] [info] compiled pure python pipeline in 0.003804s
[2021-03-31 18:12:40.446] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 18:12:40.447] [local ee] [info] Created 160 resolve tasks in 0.001174s
[2021-03-31 18:12:40.447] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 18:12:40.454] [E/7] [info] [Task Finished] Resolve in 0.007255s
[2021-03-31 18:12:40.454] [E/2] [info] [Task Finished] Resolve in 0.007271s
[2021-03-31 18:12:40.454] [E/13] [info] [Task Finished] Resolve in 0.007279s
[2021-03-31 18:12:40.454] [E/1] [info] [Task Finished] Resolve in 0.007284s
[2021-03-31 18:12:40.454] [E/4] [info] [Task Finished] Resolve in 0.007335s
[2021-03-31 18:12:40.454] [E/3] [info] [Task Finished] Resolve in 0.007341s
[2021-03-31 18:12:40.454] [driver] [info] [Task Finished] Resolve in 0.007336s
[2021-03-31 18:12:40.454] [E/11] [info] [Task Finished] Resolve in 0.007344s
[2021-03-31 18:12:40.454] [E/6] [info] [Task Finished] Resolve in 0.007352s
[2021-03-31 18:12:40.454] [E/15] [info] [Task Finished] Resolve in 0.007363s
[2021-03-31 18:12:40.454] [E/14] [info] [Task Finished] Resolve in 0.007368s
[2021-03-31 18:12:40.454] [E/9] [info] [Task Finished] Resolve in 0.007396s
[2021-03-31 18:12:40.454] [E/5] [info] [Task Finished] Resolve in 0.007388s
[2021-03-31 18:12:40.454] [E/8] [info] [Task Finished] Resolve in 0.007412s
[2021-03-31 18:12:40.454] [E/10] [info] [Task Finished] Resolve in 0.007405s
[2021-03-31 18:12:40.454] [E/12] [info] [Task Finished] Resolve in 0.007381s
[2021-03-31 18:12:40.461] [E/13] [info] [Task Finished] Resolve in 0.007272s
[2021-03-31 18:12:40.461] [E/1] [info] [Task Finished] Resolve in 0.007268s
[2021-03-31 18:12:40.462] [E/2] [info] [Task Finished] Resolve in 0.007307s
[2021-03-31 18:12:40.462] [E/7] [info] [Task Finished] Resolve in 0.007341s
[2021-03-31 18:12:40.462] [E/3] [info] [Task Finished] Resolve in 0.007270s
[2021-03-31 18:12:40.462] [E/6] [info] [Task Finished] Resolve in 0.007272s
[2021-03-31 18:12:40.462] [E/14] [info] [Task Finished] Resolve in 0.007258s
[2021-03-31 18:12:40.462] [driver] [info] [Task Finished] Resolve in 0.007290s
[2021-03-31 18:12:40.462] [E/11] [info] [Task Finished] Resolve in 0.007302s
[2021-03-31 18:12:40.462] [E/15] [info] [Task Finished] Resolve in 0.007281s
[2021-03-31 18:12:40.462] [E/10] [info] [Task Finished] Resolve in 0.007263s
[2021-03-31 18:12:40.462] [E/5] [info] [Task Finished] Resolve in 0.007289s
[2021-03-31 18:12:40.462] [E/9] [info] [Task Finished] Resolve in 0.007299s
[2021-03-31 18:12:40.462] [E/4] [info] [Task Finished] Resolve in 0.007311s
[2021-03-31 18:12:40.462] [E/8] [info] [Task Finished] Resolve in 0.007325s
[2021-03-31 18:12:40.462] [E/12] [info] [Task Finished] Resolve in 0.007315s
[2021-03-31 18:12:40.469] [E/2] [info] [Task Finished] Resolve in 0.007042s
[2021-03-31 18:12:40.469] [E/7] [info] [Task Finished] Resolve in 0.007047s
[2021-03-31 18:12:40.469] [E/1] [info] [Task Finished] Resolve in 0.007093s
[2021-03-31 18:12:40.469] [E/14] [info] [Task Finished] Resolve in 0.007010s
[2021-03-31 18:12:40.469] [E/13] [info] [Task Finished] Resolve in 0.007107s
[2021-03-31 18:12:40.469] [E/4] [info] [Task Finished] Resolve in 0.006994s
[2021-03-31 18:12:40.469] [E/3] [info] [Task Finished] Resolve in 0.007130s
[2021-03-31 18:12:40.469] [E/15] [info] [Task Finished] Resolve in 0.007111s
[2021-03-31 18:12:40.469] [E/6] [info] [Task Finished] Resolve in 0.007150s
[2021-03-31 18:12:40.469] [E/11] [info] [Task Finished] Resolve in 0.007139s
[2021-03-31 18:12:40.469] [driver] [info] [Task Finished] Resolve in 0.007180s
[2021-03-31 18:12:40.469] [E/10] [info] [Task Finished] Resolve in 0.007170s
[2021-03-31 18:12:40.469] [E/5] [info] [Task Finished] Resolve in 0.007179s
[2021-03-31 18:12:40.469] [E/9] [info] [Task Finished] Resolve in 0.007172s
[2021-03-31 18:12:40.469] [E/12] [info] [Task Finished] Resolve in 0.007146s
[2021-03-31 18:12:40.469] [E/8] [info] [Task Finished] Resolve in 0.007167s
[2021-03-31 18:12:40.476] [E/2] [info] [Task Finished] Resolve in 0.007218s
[2021-03-31 18:12:40.476] [E/1] [info] [Task Finished] Resolve in 0.007278s
[2021-03-31 18:12:40.476] [E/13] [info] [Task Finished] Resolve in 0.007279s
[2021-03-31 18:12:40.476] [E/7] [info] [Task Finished] Resolve in 0.007345s
[2021-03-31 18:12:40.476] [E/14] [info] [Task Finished] Resolve in 0.007340s
[2021-03-31 18:12:40.476] [E/3] [info] [Task Finished] Resolve in 0.007342s
[2021-03-31 18:12:40.476] [E/4] [info] [Task Finished] Resolve in 0.007387s
[2021-03-31 18:12:40.476] [E/6] [info] [Task Finished] Resolve in 0.007321s
[2021-03-31 18:12:40.476] [E/15] [info] [Task Finished] Resolve in 0.007339s
[2021-03-31 18:12:40.476] [E/11] [info] [Task Finished] Resolve in 0.007357s
[2021-03-31 18:12:40.476] [E/10] [info] [Task Finished] Resolve in 0.007334s
[2021-03-31 18:12:40.476] [driver] [info] [Task Finished] Resolve in 0.007357s
[2021-03-31 18:12:40.476] [E/5] [info] [Task Finished] Resolve in 0.007365s
[2021-03-31 18:12:40.476] [E/9] [info] [Task Finished] Resolve in 0.007364s
[2021-03-31 18:12:40.476] [E/12] [info] [Task Finished] Resolve in 0.007352s
[2021-03-31 18:12:40.476] [E/8] [info] [Task Finished] Resolve in 0.007328s
[2021-03-31 18:12:40.483] [E/2] [info] [Task Finished] Resolve in 0.007364s
[2021-03-31 18:12:40.483] [E/13] [info] [Task Finished] Resolve in 0.007382s
[2021-03-31 18:12:40.483] [E/7] [info] [Task Finished] Resolve in 0.007381s
[2021-03-31 18:12:40.483] [E/1] [info] [Task Finished] Resolve in 0.007441s
[2021-03-31 18:12:40.483] [E/14] [info] [Task Finished] Resolve in 0.007389s
[2021-03-31 18:12:40.483] [E/4] [info] [Task Finished] Resolve in 0.007348s
[2021-03-31 18:12:40.483] [E/6] [info] [Task Finished] Resolve in 0.007353s
[2021-03-31 18:12:40.483] [E/11] [info] [Task Finished] Resolve in 0.007335s
[2021-03-31 18:12:40.483] [E/3] [info] [Task Finished] Resolve in 0.007430s
[2021-03-31 18:12:40.483] [E/15] [info] [Task Finished] Resolve in 0.007396s
[2021-03-31 18:12:40.484] [driver] [info] [Task Finished] Resolve in 0.007344s
[2021-03-31 18:12:40.484] [E/8] [info] [Task Finished] Resolve in 0.007317s
[2021-03-31 18:12:40.484] [E/5] [info] [Task Finished] Resolve in 0.007390s
[2021-03-31 18:12:40.484] [E/12] [info] [Task Finished] Resolve in 0.007371s
[2021-03-31 18:12:40.484] [E/10] [info] [Task Finished] Resolve in 0.007445s
[2021-03-31 18:12:40.484] [E/9] [info] [Task Finished] Resolve in 0.007451s
[2021-03-31 18:12:40.490] [E/2] [info] [Task Finished] Resolve in 0.007304s
[2021-03-31 18:12:40.491] [E/13] [info] [Task Finished] Resolve in 0.007189s
[2021-03-31 18:12:40.491] [E/14] [info] [Task Finished] Resolve in 0.007161s
[2021-03-31 18:12:40.491] [E/6] [info] [Task Finished] Resolve in 0.007191s
[2021-03-31 18:12:40.491] [E/7] [info] [Task Finished] Resolve in 0.007298s
[2021-03-31 18:12:40.491] [E/1] [info] [Task Finished] Resolve in 0.007312s
[2021-03-31 18:12:40.491] [E/4] [info] [Task Finished] Resolve in 0.007316s
[2021-03-31 18:12:40.491] [E/15] [info] [Task Finished] Resolve in 0.007268s
[2021-03-31 18:12:40.491] [E/11] [info] [Task Finished] Resolve in 0.007306s
[2021-03-31 18:12:40.491] [E/8] [info] [Task Finished] Resolve in 0.007241s
[2021-03-31 18:12:40.491] [E/3] [info] [Task Finished] Resolve in 0.007325s
[2021-03-31 18:12:40.491] [driver] [info] [Task Finished] Resolve in 0.007323s
[2021-03-31 18:12:40.491] [E/5] [info] [Task Finished] Resolve in 0.007277s
[2021-03-31 18:12:40.491] [E/10] [info] [Task Finished] Resolve in 0.007246s
[2021-03-31 18:12:40.491] [E/12] [info] [Task Finished] Resolve in 0.007309s
[2021-03-31 18:12:40.491] [E/9] [info] [Task Finished] Resolve in 0.007272s
[2021-03-31 18:12:40.498] [E/2] [info] [Task Finished] Resolve in 0.007119s
[2021-03-31 18:12:40.498] [E/14] [info] [Task Finished] Resolve in 0.007071s
[2021-03-31 18:12:40.498] [E/13] [info] [Task Finished] Resolve in 0.007100s
[2021-03-31 18:12:40.498] [E/7] [info] [Task Finished] Resolve in 0.007093s
[2021-03-31 18:12:40.498] [E/1] [info] [Task Finished] Resolve in 0.007094s
[2021-03-31 18:12:40.498] [E/6] [info] [Task Finished] Resolve in 0.007126s
[2021-03-31 18:12:40.498] [E/15] [info] [Task Finished] Resolve in 0.007087s
[2021-03-31 18:12:40.498] [E/11] [info] [Task Finished] Resolve in 0.007084s
[2021-03-31 18:12:40.498] [E/8] [info] [Task Finished] Resolve in 0.007117s
[2021-03-31 18:12:40.498] [E/4] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:12:40.498] [driver] [info] [Task Finished] Resolve in 0.007117s
[2021-03-31 18:12:40.498] [E/3] [info] [Task Finished] Resolve in 0.007144s
[2021-03-31 18:12:40.498] [E/5] [info] [Task Finished] Resolve in 0.007134s
[2021-03-31 18:12:40.498] [E/10] [info] [Task Finished] Resolve in 0.007123s
[2021-03-31 18:12:40.498] [E/12] [info] [Task Finished] Resolve in 0.007073s
[2021-03-31 18:12:40.498] [E/9] [info] [Task Finished] Resolve in 0.007180s
[2021-03-31 18:12:40.505] [E/14] [info] [Task Finished] Resolve in 0.007263s
[2021-03-31 18:12:40.505] [E/2] [info] [Task Finished] Resolve in 0.007287s
[2021-03-31 18:12:40.505] [E/13] [info] [Task Finished] Resolve in 0.007375s
[2021-03-31 18:12:40.505] [E/1] [info] [Task Finished] Resolve in 0.007269s
[2021-03-31 18:12:40.505] [E/7] [info] [Task Finished] Resolve in 0.007314s
[2021-03-31 18:12:40.505] [E/15] [info] [Task Finished] Resolve in 0.007208s
[2021-03-31 18:12:40.505] [E/6] [info] [Task Finished] Resolve in 0.007355s
[2021-03-31 18:12:40.505] [E/4] [info] [Task Finished] Resolve in 0.007199s
[2021-03-31 18:12:40.505] [E/11] [info] [Task Finished] Resolve in 0.007317s
[2021-03-31 18:12:40.505] [E/10] [info] [Task Finished] Resolve in 0.007230s
[2021-03-31 18:12:40.505] [E/8] [info] [Task Finished] Resolve in 0.007359s
[2021-03-31 18:12:40.505] [driver] [info] [Task Finished] Resolve in 0.007370s
[2021-03-31 18:12:40.505] [E/5] [info] [Task Finished] Resolve in 0.007346s
[2021-03-31 18:12:40.505] [E/12] [info] [Task Finished] Resolve in 0.007334s
[2021-03-31 18:12:40.505] [E/3] [info] [Task Finished] Resolve in 0.007386s
[2021-03-31 18:12:40.506] [E/9] [info] [Task Finished] Resolve in 0.007373s
[2021-03-31 18:12:40.512] [E/14] [info] [Task Finished] Resolve in 0.007208s
[2021-03-31 18:12:40.512] [E/2] [info] [Task Finished] Resolve in 0.007259s
[2021-03-31 18:12:40.512] [E/1] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:12:40.512] [E/7] [info] [Task Finished] Resolve in 0.007234s
[2021-03-31 18:12:40.512] [E/15] [info] [Task Finished] Resolve in 0.007267s
[2021-03-31 18:12:40.512] [E/13] [info] [Task Finished] Resolve in 0.007363s
[2021-03-31 18:12:40.512] [E/4] [info] [Task Finished] Resolve in 0.007267s
[2021-03-31 18:12:40.512] [E/6] [info] [Task Finished] Resolve in 0.007305s
[2021-03-31 18:12:40.512] [E/11] [info] [Task Finished] Resolve in 0.007236s
[2021-03-31 18:12:40.513] [E/10] [info] [Task Finished] Resolve in 0.007265s
[2021-03-31 18:12:40.513] [E/5] [info] [Task Finished] Resolve in 0.007252s
[2021-03-31 18:12:40.513] [E/8] [info] [Task Finished] Resolve in 0.007316s
[2021-03-31 18:12:40.513] [E/12] [info] [Task Finished] Resolve in 0.007245s
[2021-03-31 18:12:40.513] [driver] [info] [Task Finished] Resolve in 0.007314s
[2021-03-31 18:12:40.513] [E/3] [info] [Task Finished] Resolve in 0.007303s
[2021-03-31 18:12:40.513] [E/9] [info] [Task Finished] Resolve in 0.007296s
[2021-03-31 18:12:40.519] [E/14] [info] [Task Finished] Resolve in 0.007114s
[2021-03-31 18:12:40.519] [E/2] [info] [Task Finished] Resolve in 0.007192s
[2021-03-31 18:12:40.519] [E/7] [info] [Task Finished] Resolve in 0.007150s
[2021-03-31 18:12:40.520] [E/1] [info] [Task Finished] Resolve in 0.007175s
[2021-03-31 18:12:40.520] [E/15] [info] [Task Finished] Resolve in 0.007157s
[2021-03-31 18:12:40.520] [E/11] [info] [Task Finished] Resolve in 0.007122s
[2021-03-31 18:12:40.520] [E/6] [info] [Task Finished] Resolve in 0.007162s
[2021-03-31 18:12:40.520] [E/13] [info] [Task Finished] Resolve in 0.007269s
[2021-03-31 18:12:40.520] [E/4] [info] [Task Finished] Resolve in 0.007249s
[2021-03-31 18:12:40.520] [E/12] [info] [Task Finished] Resolve in 0.007136s
[2021-03-31 18:12:40.520] [E/10] [info] [Task Finished] Resolve in 0.007249s
[2021-03-31 18:12:40.520] [E/5] [info] [Task Finished] Resolve in 0.007279s
[2021-03-31 18:12:40.520] [E/8] [info] [Task Finished] Resolve in 0.007273s
[2021-03-31 18:12:40.520] [E/3] [info] [Task Finished] Resolve in 0.007280s
[2021-03-31 18:12:40.520] [driver] [info] [Task Finished] Resolve in 0.007320s
[2021-03-31 18:12:40.521] [E/9] [info] [Task Finished] Resolve in 0.008356s
[2021-03-31 18:12:40.521] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 0.0795316s
[2021-03-31 18:12:40.521] [local ee] [info] slow path for Stage 0: total wall clock time: 1.16349s, time to process 1 row via slow path: 0.000726004ms
[2021-03-31 18:12:40.521] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.0795574s

[2021-03-31 18:12:40.564] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2021-03-31 18:12:40.590] [E/9] [info] [Task Finished] write to file in 0.025284s (87192 rows, 13.27 MB)
[2021-03-31 18:12:40.605] [E/15] [info] [Task Finished] write to file in 0.040528s (155704 rows, 23.70 MB)
[2021-03-31 18:12:40.605] [E/13] [info] [Task Finished] write to file in 0.040593s (155606 rows, 23.69 MB)
[2021-03-31 18:12:40.606] [E/3] [info] [Task Finished] write to file in 0.041150s (155476 rows, 23.67 MB)
[2021-03-31 18:12:40.606] [E/10] [info] [Task Finished] write to file in 0.041725s (155626 rows, 23.69 MB)
[2021-03-31 18:12:40.607] [E/12] [info] [Task Finished] write to file in 0.042194s (155541 rows, 23.68 MB)
[2021-03-31 18:12:40.607] [E/14] [info] [Task Finished] write to file in 0.042215s (155417 rows, 23.66 MB)
[2021-03-31 18:12:40.607] [E/1] [info] [Task Finished] write to file in 0.042302s (155417 rows, 23.66 MB)
[2021-03-31 18:12:40.607] [E/11] [info] [Task Finished] write to file in 0.042310s (155530 rows, 23.67 MB)
[2021-03-31 18:12:40.607] [E/6] [info] [Task Finished] write to file in 0.042341s (155530 rows, 23.67 MB)
[2021-03-31 18:12:40.607] [E/5] [info] [Task Finished] write to file in 0.042340s (155541 rows, 23.68 MB)
[2021-03-31 18:12:40.607] [E/4] [info] [Task Finished] write to file in 0.042391s (155395 rows, 23.66 MB)
[2021-03-31 18:12:40.607] [E/7] [info] [Task Finished] write to file in 0.042433s (155415 rows, 23.66 MB)
[2021-03-31 18:12:40.607] [driver] [info] [Task Finished] write to file in 0.042538s (155476 rows, 23.67 MB)
[2021-03-31 18:12:40.616] [E/2] [info] [Task Finished] write to file in 0.051068s (155704 rows, 23.70 MB)
[2021-03-31 18:12:40.616] [global] [info] writing output took 0.094279s
[2021-03-31 18:12:40.616] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0943639s
[2021-03-31 18:12:40.616] [global] [info] [Transform Stage] Stage 0 took 3.35232s
[2021-03-31 18:12:40.616] [global] [info] Query Execution took 3.45231s. (planning: 0.0999601s, execution: 3.35235s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 05:47:10) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.006049394607543945
Tuplex job time: 3.722038745880127 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '6bcf8f6a24af', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0203854,"llvm_optimization_time_s":0.296034,"llvm_compilation_time_s":0.134428,"total_compilation_time_s":0.446103,"sampling_time_s":0.109496,"stages":[{"stage_no":0,"fast_path_wall_time_s":41.0475,"fast_path_time_s":2.73228,"fast_path_per_row_time_ns":758.615,"slow_path_wall_time_s":1.16349,"slow_path_time_s":0.0795316,"slow_path_per_row_time_ns":726.004}]}
{"startupTime": 0.006049394607543945, "jobTime": 3.722038745880127}
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.640] [local execution engine] [info] Stopped local executor E/1
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.644] [local execution engine] [info] Stopped local executor E/2
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.647] [local execution engine] [info] Stopped local executor E/3
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.650] [local execution engine] [info] Stopped local executor E/4
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.653] [local execution engine] [info] Stopped local executor E/5
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.656] [local execution engine] [info] Stopped local executor E/6
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.660] [local execution engine] [info] Stopped local executor E/7
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.663] [local execution engine] [info] Stopped local executor E/8
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.666] [local execution engine] [info] Stopped local executor E/9
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.669] [local execution engine] [info] Stopped local executor E/10
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.672] [local execution engine] [info] Stopped local executor E/11
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.675] [local execution engine] [info] Stopped local executor E/12
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.678] [local execution engine] [info] Stopped local executor E/13
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.682] [local execution engine] [info] Stopped local executor E/14
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:40.685] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 21 active partitions
