[2021-03-31 18:13:09.216] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:13:09.216] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:13:09.216] [local ee] [info] initializing LLVM backend
[2021-03-31 18:13:09.216] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:13:09.216] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.217] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.217] [E/1] [info] starting detached process queue
[2021-03-31 18:13:09.217] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.217] [E/2] [info] starting detached process queue
[2021-03-31 18:13:09.217] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.217] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.217] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.217] [E/3] [info] starting detached process queue
[2021-03-31 18:13:09.217] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.217] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.217] [E/4] [info] starting detached process queue
[2021-03-31 18:13:09.217] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.217] [E/5] [info] starting detached process queue
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.217] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.218] [E/6] [info] starting detached process queue
[2021-03-31 18:13:09.218] [E/7] [info] starting detached process queue
[2021-03-31 18:13:09.218] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.218] [E/8] [info] starting detached process queue
[2021-03-31 18:13:09.218] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.218] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [E/9] [info] starting detached process queue
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.218] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.218] [E/10] [info] starting detached process queue
[2021-03-31 18:13:09.218] [E/11] [info] starting detached process queue
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.218] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [E/12] [info] starting detached process queue
[2021-03-31 18:13:09.218] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [E/13] [info] starting detached process queue
[2021-03-31 18:13:09.218] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.218] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.218] [E/14] [info] starting detached process queue
[2021-03-31 18:13:09.218] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:13:09.218] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [E/15] [info] starting detached process queue
[2021-03-31 18:13:09.218] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 18:13:09.218] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:13:09.218] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:13:09.218] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 18:13:09.218] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2021-03-31 18:13:09.352] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.368] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.376] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.403] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.424] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.437] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.470] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.487] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:09.489] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:09.492] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:09.494] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:09.510] [logical planner] [info] logical optimization took 0.020422ms
[2021-03-31 18:13:09.511] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.514] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.518] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.523] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.525] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.527] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.529] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:13:09.537] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:13:09.538] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,f64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:13:09.538] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2021-03-31 18:13:09.539] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2021-03-31 18:13:09.540] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2021-03-31 18:13:09.540] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2021-03-31 18:13:09.541] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2021-03-31 18:13:09.541] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2021-03-31 18:13:09.542] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:13:09.543] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2021-03-31 18:13:09.543] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2021-03-31 18:13:09.544] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2021-03-31 18:13:09.545] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:13:09.546] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:09.547] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:09.547] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2021-03-31 18:13:09.549] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:13:09.549] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:13:09.550] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:13:09.551] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:13:09.551] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:13:09.552] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:13:09.553] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 18:13:09.553] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 18:13:09.554] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 18:13:09.555] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:13:09.556] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:09.557] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:13:09.557] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 18:13:09.587] [global] [info] Stage0 depends on: 
[2021-03-31 18:13:09.900] [global] [info] Optimization via LLVM passes took 0.297114 ms
[2021-03-31 18:13:10.035] [global] [info] Compiled code paths for stage 0 in 0.14 ms
[2021-03-31 18:13:10.035] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.448139s
[2021-03-31 18:13:10.036] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2021-03-31 18:13:10.291] [E/2] [info] [Task Finished] Transform to mem in 0.255397s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:13:10.291] [driver] [info] [Task Finished] Transform to mem in 0.255569s (14020 normal rows, 9982 exceptions)
[2021-03-31 18:13:10.291] [E/8] [info] [Task Finished] Transform to mem in 0.255637s (13988 normal rows, 9938 exceptions)
[2021-03-31 18:13:10.291] [E/4] [info] [Task Finished] Transform to mem in 0.255727s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:13:10.292] [E/9] [info] [Task Finished] Transform to mem in 0.255901s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:13:10.292] [E/13] [info] [Task Finished] Transform to mem in 0.255966s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:13:10.292] [E/14] [info] [Task Finished] Transform to mem in 0.256110s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:13:10.292] [E/11] [info] [Task Finished] Transform to mem in 0.256122s (14217 normal rows, 10015 exceptions)
[2021-03-31 18:13:10.292] [E/12] [info] [Task Finished] Transform to mem in 0.256132s (14162 normal rows, 9952 exceptions)
[2021-03-31 18:13:10.292] [E/15] [info] [Task Finished] Transform to mem in 0.256250s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:13:10.292] [E/7] [info] [Task Finished] Transform to mem in 0.256317s (14177 normal rows, 10036 exceptions)
[2021-03-31 18:13:10.292] [E/5] [info] [Task Finished] Transform to mem in 0.256326s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:13:10.292] [E/10] [info] [Task Finished] Transform to mem in 0.256600s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:13:10.293] [E/6] [info] [Task Finished] Transform to mem in 0.256849s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:13:10.293] [E/3] [info] [Task Finished] Transform to mem in 0.257329s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:13:10.300] [E/1] [info] [Task Finished] Transform to mem in 0.264496s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:13:10.544] [driver] [info] [Task Finished] Transform to mem in 0.252449s (14059 normal rows, 9985 exceptions)
[2021-03-31 18:13:10.544] [E/2] [info] [Task Finished] Transform to mem in 0.252727s (14241 normal rows, 10100 exceptions)
[2021-03-31 18:13:10.544] [E/8] [info] [Task Finished] Transform to mem in 0.252805s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:13:10.544] [E/13] [info] [Task Finished] Transform to mem in 0.252722s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:13:10.545] [E/12] [info] [Task Finished] Transform to mem in 0.252782s (14097 normal rows, 10002 exceptions)
[2021-03-31 18:13:10.545] [E/4] [info] [Task Finished] Transform to mem in 0.253354s (14238 normal rows, 10030 exceptions)
[2021-03-31 18:13:10.545] [E/7] [info] [Task Finished] Transform to mem in 0.252801s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:13:10.545] [E/14] [info] [Task Finished] Transform to mem in 0.253150s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:13:10.545] [E/9] [info] [Task Finished] Transform to mem in 0.253384s (14081 normal rows, 9995 exceptions)
[2021-03-31 18:13:10.545] [E/15] [info] [Task Finished] Transform to mem in 0.253095s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:13:10.545] [E/5] [info] [Task Finished] Transform to mem in 0.253175s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:13:10.545] [E/11] [info] [Task Finished] Transform to mem in 0.253389s (14086 normal rows, 9989 exceptions)
[2021-03-31 18:13:10.545] [E/10] [info] [Task Finished] Transform to mem in 0.253117s (14212 normal rows, 10032 exceptions)
[2021-03-31 18:13:10.546] [E/6] [info] [Task Finished] Transform to mem in 0.253176s (14099 normal rows, 10008 exceptions)
[2021-03-31 18:13:10.547] [E/3] [info] [Task Finished] Transform to mem in 0.253663s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:13:10.561] [E/1] [info] [Task Finished] Transform to mem in 0.260942s (14223 normal rows, 10035 exceptions)
[2021-03-31 18:13:10.798] [E/2] [info] [Task Finished] Transform to mem in 0.253586s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:13:10.798] [E/13] [info] [Task Finished] Transform to mem in 0.253798s (14170 normal rows, 9994 exceptions)
[2021-03-31 18:13:10.799] [E/7] [info] [Task Finished] Transform to mem in 0.253667s (14206 normal rows, 9991 exceptions)
[2021-03-31 18:13:10.799] [E/8] [info] [Task Finished] Transform to mem in 0.254346s (14235 normal rows, 10062 exceptions)
[2021-03-31 18:13:10.799] [E/14] [info] [Task Finished] Transform to mem in 0.253565s (13961 normal rows, 9925 exceptions)
[2021-03-31 18:13:10.799] [E/5] [info] [Task Finished] Transform to mem in 0.253590s (13915 normal rows, 9900 exceptions)
[2021-03-31 18:13:10.799] [E/15] [info] [Task Finished] Transform to mem in 0.254343s (14233 normal rows, 10011 exceptions)
[2021-03-31 18:13:10.800] [E/11] [info] [Task Finished] Transform to mem in 0.254418s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:13:10.800] [E/4] [info] [Task Finished] Transform to mem in 0.254862s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:13:10.800] [E/6] [info] [Task Finished] Transform to mem in 0.253938s (13892 normal rows, 9882 exceptions)
[2021-03-31 18:13:10.800] [E/10] [info] [Task Finished] Transform to mem in 0.254496s (14267 normal rows, 10030 exceptions)
[2021-03-31 18:13:10.800] [E/9] [info] [Task Finished] Transform to mem in 0.255237s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:13:10.802] [driver] [info] [Task Finished] Transform to mem in 0.258300s (14089 normal rows, 10008 exceptions)
[2021-03-31 18:13:10.802] [E/3] [info] [Task Finished] Transform to mem in 0.255448s (14245 normal rows, 10101 exceptions)
[2021-03-31 18:13:10.803] [E/12] [info] [Task Finished] Transform to mem in 0.258286s (14002 normal rows, 9940 exceptions)
[2021-03-31 18:13:10.823] [E/1] [info] [Task Finished] Transform to mem in 0.262222s (14260 normal rows, 10025 exceptions)
[2021-03-31 18:13:11.049] [E/2] [info] [Task Finished] Transform to mem in 0.251824s (13978 normal rows, 9907 exceptions)
[2021-03-31 18:13:11.051] [E/8] [info] [Task Finished] Transform to mem in 0.252476s (14015 normal rows, 9982 exceptions)
[2021-03-31 18:13:11.051] [E/7] [info] [Task Finished] Transform to mem in 0.252708s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:13:11.051] [E/14] [info] [Task Finished] Transform to mem in 0.252732s (14142 normal rows, 9989 exceptions)
[2021-03-31 18:13:11.051] [E/13] [info] [Task Finished] Transform to mem in 0.253158s (14181 normal rows, 10067 exceptions)
[2021-03-31 18:13:11.052] [E/15] [info] [Task Finished] Transform to mem in 0.252233s (13982 normal rows, 9975 exceptions)
[2021-03-31 18:13:11.052] [E/5] [info] [Task Finished] Transform to mem in 0.253239s (14280 normal rows, 10094 exceptions)
[2021-03-31 18:13:11.052] [E/11] [info] [Task Finished] Transform to mem in 0.252661s (14173 normal rows, 10006 exceptions)
[2021-03-31 18:13:11.053] [E/6] [info] [Task Finished] Transform to mem in 0.252836s (14054 normal rows, 9984 exceptions)
[2021-03-31 18:13:11.053] [E/4] [info] [Task Finished] Transform to mem in 0.253186s (14235 normal rows, 10040 exceptions)
[2021-03-31 18:13:11.053] [E/10] [info] [Task Finished] Transform to mem in 0.253007s (14129 normal rows, 10004 exceptions)
[2021-03-31 18:13:11.053] [E/9] [info] [Task Finished] Transform to mem in 0.253152s (14223 normal rows, 10033 exceptions)
[2021-03-31 18:13:11.056] [E/3] [info] [Task Finished] Transform to mem in 0.253449s (14108 normal rows, 10010 exceptions)
[2021-03-31 18:13:11.059] [driver] [info] [Task Finished] Transform to mem in 0.256746s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:13:11.060] [E/12] [info] [Task Finished] Transform to mem in 0.257193s (14208 normal rows, 10008 exceptions)
[2021-03-31 18:13:11.085] [E/1] [info] [Task Finished] Transform to mem in 0.261481s (14089 normal rows, 10031 exceptions)
[2021-03-31 18:13:11.305] [E/2] [info] [Task Finished] Transform to mem in 0.255579s (14094 normal rows, 9960 exceptions)
[2021-03-31 18:13:11.307] [E/8] [info] [Task Finished] Transform to mem in 0.255615s (14232 normal rows, 10017 exceptions)
[2021-03-31 18:13:11.307] [E/7] [info] [Task Finished] Transform to mem in 0.255495s (14088 normal rows, 10027 exceptions)
[2021-03-31 18:13:11.307] [E/14] [info] [Task Finished] Transform to mem in 0.255675s (14106 normal rows, 9955 exceptions)
[2021-03-31 18:13:11.307] [E/15] [info] [Task Finished] Transform to mem in 0.255411s (14113 normal rows, 9997 exceptions)
[2021-03-31 18:13:11.307] [E/13] [info] [Task Finished] Transform to mem in 0.255932s (14211 normal rows, 10043 exceptions)
[2021-03-31 18:13:11.308] [E/5] [info] [Task Finished] Transform to mem in 0.255705s (14075 normal rows, 9965 exceptions)
[2021-03-31 18:13:11.308] [E/11] [info] [Task Finished] Transform to mem in 0.255782s (14223 normal rows, 10049 exceptions)
[2021-03-31 18:13:11.308] [E/6] [info] [Task Finished] Transform to mem in 0.255752s (14095 normal rows, 9995 exceptions)
[2021-03-31 18:13:11.309] [E/4] [info] [Task Finished] Transform to mem in 0.255995s (14086 normal rows, 9952 exceptions)
[2021-03-31 18:13:11.309] [E/10] [info] [Task Finished] Transform to mem in 0.256427s (14226 normal rows, 10069 exceptions)
[2021-03-31 18:13:11.310] [E/9] [info] [Task Finished] Transform to mem in 0.256295s (14170 normal rows, 9996 exceptions)
[2021-03-31 18:13:11.312] [E/3] [info] [Task Finished] Transform to mem in 0.256354s (14002 normal rows, 9931 exceptions)
[2021-03-31 18:13:11.320] [driver] [info] [Task Finished] Transform to mem in 0.261070s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:13:11.320] [E/12] [info] [Task Finished] Transform to mem in 0.260207s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:13:11.347] [E/1] [info] [Task Finished] Transform to mem in 0.262087s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:13:11.561] [E/2] [info] [Task Finished] Transform to mem in 0.256224s (14237 normal rows, 10084 exceptions)
[2021-03-31 18:13:11.562] [E/7] [info] [Task Finished] Transform to mem in 0.255675s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:13:11.563] [E/8] [info] [Task Finished] Transform to mem in 0.255860s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:13:11.563] [E/15] [info] [Task Finished] Transform to mem in 0.256260s (14248 normal rows, 10030 exceptions)
[2021-03-31 18:13:11.563] [E/13] [info] [Task Finished] Transform to mem in 0.256043s (13912 normal rows, 9882 exceptions)
[2021-03-31 18:13:11.564] [E/14] [info] [Task Finished] Transform to mem in 0.256481s (14267 normal rows, 10099 exceptions)
[2021-03-31 18:13:11.564] [E/11] [info] [Task Finished] Transform to mem in 0.256147s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:13:11.564] [E/6] [info] [Task Finished] Transform to mem in 0.256108s (13988 normal rows, 9922 exceptions)
[2021-03-31 18:13:11.565] [E/5] [info] [Task Finished] Transform to mem in 0.257014s (14248 normal rows, 10094 exceptions)
[2021-03-31 18:13:11.566] [E/4] [info] [Task Finished] Transform to mem in 0.256821s (14171 normal rows, 10052 exceptions)
[2021-03-31 18:13:11.566] [E/10] [info] [Task Finished] Transform to mem in 0.256732s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:13:11.566] [E/9] [info] [Task Finished] Transform to mem in 0.256449s (14015 normal rows, 9985 exceptions)
[2021-03-31 18:13:11.569] [E/3] [info] [Task Finished] Transform to mem in 0.256740s (14176 normal rows, 9997 exceptions)
[2021-03-31 18:13:11.581] [E/12] [info] [Task Finished] Transform to mem in 0.260333s (14059 normal rows, 9978 exceptions)
[2021-03-31 18:13:11.581] [driver] [info] [Task Finished] Transform to mem in 0.260993s (14246 normal rows, 10108 exceptions)
[2021-03-31 18:13:11.612] [E/1] [info] [Task Finished] Transform to mem in 0.264856s (14114 normal rows, 10011 exceptions)
[2021-03-31 18:13:11.814] [E/2] [info] [Task Finished] Transform to mem in 0.252607s (14238 normal rows, 10007 exceptions)
[2021-03-31 18:13:11.815] [E/7] [info] [Task Finished] Transform to mem in 0.252796s (14081 normal rows, 10003 exceptions)
[2021-03-31 18:13:11.815] [E/8] [info] [Task Finished] Transform to mem in 0.252726s (14095 normal rows, 10024 exceptions)
[2021-03-31 18:13:11.816] [E/13] [info] [Task Finished] Transform to mem in 0.252584s (14086 normal rows, 9998 exceptions)
[2021-03-31 18:13:11.816] [E/14] [info] [Task Finished] Transform to mem in 0.252794s (14091 normal rows, 10001 exceptions)
[2021-03-31 18:13:11.816] [E/15] [info] [Task Finished] Transform to mem in 0.253019s (14221 normal rows, 9998 exceptions)
[2021-03-31 18:13:11.817] [E/11] [info] [Task Finished] Transform to mem in 0.252659s (14218 normal rows, 10016 exceptions)
[2021-03-31 18:13:11.817] [E/6] [info] [Task Finished] Transform to mem in 0.252936s (14095 normal rows, 10026 exceptions)
[2021-03-31 18:13:11.818] [E/5] [info] [Task Finished] Transform to mem in 0.252685s (14113 normal rows, 9960 exceptions)
[2021-03-31 18:13:11.819] [E/10] [info] [Task Finished] Transform to mem in 0.252513s (14114 normal rows, 10012 exceptions)
[2021-03-31 18:13:11.819] [E/4] [info] [Task Finished] Transform to mem in 0.253416s (14197 normal rows, 10028 exceptions)
[2021-03-31 18:13:11.820] [E/9] [info] [Task Finished] Transform to mem in 0.253283s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:13:11.822] [E/3] [info] [Task Finished] Transform to mem in 0.253443s (14197 normal rows, 10033 exceptions)
[2021-03-31 18:13:11.837] [E/12] [info] [Task Finished] Transform to mem in 0.256595s (14115 normal rows, 10010 exceptions)
[2021-03-31 18:13:11.839] [driver] [info] [Task Finished] Transform to mem in 0.258323s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:13:11.873] [E/1] [info] [Task Finished] Transform to mem in 0.261262s (14235 normal rows, 10048 exceptions)
[2021-03-31 18:13:12.066] [E/2] [info] [Task Finished] Transform to mem in 0.252362s (14144 normal rows, 9995 exceptions)
[2021-03-31 18:13:12.068] [E/7] [info] [Task Finished] Transform to mem in 0.252615s (14015 normal rows, 9952 exceptions)
[2021-03-31 18:13:12.068] [E/8] [info] [Task Finished] Transform to mem in 0.252979s (14237 normal rows, 10069 exceptions)
[2021-03-31 18:13:12.069] [E/13] [info] [Task Finished] Transform to mem in 0.252522s (14159 normal rows, 9996 exceptions)
[2021-03-31 18:13:12.069] [E/14] [info] [Task Finished] Transform to mem in 0.252317s (14010 normal rows, 9932 exceptions)
[2021-03-31 18:13:12.070] [E/11] [info] [Task Finished] Transform to mem in 0.252528s (14178 normal rows, 10009 exceptions)
[2021-03-31 18:13:12.070] [E/15] [info] [Task Finished] Transform to mem in 0.253462s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:13:12.070] [E/6] [info] [Task Finished] Transform to mem in 0.252769s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:13:12.071] [E/5] [info] [Task Finished] Transform to mem in 0.253767s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:13:12.072] [E/10] [info] [Task Finished] Transform to mem in 0.252839s (14236 normal rows, 10015 exceptions)
[2021-03-31 18:13:12.072] [E/4] [info] [Task Finished] Transform to mem in 0.252668s (13901 normal rows, 9892 exceptions)
[2021-03-31 18:13:12.073] [E/9] [info] [Task Finished] Transform to mem in 0.253821s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:13:12.076] [E/3] [info] [Task Finished] Transform to mem in 0.253282s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:13:12.095] [E/12] [info] [Task Finished] Transform to mem in 0.257148s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:13:12.097] [driver] [info] [Task Finished] Transform to mem in 0.257683s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:13:12.134] [E/1] [info] [Task Finished] Transform to mem in 0.261143s (14245 normal rows, 10024 exceptions)
[2021-03-31 18:13:12.318] [E/2] [info] [Task Finished] Transform to mem in 0.252190s (13999 normal rows, 9935 exceptions)
[2021-03-31 18:13:12.321] [E/13] [info] [Task Finished] Transform to mem in 0.252419s (14020 normal rows, 9989 exceptions)
[2021-03-31 18:13:12.321] [E/8] [info] [Task Finished] Transform to mem in 0.252841s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:13:12.321] [E/7] [info] [Task Finished] Transform to mem in 0.253292s (14158 normal rows, 10036 exceptions)
[2021-03-31 18:13:12.322] [E/14] [info] [Task Finished] Transform to mem in 0.253020s (14173 normal rows, 10004 exceptions)
[2021-03-31 18:13:12.323] [E/11] [info] [Task Finished] Transform to mem in 0.253240s (14235 normal rows, 10041 exceptions)
[2021-03-31 18:13:12.323] [E/15] [info] [Task Finished] Transform to mem in 0.252856s (14054 normal rows, 9985 exceptions)
[2021-03-31 18:13:12.324] [E/6] [info] [Task Finished] Transform to mem in 0.253446s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:13:12.324] [E/10] [info] [Task Finished] Transform to mem in 0.252451s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:13:12.325] [E/5] [info] [Task Finished] Transform to mem in 0.253129s (14238 normal rows, 10033 exceptions)
[2021-03-31 18:13:12.325] [E/4] [info] [Task Finished] Transform to mem in 0.253254s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:13:12.327] [E/9] [info] [Task Finished] Transform to mem in 0.253659s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:13:12.329] [E/3] [info] [Task Finished] Transform to mem in 0.253038s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:13:12.352] [E/12] [info] [Task Finished] Transform to mem in 0.257523s (14094 normal rows, 9996 exceptions)
[2021-03-31 18:13:12.355] [driver] [info] [Task Finished] Transform to mem in 0.257486s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:13:12.396] [E/1] [info] [Task Finished] Transform to mem in 0.261267s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:13:12.571] [E/2] [info] [Task Finished] Transform to mem in 0.252809s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:13:12.574] [E/13] [info] [Task Finished] Transform to mem in 0.253020s (14217 normal rows, 10042 exceptions)
[2021-03-31 18:13:12.574] [E/7] [info] [Task Finished] Transform to mem in 0.252808s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:13:12.575] [E/8] [info] [Task Finished] Transform to mem in 0.253384s (14094 normal rows, 9998 exceptions)
[2021-03-31 18:13:12.575] [E/11] [info] [Task Finished] Transform to mem in 0.252406s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:13:12.575] [E/14] [info] [Task Finished] Transform to mem in 0.253542s (14223 normal rows, 10048 exceptions)
[2021-03-31 18:13:12.576] [E/15] [info] [Task Finished] Transform to mem in 0.253016s (14086 normal rows, 9953 exceptions)
[2021-03-31 18:13:12.577] [E/10] [info] [Task Finished] Transform to mem in 0.252900s (14170 normal rows, 9995 exceptions)
[2021-03-31 18:13:12.577] [E/6] [info] [Task Finished] Transform to mem in 0.253386s (14232 normal rows, 10069 exceptions)
[2021-03-31 18:13:12.577] [E/5] [info] [Task Finished] Transform to mem in 0.252965s (14002 normal rows, 9932 exceptions)
[2021-03-31 18:13:12.579] [E/4] [info] [Task Finished] Transform to mem in 0.253730s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:13:12.580] [E/9] [info] [Task Finished] Transform to mem in 0.253377s (14206 normal rows, 10009 exceptions)
[2021-03-31 18:13:12.582] [E/3] [info] [Task Finished] Transform to mem in 0.253033s (13961 normal rows, 9907 exceptions)
[2021-03-31 18:13:12.609] [E/12] [info] [Task Finished] Transform to mem in 0.257173s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:13:12.612] [driver] [info] [Task Finished] Transform to mem in 0.257478s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:13:12.700] [E/1] [info] [Task Finished] Transform to mem in 0.304034s (16320 normal rows, 11605 exceptions)
[2021-03-31 18:13:12.700] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.66425s
[2021-03-31 18:13:12.700] [global] [info] [Transform Stage] Stage 0 total wall clock time: 40.8395s, 54108450 input rows, time to process 1 row via fast path: 0.000754771ms
[2021-03-31 18:13:12.700] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2021-03-31 18:13:12.704] [local ee] [info] compiled pure python pipeline in 0.003786s
[2021-03-31 18:13:12.704] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 18:13:12.705] [local ee] [info] Created 160 resolve tasks in 0.001183s
[2021-03-31 18:13:12.705] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 18:13:12.712] [E/12] [info] [Task Finished] Resolve in 0.007238s
[2021-03-31 18:13:12.712] [E/1] [info] [Task Finished] Resolve in 0.007247s
[2021-03-31 18:13:12.712] [E/3] [info] [Task Finished] Resolve in 0.007273s
[2021-03-31 18:13:12.712] [driver] [info] [Task Finished] Resolve in 0.007280s
[2021-03-31 18:13:12.712] [E/5] [info] [Task Finished] Resolve in 0.007312s
[2021-03-31 18:13:12.712] [E/2] [info] [Task Finished] Resolve in 0.007339s
[2021-03-31 18:13:12.712] [E/6] [info] [Task Finished] Resolve in 0.007347s
[2021-03-31 18:13:12.712] [E/4] [info] [Task Finished] Resolve in 0.007347s
[2021-03-31 18:13:12.712] [E/8] [info] [Task Finished] Resolve in 0.007376s
[2021-03-31 18:13:12.712] [E/11] [info] [Task Finished] Resolve in 0.007386s
[2021-03-31 18:13:12.712] [E/13] [info] [Task Finished] Resolve in 0.007389s
[2021-03-31 18:13:12.712] [E/14] [info] [Task Finished] Resolve in 0.007388s
[2021-03-31 18:13:12.712] [E/15] [info] [Task Finished] Resolve in 0.007388s
[2021-03-31 18:13:12.712] [E/10] [info] [Task Finished] Resolve in 0.007394s
[2021-03-31 18:13:12.712] [E/9] [info] [Task Finished] Resolve in 0.007402s
[2021-03-31 18:13:12.712] [E/7] [info] [Task Finished] Resolve in 0.007422s
[2021-03-31 18:13:12.719] [E/12] [info] [Task Finished] Resolve in 0.007273s
[2021-03-31 18:13:12.719] [E/3] [info] [Task Finished] Resolve in 0.007297s
[2021-03-31 18:13:12.719] [driver] [info] [Task Finished] Resolve in 0.007320s
[2021-03-31 18:13:12.720] [E/5] [info] [Task Finished] Resolve in 0.007301s
[2021-03-31 18:13:12.720] [E/1] [info] [Task Finished] Resolve in 0.007372s
[2021-03-31 18:13:12.720] [E/6] [info] [Task Finished] Resolve in 0.007304s
[2021-03-31 18:13:12.720] [E/2] [info] [Task Finished] Resolve in 0.007352s
[2021-03-31 18:13:12.720] [E/8] [info] [Task Finished] Resolve in 0.007331s
[2021-03-31 18:13:12.720] [E/13] [info] [Task Finished] Resolve in 0.007323s
[2021-03-31 18:13:12.720] [E/11] [info] [Task Finished] Resolve in 0.007350s
[2021-03-31 18:13:12.720] [E/14] [info] [Task Finished] Resolve in 0.007336s
[2021-03-31 18:13:12.720] [E/4] [info] [Task Finished] Resolve in 0.007387s
[2021-03-31 18:13:12.720] [E/10] [info] [Task Finished] Resolve in 0.007324s
[2021-03-31 18:13:12.720] [E/9] [info] [Task Finished] Resolve in 0.007332s
[2021-03-31 18:13:12.720] [E/15] [info] [Task Finished] Resolve in 0.007385s
[2021-03-31 18:13:12.720] [E/7] [info] [Task Finished] Resolve in 0.007371s
[2021-03-31 18:13:12.727] [E/12] [info] [Task Finished] Resolve in 0.007155s
[2021-03-31 18:13:12.727] [E/6] [info] [Task Finished] Resolve in 0.007055s
[2021-03-31 18:13:12.727] [E/1] [info] [Task Finished] Resolve in 0.007093s
[2021-03-31 18:13:12.727] [E/3] [info] [Task Finished] Resolve in 0.007189s
[2021-03-31 18:13:12.727] [driver] [info] [Task Finished] Resolve in 0.007214s
[2021-03-31 18:13:12.727] [E/13] [info] [Task Finished] Resolve in 0.007081s
[2021-03-31 18:13:12.727] [E/5] [info] [Task Finished] Resolve in 0.007214s
[2021-03-31 18:13:12.727] [E/2] [info] [Task Finished] Resolve in 0.007187s
[2021-03-31 18:13:12.727] [E/10] [info] [Task Finished] Resolve in 0.007152s
[2021-03-31 18:13:12.727] [E/15] [info] [Task Finished] Resolve in 0.007103s
[2021-03-31 18:13:12.727] [E/8] [info] [Task Finished] Resolve in 0.007217s
[2021-03-31 18:13:12.727] [E/14] [info] [Task Finished] Resolve in 0.007217s
[2021-03-31 18:13:12.727] [E/4] [info] [Task Finished] Resolve in 0.007224s
[2021-03-31 18:13:12.727] [E/11] [info] [Task Finished] Resolve in 0.007233s
[2021-03-31 18:13:12.727] [E/9] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:13:12.727] [E/7] [info] [Task Finished] Resolve in 0.007190s
[2021-03-31 18:13:12.734] [E/12] [info] [Task Finished] Resolve in 0.007213s
[2021-03-31 18:13:12.734] [E/6] [info] [Task Finished] Resolve in 0.007230s
[2021-03-31 18:13:12.734] [E/3] [info] [Task Finished] Resolve in 0.007265s
[2021-03-31 18:13:12.734] [E/1] [info] [Task Finished] Resolve in 0.007323s
[2021-03-31 18:13:12.734] [E/13] [info] [Task Finished] Resolve in 0.007257s
[2021-03-31 18:13:12.734] [driver] [info] [Task Finished] Resolve in 0.007330s
[2021-03-31 18:13:12.734] [E/2] [info] [Task Finished] Resolve in 0.007285s
[2021-03-31 18:13:12.734] [E/10] [info] [Task Finished] Resolve in 0.007260s
[2021-03-31 18:13:12.734] [E/5] [info] [Task Finished] Resolve in 0.007365s
[2021-03-31 18:13:12.734] [E/8] [info] [Task Finished] Resolve in 0.007290s
[2021-03-31 18:13:12.734] [E/11] [info] [Task Finished] Resolve in 0.007269s
[2021-03-31 18:13:12.734] [E/4] [info] [Task Finished] Resolve in 0.007296s
[2021-03-31 18:13:12.734] [E/15] [info] [Task Finished] Resolve in 0.007351s
[2021-03-31 18:13:12.734] [E/7] [info] [Task Finished] Resolve in 0.007278s
[2021-03-31 18:13:12.734] [E/14] [info] [Task Finished] Resolve in 0.007331s
[2021-03-31 18:13:12.734] [E/9] [info] [Task Finished] Resolve in 0.007322s
[2021-03-31 18:13:12.741] [E/12] [info] [Task Finished] Resolve in 0.007260s
[2021-03-31 18:13:12.741] [E/6] [info] [Task Finished] Resolve in 0.007319s
[2021-03-31 18:13:12.741] [E/3] [info] [Task Finished] Resolve in 0.007267s
[2021-03-31 18:13:12.741] [E/1] [info] [Task Finished] Resolve in 0.007262s
[2021-03-31 18:13:12.741] [E/13] [info] [Task Finished] Resolve in 0.007303s
[2021-03-31 18:13:12.741] [E/2] [info] [Task Finished] Resolve in 0.007241s
[2021-03-31 18:13:12.741] [E/5] [info] [Task Finished] Resolve in 0.007297s
[2021-03-31 18:13:12.741] [E/8] [info] [Task Finished] Resolve in 0.007275s
[2021-03-31 18:13:12.741] [driver] [info] [Task Finished] Resolve in 0.007376s
[2021-03-31 18:13:12.741] [E/10] [info] [Task Finished] Resolve in 0.007342s
[2021-03-31 18:13:12.741] [E/15] [info] [Task Finished] Resolve in 0.007253s
[2021-03-31 18:13:12.741] [E/9] [info] [Task Finished] Resolve in 0.007235s
[2021-03-31 18:13:12.742] [E/11] [info] [Task Finished] Resolve in 0.007328s
[2021-03-31 18:13:12.742] [E/4] [info] [Task Finished] Resolve in 0.007317s
[2021-03-31 18:13:12.742] [E/14] [info] [Task Finished] Resolve in 0.007315s
[2021-03-31 18:13:12.742] [E/7] [info] [Task Finished] Resolve in 0.007348s
[2021-03-31 18:13:12.748] [E/6] [info] [Task Finished] Resolve in 0.006997s
[2021-03-31 18:13:12.748] [E/12] [info] [Task Finished] Resolve in 0.007121s
[2021-03-31 18:13:12.748] [E/3] [info] [Task Finished] Resolve in 0.007118s
[2021-03-31 18:13:12.748] [E/13] [info] [Task Finished] Resolve in 0.007034s
[2021-03-31 18:13:12.748] [E/1] [info] [Task Finished] Resolve in 0.007147s
[2021-03-31 18:13:12.748] [E/2] [info] [Task Finished] Resolve in 0.007146s
[2021-03-31 18:13:12.749] [E/8] [info] [Task Finished] Resolve in 0.007054s
[2021-03-31 18:13:12.749] [E/5] [info] [Task Finished] Resolve in 0.007137s
[2021-03-31 18:13:12.749] [E/10] [info] [Task Finished] Resolve in 0.007128s
[2021-03-31 18:13:12.749] [E/9] [info] [Task Finished] Resolve in 0.007093s
[2021-03-31 18:13:12.749] [E/4] [info] [Task Finished] Resolve in 0.007079s
[2021-03-31 18:13:12.749] [E/7] [info] [Task Finished] Resolve in 0.007082s
[2021-03-31 18:13:12.749] [E/11] [info] [Task Finished] Resolve in 0.007117s
[2021-03-31 18:13:12.749] [E/15] [info] [Task Finished] Resolve in 0.007153s
[2021-03-31 18:13:12.749] [driver] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:13:12.749] [E/14] [info] [Task Finished] Resolve in 0.007169s
[2021-03-31 18:13:12.755] [E/12] [info] [Task Finished] Resolve in 0.007261s
[2021-03-31 18:13:12.756] [E/6] [info] [Task Finished] Resolve in 0.007313s
[2021-03-31 18:13:12.756] [E/3] [info] [Task Finished] Resolve in 0.007250s
[2021-03-31 18:13:12.756] [E/13] [info] [Task Finished] Resolve in 0.007293s
[2021-03-31 18:13:12.756] [E/1] [info] [Task Finished] Resolve in 0.007263s
[2021-03-31 18:13:12.756] [E/2] [info] [Task Finished] Resolve in 0.007313s
[2021-03-31 18:13:12.756] [E/8] [info] [Task Finished] Resolve in 0.007322s
[2021-03-31 18:13:12.756] [E/5] [info] [Task Finished] Resolve in 0.007295s
[2021-03-31 18:13:12.756] [E/10] [info] [Task Finished] Resolve in 0.007282s
[2021-03-31 18:13:12.756] [E/9] [info] [Task Finished] Resolve in 0.007292s
[2021-03-31 18:13:12.756] [E/7] [info] [Task Finished] Resolve in 0.007263s
[2021-03-31 18:13:12.756] [E/11] [info] [Task Finished] Resolve in 0.007295s
[2021-03-31 18:13:12.756] [E/4] [info] [Task Finished] Resolve in 0.007317s
[2021-03-31 18:13:12.756] [E/15] [info] [Task Finished] Resolve in 0.007300s
[2021-03-31 18:13:12.756] [driver] [info] [Task Finished] Resolve in 0.007280s
[2021-03-31 18:13:12.756] [E/14] [info] [Task Finished] Resolve in 0.007326s
[2021-03-31 18:13:12.763] [E/12] [info] [Task Finished] Resolve in 0.007235s
[2021-03-31 18:13:12.763] [E/6] [info] [Task Finished] Resolve in 0.007193s
[2021-03-31 18:13:12.763] [E/1] [info] [Task Finished] Resolve in 0.007194s
[2021-03-31 18:13:12.763] [E/3] [info] [Task Finished] Resolve in 0.007294s
[2021-03-31 18:13:12.763] [E/13] [info] [Task Finished] Resolve in 0.007273s
[2021-03-31 18:13:12.763] [E/5] [info] [Task Finished] Resolve in 0.007189s
[2021-03-31 18:13:12.763] [E/2] [info] [Task Finished] Resolve in 0.007269s
[2021-03-31 18:13:12.763] [E/7] [info] [Task Finished] Resolve in 0.007152s
[2021-03-31 18:13:12.763] [E/8] [info] [Task Finished] Resolve in 0.007315s
[2021-03-31 18:13:12.763] [E/15] [info] [Task Finished] Resolve in 0.007190s
[2021-03-31 18:13:12.763] [E/9] [info] [Task Finished] Resolve in 0.007303s
[2021-03-31 18:13:12.763] [E/10] [info] [Task Finished] Resolve in 0.007340s
[2021-03-31 18:13:12.763] [E/4] [info] [Task Finished] Resolve in 0.007321s
[2021-03-31 18:13:12.763] [E/11] [info] [Task Finished] Resolve in 0.007332s
[2021-03-31 18:13:12.763] [driver] [info] [Task Finished] Resolve in 0.007332s
[2021-03-31 18:13:12.763] [E/14] [info] [Task Finished] Resolve in 0.007315s
[2021-03-31 18:13:12.770] [E/12] [info] [Task Finished] Resolve in 0.007169s
[2021-03-31 18:13:12.770] [E/6] [info] [Task Finished] Resolve in 0.007200s
[2021-03-31 18:13:12.770] [E/3] [info] [Task Finished] Resolve in 0.007281s
[2021-03-31 18:13:12.770] [E/1] [info] [Task Finished] Resolve in 0.007324s
[2021-03-31 18:13:12.770] [E/13] [info] [Task Finished] Resolve in 0.007322s
[2021-03-31 18:13:12.770] [E/2] [info] [Task Finished] Resolve in 0.007247s
[2021-03-31 18:13:12.770] [E/7] [info] [Task Finished] Resolve in 0.007277s
[2021-03-31 18:13:12.770] [E/5] [info] [Task Finished] Resolve in 0.007326s
[2021-03-31 18:13:12.770] [E/8] [info] [Task Finished] Resolve in 0.007261s
[2021-03-31 18:13:12.771] [E/15] [info] [Task Finished] Resolve in 0.007319s
[2021-03-31 18:13:12.771] [E/9] [info] [Task Finished] Resolve in 0.007276s
[2021-03-31 18:13:12.771] [E/10] [info] [Task Finished] Resolve in 0.007295s
[2021-03-31 18:13:12.771] [E/4] [info] [Task Finished] Resolve in 0.007248s
[2021-03-31 18:13:12.771] [E/11] [info] [Task Finished] Resolve in 0.007248s
[2021-03-31 18:13:12.771] [driver] [info] [Task Finished] Resolve in 0.007292s
[2021-03-31 18:13:12.771] [E/14] [info] [Task Finished] Resolve in 0.007266s
[2021-03-31 18:13:12.777] [E/12] [info] [Task Finished] Resolve in 0.007249s
[2021-03-31 18:13:12.777] [E/6] [info] [Task Finished] Resolve in 0.007287s
[2021-03-31 18:13:12.777] [E/3] [info] [Task Finished] Resolve in 0.007201s
[2021-03-31 18:13:12.777] [E/1] [info] [Task Finished] Resolve in 0.007212s
[2021-03-31 18:13:12.778] [E/13] [info] [Task Finished] Resolve in 0.007230s
[2021-03-31 18:13:12.778] [E/2] [info] [Task Finished] Resolve in 0.007260s
[2021-03-31 18:13:12.778] [E/7] [info] [Task Finished] Resolve in 0.007212s
[2021-03-31 18:13:12.778] [E/5] [info] [Task Finished] Resolve in 0.007260s
[2021-03-31 18:13:12.778] [E/8] [info] [Task Finished] Resolve in 0.007291s
[2021-03-31 18:13:12.778] [E/15] [info] [Task Finished] Resolve in 0.007189s
[2021-03-31 18:13:12.778] [E/4] [info] [Task Finished] Resolve in 0.007182s
[2021-03-31 18:13:12.778] [E/10] [info] [Task Finished] Resolve in 0.007257s
[2021-03-31 18:13:12.778] [E/9] [info] [Task Finished] Resolve in 0.007311s
[2021-03-31 18:13:12.778] [E/11] [info] [Task Finished] Resolve in 0.007290s
[2021-03-31 18:13:12.778] [driver] [info] [Task Finished] Resolve in 0.007292s
[2021-03-31 18:13:12.779] [E/14] [info] [Task Finished] Resolve in 0.008341s
[2021-03-31 18:13:12.779] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 0.0794016s
[2021-03-31 18:13:12.779] [local ee] [info] slow path for Stage 0: total wall clock time: 1.16315s, time to process 1 row via slow path: 0.000725792ms
[2021-03-31 18:13:12.779] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.0794292s

[2021-03-31 18:13:12.822] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2021-03-31 18:13:12.847] [E/15] [info] [Task Finished] write to file in 0.024756s (87192 rows, 13.27 MB)
[2021-03-31 18:13:12.863] [E/13] [info] [Task Finished] write to file in 0.040070s (155476 rows, 23.67 MB)
[2021-03-31 18:13:12.863] [E/7] [info] [Task Finished] write to file in 0.040354s (155417 rows, 23.66 MB)
[2021-03-31 18:13:12.864] [E/9] [info] [Task Finished] write to file in 0.041148s (155541 rows, 23.68 MB)
[2021-03-31 18:13:12.864] [E/5] [info] [Task Finished] write to file in 0.041182s (155606 rows, 23.69 MB)
[2021-03-31 18:13:12.864] [E/3] [info] [Task Finished] write to file in 0.041386s (155417 rows, 23.66 MB)
[2021-03-31 18:13:12.864] [E/12] [info] [Task Finished] write to file in 0.041520s (155415 rows, 23.66 MB)
[2021-03-31 18:13:12.864] [E/4] [info] [Task Finished] write to file in 0.041840s (155395 rows, 23.66 MB)
[2021-03-31 18:13:12.864] [E/1] [info] [Task Finished] write to file in 0.041988s (155541 rows, 23.68 MB)
[2021-03-31 18:13:12.865] [E/8] [info] [Task Finished] write to file in 0.042030s (155704 rows, 23.70 MB)
[2021-03-31 18:13:12.865] [E/11] [info] [Task Finished] write to file in 0.042102s (155530 rows, 23.67 MB)
[2021-03-31 18:13:12.865] [E/6] [info] [Task Finished] write to file in 0.042145s (155626 rows, 23.69 MB)
[2021-03-31 18:13:12.865] [driver] [info] [Task Finished] write to file in 0.042212s (155476 rows, 23.67 MB)
[2021-03-31 18:13:12.865] [E/10] [info] [Task Finished] write to file in 0.042489s (155530 rows, 23.67 MB)
[2021-03-31 18:13:12.872] [E/2] [info] [Task Finished] write to file in 0.049421s (155704 rows, 23.70 MB)
[2021-03-31 18:13:12.872] [global] [info] writing output took 0.092711s
[2021-03-31 18:13:12.872] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0927975s
[2021-03-31 18:13:12.872] [global] [info] [Transform Stage] Stage 0 took 3.28465s
[2021-03-31 18:13:12.872] [global] [info] Query Execution took 3.385s. (planning: 0.100313s, execution: 3.28469s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 05:47:10) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.005990266799926758
Tuplex job time: 3.654984474182129 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '6bcf8f6a24af', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0204218,"llvm_optimization_time_s":0.297114,"llvm_compilation_time_s":0.135021,"total_compilation_time_s":0.448136,"sampling_time_s":0.109421,"stages":[{"stage_no":0,"fast_path_wall_time_s":40.8395,"fast_path_time_s":2.66427,"fast_path_per_row_time_ns":754.771,"slow_path_wall_time_s":1.16315,"slow_path_time_s":0.0794016,"slow_path_per_row_time_ns":725.792}]}
{"startupTime": 0.005990266799926758, "jobTime": 3.654984474182129}
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.897] [local execution engine] [info] Stopped local executor E/1
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.900] [local execution engine] [info] Stopped local executor E/2
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.903] [local execution engine] [info] Stopped local executor E/3
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.907] [local execution engine] [info] Stopped local executor E/4
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.910] [local execution engine] [info] Stopped local executor E/5
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.913] [local execution engine] [info] Stopped local executor E/6
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.916] [local execution engine] [info] Stopped local executor E/7
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.919] [local execution engine] [info] Stopped local executor E/8
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.922] [local execution engine] [info] Stopped local executor E/9
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.926] [local execution engine] [info] Stopped local executor E/10
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.929] [local execution engine] [info] Stopped local executor E/11
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.932] [local execution engine] [info] Stopped local executor E/12
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.935] [local execution engine] [info] Stopped local executor E/13
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.938] [local execution engine] [info] Stopped local executor E/14
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:13:12.941] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 21 active partitions
