[2021-03-31 18:12:44.999] [global] [error] could not find backend, defaulting to local
[2021-03-31 18:12:44.999] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 18:12:44.999] [local ee] [info] initializing LLVM backend
[2021-03-31 18:12:44.999] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 18:12:44.999] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.000] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.000] [E/1] [info] starting detached process queue
[2021-03-31 18:12:45.000] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.000] [E/2] [info] starting detached process queue
[2021-03-31 18:12:45.000] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.000] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.000] [E/3] [info] starting detached process queue
[2021-03-31 18:12:45.000] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.000] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.000] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.000] [E/4] [info] starting detached process queue
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/5] [info] starting detached process queue
[2021-03-31 18:12:45.001] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [E/6] [info] starting detached process queue
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [E/7] [info] starting detached process queue
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [E/8] [info] starting detached process queue
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [E/9] [info] starting detached process queue
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/10] [info] starting detached process queue
[2021-03-31 18:12:45.001] [E/11] [info] starting detached process queue
[2021-03-31 18:12:45.001] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/12] [info] starting detached process queue
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [E/13] [info] starting detached process queue
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [E/14] [info] starting detached process queue
[2021-03-31 18:12:45.001] [E/15] [info] starting detached process queue
[2021-03-31 18:12:45.001] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 18:12:45.001] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 18:12:45.001] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 18:12:45.001] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 18:12:45.001] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 18:12:45.002] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2021-03-31 18:12:45.135] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.151] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.159] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.187] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.207] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.220] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.253] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.270] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:45.272] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:45.275] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:45.277] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:45.293] [logical planner] [info] logical optimization took 0.020357ms
[2021-03-31 18:12:45.294] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.297] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.301] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.305] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.308] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.310] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.312] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 18:12:45.320] [global] [info] performing static typing for UDF in operator map
[2021-03-31 18:12:45.321] [global] [info] performing static typing for UDF in operator select
output type of specialized pipeline is: (str,str,str,str,str,i64,f64,i64,str,str,i64)
is this the most outer stage?: 1
[2021-03-31 18:12:45.321] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2021-03-31 18:12:45.322] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2021-03-31 18:12:45.322] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2021-03-31 18:12:45.323] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2021-03-31 18:12:45.324] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2021-03-31 18:12:45.324] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2021-03-31 18:12:45.325] [codegen] [info] generating lambda function for (str) -> str
[2021-03-31 18:12:45.325] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2021-03-31 18:12:45.326] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2021-03-31 18:12:45.327] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2021-03-31 18:12:45.328] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:12:45.329] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:12:45.329] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:12:45.330] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2021-03-31 18:12:45.331] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 18:12:45.332] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 18:12:45.333] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 18:12:45.333] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 18:12:45.334] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 18:12:45.334] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 18:12:45.335] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 18:12:45.336] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 18:12:45.337] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 18:12:45.338] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 18:12:45.339] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:12:45.340] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 18:12:45.340] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 18:12:45.370] [global] [info] Stage0 depends on: 
[2021-03-31 18:12:45.682] [global] [info] Optimization via LLVM passes took 0.296635 ms
[2021-03-31 18:12:45.817] [global] [info] Compiled code paths for stage 0 in 0.14 ms
[2021-03-31 18:12:45.817] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.447466s
[2021-03-31 18:12:45.818] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2021-03-31 18:12:46.072] [E/11] [info] [Task Finished] Transform to mem in 0.253979s (14217 normal rows, 10015 exceptions)
[2021-03-31 18:12:46.072] [E/6] [info] [Task Finished] Transform to mem in 0.254158s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:12:46.072] [E/8] [info] [Task Finished] Transform to mem in 0.254159s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:12:46.072] [E/12] [info] [Task Finished] Transform to mem in 0.254237s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:12:46.072] [E/15] [info] [Task Finished] Transform to mem in 0.254336s (14177 normal rows, 10036 exceptions)
[2021-03-31 18:12:46.072] [E/10] [info] [Task Finished] Transform to mem in 0.254358s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:12:46.072] [E/3] [info] [Task Finished] Transform to mem in 0.254443s (14020 normal rows, 9982 exceptions)
[2021-03-31 18:12:46.072] [E/1] [info] [Task Finished] Transform to mem in 0.254484s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:12:46.072] [E/5] [info] [Task Finished] Transform to mem in 0.254575s (13988 normal rows, 9938 exceptions)
[2021-03-31 18:12:46.073] [E/2] [info] [Task Finished] Transform to mem in 0.254906s (14162 normal rows, 9952 exceptions)
[2021-03-31 18:12:46.073] [E/7] [info] [Task Finished] Transform to mem in 0.255105s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:12:46.073] [driver] [info] [Task Finished] Transform to mem in 0.255264s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:12:46.073] [E/9] [info] [Task Finished] Transform to mem in 0.255282s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:12:46.073] [E/13] [info] [Task Finished] Transform to mem in 0.255608s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:12:46.081] [E/14] [info] [Task Finished] Transform to mem in 0.263269s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:12:46.081] [E/4] [info] [Task Finished] Transform to mem in 0.263631s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:12:46.322] [E/6] [info] [Task Finished] Transform to mem in 0.250082s (14059 normal rows, 9985 exceptions)
[2021-03-31 18:12:46.322] [E/11] [info] [Task Finished] Transform to mem in 0.250478s (14241 normal rows, 10100 exceptions)
[2021-03-31 18:12:46.322] [E/1] [info] [Task Finished] Transform to mem in 0.250161s (14086 normal rows, 9989 exceptions)
[2021-03-31 18:12:46.323] [E/12] [info] [Task Finished] Transform to mem in 0.250622s (14238 normal rows, 10030 exceptions)
[2021-03-31 18:12:46.323] [E/15] [info] [Task Finished] Transform to mem in 0.250568s (14081 normal rows, 9995 exceptions)
[2021-03-31 18:12:46.323] [E/7] [info] [Task Finished] Transform to mem in 0.249881s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:12:46.323] [E/10] [info] [Task Finished] Transform to mem in 0.250656s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:12:46.323] [E/8] [info] [Task Finished] Transform to mem in 0.250972s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:12:46.323] [E/2] [info] [Task Finished] Transform to mem in 0.250267s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:12:46.323] [E/3] [info] [Task Finished] Transform to mem in 0.251285s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:12:46.324] [E/5] [info] [Task Finished] Transform to mem in 0.251491s (14097 normal rows, 10002 exceptions)
[2021-03-31 18:12:46.325] [driver] [info] [Task Finished] Transform to mem in 0.251548s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:12:46.325] [E/9] [info] [Task Finished] Transform to mem in 0.251547s (14212 normal rows, 10032 exceptions)
[2021-03-31 18:12:46.325] [E/13] [info] [Task Finished] Transform to mem in 0.252042s (14099 normal rows, 10008 exceptions)
[2021-03-31 18:12:46.340] [E/14] [info] [Task Finished] Transform to mem in 0.258588s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:12:46.340] [E/4] [info] [Task Finished] Transform to mem in 0.258281s (14223 normal rows, 10035 exceptions)
[2021-03-31 18:12:46.573] [E/11] [info] [Task Finished] Transform to mem in 0.250308s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:12:46.573] [E/15] [info] [Task Finished] Transform to mem in 0.250213s (14002 normal rows, 9940 exceptions)
[2021-03-31 18:12:46.573] [E/12] [info] [Task Finished] Transform to mem in 0.250453s (14170 normal rows, 9994 exceptions)
[2021-03-31 18:12:46.573] [E/8] [info] [Task Finished] Transform to mem in 0.250337s (13961 normal rows, 9925 exceptions)
[2021-03-31 18:12:46.573] [E/7] [info] [Task Finished] Transform to mem in 0.250521s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:12:46.573] [E/10] [info] [Task Finished] Transform to mem in 0.250572s (14206 normal rows, 9991 exceptions)
[2021-03-31 18:12:46.573] [E/1] [info] [Task Finished] Transform to mem in 0.251036s (14235 normal rows, 10062 exceptions)
[2021-03-31 18:12:46.574] [E/2] [info] [Task Finished] Transform to mem in 0.250709s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:12:46.575] [E/3] [info] [Task Finished] Transform to mem in 0.251346s (14233 normal rows, 10011 exceptions)
[2021-03-31 18:12:46.576] [E/9] [info] [Task Finished] Transform to mem in 0.251865s (14267 normal rows, 10030 exceptions)
[2021-03-31 18:12:46.577] [E/6] [info] [Task Finished] Transform to mem in 0.254636s (14089 normal rows, 10008 exceptions)
[2021-03-31 18:12:46.577] [driver] [info] [Task Finished] Transform to mem in 0.252185s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:12:46.577] [E/5] [info] [Task Finished] Transform to mem in 0.253126s (13915 normal rows, 9900 exceptions)
[2021-03-31 18:12:46.578] [E/13] [info] [Task Finished] Transform to mem in 0.252138s (13892 normal rows, 9882 exceptions)
[2021-03-31 18:12:46.599] [E/4] [info] [Task Finished] Transform to mem in 0.259332s (14260 normal rows, 10025 exceptions)
[2021-03-31 18:12:46.599] [E/14] [info] [Task Finished] Transform to mem in 0.259695s (14245 normal rows, 10101 exceptions)
[2021-03-31 18:12:46.823] [E/11] [info] [Task Finished] Transform to mem in 0.249994s (13978 normal rows, 9907 exceptions)
[2021-03-31 18:12:46.824] [E/7] [info] [Task Finished] Transform to mem in 0.250351s (14142 normal rows, 9989 exceptions)
[2021-03-31 18:12:46.824] [E/12] [info] [Task Finished] Transform to mem in 0.250548s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:12:46.824] [E/1] [info] [Task Finished] Transform to mem in 0.250205s (13982 normal rows, 9975 exceptions)
[2021-03-31 18:12:46.824] [E/8] [info] [Task Finished] Transform to mem in 0.250502s (14015 normal rows, 9982 exceptions)
[2021-03-31 18:12:46.824] [E/15] [info] [Task Finished] Transform to mem in 0.251112s (14181 normal rows, 10067 exceptions)
[2021-03-31 18:12:46.824] [E/2] [info] [Task Finished] Transform to mem in 0.250659s (14173 normal rows, 10006 exceptions)
[2021-03-31 18:12:46.824] [E/10] [info] [Task Finished] Transform to mem in 0.251018s (14280 normal rows, 10094 exceptions)
[2021-03-31 18:12:46.826] [E/3] [info] [Task Finished] Transform to mem in 0.251403s (14235 normal rows, 10040 exceptions)
[2021-03-31 18:12:46.828] [E/9] [info] [Task Finished] Transform to mem in 0.251400s (14054 normal rows, 9984 exceptions)
[2021-03-31 18:12:46.829] [driver] [info] [Task Finished] Transform to mem in 0.251792s (14223 normal rows, 10033 exceptions)
[2021-03-31 18:12:46.829] [E/13] [info] [Task Finished] Transform to mem in 0.251694s (14108 normal rows, 10010 exceptions)
[2021-03-31 18:12:46.831] [E/5] [info] [Task Finished] Transform to mem in 0.254353s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:12:46.832] [E/6] [info] [Task Finished] Transform to mem in 0.255031s (14129 normal rows, 10004 exceptions)
[2021-03-31 18:12:46.858] [E/4] [info] [Task Finished] Transform to mem in 0.258658s (14208 normal rows, 10008 exceptions)
[2021-03-31 18:12:46.858] [E/14] [info] [Task Finished] Transform to mem in 0.258772s (14089 normal rows, 10031 exceptions)
[2021-03-31 18:12:47.073] [E/11] [info] [Task Finished] Transform to mem in 0.250448s (14094 normal rows, 9960 exceptions)
[2021-03-31 18:12:47.074] [E/7] [info] [Task Finished] Transform to mem in 0.250153s (14232 normal rows, 10017 exceptions)
[2021-03-31 18:12:47.074] [E/12] [info] [Task Finished] Transform to mem in 0.250207s (14088 normal rows, 10027 exceptions)
[2021-03-31 18:12:47.074] [E/1] [info] [Task Finished] Transform to mem in 0.250504s (14106 normal rows, 9955 exceptions)
[2021-03-31 18:12:47.074] [E/15] [info] [Task Finished] Transform to mem in 0.250311s (14113 normal rows, 9997 exceptions)
[2021-03-31 18:12:47.074] [E/2] [info] [Task Finished] Transform to mem in 0.250075s (14075 normal rows, 9965 exceptions)
[2021-03-31 18:12:47.075] [E/8] [info] [Task Finished] Transform to mem in 0.250921s (14211 normal rows, 10043 exceptions)
[2021-03-31 18:12:47.075] [E/10] [info] [Task Finished] Transform to mem in 0.250787s (14223 normal rows, 10049 exceptions)
[2021-03-31 18:12:47.077] [E/3] [info] [Task Finished] Transform to mem in 0.251051s (14095 normal rows, 9995 exceptions)
[2021-03-31 18:12:47.079] [E/9] [info] [Task Finished] Transform to mem in 0.251453s (14086 normal rows, 9952 exceptions)
[2021-03-31 18:12:47.081] [driver] [info] [Task Finished] Transform to mem in 0.252158s (14226 normal rows, 10069 exceptions)
[2021-03-31 18:12:47.081] [E/13] [info] [Task Finished] Transform to mem in 0.251532s (14170 normal rows, 9996 exceptions)
[2021-03-31 18:12:47.085] [E/5] [info] [Task Finished] Transform to mem in 0.253955s (14002 normal rows, 9931 exceptions)
[2021-03-31 18:12:47.087] [E/6] [info] [Task Finished] Transform to mem in 0.255046s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:12:47.116] [E/4] [info] [Task Finished] Transform to mem in 0.258176s (14206 normal rows, 10014 exceptions)
[2021-03-31 18:12:47.116] [E/14] [info] [Task Finished] Transform to mem in 0.258083s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:12:47.324] [E/12] [info] [Task Finished] Transform to mem in 0.249930s (13920 normal rows, 9892 exceptions)
[2021-03-31 18:12:47.324] [E/7] [info] [Task Finished] Transform to mem in 0.250058s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:12:47.324] [E/11] [info] [Task Finished] Transform to mem in 0.250868s (14237 normal rows, 10084 exceptions)
[2021-03-31 18:12:47.324] [E/2] [info] [Task Finished] Transform to mem in 0.249589s (13912 normal rows, 9882 exceptions)
[2021-03-31 18:12:47.325] [E/15] [info] [Task Finished] Transform to mem in 0.250594s (14248 normal rows, 10030 exceptions)
[2021-03-31 18:12:47.325] [E/1] [info] [Task Finished] Transform to mem in 0.251054s (14267 normal rows, 10099 exceptions)
[2021-03-31 18:12:47.326] [E/8] [info] [Task Finished] Transform to mem in 0.251006s (14248 normal rows, 10094 exceptions)
[2021-03-31 18:12:47.327] [E/10] [info] [Task Finished] Transform to mem in 0.251617s (14237 normal rows, 10021 exceptions)
[2021-03-31 18:12:47.328] [E/3] [info] [Task Finished] Transform to mem in 0.250761s (13988 normal rows, 9922 exceptions)
[2021-03-31 18:12:47.331] [E/9] [info] [Task Finished] Transform to mem in 0.251983s (14171 normal rows, 10052 exceptions)
[2021-03-31 18:12:47.332] [E/13] [info] [Task Finished] Transform to mem in 0.251119s (14015 normal rows, 9985 exceptions)
[2021-03-31 18:12:47.332] [driver] [info] [Task Finished] Transform to mem in 0.251614s (14234 normal rows, 10024 exceptions)
[2021-03-31 18:12:47.340] [E/5] [info] [Task Finished] Transform to mem in 0.254567s (14176 normal rows, 9997 exceptions)
[2021-03-31 18:12:47.342] [E/6] [info] [Task Finished] Transform to mem in 0.254969s (14246 normal rows, 10108 exceptions)
[2021-03-31 18:12:47.375] [E/4] [info] [Task Finished] Transform to mem in 0.259224s (14059 normal rows, 9978 exceptions)
[2021-03-31 18:12:47.376] [E/14] [info] [Task Finished] Transform to mem in 0.259442s (14114 normal rows, 10011 exceptions)
[2021-03-31 18:12:47.574] [E/7] [info] [Task Finished] Transform to mem in 0.250384s (14081 normal rows, 10003 exceptions)
[2021-03-31 18:12:47.574] [E/11] [info] [Task Finished] Transform to mem in 0.250437s (14095 normal rows, 10024 exceptions)
[2021-03-31 18:12:47.574] [E/12] [info] [Task Finished] Transform to mem in 0.250599s (14238 normal rows, 10007 exceptions)
[2021-03-31 18:12:47.575] [E/2] [info] [Task Finished] Transform to mem in 0.250525s (14221 normal rows, 9998 exceptions)
[2021-03-31 18:12:47.575] [E/15] [info] [Task Finished] Transform to mem in 0.250288s (14086 normal rows, 9998 exceptions)
[2021-03-31 18:12:47.576] [E/1] [info] [Task Finished] Transform to mem in 0.250683s (14091 normal rows, 10001 exceptions)
[2021-03-31 18:12:47.577] [E/8] [info] [Task Finished] Transform to mem in 0.250844s (14218 normal rows, 10016 exceptions)
[2021-03-31 18:12:47.577] [E/10] [info] [Task Finished] Transform to mem in 0.250435s (14095 normal rows, 10026 exceptions)
[2021-03-31 18:12:47.580] [E/3] [info] [Task Finished] Transform to mem in 0.251547s (14113 normal rows, 9960 exceptions)
[2021-03-31 18:12:47.583] [E/9] [info] [Task Finished] Transform to mem in 0.251828s (14197 normal rows, 10028 exceptions)
[2021-03-31 18:12:47.583] [E/13] [info] [Task Finished] Transform to mem in 0.251351s (14114 normal rows, 10012 exceptions)
[2021-03-31 18:12:47.584] [driver] [info] [Task Finished] Transform to mem in 0.251713s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:12:47.594] [E/5] [info] [Task Finished] Transform to mem in 0.253980s (14197 normal rows, 10033 exceptions)
[2021-03-31 18:12:47.596] [E/6] [info] [Task Finished] Transform to mem in 0.254571s (14115 normal rows, 10010 exceptions)
[2021-03-31 18:12:47.633] [E/4] [info] [Task Finished] Transform to mem in 0.258183s (14083 normal rows, 9953 exceptions)
[2021-03-31 18:12:47.635] [E/14] [info] [Task Finished] Transform to mem in 0.259182s (14235 normal rows, 10048 exceptions)
[2021-03-31 18:12:47.828] [E/7] [info] [Task Finished] Transform to mem in 0.253265s (14144 normal rows, 9995 exceptions)
[2021-03-31 18:12:47.828] [E/11] [info] [Task Finished] Transform to mem in 0.253379s (14015 normal rows, 9952 exceptions)
[2021-03-31 18:12:47.828] [E/2] [info] [Task Finished] Transform to mem in 0.253490s (14159 normal rows, 9996 exceptions)
[2021-03-31 18:12:47.829] [E/15] [info] [Task Finished] Transform to mem in 0.253363s (14010 normal rows, 9932 exceptions)
[2021-03-31 18:12:47.829] [E/12] [info] [Task Finished] Transform to mem in 0.254214s (14237 normal rows, 10069 exceptions)
[2021-03-31 18:12:47.830] [E/1] [info] [Task Finished] Transform to mem in 0.254261s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:12:47.831] [E/8] [info] [Task Finished] Transform to mem in 0.254028s (14178 normal rows, 10009 exceptions)
[2021-03-31 18:12:47.831] [E/10] [info] [Task Finished] Transform to mem in 0.253624s (13970 normal rows, 9902 exceptions)
[2021-03-31 18:12:47.835] [E/3] [info] [Task Finished] Transform to mem in 0.255160s (14253 normal rows, 10088 exceptions)
[2021-03-31 18:12:47.837] [E/13] [info] [Task Finished] Transform to mem in 0.254057s (13901 normal rows, 9892 exceptions)
[2021-03-31 18:12:47.838] [E/9] [info] [Task Finished] Transform to mem in 0.254941s (14236 normal rows, 10015 exceptions)
[2021-03-31 18:12:47.840] [driver] [info] [Task Finished] Transform to mem in 0.255567s (14267 normal rows, 10106 exceptions)
[2021-03-31 18:12:47.851] [E/5] [info] [Task Finished] Transform to mem in 0.257323s (14248 normal rows, 10023 exceptions)
[2021-03-31 18:12:47.854] [E/6] [info] [Task Finished] Transform to mem in 0.257515s (13953 normal rows, 9885 exceptions)
[2021-03-31 18:12:47.896] [E/4] [info] [Task Finished] Transform to mem in 0.262289s (14207 normal rows, 10091 exceptions)
[2021-03-31 18:12:47.897] [E/14] [info] [Task Finished] Transform to mem in 0.262353s (14245 normal rows, 10024 exceptions)
[2021-03-31 18:12:48.078] [E/7] [info] [Task Finished] Transform to mem in 0.249916s (13999 normal rows, 9935 exceptions)
[2021-03-31 18:12:48.079] [E/11] [info] [Task Finished] Transform to mem in 0.250783s (14158 normal rows, 10036 exceptions)
[2021-03-31 18:12:48.079] [E/15] [info] [Task Finished] Transform to mem in 0.250175s (14020 normal rows, 9989 exceptions)
[2021-03-31 18:12:48.079] [E/2] [info] [Task Finished] Transform to mem in 0.250984s (14242 normal rows, 10080 exceptions)
[2021-03-31 18:12:48.080] [E/12] [info] [Task Finished] Transform to mem in 0.250905s (14173 normal rows, 10004 exceptions)
[2021-03-31 18:12:48.081] [E/1] [info] [Task Finished] Transform to mem in 0.250667s (14235 normal rows, 10041 exceptions)
[2021-03-31 18:12:48.081] [E/8] [info] [Task Finished] Transform to mem in 0.250574s (14054 normal rows, 9985 exceptions)
[2021-03-31 18:12:48.082] [E/10] [info] [Task Finished] Transform to mem in 0.250904s (14114 normal rows, 10004 exceptions)
[2021-03-31 18:12:48.086] [E/3] [info] [Task Finished] Transform to mem in 0.251542s (14238 normal rows, 10033 exceptions)
[2021-03-31 18:12:48.088] [E/13] [info] [Task Finished] Transform to mem in 0.250896s (14081 normal rows, 9992 exceptions)
[2021-03-31 18:12:48.090] [E/9] [info] [Task Finished] Transform to mem in 0.251587s (14095 normal rows, 10009 exceptions)
[2021-03-31 18:12:48.091] [driver] [info] [Task Finished] Transform to mem in 0.251757s (14221 normal rows, 10009 exceptions)
[2021-03-31 18:12:48.105] [E/5] [info] [Task Finished] Transform to mem in 0.253928s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:12:48.108] [E/6] [info] [Task Finished] Transform to mem in 0.254547s (14094 normal rows, 9996 exceptions)
[2021-03-31 18:12:48.154] [E/4] [info] [Task Finished] Transform to mem in 0.258293s (14212 normal rows, 10017 exceptions)
[2021-03-31 18:12:48.156] [E/14] [info] [Task Finished] Transform to mem in 0.258501s (14108 normal rows, 10027 exceptions)
[2021-03-31 18:12:48.328] [E/7] [info] [Task Finished] Transform to mem in 0.250153s (14100 normal rows, 9955 exceptions)
[2021-03-31 18:12:48.329] [E/15] [info] [Task Finished] Transform to mem in 0.250162s (14094 normal rows, 9998 exceptions)
[2021-03-31 18:12:48.329] [E/2] [info] [Task Finished] Transform to mem in 0.250331s (14094 normal rows, 9965 exceptions)
[2021-03-31 18:12:48.330] [E/11] [info] [Task Finished] Transform to mem in 0.251143s (14217 normal rows, 10042 exceptions)
[2021-03-31 18:12:48.331] [E/12] [info] [Task Finished] Transform to mem in 0.250909s (14223 normal rows, 10048 exceptions)
[2021-03-31 18:12:48.332] [E/1] [info] [Task Finished] Transform to mem in 0.250886s (14089 normal rows, 9995 exceptions)
[2021-03-31 18:12:48.332] [E/8] [info] [Task Finished] Transform to mem in 0.250675s (14086 normal rows, 9953 exceptions)
[2021-03-31 18:12:48.333] [E/10] [info] [Task Finished] Transform to mem in 0.251172s (14232 normal rows, 10069 exceptions)
[2021-03-31 18:12:48.338] [E/3] [info] [Task Finished] Transform to mem in 0.251359s (14170 normal rows, 9995 exceptions)
[2021-03-31 18:12:48.339] [E/13] [info] [Task Finished] Transform to mem in 0.251035s (14002 normal rows, 9932 exceptions)
[2021-03-31 18:12:48.342] [E/9] [info] [Task Finished] Transform to mem in 0.252127s (14226 normal rows, 10080 exceptions)
[2021-03-31 18:12:48.343] [driver] [info] [Task Finished] Transform to mem in 0.251621s (14206 normal rows, 10009 exceptions)
[2021-03-31 18:12:48.359] [E/5] [info] [Task Finished] Transform to mem in 0.253807s (13961 normal rows, 9907 exceptions)
[2021-03-31 18:12:48.364] [E/6] [info] [Task Finished] Transform to mem in 0.255246s (14246 normal rows, 10084 exceptions)
[2021-03-31 18:12:48.412] [E/4] [info] [Task Finished] Transform to mem in 0.258324s (14233 normal rows, 10019 exceptions)
[2021-03-31 18:12:48.457] [E/14] [info] [Task Finished] Transform to mem in 0.301624s (16320 normal rows, 11605 exceptions)
[2021-03-31 18:12:48.457] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.63998s
[2021-03-31 18:12:48.457] [global] [info] [Transform Stage] Stage 0 total wall clock time: 40.5114s, 54108450 input rows, time to process 1 row via fast path: 0.000748707ms
[2021-03-31 18:12:48.458] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2021-03-31 18:12:48.461] [local ee] [info] compiled pure python pipeline in 0.003836s
[2021-03-31 18:12:48.461] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 18:12:48.463] [local ee] [info] Created 160 resolve tasks in 0.001170s
[2021-03-31 18:12:48.463] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 18:12:48.470] [driver] [info] [Task Finished] Resolve in 0.007184s
[2021-03-31 18:12:48.470] [E/4] [info] [Task Finished] Resolve in 0.007213s
[2021-03-31 18:12:48.470] [E/8] [info] [Task Finished] Resolve in 0.007247s
[2021-03-31 18:12:48.470] [E/1] [info] [Task Finished] Resolve in 0.007254s
[2021-03-31 18:12:48.470] [E/3] [info] [Task Finished] Resolve in 0.007287s
[2021-03-31 18:12:48.470] [E/12] [info] [Task Finished] Resolve in 0.007296s
[2021-03-31 18:12:48.470] [E/11] [info] [Task Finished] Resolve in 0.007300s
[2021-03-31 18:12:48.470] [E/2] [info] [Task Finished] Resolve in 0.007354s
[2021-03-31 18:12:48.470] [E/14] [info] [Task Finished] Resolve in 0.007367s
[2021-03-31 18:12:48.470] [E/10] [info] [Task Finished] Resolve in 0.007373s
[2021-03-31 18:12:48.470] [E/5] [info] [Task Finished] Resolve in 0.007391s
[2021-03-31 18:12:48.470] [E/7] [info] [Task Finished] Resolve in 0.007375s
[2021-03-31 18:12:48.470] [E/13] [info] [Task Finished] Resolve in 0.007357s
[2021-03-31 18:12:48.470] [E/9] [info] [Task Finished] Resolve in 0.007447s
[2021-03-31 18:12:48.470] [E/15] [info] [Task Finished] Resolve in 0.007414s
[2021-03-31 18:12:48.470] [E/6] [info] [Task Finished] Resolve in 0.007413s
[2021-03-31 18:12:48.477] [driver] [info] [Task Finished] Resolve in 0.007144s
[2021-03-31 18:12:48.477] [E/8] [info] [Task Finished] Resolve in 0.007137s
[2021-03-31 18:12:48.477] [E/3] [info] [Task Finished] Resolve in 0.007114s
[2021-03-31 18:12:48.477] [E/12] [info] [Task Finished] Resolve in 0.007126s
[2021-03-31 18:12:48.477] [E/4] [info] [Task Finished] Resolve in 0.007229s
[2021-03-31 18:12:48.477] [E/11] [info] [Task Finished] Resolve in 0.007146s
[2021-03-31 18:12:48.477] [E/1] [info] [Task Finished] Resolve in 0.007206s
[2021-03-31 18:12:48.477] [E/2] [info] [Task Finished] Resolve in 0.007119s
[2021-03-31 18:12:48.477] [E/7] [info] [Task Finished] Resolve in 0.007103s
[2021-03-31 18:12:48.477] [E/5] [info] [Task Finished] Resolve in 0.007134s
[2021-03-31 18:12:48.477] [E/14] [info] [Task Finished] Resolve in 0.007157s
[2021-03-31 18:12:48.477] [E/10] [info] [Task Finished] Resolve in 0.007178s
[2021-03-31 18:12:48.477] [E/15] [info] [Task Finished] Resolve in 0.007101s
[2021-03-31 18:12:48.477] [E/9] [info] [Task Finished] Resolve in 0.007119s
[2021-03-31 18:12:48.477] [E/13] [info] [Task Finished] Resolve in 0.007180s
[2021-03-31 18:12:48.477] [E/6] [info] [Task Finished] Resolve in 0.007158s
[2021-03-31 18:12:48.484] [driver] [info] [Task Finished] Resolve in 0.007258s
[2021-03-31 18:12:48.484] [E/12] [info] [Task Finished] Resolve in 0.007185s
[2021-03-31 18:12:48.484] [E/8] [info] [Task Finished] Resolve in 0.007205s
[2021-03-31 18:12:48.484] [E/3] [info] [Task Finished] Resolve in 0.007277s
[2021-03-31 18:12:48.484] [E/11] [info] [Task Finished] Resolve in 0.007292s
[2021-03-31 18:12:48.484] [E/15] [info] [Task Finished] Resolve in 0.007190s
[2021-03-31 18:12:48.484] [E/9] [info] [Task Finished] Resolve in 0.007182s
[2021-03-31 18:12:48.484] [E/1] [info] [Task Finished] Resolve in 0.007320s
[2021-03-31 18:12:48.484] [E/4] [info] [Task Finished] Resolve in 0.007336s
[2021-03-31 18:12:48.484] [E/14] [info] [Task Finished] Resolve in 0.007264s
[2021-03-31 18:12:48.484] [E/2] [info] [Task Finished] Resolve in 0.007322s
[2021-03-31 18:12:48.484] [E/7] [info] [Task Finished] Resolve in 0.007310s
[2021-03-31 18:12:48.485] [E/5] [info] [Task Finished] Resolve in 0.007356s
[2021-03-31 18:12:48.485] [E/10] [info] [Task Finished] Resolve in 0.007348s
[2021-03-31 18:12:48.485] [E/13] [info] [Task Finished] Resolve in 0.007343s
[2021-03-31 18:12:48.485] [E/6] [info] [Task Finished] Resolve in 0.007345s
[2021-03-31 18:12:48.491] [driver] [info] [Task Finished] Resolve in 0.007224s
[2021-03-31 18:12:48.492] [E/12] [info] [Task Finished] Resolve in 0.007260s
[2021-03-31 18:12:48.492] [E/3] [info] [Task Finished] Resolve in 0.007212s
[2021-03-31 18:12:48.492] [E/8] [info] [Task Finished] Resolve in 0.007299s
[2021-03-31 18:12:48.492] [E/11] [info] [Task Finished] Resolve in 0.007240s
[2021-03-31 18:12:48.492] [E/14] [info] [Task Finished] Resolve in 0.007241s
[2021-03-31 18:12:48.492] [E/15] [info] [Task Finished] Resolve in 0.007290s
[2021-03-31 18:12:48.492] [E/7] [info] [Task Finished] Resolve in 0.007262s
[2021-03-31 18:12:48.492] [E/9] [info] [Task Finished] Resolve in 0.007306s
[2021-03-31 18:12:48.492] [E/2] [info] [Task Finished] Resolve in 0.007301s
[2021-03-31 18:12:48.492] [E/4] [info] [Task Finished] Resolve in 0.007320s
[2021-03-31 18:12:48.492] [E/1] [info] [Task Finished] Resolve in 0.007351s
[2021-03-31 18:12:48.492] [E/10] [info] [Task Finished] Resolve in 0.007277s
[2021-03-31 18:12:48.492] [E/5] [info] [Task Finished] Resolve in 0.007345s
[2021-03-31 18:12:48.492] [E/6] [info] [Task Finished] Resolve in 0.007279s
[2021-03-31 18:12:48.492] [E/13] [info] [Task Finished] Resolve in 0.007304s
[2021-03-31 18:12:48.499] [driver] [info] [Task Finished] Resolve in 0.007193s
[2021-03-31 18:12:48.499] [E/3] [info] [Task Finished] Resolve in 0.007193s
[2021-03-31 18:12:48.499] [E/8] [info] [Task Finished] Resolve in 0.007189s
[2021-03-31 18:12:48.499] [E/12] [info] [Task Finished] Resolve in 0.007257s
[2021-03-31 18:12:48.499] [E/11] [info] [Task Finished] Resolve in 0.007203s
[2021-03-31 18:12:48.499] [E/14] [info] [Task Finished] Resolve in 0.007167s
[2021-03-31 18:12:48.499] [E/2] [info] [Task Finished] Resolve in 0.007218s
[2021-03-31 18:12:48.499] [E/15] [info] [Task Finished] Resolve in 0.007278s
[2021-03-31 18:12:48.499] [E/7] [info] [Task Finished] Resolve in 0.007280s
[2021-03-31 18:12:48.499] [E/10] [info] [Task Finished] Resolve in 0.007197s
[2021-03-31 18:12:48.499] [E/9] [info] [Task Finished] Resolve in 0.007268s
[2021-03-31 18:12:48.499] [E/1] [info] [Task Finished] Resolve in 0.007278s
[2021-03-31 18:12:48.499] [E/4] [info] [Task Finished] Resolve in 0.007322s
[2021-03-31 18:12:48.499] [E/13] [info] [Task Finished] Resolve in 0.007204s
[2021-03-31 18:12:48.499] [E/5] [info] [Task Finished] Resolve in 0.007317s
[2021-03-31 18:12:48.499] [E/6] [info] [Task Finished] Resolve in 0.007312s
[2021-03-31 18:12:48.506] [driver] [info] [Task Finished] Resolve in 0.007207s
[2021-03-31 18:12:48.506] [E/12] [info] [Task Finished] Resolve in 0.007186s
[2021-03-31 18:12:48.506] [E/3] [info] [Task Finished] Resolve in 0.007324s
[2021-03-31 18:12:48.506] [E/8] [info] [Task Finished] Resolve in 0.007336s
[2021-03-31 18:12:48.506] [E/11] [info] [Task Finished] Resolve in 0.007341s
[2021-03-31 18:12:48.506] [E/7] [info] [Task Finished] Resolve in 0.007169s
[2021-03-31 18:12:48.506] [E/14] [info] [Task Finished] Resolve in 0.007360s
[2021-03-31 18:12:48.506] [E/9] [info] [Task Finished] Resolve in 0.007201s
[2021-03-31 18:12:48.506] [E/15] [info] [Task Finished] Resolve in 0.007300s
[2021-03-31 18:12:48.506] [E/2] [info] [Task Finished] Resolve in 0.007319s
[2021-03-31 18:12:48.506] [E/10] [info] [Task Finished] Resolve in 0.007284s
[2021-03-31 18:12:48.506] [E/4] [info] [Task Finished] Resolve in 0.007255s
[2021-03-31 18:12:48.506] [E/1] [info] [Task Finished] Resolve in 0.007307s
[2021-03-31 18:12:48.506] [E/5] [info] [Task Finished] Resolve in 0.007190s
[2021-03-31 18:12:48.506] [E/6] [info] [Task Finished] Resolve in 0.007191s
[2021-03-31 18:12:48.506] [E/13] [info] [Task Finished] Resolve in 0.007289s
[2021-03-31 18:12:48.513] [driver] [info] [Task Finished] Resolve in 0.007277s
[2021-03-31 18:12:48.513] [E/12] [info] [Task Finished] Resolve in 0.007262s
[2021-03-31 18:12:48.513] [E/3] [info] [Task Finished] Resolve in 0.007306s
[2021-03-31 18:12:48.513] [E/8] [info] [Task Finished] Resolve in 0.007307s
[2021-03-31 18:12:48.514] [E/11] [info] [Task Finished] Resolve in 0.007278s
[2021-03-31 18:12:48.514] [E/7] [info] [Task Finished] Resolve in 0.007275s
[2021-03-31 18:12:48.514] [E/14] [info] [Task Finished] Resolve in 0.007311s
[2021-03-31 18:12:48.514] [E/9] [info] [Task Finished] Resolve in 0.007292s
[2021-03-31 18:12:48.514] [E/15] [info] [Task Finished] Resolve in 0.007281s
[2021-03-31 18:12:48.514] [E/10] [info] [Task Finished] Resolve in 0.007293s
[2021-03-31 18:12:48.514] [E/4] [info] [Task Finished] Resolve in 0.007269s
[2021-03-31 18:12:48.514] [E/2] [info] [Task Finished] Resolve in 0.007320s
[2021-03-31 18:12:48.514] [E/6] [info] [Task Finished] Resolve in 0.007256s
[2021-03-31 18:12:48.514] [E/5] [info] [Task Finished] Resolve in 0.007310s
[2021-03-31 18:12:48.514] [E/1] [info] [Task Finished] Resolve in 0.007327s
[2021-03-31 18:12:48.514] [E/13] [info] [Task Finished] Resolve in 0.007348s
[2021-03-31 18:12:48.520] [driver] [info] [Task Finished] Resolve in 0.007278s
[2021-03-31 18:12:48.520] [E/12] [info] [Task Finished] Resolve in 0.007217s
[2021-03-31 18:12:48.521] [E/3] [info] [Task Finished] Resolve in 0.007274s
[2021-03-31 18:12:48.521] [E/8] [info] [Task Finished] Resolve in 0.007251s
[2021-03-31 18:12:48.521] [E/7] [info] [Task Finished] Resolve in 0.007330s
[2021-03-31 18:12:48.521] [E/9] [info] [Task Finished] Resolve in 0.007247s
[2021-03-31 18:12:48.521] [E/11] [info] [Task Finished] Resolve in 0.007357s
[2021-03-31 18:12:48.521] [E/10] [info] [Task Finished] Resolve in 0.007208s
[2021-03-31 18:12:48.521] [E/14] [info] [Task Finished] Resolve in 0.007295s
[2021-03-31 18:12:48.521] [E/5] [info] [Task Finished] Resolve in 0.007218s
[2021-03-31 18:12:48.521] [E/15] [info] [Task Finished] Resolve in 0.007335s
[2021-03-31 18:12:48.521] [E/4] [info] [Task Finished] Resolve in 0.007340s
[2021-03-31 18:12:48.521] [E/2] [info] [Task Finished] Resolve in 0.007343s
[2021-03-31 18:12:48.521] [E/6] [info] [Task Finished] Resolve in 0.007340s
[2021-03-31 18:12:48.521] [E/1] [info] [Task Finished] Resolve in 0.007332s
[2021-03-31 18:12:48.521] [E/13] [info] [Task Finished] Resolve in 0.007347s
[2021-03-31 18:12:48.528] [driver] [info] [Task Finished] Resolve in 0.007035s
[2021-03-31 18:12:48.528] [E/12] [info] [Task Finished] Resolve in 0.007093s
[2021-03-31 18:12:48.528] [E/3] [info] [Task Finished] Resolve in 0.007044s
[2021-03-31 18:12:48.528] [E/8] [info] [Task Finished] Resolve in 0.007142s
[2021-03-31 18:12:48.528] [E/7] [info] [Task Finished] Resolve in 0.007089s
[2021-03-31 18:12:48.528] [E/11] [info] [Task Finished] Resolve in 0.007072s
[2021-03-31 18:12:48.528] [E/10] [info] [Task Finished] Resolve in 0.007109s
[2021-03-31 18:12:48.528] [E/9] [info] [Task Finished] Resolve in 0.007152s
[2021-03-31 18:12:48.528] [E/14] [info] [Task Finished] Resolve in 0.007122s
[2021-03-31 18:12:48.528] [E/5] [info] [Task Finished] Resolve in 0.007081s
[2021-03-31 18:12:48.528] [E/15] [info] [Task Finished] Resolve in 0.007079s
[2021-03-31 18:12:48.528] [E/2] [info] [Task Finished] Resolve in 0.007086s
[2021-03-31 18:12:48.528] [E/6] [info] [Task Finished] Resolve in 0.007075s
[2021-03-31 18:12:48.528] [E/4] [info] [Task Finished] Resolve in 0.007139s
[2021-03-31 18:12:48.528] [E/1] [info] [Task Finished] Resolve in 0.007120s
[2021-03-31 18:12:48.528] [E/13] [info] [Task Finished] Resolve in 0.007100s
[2021-03-31 18:12:48.535] [driver] [info] [Task Finished] Resolve in 0.007245s
[2021-03-31 18:12:48.535] [E/12] [info] [Task Finished] Resolve in 0.007245s
[2021-03-31 18:12:48.535] [E/3] [info] [Task Finished] Resolve in 0.007231s
[2021-03-31 18:12:48.535] [E/8] [info] [Task Finished] Resolve in 0.007308s
[2021-03-31 18:12:48.535] [E/11] [info] [Task Finished] Resolve in 0.007276s
[2021-03-31 18:12:48.535] [E/7] [info] [Task Finished] Resolve in 0.007317s
[2021-03-31 18:12:48.535] [E/10] [info] [Task Finished] Resolve in 0.007274s
[2021-03-31 18:12:48.535] [E/5] [info] [Task Finished] Resolve in 0.007228s
[2021-03-31 18:12:48.535] [E/14] [info] [Task Finished] Resolve in 0.007289s
[2021-03-31 18:12:48.535] [E/6] [info] [Task Finished] Resolve in 0.007210s
[2021-03-31 18:12:48.535] [E/9] [info] [Task Finished] Resolve in 0.007354s
[2021-03-31 18:12:48.535] [E/15] [info] [Task Finished] Resolve in 0.007322s
[2021-03-31 18:12:48.535] [E/2] [info] [Task Finished] Resolve in 0.007319s
[2021-03-31 18:12:48.536] [E/4] [info] [Task Finished] Resolve in 0.007343s
[2021-03-31 18:12:48.536] [E/1] [info] [Task Finished] Resolve in 0.007329s
[2021-03-31 18:12:48.537] [E/13] [info] [Task Finished] Resolve in 0.008375s
[2021-03-31 18:12:48.537] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 0.0793488s
[2021-03-31 18:12:48.537] [local ee] [info] slow path for Stage 0: total wall clock time: 1.16143s, time to process 1 row via slow path: 0.000724719ms
[2021-03-31 18:12:48.537] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.0793746s

[2021-03-31 18:12:48.580] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2021-03-31 18:12:48.605] [E/13] [info] [Task Finished] write to file in 0.024711s (87192 rows, 13.27 MB)
[2021-03-31 18:12:48.621] [E/3] [info] [Task Finished] write to file in 0.040487s (155417 rows, 23.66 MB)
[2021-03-31 18:12:48.621] [E/2] [info] [Task Finished] write to file in 0.040856s (155541 rows, 23.68 MB)
[2021-03-31 18:12:48.621] [E/5] [info] [Task Finished] write to file in 0.040867s (155395 rows, 23.66 MB)
[2021-03-31 18:12:48.622] [E/11] [info] [Task Finished] write to file in 0.041711s (155626 rows, 23.69 MB)
[2021-03-31 18:12:48.622] [E/14] [info] [Task Finished] write to file in 0.041766s (155530 rows, 23.67 MB)
[2021-03-31 18:12:48.622] [E/7] [info] [Task Finished] write to file in 0.042004s (155476 rows, 23.67 MB)
[2021-03-31 18:12:48.622] [E/6] [info] [Task Finished] write to file in 0.042111s (155541 rows, 23.68 MB)
[2021-03-31 18:12:48.622] [E/12] [info] [Task Finished] write to file in 0.042134s (155476 rows, 23.67 MB)
[2021-03-31 18:12:48.622] [E/15] [info] [Task Finished] write to file in 0.042238s (155606 rows, 23.69 MB)
[2021-03-31 18:12:48.622] [E/8] [info] [Task Finished] write to file in 0.042256s (155704 rows, 23.70 MB)
[2021-03-31 18:12:48.622] [driver] [info] [Task Finished] write to file in 0.042377s (155417 rows, 23.66 MB)
[2021-03-31 18:12:48.623] [E/4] [info] [Task Finished] write to file in 0.042527s (155530 rows, 23.67 MB)
[2021-03-31 18:12:48.623] [E/10] [info] [Task Finished] write to file in 0.042600s (155415 rows, 23.66 MB)
[2021-03-31 18:12:48.631] [E/1] [info] [Task Finished] write to file in 0.050589s (155704 rows, 23.70 MB)
[2021-03-31 18:12:48.631] [global] [info] writing output took 0.093765s
[2021-03-31 18:12:48.631] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0938457s
[2021-03-31 18:12:48.631] [global] [info] [Transform Stage] Stage 0 took 3.26069s
[2021-03-31 18:12:48.631] [global] [info] Query Execution took 3.36067s. (planning: 0.0999453s, execution: 3.26073s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 05:47:10) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.006194591522216797
Tuplex job time: 3.6306347846984863 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '6bcf8f6a24af', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'true', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0203566,"llvm_optimization_time_s":0.296635,"llvm_compilation_time_s":0.135038,"total_compilation_time_s":0.447463,"sampling_time_s":0.109484,"stages":[{"stage_no":0,"fast_path_wall_time_s":40.5114,"fast_path_time_s":2.63999,"fast_path_per_row_time_ns":748.707,"slow_path_wall_time_s":1.16143,"slow_path_time_s":0.0793488,"slow_path_per_row_time_ns":724.719}]}
{"startupTime": 0.006194591522216797, "jobTime": 3.6306347846984863}
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.656] [local execution engine] [info] Stopped local executor E/1
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.659] [local execution engine] [info] Stopped local executor E/2
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.662] [local execution engine] [info] Stopped local executor E/3
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.665] [local execution engine] [info] Stopped local executor E/4
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.669] [local execution engine] [info] Stopped local executor E/5
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.672] [local execution engine] [info] Stopped local executor E/6
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.675] [local execution engine] [info] Stopped local executor E/7
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.678] [local execution engine] [info] Stopped local executor E/8
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.681] [local execution engine] [info] Stopped local executor E/9
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.685] [local execution engine] [info] Stopped local executor E/10
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.688] [local execution engine] [info] Stopped local executor E/11
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.691] [local execution engine] [info] Stopped local executor E/12
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.694] [local execution engine] [info] Stopped local executor E/13
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.697] [local execution engine] [info] Stopped local executor E/14
[GLOBAL] releasing 20 active partitions
[2021-03-31 18:12:48.700] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 21 active partitions
