[2021-03-25 10:29:17.626] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:29:17.627] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:29:17.627] [local ee] [info] initializing LLVM backend
[2021-03-25 10:29:17.627] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:29:17.627] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/1] [info] starting detached process queue
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/2] [info] starting detached process queue
[2021-03-25 10:29:17.628] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [E/3] [info] starting detached process queue
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [E/4] [info] starting detached process queue
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/5] [info] starting detached process queue
[2021-03-25 10:29:17.628] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [E/6] [info] starting detached process queue
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [E/7] [info] starting detached process queue
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/8] [info] starting detached process queue
[2021-03-25 10:29:17.628] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [E/9] [info] starting detached process queue
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/10] [info] starting detached process queue
[2021-03-25 10:29:17.628] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [E/11] [info] starting detached process queue
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/12] [info] starting detached process queue
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.628] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.628] [E/13] [info] starting detached process queue
[2021-03-25 10:29:17.628] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.629] [E/14] [info] starting detached process queue
[2021-03-25 10:29:17.629] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.629] [E/15] [info] starting detached process queue
[2021-03-25 10:29:17.629] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.629] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:17.629] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:17.629] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 10:29:17.629] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:29:17.629] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:29:17.629] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:29:17.765] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:17.771] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:17.787] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:17.796] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:17.823] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:17.843] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:17.857] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:17.889] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:17.895] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:17.912] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:17.913] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:17.915] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:17.915] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:17.917] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:17.918] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:17.918] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:17.920] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:17.921] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:17.922] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:17.938] [logical planner] [info] logical optimization took 0.022858ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:29:17.938] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:17.939] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:17.940] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:17.940] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:17.941] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:17.941] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:17.942] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:17.943] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:17.944] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:17.945] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:17.946] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:17.947] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:17.947] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:17.948] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:17.950] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:17.951] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:17.951] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:17.952] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:17.952] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:17.953] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:17.953] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:17.954] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:17.955] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:17.956] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:17.957] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:17.958] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:17.959] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:17.959] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:17.960] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:17.992] [global] [info] Stage0 depends on: 
[2021-03-25 10:29:18.342] [global] [info] Optimization via LLVM passes took 0.332612 ms
[2021-03-25 10:29:18.494] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:29:18.494] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.502121s
[2021-03-25 10:29:18.495] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:29:18.776] [E/4] [info] [Task Finished] Transform to mem in 0.281697s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:29:18.776] [E/6] [info] [Task Finished] Transform to mem in 0.281741s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:29:18.777] [E/12] [info] [Task Finished] Transform to mem in 0.282107s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:29:18.777] [E/13] [info] [Task Finished] Transform to mem in 0.282135s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:29:18.777] [E/15] [info] [Task Finished] Transform to mem in 0.282340s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:29:18.777] [E/10] [info] [Task Finished] Transform to mem in 0.282359s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:29:18.777] [E/7] [info] [Task Finished] Transform to mem in 0.282483s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:29:18.777] [E/11] [info] [Task Finished] Transform to mem in 0.282765s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:29:18.777] [E/9] [info] [Task Finished] Transform to mem in 0.282780s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:29:18.778] [E/3] [info] [Task Finished] Transform to mem in 0.283230s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:29:18.778] [E/1] [info] [Task Finished] Transform to mem in 0.283544s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:29:18.778] [E/2] [info] [Task Finished] Transform to mem in 0.283756s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:29:18.780] [E/8] [info] [Task Finished] Transform to mem in 0.284872s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:29:18.780] [E/14] [info] [Task Finished] Transform to mem in 0.284896s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:29:18.780] [E/5] [info] [Task Finished] Transform to mem in 0.285178s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:29:18.788] [driver] [info] [Task Finished] Transform to mem in 0.292904s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:29:19.055] [E/4] [info] [Task Finished] Transform to mem in 0.279018s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:29:19.056] [E/6] [info] [Task Finished] Transform to mem in 0.279313s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:29:19.056] [E/7] [info] [Task Finished] Transform to mem in 0.278590s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:29:19.056] [E/10] [info] [Task Finished] Transform to mem in 0.278804s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:29:19.056] [E/13] [info] [Task Finished] Transform to mem in 0.279099s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:29:19.056] [E/11] [info] [Task Finished] Transform to mem in 0.278545s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:29:19.056] [E/12] [info] [Task Finished] Transform to mem in 0.279318s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:29:19.056] [E/15] [info] [Task Finished] Transform to mem in 0.279297s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:29:19.057] [E/9] [info] [Task Finished] Transform to mem in 0.279113s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:29:19.057] [E/1] [info] [Task Finished] Transform to mem in 0.279020s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:29:19.058] [E/2] [info] [Task Finished] Transform to mem in 0.279694s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:29:19.058] [E/3] [info] [Task Finished] Transform to mem in 0.280399s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:29:19.059] [E/8] [info] [Task Finished] Transform to mem in 0.279026s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:29:19.061] [E/14] [info] [Task Finished] Transform to mem in 0.281227s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:29:19.061] [E/5] [info] [Task Finished] Transform to mem in 0.281488s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:29:19.066] [driver] [info] [Task Finished] Transform to mem in 0.278524s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:29:19.334] [E/4] [info] [Task Finished] Transform to mem in 0.278900s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:29:19.335] [E/7] [info] [Task Finished] Transform to mem in 0.278921s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:29:19.335] [E/11] [info] [Task Finished] Transform to mem in 0.278815s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:29:19.335] [E/10] [info] [Task Finished] Transform to mem in 0.278976s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:29:19.335] [E/6] [info] [Task Finished] Transform to mem in 0.279361s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:29:19.335] [E/15] [info] [Task Finished] Transform to mem in 0.278808s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:29:19.335] [E/13] [info] [Task Finished] Transform to mem in 0.279467s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:29:19.335] [E/12] [info] [Task Finished] Transform to mem in 0.279297s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:29:19.336] [E/9] [info] [Task Finished] Transform to mem in 0.279761s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:29:19.337] [E/1] [info] [Task Finished] Transform to mem in 0.279324s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:29:19.337] [E/3] [info] [Task Finished] Transform to mem in 0.278986s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:29:19.338] [E/2] [info] [Task Finished] Transform to mem in 0.280140s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:29:19.341] [E/8] [info] [Task Finished] Transform to mem in 0.282574s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:29:19.343] [E/14] [info] [Task Finished] Transform to mem in 0.281897s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:29:19.343] [E/5] [info] [Task Finished] Transform to mem in 0.281375s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:29:19.346] [driver] [info] [Task Finished] Transform to mem in 0.279564s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:29:19.613] [E/4] [info] [Task Finished] Transform to mem in 0.279045s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:29:19.614] [E/10] [info] [Task Finished] Transform to mem in 0.278728s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:29:19.614] [E/6] [info] [Task Finished] Transform to mem in 0.278624s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:29:19.614] [E/7] [info] [Task Finished] Transform to mem in 0.279289s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:29:19.614] [E/13] [info] [Task Finished] Transform to mem in 0.278720s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:29:19.614] [E/11] [info] [Task Finished] Transform to mem in 0.279408s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:29:19.614] [E/12] [info] [Task Finished] Transform to mem in 0.278941s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:29:19.615] [E/15] [info] [Task Finished] Transform to mem in 0.279574s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:29:19.616] [E/9] [info] [Task Finished] Transform to mem in 0.279253s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:29:19.616] [E/1] [info] [Task Finished] Transform to mem in 0.279515s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:29:19.616] [E/3] [info] [Task Finished] Transform to mem in 0.279167s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:29:19.618] [E/2] [info] [Task Finished] Transform to mem in 0.279626s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:29:19.620] [E/8] [info] [Task Finished] Transform to mem in 0.279135s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:29:19.624] [E/5] [info] [Task Finished] Transform to mem in 0.281266s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:29:19.624] [E/14] [info] [Task Finished] Transform to mem in 0.281653s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:29:19.625] [driver] [info] [Task Finished] Transform to mem in 0.279292s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:29:19.892] [E/4] [info] [Task Finished] Transform to mem in 0.278859s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:29:19.893] [E/6] [info] [Task Finished] Transform to mem in 0.278944s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:29:19.893] [E/7] [info] [Task Finished] Transform to mem in 0.278927s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:29:19.893] [E/10] [info] [Task Finished] Transform to mem in 0.279392s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:29:19.893] [E/13] [info] [Task Finished] Transform to mem in 0.279046s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:29:19.893] [E/11] [info] [Task Finished] Transform to mem in 0.279211s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:29:19.894] [E/12] [info] [Task Finished] Transform to mem in 0.279200s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:29:19.894] [E/15] [info] [Task Finished] Transform to mem in 0.278953s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:29:19.895] [E/9] [info] [Task Finished] Transform to mem in 0.279510s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:29:19.895] [E/3] [info] [Task Finished] Transform to mem in 0.278891s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:29:19.896] [E/1] [info] [Task Finished] Transform to mem in 0.279610s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:29:19.898] [E/2] [info] [Task Finished] Transform to mem in 0.279683s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:29:19.902] [E/8] [info] [Task Finished] Transform to mem in 0.281357s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:29:19.904] [driver] [info] [Task Finished] Transform to mem in 0.279320s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:29:19.905] [E/5] [info] [Task Finished] Transform to mem in 0.281331s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:29:19.906] [E/14] [info] [Task Finished] Transform to mem in 0.281304s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:29:20.171] [E/4] [info] [Task Finished] Transform to mem in 0.278680s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:29:20.171] [E/10] [info] [Task Finished] Transform to mem in 0.278328s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:29:20.171] [E/6] [info] [Task Finished] Transform to mem in 0.278768s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:29:20.172] [E/7] [info] [Task Finished] Transform to mem in 0.278704s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:29:20.172] [E/12] [info] [Task Finished] Transform to mem in 0.278189s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:29:20.173] [E/13] [info] [Task Finished] Transform to mem in 0.279320s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:29:20.173] [E/11] [info] [Task Finished] Transform to mem in 0.279208s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:29:20.173] [E/15] [info] [Task Finished] Transform to mem in 0.279194s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:29:20.174] [E/9] [info] [Task Finished] Transform to mem in 0.278754s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:29:20.174] [E/3] [info] [Task Finished] Transform to mem in 0.279057s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:29:20.175] [E/1] [info] [Task Finished] Transform to mem in 0.279110s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:29:20.178] [E/2] [info] [Task Finished] Transform to mem in 0.280030s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:29:20.181] [E/8] [info] [Task Finished] Transform to mem in 0.278882s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:29:20.183] [driver] [info] [Task Finished] Transform to mem in 0.279049s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:29:20.186] [E/5] [info] [Task Finished] Transform to mem in 0.280855s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:29:20.187] [E/14] [info] [Task Finished] Transform to mem in 0.281400s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:29:20.450] [E/4] [info] [Task Finished] Transform to mem in 0.278487s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:29:20.450] [E/6] [info] [Task Finished] Transform to mem in 0.278651s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:29:20.450] [E/12] [info] [Task Finished] Transform to mem in 0.278707s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:29:20.450] [E/7] [info] [Task Finished] Transform to mem in 0.278843s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:29:20.451] [E/10] [info] [Task Finished] Transform to mem in 0.279407s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:29:20.451] [E/11] [info] [Task Finished] Transform to mem in 0.278712s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:29:20.452] [E/15] [info] [Task Finished] Transform to mem in 0.278667s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:29:20.452] [E/13] [info] [Task Finished] Transform to mem in 0.279216s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:29:20.453] [E/9] [info] [Task Finished] Transform to mem in 0.279219s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:29:20.454] [E/3] [info] [Task Finished] Transform to mem in 0.279166s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:29:20.454] [E/1] [info] [Task Finished] Transform to mem in 0.278907s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:29:20.458] [E/2] [info] [Task Finished] Transform to mem in 0.280376s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:29:20.462] [E/8] [info] [Task Finished] Transform to mem in 0.281602s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:29:20.463] [driver] [info] [Task Finished] Transform to mem in 0.279629s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:29:20.467] [E/5] [info] [Task Finished] Transform to mem in 0.281023s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:29:20.469] [E/14] [info] [Task Finished] Transform to mem in 0.282011s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:29:20.729] [E/4] [info] [Task Finished] Transform to mem in 0.279376s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:20.730] [E/7] [info] [Task Finished] Transform to mem in 0.279765s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:29:20.730] [E/10] [info] [Task Finished] Transform to mem in 0.279544s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:29:20.730] [E/6] [info] [Task Finished] Transform to mem in 0.280133s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:29:20.730] [E/12] [info] [Task Finished] Transform to mem in 0.279958s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:29:20.731] [E/11] [info] [Task Finished] Transform to mem in 0.279876s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:29:20.732] [E/15] [info] [Task Finished] Transform to mem in 0.280584s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:29:20.732] [E/13] [info] [Task Finished] Transform to mem in 0.280413s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:29:20.734] [E/3] [info] [Task Finished] Transform to mem in 0.280381s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:29:20.734] [E/9] [info] [Task Finished] Transform to mem in 0.281029s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:20.735] [E/1] [info] [Task Finished] Transform to mem in 0.281627s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:29:20.739] [E/2] [info] [Task Finished] Transform to mem in 0.280649s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:29:20.742] [E/8] [info] [Task Finished] Transform to mem in 0.279686s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:29:20.743] [driver] [info] [Task Finished] Transform to mem in 0.279755s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:29:20.749] [E/5] [info] [Task Finished] Transform to mem in 0.281703s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:29:20.752] [E/14] [info] [Task Finished] Transform to mem in 0.282477s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:29:21.009] [E/4] [info] [Task Finished] Transform to mem in 0.279685s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:29:21.009] [E/7] [info] [Task Finished] Transform to mem in 0.279162s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:29:21.010] [E/10] [info] [Task Finished] Transform to mem in 0.279225s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:29:21.010] [E/12] [info] [Task Finished] Transform to mem in 0.279157s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:29:21.010] [E/6] [info] [Task Finished] Transform to mem in 0.279475s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:29:21.011] [E/11] [info] [Task Finished] Transform to mem in 0.279242s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:29:21.011] [E/13] [info] [Task Finished] Transform to mem in 0.279276s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:29:21.012] [E/15] [info] [Task Finished] Transform to mem in 0.279566s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:29:21.013] [E/3] [info] [Task Finished] Transform to mem in 0.279367s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:21.014] [E/9] [info] [Task Finished] Transform to mem in 0.280128s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:29:21.015] [E/1] [info] [Task Finished] Transform to mem in 0.279389s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:29:21.019] [E/2] [info] [Task Finished] Transform to mem in 0.280306s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:29:21.022] [driver] [info] [Task Finished] Transform to mem in 0.279621s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:29:21.024] [E/8] [info] [Task Finished] Transform to mem in 0.281741s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:29:21.030] [E/5] [info] [Task Finished] Transform to mem in 0.280978s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:29:21.034] [E/14] [info] [Task Finished] Transform to mem in 0.282029s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:29:21.288] [E/4] [info] [Task Finished] Transform to mem in 0.279676s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:21.289] [E/6] [info] [Task Finished] Transform to mem in 0.278902s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:29:21.289] [E/7] [info] [Task Finished] Transform to mem in 0.279433s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:29:21.290] [E/12] [info] [Task Finished] Transform to mem in 0.279921s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:29:21.290] [E/10] [info] [Task Finished] Transform to mem in 0.280393s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:29:21.291] [E/13] [info] [Task Finished] Transform to mem in 0.279277s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:29:21.291] [E/11] [info] [Task Finished] Transform to mem in 0.280397s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:29:21.291] [E/15] [info] [Task Finished] Transform to mem in 0.279620s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:29:21.293] [E/3] [info] [Task Finished] Transform to mem in 0.279538s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:29:21.295] [E/9] [info] [Task Finished] Transform to mem in 0.280744s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:29:21.295] [E/1] [info] [Task Finished] Transform to mem in 0.280600s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:29:21.300] [E/2] [info] [Task Finished] Transform to mem in 0.281113s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:29:21.302] [driver] [info] [Task Finished] Transform to mem in 0.279610s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:29:21.304] [E/8] [info] [Task Finished] Transform to mem in 0.280690s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:29:21.312] [E/5] [info] [Task Finished] Transform to mem in 0.281927s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:29:21.350] [E/14] [info] [Task Finished] Transform to mem in 0.315833s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:29:21.350] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.85531s
[2021-03-25 10:29:21.350] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.8533s, 56350770 input rows, time to process 1 row via fast path: 0.000795967ms
[2021-03-25 10:29:21.350] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:29:21.354] [local ee] [info] compiled pure python pipeline in 0.004253s
[2021-03-25 10:29:21.354] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:29:21.355] [local ee] [info] Created 160 resolve tasks in 0.001234s
[2021-03-25 10:29:21.355] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:29:21.367] [E/7] [info] [Task Finished] Resolve in 0.012002s
[2021-03-25 10:29:21.367] [E/6] [info] [Task Finished] Resolve in 0.012004s
[2021-03-25 10:29:21.367] [E/2] [info] [Task Finished] Resolve in 0.012040s
[2021-03-25 10:29:21.367] [E/10] [info] [Task Finished] Resolve in 0.012051s
[2021-03-25 10:29:21.367] [E/9] [info] [Task Finished] Resolve in 0.012010s
[2021-03-25 10:29:21.367] [driver] [info] [Task Finished] Resolve in 0.012074s
[2021-03-25 10:29:21.367] [E/12] [info] [Task Finished] Resolve in 0.012010s
[2021-03-25 10:29:21.367] [E/3] [info] [Task Finished] Resolve in 0.012101s
[2021-03-25 10:29:21.367] [E/11] [info] [Task Finished] Resolve in 0.012127s
[2021-03-25 10:29:21.367] [E/14] [info] [Task Finished] Resolve in 0.012133s
[2021-03-25 10:29:21.367] [E/8] [info] [Task Finished] Resolve in 0.012162s
[2021-03-25 10:29:21.367] [E/4] [info] [Task Finished] Resolve in 0.012179s
[2021-03-25 10:29:21.367] [E/13] [info] [Task Finished] Resolve in 0.012194s
[2021-03-25 10:29:21.367] [E/15] [info] [Task Finished] Resolve in 0.012196s
[2021-03-25 10:29:21.367] [E/5] [info] [Task Finished] Resolve in 0.012135s
[2021-03-25 10:29:21.368] [E/1] [info] [Task Finished] Resolve in 0.012248s
[2021-03-25 10:29:21.379] [driver] [info] [Task Finished] Resolve in 0.011828s
[2021-03-25 10:29:21.379] [E/10] [info] [Task Finished] Resolve in 0.011886s
[2021-03-25 10:29:21.379] [E/12] [info] [Task Finished] Resolve in 0.011862s
[2021-03-25 10:29:21.379] [E/14] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:29:21.379] [E/9] [info] [Task Finished] Resolve in 0.011926s
[2021-03-25 10:29:21.379] [E/2] [info] [Task Finished] Resolve in 0.011966s
[2021-03-25 10:29:21.379] [E/1] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:29:21.379] [E/15] [info] [Task Finished] Resolve in 0.011837s
[2021-03-25 10:29:21.379] [E/8] [info] [Task Finished] Resolve in 0.011901s
[2021-03-25 10:29:21.379] [E/11] [info] [Task Finished] Resolve in 0.011910s
[2021-03-25 10:29:21.379] [E/7] [info] [Task Finished] Resolve in 0.012036s
[2021-03-25 10:29:21.379] [E/3] [info] [Task Finished] Resolve in 0.012003s
[2021-03-25 10:29:21.379] [E/5] [info] [Task Finished] Resolve in 0.011881s
[2021-03-25 10:29:21.379] [E/13] [info] [Task Finished] Resolve in 0.011958s
[2021-03-25 10:29:21.379] [E/6] [info] [Task Finished] Resolve in 0.012172s
[2021-03-25 10:29:21.380] [E/4] [info] [Task Finished] Resolve in 0.012092s
[2021-03-25 10:29:21.391] [driver] [info] [Task Finished] Resolve in 0.011771s
[2021-03-25 10:29:21.391] [E/10] [info] [Task Finished] Resolve in 0.011754s
[2021-03-25 10:29:21.391] [E/12] [info] [Task Finished] Resolve in 0.011758s
[2021-03-25 10:29:21.391] [E/14] [info] [Task Finished] Resolve in 0.011758s
[2021-03-25 10:29:21.391] [E/8] [info] [Task Finished] Resolve in 0.011739s
[2021-03-25 10:29:21.391] [E/2] [info] [Task Finished] Resolve in 0.011811s
[2021-03-25 10:29:21.391] [E/3] [info] [Task Finished] Resolve in 0.011739s
[2021-03-25 10:29:21.391] [E/1] [info] [Task Finished] Resolve in 0.011815s
[2021-03-25 10:29:21.391] [E/15] [info] [Task Finished] Resolve in 0.011804s
[2021-03-25 10:29:21.391] [E/5] [info] [Task Finished] Resolve in 0.011785s
[2021-03-25 10:29:21.391] [E/7] [info] [Task Finished] Resolve in 0.011833s
[2021-03-25 10:29:21.391] [E/13] [info] [Task Finished] Resolve in 0.011775s
[2021-03-25 10:29:21.391] [E/9] [info] [Task Finished] Resolve in 0.012022s
[2021-03-25 10:29:21.391] [E/4] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:29:21.391] [E/6] [info] [Task Finished] Resolve in 0.011841s
[2021-03-25 10:29:21.391] [E/11] [info] [Task Finished] Resolve in 0.012006s
[2021-03-25 10:29:21.403] [E/10] [info] [Task Finished] Resolve in 0.011813s
[2021-03-25 10:29:21.403] [driver] [info] [Task Finished] Resolve in 0.011853s
[2021-03-25 10:29:21.403] [E/15] [info] [Task Finished] Resolve in 0.011689s
[2021-03-25 10:29:21.403] [E/3] [info] [Task Finished] Resolve in 0.011729s
[2021-03-25 10:29:21.403] [E/2] [info] [Task Finished] Resolve in 0.011802s
[2021-03-25 10:29:21.403] [E/12] [info] [Task Finished] Resolve in 0.011938s
[2021-03-25 10:29:21.403] [E/7] [info] [Task Finished] Resolve in 0.011762s
[2021-03-25 10:29:21.403] [E/8] [info] [Task Finished] Resolve in 0.011922s
[2021-03-25 10:29:21.403] [E/1] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:29:21.403] [E/13] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:29:21.403] [E/14] [info] [Task Finished] Resolve in 0.012077s
[2021-03-25 10:29:21.403] [E/11] [info] [Task Finished] Resolve in 0.011746s
[2021-03-25 10:29:21.403] [E/9] [info] [Task Finished] Resolve in 0.011847s
[2021-03-25 10:29:21.403] [E/6] [info] [Task Finished] Resolve in 0.011812s
[2021-03-25 10:29:21.403] [E/4] [info] [Task Finished] Resolve in 0.011865s
[2021-03-25 10:29:21.403] [E/5] [info] [Task Finished] Resolve in 0.012105s
[2021-03-25 10:29:21.415] [E/10] [info] [Task Finished] Resolve in 0.011722s
[2021-03-25 10:29:21.415] [driver] [info] [Task Finished] Resolve in 0.011767s
[2021-03-25 10:29:21.415] [E/15] [info] [Task Finished] Resolve in 0.011905s
[2021-03-25 10:29:21.415] [E/12] [info] [Task Finished] Resolve in 0.011795s
[2021-03-25 10:29:21.415] [E/8] [info] [Task Finished] Resolve in 0.011743s
[2021-03-25 10:29:21.415] [E/1] [info] [Task Finished] Resolve in 0.011715s
[2021-03-25 10:29:21.415] [E/7] [info] [Task Finished] Resolve in 0.011828s
[2021-03-25 10:29:21.415] [E/3] [info] [Task Finished] Resolve in 0.011982s
[2021-03-25 10:29:21.415] [E/13] [info] [Task Finished] Resolve in 0.011802s
[2021-03-25 10:29:21.415] [E/2] [info] [Task Finished] Resolve in 0.011976s
[2021-03-25 10:29:21.415] [E/11] [info] [Task Finished] Resolve in 0.011775s
[2021-03-25 10:29:21.415] [E/6] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:29:21.415] [E/4] [info] [Task Finished] Resolve in 0.011803s
[2021-03-25 10:29:21.415] [E/9] [info] [Task Finished] Resolve in 0.011864s
[2021-03-25 10:29:21.415] [E/5] [info] [Task Finished] Resolve in 0.011787s
[2021-03-25 10:29:21.415] [E/14] [info] [Task Finished] Resolve in 0.012018s
[2021-03-25 10:29:21.426] [driver] [info] [Task Finished] Resolve in 0.011784s
[2021-03-25 10:29:21.426] [E/10] [info] [Task Finished] Resolve in 0.011868s
[2021-03-25 10:29:21.427] [E/12] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:29:21.427] [E/8] [info] [Task Finished] Resolve in 0.011812s
[2021-03-25 10:29:21.427] [E/13] [info] [Task Finished] Resolve in 0.011732s
[2021-03-25 10:29:21.427] [E/7] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:29:21.427] [E/3] [info] [Task Finished] Resolve in 0.011771s
[2021-03-25 10:29:21.427] [E/11] [info] [Task Finished] Resolve in 0.011736s
[2021-03-25 10:29:21.427] [E/1] [info] [Task Finished] Resolve in 0.011894s
[2021-03-25 10:29:21.427] [E/15] [info] [Task Finished] Resolve in 0.011993s
[2021-03-25 10:29:21.427] [E/6] [info] [Task Finished] Resolve in 0.011804s
[2021-03-25 10:29:21.427] [E/9] [info] [Task Finished] Resolve in 0.011850s
[2021-03-25 10:29:21.427] [E/4] [info] [Task Finished] Resolve in 0.011958s
[2021-03-25 10:29:21.427] [E/5] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:29:21.427] [E/2] [info] [Task Finished] Resolve in 0.012108s
[2021-03-25 10:29:21.427] [E/14] [info] [Task Finished] Resolve in 0.011900s
[2021-03-25 10:29:21.438] [driver] [info] [Task Finished] Resolve in 0.011901s
[2021-03-25 10:29:21.438] [E/10] [info] [Task Finished] Resolve in 0.012003s
[2021-03-25 10:29:21.439] [E/7] [info] [Task Finished] Resolve in 0.011929s
[2021-03-25 10:29:21.439] [E/8] [info] [Task Finished] Resolve in 0.011982s
[2021-03-25 10:29:21.439] [E/1] [info] [Task Finished] Resolve in 0.011906s
[2021-03-25 10:29:21.439] [E/11] [info] [Task Finished] Resolve in 0.011963s
[2021-03-25 10:29:21.439] [E/12] [info] [Task Finished] Resolve in 0.012082s
[2021-03-25 10:29:21.439] [E/3] [info] [Task Finished] Resolve in 0.012045s
[2021-03-25 10:29:21.439] [E/6] [info] [Task Finished] Resolve in 0.011995s
[2021-03-25 10:29:21.439] [E/13] [info] [Task Finished] Resolve in 0.012198s
[2021-03-25 10:29:21.439] [E/9] [info] [Task Finished] Resolve in 0.011950s
[2021-03-25 10:29:21.439] [E/2] [info] [Task Finished] Resolve in 0.011892s
[2021-03-25 10:29:21.439] [E/5] [info] [Task Finished] Resolve in 0.011922s
[2021-03-25 10:29:21.439] [E/15] [info] [Task Finished] Resolve in 0.012171s
[2021-03-25 10:29:21.439] [E/4] [info] [Task Finished] Resolve in 0.011994s
[2021-03-25 10:29:21.439] [E/14] [info] [Task Finished] Resolve in 0.011971s
[2021-03-25 10:29:21.450] [driver] [info] [Task Finished] Resolve in 0.011708s
[2021-03-25 10:29:21.450] [E/10] [info] [Task Finished] Resolve in 0.011770s
[2021-03-25 10:29:21.450] [E/11] [info] [Task Finished] Resolve in 0.011731s
[2021-03-25 10:29:21.450] [E/12] [info] [Task Finished] Resolve in 0.011748s
[2021-03-25 10:29:21.450] [E/1] [info] [Task Finished] Resolve in 0.011795s
[2021-03-25 10:29:21.450] [E/7] [info] [Task Finished] Resolve in 0.011870s
[2021-03-25 10:29:21.451] [E/13] [info] [Task Finished] Resolve in 0.011683s
[2021-03-25 10:29:21.451] [E/3] [info] [Task Finished] Resolve in 0.011879s
[2021-03-25 10:29:21.451] [E/8] [info] [Task Finished] Resolve in 0.012013s
[2021-03-25 10:29:21.451] [E/9] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:29:21.451] [E/2] [info] [Task Finished] Resolve in 0.011786s
[2021-03-25 10:29:21.451] [E/15] [info] [Task Finished] Resolve in 0.011753s
[2021-03-25 10:29:21.451] [E/4] [info] [Task Finished] Resolve in 0.011770s
[2021-03-25 10:29:21.451] [E/5] [info] [Task Finished] Resolve in 0.011839s
[2021-03-25 10:29:21.451] [E/6] [info] [Task Finished] Resolve in 0.012009s
[2021-03-25 10:29:21.451] [E/14] [info] [Task Finished] Resolve in 0.011837s
[2021-03-25 10:29:21.462] [driver] [info] [Task Finished] Resolve in 0.011671s
[2021-03-25 10:29:21.462] [E/11] [info] [Task Finished] Resolve in 0.011742s
[2021-03-25 10:29:21.462] [E/1] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:29:21.462] [E/10] [info] [Task Finished] Resolve in 0.012005s
[2021-03-25 10:29:21.462] [E/7] [info] [Task Finished] Resolve in 0.011801s
[2021-03-25 10:29:21.462] [E/12] [info] [Task Finished] Resolve in 0.011851s
[2021-03-25 10:29:21.462] [E/3] [info] [Task Finished] Resolve in 0.011732s
[2021-03-25 10:29:21.462] [E/8] [info] [Task Finished] Resolve in 0.011693s
[2021-03-25 10:29:21.463] [E/15] [info] [Task Finished] Resolve in 0.011737s
[2021-03-25 10:29:21.463] [E/13] [info] [Task Finished] Resolve in 0.011971s
[2021-03-25 10:29:21.463] [E/6] [info] [Task Finished] Resolve in 0.011748s
[2021-03-25 10:29:21.463] [E/2] [info] [Task Finished] Resolve in 0.011849s
[2021-03-25 10:29:21.463] [E/4] [info] [Task Finished] Resolve in 0.011800s
[2021-03-25 10:29:21.463] [E/5] [info] [Task Finished] Resolve in 0.011821s
[2021-03-25 10:29:21.463] [E/9] [info] [Task Finished] Resolve in 0.011963s
[2021-03-25 10:29:21.463] [E/14] [info] [Task Finished] Resolve in 0.011823s
[2021-03-25 10:29:21.473] [driver] [info] [Task Finished] Resolve in 0.011672s
[2021-03-25 10:29:21.474] [E/10] [info] [Task Finished] Resolve in 0.011774s
[2021-03-25 10:29:21.474] [E/11] [info] [Task Finished] Resolve in 0.011890s
[2021-03-25 10:29:21.474] [E/12] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:29:21.474] [E/3] [info] [Task Finished] Resolve in 0.011762s
[2021-03-25 10:29:21.474] [E/7] [info] [Task Finished] Resolve in 0.011869s
[2021-03-25 10:29:21.474] [E/1] [info] [Task Finished] Resolve in 0.011938s
[2021-03-25 10:29:21.474] [E/8] [info] [Task Finished] Resolve in 0.011835s
[2021-03-25 10:29:21.474] [E/15] [info] [Task Finished] Resolve in 0.011706s
[2021-03-25 10:29:21.474] [E/2] [info] [Task Finished] Resolve in 0.011810s
[2021-03-25 10:29:21.474] [E/5] [info] [Task Finished] Resolve in 0.011774s
[2021-03-25 10:29:21.474] [E/9] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:29:21.474] [E/13] [info] [Task Finished] Resolve in 0.011925s
[2021-03-25 10:29:21.475] [E/6] [info] [Task Finished] Resolve in 0.011880s
[2021-03-25 10:29:21.475] [E/4] [info] [Task Finished] Resolve in 0.011894s
[2021-03-25 10:29:21.476] [E/14] [info] [Task Finished] Resolve in 0.013143s
[2021-03-25 10:29:21.476] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.126396s
[2021-03-25 10:29:21.476] [local ee] [info] slow path for Stage 0: total wall clock time: 1.90234s, time to process 1 row via slow path: 0.000275865ms
[2021-03-25 10:29:21.476] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.126422s

[2021-03-25 10:29:21.514] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:29:21.528] [E/6] [info] [Task Finished] write to file in 0.013645s (46082 rows, 7.02 MB)
[2021-03-25 10:29:21.546] [E/8] [info] [Task Finished] write to file in 0.031994s (112421 rows, 17.11 MB)
[2021-03-25 10:29:21.546] [driver] [info] [Task Finished] write to file in 0.032021s (112583 rows, 17.14 MB)
[2021-03-25 10:29:21.546] [E/15] [info] [Task Finished] write to file in 0.031999s (112459 rows, 17.12 MB)
[2021-03-25 10:29:21.547] [E/14] [info] [Task Finished] write to file in 0.032238s (112425 rows, 17.11 MB)
[2021-03-25 10:29:21.547] [E/9] [info] [Task Finished] write to file in 0.032254s (112438 rows, 17.12 MB)
[2021-03-25 10:29:21.547] [E/12] [info] [Task Finished] write to file in 0.032281s (112482 rows, 17.12 MB)
[2021-03-25 10:29:21.547] [E/3] [info] [Task Finished] write to file in 0.032309s (112573 rows, 17.14 MB)
[2021-03-25 10:29:21.547] [E/4] [info] [Task Finished] write to file in 0.032402s (112467 rows, 17.12 MB)
[2021-03-25 10:29:21.548] [E/7] [info] [Task Finished] write to file in 0.033245s (123424 rows, 18.79 MB)
[2021-03-25 10:29:21.548] [E/2] [info] [Task Finished] write to file in 0.033416s (123389 rows, 18.78 MB)
[2021-03-25 10:29:21.548] [E/13] [info] [Task Finished] write to file in 0.033678s (123299 rows, 18.77 MB)
[2021-03-25 10:29:21.548] [E/11] [info] [Task Finished] write to file in 0.033762s (123410 rows, 18.79 MB)
[2021-03-25 10:29:21.548] [E/10] [info] [Task Finished] write to file in 0.033770s (123251 rows, 18.76 MB)
[2021-03-25 10:29:21.548] [E/5] [info] [Task Finished] write to file in 0.033868s (123377 rows, 18.78 MB)
[2021-03-25 10:29:21.552] [E/1] [info] [Task Finished] write to file in 0.037623s (112411 rows, 17.11 MB)
[2021-03-25 10:29:21.552] [global] [info] writing output took 0.075990s
[2021-03-25 10:29:21.552] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0760786s
[2021-03-25 10:29:21.552] [global] [info] [Transform Stage] Stage 0 took 3.55997s
[2021-03-25 10:29:21.552] [global] [info] Query Execution took 3.64006s. (planning: 0.0800594s, execution: 3.56s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.0060541629791259766
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 3.9244046211242676 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0228581,"llvm_optimization_time_s":0.332612,"llvm_compilation_time_s":0.151856,"total_compilation_time_s":0.502118,"sampling_time_s":0.111329,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.8533,"fast_path_time_s":2.85533,"fast_path_per_row_time_ns":795.967,"slow_path_wall_time_s":1.90234,"slow_path_time_s":0.126396,"slow_path_per_row_time_ns":275.865}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.0060541629791259766, "jobTime": 3.9244046211242676, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-25 10:29:21.577] [local execution engine] [info] Stopped local executor E/1
[2021-03-25 10:29:21.583] [local execution engine] [info] Stopped local executor E/2
[2021-03-25 10:29:21.590] [local execution engine] [info] Stopped local executor E/3
[2021-03-25 10:29:21.596] [local execution engine] [info] Stopped local executor E/4
[2021-03-25 10:29:21.602] [local execution engine] [info] Stopped local executor E/5
[2021-03-25 10:29:21.608] [local execution engine] [info] Stopped local executor E/6
[2021-03-25 10:29:21.615] [local execution engine] [info] Stopped local executor E/7
[2021-03-25 10:29:21.621] [local execution engine] [info] Stopped local executor E/8
[2021-03-25 10:29:21.627] [local execution engine] [info] Stopped local executor E/9
[2021-03-25 10:29:21.633] [local execution engine] [info] Stopped local executor E/10
[2021-03-25 10:29:21.639] [local execution engine] [info] Stopped local executor E/11
[2021-03-25 10:29:21.645] [local execution engine] [info] Stopped local executor E/12
[2021-03-25 10:29:21.651] [local execution engine] [info] Stopped local executor E/13
[2021-03-25 10:29:21.658] [local execution engine] [info] Stopped local executor E/14
[2021-03-25 10:29:21.664] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
