[2021-03-31 16:36:32.245] [global] [error] could not find backend, defaulting to local
[2021-03-31 16:36:32.246] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 16:36:32.246] [local ee] [info] initializing LLVM backend
[2021-03-31 16:36:32.246] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 16:36:32.246] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/1] [info] starting detached process queue
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/2] [info] starting detached process queue
[2021-03-31 16:36:32.247] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/3] [info] starting detached process queue
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [E/4] [info] starting detached process queue
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/5] [info] starting detached process queue
[2021-03-31 16:36:32.247] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [E/6] [info] starting detached process queue
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/7] [info] starting detached process queue
[2021-03-31 16:36:32.247] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/8] [info] starting detached process queue
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [E/9] [info] starting detached process queue
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [E/10] [info] starting detached process queue
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/11] [info] starting detached process queue
[2021-03-31 16:36:32.247] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.247] [E/12] [info] starting detached process queue
[2021-03-31 16:36:32.247] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.248] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.248] [E/13] [info] starting detached process queue
[2021-03-31 16:36:32.248] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.248] [E/14] [info] starting detached process queue
[2021-03-31 16:36:32.248] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.248] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:36:32.248] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.248] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 16:36:32.248] [E/15] [info] starting detached process queue
[2021-03-31 16:36:32.248] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 16:36:32.248] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:36:32.248] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 16:36:32.248] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-31 16:36:32.385] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:36:32.391] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:36:32.407] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:36:32.415] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:36:32.442] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:36:32.462] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:36:32.476] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:36:32.509] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:36:32.515] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:36:32.531] [global] [info] performing static typing for UDF in operator map
[2021-03-31 16:36:32.533] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:36:32.534] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:36:32.534] [global] [info] performing static typing for UDF in operator map
[2021-03-31 16:36:32.536] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:36:32.537] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:36:32.538] [global] [info] performing static typing for UDF in operator map
[2021-03-31 16:36:32.539] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:36:32.541] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:36:32.541] [global] [info] performing static typing for UDF in operator map
[2021-03-31 16:36:32.557] [logical planner] [info] logical optimization took 0.022646ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 16:36:32.558] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 16:36:32.558] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 16:36:32.559] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 16:36:32.560] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 16:36:32.560] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 16:36:32.561] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 16:36:32.561] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 16:36:32.562] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 16:36:32.563] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 16:36:32.564] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 16:36:32.565] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 16:36:32.566] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 16:36:32.567] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 16:36:32.567] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 16:36:32.569] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 16:36:32.570] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 16:36:32.570] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 16:36:32.571] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 16:36:32.572] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 16:36:32.572] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 16:36:32.573] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 16:36:32.574] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 16:36:32.575] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 16:36:32.576] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 16:36:32.576] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 16:36:32.577] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 16:36:32.578] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 16:36:32.579] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 16:36:32.579] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 16:36:32.611] [global] [info] Stage0 depends on: 
[2021-03-31 16:36:32.960] [global] [info] Optimization via LLVM passes took 0.331986 ms
[2021-03-31 16:36:33.112] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-31 16:36:33.113] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.501668s
[2021-03-31 16:36:33.113] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-31 16:36:33.392] [driver] [info] [Task Finished] Transform to mem in 0.278848s (10997 normal rows, 42873 exceptions)
[2021-03-31 16:36:33.393] [E/13] [info] [Task Finished] Transform to mem in 0.280041s (11153 normal rows, 42968 exceptions)
[2021-03-31 16:36:33.393] [E/15] [info] [Task Finished] Transform to mem in 0.280078s (11153 normal rows, 42970 exceptions)
[2021-03-31 16:36:33.393] [E/5] [info] [Task Finished] Transform to mem in 0.280428s (11073 normal rows, 43414 exceptions)
[2021-03-31 16:36:33.394] [E/11] [info] [Task Finished] Transform to mem in 0.280627s (11092 normal rows, 43495 exceptions)
[2021-03-31 16:36:33.394] [E/2] [info] [Task Finished] Transform to mem in 0.280818s (11008 normal rows, 43077 exceptions)
[2021-03-31 16:36:33.394] [E/1] [info] [Task Finished] Transform to mem in 0.281031s (11105 normal rows, 43095 exceptions)
[2021-03-31 16:36:33.394] [E/10] [info] [Task Finished] Transform to mem in 0.281184s (11026 normal rows, 43206 exceptions)
[2021-03-31 16:36:33.394] [E/3] [info] [Task Finished] Transform to mem in 0.281191s (11047 normal rows, 43210 exceptions)
[2021-03-31 16:36:33.394] [E/12] [info] [Task Finished] Transform to mem in 0.281312s (11036 normal rows, 43139 exceptions)
[2021-03-31 16:36:33.394] [E/4] [info] [Task Finished] Transform to mem in 0.281382s (11005 normal rows, 42741 exceptions)
[2021-03-31 16:36:33.394] [E/8] [info] [Task Finished] Transform to mem in 0.281523s (11005 normal rows, 42744 exceptions)
[2021-03-31 16:36:33.395] [E/6] [info] [Task Finished] Transform to mem in 0.282000s (10987 normal rows, 43113 exceptions)
[2021-03-31 16:36:33.395] [E/14] [info] [Task Finished] Transform to mem in 0.282233s (10997 normal rows, 42910 exceptions)
[2021-03-31 16:36:33.395] [E/7] [info] [Task Finished] Transform to mem in 0.282311s (11086 normal rows, 43015 exceptions)
[2021-03-31 16:36:33.396] [E/9] [info] [Task Finished] Transform to mem in 0.282729s (11036 normal rows, 43142 exceptions)
[2021-03-31 16:36:33.667] [driver] [info] [Task Finished] Transform to mem in 0.275463s (11086 normal rows, 42996 exceptions)
[2021-03-31 16:36:33.669] [E/5] [info] [Task Finished] Transform to mem in 0.275572s (11026 normal rows, 43205 exceptions)
[2021-03-31 16:36:33.669] [E/15] [info] [Task Finished] Transform to mem in 0.276103s (11153 normal rows, 42978 exceptions)
[2021-03-31 16:36:33.670] [E/13] [info] [Task Finished] Transform to mem in 0.276762s (11092 normal rows, 43505 exceptions)
[2021-03-31 16:36:33.671] [E/1] [info] [Task Finished] Transform to mem in 0.276766s (11036 normal rows, 43115 exceptions)
[2021-03-31 16:36:33.671] [E/4] [info] [Task Finished] Transform to mem in 0.276821s (11111 normal rows, 42961 exceptions)
[2021-03-31 16:36:33.671] [E/14] [info] [Task Finished] Transform to mem in 0.276207s (11023 normal rows, 42880 exceptions)
[2021-03-31 16:36:33.672] [E/2] [info] [Task Finished] Transform to mem in 0.277941s (11023 normal rows, 42910 exceptions)
[2021-03-31 16:36:33.672] [E/11] [info] [Task Finished] Transform to mem in 0.278420s (10982 normal rows, 43059 exceptions)
[2021-03-31 16:36:33.673] [E/6] [info] [Task Finished] Transform to mem in 0.277756s (10987 normal rows, 43068 exceptions)
[2021-03-31 16:36:33.673] [E/12] [info] [Task Finished] Transform to mem in 0.278562s (11079 normal rows, 43539 exceptions)
[2021-03-31 16:36:33.673] [E/3] [info] [Task Finished] Transform to mem in 0.278906s (11086 normal rows, 42970 exceptions)
[2021-03-31 16:36:33.673] [E/8] [info] [Task Finished] Transform to mem in 0.278937s (11076 normal rows, 43220 exceptions)
[2021-03-31 16:36:33.674] [E/10] [info] [Task Finished] Transform to mem in 0.279479s (11005 normal rows, 42772 exceptions)
[2021-03-31 16:36:33.674] [E/7] [info] [Task Finished] Transform to mem in 0.278664s (11036 normal rows, 43053 exceptions)
[2021-03-31 16:36:33.674] [E/9] [info] [Task Finished] Transform to mem in 0.278531s (10992 normal rows, 42864 exceptions)
[2021-03-31 16:36:33.945] [driver] [info] [Task Finished] Transform to mem in 0.277284s (11099 normal rows, 42882 exceptions)
[2021-03-31 16:36:33.946] [E/5] [info] [Task Finished] Transform to mem in 0.277109s (11063 normal rows, 43617 exceptions)
[2021-03-31 16:36:33.947] [E/15] [info] [Task Finished] Transform to mem in 0.277876s (11127 normal rows, 42969 exceptions)
[2021-03-31 16:36:33.948] [E/13] [info] [Task Finished] Transform to mem in 0.277733s (11076 normal rows, 43221 exceptions)
[2021-03-31 16:36:33.949] [E/1] [info] [Task Finished] Transform to mem in 0.277915s (10987 normal rows, 43063 exceptions)
[2021-03-31 16:36:33.949] [E/4] [info] [Task Finished] Transform to mem in 0.277709s (11004 normal rows, 42876 exceptions)
[2021-03-31 16:36:33.950] [E/6] [info] [Task Finished] Transform to mem in 0.277147s (11098 normal rows, 43603 exceptions)
[2021-03-31 16:36:33.951] [E/14] [info] [Task Finished] Transform to mem in 0.279745s (11026 normal rows, 43041 exceptions)
[2021-03-31 16:36:33.951] [E/11] [info] [Task Finished] Transform to mem in 0.279188s (11064 normal rows, 42832 exceptions)
[2021-03-31 16:36:33.951] [E/2] [info] [Task Finished] Transform to mem in 0.279741s (11021 normal rows, 42887 exceptions)
[2021-03-31 16:36:33.953] [E/12] [info] [Task Finished] Transform to mem in 0.280118s (11127 normal rows, 43028 exceptions)
[2021-03-31 16:36:33.953] [E/9] [info] [Task Finished] Transform to mem in 0.279036s (11012 normal rows, 42883 exceptions)
[2021-03-31 16:36:33.953] [E/3] [info] [Task Finished] Transform to mem in 0.280247s (11076 normal rows, 43212 exceptions)
[2021-03-31 16:36:33.954] [E/10] [info] [Task Finished] Transform to mem in 0.280028s (11004 normal rows, 42913 exceptions)
[2021-03-31 16:36:33.954] [E/7] [info] [Task Finished] Transform to mem in 0.280013s (11026 normal rows, 43037 exceptions)
[2021-03-31 16:36:33.955] [E/8] [info] [Task Finished] Transform to mem in 0.281288s (10987 normal rows, 43041 exceptions)
[2021-03-31 16:36:34.220] [driver] [info] [Task Finished] Transform to mem in 0.275029s (11073 normal rows, 42820 exceptions)
[2021-03-31 16:36:34.224] [E/15] [info] [Task Finished] Transform to mem in 0.276613s (11130 normal rows, 43084 exceptions)
[2021-03-31 16:36:34.224] [E/5] [info] [Task Finished] Transform to mem in 0.277722s (11095 normal rows, 43503 exceptions)
[2021-03-31 16:36:34.224] [E/13] [info] [Task Finished] Transform to mem in 0.276334s (11076 normal rows, 43152 exceptions)
[2021-03-31 16:36:34.225] [E/4] [info] [Task Finished] Transform to mem in 0.276295s (11015 normal rows, 42966 exceptions)
[2021-03-31 16:36:34.226] [E/6] [info] [Task Finished] Transform to mem in 0.275770s (11026 normal rows, 43035 exceptions)
[2021-03-31 16:36:34.226] [E/1] [info] [Task Finished] Transform to mem in 0.277660s (10976 normal rows, 43110 exceptions)
[2021-03-31 16:36:34.228] [E/11] [info] [Task Finished] Transform to mem in 0.276294s (11073 normal rows, 42754 exceptions)
[2021-03-31 16:36:34.230] [E/10] [info] [Task Finished] Transform to mem in 0.276041s (11008 normal rows, 42964 exceptions)
[2021-03-31 16:36:34.230] [E/7] [info] [Task Finished] Transform to mem in 0.275879s (11042 normal rows, 43023 exceptions)
[2021-03-31 16:36:34.230] [E/2] [info] [Task Finished] Transform to mem in 0.278576s (11095 normal rows, 43552 exceptions)
[2021-03-31 16:36:34.230] [E/14] [info] [Task Finished] Transform to mem in 0.278935s (11012 normal rows, 42888 exceptions)
[2021-03-31 16:36:34.231] [E/3] [info] [Task Finished] Transform to mem in 0.277586s (10974 normal rows, 43172 exceptions)
[2021-03-31 16:36:34.231] [E/9] [info] [Task Finished] Transform to mem in 0.278049s (11069 normal rows, 43142 exceptions)
[2021-03-31 16:36:34.231] [E/12] [info] [Task Finished] Transform to mem in 0.278396s (11130 normal rows, 43033 exceptions)
[2021-03-31 16:36:34.233] [E/8] [info] [Task Finished] Transform to mem in 0.278416s (11012 normal rows, 42911 exceptions)
[2021-03-31 16:36:34.495] [driver] [info] [Task Finished] Transform to mem in 0.275125s (11063 normal rows, 42726 exceptions)
[2021-03-31 16:36:34.500] [E/13] [info] [Task Finished] Transform to mem in 0.276232s (11087 normal rows, 43150 exceptions)
[2021-03-31 16:36:34.500] [E/15] [info] [Task Finished] Transform to mem in 0.276594s (11105 normal rows, 43555 exceptions)
[2021-03-31 16:36:34.501] [E/4] [info] [Task Finished] Transform to mem in 0.276286s (11005 normal rows, 43164 exceptions)
[2021-03-31 16:36:34.502] [E/5] [info] [Task Finished] Transform to mem in 0.278069s (11081 normal rows, 43050 exceptions)
[2021-03-31 16:36:34.503] [E/6] [info] [Task Finished] Transform to mem in 0.277766s (11008 normal rows, 42975 exceptions)
[2021-03-31 16:36:34.504] [E/1] [info] [Task Finished] Transform to mem in 0.277943s (11042 normal rows, 42959 exceptions)
[2021-03-31 16:36:34.505] [E/11] [info] [Task Finished] Transform to mem in 0.277079s (11002 normal rows, 42964 exceptions)
[2021-03-31 16:36:34.506] [E/7] [info] [Task Finished] Transform to mem in 0.276276s (11088 normal rows, 43511 exceptions)
[2021-03-31 16:36:34.507] [E/2] [info] [Task Finished] Transform to mem in 0.276518s (11098 normal rows, 43112 exceptions)
[2021-03-31 16:36:34.507] [E/14] [info] [Task Finished] Transform to mem in 0.276729s (11087 normal rows, 43044 exceptions)
[2021-03-31 16:36:34.508] [E/9] [info] [Task Finished] Transform to mem in 0.276718s (11008 normal rows, 43017 exceptions)
[2021-03-31 16:36:34.508] [E/10] [info] [Task Finished] Transform to mem in 0.278380s (11073 normal rows, 42720 exceptions)
[2021-03-31 16:36:34.510] [E/12] [info] [Task Finished] Transform to mem in 0.278690s (11024 normal rows, 42947 exceptions)
[2021-03-31 16:36:34.510] [E/3] [info] [Task Finished] Transform to mem in 0.279196s (11005 normal rows, 43229 exceptions)
[2021-03-31 16:36:34.513] [E/8] [info] [Task Finished] Transform to mem in 0.279683s (11020 normal rows, 42976 exceptions)
[2021-03-31 16:36:34.770] [driver] [info] [Task Finished] Transform to mem in 0.275028s (11036 normal rows, 42710 exceptions)
[2021-03-31 16:36:34.778] [E/13] [info] [Task Finished] Transform to mem in 0.277417s (11125 normal rows, 43517 exceptions)
[2021-03-31 16:36:34.778] [E/4] [info] [Task Finished] Transform to mem in 0.276782s (11087 normal rows, 42938 exceptions)
[2021-03-31 16:36:34.778] [E/15] [info] [Task Finished] Transform to mem in 0.278037s (11098 normal rows, 43115 exceptions)
[2021-03-31 16:36:34.779] [E/6] [info] [Task Finished] Transform to mem in 0.275945s (11000 normal rows, 42999 exceptions)
[2021-03-31 16:36:34.781] [E/5] [info] [Task Finished] Transform to mem in 0.279133s (10985 normal rows, 43336 exceptions)
[2021-03-31 16:36:34.782] [E/7] [info] [Task Finished] Transform to mem in 0.276191s (10995 normal rows, 42708 exceptions)
[2021-03-31 16:36:34.783] [E/1] [info] [Task Finished] Transform to mem in 0.278412s (11052 normal rows, 42881 exceptions)
[2021-03-31 16:36:34.784] [E/2] [info] [Task Finished] Transform to mem in 0.276891s (11166 normal rows, 43520 exceptions)
[2021-03-31 16:36:34.784] [E/11] [info] [Task Finished] Transform to mem in 0.278946s (11020 normal rows, 43057 exceptions)
[2021-03-31 16:36:34.784] [E/14] [info] [Task Finished] Transform to mem in 0.276872s (11098 normal rows, 43075 exceptions)
[2021-03-31 16:36:34.784] [E/9] [info] [Task Finished] Transform to mem in 0.276213s (11073 normal rows, 42970 exceptions)
[2021-03-31 16:36:34.785] [E/10] [info] [Task Finished] Transform to mem in 0.276983s (10999 normal rows, 43334 exceptions)
[2021-03-31 16:36:34.788] [E/12] [info] [Task Finished] Transform to mem in 0.277713s (11000 normal rows, 43009 exceptions)
[2021-03-31 16:36:34.788] [E/3] [info] [Task Finished] Transform to mem in 0.277819s (11052 normal rows, 42764 exceptions)
[2021-03-31 16:36:34.792] [E/8] [info] [Task Finished] Transform to mem in 0.279168s (11020 normal rows, 43138 exceptions)
[2021-03-31 16:36:35.048] [driver] [info] [Task Finished] Transform to mem in 0.278031s (10995 normal rows, 42726 exceptions)
[2021-03-31 16:36:35.058] [E/4] [info] [Task Finished] Transform to mem in 0.279904s (11091 normal rows, 43047 exceptions)
[2021-03-31 16:36:35.059] [E/6] [info] [Task Finished] Transform to mem in 0.279399s (10999 normal rows, 43300 exceptions)
[2021-03-31 16:36:35.060] [E/13] [info] [Task Finished] Transform to mem in 0.282245s (11166 normal rows, 43508 exceptions)
[2021-03-31 16:36:35.060] [E/15] [info] [Task Finished] Transform to mem in 0.281769s (11080 normal rows, 43031 exceptions)
[2021-03-31 16:36:35.061] [E/5] [info] [Task Finished] Transform to mem in 0.279487s (11000 normal rows, 43043 exceptions)
[2021-03-31 16:36:35.062] [E/7] [info] [Task Finished] Transform to mem in 0.279145s (11036 normal rows, 42720 exceptions)
[2021-03-31 16:36:35.064] [E/14] [info] [Task Finished] Transform to mem in 0.279752s (11001 normal rows, 43113 exceptions)
[2021-03-31 16:36:35.064] [E/2] [info] [Task Finished] Transform to mem in 0.280032s (10995 normal rows, 42718 exceptions)
[2021-03-31 16:36:35.064] [E/9] [info] [Task Finished] Transform to mem in 0.279748s (11170 normal rows, 43024 exceptions)
[2021-03-31 16:36:35.064] [E/1] [info] [Task Finished] Transform to mem in 0.281406s (11016 normal rows, 43165 exceptions)
[2021-03-31 16:36:35.064] [E/10] [info] [Task Finished] Transform to mem in 0.279138s (10989 normal rows, 43282 exceptions)
[2021-03-31 16:36:35.065] [E/11] [info] [Task Finished] Transform to mem in 0.281697s (11186 normal rows, 43465 exceptions)
[2021-03-31 16:36:35.067] [E/12] [info] [Task Finished] Transform to mem in 0.279319s (11010 normal rows, 43002 exceptions)
[2021-03-31 16:36:35.069] [E/3] [info] [Task Finished] Transform to mem in 0.280957s (11002 normal rows, 42755 exceptions)
[2021-03-31 16:36:35.074] [E/8] [info] [Task Finished] Transform to mem in 0.282158s (11050 normal rows, 43199 exceptions)
[2021-03-31 16:36:35.326] [driver] [info] [Task Finished] Transform to mem in 0.278392s (10973 normal rows, 42686 exceptions)
[2021-03-31 16:36:35.338] [E/6] [info] [Task Finished] Transform to mem in 0.279044s (11045 normal rows, 43148 exceptions)
[2021-03-31 16:36:35.339] [E/4] [info] [Task Finished] Transform to mem in 0.280288s (11160 normal rows, 43455 exceptions)
[2021-03-31 16:36:35.340] [E/15] [info] [Task Finished] Transform to mem in 0.279625s (10997 normal rows, 43283 exceptions)
[2021-03-31 16:36:35.341] [E/5] [info] [Task Finished] Transform to mem in 0.280726s (11005 normal rows, 42971 exceptions)
[2021-03-31 16:36:35.341] [E/13] [info] [Task Finished] Transform to mem in 0.281647s (11166 normal rows, 43023 exceptions)
[2021-03-31 16:36:35.343] [E/7] [info] [Task Finished] Transform to mem in 0.281098s (11007 normal rows, 42795 exceptions)
[2021-03-31 16:36:35.343] [E/14] [info] [Task Finished] Transform to mem in 0.279626s (11050 normal rows, 43196 exceptions)
[2021-03-31 16:36:35.343] [E/2] [info] [Task Finished] Transform to mem in 0.279787s (10973 normal rows, 42686 exceptions)
[2021-03-31 16:36:35.343] [E/1] [info] [Task Finished] Transform to mem in 0.279213s (11043 normal rows, 43153 exceptions)
[2021-03-31 16:36:35.344] [E/9] [info] [Task Finished] Transform to mem in 0.279515s (11160 normal rows, 43446 exceptions)
[2021-03-31 16:36:35.346] [E/10] [info] [Task Finished] Transform to mem in 0.281240s (11168 normal rows, 43028 exceptions)
[2021-03-31 16:36:35.346] [E/12] [info] [Task Finished] Transform to mem in 0.279126s (10997 normal rows, 42973 exceptions)
[2021-03-31 16:36:35.347] [E/11] [info] [Task Finished] Transform to mem in 0.281988s (10997 normal rows, 43277 exceptions)
[2021-03-31 16:36:35.350] [E/3] [info] [Task Finished] Transform to mem in 0.280681s (11015 normal rows, 42799 exceptions)
[2021-03-31 16:36:35.355] [E/8] [info] [Task Finished] Transform to mem in 0.281087s (11050 normal rows, 43170 exceptions)
[2021-03-31 16:36:35.601] [driver] [info] [Task Finished] Transform to mem in 0.274847s (10973 normal rows, 42710 exceptions)
[2021-03-31 16:36:35.614] [E/6] [info] [Task Finished] Transform to mem in 0.276262s (11160 normal rows, 43431 exceptions)
[2021-03-31 16:36:35.616] [E/4] [info] [Task Finished] Transform to mem in 0.277432s (11043 normal rows, 43166 exceptions)
[2021-03-31 16:36:35.618] [E/15] [info] [Task Finished] Transform to mem in 0.278694s (11168 normal rows, 43027 exceptions)
[2021-03-31 16:36:35.619] [E/5] [info] [Task Finished] Transform to mem in 0.277583s (10997 normal rows, 43237 exceptions)
[2021-03-31 16:36:35.619] [E/1] [info] [Task Finished] Transform to mem in 0.276051s (11165 normal rows, 43354 exceptions)
[2021-03-31 16:36:35.620] [E/14] [info] [Task Finished] Transform to mem in 0.276339s (11021 normal rows, 43160 exceptions)
[2021-03-31 16:36:35.620] [E/9] [info] [Task Finished] Transform to mem in 0.276045s (11043 normal rows, 43217 exceptions)
[2021-03-31 16:36:35.620] [E/13] [info] [Task Finished] Transform to mem in 0.278856s (10997 normal rows, 43012 exceptions)
[2021-03-31 16:36:35.621] [E/2] [info] [Task Finished] Transform to mem in 0.277184s (11003 normal rows, 42716 exceptions)
[2021-03-31 16:36:35.621] [E/7] [info] [Task Finished] Transform to mem in 0.278175s (11009 normal rows, 42805 exceptions)
[2021-03-31 16:36:35.622] [E/12] [info] [Task Finished] Transform to mem in 0.275921s (11009 normal rows, 43187 exceptions)
[2021-03-31 16:36:35.623] [E/10] [info] [Task Finished] Transform to mem in 0.277765s (11156 normal rows, 43044 exceptions)
[2021-03-31 16:36:35.625] [E/11] [info] [Task Finished] Transform to mem in 0.277618s (10997 normal rows, 43067 exceptions)
[2021-03-31 16:36:35.626] [E/3] [info] [Task Finished] Transform to mem in 0.276344s (11009 normal rows, 42811 exceptions)
[2021-03-31 16:36:35.633] [E/8] [info] [Task Finished] Transform to mem in 0.277780s (11021 normal rows, 43162 exceptions)
[2021-03-31 16:36:35.877] [driver] [info] [Task Finished] Transform to mem in 0.275879s (11003 normal rows, 42716 exceptions)
[2021-03-31 16:36:35.890] [E/6] [info] [Task Finished] Transform to mem in 0.276085s (11165 normal rows, 43260 exceptions)
[2021-03-31 16:36:35.893] [E/4] [info] [Task Finished] Transform to mem in 0.277373s (11027 normal rows, 43245 exceptions)
[2021-03-31 16:36:35.896] [E/14] [info] [Task Finished] Transform to mem in 0.276703s (10999 normal rows, 42828 exceptions)
[2021-03-31 16:36:35.896] [E/9] [info] [Task Finished] Transform to mem in 0.276635s (11031 normal rows, 43157 exceptions)
[2021-03-31 16:36:35.897] [E/1] [info] [Task Finished] Transform to mem in 0.277119s (11009 normal rows, 43050 exceptions)
[2021-03-31 16:36:35.897] [E/13] [info] [Task Finished] Transform to mem in 0.276660s (11000 normal rows, 42726 exceptions)
[2021-03-31 16:36:35.897] [E/15] [info] [Task Finished] Transform to mem in 0.278651s (11172 normal rows, 43107 exceptions)
[2021-03-31 16:36:35.897] [E/5] [info] [Task Finished] Transform to mem in 0.278527s (10997 normal rows, 43177 exceptions)
[2021-03-31 16:36:35.899] [E/2] [info] [Task Finished] Transform to mem in 0.278093s (11091 normal rows, 43230 exceptions)
[2021-03-31 16:36:35.899] [E/12] [info] [Task Finished] Transform to mem in 0.276637s (11177 normal rows, 43113 exceptions)
[2021-03-31 16:36:35.900] [E/7] [info] [Task Finished] Transform to mem in 0.278761s (11099 normal rows, 43272 exceptions)
[2021-03-31 16:36:35.900] [E/10] [info] [Task Finished] Transform to mem in 0.276311s (10997 normal rows, 43174 exceptions)
[2021-03-31 16:36:35.903] [E/11] [info] [Task Finished] Transform to mem in 0.277965s (10987 normal rows, 43020 exceptions)
[2021-03-31 16:36:35.905] [E/3] [info] [Task Finished] Transform to mem in 0.278684s (11020 normal rows, 42867 exceptions)
[2021-03-31 16:36:35.945] [E/8] [info] [Task Finished] Transform to mem in 0.311911s (12330 normal rows, 48094 exceptions)
[2021-03-31 16:36:35.945] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.83256s
[2021-03-31 16:36:35.945] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.5814s, 56350770 input rows, time to process 1 row via fast path: 0.000791141ms
[2021-03-31 16:36:35.945] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-31 16:36:35.950] [local ee] [info] compiled pure python pipeline in 0.004262s
[2021-03-31 16:36:35.950] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 16:36:35.951] [local ee] [info] Created 160 resolve tasks in 0.001223s
[2021-03-31 16:36:35.951] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 16:37:40.541] [E/15] [info] [Task Finished] Resolve in 64.590016s
[2021-03-31 16:37:44.624] [E/5] [info] [Task Finished] Resolve in 68.673327s
[2021-03-31 16:37:44.740] [E/4] [info] [Task Finished] Resolve in 68.789258s
[2021-03-31 16:37:45.840] [E/1] [info] [Task Finished] Resolve in 69.888965s
[2021-03-31 16:37:48.680] [E/12] [info] [Task Finished] Resolve in 72.729574s
[2021-03-31 16:37:49.165] [driver] [info] [Task Finished] Resolve in 73.213785s
[2021-03-31 16:37:50.168] [E/10] [info] [Task Finished] Resolve in 74.217486s
[2021-03-31 16:37:53.453] [E/6] [info] [Task Finished] Resolve in 77.502151s
[2021-03-31 16:37:53.507] [E/2] [info] [Task Finished] Resolve in 77.556606s
[2021-03-31 16:37:56.808] [E/3] [info] [Task Finished] Resolve in 80.857064s
[2021-03-31 16:37:59.510] [E/8] [info] [Task Finished] Resolve in 83.558686s
[2021-03-31 16:37:59.949] [E/9] [info] [Task Finished] Resolve in 83.998191s
[2021-03-31 16:38:04.119] [E/13] [info] [Task Finished] Resolve in 88.167669s
[2021-03-31 16:38:06.247] [E/14] [info] [Task Finished] Resolve in 90.296618s
[2021-03-31 16:38:07.098] [E/7] [info] [Task Finished] Resolve in 91.147208s
[2021-03-31 16:38:07.293] [E/11] [info] [Task Finished] Resolve in 91.342456s
[2021-03-31 16:38:54.576] [E/5] [info] [Task Finished] Resolve in 69.952033s
[2021-03-31 16:38:56.002] [E/13] [info] [Task Finished] Resolve in 51.883889s
[2021-03-31 16:38:56.329] [E/1] [info] [Task Finished] Resolve in 70.489477s
[2021-03-31 16:38:59.705] [E/15] [info] [Task Finished] Resolve in 79.163928s
[2021-03-31 16:39:00.105] [E/10] [info] [Task Finished] Resolve in 69.937040s
[2021-03-31 16:39:02.958] [E/3] [info] [Task Finished] Resolve in 66.150035s
[2021-03-31 16:39:02.998] [E/4] [info] [Task Finished] Resolve in 78.257915s
[2021-03-31 16:39:08.112] [E/12] [info] [Task Finished] Resolve in 79.431860s
[2021-03-31 16:39:11.839] [E/9] [info] [Task Finished] Resolve in 71.889546s
[2021-03-31 16:39:13.374] [E/6] [info] [Task Finished] Resolve in 79.920780s
[2021-03-31 16:39:13.691] [driver] [info] [Task Finished] Resolve in 84.526163s
[2021-03-31 16:39:16.291] [E/2] [info] [Task Finished] Resolve in 82.783648s
[2021-03-31 16:39:20.526] [E/8] [info] [Task Finished] Resolve in 81.016151s
[2021-03-31 16:39:20.743] [E/14] [info] [Task Finished] Resolve in 74.495370s
[2021-03-31 16:39:28.539] [E/7] [info] [Task Finished] Resolve in 81.440515s
[2021-03-31 16:39:43.639] [E/11] [info] [Task Finished] Resolve in 96.345424s
[2021-03-31 16:39:57.751] [E/13] [info] [Task Finished] Resolve in 61.748656s
[2021-03-31 16:40:00.552] [E/1] [info] [Task Finished] Resolve in 64.222189s
[2021-03-31 16:40:08.219] [E/5] [info] [Task Finished] Resolve in 73.642336s
[2021-03-31 16:40:21.511] [driver] [info] [Task Finished] Resolve in 67.820433s
[2021-03-31 16:40:23.865] [E/15] [info] [Task Finished] Resolve in 84.160200s
[2021-03-31 16:40:28.889] [E/12] [info] [Task Finished] Resolve in 80.776567s
[2021-03-31 16:40:30.358] [E/4] [info] [Task Finished] Resolve in 87.359641s
[2021-03-31 16:40:30.694] [E/10] [info] [Task Finished] Resolve in 90.589010s
[2021-03-31 16:40:32.647] [E/6] [info] [Task Finished] Resolve in 79.272799s
[2021-03-31 16:40:33.940] [E/3] [info] [Task Finished] Resolve in 90.982263s
[2021-03-31 16:40:35.731] [E/2] [info] [Task Finished] Resolve in 79.439817s
[2021-03-31 16:40:40.775] [E/9] [info] [Task Finished] Resolve in 88.936412s
[2021-03-31 16:40:45.370] [E/14] [info] [Task Finished] Resolve in 84.626630s
[2021-03-31 16:40:46.052] [E/8] [info] [Task Finished] Resolve in 85.526094s
[2021-03-31 16:41:00.993] [E/11] [info] [Task Finished] Resolve in 77.353945s
[2021-03-31 16:41:03.195] [E/1] [info] [Task Finished] Resolve in 62.643748s
[2021-03-31 16:41:04.016] [E/13] [info] [Task Finished] Resolve in 66.264454s
[2021-03-31 16:41:13.251] [E/5] [info] [Task Finished] Resolve in 65.032799s
[2021-03-31 16:41:16.799] [E/7] [info] [Task Finished] Resolve in 108.260099s
[2021-03-31 16:41:33.201] [driver] [info] [Task Finished] Resolve in 71.689996s
[2021-03-31 16:41:39.438] [E/6] [info] [Task Finished] Resolve in 66.791618s
[2021-03-31 16:41:40.550] [E/2] [info] [Task Finished] Resolve in 64.819116s
[2021-03-31 16:41:44.252] [E/3] [info] [Task Finished] Resolve in 70.311854s
[2021-03-31 16:41:47.895] [E/12] [info] [Task Finished] Resolve in 79.006161s
[2021-03-31 16:41:54.359] [E/10] [info] [Task Finished] Resolve in 83.664802s
[2021-03-31 16:41:54.535] [E/9] [info] [Task Finished] Resolve in 73.760093s
[2021-03-31 16:41:55.346] [E/15] [info] [Task Finished] Resolve in 91.480747s
[2021-03-31 16:41:56.736] [E/8] [info] [Task Finished] Resolve in 70.684377s
[2021-03-31 16:42:02.176] [E/4] [info] [Task Finished] Resolve in 91.818718s
[2021-03-31 16:42:05.005] [E/14] [info] [Task Finished] Resolve in 79.634980s
[2021-03-31 16:42:09.436] [E/11] [info] [Task Finished] Resolve in 68.443199s
[2021-03-31 16:42:15.117] [E/1] [info] [Task Finished] Resolve in 71.921608s
[2021-03-31 16:42:15.144] [E/13] [info] [Task Finished] Resolve in 71.127931s
[2021-03-31 16:42:21.254] [E/5] [info] [Task Finished] Resolve in 68.002691s
[2021-03-31 16:42:45.518] [driver] [info] [Task Finished] Resolve in 72.316415s
[2021-03-31 16:42:56.834] [E/12] [info] [Task Finished] Resolve in 68.938730s
[2021-03-31 16:43:00.575] [E/3] [info] [Task Finished] Resolve in 76.322501s
[2021-03-31 16:43:01.065] [E/8] [info] [Task Finished] Resolve in 64.328420s
[2021-03-31 16:43:02.829] [E/2] [info] [Task Finished] Resolve in 82.278723s
[2021-03-31 16:43:02.955] [E/6] [info] [Task Finished] Resolve in 83.516818s
[2021-03-31 16:43:04.191] [E/10] [info] [Task Finished] Resolve in 69.831256s
[2021-03-31 16:43:06.137] [E/7] [info] [Task Finished] Resolve in 109.337917s
[2021-03-31 16:43:07.513] [E/15] [info] [Task Finished] Resolve in 72.167295s
[2021-03-31 16:43:13.389] [E/9] [info] [Task Finished] Resolve in 78.854063s
[2021-03-31 16:43:20.893] [E/13] [info] [Task Finished] Resolve in 65.749716s
[2021-03-31 16:43:23.478] [E/4] [info] [Task Finished] Resolve in 81.301927s
[2021-03-31 16:43:23.657] [E/5] [info] [Task Finished] Resolve in 62.402690s
[2021-03-31 16:43:26.065] [E/1] [info] [Task Finished] Resolve in 70.948018s
[2021-03-31 16:43:40.035] [E/14] [info] [Task Finished] Resolve in 95.030882s
[2021-03-31 16:43:42.830] [E/11] [info] [Task Finished] Resolve in 93.394445s
[2021-03-31 16:44:03.898] [driver] [info] [Task Finished] Resolve in 78.379974s
[2021-03-31 16:44:09.237] [E/12] [info] [Task Finished] Resolve in 72.402993s
[2021-03-31 16:44:17.418] [E/9] [info] [Task Finished] Resolve in 64.029001s
[2021-03-31 16:44:20.762] [E/2] [info] [Task Finished] Resolve in 77.932912s
[2021-03-31 16:44:20.782] [E/8] [info] [Task Finished] Resolve in 79.717072s
[2021-03-31 16:44:23.846] [E/5] [info] [Task Finished] Resolve in 60.188829s
[2021-03-31 16:44:24.022] [E/15] [info] [Task Finished] Resolve in 76.508742s
[2021-03-31 16:44:24.206] [E/6] [info] [Task Finished] Resolve in 81.251220s
[2021-03-31 16:44:25.840] [E/10] [info] [Task Finished] Resolve in 81.649481s
[2021-03-31 16:44:29.625] [E/3] [info] [Task Finished] Resolve in 89.050417s
[2021-03-31 16:44:31.874] [E/7] [info] [Task Finished] Resolve in 85.737633s
[2021-03-31 16:44:37.005] [E/1] [info] [Task Finished] Resolve in 70.939965s
[2021-03-31 16:44:39.795] [E/13] [info] [Task Finished] Resolve in 78.901656s
[2021-03-31 16:44:45.932] [E/4] [info] [Task Finished] Resolve in 82.453281s
[2021-03-31 16:45:04.961] [E/11] [info] [Task Finished] Resolve in 82.130217s
[2021-03-31 16:45:07.183] [E/14] [info] [Task Finished] Resolve in 87.147318s
[2021-03-31 16:45:19.926] [E/2] [info] [Task Finished] Resolve in 59.163852s
[2021-03-31 16:45:25.853] [E/10] [info] [Task Finished] Resolve in 60.013015s
[2021-03-31 16:45:27.803] [E/12] [info] [Task Finished] Resolve in 78.565614s
[2021-03-31 16:45:30.100] [E/15] [info] [Task Finished] Resolve in 66.078142s
[2021-03-31 16:45:31.484] [driver] [info] [Task Finished] Resolve in 87.585814s
[2021-03-31 16:45:35.507] [E/6] [info] [Task Finished] Resolve in 71.300647s
[2021-03-31 16:45:37.228] [E/5] [info] [Task Finished] Resolve in 73.382389s
[2021-03-31 16:45:40.076] [E/1] [info] [Task Finished] Resolve in 63.071122s
[2021-03-31 16:45:48.729] [E/13] [info] [Task Finished] Resolve in 68.934383s
[2021-03-31 16:45:51.635] [E/3] [info] [Task Finished] Resolve in 82.009980s
[2021-03-31 16:45:51.734] [E/8] [info] [Task Finished] Resolve in 90.952669s
[2021-03-31 16:45:51.833] [E/9] [info] [Task Finished] Resolve in 94.414570s
[2021-03-31 16:46:07.576] [E/4] [info] [Task Finished] Resolve in 81.644630s
[2021-03-31 16:46:10.913] [E/7] [info] [Task Finished] Resolve in 99.039011s
[2021-03-31 16:46:27.488] [E/14] [info] [Task Finished] Resolve in 80.305083s
[2021-03-31 16:46:28.200] [E/11] [info] [Task Finished] Resolve in 83.238984s
[2021-03-31 16:46:33.633] [E/12] [info] [Task Finished] Resolve in 65.830424s
[2021-03-31 16:46:40.611] [E/2] [info] [Task Finished] Resolve in 80.684823s
[2021-03-31 16:46:45.049] [E/6] [info] [Task Finished] Resolve in 69.541656s
[2021-03-31 16:46:47.219] [E/15] [info] [Task Finished] Resolve in 77.118563s
[2021-03-31 16:46:47.759] [driver] [info] [Task Finished] Resolve in 76.275141s
[2021-03-31 16:46:50.564] [E/10] [info] [Task Finished] Resolve in 84.710627s
[2021-03-31 16:46:52.162] [E/13] [info] [Task Finished] Resolve in 63.432986s
[2021-03-31 16:46:57.271] [E/9] [info] [Task Finished] Resolve in 65.437708s
[2021-03-31 16:47:03.430] [E/5] [info] [Task Finished] Resolve in 86.202142s
[2021-03-31 16:47:05.934] [E/1] [info] [Task Finished] Resolve in 85.857353s
[2021-03-31 16:47:19.238] [E/3] [info] [Task Finished] Resolve in 87.603065s
[2021-03-31 16:47:23.583] [E/8] [info] [Task Finished] Resolve in 91.848158s
[2021-03-31 16:47:26.409] [E/14] [info] [Task Finished] Resolve in 58.921000s
[2021-03-31 16:47:28.534] [E/12] [info] [Task Finished] Resolve in 54.900668s
[2021-03-31 16:47:34.890] [E/4] [info] [Task Finished] Resolve in 87.314021s
[2021-03-31 16:47:46.995] [E/7] [info] [Task Finished] Resolve in 96.081668s
[2021-03-31 16:47:57.567] [driver] [info] [Task Finished] Resolve in 69.808274s
[2021-03-31 16:48:01.580] [E/10] [info] [Task Finished] Resolve in 71.016599s
[2021-03-31 16:48:02.869] [E/13] [info] [Task Finished] Resolve in 70.707009s
[2021-03-31 16:48:05.633] [E/6] [info] [Task Finished] Resolve in 80.584215s
[2021-03-31 16:48:06.570] [E/11] [info] [Task Finished] Resolve in 98.370053s
[2021-03-31 16:48:08.001] [E/15] [info] [Task Finished] Resolve in 80.782016s
[2021-03-31 16:48:09.438] [E/2] [info] [Task Finished] Resolve in 88.827444s
[2021-03-31 16:48:10.260] [E/1] [info] [Task Finished] Resolve in 64.326099s
[2021-03-31 16:48:14.272] [E/5] [info] [Task Finished] Resolve in 70.841473s
[2021-03-31 16:48:14.881] [E/9] [info] [Task Finished] Resolve in 77.610279s
[2021-03-31 16:48:31.945] [E/3] [info] [Task Finished] Resolve in 72.706745s
[2021-03-31 16:48:34.703] [E/14] [info] [Task Finished] Resolve in 68.293936s
[2021-03-31 16:48:36.155] [E/12] [info] [Task Finished] Resolve in 67.621228s
[2021-03-31 16:48:56.597] [E/8] [info] [Task Finished] Resolve in 93.014130s
[2021-03-31 16:49:02.861] [driver] [info] [Task Finished] Resolve in 65.294310s
[2021-03-31 16:49:05.345] [E/4] [info] [Task Finished] Resolve in 90.454127s
[2021-03-31 16:49:05.997] [E/7] [info] [Task Finished] Resolve in 79.001801s
[2021-03-31 16:49:11.027] [E/13] [info] [Task Finished] Resolve in 68.157906s
[2021-03-31 16:49:17.043] [E/5] [info] [Task Finished] Resolve in 62.770798s
[2021-03-31 16:49:21.360] [E/11] [info] [Task Finished] Resolve in 74.790423s
[2021-03-31 16:49:21.509] [E/6] [info] [Task Finished] Resolve in 75.875502s
[2021-03-31 16:49:21.707] [E/9] [info] [Task Finished] Resolve in 66.826313s
[2021-03-31 16:49:21.782] [E/3] [info] [Task Finished] Resolve in 49.836609s
[2021-03-31 16:49:22.363] [E/2] [info] [Task Finished] Resolve in 72.924489s
[2021-03-31 16:49:23.940] [E/10] [info] [Task Finished] Resolve in 82.359342s
[2021-03-31 16:49:25.055] [E/15] [info] [Task Finished] Resolve in 77.054011s
[2021-03-31 16:49:27.109] [E/1] [info] [Task Finished] Resolve in 76.849792s
[2021-03-31 16:49:27.283] [E/14] [info] [Task Finished] Resolve in 52.580071s
[2021-03-31 16:49:27.453] [E/12] [info] [Task Finished] Resolve in 51.297568s
[2021-03-31 16:49:30.003] [E/8] [info] [Task Finished] Resolve in 33.406111s
[2021-03-31 16:49:30.003] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 774.058s
[2021-03-31 16:49:30.003] [local ee] [info] slow path for Stage 0: total wall clock time: 12216.6s, time to process 1 row via slow path: 1.77157ms
[2021-03-31 16:49:30.003] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 774.058s

[2021-03-31 16:49:30.032] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-31 16:49:30.046] [E/8] [info] [Task Finished] write to file in 0.014027s (46082 rows, 7.01 MB)
[2021-03-31 16:49:30.064] [E/15] [info] [Task Finished] write to file in 0.032527s (112425 rows, 17.10 MB)
[2021-03-31 16:49:30.065] [E/5] [info] [Task Finished] write to file in 0.032700s (112573 rows, 17.12 MB)
[2021-03-31 16:49:30.065] [E/2] [info] [Task Finished] write to file in 0.032758s (112421 rows, 17.10 MB)
[2021-03-31 16:49:30.065] [driver] [info] [Task Finished] write to file in 0.032775s (112438 rows, 17.10 MB)
[2021-03-31 16:49:30.065] [E/12] [info] [Task Finished] write to file in 0.032874s (112459 rows, 17.11 MB)
[2021-03-31 16:49:30.065] [E/10] [info] [Task Finished] write to file in 0.033007s (112583 rows, 17.13 MB)
[2021-03-31 16:49:30.065] [E/6] [info] [Task Finished] write to file in 0.033013s (112467 rows, 17.11 MB)
[2021-03-31 16:49:30.065] [E/9] [info] [Task Finished] write to file in 0.033073s (112482 rows, 17.11 MB)
[2021-03-31 16:49:30.066] [E/4] [info] [Task Finished] write to file in 0.033975s (123377 rows, 18.77 MB)
[2021-03-31 16:49:30.066] [E/11] [info] [Task Finished] write to file in 0.034210s (123424 rows, 18.78 MB)
[2021-03-31 16:49:30.066] [E/1] [info] [Task Finished] write to file in 0.034341s (123389 rows, 18.77 MB)
[2021-03-31 16:49:30.066] [E/13] [info] [Task Finished] write to file in 0.034506s (123410 rows, 18.78 MB)
[2021-03-31 16:49:30.066] [E/7] [info] [Task Finished] write to file in 0.034533s (123251 rows, 18.75 MB)
[2021-03-31 16:49:30.066] [E/3] [info] [Task Finished] write to file in 0.034573s (112411 rows, 17.10 MB)
[2021-03-31 16:49:30.066] [E/14] [info] [Task Finished] write to file in 0.034562s (123299 rows, 18.76 MB)
[2021-03-31 16:49:30.066] [global] [info] writing output took 0.063335s
[2021-03-31 16:49:30.067] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0634249s
[2021-03-31 16:49:30.067] [global] [info] [Transform Stage] Stage 0 took 777.456s
[2021-03-31 16:49:30.067] [global] [info] Query Execution took 777.535s. (planning: 0.0794307s, execution: 777.456s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 12:55:20) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005357265472412109
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 777.8198847770691 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '499bbd619a75', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.022646,"llvm_optimization_time_s":0.331986,"llvm_compilation_time_s":0.152005,"total_compilation_time_s":0.501665,"sampling_time_s":0.111798,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.5814,"fast_path_time_s":2.83258,"fast_path_per_row_time_ns":791.141,"slow_path_wall_time_s":12216.6,"slow_path_time_s":774.058,"slow_path_per_row_time_ns":1.77157e+06}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.005357265472412109, "jobTime": 777.8198847770691, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-31 16:49:38.286] [local execution engine] [info] Stopped local executor E/1
[2021-03-31 16:49:38.291] [local execution engine] [info] Stopped local executor E/2
[2021-03-31 16:49:38.297] [local execution engine] [info] Stopped local executor E/3
[2021-03-31 16:49:38.302] [local execution engine] [info] Stopped local executor E/4
[2021-03-31 16:49:38.307] [local execution engine] [info] Stopped local executor E/5
[2021-03-31 16:49:38.312] [local execution engine] [info] Stopped local executor E/6
[2021-03-31 16:49:38.317] [local execution engine] [info] Stopped local executor E/7
[2021-03-31 16:49:38.322] [local execution engine] [info] Stopped local executor E/8
[2021-03-31 16:49:38.328] [local execution engine] [info] Stopped local executor E/9
[2021-03-31 16:49:38.333] [local execution engine] [info] Stopped local executor E/10
[2021-03-31 16:49:38.338] [local execution engine] [info] Stopped local executor E/11
[2021-03-31 16:49:38.343] [local execution engine] [info] Stopped local executor E/12
[2021-03-31 16:49:38.348] [local execution engine] [info] Stopped local executor E/13
[2021-03-31 16:49:38.353] [local execution engine] [info] Stopped local executor E/14
[2021-03-31 16:49:38.358] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
