[2021-03-31 15:30:36.982] [global] [error] could not find backend, defaulting to local
[2021-03-31 15:30:36.982] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 15:30:36.982] [local ee] [info] initializing LLVM backend
[2021-03-31 15:30:36.982] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 15:30:36.982] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.983] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.983] [E/1] [info] starting detached process queue
[2021-03-31 15:30:36.983] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.983] [E/2] [info] starting detached process queue
[2021-03-31 15:30:36.983] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.983] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.983] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.983] [E/3] [info] starting detached process queue
[2021-03-31 15:30:36.983] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.983] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.983] [E/4] [info] starting detached process queue
[2021-03-31 15:30:36.983] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.983] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.983] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.983] [E/5] [info] starting detached process queue
[2021-03-31 15:30:36.984] [E/6] [info] starting detached process queue
[2021-03-31 15:30:36.984] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.984] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.984] [E/7] [info] starting detached process queue
[2021-03-31 15:30:36.984] [E/8] [info] starting detached process queue
[2021-03-31 15:30:36.984] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.984] [E/9] [info] starting detached process queue
[2021-03-31 15:30:36.984] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.984] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [E/10] [info] starting detached process queue
[2021-03-31 15:30:36.984] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.984] [E/11] [info] starting detached process queue
[2021-03-31 15:30:36.984] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.984] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [E/12] [info] starting detached process queue
[2021-03-31 15:30:36.984] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.984] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.984] [E/13] [info] starting detached process queue
[2021-03-31 15:30:36.984] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:30:36.984] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [E/14] [info] starting detached process queue
[2021-03-31 15:30:36.984] [E/15] [info] starting detached process queue
[2021-03-31 15:30:36.984] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 15:30:36.984] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:30:36.984] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 15:30:36.984] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 15:30:36.984] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-31 15:30:37.120] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:30:37.127] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:30:37.143] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:30:37.151] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:30:37.178] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:30:37.198] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:30:37.212] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:30:37.245] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:30:37.251] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:30:37.267] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:30:37.269] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:30:37.270] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:30:37.270] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:30:37.272] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:30:37.273] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:30:37.274] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:30:37.275] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:30:37.277] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:30:37.277] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:30:37.293] [logical planner] [info] logical optimization took 0.022719ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 15:30:37.294] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 15:30:37.294] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 15:30:37.295] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 15:30:37.296] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 15:30:37.296] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 15:30:37.297] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 15:30:37.297] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 15:30:37.298] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 15:30:37.299] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 15:30:37.300] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 15:30:37.301] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 15:30:37.302] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:30:37.303] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:30:37.303] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 15:30:37.305] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 15:30:37.306] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 15:30:37.307] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 15:30:37.307] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 15:30:37.308] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 15:30:37.308] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 15:30:37.309] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 15:30:37.310] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 15:30:37.311] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 15:30:37.312] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 15:30:37.312] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 15:30:37.314] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 15:30:37.314] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:30:37.315] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:30:37.315] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 15:30:37.347] [global] [info] Stage0 depends on: 
[2021-03-31 15:30:37.697] [global] [info] Optimization via LLVM passes took 0.331991 ms
[2021-03-31 15:30:37.849] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-31 15:30:37.849] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.501655s
[2021-03-31 15:30:37.849] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-31 15:30:38.128] [driver] [info] [Task Finished] Transform to mem in 0.278491s (11036 normal rows, 43142 exceptions)
[2021-03-31 15:30:38.128] [E/5] [info] [Task Finished] Transform to mem in 0.279060s (11005 normal rows, 42741 exceptions)
[2021-03-31 15:30:38.128] [E/2] [info] [Task Finished] Transform to mem in 0.279243s (11026 normal rows, 43206 exceptions)
[2021-03-31 15:30:38.128] [E/7] [info] [Task Finished] Transform to mem in 0.279246s (11047 normal rows, 43210 exceptions)
[2021-03-31 15:30:38.129] [E/12] [info] [Task Finished] Transform to mem in 0.279543s (11005 normal rows, 42744 exceptions)
[2021-03-31 15:30:38.129] [E/6] [info] [Task Finished] Transform to mem in 0.279676s (11086 normal rows, 43015 exceptions)
[2021-03-31 15:30:38.129] [E/13] [info] [Task Finished] Transform to mem in 0.279878s (10997 normal rows, 42873 exceptions)
[2021-03-31 15:30:38.129] [E/11] [info] [Task Finished] Transform to mem in 0.279944s (10997 normal rows, 42910 exceptions)
[2021-03-31 15:30:38.129] [E/1] [info] [Task Finished] Transform to mem in 0.279982s (11105 normal rows, 43095 exceptions)
[2021-03-31 15:30:38.129] [E/15] [info] [Task Finished] Transform to mem in 0.280269s (10987 normal rows, 43113 exceptions)
[2021-03-31 15:30:38.130] [E/10] [info] [Task Finished] Transform to mem in 0.280489s (11008 normal rows, 43077 exceptions)
[2021-03-31 15:30:38.130] [E/14] [info] [Task Finished] Transform to mem in 0.280497s (11036 normal rows, 43139 exceptions)
[2021-03-31 15:30:38.130] [E/4] [info] [Task Finished] Transform to mem in 0.280542s (11153 normal rows, 42970 exceptions)
[2021-03-31 15:30:38.130] [E/3] [info] [Task Finished] Transform to mem in 0.280746s (11073 normal rows, 43414 exceptions)
[2021-03-31 15:30:38.130] [E/9] [info] [Task Finished] Transform to mem in 0.280762s (11153 normal rows, 42968 exceptions)
[2021-03-31 15:30:38.130] [E/8] [info] [Task Finished] Transform to mem in 0.280838s (11092 normal rows, 43495 exceptions)
[2021-03-31 15:30:38.403] [driver] [info] [Task Finished] Transform to mem in 0.275218s (11086 normal rows, 42996 exceptions)
[2021-03-31 15:30:38.405] [E/5] [info] [Task Finished] Transform to mem in 0.276253s (11092 normal rows, 43505 exceptions)
[2021-03-31 15:30:38.405] [E/2] [info] [Task Finished] Transform to mem in 0.276331s (11153 normal rows, 42978 exceptions)
[2021-03-31 15:30:38.405] [E/6] [info] [Task Finished] Transform to mem in 0.276077s (11023 normal rows, 42910 exceptions)
[2021-03-31 15:30:38.405] [E/12] [info] [Task Finished] Transform to mem in 0.276314s (10982 normal rows, 43059 exceptions)
[2021-03-31 15:30:38.405] [E/13] [info] [Task Finished] Transform to mem in 0.276123s (11036 normal rows, 43115 exceptions)
[2021-03-31 15:30:38.405] [E/11] [info] [Task Finished] Transform to mem in 0.276114s (11005 normal rows, 42772 exceptions)
[2021-03-31 15:30:38.406] [E/7] [info] [Task Finished] Transform to mem in 0.277104s (11026 normal rows, 43205 exceptions)
[2021-03-31 15:30:38.406] [E/3] [info] [Task Finished] Transform to mem in 0.276168s (11023 normal rows, 42880 exceptions)
[2021-03-31 15:30:38.406] [E/8] [info] [Task Finished] Transform to mem in 0.276280s (10992 normal rows, 42864 exceptions)
[2021-03-31 15:30:38.406] [E/1] [info] [Task Finished] Transform to mem in 0.277160s (11086 normal rows, 42970 exceptions)
[2021-03-31 15:30:38.406] [E/15] [info] [Task Finished] Transform to mem in 0.276969s (11079 normal rows, 43539 exceptions)
[2021-03-31 15:30:38.406] [E/9] [info] [Task Finished] Transform to mem in 0.276495s (11036 normal rows, 43053 exceptions)
[2021-03-31 15:30:38.407] [E/10] [info] [Task Finished] Transform to mem in 0.276781s (11111 normal rows, 42961 exceptions)
[2021-03-31 15:30:38.407] [E/14] [info] [Task Finished] Transform to mem in 0.277173s (11076 normal rows, 43220 exceptions)
[2021-03-31 15:30:38.407] [E/4] [info] [Task Finished] Transform to mem in 0.277141s (10987 normal rows, 43068 exceptions)
[2021-03-31 15:30:38.682] [driver] [info] [Task Finished] Transform to mem in 0.279335s (11099 normal rows, 42882 exceptions)
[2021-03-31 15:30:38.684] [E/5] [info] [Task Finished] Transform to mem in 0.279576s (11063 normal rows, 43617 exceptions)
[2021-03-31 15:30:38.684] [E/2] [info] [Task Finished] Transform to mem in 0.279514s (11127 normal rows, 42969 exceptions)
[2021-03-31 15:30:38.684] [E/6] [info] [Task Finished] Transform to mem in 0.279370s (11076 normal rows, 43221 exceptions)
[2021-03-31 15:30:38.684] [E/13] [info] [Task Finished] Transform to mem in 0.279199s (11004 normal rows, 42876 exceptions)
[2021-03-31 15:30:38.685] [E/7] [info] [Task Finished] Transform to mem in 0.278903s (11021 normal rows, 42887 exceptions)
[2021-03-31 15:30:38.685] [E/12] [info] [Task Finished] Transform to mem in 0.279577s (10987 normal rows, 43063 exceptions)
[2021-03-31 15:30:38.685] [E/11] [info] [Task Finished] Transform to mem in 0.279743s (11026 normal rows, 43041 exceptions)
[2021-03-31 15:30:38.685] [E/3] [info] [Task Finished] Transform to mem in 0.279031s (11064 normal rows, 42832 exceptions)
[2021-03-31 15:30:38.686] [E/10] [info] [Task Finished] Transform to mem in 0.279204s (11004 normal rows, 42913 exceptions)
[2021-03-31 15:30:38.686] [E/8] [info] [Task Finished] Transform to mem in 0.279813s (11098 normal rows, 43603 exceptions)
[2021-03-31 15:30:38.686] [E/15] [info] [Task Finished] Transform to mem in 0.279711s (11076 normal rows, 43212 exceptions)
[2021-03-31 15:30:38.686] [E/9] [info] [Task Finished] Transform to mem in 0.279906s (10987 normal rows, 43041 exceptions)
[2021-03-31 15:30:38.687] [E/4] [info] [Task Finished] Transform to mem in 0.279615s (11012 normal rows, 42883 exceptions)
[2021-03-31 15:30:38.687] [E/1] [info] [Task Finished] Transform to mem in 0.280819s (11127 normal rows, 43028 exceptions)
[2021-03-31 15:30:38.687] [E/14] [info] [Task Finished] Transform to mem in 0.280389s (11026 normal rows, 43037 exceptions)
[2021-03-31 15:30:38.959] [driver] [info] [Task Finished] Transform to mem in 0.276340s (11073 normal rows, 42820 exceptions)
[2021-03-31 15:30:38.962] [E/7] [info] [Task Finished] Transform to mem in 0.277418s (11015 normal rows, 42966 exceptions)
[2021-03-31 15:30:38.962] [E/5] [info] [Task Finished] Transform to mem in 0.277799s (11095 normal rows, 43503 exceptions)
[2021-03-31 15:30:38.962] [E/6] [info] [Task Finished] Transform to mem in 0.277815s (11076 normal rows, 43152 exceptions)
[2021-03-31 15:30:38.962] [E/13] [info] [Task Finished] Transform to mem in 0.277970s (10976 normal rows, 43110 exceptions)
[2021-03-31 15:30:38.962] [E/2] [info] [Task Finished] Transform to mem in 0.278080s (11130 normal rows, 43084 exceptions)
[2021-03-31 15:30:38.963] [E/12] [info] [Task Finished] Transform to mem in 0.277989s (11026 normal rows, 43035 exceptions)
[2021-03-31 15:30:38.963] [E/3] [info] [Task Finished] Transform to mem in 0.278046s (11073 normal rows, 42754 exceptions)
[2021-03-31 15:30:38.964] [E/11] [info] [Task Finished] Transform to mem in 0.278851s (11012 normal rows, 42888 exceptions)
[2021-03-31 15:30:38.964] [E/10] [info] [Task Finished] Transform to mem in 0.278305s (11095 normal rows, 43552 exceptions)
[2021-03-31 15:30:38.964] [E/9] [info] [Task Finished] Transform to mem in 0.278010s (10974 normal rows, 43172 exceptions)
[2021-03-31 15:30:38.964] [E/15] [info] [Task Finished] Transform to mem in 0.278243s (11069 normal rows, 43142 exceptions)
[2021-03-31 15:30:38.965] [E/8] [info] [Task Finished] Transform to mem in 0.278334s (11130 normal rows, 43033 exceptions)
[2021-03-31 15:30:38.965] [E/4] [info] [Task Finished] Transform to mem in 0.278790s (11008 normal rows, 42964 exceptions)
[2021-03-31 15:30:38.966] [E/14] [info] [Task Finished] Transform to mem in 0.279021s (11012 normal rows, 42911 exceptions)
[2021-03-31 15:30:38.967] [E/1] [info] [Task Finished] Transform to mem in 0.279670s (11042 normal rows, 43023 exceptions)
[2021-03-31 15:30:39.236] [driver] [info] [Task Finished] Transform to mem in 0.276964s (11063 normal rows, 42726 exceptions)
[2021-03-31 15:30:39.240] [E/5] [info] [Task Finished] Transform to mem in 0.277573s (11081 normal rows, 43050 exceptions)
[2021-03-31 15:30:39.240] [E/6] [info] [Task Finished] Transform to mem in 0.277498s (11087 normal rows, 43150 exceptions)
[2021-03-31 15:30:39.240] [E/12] [info] [Task Finished] Transform to mem in 0.277534s (11042 normal rows, 42959 exceptions)
[2021-03-31 15:30:39.240] [E/13] [info] [Task Finished] Transform to mem in 0.277804s (11005 normal rows, 43164 exceptions)
[2021-03-31 15:30:39.241] [E/2] [info] [Task Finished] Transform to mem in 0.278060s (11008 normal rows, 42975 exceptions)
[2021-03-31 15:30:39.241] [E/3] [info] [Task Finished] Transform to mem in 0.277426s (11002 normal rows, 42964 exceptions)
[2021-03-31 15:30:39.241] [E/11] [info] [Task Finished] Transform to mem in 0.277058s (11073 normal rows, 42720 exceptions)
[2021-03-31 15:30:39.241] [E/7] [info] [Task Finished] Transform to mem in 0.279171s (11105 normal rows, 43555 exceptions)
[2021-03-31 15:30:39.242] [E/15] [info] [Task Finished] Transform to mem in 0.277112s (11087 normal rows, 43044 exceptions)
[2021-03-31 15:30:39.242] [E/8] [info] [Task Finished] Transform to mem in 0.277594s (11005 normal rows, 43229 exceptions)
[2021-03-31 15:30:39.242] [E/9] [info] [Task Finished] Transform to mem in 0.277913s (11098 normal rows, 43112 exceptions)
[2021-03-31 15:30:39.243] [E/10] [info] [Task Finished] Transform to mem in 0.278811s (11088 normal rows, 43511 exceptions)
[2021-03-31 15:30:39.244] [E/4] [info] [Task Finished] Transform to mem in 0.278171s (11008 normal rows, 43017 exceptions)
[2021-03-31 15:30:39.244] [E/14] [info] [Task Finished] Transform to mem in 0.277822s (11024 normal rows, 42947 exceptions)
[2021-03-31 15:30:39.246] [E/1] [info] [Task Finished] Transform to mem in 0.278900s (11020 normal rows, 42976 exceptions)
[2021-03-31 15:30:39.510] [driver] [info] [Task Finished] Transform to mem in 0.274719s (11036 normal rows, 42710 exceptions)
[2021-03-31 15:30:39.516] [E/6] [info] [Task Finished] Transform to mem in 0.276238s (11098 normal rows, 43115 exceptions)
[2021-03-31 15:30:39.516] [E/5] [info] [Task Finished] Transform to mem in 0.276422s (11125 normal rows, 43517 exceptions)
[2021-03-31 15:30:39.516] [E/12] [info] [Task Finished] Transform to mem in 0.276239s (11087 normal rows, 42938 exceptions)
[2021-03-31 15:30:39.517] [E/13] [info] [Task Finished] Transform to mem in 0.276374s (10985 normal rows, 43336 exceptions)
[2021-03-31 15:30:39.517] [E/7] [info] [Task Finished] Transform to mem in 0.275515s (10995 normal rows, 42708 exceptions)
[2021-03-31 15:30:39.517] [E/3] [info] [Task Finished] Transform to mem in 0.276186s (11052 normal rows, 42881 exceptions)
[2021-03-31 15:30:39.517] [E/2] [info] [Task Finished] Transform to mem in 0.276546s (11000 normal rows, 42999 exceptions)
[2021-03-31 15:30:39.517] [E/11] [info] [Task Finished] Transform to mem in 0.276261s (11020 normal rows, 43057 exceptions)
[2021-03-31 15:30:39.518] [E/15] [info] [Task Finished] Transform to mem in 0.276205s (11166 normal rows, 43520 exceptions)
[2021-03-31 15:30:39.518] [E/9] [info] [Task Finished] Transform to mem in 0.275814s (11073 normal rows, 42970 exceptions)
[2021-03-31 15:30:39.518] [E/8] [info] [Task Finished] Transform to mem in 0.276137s (11098 normal rows, 43075 exceptions)
[2021-03-31 15:30:39.519] [E/10] [info] [Task Finished] Transform to mem in 0.275998s (10999 normal rows, 43334 exceptions)
[2021-03-31 15:30:39.520] [E/4] [info] [Task Finished] Transform to mem in 0.276202s (11000 normal rows, 43009 exceptions)
[2021-03-31 15:30:39.521] [E/14] [info] [Task Finished] Transform to mem in 0.277117s (11052 normal rows, 42764 exceptions)
[2021-03-31 15:30:39.523] [E/1] [info] [Task Finished] Transform to mem in 0.277494s (11020 normal rows, 43138 exceptions)
[2021-03-31 15:30:39.786] [driver] [info] [Task Finished] Transform to mem in 0.275303s (10995 normal rows, 42726 exceptions)
[2021-03-31 15:30:39.793] [E/5] [info] [Task Finished] Transform to mem in 0.276502s (11091 normal rows, 43047 exceptions)
[2021-03-31 15:30:39.793] [E/6] [info] [Task Finished] Transform to mem in 0.277029s (11166 normal rows, 43508 exceptions)
[2021-03-31 15:30:39.793] [E/3] [info] [Task Finished] Transform to mem in 0.276114s (11036 normal rows, 42720 exceptions)
[2021-03-31 15:30:39.793] [E/12] [info] [Task Finished] Transform to mem in 0.276594s (11080 normal rows, 43031 exceptions)
[2021-03-31 15:30:39.793] [E/13] [info] [Task Finished] Transform to mem in 0.276491s (10999 normal rows, 43300 exceptions)
[2021-03-31 15:30:39.793] [E/11] [info] [Task Finished] Transform to mem in 0.275992s (10995 normal rows, 42718 exceptions)
[2021-03-31 15:30:39.793] [E/7] [info] [Task Finished] Transform to mem in 0.276573s (11000 normal rows, 43043 exceptions)
[2021-03-31 15:30:39.793] [E/2] [info] [Task Finished] Transform to mem in 0.276324s (11016 normal rows, 43165 exceptions)
[2021-03-31 15:30:39.794] [E/15] [info] [Task Finished] Transform to mem in 0.276515s (11186 normal rows, 43465 exceptions)
[2021-03-31 15:30:39.795] [E/9] [info] [Task Finished] Transform to mem in 0.276423s (11001 normal rows, 43113 exceptions)
[2021-03-31 15:30:39.795] [E/8] [info] [Task Finished] Transform to mem in 0.276537s (11170 normal rows, 43024 exceptions)
[2021-03-31 15:30:39.795] [E/10] [info] [Task Finished] Transform to mem in 0.276105s (10989 normal rows, 43282 exceptions)
[2021-03-31 15:30:39.797] [E/4] [info] [Task Finished] Transform to mem in 0.276779s (11010 normal rows, 43002 exceptions)
[2021-03-31 15:30:39.798] [E/14] [info] [Task Finished] Transform to mem in 0.276714s (11002 normal rows, 42755 exceptions)
[2021-03-31 15:30:39.800] [E/1] [info] [Task Finished] Transform to mem in 0.276536s (11050 normal rows, 43199 exceptions)
[2021-03-31 15:30:40.061] [driver] [info] [Task Finished] Transform to mem in 0.275660s (10973 normal rows, 42686 exceptions)
[2021-03-31 15:30:40.069] [E/5] [info] [Task Finished] Transform to mem in 0.276170s (11160 normal rows, 43455 exceptions)
[2021-03-31 15:30:40.069] [E/6] [info] [Task Finished] Transform to mem in 0.276264s (11045 normal rows, 43148 exceptions)
[2021-03-31 15:30:40.069] [E/2] [info] [Task Finished] Transform to mem in 0.275971s (10973 normal rows, 42686 exceptions)
[2021-03-31 15:30:40.070] [E/7] [info] [Task Finished] Transform to mem in 0.276201s (11050 normal rows, 43196 exceptions)
[2021-03-31 15:30:40.070] [E/13] [info] [Task Finished] Transform to mem in 0.276372s (11005 normal rows, 42971 exceptions)
[2021-03-31 15:30:40.070] [E/11] [info] [Task Finished] Transform to mem in 0.276583s (11007 normal rows, 42795 exceptions)
[2021-03-31 15:30:40.070] [E/3] [info] [Task Finished] Transform to mem in 0.277159s (11166 normal rows, 43023 exceptions)
[2021-03-31 15:30:40.071] [E/15] [info] [Task Finished] Transform to mem in 0.276603s (11160 normal rows, 43446 exceptions)
[2021-03-31 15:30:40.071] [E/10] [info] [Task Finished] Transform to mem in 0.276134s (10997 normal rows, 43277 exceptions)
[2021-03-31 15:30:40.071] [E/12] [info] [Task Finished] Transform to mem in 0.278253s (10997 normal rows, 43283 exceptions)
[2021-03-31 15:30:40.072] [E/9] [info] [Task Finished] Transform to mem in 0.276921s (11043 normal rows, 43153 exceptions)
[2021-03-31 15:30:40.072] [E/8] [info] [Task Finished] Transform to mem in 0.276840s (11168 normal rows, 43028 exceptions)
[2021-03-31 15:30:40.073] [E/4] [info] [Task Finished] Transform to mem in 0.276695s (10997 normal rows, 42973 exceptions)
[2021-03-31 15:30:40.076] [E/14] [info] [Task Finished] Transform to mem in 0.277400s (11015 normal rows, 42799 exceptions)
[2021-03-31 15:30:40.077] [E/1] [info] [Task Finished] Transform to mem in 0.276604s (11050 normal rows, 43170 exceptions)
[2021-03-31 15:30:40.337] [driver] [info] [Task Finished] Transform to mem in 0.275202s (10973 normal rows, 42710 exceptions)
[2021-03-31 15:30:40.345] [E/5] [info] [Task Finished] Transform to mem in 0.276313s (11160 normal rows, 43431 exceptions)
[2021-03-31 15:30:40.346] [E/7] [info] [Task Finished] Transform to mem in 0.276090s (10997 normal rows, 43237 exceptions)
[2021-03-31 15:30:40.346] [E/6] [info] [Task Finished] Transform to mem in 0.276284s (11043 normal rows, 43166 exceptions)
[2021-03-31 15:30:40.346] [E/2] [info] [Task Finished] Transform to mem in 0.276292s (11168 normal rows, 43027 exceptions)
[2021-03-31 15:30:40.346] [E/13] [info] [Task Finished] Transform to mem in 0.276491s (10997 normal rows, 43012 exceptions)
[2021-03-31 15:30:40.346] [E/11] [info] [Task Finished] Transform to mem in 0.276273s (11009 normal rows, 42805 exceptions)
[2021-03-31 15:30:40.347] [E/3] [info] [Task Finished] Transform to mem in 0.276469s (11021 normal rows, 43160 exceptions)
[2021-03-31 15:30:40.347] [E/15] [info] [Task Finished] Transform to mem in 0.275770s (11003 normal rows, 42716 exceptions)
[2021-03-31 15:30:40.348] [E/10] [info] [Task Finished] Transform to mem in 0.276458s (11165 normal rows, 43354 exceptions)
[2021-03-31 15:30:40.348] [E/8] [info] [Task Finished] Transform to mem in 0.276182s (11009 normal rows, 43187 exceptions)
[2021-03-31 15:30:40.348] [E/12] [info] [Task Finished] Transform to mem in 0.276643s (11043 normal rows, 43217 exceptions)
[2021-03-31 15:30:40.348] [E/9] [info] [Task Finished] Transform to mem in 0.276547s (11156 normal rows, 43044 exceptions)
[2021-03-31 15:30:40.350] [E/4] [info] [Task Finished] Transform to mem in 0.276456s (10997 normal rows, 43067 exceptions)
[2021-03-31 15:30:40.353] [E/14] [info] [Task Finished] Transform to mem in 0.276976s (11009 normal rows, 42811 exceptions)
[2021-03-31 15:30:40.353] [E/1] [info] [Task Finished] Transform to mem in 0.276502s (11021 normal rows, 43162 exceptions)
[2021-03-31 15:30:40.612] [driver] [info] [Task Finished] Transform to mem in 0.274909s (11003 normal rows, 42716 exceptions)
[2021-03-31 15:30:40.621] [E/5] [info] [Task Finished] Transform to mem in 0.276075s (11165 normal rows, 43260 exceptions)
[2021-03-31 15:30:40.622] [E/7] [info] [Task Finished] Transform to mem in 0.276236s (11027 normal rows, 43245 exceptions)
[2021-03-31 15:30:40.622] [E/6] [info] [Task Finished] Transform to mem in 0.276440s (11172 normal rows, 43107 exceptions)
[2021-03-31 15:30:40.622] [E/2] [info] [Task Finished] Transform to mem in 0.276391s (10997 normal rows, 43177 exceptions)
[2021-03-31 15:30:40.622] [E/13] [info] [Task Finished] Transform to mem in 0.276147s (11009 normal rows, 43050 exceptions)
[2021-03-31 15:30:40.623] [E/11] [info] [Task Finished] Transform to mem in 0.276468s (10999 normal rows, 42828 exceptions)
[2021-03-31 15:30:40.623] [E/3] [info] [Task Finished] Transform to mem in 0.276331s (11031 normal rows, 43157 exceptions)
[2021-03-31 15:30:40.623] [E/15] [info] [Task Finished] Transform to mem in 0.276513s (11000 normal rows, 42726 exceptions)
[2021-03-31 15:30:40.624] [E/10] [info] [Task Finished] Transform to mem in 0.276286s (11091 normal rows, 43230 exceptions)
[2021-03-31 15:30:40.624] [E/8] [info] [Task Finished] Transform to mem in 0.276444s (11099 normal rows, 43272 exceptions)
[2021-03-31 15:30:40.625] [E/9] [info] [Task Finished] Transform to mem in 0.276419s (10997 normal rows, 43174 exceptions)
[2021-03-31 15:30:40.625] [E/12] [info] [Task Finished] Transform to mem in 0.276806s (11177 normal rows, 43113 exceptions)
[2021-03-31 15:30:40.626] [E/4] [info] [Task Finished] Transform to mem in 0.276503s (10987 normal rows, 43020 exceptions)
[2021-03-31 15:30:40.629] [E/14] [info] [Task Finished] Transform to mem in 0.276479s (11020 normal rows, 42867 exceptions)
[2021-03-31 15:30:40.663] [E/1] [info] [Task Finished] Transform to mem in 0.309860s (12330 normal rows, 48094 exceptions)
[2021-03-31 15:30:40.663] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.8141s
[2021-03-31 15:30:40.663] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.4158s, 56350770 input rows, time to process 1 row via fast path: 0.000788202ms
[2021-03-31 15:30:40.663] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-31 15:30:40.667] [local ee] [info] compiled pure python pipeline in 0.004288s
[2021-03-31 15:30:40.667] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 15:30:40.669] [local ee] [info] Created 160 resolve tasks in 0.001183s
[2021-03-31 15:30:40.669] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 15:31:42.479] [E/3] [info] [Task Finished] Resolve in 61.810653s
[2021-03-31 15:31:42.645] [E/9] [info] [Task Finished] Resolve in 61.976093s
[2021-03-31 15:31:48.824] [E/1] [info] [Task Finished] Resolve in 68.154990s
[2021-03-31 15:31:49.853] [driver] [info] [Task Finished] Resolve in 69.183982s
[2021-03-31 15:31:51.028] [E/13] [info] [Task Finished] Resolve in 70.359741s
[2021-03-31 15:31:52.710] [E/12] [info] [Task Finished] Resolve in 72.040854s
[2021-03-31 15:31:54.467] [E/6] [info] [Task Finished] Resolve in 73.798284s
[2021-03-31 15:31:55.857] [E/5] [info] [Task Finished] Resolve in 75.187899s
[2021-03-31 15:32:00.606] [E/2] [info] [Task Finished] Resolve in 79.937037s
[2021-03-31 15:32:03.378] [E/4] [info] [Task Finished] Resolve in 82.709570s
[2021-03-31 15:32:04.570] [E/7] [info] [Task Finished] Resolve in 83.900876s
[2021-03-31 15:32:05.171] [E/14] [info] [Task Finished] Resolve in 84.501863s
[2021-03-31 15:32:08.391] [E/15] [info] [Task Finished] Resolve in 87.722231s
[2021-03-31 15:32:08.688] [E/11] [info] [Task Finished] Resolve in 88.019460s
[2021-03-31 15:32:09.568] [E/8] [info] [Task Finished] Resolve in 88.899716s
[2021-03-31 15:32:19.130] [E/10] [info] [Task Finished] Resolve in 98.461298s
[2021-03-31 15:32:45.158] [E/9] [info] [Task Finished] Resolve in 62.513643s
[2021-03-31 15:32:54.446] [E/3] [info] [Task Finished] Resolve in 71.966612s
[2021-03-31 15:32:55.928] [E/12] [info] [Task Finished] Resolve in 63.218581s
[2021-03-31 15:33:01.789] [driver] [info] [Task Finished] Resolve in 71.936268s
[2021-03-31 15:33:02.947] [E/6] [info] [Task Finished] Resolve in 68.480224s
[2021-03-31 15:33:12.891] [E/4] [info] [Task Finished] Resolve in 69.512985s
[2021-03-31 15:33:13.300] [E/5] [info] [Task Finished] Resolve in 77.443028s
[2021-03-31 15:33:15.431] [E/13] [info] [Task Finished] Resolve in 84.402229s
[2021-03-31 15:33:18.931] [E/1] [info] [Task Finished] Resolve in 90.106865s
[2021-03-31 15:33:23.185] [E/15] [info] [Task Finished] Resolve in 74.794246s
[2021-03-31 15:33:24.226] [E/7] [info] [Task Finished] Resolve in 79.655992s
[2021-03-31 15:33:28.608] [E/11] [info] [Task Finished] Resolve in 79.920253s
[2021-03-31 15:33:29.798] [E/14] [info] [Task Finished] Resolve in 84.627484s
[2021-03-31 15:33:32.976] [E/8] [info] [Task Finished] Resolve in 83.407625s
[2021-03-31 15:33:33.132] [E/2] [info] [Task Finished] Resolve in 92.525904s
[2021-03-31 15:33:37.714] [E/10] [info] [Task Finished] Resolve in 78.584247s
[2021-03-31 15:33:55.725] [E/9] [info] [Task Finished] Resolve in 70.566618s
[2021-03-31 15:34:10.246] [E/3] [info] [Task Finished] Resolve in 75.800482s
[2021-03-31 15:34:16.470] [E/4] [info] [Task Finished] Resolve in 63.579067s
[2021-03-31 15:34:16.505] [E/6] [info] [Task Finished] Resolve in 73.557578s
[2021-03-31 15:34:19.202] [E/12] [info] [Task Finished] Resolve in 83.273484s
[2021-03-31 15:34:27.108] [E/7] [info] [Task Finished] Resolve in 62.882407s
[2021-03-31 15:34:28.039] [driver] [info] [Task Finished] Resolve in 86.249711s
[2021-03-31 15:34:32.500] [E/13] [info] [Task Finished] Resolve in 77.068996s
[2021-03-31 15:34:34.068] [E/5] [info] [Task Finished] Resolve in 80.768818s
[2021-03-31 15:34:40.162] [E/15] [info] [Task Finished] Resolve in 76.977173s
[2021-03-31 15:34:41.012] [E/11] [info] [Task Finished] Resolve in 72.403274s
[2021-03-31 15:34:47.382] [E/8] [info] [Task Finished] Resolve in 74.405837s
[2021-03-31 15:34:48.246] [E/1] [info] [Task Finished] Resolve in 89.315857s
[2021-03-31 15:34:55.545] [E/2] [info] [Task Finished] Resolve in 82.413088s
[2021-03-31 15:34:57.026] [E/14] [info] [Task Finished] Resolve in 87.227951s
[2021-03-31 15:35:06.702] [E/9] [info] [Task Finished] Resolve in 70.977201s
[2021-03-31 15:35:07.848] [E/10] [info] [Task Finished] Resolve in 90.133972s
[2021-03-31 15:35:18.932] [E/6] [info] [Task Finished] Resolve in 62.426767s
[2021-03-31 15:35:21.277] [E/12] [info] [Task Finished] Resolve in 62.075233s
[2021-03-31 15:35:21.971] [E/3] [info] [Task Finished] Resolve in 71.724818s
[2021-03-31 15:35:24.619] [E/4] [info] [Task Finished] Resolve in 68.149009s
[2021-03-31 15:35:30.969] [E/7] [info] [Task Finished] Resolve in 63.861335s
[2021-03-31 15:35:48.422] [E/13] [info] [Task Finished] Resolve in 75.922414s
[2021-03-31 15:35:55.146] [driver] [info] [Task Finished] Resolve in 87.106865s
[2021-03-31 15:35:58.340] [E/11] [info] [Task Finished] Resolve in 77.328713s
[2021-03-31 15:36:03.877] [E/8] [info] [Task Finished] Resolve in 76.494976s
[2021-03-31 15:36:03.909] [E/5] [info] [Task Finished] Resolve in 89.840815s
[2021-03-31 15:36:08.091] [E/15] [info] [Task Finished] Resolve in 87.928738s
[2021-03-31 15:36:10.197] [E/1] [info] [Task Finished] Resolve in 81.950487s
[2021-03-31 15:36:14.048] [E/2] [info] [Task Finished] Resolve in 78.503722s
[2021-03-31 15:36:16.790] [E/14] [info] [Task Finished] Resolve in 79.764041s
[2021-03-31 15:36:22.677] [E/9] [info] [Task Finished] Resolve in 75.974964s
[2021-03-31 15:36:25.520] [E/6] [info] [Task Finished] Resolve in 66.588530s
[2021-03-31 15:36:29.272] [E/4] [info] [Task Finished] Resolve in 64.652444s
[2021-03-31 15:36:36.566] [E/10] [info] [Task Finished] Resolve in 88.717796s
[2021-03-31 15:36:44.609] [E/12] [info] [Task Finished] Resolve in 83.332329s
[2021-03-31 15:36:59.218] [E/3] [info] [Task Finished] Resolve in 97.247112s
[2021-03-31 15:37:00.182] [driver] [info] [Task Finished] Resolve in 65.036124s
[2021-03-31 15:37:00.300] [E/7] [info] [Task Finished] Resolve in 89.330956s
[2021-03-31 15:37:01.744] [E/13] [info] [Task Finished] Resolve in 73.322188s
[2021-03-31 15:37:12.934] [E/8] [info] [Task Finished] Resolve in 69.056567s
[2021-03-31 15:37:16.709] [E/1] [info] [Task Finished] Resolve in 66.511526s
[2021-03-31 15:37:22.286] [E/5] [info] [Task Finished] Resolve in 78.376352s
[2021-03-31 15:37:23.229] [E/4] [info] [Task Finished] Resolve in 53.957017s
[2021-03-31 15:37:31.257] [E/15] [info] [Task Finished] Resolve in 83.166080s
[2021-03-31 15:37:31.549] [E/11] [info] [Task Finished] Resolve in 93.208995s
[2021-03-31 15:37:39.818] [E/6] [info] [Task Finished] Resolve in 74.297850s
[2021-03-31 15:37:41.808] [E/9] [info] [Task Finished] Resolve in 79.130846s
[2021-03-31 15:37:43.402] [E/14] [info] [Task Finished] Resolve in 86.612234s
[2021-03-31 15:37:48.126] [E/12] [info] [Task Finished] Resolve in 63.517054s
[2021-03-31 15:37:56.601] [E/7] [info] [Task Finished] Resolve in 56.300774s
[2021-03-31 15:37:58.142] [E/2] [info] [Task Finished] Resolve in 104.093015s
[2021-03-31 15:38:03.874] [E/3] [info] [Task Finished] Resolve in 64.655960s
[2021-03-31 15:38:05.601] [E/10] [info] [Task Finished] Resolve in 89.035273s
[2021-03-31 15:38:22.629] [driver] [info] [Task Finished] Resolve in 82.446995s
[2021-03-31 15:38:32.287] [E/13] [info] [Task Finished] Resolve in 90.542918s
[2021-03-31 15:38:33.735] [E/8] [info] [Task Finished] Resolve in 80.801833s
[2021-03-31 15:38:40.203] [E/11] [info] [Task Finished] Resolve in 68.653819s
[2021-03-31 15:38:41.030] [E/1] [info] [Task Finished] Resolve in 84.321038s
[2021-03-31 15:38:51.052] [E/9] [info] [Task Finished] Resolve in 69.243944s
[2021-03-31 15:38:51.254] [E/4] [info] [Task Finished] Resolve in 88.025213s
[2021-03-31 15:38:51.901] [E/14] [info] [Task Finished] Resolve in 68.499012s
[2021-03-31 15:38:52.826] [E/15] [info] [Task Finished] Resolve in 81.569189s
[2021-03-31 15:38:53.141] [E/5] [info] [Task Finished] Resolve in 90.854982s
[2021-03-31 15:39:02.905] [E/6] [info] [Task Finished] Resolve in 83.086800s
[2021-03-31 15:39:03.979] [E/2] [info] [Task Finished] Resolve in 65.837004s
[2021-03-31 15:39:08.382] [E/7] [info] [Task Finished] Resolve in 71.780741s
[2021-03-31 15:39:11.246] [E/12] [info] [Task Finished] Resolve in 83.119927s
[2021-03-31 15:39:15.418] [E/3] [info] [Task Finished] Resolve in 71.543771s
[2021-03-31 15:39:22.450] [E/10] [info] [Task Finished] Resolve in 76.848713s
[2021-03-31 15:39:41.219] [driver] [info] [Task Finished] Resolve in 78.590082s
[2021-03-31 15:39:41.609] [E/13] [info] [Task Finished] Resolve in 69.321788s
[2021-03-31 15:40:01.687] [E/1] [info] [Task Finished] Resolve in 80.657121s
[2021-03-31 15:40:01.928] [E/11] [info] [Task Finished] Resolve in 81.725023s
[2021-03-31 15:40:02.295] [E/8] [info] [Task Finished] Resolve in 88.559414s
[2021-03-31 15:40:06.575] [E/4] [info] [Task Finished] Resolve in 75.320777s
[2021-03-31 15:40:08.936] [E/5] [info] [Task Finished] Resolve in 75.794810s
[2021-03-31 15:40:11.677] [E/15] [info] [Task Finished] Resolve in 78.850473s
[2021-03-31 15:40:13.400] [E/14] [info] [Task Finished] Resolve in 81.498308s
[2021-03-31 15:40:14.884] [E/9] [info] [Task Finished] Resolve in 83.831729s
[2021-03-31 15:40:17.418] [E/12] [info] [Task Finished] Resolve in 66.171778s
[2021-03-31 15:40:19.043] [E/6] [info] [Task Finished] Resolve in 76.137763s
[2021-03-31 15:40:20.044] [E/2] [info] [Task Finished] Resolve in 76.065392s
[2021-03-31 15:40:27.396] [E/7] [info] [Task Finished] Resolve in 79.014465s
[2021-03-31 15:40:43.427] [E/3] [info] [Task Finished] Resolve in 88.009014s
[2021-03-31 15:40:49.498] [E/10] [info] [Task Finished] Resolve in 87.047587s
[2021-03-31 15:40:51.562] [driver] [info] [Task Finished] Resolve in 70.342711s
[2021-03-31 15:41:02.016] [E/8] [info] [Task Finished] Resolve in 59.721516s
[2021-03-31 15:41:03.317] [E/13] [info] [Task Finished] Resolve in 81.707509s
[2021-03-31 15:41:16.885] [E/5] [info] [Task Finished] Resolve in 67.949708s
[2021-03-31 15:41:20.969] [E/15] [info] [Task Finished] Resolve in 69.292153s
[2021-03-31 15:41:21.504] [E/12] [info] [Task Finished] Resolve in 64.085582s
[2021-03-31 15:41:24.179] [E/6] [info] [Task Finished] Resolve in 65.135924s
[2021-03-31 15:41:24.677] [E/11] [info] [Task Finished] Resolve in 82.748593s
[2021-03-31 15:41:26.808] [E/4] [info] [Task Finished] Resolve in 80.232885s
[2021-03-31 15:41:27.574] [E/9] [info] [Task Finished] Resolve in 72.689953s
[2021-03-31 15:41:31.762] [E/7] [info] [Task Finished] Resolve in 64.365167s
[2021-03-31 15:41:32.764] [E/2] [info] [Task Finished] Resolve in 72.720032s
[2021-03-31 15:41:42.876] [E/1] [info] [Task Finished] Resolve in 101.189389s
[2021-03-31 15:41:59.954] [E/14] [info] [Task Finished] Resolve in 106.554708s
[2021-03-31 15:42:02.272] [E/3] [info] [Task Finished] Resolve in 78.844413s
[2021-03-31 15:42:05.576] [driver] [info] [Task Finished] Resolve in 74.014459s
[2021-03-31 15:42:14.340] [E/8] [info] [Task Finished] Resolve in 72.323464s
[2021-03-31 15:42:14.883] [E/13] [info] [Task Finished] Resolve in 71.566222s
[2021-03-31 15:42:26.228] [E/15] [info] [Task Finished] Resolve in 65.259063s
[2021-03-31 15:42:26.612] [E/10] [info] [Task Finished] Resolve in 97.114225s
[2021-03-31 15:42:30.758] [E/5] [info] [Task Finished] Resolve in 73.872259s
[2021-03-31 15:42:34.678] [E/11] [info] [Task Finished] Resolve in 70.000679s
[2021-03-31 15:42:35.713] [E/12] [info] [Task Finished] Resolve in 74.209590s
[2021-03-31 15:42:41.103] [E/4] [info] [Task Finished] Resolve in 74.295021s
[2021-03-31 15:42:43.947] [E/6] [info] [Task Finished] Resolve in 79.768330s
[2021-03-31 15:42:48.123] [E/7] [info] [Task Finished] Resolve in 76.361796s
[2021-03-31 15:42:54.810] [E/2] [info] [Task Finished] Resolve in 82.046150s
[2021-03-31 15:42:59.794] [E/9] [info] [Task Finished] Resolve in 92.220142s
[2021-03-31 15:43:12.543] [E/3] [info] [Task Finished] Resolve in 70.271666s
[2021-03-31 15:43:21.691] [E/15] [info] [Task Finished] Resolve in 55.462315s
[2021-03-31 15:43:22.590] [E/1] [info] [Task Finished] Resolve in 99.714231s
[2021-03-31 15:43:22.884] [E/14] [info] [Task Finished] Resolve in 82.929718s
[2021-03-31 15:43:22.893] [driver] [info] [Task Finished] Resolve in 77.316700s
[2021-03-31 15:43:25.074] [E/8] [info] [Task Finished] Resolve in 70.734455s
[2021-03-31 15:43:25.980] [E/13] [info] [Task Finished] Resolve in 71.097000s
[2021-03-31 15:43:31.161] [E/12] [info] [Task Finished] Resolve in 55.447561s
[2021-03-31 15:43:31.819] [E/10] [info] [Task Finished] Resolve in 65.206963s
[2021-03-31 15:43:32.109] [E/5] [info] [Task Finished] Resolve in 61.351384s
[2021-03-31 15:43:32.456] [E/6] [info] [Task Finished] Resolve in 48.508893s
[2021-03-31 15:43:33.640] [E/4] [info] [Task Finished] Resolve in 52.537297s
[2021-03-31 15:43:33.979] [E/11] [info] [Task Finished] Resolve in 59.301757s
[2021-03-31 15:43:34.162] [E/7] [info] [Task Finished] Resolve in 46.038114s
[2021-03-31 15:43:34.162] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 773.499s
[2021-03-31 15:43:34.162] [local ee] [info] slow path for Stage 0: total wall clock time: 12206.9s, time to process 1 row via slow path: 1.77016ms
[2021-03-31 15:43:34.162] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 773.499s

[2021-03-31 15:43:34.190] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-31 15:43:34.205] [E/7] [info] [Task Finished] write to file in 0.014209s (46082 rows, 7.01 MB)
[2021-03-31 15:43:34.223] [E/13] [info] [Task Finished] write to file in 0.032800s (112573 rows, 17.12 MB)
[2021-03-31 15:43:34.223] [E/11] [info] [Task Finished] write to file in 0.032919s (112421 rows, 17.10 MB)
[2021-03-31 15:43:34.223] [E/9] [info] [Task Finished] write to file in 0.032979s (112438 rows, 17.10 MB)
[2021-03-31 15:43:34.224] [E/14] [info] [Task Finished] write to file in 0.033013s (112425 rows, 17.10 MB)
[2021-03-31 15:43:34.224] [E/12] [info] [Task Finished] write to file in 0.033055s (112583 rows, 17.13 MB)
[2021-03-31 15:43:34.224] [E/3] [info] [Task Finished] write to file in 0.033129s (112467 rows, 17.11 MB)
[2021-03-31 15:43:34.224] [E/6] [info] [Task Finished] write to file in 0.033198s (112482 rows, 17.11 MB)
[2021-03-31 15:43:34.224] [E/10] [info] [Task Finished] write to file in 0.033275s (112459 rows, 17.11 MB)
[2021-03-31 15:43:34.225] [E/5] [info] [Task Finished] write to file in 0.034551s (123424 rows, 18.78 MB)
[2021-03-31 15:43:34.225] [E/4] [info] [Task Finished] write to file in 0.034625s (123299 rows, 18.76 MB)
[2021-03-31 15:43:34.225] [E/8] [info] [Task Finished] write to file in 0.034651s (123377 rows, 18.77 MB)
[2021-03-31 15:43:34.225] [driver] [info] [Task Finished] write to file in 0.034654s (123410 rows, 18.78 MB)
[2021-03-31 15:43:34.225] [E/2] [info] [Task Finished] write to file in 0.034750s (123389 rows, 18.77 MB)
[2021-03-31 15:43:34.225] [E/15] [info] [Task Finished] write to file in 0.034831s (123251 rows, 18.75 MB)
[2021-03-31 15:43:34.226] [E/1] [info] [Task Finished] write to file in 0.035772s (112411 rows, 17.10 MB)
[2021-03-31 15:43:34.226] [global] [info] writing output took 0.064458s
[2021-03-31 15:43:34.226] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0645473s
[2021-03-31 15:43:34.226] [global] [info] [Transform Stage] Stage 0 took 776.879s
[2021-03-31 15:43:34.226] [global] [info] Query Execution took 776.959s. (planning: 0.079636s, execution: 776.879s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 12:55:20) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005407810211181641
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 777.2432563304901 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '499bbd619a75', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0227189,"llvm_optimization_time_s":0.331991,"llvm_compilation_time_s":0.151843,"total_compilation_time_s":0.501653,"sampling_time_s":0.11114,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.4158,"fast_path_time_s":2.81412,"fast_path_per_row_time_ns":788.202,"slow_path_wall_time_s":12206.9,"slow_path_time_s":773.499,"slow_path_per_row_time_ns":1.77016e+06}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.005407810211181641, "jobTime": 777.2432563304901, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-31 15:43:42.498] [local execution engine] [info] Stopped local executor E/1
[2021-03-31 15:43:42.504] [local execution engine] [info] Stopped local executor E/2
[2021-03-31 15:43:42.509] [local execution engine] [info] Stopped local executor E/3
[2021-03-31 15:43:42.514] [local execution engine] [info] Stopped local executor E/4
[2021-03-31 15:43:42.520] [local execution engine] [info] Stopped local executor E/5
[2021-03-31 15:43:42.525] [local execution engine] [info] Stopped local executor E/6
[2021-03-31 15:43:42.530] [local execution engine] [info] Stopped local executor E/7
[2021-03-31 15:43:42.535] [local execution engine] [info] Stopped local executor E/8
[2021-03-31 15:43:42.540] [local execution engine] [info] Stopped local executor E/9
[2021-03-31 15:43:42.545] [local execution engine] [info] Stopped local executor E/10
[2021-03-31 15:43:42.550] [local execution engine] [info] Stopped local executor E/11
[2021-03-31 15:43:42.555] [local execution engine] [info] Stopped local executor E/12
[2021-03-31 15:43:42.560] [local execution engine] [info] Stopped local executor E/13
[2021-03-31 15:43:42.565] [local execution engine] [info] Stopped local executor E/14
[2021-03-31 15:43:42.570] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
