[2021-03-31 14:51:05.162] [global] [error] could not find backend, defaulting to local
[2021-03-31 14:51:05.163] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 14:51:05.163] [local ee] [info] initializing LLVM backend
[2021-03-31 14:51:05.163] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 14:51:05.163] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/1] [info] starting detached process queue
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/2] [info] starting detached process queue
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [E/3] [info] starting detached process queue
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/4] [info] starting detached process queue
[2021-03-31 14:51:05.164] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/5] [info] starting detached process queue
[2021-03-31 14:51:05.164] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/6] [info] starting detached process queue
[2021-03-31 14:51:05.164] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [E/7] [info] starting detached process queue
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [E/8] [info] starting detached process queue
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/9] [info] starting detached process queue
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [E/10] [info] starting detached process queue
[2021-03-31 14:51:05.164] [E/11] [info] starting detached process queue
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.164] [E/12] [info] starting detached process queue
[2021-03-31 14:51:05.164] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.165] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.165] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.165] [E/13] [info] starting detached process queue
[2021-03-31 14:51:05.165] [E/14] [info] starting detached process queue
[2021-03-31 14:51:05.165] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:51:05.165] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.165] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.165] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 14:51:05.165] [E/15] [info] starting detached process queue
[2021-03-31 14:51:05.165] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 14:51:05.165] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:51:05.165] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 14:51:05.165] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-31 14:51:05.302] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:51:05.308] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:51:05.324] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:51:05.332] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:51:05.359] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:51:05.380] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:51:05.393] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:51:05.426] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:51:05.432] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:51:05.448] [global] [info] performing static typing for UDF in operator map
[2021-03-31 14:51:05.450] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:51:05.451] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:51:05.452] [global] [info] performing static typing for UDF in operator map
[2021-03-31 14:51:05.453] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:51:05.455] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:51:05.455] [global] [info] performing static typing for UDF in operator map
[2021-03-31 14:51:05.457] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:51:05.458] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:51:05.458] [global] [info] performing static typing for UDF in operator map
[2021-03-31 14:51:05.475] [logical planner] [info] logical optimization took 0.022685ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 14:51:05.475] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 14:51:05.475] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 14:51:05.476] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 14:51:05.477] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 14:51:05.477] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 14:51:05.478] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 14:51:05.479] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 14:51:05.480] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 14:51:05.481] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 14:51:05.481] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 14:51:05.482] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 14:51:05.483] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 14:51:05.484] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 14:51:05.485] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 14:51:05.486] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 14:51:05.487] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 14:51:05.488] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 14:51:05.488] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 14:51:05.489] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 14:51:05.489] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 14:51:05.490] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 14:51:05.491] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 14:51:05.492] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 14:51:05.493] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 14:51:05.493] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 14:51:05.495] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 14:51:05.495] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 14:51:05.496] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 14:51:05.496] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 14:51:05.528] [global] [info] Stage0 depends on: 
[2021-03-31 14:51:05.877] [global] [info] Optimization via LLVM passes took 0.331494 ms
[2021-03-31 14:51:06.028] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-31 14:51:06.028] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.500585s
[2021-03-31 14:51:06.029] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-31 14:51:06.314] [E/5] [info] [Task Finished] Transform to mem in 0.284748s (11005 normal rows, 42741 exceptions)
[2021-03-31 14:51:06.314] [E/7] [info] [Task Finished] Transform to mem in 0.285211s (11036 normal rows, 43139 exceptions)
[2021-03-31 14:51:06.314] [E/12] [info] [Task Finished] Transform to mem in 0.285219s (11026 normal rows, 43206 exceptions)
[2021-03-31 14:51:06.314] [E/1] [info] [Task Finished] Transform to mem in 0.285321s (11073 normal rows, 43414 exceptions)
[2021-03-31 14:51:06.314] [E/6] [info] [Task Finished] Transform to mem in 0.285395s (11047 normal rows, 43210 exceptions)
[2021-03-31 14:51:06.314] [E/2] [info] [Task Finished] Transform to mem in 0.285418s (11105 normal rows, 43095 exceptions)
[2021-03-31 14:51:06.314] [E/10] [info] [Task Finished] Transform to mem in 0.285459s (10987 normal rows, 43113 exceptions)
[2021-03-31 14:51:06.314] [E/3] [info] [Task Finished] Transform to mem in 0.285591s (10997 normal rows, 42910 exceptions)
[2021-03-31 14:51:06.314] [E/4] [info] [Task Finished] Transform to mem in 0.285627s (10997 normal rows, 42873 exceptions)
[2021-03-31 14:51:06.314] [E/9] [info] [Task Finished] Transform to mem in 0.285653s (11153 normal rows, 42968 exceptions)
[2021-03-31 14:51:06.315] [E/8] [info] [Task Finished] Transform to mem in 0.285721s (11005 normal rows, 42744 exceptions)
[2021-03-31 14:51:06.315] [E/13] [info] [Task Finished] Transform to mem in 0.285742s (11086 normal rows, 43015 exceptions)
[2021-03-31 14:51:06.315] [E/15] [info] [Task Finished] Transform to mem in 0.286152s (11008 normal rows, 43077 exceptions)
[2021-03-31 14:51:06.316] [E/14] [info] [Task Finished] Transform to mem in 0.286734s (11092 normal rows, 43495 exceptions)
[2021-03-31 14:51:06.316] [driver] [info] [Task Finished] Transform to mem in 0.287143s (11153 normal rows, 42970 exceptions)
[2021-03-31 14:51:06.319] [E/11] [info] [Task Finished] Transform to mem in 0.290387s (11036 normal rows, 43142 exceptions)
[2021-03-31 14:51:06.592] [E/5] [info] [Task Finished] Transform to mem in 0.278411s (11086 normal rows, 42996 exceptions)
[2021-03-31 14:51:06.593] [E/10] [info] [Task Finished] Transform to mem in 0.278542s (11036 normal rows, 43115 exceptions)
[2021-03-31 14:51:06.593] [E/1] [info] [Task Finished] Transform to mem in 0.278693s (11026 normal rows, 43205 exceptions)
[2021-03-31 14:51:06.593] [E/2] [info] [Task Finished] Transform to mem in 0.278781s (11023 normal rows, 42910 exceptions)
[2021-03-31 14:51:06.593] [E/3] [info] [Task Finished] Transform to mem in 0.278624s (11005 normal rows, 42772 exceptions)
[2021-03-31 14:51:06.593] [E/7] [info] [Task Finished] Transform to mem in 0.279007s (11092 normal rows, 43505 exceptions)
[2021-03-31 14:51:06.593] [E/6] [info] [Task Finished] Transform to mem in 0.278848s (10982 normal rows, 43059 exceptions)
[2021-03-31 14:51:06.593] [E/4] [info] [Task Finished] Transform to mem in 0.278918s (11086 normal rows, 42970 exceptions)
[2021-03-31 14:51:06.593] [E/12] [info] [Task Finished] Transform to mem in 0.279351s (11153 normal rows, 42978 exceptions)
[2021-03-31 14:51:06.594] [E/9] [info] [Task Finished] Transform to mem in 0.279137s (11079 normal rows, 43539 exceptions)
[2021-03-31 14:51:06.594] [E/8] [info] [Task Finished] Transform to mem in 0.279666s (11111 normal rows, 42961 exceptions)
[2021-03-31 14:51:06.594] [E/15] [info] [Task Finished] Transform to mem in 0.279487s (10987 normal rows, 43068 exceptions)
[2021-03-31 14:51:06.595] [E/14] [info] [Task Finished] Transform to mem in 0.279365s (11023 normal rows, 42880 exceptions)
[2021-03-31 14:51:06.601] [E/13] [info] [Task Finished] Transform to mem in 0.286734s (11076 normal rows, 43220 exceptions)
[2021-03-31 14:51:06.602] [driver] [info] [Task Finished] Transform to mem in 0.286106s (11036 normal rows, 43053 exceptions)
[2021-03-31 14:51:06.603] [E/11] [info] [Task Finished] Transform to mem in 0.284151s (10992 normal rows, 42864 exceptions)
[2021-03-31 14:51:06.874] [E/5] [info] [Task Finished] Transform to mem in 0.282054s (11099 normal rows, 42882 exceptions)
[2021-03-31 14:51:06.875] [E/7] [info] [Task Finished] Transform to mem in 0.281884s (11004 normal rows, 42876 exceptions)
[2021-03-31 14:51:06.875] [E/6] [info] [Task Finished] Transform to mem in 0.281880s (11026 normal rows, 43041 exceptions)
[2021-03-31 14:51:06.875] [E/10] [info] [Task Finished] Transform to mem in 0.282174s (11063 normal rows, 43617 exceptions)
[2021-03-31 14:51:06.875] [E/2] [info] [Task Finished] Transform to mem in 0.282087s (11076 normal rows, 43221 exceptions)
[2021-03-31 14:51:06.875] [E/1] [info] [Task Finished] Transform to mem in 0.282305s (11127 normal rows, 42969 exceptions)
[2021-03-31 14:51:06.876] [E/12] [info] [Task Finished] Transform to mem in 0.282265s (11064 normal rows, 42832 exceptions)
[2021-03-31 14:51:06.876] [E/4] [info] [Task Finished] Transform to mem in 0.282322s (11021 normal rows, 42887 exceptions)
[2021-03-31 14:51:06.876] [E/3] [info] [Task Finished] Transform to mem in 0.282910s (10987 normal rows, 43063 exceptions)
[2021-03-31 14:51:06.876] [E/9] [info] [Task Finished] Transform to mem in 0.282676s (11098 normal rows, 43603 exceptions)
[2021-03-31 14:51:06.877] [E/15] [info] [Task Finished] Transform to mem in 0.282777s (11076 normal rows, 43212 exceptions)
[2021-03-31 14:51:06.878] [E/8] [info] [Task Finished] Transform to mem in 0.283801s (11127 normal rows, 43028 exceptions)
[2021-03-31 14:51:06.878] [E/14] [info] [Task Finished] Transform to mem in 0.283207s (10987 normal rows, 43041 exceptions)
[2021-03-31 14:51:06.884] [E/13] [info] [Task Finished] Transform to mem in 0.282488s (11004 normal rows, 42913 exceptions)
[2021-03-31 14:51:06.886] [driver] [info] [Task Finished] Transform to mem in 0.284399s (11026 normal rows, 43037 exceptions)
[2021-03-31 14:51:06.890] [E/11] [info] [Task Finished] Transform to mem in 0.286892s (11012 normal rows, 42883 exceptions)
[2021-03-31 14:51:07.152] [E/5] [info] [Task Finished] Transform to mem in 0.278255s (11073 normal rows, 42820 exceptions)
[2021-03-31 14:51:07.154] [E/10] [info] [Task Finished] Transform to mem in 0.279017s (11076 normal rows, 43152 exceptions)
[2021-03-31 14:51:07.154] [E/2] [info] [Task Finished] Transform to mem in 0.278922s (10976 normal rows, 43110 exceptions)
[2021-03-31 14:51:07.154] [E/6] [info] [Task Finished] Transform to mem in 0.279220s (11130 normal rows, 43084 exceptions)
[2021-03-31 14:51:07.154] [E/1] [info] [Task Finished] Transform to mem in 0.279094s (11015 normal rows, 42966 exceptions)
[2021-03-31 14:51:07.154] [E/7] [info] [Task Finished] Transform to mem in 0.279463s (11095 normal rows, 43503 exceptions)
[2021-03-31 14:51:07.155] [E/4] [info] [Task Finished] Transform to mem in 0.279163s (11012 normal rows, 42888 exceptions)
[2021-03-31 14:51:07.155] [E/12] [info] [Task Finished] Transform to mem in 0.279275s (11026 normal rows, 43035 exceptions)
[2021-03-31 14:51:07.155] [E/3] [info] [Task Finished] Transform to mem in 0.279078s (11073 normal rows, 42754 exceptions)
[2021-03-31 14:51:07.156] [E/9] [info] [Task Finished] Transform to mem in 0.279543s (11095 normal rows, 43552 exceptions)
[2021-03-31 14:51:07.157] [E/15] [info] [Task Finished] Transform to mem in 0.279804s (11130 normal rows, 43033 exceptions)
[2021-03-31 14:51:07.158] [E/14] [info] [Task Finished] Transform to mem in 0.279707s (10974 normal rows, 43172 exceptions)
[2021-03-31 14:51:07.158] [E/8] [info] [Task Finished] Transform to mem in 0.279915s (11069 normal rows, 43142 exceptions)
[2021-03-31 14:51:07.163] [E/13] [info] [Task Finished] Transform to mem in 0.279118s (11008 normal rows, 42964 exceptions)
[2021-03-31 14:51:07.167] [driver] [info] [Task Finished] Transform to mem in 0.280259s (11042 normal rows, 43023 exceptions)
[2021-03-31 14:51:07.174] [E/11] [info] [Task Finished] Transform to mem in 0.283929s (11012 normal rows, 42911 exceptions)
[2021-03-31 14:51:07.431] [E/5] [info] [Task Finished] Transform to mem in 0.278520s (11063 normal rows, 42726 exceptions)
[2021-03-31 14:51:07.433] [E/1] [info] [Task Finished] Transform to mem in 0.278837s (11005 normal rows, 43164 exceptions)
[2021-03-31 14:51:07.433] [E/6] [info] [Task Finished] Transform to mem in 0.279034s (11087 normal rows, 43150 exceptions)
[2021-03-31 14:51:07.433] [E/2] [info] [Task Finished] Transform to mem in 0.279365s (11081 normal rows, 43050 exceptions)
[2021-03-31 14:51:07.434] [E/10] [info] [Task Finished] Transform to mem in 0.279476s (11105 normal rows, 43555 exceptions)
[2021-03-31 14:51:07.434] [E/7] [info] [Task Finished] Transform to mem in 0.279294s (11008 normal rows, 42975 exceptions)
[2021-03-31 14:51:07.434] [E/12] [info] [Task Finished] Transform to mem in 0.278881s (11002 normal rows, 42964 exceptions)
[2021-03-31 14:51:07.434] [E/4] [info] [Task Finished] Transform to mem in 0.279073s (11042 normal rows, 42959 exceptions)
[2021-03-31 14:51:07.434] [E/3] [info] [Task Finished] Transform to mem in 0.278920s (11073 normal rows, 42720 exceptions)
[2021-03-31 14:51:07.435] [E/9] [info] [Task Finished] Transform to mem in 0.279601s (11088 normal rows, 43511 exceptions)
[2021-03-31 14:51:07.437] [E/15] [info] [Task Finished] Transform to mem in 0.279434s (11098 normal rows, 43112 exceptions)
[2021-03-31 14:51:07.437] [E/8] [info] [Task Finished] Transform to mem in 0.279523s (11005 normal rows, 43229 exceptions)
[2021-03-31 14:51:07.438] [E/14] [info] [Task Finished] Transform to mem in 0.279865s (11087 normal rows, 43044 exceptions)
[2021-03-31 14:51:07.442] [E/13] [info] [Task Finished] Transform to mem in 0.279458s (11008 normal rows, 43017 exceptions)
[2021-03-31 14:51:07.446] [driver] [info] [Task Finished] Transform to mem in 0.279643s (11024 normal rows, 42947 exceptions)
[2021-03-31 14:51:07.458] [E/11] [info] [Task Finished] Transform to mem in 0.283826s (11020 normal rows, 42976 exceptions)
[2021-03-31 14:51:07.709] [E/5] [info] [Task Finished] Transform to mem in 0.278244s (11036 normal rows, 42710 exceptions)
[2021-03-31 14:51:07.712] [E/1] [info] [Task Finished] Transform to mem in 0.279095s (11125 normal rows, 43517 exceptions)
[2021-03-31 14:51:07.712] [E/10] [info] [Task Finished] Transform to mem in 0.278757s (10985 normal rows, 43336 exceptions)
[2021-03-31 14:51:07.712] [E/2] [info] [Task Finished] Transform to mem in 0.278903s (11087 normal rows, 42938 exceptions)
[2021-03-31 14:51:07.712] [E/6] [info] [Task Finished] Transform to mem in 0.279217s (11098 normal rows, 43115 exceptions)
[2021-03-31 14:51:07.713] [E/12] [info] [Task Finished] Transform to mem in 0.278925s (11052 normal rows, 42881 exceptions)
[2021-03-31 14:51:07.713] [E/3] [info] [Task Finished] Transform to mem in 0.278914s (10995 normal rows, 42708 exceptions)
[2021-03-31 14:51:07.713] [E/7] [info] [Task Finished] Transform to mem in 0.279276s (11000 normal rows, 42999 exceptions)
[2021-03-31 14:51:07.714] [E/4] [info] [Task Finished] Transform to mem in 0.279538s (11020 normal rows, 43057 exceptions)
[2021-03-31 14:51:07.715] [E/9] [info] [Task Finished] Transform to mem in 0.279425s (11166 normal rows, 43520 exceptions)
[2021-03-31 14:51:07.716] [E/15] [info] [Task Finished] Transform to mem in 0.279292s (11098 normal rows, 43075 exceptions)
[2021-03-31 14:51:07.717] [E/8] [info] [Task Finished] Transform to mem in 0.279370s (11073 normal rows, 42970 exceptions)
[2021-03-31 14:51:07.718] [E/14] [info] [Task Finished] Transform to mem in 0.280122s (10999 normal rows, 43334 exceptions)
[2021-03-31 14:51:07.722] [E/13] [info] [Task Finished] Transform to mem in 0.279729s (11000 normal rows, 43009 exceptions)
[2021-03-31 14:51:07.727] [driver] [info] [Task Finished] Transform to mem in 0.280259s (11052 normal rows, 42764 exceptions)
[2021-03-31 14:51:07.743] [E/11] [info] [Task Finished] Transform to mem in 0.284487s (11020 normal rows, 43138 exceptions)
[2021-03-31 14:51:07.987] [E/5] [info] [Task Finished] Transform to mem in 0.278150s (10995 normal rows, 42726 exceptions)
[2021-03-31 14:51:07.991] [E/10] [info] [Task Finished] Transform to mem in 0.278814s (11091 normal rows, 43047 exceptions)
[2021-03-31 14:51:07.992] [E/6] [info] [Task Finished] Transform to mem in 0.279093s (10999 normal rows, 43300 exceptions)
[2021-03-31 14:51:07.992] [E/3] [info] [Task Finished] Transform to mem in 0.278748s (11036 normal rows, 42720 exceptions)
[2021-03-31 14:51:07.992] [E/1] [info] [Task Finished] Transform to mem in 0.279513s (11166 normal rows, 43508 exceptions)
[2021-03-31 14:51:07.992] [E/12] [info] [Task Finished] Transform to mem in 0.279190s (11000 normal rows, 43043 exceptions)
[2021-03-31 14:51:07.992] [E/7] [info] [Task Finished] Transform to mem in 0.279063s (11016 normal rows, 43165 exceptions)
[2021-03-31 14:51:07.992] [E/4] [info] [Task Finished] Transform to mem in 0.278666s (10995 normal rows, 42718 exceptions)
[2021-03-31 14:51:07.995] [E/9] [info] [Task Finished] Transform to mem in 0.279728s (11186 normal rows, 43465 exceptions)
[2021-03-31 14:51:07.995] [E/15] [info] [Task Finished] Transform to mem in 0.279593s (11001 normal rows, 43113 exceptions)
[2021-03-31 14:51:07.997] [E/8] [info] [Task Finished] Transform to mem in 0.280100s (11170 normal rows, 43024 exceptions)
[2021-03-31 14:51:07.998] [E/14] [info] [Task Finished] Transform to mem in 0.279964s (10989 normal rows, 43282 exceptions)
[2021-03-31 14:51:08.002] [E/13] [info] [Task Finished] Transform to mem in 0.279478s (11010 normal rows, 43002 exceptions)
[2021-03-31 14:51:08.007] [driver] [info] [Task Finished] Transform to mem in 0.280108s (11002 normal rows, 42755 exceptions)
[2021-03-31 14:51:08.027] [E/11] [info] [Task Finished] Transform to mem in 0.284313s (11050 normal rows, 43199 exceptions)
[2021-03-31 14:51:08.041] [E/2] [info] [Task Finished] Transform to mem in 0.328211s (11080 normal rows, 43031 exceptions)
[2021-03-31 14:51:08.266] [E/5] [info] [Task Finished] Transform to mem in 0.278277s (10973 normal rows, 42686 exceptions)
[2021-03-31 14:51:08.270] [E/10] [info] [Task Finished] Transform to mem in 0.279241s (11160 normal rows, 43455 exceptions)
[2021-03-31 14:51:08.271] [E/6] [info] [Task Finished] Transform to mem in 0.279321s (11045 normal rows, 43148 exceptions)
[2021-03-31 14:51:08.271] [E/7] [info] [Task Finished] Transform to mem in 0.278966s (11007 normal rows, 42795 exceptions)
[2021-03-31 14:51:08.271] [E/1] [info] [Task Finished] Transform to mem in 0.279446s (10997 normal rows, 43283 exceptions)
[2021-03-31 14:51:08.271] [E/3] [info] [Task Finished] Transform to mem in 0.279632s (11166 normal rows, 43023 exceptions)
[2021-03-31 14:51:08.271] [E/4] [info] [Task Finished] Transform to mem in 0.279185s (11050 normal rows, 43196 exceptions)
[2021-03-31 14:51:08.272] [E/12] [info] [Task Finished] Transform to mem in 0.279611s (11005 normal rows, 42971 exceptions)
[2021-03-31 14:51:08.273] [E/9] [info] [Task Finished] Transform to mem in 0.278801s (10973 normal rows, 42686 exceptions)
[2021-03-31 14:51:08.276] [E/15] [info] [Task Finished] Transform to mem in 0.280442s (11160 normal rows, 43446 exceptions)
[2021-03-31 14:51:08.278] [E/8] [info] [Task Finished] Transform to mem in 0.280617s (11043 normal rows, 43153 exceptions)
[2021-03-31 14:51:08.278] [E/14] [info] [Task Finished] Transform to mem in 0.279766s (11168 normal rows, 43028 exceptions)
[2021-03-31 14:51:08.281] [E/13] [info] [Task Finished] Transform to mem in 0.279535s (10997 normal rows, 43277 exceptions)
[2021-03-31 14:51:08.288] [driver] [info] [Task Finished] Transform to mem in 0.280678s (10997 normal rows, 42973 exceptions)
[2021-03-31 14:51:08.311] [E/11] [info] [Task Finished] Transform to mem in 0.284486s (11015 normal rows, 42799 exceptions)
[2021-03-31 14:51:08.320] [E/2] [info] [Task Finished] Transform to mem in 0.279329s (11050 normal rows, 43170 exceptions)
[2021-03-31 14:51:08.548] [E/5] [info] [Task Finished] Transform to mem in 0.282361s (10973 normal rows, 42710 exceptions)
[2021-03-31 14:51:08.554] [E/10] [info] [Task Finished] Transform to mem in 0.283433s (11160 normal rows, 43431 exceptions)
[2021-03-31 14:51:08.554] [E/6] [info] [Task Finished] Transform to mem in 0.283264s (11043 normal rows, 43166 exceptions)
[2021-03-31 14:51:08.554] [E/1] [info] [Task Finished] Transform to mem in 0.283253s (10997 normal rows, 43237 exceptions)
[2021-03-31 14:51:08.555] [E/7] [info] [Task Finished] Transform to mem in 0.283597s (11168 normal rows, 43027 exceptions)
[2021-03-31 14:51:08.555] [E/4] [info] [Task Finished] Transform to mem in 0.283372s (11009 normal rows, 42805 exceptions)
[2021-03-31 14:51:08.555] [E/3] [info] [Task Finished] Transform to mem in 0.283729s (10997 normal rows, 43012 exceptions)
[2021-03-31 14:51:08.555] [E/12] [info] [Task Finished] Transform to mem in 0.283651s (11021 normal rows, 43160 exceptions)
[2021-03-31 14:51:08.557] [E/9] [info] [Task Finished] Transform to mem in 0.283427s (11003 normal rows, 42716 exceptions)
[2021-03-31 14:51:08.560] [E/15] [info] [Task Finished] Transform to mem in 0.283862s (11165 normal rows, 43354 exceptions)
[2021-03-31 14:51:08.562] [E/8] [info] [Task Finished] Transform to mem in 0.284187s (11043 normal rows, 43217 exceptions)
[2021-03-31 14:51:08.562] [E/14] [info] [Task Finished] Transform to mem in 0.284266s (11156 normal rows, 43044 exceptions)
[2021-03-31 14:51:08.565] [E/13] [info] [Task Finished] Transform to mem in 0.283499s (11009 normal rows, 43187 exceptions)
[2021-03-31 14:51:08.573] [driver] [info] [Task Finished] Transform to mem in 0.284971s (10997 normal rows, 43067 exceptions)
[2021-03-31 14:51:08.600] [E/11] [info] [Task Finished] Transform to mem in 0.288086s (11009 normal rows, 42811 exceptions)
[2021-03-31 14:51:08.603] [E/2] [info] [Task Finished] Transform to mem in 0.283394s (11021 normal rows, 43162 exceptions)
[2021-03-31 14:51:08.827] [E/5] [info] [Task Finished] Transform to mem in 0.278290s (11003 normal rows, 42716 exceptions)
[2021-03-31 14:51:08.833] [E/10] [info] [Task Finished] Transform to mem in 0.279033s (11165 normal rows, 43260 exceptions)
[2021-03-31 14:51:08.833] [E/6] [info] [Task Finished] Transform to mem in 0.279205s (11027 normal rows, 43245 exceptions)
[2021-03-31 14:51:08.834] [E/7] [info] [Task Finished] Transform to mem in 0.279220s (10997 normal rows, 43177 exceptions)
[2021-03-31 14:51:08.834] [E/1] [info] [Task Finished] Transform to mem in 0.279588s (11172 normal rows, 43107 exceptions)
[2021-03-31 14:51:08.834] [E/4] [info] [Task Finished] Transform to mem in 0.279451s (11009 normal rows, 43050 exceptions)
[2021-03-31 14:51:08.834] [E/3] [info] [Task Finished] Transform to mem in 0.279219s (10999 normal rows, 42828 exceptions)
[2021-03-31 14:51:08.835] [E/12] [info] [Task Finished] Transform to mem in 0.279340s (11031 normal rows, 43157 exceptions)
[2021-03-31 14:51:08.836] [E/9] [info] [Task Finished] Transform to mem in 0.278946s (11000 normal rows, 42726 exceptions)
[2021-03-31 14:51:08.840] [E/15] [info] [Task Finished] Transform to mem in 0.279766s (11091 normal rows, 43230 exceptions)
[2021-03-31 14:51:08.842] [E/8] [info] [Task Finished] Transform to mem in 0.279817s (11099 normal rows, 43272 exceptions)
[2021-03-31 14:51:08.842] [E/14] [info] [Task Finished] Transform to mem in 0.280155s (11177 normal rows, 43113 exceptions)
[2021-03-31 14:51:08.844] [E/13] [info] [Task Finished] Transform to mem in 0.279214s (10997 normal rows, 43174 exceptions)
[2021-03-31 14:51:08.853] [driver] [info] [Task Finished] Transform to mem in 0.280792s (10987 normal rows, 43020 exceptions)
[2021-03-31 14:51:08.884] [E/11] [info] [Task Finished] Transform to mem in 0.284572s (11020 normal rows, 42867 exceptions)
[2021-03-31 14:51:08.916] [E/2] [info] [Task Finished] Transform to mem in 0.312283s (12330 normal rows, 48094 exceptions)
[2021-03-31 14:51:08.916] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.88725s
[2021-03-31 14:51:08.916] [global] [info] [Transform Stage] Stage 0 total wall clock time: 45.0568s, 56350770 input rows, time to process 1 row via fast path: 0.000799578ms
[2021-03-31 14:51:08.916] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-31 14:51:08.920] [local ee] [info] compiled pure python pipeline in 0.004285s
[2021-03-31 14:51:08.920] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 14:51:08.921] [local ee] [info] Created 160 resolve tasks in 0.001205s
[2021-03-31 14:51:08.921] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 14:52:15.653] [E/4] [info] [Task Finished] Resolve in 66.731860s
[2021-03-31 14:52:19.034] [E/9] [info] [Task Finished] Resolve in 70.112919s
[2021-03-31 14:52:23.285] [E/8] [info] [Task Finished] Resolve in 74.363625s
[2021-03-31 14:52:23.421] [E/13] [info] [Task Finished] Resolve in 74.499187s
[2021-03-31 14:52:24.785] [E/15] [info] [Task Finished] Resolve in 75.863640s
[2021-03-31 14:52:25.863] [E/14] [info] [Task Finished] Resolve in 76.941543s
[2021-03-31 14:52:26.494] [E/12] [info] [Task Finished] Resolve in 77.572644s
[2021-03-31 14:52:27.203] [E/10] [info] [Task Finished] Resolve in 78.281096s
[2021-03-31 14:52:27.419] [E/1] [info] [Task Finished] Resolve in 78.497396s
[2021-03-31 14:52:27.536] [E/5] [info] [Task Finished] Resolve in 78.614697s
[2021-03-31 14:52:27.714] [E/6] [info] [Task Finished] Resolve in 78.792183s
[2021-03-31 14:52:29.598] [E/11] [info] [Task Finished] Resolve in 80.677069s
[2021-03-31 14:52:29.834] [driver] [info] [Task Finished] Resolve in 80.912655s
[2021-03-31 14:52:32.652] [E/2] [info] [Task Finished] Resolve in 83.730347s
[2021-03-31 14:52:35.314] [E/3] [info] [Task Finished] Resolve in 86.392190s
[2021-03-31 14:52:38.862] [E/7] [info] [Task Finished] Resolve in 89.940524s
[2021-03-31 14:53:21.959] [E/4] [info] [Task Finished] Resolve in 66.305653s
[2021-03-31 14:53:28.744] [E/6] [info] [Task Finished] Resolve in 61.030309s
[2021-03-31 14:53:35.346] [E/11] [info] [Task Finished] Resolve in 65.747244s
[2021-03-31 14:53:35.631] [E/15] [info] [Task Finished] Resolve in 70.845519s
[2021-03-31 14:53:36.468] [E/1] [info] [Task Finished] Resolve in 69.049595s
[2021-03-31 14:53:36.691] [E/5] [info] [Task Finished] Resolve in 69.154776s
[2021-03-31 14:53:40.035] [E/12] [info] [Task Finished] Resolve in 73.540676s
[2021-03-31 14:53:41.746] [E/9] [info] [Task Finished] Resolve in 82.711646s
[2021-03-31 14:53:42.211] [E/8] [info] [Task Finished] Resolve in 78.925738s
[2021-03-31 14:53:44.744] [E/10] [info] [Task Finished] Resolve in 77.541631s
[2021-03-31 14:53:46.569] [E/13] [info] [Task Finished] Resolve in 83.148830s
[2021-03-31 14:53:56.013] [driver] [info] [Task Finished] Resolve in 86.178579s
[2021-03-31 14:53:57.495] [E/2] [info] [Task Finished] Resolve in 84.843685s
[2021-03-31 14:53:59.157] [E/14] [info] [Task Finished] Resolve in 93.293695s
[2021-03-31 14:54:02.441] [E/7] [info] [Task Finished] Resolve in 83.579319s
[2021-03-31 14:54:04.653] [E/3] [info] [Task Finished] Resolve in 89.339277s
[2021-03-31 14:54:45.990] [E/4] [info] [Task Finished] Resolve in 84.030782s
[2021-03-31 14:54:46.730] [E/5] [info] [Task Finished] Resolve in 70.038979s
[2021-03-31 14:54:47.667] [E/8] [info] [Task Finished] Resolve in 65.456001s
[2021-03-31 14:54:49.669] [E/1] [info] [Task Finished] Resolve in 73.200859s
[2021-03-31 14:54:50.538] [E/6] [info] [Task Finished] Resolve in 81.794241s
[2021-03-31 14:54:56.464] [E/11] [info] [Task Finished] Resolve in 81.118686s
[2021-03-31 14:54:57.552] [E/12] [info] [Task Finished] Resolve in 77.517400s
[2021-03-31 14:54:59.317] [E/2] [info] [Task Finished] Resolve in 61.821214s
[2021-03-31 14:55:03.484] [E/9] [info] [Task Finished] Resolve in 81.738126s
[2021-03-31 14:55:03.798] [E/15] [info] [Task Finished] Resolve in 88.167705s
[2021-03-31 14:55:04.481] [E/10] [info] [Task Finished] Resolve in 79.736914s
[2021-03-31 14:55:06.558] [E/14] [info] [Task Finished] Resolve in 67.401622s
[2021-03-31 14:55:13.454] [driver] [info] [Task Finished] Resolve in 77.441313s
[2021-03-31 14:55:18.332] [E/13] [info] [Task Finished] Resolve in 91.762379s
[2021-03-31 14:55:23.644] [E/7] [info] [Task Finished] Resolve in 81.202374s
[2021-03-31 14:55:32.680] [E/3] [info] [Task Finished] Resolve in 88.027458s
[2021-03-31 14:55:52.484] [E/11] [info] [Task Finished] Resolve in 56.019649s
[2021-03-31 14:55:59.336] [E/6] [info] [Task Finished] Resolve in 68.797499s
[2021-03-31 14:56:02.379] [E/4] [info] [Task Finished] Resolve in 76.388868s
[2021-03-31 14:56:06.825] [E/5] [info] [Task Finished] Resolve in 80.095456s
[2021-03-31 14:56:07.406] [E/8] [info] [Task Finished] Resolve in 79.739295s
[2021-03-31 14:56:10.370] [E/12] [info] [Task Finished] Resolve in 72.817399s
[2021-03-31 14:56:15.787] [E/1] [info] [Task Finished] Resolve in 86.118161s
[2021-03-31 14:56:17.423] [E/2] [info] [Task Finished] Resolve in 78.106596s
[2021-03-31 14:56:21.512] [E/9] [info] [Task Finished] Resolve in 78.027801s
[2021-03-31 14:56:21.772] [E/10] [info] [Task Finished] Resolve in 77.291266s
[2021-03-31 14:56:22.588] [E/15] [info] [Task Finished] Resolve in 78.790057s
[2021-03-31 14:56:30.710] [driver] [info] [Task Finished] Resolve in 77.255753s
[2021-03-31 14:56:38.120] [E/13] [info] [Task Finished] Resolve in 79.787707s
[2021-03-31 14:56:39.647] [E/14] [info] [Task Finished] Resolve in 93.088433s
[2021-03-31 14:56:44.704] [E/7] [info] [Task Finished] Resolve in 81.060425s
[2021-03-31 14:56:54.628] [E/3] [info] [Task Finished] Resolve in 81.947585s
[2021-03-31 14:56:55.426] [E/11] [info] [Task Finished] Resolve in 62.942160s
[2021-03-31 14:57:07.578] [E/5] [info] [Task Finished] Resolve in 60.752428s
[2021-03-31 14:57:12.965] [E/4] [info] [Task Finished] Resolve in 70.586206s
[2021-03-31 14:57:17.321] [E/6] [info] [Task Finished] Resolve in 77.984904s
[2021-03-31 14:57:17.499] [E/1] [info] [Task Finished] Resolve in 61.711391s
[2021-03-31 14:57:24.737] [E/12] [info] [Task Finished] Resolve in 74.367486s
[2021-03-31 14:57:31.682] [driver] [info] [Task Finished] Resolve in 60.971804s
[2021-03-31 14:57:37.157] [E/2] [info] [Task Finished] Resolve in 79.733999s
[2021-03-31 14:57:38.958] [E/10] [info] [Task Finished] Resolve in 77.185404s
[2021-03-31 14:57:40.840] [E/9] [info] [Task Finished] Resolve in 79.328136s
[2021-03-31 14:57:50.169] [E/8] [info] [Task Finished] Resolve in 102.762803s
[2021-03-31 14:57:54.563] [E/7] [info] [Task Finished] Resolve in 69.859273s
[2021-03-31 14:57:56.033] [E/11] [info] [Task Finished] Resolve in 60.606690s
[2021-03-31 14:58:00.486] [E/14] [info] [Task Finished] Resolve in 80.839265s
[2021-03-31 14:58:05.619] [E/15] [info] [Task Finished] Resolve in 103.030344s
[2021-03-31 14:58:18.683] [E/6] [info] [Task Finished] Resolve in 61.362217s
[2021-03-31 14:58:20.606] [E/13] [info] [Task Finished] Resolve in 102.486580s
[2021-03-31 14:58:28.051] [E/1] [info] [Task Finished] Resolve in 70.551611s
[2021-03-31 14:58:28.465] [E/5] [info] [Task Finished] Resolve in 80.887053s
[2021-03-31 14:58:31.205] [E/3] [info] [Task Finished] Resolve in 96.576923s
[2021-03-31 14:58:39.833] [E/4] [info] [Task Finished] Resolve in 86.868246s
[2021-03-31 14:58:42.982] [E/12] [info] [Task Finished] Resolve in 78.244370s
[2021-03-31 14:58:53.370] [driver] [info] [Task Finished] Resolve in 81.688039s
[2021-03-31 14:58:56.883] [E/2] [info] [Task Finished] Resolve in 79.725649s
[2021-03-31 14:58:58.362] [E/8] [info] [Task Finished] Resolve in 68.192655s
[2021-03-31 14:59:03.839] [E/10] [info] [Task Finished] Resolve in 84.881365s
[2021-03-31 14:59:04.918] [E/7] [info] [Task Finished] Resolve in 70.354139s
[2021-03-31 14:59:09.150] [E/9] [info] [Task Finished] Resolve in 88.309666s
[2021-03-31 14:59:09.204] [E/11] [info] [Task Finished] Resolve in 73.170644s
[2021-03-31 14:59:21.615] [E/14] [info] [Task Finished] Resolve in 81.129326s
[2021-03-31 14:59:24.314] [E/15] [info] [Task Finished] Resolve in 78.695405s
[2021-03-31 14:59:29.709] [E/13] [info] [Task Finished] Resolve in 69.102937s
[2021-03-31 14:59:36.055] [E/1] [info] [Task Finished] Resolve in 68.004104s
[2021-03-31 14:59:36.165] [E/6] [info] [Task Finished] Resolve in 77.481763s
[2021-03-31 14:59:38.052] [E/5] [info] [Task Finished] Resolve in 69.586834s
[2021-03-31 14:59:48.833] [E/3] [info] [Task Finished] Resolve in 77.628033s
[2021-03-31 14:59:59.646] [driver] [info] [Task Finished] Resolve in 66.275811s
[2021-03-31 15:00:06.054] [E/12] [info] [Task Finished] Resolve in 83.072064s
[2021-03-31 15:00:14.915] [E/11] [info] [Task Finished] Resolve in 65.710963s
[2021-03-31 15:00:17.696] [E/8] [info] [Task Finished] Resolve in 79.334679s
[2021-03-31 15:00:19.229] [E/4] [info] [Task Finished] Resolve in 99.396120s
[2021-03-31 15:00:19.625] [E/10] [info] [Task Finished] Resolve in 75.786023s
[2021-03-31 15:00:20.865] [E/2] [info] [Task Finished] Resolve in 83.981431s
[2021-03-31 15:00:23.035] [E/7] [info] [Task Finished] Resolve in 78.117846s
[2021-03-31 15:00:38.393] [E/14] [info] [Task Finished] Resolve in 76.777246s
[2021-03-31 15:00:40.045] [E/9] [info] [Task Finished] Resolve in 90.895598s
[2021-03-31 15:00:47.380] [E/6] [info] [Task Finished] Resolve in 71.215008s
[2021-03-31 15:00:52.534] [E/15] [info] [Task Finished] Resolve in 88.219863s
[2021-03-31 15:00:56.168] [E/1] [info] [Task Finished] Resolve in 80.112984s
[2021-03-31 15:00:56.429] [E/13] [info] [Task Finished] Resolve in 86.720086s
[2021-03-31 15:00:59.949] [E/5] [info] [Task Finished] Resolve in 81.896757s
[2021-03-31 15:01:15.304] [E/11] [info] [Task Finished] Resolve in 60.388911s
[2021-03-31 15:01:19.982] [E/12] [info] [Task Finished] Resolve in 73.928787s
[2021-03-31 15:01:20.382] [E/3] [info] [Task Finished] Resolve in 91.548715s
[2021-03-31 15:01:22.342] [E/8] [info] [Task Finished] Resolve in 64.645270s
[2021-03-31 15:01:22.713] [driver] [info] [Task Finished] Resolve in 83.067405s
[2021-03-31 15:01:25.086] [E/4] [info] [Task Finished] Resolve in 65.856166s
[2021-03-31 15:01:31.427] [E/10] [info] [Task Finished] Resolve in 71.801257s
[2021-03-31 15:01:31.837] [E/2] [info] [Task Finished] Resolve in 70.972266s
[2021-03-31 15:01:41.110] [E/7] [info] [Task Finished] Resolve in 78.074648s
[2021-03-31 15:01:47.038] [E/9] [info] [Task Finished] Resolve in 66.992589s
[2021-03-31 15:01:52.223] [E/14] [info] [Task Finished] Resolve in 73.830166s
[2021-03-31 15:02:04.440] [E/13] [info] [Task Finished] Resolve in 68.011036s
[2021-03-31 15:02:10.683] [E/1] [info] [Task Finished] Resolve in 74.515210s
[2021-03-31 15:02:13.613] [E/6] [info] [Task Finished] Resolve in 86.232959s
[2021-03-31 15:02:16.946] [E/5] [info] [Task Finished] Resolve in 76.996950s
[2021-03-31 15:02:21.323] [E/15] [info] [Task Finished] Resolve in 88.788768s
[2021-03-31 15:02:24.051] [driver] [info] [Task Finished] Resolve in 61.337459s
[2021-03-31 15:02:34.870] [E/11] [info] [Task Finished] Resolve in 79.566520s
[2021-03-31 15:02:43.743] [E/4] [info] [Task Finished] Resolve in 78.657588s
[2021-03-31 15:02:46.407] [E/2] [info] [Task Finished] Resolve in 74.569663s
[2021-03-31 15:02:46.899] [E/12] [info] [Task Finished] Resolve in 86.916942s
[2021-03-31 15:02:47.618] [E/10] [info] [Task Finished] Resolve in 76.191128s
[2021-03-31 15:02:48.346] [E/8] [info] [Task Finished] Resolve in 86.004336s
[2021-03-31 15:02:58.609] [E/3] [info] [Task Finished] Resolve in 98.226908s
[2021-03-31 15:03:08.172] [E/7] [info] [Task Finished] Resolve in 87.061815s
[2021-03-31 15:03:20.701] [E/9] [info] [Task Finished] Resolve in 93.663254s
[2021-03-31 15:03:21.765] [E/14] [info] [Task Finished] Resolve in 89.541667s
[2021-03-31 15:03:27.228] [E/1] [info] [Task Finished] Resolve in 76.544661s
[2021-03-31 15:03:30.789] [E/13] [info] [Task Finished] Resolve in 86.348830s
[2021-03-31 15:03:31.258] [E/6] [info] [Task Finished] Resolve in 77.644782s
[2021-03-31 15:03:33.868] [E/5] [info] [Task Finished] Resolve in 76.922842s
[2021-03-31 15:03:35.311] [E/11] [info] [Task Finished] Resolve in 60.440495s
[2021-03-31 15:03:35.542] [driver] [info] [Task Finished] Resolve in 71.491123s
[2021-03-31 15:03:36.862] [E/15] [info] [Task Finished] Resolve in 75.539538s
[2021-03-31 15:03:46.487] [E/10] [info] [Task Finished] Resolve in 58.869742s
[2021-03-31 15:03:48.795] [E/8] [info] [Task Finished] Resolve in 60.448742s
[2021-03-31 15:03:49.779] [E/2] [info] [Task Finished] Resolve in 63.372247s
[2021-03-31 15:03:53.032] [E/12] [info] [Task Finished] Resolve in 66.132222s
[2021-03-31 15:03:56.062] [E/3] [info] [Task Finished] Resolve in 57.452763s
[2021-03-31 15:03:57.578] [E/4] [info] [Task Finished] Resolve in 73.834827s
[2021-03-31 15:04:02.386] [E/9] [info] [Task Finished] Resolve in 41.684445s
[2021-03-31 15:04:02.994] [E/7] [info] [Task Finished] Resolve in 54.821524s
[2021-03-31 15:04:05.087] [E/1] [info] [Task Finished] Resolve in 37.859338s
[2021-03-31 15:04:05.382] [E/13] [info] [Task Finished] Resolve in 34.592875s
[2021-03-31 15:04:05.487] [E/14] [info] [Task Finished] Resolve in 43.721986s
[2021-03-31 15:04:05.487] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 776.571s
[2021-03-31 15:04:05.487] [local ee] [info] slow path for Stage 0: total wall clock time: 12183.2s, time to process 1 row via slow path: 1.76672ms
[2021-03-31 15:04:05.487] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 776.571s

[2021-03-31 15:04:05.515] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-31 15:04:05.530] [E/13] [info] [Task Finished] write to file in 0.014250s (46082 rows, 7.01 MB)
[2021-03-31 15:04:05.548] [E/14] [info] [Task Finished] write to file in 0.033043s (112425 rows, 17.10 MB)
[2021-03-31 15:04:05.549] [E/2] [info] [Task Finished] write to file in 0.033142s (112459 rows, 17.11 MB)
[2021-03-31 15:04:05.549] [E/15] [info] [Task Finished] write to file in 0.033224s (112482 rows, 17.11 MB)
[2021-03-31 15:04:05.549] [E/6] [info] [Task Finished] write to file in 0.033324s (112573 rows, 17.12 MB)
[2021-03-31 15:04:05.549] [E/8] [info] [Task Finished] write to file in 0.033365s (112438 rows, 17.10 MB)
[2021-03-31 15:04:05.549] [E/11] [info] [Task Finished] write to file in 0.033480s (112421 rows, 17.10 MB)
[2021-03-31 15:04:05.549] [E/4] [info] [Task Finished] write to file in 0.033538s (112467 rows, 17.11 MB)
[2021-03-31 15:04:05.549] [E/12] [info] [Task Finished] write to file in 0.033595s (112583 rows, 17.13 MB)
[2021-03-31 15:04:05.550] [E/3] [info] [Task Finished] write to file in 0.034898s (123410 rows, 18.78 MB)
[2021-03-31 15:04:05.550] [E/10] [info] [Task Finished] write to file in 0.034892s (123424 rows, 18.78 MB)
[2021-03-31 15:04:05.550] [E/5] [info] [Task Finished] write to file in 0.034925s (123389 rows, 18.77 MB)
[2021-03-31 15:04:05.550] [E/7] [info] [Task Finished] write to file in 0.034958s (123377 rows, 18.77 MB)
[2021-03-31 15:04:05.550] [E/9] [info] [Task Finished] write to file in 0.034971s (123251 rows, 18.75 MB)
[2021-03-31 15:04:05.551] [driver] [info] [Task Finished] write to file in 0.035190s (123299 rows, 18.76 MB)
[2021-03-31 15:04:05.552] [E/1] [info] [Task Finished] write to file in 0.036640s (112411 rows, 17.10 MB)
[2021-03-31 15:04:05.552] [global] [info] writing output took 0.065227s
[2021-03-31 15:04:05.552] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.065317s
[2021-03-31 15:04:05.552] [global] [info] [Transform Stage] Stage 0 took 780.024s
[2021-03-31 15:04:05.552] [global] [info] Query Execution took 780.103s. (planning: 0.0790486s, execution: 780.024s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 12:55:20) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005404472351074219
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 780.3884348869324 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '499bbd619a75', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0226846,"llvm_optimization_time_s":0.331494,"llvm_compilation_time_s":0.151466,"total_compilation_time_s":0.500583,"sampling_time_s":0.1119,"stages":[{"stage_no":0,"fast_path_wall_time_s":45.0568,"fast_path_time_s":2.88727,"fast_path_per_row_time_ns":799.578,"slow_path_wall_time_s":12183.2,"slow_path_time_s":776.571,"slow_path_per_row_time_ns":1.76672e+06}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.005404472351074219, "jobTime": 780.3884348869324, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-31 15:04:13.846] [local execution engine] [info] Stopped local executor E/1
[2021-03-31 15:04:13.851] [local execution engine] [info] Stopped local executor E/2
[2021-03-31 15:04:13.857] [local execution engine] [info] Stopped local executor E/3
[2021-03-31 15:04:13.862] [local execution engine] [info] Stopped local executor E/4
[2021-03-31 15:04:13.867] [local execution engine] [info] Stopped local executor E/5
[2021-03-31 15:04:13.872] [local execution engine] [info] Stopped local executor E/6
[2021-03-31 15:04:13.877] [local execution engine] [info] Stopped local executor E/7
[2021-03-31 15:04:13.882] [local execution engine] [info] Stopped local executor E/8
[2021-03-31 15:04:13.887] [local execution engine] [info] Stopped local executor E/9
[2021-03-31 15:04:13.893] [local execution engine] [info] Stopped local executor E/10
[2021-03-31 15:04:13.897] [local execution engine] [info] Stopped local executor E/11
[2021-03-31 15:04:13.902] [local execution engine] [info] Stopped local executor E/12
[2021-03-31 15:04:13.907] [local execution engine] [info] Stopped local executor E/13
[2021-03-31 15:04:13.912] [local execution engine] [info] Stopped local executor E/14
[2021-03-31 15:04:13.917] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
