[2021-03-31 15:17:27.240] [global] [error] could not find backend, defaulting to local
[2021-03-31 15:17:27.240] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 15:17:27.240] [local ee] [info] initializing LLVM backend
[2021-03-31 15:17:27.240] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 15:17:27.240] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.241] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/1] [info] starting detached process queue
[2021-03-31 15:17:27.242] [E/2] [info] starting detached process queue
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [E/3] [info] starting detached process queue
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/4] [info] starting detached process queue
[2021-03-31 15:17:27.242] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [E/5] [info] starting detached process queue
[2021-03-31 15:17:27.242] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/6] [info] starting detached process queue
[2021-03-31 15:17:27.242] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [E/7] [info] starting detached process queue
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/8] [info] starting detached process queue
[2021-03-31 15:17:27.242] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [E/9] [info] starting detached process queue
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [E/10] [info] starting detached process queue
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [E/11] [info] starting detached process queue
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/12] [info] starting detached process queue
[2021-03-31 15:17:27.242] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/13] [info] starting detached process queue
[2021-03-31 15:17:27.242] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [E/14] [info] starting detached process queue
[2021-03-31 15:17:27.242] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:17:27.242] [E/15] [info] starting detached process queue
[2021-03-31 15:17:27.242] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 15:17:27.242] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 15:17:27.242] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:17:27.242] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 15:17:27.243] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-31 15:17:27.377] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:17:27.383] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:17:27.399] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:17:27.407] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:17:27.434] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:17:27.455] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:17:27.469] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:17:27.501] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:17:27.507] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:17:27.524] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:17:27.525] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:17:27.527] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:17:27.527] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:17:27.529] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:17:27.530] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:17:27.530] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:17:27.532] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:17:27.533] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:17:27.533] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:17:27.550] [logical planner] [info] logical optimization took 0.022607ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 15:17:27.550] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 15:17:27.551] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 15:17:27.552] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 15:17:27.552] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 15:17:27.553] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 15:17:27.553] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 15:17:27.554] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 15:17:27.555] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 15:17:27.556] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 15:17:27.557] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 15:17:27.557] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 15:17:27.559] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:17:27.559] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:17:27.560] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 15:17:27.562] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 15:17:27.562] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 15:17:27.563] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 15:17:27.564] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 15:17:27.564] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 15:17:27.565] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 15:17:27.565] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 15:17:27.566] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 15:17:27.567] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 15:17:27.568] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 15:17:27.569] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 15:17:27.570] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 15:17:27.571] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:17:27.571] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:17:27.572] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 15:17:27.603] [global] [info] Stage0 depends on: 
[2021-03-31 15:17:27.953] [global] [info] Optimization via LLVM passes took 0.332418 ms
[2021-03-31 15:17:28.105] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-31 15:17:28.105] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.502158s
[2021-03-31 15:17:28.106] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-31 15:17:28.389] [E/11] [info] [Task Finished] Transform to mem in 0.282704s (11026 normal rows, 43206 exceptions)
[2021-03-31 15:17:28.389] [E/12] [info] [Task Finished] Transform to mem in 0.282750s (11036 normal rows, 43139 exceptions)
[2021-03-31 15:17:28.389] [E/9] [info] [Task Finished] Transform to mem in 0.283029s (10997 normal rows, 42873 exceptions)
[2021-03-31 15:17:28.389] [E/15] [info] [Task Finished] Transform to mem in 0.283572s (11005 normal rows, 42741 exceptions)
[2021-03-31 15:17:28.389] [E/5] [info] [Task Finished] Transform to mem in 0.283583s (11073 normal rows, 43414 exceptions)
[2021-03-31 15:17:28.390] [E/10] [info] [Task Finished] Transform to mem in 0.283739s (11008 normal rows, 43077 exceptions)
[2021-03-31 15:17:28.390] [E/2] [info] [Task Finished] Transform to mem in 0.283874s (10987 normal rows, 43113 exceptions)
[2021-03-31 15:17:28.390] [E/6] [info] [Task Finished] Transform to mem in 0.283910s (11086 normal rows, 43015 exceptions)
[2021-03-31 15:17:28.390] [E/14] [info] [Task Finished] Transform to mem in 0.284150s (10997 normal rows, 42910 exceptions)
[2021-03-31 15:17:28.390] [E/3] [info] [Task Finished] Transform to mem in 0.284570s (11005 normal rows, 42744 exceptions)
[2021-03-31 15:17:28.391] [E/7] [info] [Task Finished] Transform to mem in 0.284810s (11092 normal rows, 43495 exceptions)
[2021-03-31 15:17:28.391] [E/1] [info] [Task Finished] Transform to mem in 0.285453s (11036 normal rows, 43142 exceptions)
[2021-03-31 15:17:28.391] [E/8] [info] [Task Finished] Transform to mem in 0.285479s (11153 normal rows, 42970 exceptions)
[2021-03-31 15:17:28.394] [E/13] [info] [Task Finished] Transform to mem in 0.288170s (11153 normal rows, 42968 exceptions)
[2021-03-31 15:17:28.403] [driver] [info] [Task Finished] Transform to mem in 0.296668s (11047 normal rows, 43210 exceptions)
[2021-03-31 15:17:28.410] [E/4] [info] [Task Finished] Transform to mem in 0.303792s (11105 normal rows, 43095 exceptions)
[2021-03-31 15:17:28.668] [E/11] [info] [Task Finished] Transform to mem in 0.278980s (11086 normal rows, 42996 exceptions)
[2021-03-31 15:17:28.668] [E/12] [info] [Task Finished] Transform to mem in 0.279328s (11092 normal rows, 43505 exceptions)
[2021-03-31 15:17:28.668] [E/9] [info] [Task Finished] Transform to mem in 0.279539s (11153 normal rows, 42978 exceptions)
[2021-03-31 15:17:28.669] [E/6] [info] [Task Finished] Transform to mem in 0.278804s (11005 normal rows, 42772 exceptions)
[2021-03-31 15:17:28.669] [E/5] [info] [Task Finished] Transform to mem in 0.279160s (10982 normal rows, 43059 exceptions)
[2021-03-31 15:17:28.669] [E/10] [info] [Task Finished] Transform to mem in 0.279125s (11023 normal rows, 42910 exceptions)
[2021-03-31 15:17:28.669] [E/2] [info] [Task Finished] Transform to mem in 0.279054s (11036 normal rows, 43115 exceptions)
[2021-03-31 15:17:28.669] [E/14] [info] [Task Finished] Transform to mem in 0.279370s (11086 normal rows, 42970 exceptions)
[2021-03-31 15:17:28.670] [E/15] [info] [Task Finished] Transform to mem in 0.280924s (11026 normal rows, 43205 exceptions)
[2021-03-31 15:17:28.671] [E/1] [info] [Task Finished] Transform to mem in 0.279290s (11076 normal rows, 43220 exceptions)
[2021-03-31 15:17:28.671] [E/7] [info] [Task Finished] Transform to mem in 0.280456s (11111 normal rows, 42961 exceptions)
[2021-03-31 15:17:28.673] [E/3] [info] [Task Finished] Transform to mem in 0.282784s (11079 normal rows, 43539 exceptions)
[2021-03-31 15:17:28.673] [E/8] [info] [Task Finished] Transform to mem in 0.281960s (10987 normal rows, 43068 exceptions)
[2021-03-31 15:17:28.675] [E/13] [info] [Task Finished] Transform to mem in 0.280854s (11023 normal rows, 42880 exceptions)
[2021-03-31 15:17:28.682] [driver] [info] [Task Finished] Transform to mem in 0.279913s (11036 normal rows, 43053 exceptions)
[2021-03-31 15:17:28.691] [E/4] [info] [Task Finished] Transform to mem in 0.281433s (10992 normal rows, 42864 exceptions)
[2021-03-31 15:17:28.948] [E/6] [info] [Task Finished] Transform to mem in 0.278997s (11076 normal rows, 43221 exceptions)
[2021-03-31 15:17:28.948] [E/10] [info] [Task Finished] Transform to mem in 0.279194s (11004 normal rows, 42876 exceptions)
[2021-03-31 15:17:28.948] [E/11] [info] [Task Finished] Transform to mem in 0.280357s (11099 normal rows, 42882 exceptions)
[2021-03-31 15:17:28.948] [E/9] [info] [Task Finished] Transform to mem in 0.279659s (11127 normal rows, 42969 exceptions)
[2021-03-31 15:17:28.948] [E/12] [info] [Task Finished] Transform to mem in 0.280139s (11063 normal rows, 43617 exceptions)
[2021-03-31 15:17:28.949] [E/5] [info] [Task Finished] Transform to mem in 0.280555s (10987 normal rows, 43063 exceptions)
[2021-03-31 15:17:28.949] [E/14] [info] [Task Finished] Transform to mem in 0.280042s (11021 normal rows, 42887 exceptions)
[2021-03-31 15:17:28.950] [E/2] [info] [Task Finished] Transform to mem in 0.280687s (11026 normal rows, 43041 exceptions)
[2021-03-31 15:17:28.951] [E/7] [info] [Task Finished] Transform to mem in 0.279507s (11127 normal rows, 43028 exceptions)
[2021-03-31 15:17:28.951] [E/15] [info] [Task Finished] Transform to mem in 0.280474s (11064 normal rows, 42832 exceptions)
[2021-03-31 15:17:28.951] [E/1] [info] [Task Finished] Transform to mem in 0.280233s (11098 normal rows, 43603 exceptions)
[2021-03-31 15:17:28.953] [E/8] [info] [Task Finished] Transform to mem in 0.279818s (10987 normal rows, 43041 exceptions)
[2021-03-31 15:17:28.953] [E/3] [info] [Task Finished] Transform to mem in 0.280071s (11076 normal rows, 43212 exceptions)
[2021-03-31 15:17:28.956] [E/13] [info] [Task Finished] Transform to mem in 0.280788s (11004 normal rows, 42913 exceptions)
[2021-03-31 15:17:28.963] [driver] [info] [Task Finished] Transform to mem in 0.280564s (11026 normal rows, 43037 exceptions)
[2021-03-31 15:17:28.973] [E/4] [info] [Task Finished] Transform to mem in 0.281880s (11012 normal rows, 42883 exceptions)
[2021-03-31 15:17:29.228] [E/9] [info] [Task Finished] Transform to mem in 0.279655s (11076 normal rows, 43152 exceptions)
[2021-03-31 15:17:29.228] [E/5] [info] [Task Finished] Transform to mem in 0.278773s (11015 normal rows, 42966 exceptions)
[2021-03-31 15:17:29.228] [E/6] [info] [Task Finished] Transform to mem in 0.280718s (11073 normal rows, 42820 exceptions)
[2021-03-31 15:17:29.229] [E/10] [info] [Task Finished] Transform to mem in 0.280545s (11095 normal rows, 43503 exceptions)
[2021-03-31 15:17:29.229] [E/12] [info] [Task Finished] Transform to mem in 0.280543s (10976 normal rows, 43110 exceptions)
[2021-03-31 15:17:29.229] [E/11] [info] [Task Finished] Transform to mem in 0.280991s (11130 normal rows, 43084 exceptions)
[2021-03-31 15:17:29.229] [E/2] [info] [Task Finished] Transform to mem in 0.279811s (11012 normal rows, 42888 exceptions)
[2021-03-31 15:17:29.230] [E/14] [info] [Task Finished] Transform to mem in 0.280580s (11026 normal rows, 43035 exceptions)
[2021-03-31 15:17:29.230] [E/7] [info] [Task Finished] Transform to mem in 0.279442s (11073 normal rows, 42754 exceptions)
[2021-03-31 15:17:29.231] [E/1] [info] [Task Finished] Transform to mem in 0.280376s (11130 normal rows, 43033 exceptions)
[2021-03-31 15:17:29.232] [E/15] [info] [Task Finished] Transform to mem in 0.280861s (11095 normal rows, 43552 exceptions)
[2021-03-31 15:17:29.233] [E/8] [info] [Task Finished] Transform to mem in 0.280237s (11069 normal rows, 43142 exceptions)
[2021-03-31 15:17:29.234] [E/3] [info] [Task Finished] Transform to mem in 0.280188s (10974 normal rows, 43172 exceptions)
[2021-03-31 15:17:29.235] [E/13] [info] [Task Finished] Transform to mem in 0.279403s (11008 normal rows, 42964 exceptions)
[2021-03-31 15:17:29.243] [driver] [info] [Task Finished] Transform to mem in 0.280272s (11042 normal rows, 43023 exceptions)
[2021-03-31 15:17:29.254] [E/4] [info] [Task Finished] Transform to mem in 0.281124s (11012 normal rows, 42911 exceptions)
[2021-03-31 15:17:29.507] [E/5] [info] [Task Finished] Transform to mem in 0.279218s (11105 normal rows, 43555 exceptions)
[2021-03-31 15:17:29.507] [E/9] [info] [Task Finished] Transform to mem in 0.279584s (11063 normal rows, 42726 exceptions)
[2021-03-31 15:17:29.508] [E/6] [info] [Task Finished] Transform to mem in 0.279747s (11081 normal rows, 43050 exceptions)
[2021-03-31 15:17:29.508] [E/10] [info] [Task Finished] Transform to mem in 0.279694s (11087 normal rows, 43150 exceptions)
[2021-03-31 15:17:29.508] [E/11] [info] [Task Finished] Transform to mem in 0.279430s (11008 normal rows, 42975 exceptions)
[2021-03-31 15:17:29.509] [E/12] [info] [Task Finished] Transform to mem in 0.279863s (11005 normal rows, 43164 exceptions)
[2021-03-31 15:17:29.509] [E/7] [info] [Task Finished] Transform to mem in 0.278944s (11073 normal rows, 42720 exceptions)
[2021-03-31 15:17:29.510] [E/2] [info] [Task Finished] Transform to mem in 0.280469s (11042 normal rows, 42959 exceptions)
[2021-03-31 15:17:29.510] [E/14] [info] [Task Finished] Transform to mem in 0.280331s (11002 normal rows, 42964 exceptions)
[2021-03-31 15:17:29.512] [E/15] [info] [Task Finished] Transform to mem in 0.279878s (11098 normal rows, 43112 exceptions)
[2021-03-31 15:17:29.513] [E/1] [info] [Task Finished] Transform to mem in 0.281524s (11088 normal rows, 43511 exceptions)
[2021-03-31 15:17:29.513] [E/8] [info] [Task Finished] Transform to mem in 0.279651s (11087 normal rows, 43044 exceptions)
[2021-03-31 15:17:29.514] [E/3] [info] [Task Finished] Transform to mem in 0.280371s (11005 normal rows, 43229 exceptions)
[2021-03-31 15:17:29.515] [E/13] [info] [Task Finished] Transform to mem in 0.279622s (11008 normal rows, 43017 exceptions)
[2021-03-31 15:17:29.523] [driver] [info] [Task Finished] Transform to mem in 0.279961s (11024 normal rows, 42947 exceptions)
[2021-03-31 15:17:29.536] [E/4] [info] [Task Finished] Transform to mem in 0.282163s (11020 normal rows, 42976 exceptions)
[2021-03-31 15:17:29.786] [E/5] [info] [Task Finished] Transform to mem in 0.278509s (11036 normal rows, 42710 exceptions)
[2021-03-31 15:17:29.788] [E/10] [info] [Task Finished] Transform to mem in 0.279304s (11087 normal rows, 42938 exceptions)
[2021-03-31 15:17:29.788] [E/9] [info] [Task Finished] Transform to mem in 0.280317s (11125 normal rows, 43517 exceptions)
[2021-03-31 15:17:29.788] [E/6] [info] [Task Finished] Transform to mem in 0.279944s (11098 normal rows, 43115 exceptions)
[2021-03-31 15:17:29.788] [E/12] [info] [Task Finished] Transform to mem in 0.279606s (11000 normal rows, 42999 exceptions)
[2021-03-31 15:17:29.788] [E/11] [info] [Task Finished] Transform to mem in 0.279968s (10985 normal rows, 43336 exceptions)
[2021-03-31 15:17:29.789] [E/7] [info] [Task Finished] Transform to mem in 0.279996s (11052 normal rows, 42881 exceptions)
[2021-03-31 15:17:29.790] [E/2] [info] [Task Finished] Transform to mem in 0.280409s (11020 normal rows, 43057 exceptions)
[2021-03-31 15:17:29.791] [E/15] [info] [Task Finished] Transform to mem in 0.279632s (11166 normal rows, 43520 exceptions)
[2021-03-31 15:17:29.792] [E/14] [info] [Task Finished] Transform to mem in 0.281697s (10995 normal rows, 42708 exceptions)
[2021-03-31 15:17:29.792] [E/1] [info] [Task Finished] Transform to mem in 0.279362s (11098 normal rows, 43075 exceptions)
[2021-03-31 15:17:29.794] [E/3] [info] [Task Finished] Transform to mem in 0.280166s (10999 normal rows, 43334 exceptions)
[2021-03-31 15:17:29.794] [E/8] [info] [Task Finished] Transform to mem in 0.281237s (11073 normal rows, 42970 exceptions)
[2021-03-31 15:17:29.795] [E/13] [info] [Task Finished] Transform to mem in 0.280075s (11000 normal rows, 43009 exceptions)
[2021-03-31 15:17:29.803] [driver] [info] [Task Finished] Transform to mem in 0.279711s (11052 normal rows, 42764 exceptions)
[2021-03-31 15:17:29.819] [E/4] [info] [Task Finished] Transform to mem in 0.282416s (11020 normal rows, 43138 exceptions)
[2021-03-31 15:17:30.065] [E/5] [info] [Task Finished] Transform to mem in 0.279509s (10995 normal rows, 42726 exceptions)
[2021-03-31 15:17:30.067] [E/9] [info] [Task Finished] Transform to mem in 0.279456s (11091 normal rows, 43047 exceptions)
[2021-03-31 15:17:30.067] [E/12] [info] [Task Finished] Transform to mem in 0.279224s (10999 normal rows, 43300 exceptions)
[2021-03-31 15:17:30.068] [E/10] [info] [Task Finished] Transform to mem in 0.280516s (11166 normal rows, 43508 exceptions)
[2021-03-31 15:17:30.068] [E/11] [info] [Task Finished] Transform to mem in 0.279716s (11000 normal rows, 43043 exceptions)
[2021-03-31 15:17:30.068] [E/6] [info] [Task Finished] Transform to mem in 0.280090s (11080 normal rows, 43031 exceptions)
[2021-03-31 15:17:30.068] [E/7] [info] [Task Finished] Transform to mem in 0.279295s (11036 normal rows, 42720 exceptions)
[2021-03-31 15:17:30.071] [E/15] [info] [Task Finished] Transform to mem in 0.279209s (10995 normal rows, 42718 exceptions)
[2021-03-31 15:17:30.071] [E/2] [info] [Task Finished] Transform to mem in 0.280375s (11016 normal rows, 43165 exceptions)
[2021-03-31 15:17:30.072] [E/14] [info] [Task Finished] Transform to mem in 0.279692s (11186 normal rows, 43465 exceptions)
[2021-03-31 15:17:30.072] [E/1] [info] [Task Finished] Transform to mem in 0.279942s (11001 normal rows, 43113 exceptions)
[2021-03-31 15:17:30.073] [E/3] [info] [Task Finished] Transform to mem in 0.279279s (11170 normal rows, 43024 exceptions)
[2021-03-31 15:17:30.073] [E/8] [info] [Task Finished] Transform to mem in 0.279098s (10989 normal rows, 43282 exceptions)
[2021-03-31 15:17:30.076] [E/13] [info] [Task Finished] Transform to mem in 0.281595s (11010 normal rows, 43002 exceptions)
[2021-03-31 15:17:30.083] [driver] [info] [Task Finished] Transform to mem in 0.279955s (11002 normal rows, 42755 exceptions)
[2021-03-31 15:17:30.100] [E/4] [info] [Task Finished] Transform to mem in 0.281328s (11050 normal rows, 43199 exceptions)
[2021-03-31 15:17:30.347] [E/5] [info] [Task Finished] Transform to mem in 0.282030s (10973 normal rows, 42686 exceptions)
[2021-03-31 15:17:30.350] [E/10] [info] [Task Finished] Transform to mem in 0.281875s (11166 normal rows, 43023 exceptions)
[2021-03-31 15:17:30.350] [E/9] [info] [Task Finished] Transform to mem in 0.282881s (11160 normal rows, 43455 exceptions)
[2021-03-31 15:17:30.351] [E/7] [info] [Task Finished] Transform to mem in 0.282961s (11007 normal rows, 42795 exceptions)
[2021-03-31 15:17:30.351] [E/6] [info] [Task Finished] Transform to mem in 0.283252s (11005 normal rows, 42971 exceptions)
[2021-03-31 15:17:30.352] [E/12] [info] [Task Finished] Transform to mem in 0.284138s (11045 normal rows, 43148 exceptions)
[2021-03-31 15:17:30.352] [E/11] [info] [Task Finished] Transform to mem in 0.283499s (10997 normal rows, 43283 exceptions)
[2021-03-31 15:17:30.354] [E/2] [info] [Task Finished] Transform to mem in 0.283404s (10973 normal rows, 42686 exceptions)
[2021-03-31 15:17:30.355] [E/1] [info] [Task Finished] Transform to mem in 0.282698s (11043 normal rows, 43153 exceptions)
[2021-03-31 15:17:30.355] [E/15] [info] [Task Finished] Transform to mem in 0.284772s (11050 normal rows, 43196 exceptions)
[2021-03-31 15:17:30.356] [E/8] [info] [Task Finished] Transform to mem in 0.282742s (10997 normal rows, 43277 exceptions)
[2021-03-31 15:17:30.357] [E/14] [info] [Task Finished] Transform to mem in 0.284806s (11160 normal rows, 43446 exceptions)
[2021-03-31 15:17:30.357] [E/3] [info] [Task Finished] Transform to mem in 0.283271s (11168 normal rows, 43028 exceptions)
[2021-03-31 15:17:30.359] [E/13] [info] [Task Finished] Transform to mem in 0.282947s (10997 normal rows, 42973 exceptions)
[2021-03-31 15:17:30.366] [driver] [info] [Task Finished] Transform to mem in 0.283277s (11015 normal rows, 42799 exceptions)
[2021-03-31 15:17:30.386] [E/4] [info] [Task Finished] Transform to mem in 0.285979s (11050 normal rows, 43170 exceptions)
[2021-03-31 15:17:30.627] [E/5] [info] [Task Finished] Transform to mem in 0.279157s (10973 normal rows, 42710 exceptions)
[2021-03-31 15:17:30.629] [E/10] [info] [Task Finished] Transform to mem in 0.278735s (11160 normal rows, 43431 exceptions)
[2021-03-31 15:17:30.630] [E/9] [info] [Task Finished] Transform to mem in 0.280283s (11043 normal rows, 43166 exceptions)
[2021-03-31 15:17:30.631] [E/11] [info] [Task Finished] Transform to mem in 0.278933s (11009 normal rows, 42805 exceptions)
[2021-03-31 15:17:30.631] [E/6] [info] [Task Finished] Transform to mem in 0.279538s (10997 normal rows, 43237 exceptions)
[2021-03-31 15:17:30.632] [E/12] [info] [Task Finished] Transform to mem in 0.280035s (10997 normal rows, 43012 exceptions)
[2021-03-31 15:17:30.632] [E/7] [info] [Task Finished] Transform to mem in 0.280667s (11168 normal rows, 43027 exceptions)
[2021-03-31 15:17:30.634] [E/1] [info] [Task Finished] Transform to mem in 0.278782s (11003 normal rows, 42716 exceptions)
[2021-03-31 15:17:30.635] [E/2] [info] [Task Finished] Transform to mem in 0.280854s (11021 normal rows, 43160 exceptions)
[2021-03-31 15:17:30.635] [E/15] [info] [Task Finished] Transform to mem in 0.279826s (11165 normal rows, 43354 exceptions)
[2021-03-31 15:17:30.636] [E/8] [info] [Task Finished] Transform to mem in 0.279750s (11043 normal rows, 43217 exceptions)
[2021-03-31 15:17:30.636] [E/3] [info] [Task Finished] Transform to mem in 0.279308s (11009 normal rows, 43187 exceptions)
[2021-03-31 15:17:30.638] [E/14] [info] [Task Finished] Transform to mem in 0.280884s (11156 normal rows, 43044 exceptions)
[2021-03-31 15:17:30.640] [E/13] [info] [Task Finished] Transform to mem in 0.280190s (10997 normal rows, 43067 exceptions)
[2021-03-31 15:17:30.646] [driver] [info] [Task Finished] Transform to mem in 0.279554s (11009 normal rows, 42811 exceptions)
[2021-03-31 15:17:30.669] [E/4] [info] [Task Finished] Transform to mem in 0.282941s (11021 normal rows, 43162 exceptions)
[2021-03-31 15:17:30.909] [E/5] [info] [Task Finished] Transform to mem in 0.282224s (11003 normal rows, 42716 exceptions)
[2021-03-31 15:17:30.912] [E/10] [info] [Task Finished] Transform to mem in 0.283235s (11165 normal rows, 43260 exceptions)
[2021-03-31 15:17:30.914] [E/9] [info] [Task Finished] Transform to mem in 0.283040s (11027 normal rows, 43245 exceptions)
[2021-03-31 15:17:30.915] [E/6] [info] [Task Finished] Transform to mem in 0.283519s (10997 normal rows, 43177 exceptions)
[2021-03-31 15:17:30.915] [E/11] [info] [Task Finished] Transform to mem in 0.284249s (11172 normal rows, 43107 exceptions)
[2021-03-31 15:17:30.915] [E/12] [info] [Task Finished] Transform to mem in 0.283349s (11009 normal rows, 43050 exceptions)
[2021-03-31 15:17:30.915] [E/7] [info] [Task Finished] Transform to mem in 0.283023s (10999 normal rows, 42828 exceptions)
[2021-03-31 15:17:30.917] [E/1] [info] [Task Finished] Transform to mem in 0.283765s (11031 normal rows, 43157 exceptions)
[2021-03-31 15:17:30.918] [E/15] [info] [Task Finished] Transform to mem in 0.282662s (11091 normal rows, 43230 exceptions)
[2021-03-31 15:17:30.918] [E/2] [info] [Task Finished] Transform to mem in 0.283251s (11000 normal rows, 42726 exceptions)
[2021-03-31 15:17:30.919] [E/3] [info] [Task Finished] Transform to mem in 0.283305s (11177 normal rows, 43113 exceptions)
[2021-03-31 15:17:30.920] [E/8] [info] [Task Finished] Transform to mem in 0.283768s (11099 normal rows, 43272 exceptions)
[2021-03-31 15:17:30.921] [E/14] [info] [Task Finished] Transform to mem in 0.283215s (10997 normal rows, 43174 exceptions)
[2021-03-31 15:17:30.922] [E/13] [info] [Task Finished] Transform to mem in 0.282808s (10987 normal rows, 43020 exceptions)
[2021-03-31 15:17:30.929] [driver] [info] [Task Finished] Transform to mem in 0.283263s (11020 normal rows, 42867 exceptions)
[2021-03-31 15:17:30.987] [E/4] [info] [Task Finished] Transform to mem in 0.317656s (12330 normal rows, 48094 exceptions)
[2021-03-31 15:17:30.987] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.88131s
[2021-03-31 15:17:30.987] [global] [info] [Transform Stage] Stage 0 total wall clock time: 45.0491s, 56350770 input rows, time to process 1 row via fast path: 0.000799441ms
[2021-03-31 15:17:30.987] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-31 15:17:30.991] [local ee] [info] compiled pure python pipeline in 0.004304s
[2021-03-31 15:17:30.991] [local ee] [info] creating hybrid intermediates took 0.000004s
[2021-03-31 15:17:30.993] [local ee] [info] Created 160 resolve tasks in 0.001258s
[2021-03-31 15:17:30.993] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 15:18:29.516] [E/2] [info] [Task Finished] Resolve in 58.523329s
[2021-03-31 15:18:34.874] [E/10] [info] [Task Finished] Resolve in 63.881135s
[2021-03-31 15:18:41.533] [E/11] [info] [Task Finished] Resolve in 70.540330s
[2021-03-31 15:18:43.172] [E/14] [info] [Task Finished] Resolve in 72.179881s
[2021-03-31 15:18:43.530] [E/9] [info] [Task Finished] Resolve in 72.537138s
[2021-03-31 15:18:45.917] [E/4] [info] [Task Finished] Resolve in 74.924878s
[2021-03-31 15:18:47.286] [E/13] [info] [Task Finished] Resolve in 76.293204s
[2021-03-31 15:18:49.448] [E/6] [info] [Task Finished] Resolve in 78.454967s
[2021-03-31 15:18:50.454] [E/7] [info] [Task Finished] Resolve in 79.461277s
[2021-03-31 15:18:50.864] [driver] [info] [Task Finished] Resolve in 79.871886s
[2021-03-31 15:18:53.953] [E/3] [info] [Task Finished] Resolve in 82.960261s
[2021-03-31 15:18:55.020] [E/15] [info] [Task Finished] Resolve in 84.027173s
[2021-03-31 15:18:55.802] [E/8] [info] [Task Finished] Resolve in 84.809579s
[2021-03-31 15:18:56.731] [E/12] [info] [Task Finished] Resolve in 85.738588s
[2021-03-31 15:19:04.478] [E/1] [info] [Task Finished] Resolve in 93.485013s
[2021-03-31 15:19:04.750] [E/5] [info] [Task Finished] Resolve in 93.756935s
[2021-03-31 15:19:33.930] [E/2] [info] [Task Finished] Resolve in 64.414083s
[2021-03-31 15:19:44.867] [E/11] [info] [Task Finished] Resolve in 63.334004s
[2021-03-31 15:19:47.054] [E/10] [info] [Task Finished] Resolve in 72.180607s
[2021-03-31 15:19:52.615] [E/14] [info] [Task Finished] Resolve in 69.442980s
[2021-03-31 15:20:03.981] [E/8] [info] [Task Finished] Resolve in 68.178721s
[2021-03-31 15:20:05.018] [E/7] [info] [Task Finished] Resolve in 74.564435s
[2021-03-31 15:20:06.512] [driver] [info] [Task Finished] Resolve in 75.647148s
[2021-03-31 15:20:06.848] [E/9] [info] [Task Finished] Resolve in 83.318213s
[2021-03-31 15:20:09.040] [E/6] [info] [Task Finished] Resolve in 79.592820s
[2021-03-31 15:20:09.576] [E/15] [info] [Task Finished] Resolve in 74.556033s
[2021-03-31 15:20:10.363] [E/13] [info] [Task Finished] Resolve in 83.076916s
[2021-03-31 15:20:13.942] [E/3] [info] [Task Finished] Resolve in 79.989462s
[2021-03-31 15:20:15.675] [E/12] [info] [Task Finished] Resolve in 78.944109s
[2021-03-31 15:20:23.496] [E/1] [info] [Task Finished] Resolve in 79.017940s
[2021-03-31 15:20:24.072] [E/4] [info] [Task Finished] Resolve in 98.154394s
[2021-03-31 15:20:26.317] [E/5] [info] [Task Finished] Resolve in 81.567512s
[2021-03-31 15:20:46.521] [E/2] [info] [Task Finished] Resolve in 72.590655s
[2021-03-31 15:20:54.191] [E/11] [info] [Task Finished] Resolve in 69.324323s
[2021-03-31 15:21:02.885] [E/10] [info] [Task Finished] Resolve in 75.830451s
[2021-03-31 15:21:12.387] [E/9] [info] [Task Finished] Resolve in 65.539044s
[2021-03-31 15:21:17.532] [E/14] [info] [Task Finished] Resolve in 84.916058s
[2021-03-31 15:21:20.601] [E/13] [info] [Task Finished] Resolve in 70.238488s
[2021-03-31 15:21:22.172] [E/8] [info] [Task Finished] Resolve in 78.190835s
[2021-03-31 15:21:22.670] [E/15] [info] [Task Finished] Resolve in 73.094609s
[2021-03-31 15:21:26.644] [driver] [info] [Task Finished] Resolve in 80.132597s
[2021-03-31 15:21:32.304] [E/12] [info] [Task Finished] Resolve in 76.628762s
[2021-03-31 15:21:33.275] [E/6] [info] [Task Finished] Resolve in 84.234386s
[2021-03-31 15:21:38.295] [E/3] [info] [Task Finished] Resolve in 84.352560s
[2021-03-31 15:21:41.743] [E/1] [info] [Task Finished] Resolve in 78.247717s
[2021-03-31 15:21:43.101] [E/5] [info] [Task Finished] Resolve in 76.784373s
[2021-03-31 15:21:45.302] [E/7] [info] [Task Finished] Resolve in 100.283404s
[2021-03-31 15:21:46.852] [E/2] [info] [Task Finished] Resolve in 60.330898s
[2021-03-31 15:21:48.326] [E/4] [info] [Task Finished] Resolve in 84.254494s
[2021-03-31 15:21:52.849] [E/11] [info] [Task Finished] Resolve in 58.657894s
[2021-03-31 15:22:18.988] [E/10] [info] [Task Finished] Resolve in 76.103165s
[2021-03-31 15:22:34.867] [E/9] [info] [Task Finished] Resolve in 82.479952s
[2021-03-31 15:22:36.232] [E/13] [info] [Task Finished] Resolve in 75.630855s
[2021-03-31 15:22:36.649] [E/8] [info] [Task Finished] Resolve in 74.477303s
[2021-03-31 15:22:41.907] [E/15] [info] [Task Finished] Resolve in 79.236085s
[2021-03-31 15:22:46.174] [driver] [info] [Task Finished] Resolve in 79.529511s
[2021-03-31 15:22:48.814] [E/14] [info] [Task Finished] Resolve in 91.282419s
[2021-03-31 15:22:48.939] [E/12] [info] [Task Finished] Resolve in 76.634376s
[2021-03-31 15:22:51.056] [E/1] [info] [Task Finished] Resolve in 69.312932s
[2021-03-31 15:22:51.217] [E/3] [info] [Task Finished] Resolve in 72.922072s
[2021-03-31 15:22:53.697] [E/5] [info] [Task Finished] Resolve in 70.595961s
[2021-03-31 15:23:02.700] [E/11] [info] [Task Finished] Resolve in 69.850843s
[2021-03-31 15:23:04.777] [E/4] [info] [Task Finished] Resolve in 76.450341s
[2021-03-31 15:23:05.772] [E/6] [info] [Task Finished] Resolve in 92.496971s
[2021-03-31 15:23:09.029] [E/2] [info] [Task Finished] Resolve in 82.177320s
[2021-03-31 15:23:09.696] [E/7] [info] [Task Finished] Resolve in 84.394311s
[2021-03-31 15:23:38.013] [E/8] [info] [Task Finished] Resolve in 61.363988s
[2021-03-31 15:23:48.096] [E/10] [info] [Task Finished] Resolve in 89.107608s
[2021-03-31 15:23:52.818] [E/15] [info] [Task Finished] Resolve in 70.911451s
[2021-03-31 15:23:53.025] [E/13] [info] [Task Finished] Resolve in 76.792650s
[2021-03-31 15:23:56.081] [E/9] [info] [Task Finished] Resolve in 81.213592s
[2021-03-31 15:23:56.276] [driver] [info] [Task Finished] Resolve in 70.102633s
[2021-03-31 15:23:56.875] [E/14] [info] [Task Finished] Resolve in 68.061037s
[2021-03-31 15:24:11.084] [E/3] [info] [Task Finished] Resolve in 79.867325s
[2021-03-31 15:24:11.243] [E/12] [info] [Task Finished] Resolve in 82.304315s
[2021-03-31 15:24:13.066] [E/1] [info] [Task Finished] Resolve in 82.009359s
[2021-03-31 15:24:16.649] [E/5] [info] [Task Finished] Resolve in 82.951443s
[2021-03-31 15:24:17.970] [E/7] [info] [Task Finished] Resolve in 68.273420s
[2021-03-31 15:24:19.316] [E/11] [info] [Task Finished] Resolve in 76.616058s
[2021-03-31 15:24:24.581] [E/4] [info] [Task Finished] Resolve in 79.804292s
[2021-03-31 15:24:24.754] [E/2] [info] [Task Finished] Resolve in 75.725207s
[2021-03-31 15:24:26.313] [E/6] [info] [Task Finished] Resolve in 80.540713s
[2021-03-31 15:25:02.125] [E/8] [info] [Task Finished] Resolve in 84.111448s
[2021-03-31 15:25:03.159] [E/10] [info] [Task Finished] Resolve in 75.062966s
[2021-03-31 15:25:05.062] [driver] [info] [Task Finished] Resolve in 68.785520s
[2021-03-31 15:25:05.147] [E/15] [info] [Task Finished] Resolve in 72.328931s
[2021-03-31 15:25:06.634] [E/13] [info] [Task Finished] Resolve in 73.609584s
[2021-03-31 15:25:13.102] [E/1] [info] [Task Finished] Resolve in 60.036466s
[2021-03-31 15:25:16.440] [E/12] [info] [Task Finished] Resolve in 65.196857s
[2021-03-31 15:25:22.112] [E/5] [info] [Task Finished] Resolve in 65.462896s
[2021-03-31 15:25:29.681] [E/9] [info] [Task Finished] Resolve in 93.600333s
[2021-03-31 15:25:34.398] [E/11] [info] [Task Finished] Resolve in 75.081264s
[2021-03-31 15:25:35.284] [E/14] [info] [Task Finished] Resolve in 98.409303s
[2021-03-31 15:25:35.663] [E/2] [info] [Task Finished] Resolve in 70.909109s
[2021-03-31 15:25:37.754] [E/3] [info] [Task Finished] Resolve in 86.669149s
[2021-03-31 15:25:38.191] [E/7] [info] [Task Finished] Resolve in 80.221459s
[2021-03-31 15:25:47.894] [E/4] [info] [Task Finished] Resolve in 83.312700s
[2021-03-31 15:25:59.612] [E/6] [info] [Task Finished] Resolve in 93.299255s
[2021-03-31 15:26:09.782] [E/10] [info] [Task Finished] Resolve in 66.623683s
[2021-03-31 15:26:10.947] [E/13] [info] [Task Finished] Resolve in 64.312184s
[2021-03-31 15:26:18.496] [E/15] [info] [Task Finished] Resolve in 73.348540s
[2021-03-31 15:26:18.747] [E/1] [info] [Task Finished] Resolve in 65.644700s
[2021-03-31 15:26:19.106] [driver] [info] [Task Finished] Resolve in 74.044403s
[2021-03-31 15:26:30.202] [E/12] [info] [Task Finished] Resolve in 73.762580s
[2021-03-31 15:26:36.765] [E/8] [info] [Task Finished] Resolve in 94.639914s
[2021-03-31 15:26:42.890] [E/5] [info] [Task Finished] Resolve in 80.778018s
[2021-03-31 15:26:50.370] [E/2] [info] [Task Finished] Resolve in 74.706746s
[2021-03-31 15:26:53.379] [E/14] [info] [Task Finished] Resolve in 78.094780s
[2021-03-31 15:26:56.715] [E/11] [info] [Task Finished] Resolve in 82.317083s
[2021-03-31 15:26:59.585] [E/9] [info] [Task Finished] Resolve in 89.904264s
[2021-03-31 15:27:01.860] [E/7] [info] [Task Finished] Resolve in 83.669168s
[2021-03-31 15:27:09.526] [E/3] [info] [Task Finished] Resolve in 91.772569s
[2021-03-31 15:27:12.139] [E/4] [info] [Task Finished] Resolve in 84.245031s
[2021-03-31 15:27:13.433] [E/15] [info] [Task Finished] Resolve in 54.937114s
[2021-03-31 15:27:16.871] [E/6] [info] [Task Finished] Resolve in 77.258636s
[2021-03-31 15:27:18.463] [E/13] [info] [Task Finished] Resolve in 67.515849s
[2021-03-31 15:27:31.963] [driver] [info] [Task Finished] Resolve in 72.856446s
[2021-03-31 15:27:42.591] [E/10] [info] [Task Finished] Resolve in 92.808085s
[2021-03-31 15:27:44.033] [E/12] [info] [Task Finished] Resolve in 73.830736s
[2021-03-31 15:27:46.271] [E/8] [info] [Task Finished] Resolve in 69.506510s
[2021-03-31 15:27:47.664] [E/1] [info] [Task Finished] Resolve in 88.916596s
[2021-03-31 15:27:56.987] [E/14] [info] [Task Finished] Resolve in 63.607686s
[2021-03-31 15:28:04.617] [E/2] [info] [Task Finished] Resolve in 74.246344s
[2021-03-31 15:28:04.817] [E/5] [info] [Task Finished] Resolve in 81.926759s
[2021-03-31 15:28:09.521] [E/9] [info] [Task Finished] Resolve in 69.935992s
[2021-03-31 15:28:17.538] [E/7] [info] [Task Finished] Resolve in 75.677509s
[2021-03-31 15:28:20.610] [E/11] [info] [Task Finished] Resolve in 83.895255s
[2021-03-31 15:28:22.213] [E/13] [info] [Task Finished] Resolve in 63.749989s
[2021-03-31 15:28:28.996] [E/4] [info] [Task Finished] Resolve in 76.857103s
[2021-03-31 15:28:29.075] [E/3] [info] [Task Finished] Resolve in 79.548584s
[2021-03-31 15:28:31.778] [E/6] [info] [Task Finished] Resolve in 74.907300s
[2021-03-31 15:28:48.050] [driver] [info] [Task Finished] Resolve in 76.087047s
[2021-03-31 15:28:53.662] [E/15] [info] [Task Finished] Resolve in 100.228998s
[2021-03-31 15:28:59.536] [E/10] [info] [Task Finished] Resolve in 76.945687s
[2021-03-31 15:29:00.880] [E/12] [info] [Task Finished] Resolve in 76.846499s
[2021-03-31 15:29:02.069] [E/8] [info] [Task Finished] Resolve in 75.798197s
[2021-03-31 15:29:11.069] [E/14] [info] [Task Finished] Resolve in 74.081983s
[2021-03-31 15:29:17.766] [E/2] [info] [Task Finished] Resolve in 73.149386s
[2021-03-31 15:29:18.594] [E/5] [info] [Task Finished] Resolve in 73.776992s
[2021-03-31 15:29:18.814] [E/1] [info] [Task Finished] Resolve in 91.150145s
[2021-03-31 15:29:27.459] [E/11] [info] [Task Finished] Resolve in 66.849038s
[2021-03-31 15:29:30.776] [E/9] [info] [Task Finished] Resolve in 81.254576s
[2021-03-31 15:29:32.051] [E/7] [info] [Task Finished] Resolve in 74.513632s
[2021-03-31 15:29:34.252] [E/4] [info] [Task Finished] Resolve in 65.255985s
[2021-03-31 15:29:47.077] [E/13] [info] [Task Finished] Resolve in 84.864078s
[2021-03-31 15:29:48.392] [E/3] [info] [Task Finished] Resolve in 79.316898s
[2021-03-31 15:29:54.310] [E/6] [info] [Task Finished] Resolve in 82.531927s
[2021-03-31 15:30:03.660] [driver] [info] [Task Finished] Resolve in 75.609580s
[2021-03-31 15:30:07.551] [E/10] [info] [Task Finished] Resolve in 68.014535s
[2021-03-31 15:30:11.479] [E/15] [info] [Task Finished] Resolve in 77.817137s
[2021-03-31 15:30:12.398] [E/8] [info] [Task Finished] Resolve in 70.328808s
[2021-03-31 15:30:12.756] [E/1] [info] [Task Finished] Resolve in 53.942131s
[2021-03-31 15:30:17.015] [E/12] [info] [Task Finished] Resolve in 76.135162s
[2021-03-31 15:30:17.201] [E/14] [info] [Task Finished] Resolve in 66.131643s
[2021-03-31 15:30:18.922] [E/2] [info] [Task Finished] Resolve in 61.156290s
[2021-03-31 15:30:21.397] [E/9] [info] [Task Finished] Resolve in 50.621272s
[2021-03-31 15:30:22.394] [E/7] [info] [Task Finished] Resolve in 50.342930s
[2021-03-31 15:30:22.443] [E/11] [info] [Task Finished] Resolve in 54.983920s
[2021-03-31 15:30:23.389] [E/5] [info] [Task Finished] Resolve in 64.795117s
[2021-03-31 15:30:23.864] [E/4] [info] [Task Finished] Resolve in 49.611581s
[2021-03-31 15:30:23.864] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 772.877s
[2021-03-31 15:30:23.864] [local ee] [info] slow path for Stage 0: total wall clock time: 12168.4s, time to process 1 row via slow path: 1.76457ms
[2021-03-31 15:30:23.864] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 772.877s

[2021-03-31 15:30:23.892] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-31 15:30:23.907] [E/9] [info] [Task Finished] write to file in 0.014482s (46082 rows, 7.01 MB)
[2021-03-31 15:30:23.925] [E/14] [info] [Task Finished] write to file in 0.032769s (112425 rows, 17.10 MB)
[2021-03-31 15:30:23.926] [driver] [info] [Task Finished] write to file in 0.033502s (112482 rows, 17.11 MB)
[2021-03-31 15:30:23.926] [E/11] [info] [Task Finished] write to file in 0.033558s (112438 rows, 17.10 MB)
[2021-03-31 15:30:23.926] [E/6] [info] [Task Finished] write to file in 0.033605s (112421 rows, 17.10 MB)
[2021-03-31 15:30:23.926] [E/3] [info] [Task Finished] write to file in 0.033657s (112467 rows, 17.11 MB)
[2021-03-31 15:30:23.926] [E/10] [info] [Task Finished] write to file in 0.033682s (112573 rows, 17.12 MB)
[2021-03-31 15:30:23.926] [E/13] [info] [Task Finished] write to file in 0.033709s (112583 rows, 17.13 MB)
[2021-03-31 15:30:23.926] [E/8] [info] [Task Finished] write to file in 0.033912s (112459 rows, 17.11 MB)
[2021-03-31 15:30:23.927] [E/4] [info] [Task Finished] write to file in 0.034892s (123389 rows, 18.77 MB)
[2021-03-31 15:30:23.928] [E/7] [info] [Task Finished] write to file in 0.035052s (123424 rows, 18.78 MB)
[2021-03-31 15:30:23.928] [E/15] [info] [Task Finished] write to file in 0.035091s (123251 rows, 18.75 MB)
[2021-03-31 15:30:23.928] [E/2] [info] [Task Finished] write to file in 0.035110s (123377 rows, 18.77 MB)
[2021-03-31 15:30:23.928] [E/5] [info] [Task Finished] write to file in 0.035106s (123410 rows, 18.78 MB)
[2021-03-31 15:30:23.928] [E/12] [info] [Task Finished] write to file in 0.035254s (123299 rows, 18.76 MB)
[2021-03-31 15:30:23.929] [E/1] [info] [Task Finished] write to file in 0.036282s (112411 rows, 17.10 MB)
[2021-03-31 15:30:23.929] [global] [info] writing output took 0.065021s
[2021-03-31 15:30:23.929] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0651116s
[2021-03-31 15:30:23.929] [global] [info] [Transform Stage] Stage 0 took 776.326s
[2021-03-31 15:30:23.929] [global] [info] Query Execution took 776.405s. (planning: 0.0793109s, execution: 776.326s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 12:55:20) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005376577377319336
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 776.6876146793365 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '499bbd619a75', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0226066,"llvm_optimization_time_s":0.332418,"llvm_compilation_time_s":0.15211,"total_compilation_time_s":0.502156,"sampling_time_s":0.10934,"stages":[{"stage_no":0,"fast_path_wall_time_s":45.0491,"fast_path_time_s":2.88133,"fast_path_per_row_time_ns":799.441,"slow_path_wall_time_s":12168.4,"slow_path_time_s":772.877,"slow_path_per_row_time_ns":1.76457e+06}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.005376577377319336, "jobTime": 776.6876146793365, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-31 15:30:32.102] [local execution engine] [info] Stopped local executor E/1
[2021-03-31 15:30:32.107] [local execution engine] [info] Stopped local executor E/2
[2021-03-31 15:30:32.112] [local execution engine] [info] Stopped local executor E/3
[2021-03-31 15:30:32.118] [local execution engine] [info] Stopped local executor E/4
[2021-03-31 15:30:32.123] [local execution engine] [info] Stopped local executor E/5
[2021-03-31 15:30:32.128] [local execution engine] [info] Stopped local executor E/6
[2021-03-31 15:30:32.133] [local execution engine] [info] Stopped local executor E/7
[2021-03-31 15:30:32.138] [local execution engine] [info] Stopped local executor E/8
[2021-03-31 15:30:32.143] [local execution engine] [info] Stopped local executor E/9
[2021-03-31 15:30:32.148] [local execution engine] [info] Stopped local executor E/10
[2021-03-31 15:30:32.153] [local execution engine] [info] Stopped local executor E/11
[2021-03-31 15:30:32.158] [local execution engine] [info] Stopped local executor E/12
[2021-03-31 15:30:32.163] [local execution engine] [info] Stopped local executor E/13
[2021-03-31 15:30:32.168] [local execution engine] [info] Stopped local executor E/14
[2021-03-31 15:30:32.173] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
