[2021-03-31 16:23:27.988] [global] [error] could not find backend, defaulting to local
[2021-03-31 16:23:27.989] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 16:23:27.989] [local ee] [info] initializing LLVM backend
[2021-03-31 16:23:27.989] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 16:23:27.989] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/1] [info] starting detached process queue
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/2] [info] starting detached process queue
[2021-03-31 16:23:27.990] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [E/3] [info] starting detached process queue
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [E/4] [info] starting detached process queue
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/5] [info] starting detached process queue
[2021-03-31 16:23:27.990] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [E/6] [info] starting detached process queue
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/7] [info] starting detached process queue
[2021-03-31 16:23:27.990] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/8] [info] starting detached process queue
[2021-03-31 16:23:27.990] [E/9] [info] starting detached process queue
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [E/10] [info] starting detached process queue
[2021-03-31 16:23:27.990] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [E/11] [info] starting detached process queue
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/12] [info] starting detached process queue
[2021-03-31 16:23:27.990] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/13] [info] starting detached process queue
[2021-03-31 16:23:27.990] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.990] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.990] [E/14] [info] starting detached process queue
[2021-03-31 16:23:27.991] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 16:23:27.991] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.991] [E/15] [info] starting detached process queue
[2021-03-31 16:23:27.991] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 16:23:27.991] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 16:23:27.991] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 16:23:27.991] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 16:23:27.991] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-31 16:23:28.127] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:23:28.133] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:23:28.149] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:23:28.157] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:23:28.184] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:23:28.205] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:23:28.219] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:23:28.251] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 16:23:28.257] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:23:28.273] [global] [info] performing static typing for UDF in operator map
[2021-03-31 16:23:28.275] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:23:28.276] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:23:28.277] [global] [info] performing static typing for UDF in operator map
[2021-03-31 16:23:28.279] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:23:28.280] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:23:28.280] [global] [info] performing static typing for UDF in operator map
[2021-03-31 16:23:28.282] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:23:28.283] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 16:23:28.283] [global] [info] performing static typing for UDF in operator map
[2021-03-31 16:23:28.300] [logical planner] [info] logical optimization took 0.022635ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 16:23:28.300] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 16:23:28.301] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 16:23:28.301] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 16:23:28.302] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 16:23:28.303] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 16:23:28.303] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 16:23:28.304] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 16:23:28.305] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 16:23:28.306] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 16:23:28.307] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 16:23:28.307] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 16:23:28.309] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 16:23:28.309] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 16:23:28.310] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 16:23:28.311] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 16:23:28.312] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 16:23:28.313] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 16:23:28.313] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 16:23:28.314] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 16:23:28.315] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 16:23:28.315] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 16:23:28.316] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 16:23:28.317] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 16:23:28.318] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 16:23:28.319] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 16:23:28.320] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 16:23:28.321] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 16:23:28.321] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 16:23:28.322] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 16:23:28.353] [global] [info] Stage0 depends on: 
[2021-03-31 16:23:28.704] [global] [info] Optimization via LLVM passes took 0.333342 ms
[2021-03-31 16:23:28.856] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-31 16:23:28.856] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.502736s
[2021-03-31 16:23:28.856] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-31 16:23:29.136] [driver] [info] [Task Finished] Transform to mem in 0.279044s (11005 normal rows, 42744 exceptions)
[2021-03-31 16:23:29.136] [E/7] [info] [Task Finished] Transform to mem in 0.279044s (11026 normal rows, 43206 exceptions)
[2021-03-31 16:23:29.136] [E/2] [info] [Task Finished] Transform to mem in 0.279080s (11153 normal rows, 42968 exceptions)
[2021-03-31 16:23:29.136] [E/5] [info] [Task Finished] Transform to mem in 0.279171s (11047 normal rows, 43210 exceptions)
[2021-03-31 16:23:29.136] [E/4] [info] [Task Finished] Transform to mem in 0.279623s (11086 normal rows, 43015 exceptions)
[2021-03-31 16:23:29.136] [E/8] [info] [Task Finished] Transform to mem in 0.279654s (10997 normal rows, 42910 exceptions)
[2021-03-31 16:23:29.136] [E/3] [info] [Task Finished] Transform to mem in 0.279788s (11073 normal rows, 43414 exceptions)
[2021-03-31 16:23:29.136] [E/11] [info] [Task Finished] Transform to mem in 0.279947s (11008 normal rows, 43077 exceptions)
[2021-03-31 16:23:29.136] [E/10] [info] [Task Finished] Transform to mem in 0.280010s (11092 normal rows, 43495 exceptions)
[2021-03-31 16:23:29.137] [E/13] [info] [Task Finished] Transform to mem in 0.280209s (11153 normal rows, 42970 exceptions)
[2021-03-31 16:23:29.137] [E/1] [info] [Task Finished] Transform to mem in 0.280240s (11105 normal rows, 43095 exceptions)
[2021-03-31 16:23:29.137] [E/15] [info] [Task Finished] Transform to mem in 0.280483s (10997 normal rows, 42873 exceptions)
[2021-03-31 16:23:29.137] [E/14] [info] [Task Finished] Transform to mem in 0.280488s (11036 normal rows, 43142 exceptions)
[2021-03-31 16:23:29.138] [E/6] [info] [Task Finished] Transform to mem in 0.281314s (11036 normal rows, 43139 exceptions)
[2021-03-31 16:23:29.142] [E/9] [info] [Task Finished] Transform to mem in 0.285345s (11005 normal rows, 42741 exceptions)
[2021-03-31 16:23:29.144] [E/12] [info] [Task Finished] Transform to mem in 0.288054s (10987 normal rows, 43113 exceptions)
[2021-03-31 16:23:29.411] [E/2] [info] [Task Finished] Transform to mem in 0.275691s (11153 normal rows, 42978 exceptions)
[2021-03-31 16:23:29.411] [driver] [info] [Task Finished] Transform to mem in 0.275738s (11086 normal rows, 42996 exceptions)
[2021-03-31 16:23:29.412] [E/7] [info] [Task Finished] Transform to mem in 0.276194s (11092 normal rows, 43505 exceptions)
[2021-03-31 16:23:29.412] [E/5] [info] [Task Finished] Transform to mem in 0.276368s (11026 normal rows, 43205 exceptions)
[2021-03-31 16:23:29.412] [E/8] [info] [Task Finished] Transform to mem in 0.276002s (11023 normal rows, 42910 exceptions)
[2021-03-31 16:23:29.412] [E/11] [info] [Task Finished] Transform to mem in 0.275719s (11005 normal rows, 42772 exceptions)
[2021-03-31 16:23:29.413] [E/3] [info] [Task Finished] Transform to mem in 0.276323s (11036 normal rows, 43115 exceptions)
[2021-03-31 16:23:29.413] [E/10] [info] [Task Finished] Transform to mem in 0.276222s (11086 normal rows, 42970 exceptions)
[2021-03-31 16:23:29.413] [E/4] [info] [Task Finished] Transform to mem in 0.276647s (10982 normal rows, 43059 exceptions)
[2021-03-31 16:23:29.413] [E/1] [info] [Task Finished] Transform to mem in 0.276140s (11111 normal rows, 42961 exceptions)
[2021-03-31 16:23:29.414] [E/13] [info] [Task Finished] Transform to mem in 0.277044s (11079 normal rows, 43539 exceptions)
[2021-03-31 16:23:29.415] [E/15] [info] [Task Finished] Transform to mem in 0.277565s (11076 normal rows, 43220 exceptions)
[2021-03-31 16:23:29.415] [E/14] [info] [Task Finished] Transform to mem in 0.277923s (10987 normal rows, 43068 exceptions)
[2021-03-31 16:23:29.416] [E/6] [info] [Task Finished] Transform to mem in 0.277757s (11023 normal rows, 42880 exceptions)
[2021-03-31 16:23:29.420] [E/12] [info] [Task Finished] Transform to mem in 0.275977s (10992 normal rows, 42864 exceptions)
[2021-03-31 16:23:29.424] [E/9] [info] [Task Finished] Transform to mem in 0.281955s (11036 normal rows, 43053 exceptions)
[2021-03-31 16:23:29.688] [driver] [info] [Task Finished] Transform to mem in 0.276499s (11063 normal rows, 43617 exceptions)
[2021-03-31 16:23:29.688] [E/11] [info] [Task Finished] Transform to mem in 0.276183s (11004 normal rows, 42876 exceptions)
[2021-03-31 16:23:29.688] [E/7] [info] [Task Finished] Transform to mem in 0.276594s (11127 normal rows, 42969 exceptions)
[2021-03-31 16:23:29.688] [E/5] [info] [Task Finished] Transform to mem in 0.276381s (11076 normal rows, 43221 exceptions)
[2021-03-31 16:23:29.688] [E/2] [info] [Task Finished] Transform to mem in 0.277128s (11099 normal rows, 42882 exceptions)
[2021-03-31 16:23:29.689] [E/3] [info] [Task Finished] Transform to mem in 0.276155s (11026 normal rows, 43041 exceptions)
[2021-03-31 16:23:29.689] [E/4] [info] [Task Finished] Transform to mem in 0.276162s (11064 normal rows, 42832 exceptions)
[2021-03-31 16:23:29.689] [E/8] [info] [Task Finished] Transform to mem in 0.276926s (10987 normal rows, 43063 exceptions)
[2021-03-31 16:23:29.690] [E/10] [info] [Task Finished] Transform to mem in 0.276925s (11021 normal rows, 42887 exceptions)
[2021-03-31 16:23:29.690] [E/1] [info] [Task Finished] Transform to mem in 0.277069s (11098 normal rows, 43603 exceptions)
[2021-03-31 16:23:29.690] [E/13] [info] [Task Finished] Transform to mem in 0.276374s (11127 normal rows, 43028 exceptions)
[2021-03-31 16:23:29.692] [E/15] [info] [Task Finished] Transform to mem in 0.277226s (11076 normal rows, 43212 exceptions)
[2021-03-31 16:23:29.692] [E/14] [info] [Task Finished] Transform to mem in 0.277115s (10987 normal rows, 43041 exceptions)
[2021-03-31 16:23:29.694] [E/6] [info] [Task Finished] Transform to mem in 0.278409s (11004 normal rows, 42913 exceptions)
[2021-03-31 16:23:29.696] [E/12] [info] [Task Finished] Transform to mem in 0.275714s (11026 normal rows, 43037 exceptions)
[2021-03-31 16:23:29.705] [E/9] [info] [Task Finished] Transform to mem in 0.281559s (11012 normal rows, 42883 exceptions)
[2021-03-31 16:23:29.964] [driver] [info] [Task Finished] Transform to mem in 0.276208s (11073 normal rows, 42820 exceptions)
[2021-03-31 16:23:29.965] [E/4] [info] [Task Finished] Transform to mem in 0.275790s (11026 normal rows, 43035 exceptions)
[2021-03-31 16:23:29.965] [E/5] [info] [Task Finished] Transform to mem in 0.276537s (11076 normal rows, 43152 exceptions)
[2021-03-31 16:23:29.965] [E/2] [info] [Task Finished] Transform to mem in 0.276538s (10976 normal rows, 43110 exceptions)
[2021-03-31 16:23:29.965] [E/3] [info] [Task Finished] Transform to mem in 0.276425s (11015 normal rows, 42966 exceptions)
[2021-03-31 16:23:29.965] [E/11] [info] [Task Finished] Transform to mem in 0.276874s (11095 normal rows, 43503 exceptions)
[2021-03-31 16:23:29.965] [E/7] [info] [Task Finished] Transform to mem in 0.277034s (11130 normal rows, 43084 exceptions)
[2021-03-31 16:23:29.965] [E/8] [info] [Task Finished] Transform to mem in 0.276400s (11012 normal rows, 42888 exceptions)
[2021-03-31 16:23:29.966] [E/10] [info] [Task Finished] Transform to mem in 0.276574s (11073 normal rows, 42754 exceptions)
[2021-03-31 16:23:29.967] [E/1] [info] [Task Finished] Transform to mem in 0.276780s (11095 normal rows, 43552 exceptions)
[2021-03-31 16:23:29.967] [E/13] [info] [Task Finished] Transform to mem in 0.276700s (11130 normal rows, 43033 exceptions)
[2021-03-31 16:23:29.969] [E/15] [info] [Task Finished] Transform to mem in 0.277011s (11069 normal rows, 43142 exceptions)
[2021-03-31 16:23:29.970] [E/14] [info] [Task Finished] Transform to mem in 0.277656s (10974 normal rows, 43172 exceptions)
[2021-03-31 16:23:29.972] [E/6] [info] [Task Finished] Transform to mem in 0.278305s (11008 normal rows, 42964 exceptions)
[2021-03-31 16:23:29.972] [E/12] [info] [Task Finished] Transform to mem in 0.276038s (11042 normal rows, 43023 exceptions)
[2021-03-31 16:23:29.987] [E/9] [info] [Task Finished] Transform to mem in 0.281801s (11012 normal rows, 42911 exceptions)
[2021-03-31 16:23:30.243] [driver] [info] [Task Finished] Transform to mem in 0.278538s (11063 normal rows, 42726 exceptions)
[2021-03-31 16:23:30.244] [E/2] [info] [Task Finished] Transform to mem in 0.279429s (11087 normal rows, 43150 exceptions)
[2021-03-31 16:23:30.245] [E/5] [info] [Task Finished] Transform to mem in 0.279572s (11081 normal rows, 43050 exceptions)
[2021-03-31 16:23:30.245] [E/11] [info] [Task Finished] Transform to mem in 0.279425s (11008 normal rows, 42975 exceptions)
[2021-03-31 16:23:30.245] [E/4] [info] [Task Finished] Transform to mem in 0.279953s (11105 normal rows, 43555 exceptions)
[2021-03-31 16:23:30.245] [E/7] [info] [Task Finished] Transform to mem in 0.279286s (11042 normal rows, 42959 exceptions)
[2021-03-31 16:23:30.245] [E/8] [info] [Task Finished] Transform to mem in 0.279248s (11002 normal rows, 42964 exceptions)
[2021-03-31 16:23:30.245] [E/3] [info] [Task Finished] Transform to mem in 0.279831s (11005 normal rows, 43164 exceptions)
[2021-03-31 16:23:30.245] [E/10] [info] [Task Finished] Transform to mem in 0.279241s (11073 normal rows, 42720 exceptions)
[2021-03-31 16:23:30.247] [E/1] [info] [Task Finished] Transform to mem in 0.279961s (11088 normal rows, 43511 exceptions)
[2021-03-31 16:23:30.247] [E/13] [info] [Task Finished] Transform to mem in 0.279932s (11098 normal rows, 43112 exceptions)
[2021-03-31 16:23:30.248] [E/15] [info] [Task Finished] Transform to mem in 0.279649s (11087 normal rows, 43044 exceptions)
[2021-03-31 16:23:30.250] [E/14] [info] [Task Finished] Transform to mem in 0.280003s (11005 normal rows, 43229 exceptions)
[2021-03-31 16:23:30.251] [E/12] [info] [Task Finished] Transform to mem in 0.279001s (11024 normal rows, 42947 exceptions)
[2021-03-31 16:23:30.254] [E/6] [info] [Task Finished] Transform to mem in 0.281928s (11008 normal rows, 43017 exceptions)
[2021-03-31 16:23:30.272] [E/9] [info] [Task Finished] Transform to mem in 0.285268s (11020 normal rows, 42976 exceptions)
[2021-03-31 16:23:30.519] [driver] [info] [Task Finished] Transform to mem in 0.276151s (11036 normal rows, 42710 exceptions)
[2021-03-31 16:23:30.522] [E/11] [info] [Task Finished] Transform to mem in 0.276943s (11087 normal rows, 42938 exceptions)
[2021-03-31 16:23:30.522] [E/5] [info] [Task Finished] Transform to mem in 0.277267s (11098 normal rows, 43115 exceptions)
[2021-03-31 16:23:30.522] [E/2] [info] [Task Finished] Transform to mem in 0.277718s (11125 normal rows, 43517 exceptions)
[2021-03-31 16:23:30.522] [E/8] [info] [Task Finished] Transform to mem in 0.277498s (11052 normal rows, 42881 exceptions)
[2021-03-31 16:23:30.523] [E/7] [info] [Task Finished] Transform to mem in 0.277772s (11000 normal rows, 42999 exceptions)
[2021-03-31 16:23:30.523] [E/4] [info] [Task Finished] Transform to mem in 0.277952s (10985 normal rows, 43336 exceptions)
[2021-03-31 16:23:30.523] [E/3] [info] [Task Finished] Transform to mem in 0.278181s (11020 normal rows, 43057 exceptions)
[2021-03-31 16:23:30.524] [E/10] [info] [Task Finished] Transform to mem in 0.278110s (10995 normal rows, 42708 exceptions)
[2021-03-31 16:23:30.524] [E/13] [info] [Task Finished] Transform to mem in 0.277602s (11098 normal rows, 43075 exceptions)
[2021-03-31 16:23:30.525] [E/1] [info] [Task Finished] Transform to mem in 0.277831s (11166 normal rows, 43520 exceptions)
[2021-03-31 16:23:30.526] [E/15] [info] [Task Finished] Transform to mem in 0.277996s (11073 normal rows, 42970 exceptions)
[2021-03-31 16:23:30.528] [E/14] [info] [Task Finished] Transform to mem in 0.278687s (10999 normal rows, 43334 exceptions)
[2021-03-31 16:23:30.530] [E/12] [info] [Task Finished] Transform to mem in 0.278284s (11000 normal rows, 43009 exceptions)
[2021-03-31 16:23:30.535] [E/6] [info] [Task Finished] Transform to mem in 0.280326s (11052 normal rows, 42764 exceptions)
[2021-03-31 16:23:30.558] [E/9] [info] [Task Finished] Transform to mem in 0.285385s (11020 normal rows, 43138 exceptions)
[2021-03-31 16:23:30.797] [driver] [info] [Task Finished] Transform to mem in 0.277713s (10995 normal rows, 42726 exceptions)
[2021-03-31 16:23:30.800] [E/5] [info] [Task Finished] Transform to mem in 0.278363s (11091 normal rows, 43047 exceptions)
[2021-03-31 16:23:30.800] [E/11] [info] [Task Finished] Transform to mem in 0.278747s (11166 normal rows, 43508 exceptions)
[2021-03-31 16:23:30.800] [E/7] [info] [Task Finished] Transform to mem in 0.277934s (11000 normal rows, 43043 exceptions)
[2021-03-31 16:23:30.801] [E/8] [info] [Task Finished] Transform to mem in 0.278357s (10999 normal rows, 43300 exceptions)
[2021-03-31 16:23:30.801] [E/2] [info] [Task Finished] Transform to mem in 0.278443s (11080 normal rows, 43031 exceptions)
[2021-03-31 16:23:30.801] [E/4] [info] [Task Finished] Transform to mem in 0.278103s (11036 normal rows, 42720 exceptions)
[2021-03-31 16:23:30.802] [E/3] [info] [Task Finished] Transform to mem in 0.278510s (11016 normal rows, 43165 exceptions)
[2021-03-31 16:23:30.803] [E/10] [info] [Task Finished] Transform to mem in 0.278928s (10995 normal rows, 42718 exceptions)
[2021-03-31 16:23:30.803] [E/13] [info] [Task Finished] Transform to mem in 0.278247s (11186 normal rows, 43465 exceptions)
[2021-03-31 16:23:30.803] [E/1] [info] [Task Finished] Transform to mem in 0.278246s (11001 normal rows, 43113 exceptions)
[2021-03-31 16:23:30.804] [E/15] [info] [Task Finished] Transform to mem in 0.277915s (11170 normal rows, 43024 exceptions)
[2021-03-31 16:23:30.807] [E/12] [info] [Task Finished] Transform to mem in 0.277294s (11010 normal rows, 43002 exceptions)
[2021-03-31 16:23:30.807] [E/14] [info] [Task Finished] Transform to mem in 0.278883s (10989 normal rows, 43282 exceptions)
[2021-03-31 16:23:30.813] [E/6] [info] [Task Finished] Transform to mem in 0.278411s (11002 normal rows, 42755 exceptions)
[2021-03-31 16:23:30.840] [E/9] [info] [Task Finished] Transform to mem in 0.282181s (11050 normal rows, 43199 exceptions)
[2021-03-31 16:23:31.073] [driver] [info] [Task Finished] Transform to mem in 0.276111s (10973 normal rows, 42686 exceptions)
[2021-03-31 16:23:31.077] [E/4] [info] [Task Finished] Transform to mem in 0.275907s (11007 normal rows, 42795 exceptions)
[2021-03-31 16:23:31.077] [E/5] [info] [Task Finished] Transform to mem in 0.276491s (11160 normal rows, 43455 exceptions)
[2021-03-31 16:23:31.077] [E/7] [info] [Task Finished] Transform to mem in 0.276642s (11166 normal rows, 43023 exceptions)
[2021-03-31 16:23:31.077] [E/8] [info] [Task Finished] Transform to mem in 0.276540s (10997 normal rows, 43283 exceptions)
[2021-03-31 16:23:31.078] [E/2] [info] [Task Finished] Transform to mem in 0.277011s (11005 normal rows, 42971 exceptions)
[2021-03-31 16:23:31.078] [E/11] [info] [Task Finished] Transform to mem in 0.277871s (11045 normal rows, 43148 exceptions)
[2021-03-31 16:23:31.079] [E/3] [info] [Task Finished] Transform to mem in 0.276766s (11050 normal rows, 43196 exceptions)
[2021-03-31 16:23:31.079] [E/10] [info] [Task Finished] Transform to mem in 0.276398s (10973 normal rows, 42686 exceptions)
[2021-03-31 16:23:31.079] [E/1] [info] [Task Finished] Transform to mem in 0.276265s (11043 normal rows, 43153 exceptions)
[2021-03-31 16:23:31.079] [E/13] [info] [Task Finished] Transform to mem in 0.276758s (11160 normal rows, 43446 exceptions)
[2021-03-31 16:23:31.081] [E/15] [info] [Task Finished] Transform to mem in 0.276570s (11168 normal rows, 43028 exceptions)
[2021-03-31 16:23:31.083] [E/12] [info] [Task Finished] Transform to mem in 0.275765s (10997 normal rows, 43277 exceptions)
[2021-03-31 16:23:31.085] [E/14] [info] [Task Finished] Transform to mem in 0.277580s (10997 normal rows, 42973 exceptions)
[2021-03-31 16:23:31.091] [E/6] [info] [Task Finished] Transform to mem in 0.278162s (11015 normal rows, 42799 exceptions)
[2021-03-31 16:23:31.122] [E/9] [info] [Task Finished] Transform to mem in 0.282300s (11050 normal rows, 43170 exceptions)
[2021-03-31 16:23:31.349] [driver] [info] [Task Finished] Transform to mem in 0.276114s (10973 normal rows, 42710 exceptions)
[2021-03-31 16:23:31.352] [E/5] [info] [Task Finished] Transform to mem in 0.275458s (11043 normal rows, 43166 exceptions)
[2021-03-31 16:23:31.354] [E/8] [info] [Task Finished] Transform to mem in 0.276353s (10997 normal rows, 43237 exceptions)
[2021-03-31 16:23:31.354] [E/4] [info] [Task Finished] Transform to mem in 0.276844s (11160 normal rows, 43431 exceptions)
[2021-03-31 16:23:31.354] [E/11] [info] [Task Finished] Transform to mem in 0.275599s (11009 normal rows, 42805 exceptions)
[2021-03-31 16:23:31.355] [E/2] [info] [Task Finished] Transform to mem in 0.277013s (10997 normal rows, 43012 exceptions)
[2021-03-31 16:23:31.355] [E/3] [info] [Task Finished] Transform to mem in 0.276363s (11021 normal rows, 43160 exceptions)
[2021-03-31 16:23:31.355] [E/7] [info] [Task Finished] Transform to mem in 0.277940s (11168 normal rows, 43027 exceptions)
[2021-03-31 16:23:31.355] [E/10] [info] [Task Finished] Transform to mem in 0.276285s (11003 normal rows, 42716 exceptions)
[2021-03-31 16:23:31.356] [E/1] [info] [Task Finished] Transform to mem in 0.276860s (11165 normal rows, 43354 exceptions)
[2021-03-31 16:23:31.356] [E/13] [info] [Task Finished] Transform to mem in 0.277044s (11043 normal rows, 43217 exceptions)
[2021-03-31 16:23:31.358] [E/15] [info] [Task Finished] Transform to mem in 0.276549s (11156 normal rows, 43044 exceptions)
[2021-03-31 16:23:31.359] [E/12] [info] [Task Finished] Transform to mem in 0.276221s (11009 normal rows, 43187 exceptions)
[2021-03-31 16:23:31.362] [E/14] [info] [Task Finished] Transform to mem in 0.277221s (10997 normal rows, 43067 exceptions)
[2021-03-31 16:23:31.370] [E/6] [info] [Task Finished] Transform to mem in 0.278320s (11009 normal rows, 42811 exceptions)
[2021-03-31 16:23:31.405] [E/9] [info] [Task Finished] Transform to mem in 0.282192s (11021 normal rows, 43162 exceptions)
[2021-03-31 16:23:31.625] [driver] [info] [Task Finished] Transform to mem in 0.275618s (11003 normal rows, 42716 exceptions)
[2021-03-31 16:23:31.628] [E/5] [info] [Task Finished] Transform to mem in 0.276172s (11165 normal rows, 43260 exceptions)
[2021-03-31 16:23:31.630] [E/11] [info] [Task Finished] Transform to mem in 0.275811s (10997 normal rows, 43177 exceptions)
[2021-03-31 16:23:31.630] [E/8] [info] [Task Finished] Transform to mem in 0.276590s (11027 normal rows, 43245 exceptions)
[2021-03-31 16:23:31.630] [E/4] [info] [Task Finished] Transform to mem in 0.276604s (11172 normal rows, 43107 exceptions)
[2021-03-31 16:23:31.631] [E/2] [info] [Task Finished] Transform to mem in 0.276523s (11009 normal rows, 43050 exceptions)
[2021-03-31 16:23:31.631] [E/10] [info] [Task Finished] Transform to mem in 0.275981s (11000 normal rows, 42726 exceptions)
[2021-03-31 16:23:31.631] [E/3] [info] [Task Finished] Transform to mem in 0.276515s (10999 normal rows, 42828 exceptions)
[2021-03-31 16:23:31.632] [E/7] [info] [Task Finished] Transform to mem in 0.276733s (11031 normal rows, 43157 exceptions)
[2021-03-31 16:23:31.632] [E/1] [info] [Task Finished] Transform to mem in 0.275978s (11091 normal rows, 43230 exceptions)
[2021-03-31 16:23:31.633] [E/13] [info] [Task Finished] Transform to mem in 0.276190s (11099 normal rows, 43272 exceptions)
[2021-03-31 16:23:31.635] [E/15] [info] [Task Finished] Transform to mem in 0.276937s (11177 normal rows, 43113 exceptions)
[2021-03-31 16:23:31.635] [E/12] [info] [Task Finished] Transform to mem in 0.276402s (10997 normal rows, 43174 exceptions)
[2021-03-31 16:23:31.639] [E/14] [info] [Task Finished] Transform to mem in 0.276873s (10987 normal rows, 43020 exceptions)
[2021-03-31 16:23:31.648] [E/6] [info] [Task Finished] Transform to mem in 0.278058s (11020 normal rows, 42867 exceptions)
[2021-03-31 16:23:31.721] [E/9] [info] [Task Finished] Transform to mem in 0.315915s (12330 normal rows, 48094 exceptions)
[2021-03-31 16:23:31.721] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.86448s
[2021-03-31 16:23:31.721] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.5045s, 56350770 input rows, time to process 1 row via fast path: 0.000789776ms
[2021-03-31 16:23:31.721] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-31 16:23:31.725] [local ee] [info] compiled pure python pipeline in 0.004375s
[2021-03-31 16:23:31.725] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 16:23:31.726] [local ee] [info] Created 160 resolve tasks in 0.001228s
[2021-03-31 16:23:31.726] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 16:24:37.323] [E/9] [info] [Task Finished] Resolve in 65.596663s
[2021-03-31 16:24:40.529] [E/4] [info] [Task Finished] Resolve in 68.802240s
[2021-03-31 16:24:42.252] [E/7] [info] [Task Finished] Resolve in 70.525906s
[2021-03-31 16:24:43.008] [E/15] [info] [Task Finished] Resolve in 71.281675s
[2021-03-31 16:24:43.319] [E/13] [info] [Task Finished] Resolve in 71.592586s
[2021-03-31 16:24:44.821] [driver] [info] [Task Finished] Resolve in 73.094479s
[2021-03-31 16:24:45.229] [E/5] [info] [Task Finished] Resolve in 73.502358s
[2021-03-31 16:24:46.351] [E/11] [info] [Task Finished] Resolve in 74.624850s
[2021-03-31 16:24:47.375] [E/6] [info] [Task Finished] Resolve in 75.648202s
[2021-03-31 16:24:48.535] [E/3] [info] [Task Finished] Resolve in 76.808345s
[2021-03-31 16:24:50.716] [E/1] [info] [Task Finished] Resolve in 78.989573s
[2021-03-31 16:24:51.096] [E/14] [info] [Task Finished] Resolve in 79.369656s
[2021-03-31 16:24:52.792] [E/2] [info] [Task Finished] Resolve in 81.065784s
[2021-03-31 16:24:55.691] [E/10] [info] [Task Finished] Resolve in 83.964212s
[2021-03-31 16:24:58.911] [E/8] [info] [Task Finished] Resolve in 87.184380s
[2021-03-31 16:25:06.112] [E/12] [info] [Task Finished] Resolve in 94.385533s
[2021-03-31 16:25:49.386] [E/5] [info] [Task Finished] Resolve in 64.157690s
[2021-03-31 16:25:56.354] [E/7] [info] [Task Finished] Resolve in 74.101547s
[2021-03-31 16:25:57.379] [E/10] [info] [Task Finished] Resolve in 61.688732s
[2021-03-31 16:25:58.093] [E/4] [info] [Task Finished] Resolve in 77.564426s
[2021-03-31 16:25:58.403] [E/9] [info] [Task Finished] Resolve in 81.080376s
[2021-03-31 16:26:01.726] [E/6] [info] [Task Finished] Resolve in 74.351420s
[2021-03-31 16:26:02.915] [E/2] [info] [Task Finished] Resolve in 70.123027s
[2021-03-31 16:26:04.773] [E/12] [info] [Task Finished] Resolve in 58.661024s
[2021-03-31 16:26:07.714] [E/13] [info] [Task Finished] Resolve in 84.395442s
[2021-03-31 16:26:08.276] [driver] [info] [Task Finished] Resolve in 83.454939s
[2021-03-31 16:26:08.789] [E/14] [info] [Task Finished] Resolve in 77.693316s
[2021-03-31 16:26:09.546] [E/1] [info] [Task Finished] Resolve in 78.830334s
[2021-03-31 16:26:10.483] [E/8] [info] [Task Finished] Resolve in 71.571996s
[2021-03-31 16:26:11.935] [E/15] [info] [Task Finished] Resolve in 88.927110s
[2021-03-31 16:26:15.368] [E/11] [info] [Task Finished] Resolve in 89.016972s
[2021-03-31 16:26:30.172] [E/3] [info] [Task Finished] Resolve in 101.637383s
[2021-03-31 16:26:59.344] [E/5] [info] [Task Finished] Resolve in 69.957046s
[2021-03-31 16:27:06.411] [E/10] [info] [Task Finished] Resolve in 69.031530s
[2021-03-31 16:27:12.825] [E/13] [info] [Task Finished] Resolve in 65.110789s
[2021-03-31 16:27:15.682] [E/11] [info] [Task Finished] Resolve in 60.313687s
[2021-03-31 16:27:16.343] [E/7] [info] [Task Finished] Resolve in 79.989220s
[2021-03-31 16:27:16.392] [E/6] [info] [Task Finished] Resolve in 74.665723s
[2021-03-31 16:27:17.566] [E/2] [info] [Task Finished] Resolve in 74.651076s
[2021-03-31 16:27:18.758] [E/4] [info] [Task Finished] Resolve in 80.665078s
[2021-03-31 16:27:19.258] [E/9] [info] [Task Finished] Resolve in 80.854876s
[2021-03-31 16:27:22.820] [E/14] [info] [Task Finished] Resolve in 74.030258s
[2021-03-31 16:27:27.749] [driver] [info] [Task Finished] Resolve in 79.473489s
[2021-03-31 16:27:27.807] [E/12] [info] [Task Finished] Resolve in 83.033812s
[2021-03-31 16:27:32.277] [E/8] [info] [Task Finished] Resolve in 81.794368s
[2021-03-31 16:27:34.134] [E/1] [info] [Task Finished] Resolve in 84.587399s
[2021-03-31 16:27:40.190] [E/15] [info] [Task Finished] Resolve in 88.254716s
[2021-03-31 16:27:50.624] [E/3] [info] [Task Finished] Resolve in 80.451648s
[2021-03-31 16:28:10.270] [E/5] [info] [Task Finished] Resolve in 70.926646s
[2021-03-31 16:28:26.518] [E/6] [info] [Task Finished] Resolve in 70.126042s
[2021-03-31 16:28:27.094] [E/10] [info] [Task Finished] Resolve in 80.683439s
[2021-03-31 16:28:28.986] [E/11] [info] [Task Finished] Resolve in 73.304428s
[2021-03-31 16:28:32.406] [E/7] [info] [Task Finished] Resolve in 76.062345s
[2021-03-31 16:28:32.608] [E/4] [info] [Task Finished] Resolve in 73.849341s
[2021-03-31 16:28:35.632] [E/14] [info] [Task Finished] Resolve in 72.811841s
[2021-03-31 16:28:37.131] [E/9] [info] [Task Finished] Resolve in 77.872883s
[2021-03-31 16:28:39.865] [E/8] [info] [Task Finished] Resolve in 67.587533s
[2021-03-31 16:28:42.992] [E/2] [info] [Task Finished] Resolve in 85.425960s
[2021-03-31 16:28:45.450] [E/13] [info] [Task Finished] Resolve in 92.624488s
[2021-03-31 16:28:45.812] [E/3] [info] [Task Finished] Resolve in 55.187953s
[2021-03-31 16:28:47.626] [E/1] [info] [Task Finished] Resolve in 73.491869s
[2021-03-31 16:28:52.479] [E/15] [info] [Task Finished] Resolve in 72.288705s
[2021-03-31 16:28:56.112] [E/12] [info] [Task Finished] Resolve in 88.305066s
[2021-03-31 16:28:58.193] [driver] [info] [Task Finished] Resolve in 90.443295s
[2021-03-31 16:29:18.695] [E/5] [info] [Task Finished] Resolve in 68.425137s
[2021-03-31 16:29:30.787] [E/10] [info] [Task Finished] Resolve in 63.692710s
[2021-03-31 16:29:46.344] [E/7] [info] [Task Finished] Resolve in 73.938478s
[2021-03-31 16:29:48.653] [E/6] [info] [Task Finished] Resolve in 82.134862s
[2021-03-31 16:29:52.215] [E/2] [info] [Task Finished] Resolve in 69.222453s
[2021-03-31 16:29:52.561] [E/13] [info] [Task Finished] Resolve in 67.110867s
[2021-03-31 16:29:55.143] [E/11] [info] [Task Finished] Resolve in 86.156378s
[2021-03-31 16:29:56.453] [E/4] [info] [Task Finished] Resolve in 83.845332s
[2021-03-31 16:30:00.751] [E/1] [info] [Task Finished] Resolve in 73.125346s
[2021-03-31 16:30:02.948] [E/12] [info] [Task Finished] Resolve in 66.836378s
[2021-03-31 16:30:04.805] [E/3] [info] [Task Finished] Resolve in 78.992735s
[2021-03-31 16:30:05.311] [E/8] [info] [Task Finished] Resolve in 85.446427s
[2021-03-31 16:30:05.324] [E/14] [info] [Task Finished] Resolve in 89.692216s
[2021-03-31 16:30:07.592] [E/9] [info] [Task Finished] Resolve in 90.460387s
[2021-03-31 16:30:12.356] [E/15] [info] [Task Finished] Resolve in 79.877356s
[2021-03-31 16:30:28.736] [E/5] [info] [Task Finished] Resolve in 70.040418s
[2021-03-31 16:30:29.723] [driver] [info] [Task Finished] Resolve in 91.530157s
[2021-03-31 16:30:47.475] [E/10] [info] [Task Finished] Resolve in 76.688049s
[2021-03-31 16:30:49.304] [E/7] [info] [Task Finished] Resolve in 62.959945s
[2021-03-31 16:30:58.701] [E/6] [info] [Task Finished] Resolve in 70.047890s
[2021-03-31 16:31:04.017] [E/13] [info] [Task Finished] Resolve in 71.456628s
[2021-03-31 16:31:04.607] [E/4] [info] [Task Finished] Resolve in 68.153691s
[2021-03-31 16:31:08.892] [E/2] [info] [Task Finished] Resolve in 76.676771s
[2021-03-31 16:31:13.143] [E/11] [info] [Task Finished] Resolve in 77.999977s
[2021-03-31 16:31:15.999] [E/12] [info] [Task Finished] Resolve in 73.050834s
[2021-03-31 16:31:16.543] [E/1] [info] [Task Finished] Resolve in 75.792299s
[2021-03-31 16:31:22.075] [E/14] [info] [Task Finished] Resolve in 76.751421s
[2021-03-31 16:31:28.577] [E/15] [info] [Task Finished] Resolve in 76.220465s
[2021-03-31 16:31:29.742] [E/8] [info] [Task Finished] Resolve in 84.430797s
[2021-03-31 16:31:34.565] [E/9] [info] [Task Finished] Resolve in 86.973079s
[2021-03-31 16:31:35.595] [E/3] [info] [Task Finished] Resolve in 90.790664s
[2021-03-31 16:31:50.486] [E/5] [info] [Task Finished] Resolve in 81.750108s
[2021-03-31 16:31:53.047] [driver] [info] [Task Finished] Resolve in 83.324362s
[2021-03-31 16:32:03.137] [E/10] [info] [Task Finished] Resolve in 75.661454s
[2021-03-31 16:32:10.004] [E/13] [info] [Task Finished] Resolve in 65.986424s
[2021-03-31 16:32:10.541] [E/7] [info] [Task Finished] Resolve in 81.236595s
[2021-03-31 16:32:10.684] [E/2] [info] [Task Finished] Resolve in 61.792534s
[2021-03-31 16:32:19.742] [E/6] [info] [Task Finished] Resolve in 81.041127s
[2021-03-31 16:32:20.990] [E/4] [info] [Task Finished] Resolve in 76.383620s
[2021-03-31 16:32:22.212] [E/14] [info] [Task Finished] Resolve in 60.137033s
[2021-03-31 16:32:27.014] [E/11] [info] [Task Finished] Resolve in 73.871508s
[2021-03-31 16:32:31.313] [E/1] [info] [Task Finished] Resolve in 74.769767s
[2021-03-31 16:32:31.445] [E/12] [info] [Task Finished] Resolve in 75.445869s
[2021-03-31 16:32:43.103] [E/8] [info] [Task Finished] Resolve in 73.360945s
[2021-03-31 16:32:49.747] [E/9] [info] [Task Finished] Resolve in 75.181917s
[2021-03-31 16:32:51.173] [E/15] [info] [Task Finished] Resolve in 82.596101s
[2021-03-31 16:32:52.939] [E/3] [info] [Task Finished] Resolve in 77.344175s
[2021-03-31 16:33:01.357] [E/5] [info] [Task Finished] Resolve in 70.871010s
[2021-03-31 16:33:16.719] [driver] [info] [Task Finished] Resolve in 83.671617s
[2021-03-31 16:33:23.127] [E/10] [info] [Task Finished] Resolve in 79.990598s
[2021-03-31 16:33:32.634] [E/7] [info] [Task Finished] Resolve in 82.092883s
[2021-03-31 16:33:34.197] [E/13] [info] [Task Finished] Resolve in 84.193109s
[2021-03-31 16:33:35.170] [E/11] [info] [Task Finished] Resolve in 68.155743s
[2021-03-31 16:33:35.651] [E/6] [info] [Task Finished] Resolve in 75.908830s
[2021-03-31 16:33:36.300] [E/14] [info] [Task Finished] Resolve in 74.088079s
[2021-03-31 16:33:37.721] [E/2] [info] [Task Finished] Resolve in 87.036506s
[2021-03-31 16:33:40.511] [E/4] [info] [Task Finished] Resolve in 79.520640s
[2021-03-31 16:33:49.261] [E/1] [info] [Task Finished] Resolve in 77.947438s
[2021-03-31 16:33:50.838] [E/8] [info] [Task Finished] Resolve in 67.734470s
[2021-03-31 16:33:55.282] [E/9] [info] [Task Finished] Resolve in 65.535369s
[2021-03-31 16:33:57.472] [E/12] [info] [Task Finished] Resolve in 86.026416s
[2021-03-31 16:33:58.970] [E/15] [info] [Task Finished] Resolve in 67.797241s
[2021-03-31 16:34:13.850] [E/5] [info] [Task Finished] Resolve in 72.493392s
[2021-03-31 16:34:22.457] [E/3] [info] [Task Finished] Resolve in 89.517629s
[2021-03-31 16:34:37.753] [E/10] [info] [Task Finished] Resolve in 74.625718s
[2021-03-31 16:34:40.871] [driver] [info] [Task Finished] Resolve in 84.152267s
[2021-03-31 16:34:49.379] [E/7] [info] [Task Finished] Resolve in 76.744960s
[2021-03-31 16:34:50.450] [E/2] [info] [Task Finished] Resolve in 72.729688s
[2021-03-31 16:34:55.666] [E/13] [info] [Task Finished] Resolve in 81.469150s
[2021-03-31 16:34:56.580] [E/11] [info] [Task Finished] Resolve in 81.409436s
[2021-03-31 16:34:59.153] [E/4] [info] [Task Finished] Resolve in 78.641994s
[2021-03-31 16:34:59.873] [E/14] [info] [Task Finished] Resolve in 83.572426s
[2021-03-31 16:35:04.467] [E/12] [info] [Task Finished] Resolve in 66.995419s
[2021-03-31 16:35:06.383] [E/6] [info] [Task Finished] Resolve in 90.732294s
[2021-03-31 16:35:10.136] [E/15] [info] [Task Finished] Resolve in 71.165705s
[2021-03-31 16:35:11.306] [E/9] [info] [Task Finished] Resolve in 76.023895s
[2021-03-31 16:35:16.536] [E/1] [info] [Task Finished] Resolve in 87.275310s
[2021-03-31 16:35:20.623] [E/8] [info] [Task Finished] Resolve in 89.785735s
[2021-03-31 16:35:37.440] [E/3] [info] [Task Finished] Resolve in 74.982917s
[2021-03-31 16:35:44.791] [E/10] [info] [Task Finished] Resolve in 67.037864s
[2021-03-31 16:35:46.921] [E/5] [info] [Task Finished] Resolve in 93.070594s
[2021-03-31 16:35:48.656] [E/7] [info] [Task Finished] Resolve in 59.277609s
[2021-03-31 16:35:49.814] [E/2] [info] [Task Finished] Resolve in 59.363247s
[2021-03-31 16:36:00.874] [E/4] [info] [Task Finished] Resolve in 61.721371s
[2021-03-31 16:36:01.794] [driver] [info] [Task Finished] Resolve in 80.922719s
[2021-03-31 16:36:06.830] [E/13] [info] [Task Finished] Resolve in 71.163918s
[2021-03-31 16:36:09.969] [E/12] [info] [Task Finished] Resolve in 65.501515s
[2021-03-31 16:36:12.088] [E/9] [info] [Task Finished] Resolve in 60.782036s
[2021-03-31 16:36:13.217] [E/11] [info] [Task Finished] Resolve in 76.636877s
[2021-03-31 16:36:13.386] [E/14] [info] [Task Finished] Resolve in 73.513439s
[2021-03-31 16:36:13.867] [E/6] [info] [Task Finished] Resolve in 67.484227s
[2021-03-31 16:36:14.596] [E/15] [info] [Task Finished] Resolve in 64.460493s
[2021-03-31 16:36:15.148] [E/1] [info] [Task Finished] Resolve in 58.612398s
[2021-03-31 16:36:16.455] [E/8] [info] [Task Finished] Resolve in 55.831959s
[2021-03-31 16:36:17.888] [E/3] [info] [Task Finished] Resolve in 40.447887s
[2021-03-31 16:36:19.281] [E/10] [info] [Task Finished] Resolve in 34.489712s
[2021-03-31 16:36:19.281] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 767.56s
[2021-03-31 16:36:19.281] [local ee] [info] slow path for Stage 0: total wall clock time: 12093.2s, time to process 1 row via slow path: 1.75367ms
[2021-03-31 16:36:19.281] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 767.56s

[2021-03-31 16:36:19.310] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-31 16:36:19.324] [driver] [info] [Task Finished] write to file in 0.014114s (46082 rows, 7.01 MB)
[2021-03-31 16:36:19.343] [E/7] [info] [Task Finished] write to file in 0.033052s (112459 rows, 17.11 MB)
[2021-03-31 16:36:19.343] [E/13] [info] [Task Finished] write to file in 0.033168s (112425 rows, 17.10 MB)
[2021-03-31 16:36:19.343] [E/12] [info] [Task Finished] write to file in 0.033403s (112583 rows, 17.13 MB)
[2021-03-31 16:36:19.343] [E/14] [info] [Task Finished] write to file in 0.033430s (112482 rows, 17.11 MB)
[2021-03-31 16:36:19.343] [E/4] [info] [Task Finished] write to file in 0.033499s (112573 rows, 17.12 MB)
[2021-03-31 16:36:19.343] [E/3] [info] [Task Finished] write to file in 0.033530s (112467 rows, 17.11 MB)
[2021-03-31 16:36:19.343] [E/6] [info] [Task Finished] write to file in 0.033522s (112438 rows, 17.10 MB)
[2021-03-31 16:36:19.343] [E/15] [info] [Task Finished] write to file in 0.033592s (112421 rows, 17.10 MB)
[2021-03-31 16:36:19.344] [E/9] [info] [Task Finished] write to file in 0.034780s (123377 rows, 18.77 MB)
[2021-03-31 16:36:19.345] [E/5] [info] [Task Finished] write to file in 0.034967s (123299 rows, 18.76 MB)
[2021-03-31 16:36:19.345] [E/10] [info] [Task Finished] write to file in 0.035103s (123410 rows, 18.78 MB)
[2021-03-31 16:36:19.345] [E/11] [info] [Task Finished] write to file in 0.035118s (123251 rows, 18.75 MB)
[2021-03-31 16:36:19.345] [E/2] [info] [Task Finished] write to file in 0.035138s (123389 rows, 18.77 MB)
[2021-03-31 16:36:19.345] [E/8] [info] [Task Finished] write to file in 0.035176s (123424 rows, 18.78 MB)
[2021-03-31 16:36:19.346] [E/1] [info] [Task Finished] write to file in 0.035915s (112411 rows, 17.10 MB)
[2021-03-31 16:36:19.346] [global] [info] writing output took 0.064661s
[2021-03-31 16:36:19.346] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0647537s
[2021-03-31 16:36:19.346] [global] [info] [Transform Stage] Stage 0 took 770.992s
[2021-03-31 16:36:19.346] [global] [info] Query Execution took 771.072s. (planning: 0.0793699s, execution: 770.992s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 12:55:20) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005476951599121094
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 771.3560235500336 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '499bbd619a75', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0226347,"llvm_optimization_time_s":0.333342,"llvm_compilation_time_s":0.151796,"total_compilation_time_s":0.502733,"sampling_time_s":0.111103,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.5045,"fast_path_time_s":2.8645,"fast_path_per_row_time_ns":789.776,"slow_path_wall_time_s":12093.2,"slow_path_time_s":767.56,"slow_path_per_row_time_ns":1.75367e+06}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.005476951599121094, "jobTime": 771.3560235500336, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-31 16:36:27.425] [local execution engine] [info] Stopped local executor E/1
[2021-03-31 16:36:27.430] [local execution engine] [info] Stopped local executor E/2
[2021-03-31 16:36:27.435] [local execution engine] [info] Stopped local executor E/3
[2021-03-31 16:36:27.441] [local execution engine] [info] Stopped local executor E/4
[2021-03-31 16:36:27.446] [local execution engine] [info] Stopped local executor E/5
[2021-03-31 16:36:27.451] [local execution engine] [info] Stopped local executor E/6
[2021-03-31 16:36:27.456] [local execution engine] [info] Stopped local executor E/7
[2021-03-31 16:36:27.461] [local execution engine] [info] Stopped local executor E/8
[2021-03-31 16:36:27.466] [local execution engine] [info] Stopped local executor E/9
[2021-03-31 16:36:27.471] [local execution engine] [info] Stopped local executor E/10
[2021-03-31 16:36:27.476] [local execution engine] [info] Stopped local executor E/11
[2021-03-31 16:36:27.481] [local execution engine] [info] Stopped local executor E/12
[2021-03-31 16:36:27.486] [local execution engine] [info] Stopped local executor E/13
[2021-03-31 16:36:27.491] [local execution engine] [info] Stopped local executor E/14
[2021-03-31 16:36:27.496] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
