[2021-03-25 10:29:22.023] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:29:22.023] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:29:22.023] [local ee] [info] initializing LLVM backend
[2021-03-25 10:29:22.023] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:29:22.023] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.024] [E/1] [info] starting detached process queue
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.024] [E/2] [info] starting detached process queue
[2021-03-25 10:29:22.024] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.024] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.024] [E/3] [info] starting detached process queue
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.024] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.024] [E/4] [info] starting detached process queue
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.024] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.024] [E/5] [info] starting detached process queue
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.024] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.024] [E/6] [info] starting detached process queue
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.024] [E/7] [info] starting detached process queue
[2021-03-25 10:29:22.024] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.024] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.024] [E/8] [info] starting detached process queue
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.024] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.024] [E/9] [info] starting detached process queue
[2021-03-25 10:29:22.024] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.025] [E/10] [info] starting detached process queue
[2021-03-25 10:29:22.025] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.025] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.025] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.025] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.025] [E/11] [info] starting detached process queue
[2021-03-25 10:29:22.025] [E/12] [info] starting detached process queue
[2021-03-25 10:29:22.025] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.025] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.025] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.025] [E/13] [info] starting detached process queue
[2021-03-25 10:29:22.025] [E/14] [info] starting detached process queue
[2021-03-25 10:29:22.025] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.025] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.025] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.025] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:22.025] [E/15] [info] starting detached process queue
[2021-03-25 10:29:22.025] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 10:29:22.025] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:29:22.025] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:22.025] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:29:22.025] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:29:22.163] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:22.169] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:22.185] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:22.193] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:22.220] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:22.241] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:22.254] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:22.287] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:22.293] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:22.309] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:22.311] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:22.312] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:22.313] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:22.314] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:22.316] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:22.316] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:22.318] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:22.319] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:22.319] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:22.336] [logical planner] [info] logical optimization took 0.022789ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:29:22.336] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:22.336] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:22.337] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:22.338] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:22.339] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:22.339] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:22.340] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:22.341] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:22.342] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:22.343] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:22.343] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:22.345] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:22.345] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:22.346] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:22.347] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:22.348] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:22.349] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:22.349] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:22.350] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:22.351] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:22.351] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:22.352] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:22.353] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:22.354] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:22.355] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:22.356] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:22.357] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:22.357] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:22.358] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:22.390] [global] [info] Stage0 depends on: 
[2021-03-25 10:29:22.741] [global] [info] Optimization via LLVM passes took 0.333339 ms
[2021-03-25 10:29:22.893] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:29:22.893] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.503486s
[2021-03-25 10:29:22.894] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:29:23.176] [E/9] [info] [Task Finished] Transform to mem in 0.281674s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:29:23.176] [E/7] [info] [Task Finished] Transform to mem in 0.281899s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:29:23.176] [E/12] [info] [Task Finished] Transform to mem in 0.282114s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:29:23.176] [E/8] [info] [Task Finished] Transform to mem in 0.282164s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:29:23.176] [E/4] [info] [Task Finished] Transform to mem in 0.282163s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:29:23.176] [E/14] [info] [Task Finished] Transform to mem in 0.282193s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:29:23.176] [E/5] [info] [Task Finished] Transform to mem in 0.282208s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:29:23.176] [E/6] [info] [Task Finished] Transform to mem in 0.282279s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:29:23.176] [E/13] [info] [Task Finished] Transform to mem in 0.282530s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:29:23.176] [E/11] [info] [Task Finished] Transform to mem in 0.282553s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:29:23.177] [driver] [info] [Task Finished] Transform to mem in 0.282923s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:29:23.177] [E/15] [info] [Task Finished] Transform to mem in 0.282932s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:29:23.177] [E/10] [info] [Task Finished] Transform to mem in 0.283131s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:29:23.177] [E/1] [info] [Task Finished] Transform to mem in 0.283444s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:29:23.179] [E/3] [info] [Task Finished] Transform to mem in 0.284878s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:29:23.180] [E/2] [info] [Task Finished] Transform to mem in 0.285706s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:29:23.455] [E/9] [info] [Task Finished] Transform to mem in 0.279028s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:29:23.455] [E/6] [info] [Task Finished] Transform to mem in 0.278505s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:29:23.455] [E/14] [info] [Task Finished] Transform to mem in 0.278667s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:29:23.455] [E/8] [info] [Task Finished] Transform to mem in 0.278796s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:29:23.455] [E/4] [info] [Task Finished] Transform to mem in 0.279063s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:29:23.455] [E/12] [info] [Task Finished] Transform to mem in 0.279153s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:29:23.455] [E/13] [info] [Task Finished] Transform to mem in 0.278960s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:29:23.455] [E/7] [info] [Task Finished] Transform to mem in 0.279590s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:29:23.456] [E/5] [info] [Task Finished] Transform to mem in 0.279920s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:29:23.456] [E/15] [info] [Task Finished] Transform to mem in 0.279352s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:29:23.456] [E/10] [info] [Task Finished] Transform to mem in 0.279281s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:29:23.456] [E/11] [info] [Task Finished] Transform to mem in 0.279909s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:29:23.457] [driver] [info] [Task Finished] Transform to mem in 0.279881s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:29:23.457] [E/1] [info] [Task Finished] Transform to mem in 0.280081s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:29:23.458] [E/2] [info] [Task Finished] Transform to mem in 0.278595s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:29:23.460] [E/3] [info] [Task Finished] Transform to mem in 0.281072s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:29:23.734] [E/8] [info] [Task Finished] Transform to mem in 0.278759s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:29:23.734] [E/14] [info] [Task Finished] Transform to mem in 0.279060s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:29:23.734] [E/12] [info] [Task Finished] Transform to mem in 0.278719s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:29:23.734] [E/6] [info] [Task Finished] Transform to mem in 0.279366s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:29:23.734] [E/7] [info] [Task Finished] Transform to mem in 0.278930s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:29:23.735] [E/4] [info] [Task Finished] Transform to mem in 0.279367s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:29:23.735] [E/5] [info] [Task Finished] Transform to mem in 0.278845s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:29:23.736] [E/10] [info] [Task Finished] Transform to mem in 0.279310s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:29:23.736] [E/11] [info] [Task Finished] Transform to mem in 0.279593s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:29:23.736] [E/15] [info] [Task Finished] Transform to mem in 0.279811s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:29:23.736] [E/9] [info] [Task Finished] Transform to mem in 0.281409s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:29:23.738] [driver] [info] [Task Finished] Transform to mem in 0.280857s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:29:23.738] [E/13] [info] [Task Finished] Transform to mem in 0.282732s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:29:23.738] [E/1] [info] [Task Finished] Transform to mem in 0.280945s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:29:23.740] [E/2] [info] [Task Finished] Transform to mem in 0.281466s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:29:23.741] [E/3] [info] [Task Finished] Transform to mem in 0.281069s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:29:24.013] [E/8] [info] [Task Finished] Transform to mem in 0.278875s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:29:24.013] [E/14] [info] [Task Finished] Transform to mem in 0.279300s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:29:24.013] [E/6] [info] [Task Finished] Transform to mem in 0.279105s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:29:24.013] [E/12] [info] [Task Finished] Transform to mem in 0.279314s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:29:24.013] [E/7] [info] [Task Finished] Transform to mem in 0.278914s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:29:24.014] [E/4] [info] [Task Finished] Transform to mem in 0.279020s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:29:24.014] [E/5] [info] [Task Finished] Transform to mem in 0.278792s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:29:24.014] [E/10] [info] [Task Finished] Transform to mem in 0.278623s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:29:24.015] [E/11] [info] [Task Finished] Transform to mem in 0.279233s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:29:24.016] [E/15] [info] [Task Finished] Transform to mem in 0.279698s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:29:24.017] [driver] [info] [Task Finished] Transform to mem in 0.279909s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:29:24.018] [E/9] [info] [Task Finished] Transform to mem in 0.281667s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:29:24.019] [E/1] [info] [Task Finished] Transform to mem in 0.280215s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:29:24.019] [E/2] [info] [Task Finished] Transform to mem in 0.278980s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:29:24.021] [E/13] [info] [Task Finished] Transform to mem in 0.282793s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:29:24.022] [E/3] [info] [Task Finished] Transform to mem in 0.281090s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:29:24.291] [E/8] [info] [Task Finished] Transform to mem in 0.278688s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:29:24.292] [E/12] [info] [Task Finished] Transform to mem in 0.278745s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:29:24.292] [E/14] [info] [Task Finished] Transform to mem in 0.278995s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:29:24.292] [E/7] [info] [Task Finished] Transform to mem in 0.279033s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:29:24.292] [E/6] [info] [Task Finished] Transform to mem in 0.279142s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:29:24.292] [E/4] [info] [Task Finished] Transform to mem in 0.278801s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:29:24.293] [E/5] [info] [Task Finished] Transform to mem in 0.278860s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:29:24.293] [E/10] [info] [Task Finished] Transform to mem in 0.278991s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:29:24.294] [E/11] [info] [Task Finished] Transform to mem in 0.279272s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:29:24.295] [E/15] [info] [Task Finished] Transform to mem in 0.279756s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:29:24.297] [driver] [info] [Task Finished] Transform to mem in 0.279844s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:29:24.299] [E/1] [info] [Task Finished] Transform to mem in 0.280394s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:29:24.300] [E/9] [info] [Task Finished] Transform to mem in 0.281970s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:29:24.300] [E/2] [info] [Task Finished] Transform to mem in 0.281731s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:29:24.303] [E/3] [info] [Task Finished] Transform to mem in 0.281080s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:29:24.303] [E/13] [info] [Task Finished] Transform to mem in 0.282299s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:29:24.570] [E/8] [info] [Task Finished] Transform to mem in 0.278770s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:29:24.571] [E/7] [info] [Task Finished] Transform to mem in 0.278999s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:29:24.571] [E/12] [info] [Task Finished] Transform to mem in 0.279443s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:29:24.571] [E/5] [info] [Task Finished] Transform to mem in 0.278873s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:29:24.571] [E/14] [info] [Task Finished] Transform to mem in 0.279312s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:29:24.572] [E/6] [info] [Task Finished] Transform to mem in 0.279747s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:29:24.573] [E/4] [info] [Task Finished] Transform to mem in 0.280167s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:29:24.573] [E/10] [info] [Task Finished] Transform to mem in 0.279412s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:29:24.574] [E/11] [info] [Task Finished] Transform to mem in 0.279458s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:29:24.576] [E/15] [info] [Task Finished] Transform to mem in 0.280044s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:29:24.578] [driver] [info] [Task Finished] Transform to mem in 0.280324s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:29:24.580] [E/1] [info] [Task Finished] Transform to mem in 0.280552s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:29:24.580] [E/2] [info] [Task Finished] Transform to mem in 0.279275s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:29:24.581] [E/9] [info] [Task Finished] Transform to mem in 0.281649s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:29:24.584] [E/3] [info] [Task Finished] Transform to mem in 0.280947s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:29:24.586] [E/13] [info] [Task Finished] Transform to mem in 0.283023s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:29:24.849] [E/8] [info] [Task Finished] Transform to mem in 0.278711s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:29:24.850] [E/12] [info] [Task Finished] Transform to mem in 0.278930s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:29:24.851] [E/14] [info] [Task Finished] Transform to mem in 0.279026s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:29:24.851] [E/5] [info] [Task Finished] Transform to mem in 0.279215s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:29:24.851] [E/7] [info] [Task Finished] Transform to mem in 0.279643s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:29:24.851] [E/4] [info] [Task Finished] Transform to mem in 0.278460s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:29:24.852] [E/6] [info] [Task Finished] Transform to mem in 0.279566s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:29:24.852] [E/10] [info] [Task Finished] Transform to mem in 0.278960s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:29:24.853] [E/11] [info] [Task Finished] Transform to mem in 0.279163s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:29:24.855] [E/15] [info] [Task Finished] Transform to mem in 0.279810s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:29:24.857] [driver] [info] [Task Finished] Transform to mem in 0.279652s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:29:24.860] [E/1] [info] [Task Finished] Transform to mem in 0.280842s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:29:24.861] [E/2] [info] [Task Finished] Transform to mem in 0.281289s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:29:24.863] [E/9] [info] [Task Finished] Transform to mem in 0.282086s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:29:24.865] [E/3] [info] [Task Finished] Transform to mem in 0.281102s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:29:24.870] [E/13] [info] [Task Finished] Transform to mem in 0.283403s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:29:25.128] [E/8] [info] [Task Finished] Transform to mem in 0.279545s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:25.131] [E/4] [info] [Task Finished] Transform to mem in 0.279493s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:29:25.131] [E/12] [info] [Task Finished] Transform to mem in 0.280178s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:29:25.131] [E/14] [info] [Task Finished] Transform to mem in 0.280160s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:29:25.131] [E/7] [info] [Task Finished] Transform to mem in 0.279848s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:29:25.131] [E/5] [info] [Task Finished] Transform to mem in 0.280342s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:29:25.132] [E/6] [info] [Task Finished] Transform to mem in 0.280222s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:29:25.132] [E/10] [info] [Task Finished] Transform to mem in 0.280604s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:29:25.133] [E/11] [info] [Task Finished] Transform to mem in 0.280090s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:25.136] [E/15] [info] [Task Finished] Transform to mem in 0.280768s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:29:25.139] [driver] [info] [Task Finished] Transform to mem in 0.281387s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:29:25.140] [E/2] [info] [Task Finished] Transform to mem in 0.279458s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:29:25.142] [E/1] [info] [Task Finished] Transform to mem in 0.281867s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:29:25.146] [E/9] [info] [Task Finished] Transform to mem in 0.282307s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:29:25.147] [E/3] [info] [Task Finished] Transform to mem in 0.281674s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:29:25.153] [E/13] [info] [Task Finished] Transform to mem in 0.282865s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:29:25.408] [E/8] [info] [Task Finished] Transform to mem in 0.279912s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:29:25.410] [E/12] [info] [Task Finished] Transform to mem in 0.279248s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:29:25.410] [E/4] [info] [Task Finished] Transform to mem in 0.279791s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:29:25.410] [E/7] [info] [Task Finished] Transform to mem in 0.279579s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:29:25.411] [E/5] [info] [Task Finished] Transform to mem in 0.279661s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:29:25.411] [E/14] [info] [Task Finished] Transform to mem in 0.280088s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:29:25.412] [E/6] [info] [Task Finished] Transform to mem in 0.279700s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:29:25.412] [E/10] [info] [Task Finished] Transform to mem in 0.279958s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:29:25.413] [E/11] [info] [Task Finished] Transform to mem in 0.280137s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:25.416] [E/15] [info] [Task Finished] Transform to mem in 0.280226s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:29:25.419] [driver] [info] [Task Finished] Transform to mem in 0.280373s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:29:25.423] [E/2] [info] [Task Finished] Transform to mem in 0.282064s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:29:25.424] [E/1] [info] [Task Finished] Transform to mem in 0.281247s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:29:25.428] [E/3] [info] [Task Finished] Transform to mem in 0.281220s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:29:25.428] [E/9] [info] [Task Finished] Transform to mem in 0.282598s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:29:25.435] [E/13] [info] [Task Finished] Transform to mem in 0.282550s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:29:25.688] [E/8] [info] [Task Finished] Transform to mem in 0.279640s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:25.690] [E/12] [info] [Task Finished] Transform to mem in 0.280186s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:29:25.690] [E/4] [info] [Task Finished] Transform to mem in 0.280055s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:29:25.691] [E/5] [info] [Task Finished] Transform to mem in 0.279814s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:29:25.691] [E/7] [info] [Task Finished] Transform to mem in 0.280269s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:29:25.691] [E/6] [info] [Task Finished] Transform to mem in 0.279458s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:29:25.691] [E/14] [info] [Task Finished] Transform to mem in 0.280382s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:29:25.693] [E/10] [info] [Task Finished] Transform to mem in 0.280315s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:29:25.694] [E/11] [info] [Task Finished] Transform to mem in 0.280315s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:29:25.697] [E/15] [info] [Task Finished] Transform to mem in 0.280370s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:29:25.700] [driver] [info] [Task Finished] Transform to mem in 0.281237s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:29:25.703] [E/2] [info] [Task Finished] Transform to mem in 0.280010s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:29:25.705] [E/1] [info] [Task Finished] Transform to mem in 0.281269s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:29:25.711] [E/3] [info] [Task Finished] Transform to mem in 0.282349s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:29:25.711] [E/9] [info] [Task Finished] Transform to mem in 0.282772s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:29:25.752] [E/13] [info] [Task Finished] Transform to mem in 0.316632s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:29:25.752] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.85839s
[2021-03-25 10:29:25.752] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.8921s, 56350770 input rows, time to process 1 row via fast path: 0.000796655ms
[2021-03-25 10:29:25.752] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:29:25.756] [local ee] [info] compiled pure python pipeline in 0.004274s
[2021-03-25 10:29:25.756] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:29:25.758] [local ee] [info] Created 160 resolve tasks in 0.001275s
[2021-03-25 10:29:25.758] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:29:25.770] [E/9] [info] [Task Finished] Resolve in 0.011922s
[2021-03-25 10:29:25.770] [E/1] [info] [Task Finished] Resolve in 0.011952s
[2021-03-25 10:29:25.770] [E/10] [info] [Task Finished] Resolve in 0.011960s
[2021-03-25 10:29:25.770] [E/11] [info] [Task Finished] Resolve in 0.011990s
[2021-03-25 10:29:25.770] [E/3] [info] [Task Finished] Resolve in 0.012000s
[2021-03-25 10:29:25.770] [E/7] [info] [Task Finished] Resolve in 0.012006s
[2021-03-25 10:29:25.770] [E/12] [info] [Task Finished] Resolve in 0.012035s
[2021-03-25 10:29:25.770] [E/4] [info] [Task Finished] Resolve in 0.012044s
[2021-03-25 10:29:25.770] [E/5] [info] [Task Finished] Resolve in 0.012055s
[2021-03-25 10:29:25.770] [E/13] [info] [Task Finished] Resolve in 0.012066s
[2021-03-25 10:29:25.770] [E/6] [info] [Task Finished] Resolve in 0.012062s
[2021-03-25 10:29:25.770] [E/8] [info] [Task Finished] Resolve in 0.012096s
[2021-03-25 10:29:25.770] [E/14] [info] [Task Finished] Resolve in 0.012107s
[2021-03-25 10:29:25.770] [E/15] [info] [Task Finished] Resolve in 0.012123s
[2021-03-25 10:29:25.770] [E/2] [info] [Task Finished] Resolve in 0.012134s
[2021-03-25 10:29:25.770] [driver] [info] [Task Finished] Resolve in 0.012169s
[2021-03-25 10:29:25.781] [E/1] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:29:25.781] [E/10] [info] [Task Finished] Resolve in 0.011753s
[2021-03-25 10:29:25.781] [E/9] [info] [Task Finished] Resolve in 0.011813s
[2021-03-25 10:29:25.781] [E/7] [info] [Task Finished] Resolve in 0.011721s
[2021-03-25 10:29:25.781] [E/11] [info] [Task Finished] Resolve in 0.011801s
[2021-03-25 10:29:25.781] [E/12] [info] [Task Finished] Resolve in 0.011796s
[2021-03-25 10:29:25.781] [E/14] [info] [Task Finished] Resolve in 0.011731s
[2021-03-25 10:29:25.782] [E/15] [info] [Task Finished] Resolve in 0.011730s
[2021-03-25 10:29:25.782] [E/2] [info] [Task Finished] Resolve in 0.011707s
[2021-03-25 10:29:25.782] [E/13] [info] [Task Finished] Resolve in 0.011832s
[2021-03-25 10:29:25.782] [E/5] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:29:25.782] [E/6] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:29:25.782] [E/4] [info] [Task Finished] Resolve in 0.011927s
[2021-03-25 10:29:25.782] [driver] [info] [Task Finished] Resolve in 0.011835s
[2021-03-25 10:29:25.782] [E/3] [info] [Task Finished] Resolve in 0.012037s
[2021-03-25 10:29:25.782] [E/8] [info] [Task Finished] Resolve in 0.011958s
[2021-03-25 10:29:25.793] [E/9] [info] [Task Finished] Resolve in 0.011734s
[2021-03-25 10:29:25.793] [E/10] [info] [Task Finished] Resolve in 0.011889s
[2021-03-25 10:29:25.793] [E/14] [info] [Task Finished] Resolve in 0.011763s
[2021-03-25 10:29:25.793] [E/12] [info] [Task Finished] Resolve in 0.011786s
[2021-03-25 10:29:25.793] [E/15] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:29:25.793] [E/11] [info] [Task Finished] Resolve in 0.011868s
[2021-03-25 10:29:25.793] [E/5] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:29:25.793] [E/1] [info] [Task Finished] Resolve in 0.011976s
[2021-03-25 10:29:25.793] [E/2] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:29:25.793] [E/6] [info] [Task Finished] Resolve in 0.011844s
[2021-03-25 10:29:25.793] [driver] [info] [Task Finished] Resolve in 0.011792s
[2021-03-25 10:29:25.793] [E/8] [info] [Task Finished] Resolve in 0.011764s
[2021-03-25 10:29:25.794] [E/7] [info] [Task Finished] Resolve in 0.012118s
[2021-03-25 10:29:25.794] [E/3] [info] [Task Finished] Resolve in 0.011837s
[2021-03-25 10:29:25.794] [E/4] [info] [Task Finished] Resolve in 0.011939s
[2021-03-25 10:29:25.794] [E/13] [info] [Task Finished] Resolve in 0.012032s
[2021-03-25 10:29:25.805] [E/9] [info] [Task Finished] Resolve in 0.011860s
[2021-03-25 10:29:25.805] [E/12] [info] [Task Finished] Resolve in 0.011735s
[2021-03-25 10:29:25.805] [E/14] [info] [Task Finished] Resolve in 0.011781s
[2021-03-25 10:29:25.805] [E/2] [info] [Task Finished] Resolve in 0.011703s
[2021-03-25 10:29:25.805] [E/1] [info] [Task Finished] Resolve in 0.011761s
[2021-03-25 10:29:25.805] [E/5] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:29:25.805] [E/11] [info] [Task Finished] Resolve in 0.011773s
[2021-03-25 10:29:25.805] [E/15] [info] [Task Finished] Resolve in 0.011884s
[2021-03-25 10:29:25.805] [E/8] [info] [Task Finished] Resolve in 0.011774s
[2021-03-25 10:29:25.805] [E/10] [info] [Task Finished] Resolve in 0.011995s
[2021-03-25 10:29:25.805] [driver] [info] [Task Finished] Resolve in 0.011832s
[2021-03-25 10:29:25.805] [E/7] [info] [Task Finished] Resolve in 0.011749s
[2021-03-25 10:29:25.805] [E/13] [info] [Task Finished] Resolve in 0.011729s
[2021-03-25 10:29:25.805] [E/3] [info] [Task Finished] Resolve in 0.011860s
[2021-03-25 10:29:25.805] [E/4] [info] [Task Finished] Resolve in 0.011858s
[2021-03-25 10:29:25.806] [E/6] [info] [Task Finished] Resolve in 0.012153s
[2021-03-25 10:29:25.817] [E/9] [info] [Task Finished] Resolve in 0.011693s
[2021-03-25 10:29:25.817] [E/12] [info] [Task Finished] Resolve in 0.011755s
[2021-03-25 10:29:25.817] [E/5] [info] [Task Finished] Resolve in 0.011775s
[2021-03-25 10:29:25.817] [E/15] [info] [Task Finished] Resolve in 0.011739s
[2021-03-25 10:29:25.817] [E/11] [info] [Task Finished] Resolve in 0.011813s
[2021-03-25 10:29:25.817] [E/1] [info] [Task Finished] Resolve in 0.011848s
[2021-03-25 10:29:25.817] [E/8] [info] [Task Finished] Resolve in 0.011796s
[2021-03-25 10:29:25.817] [E/2] [info] [Task Finished] Resolve in 0.011991s
[2021-03-25 10:29:25.817] [driver] [info] [Task Finished] Resolve in 0.011852s
[2021-03-25 10:29:25.817] [E/7] [info] [Task Finished] Resolve in 0.011869s
[2021-03-25 10:29:25.817] [E/13] [info] [Task Finished] Resolve in 0.011867s
[2021-03-25 10:29:25.817] [E/4] [info] [Task Finished] Resolve in 0.011833s
[2021-03-25 10:29:25.817] [E/14] [info] [Task Finished] Resolve in 0.012215s
[2021-03-25 10:29:25.817] [E/3] [info] [Task Finished] Resolve in 0.011894s
[2021-03-25 10:29:25.817] [E/10] [info] [Task Finished] Resolve in 0.012110s
[2021-03-25 10:29:25.818] [E/6] [info] [Task Finished] Resolve in 0.011941s
[2021-03-25 10:29:25.829] [E/9] [info] [Task Finished] Resolve in 0.011893s
[2021-03-25 10:29:25.829] [E/12] [info] [Task Finished] Resolve in 0.011902s
[2021-03-25 10:29:25.829] [E/15] [info] [Task Finished] Resolve in 0.011909s
[2021-03-25 10:29:25.829] [E/11] [info] [Task Finished] Resolve in 0.011900s
[2021-03-25 10:29:25.829] [E/8] [info] [Task Finished] Resolve in 0.011942s
[2021-03-25 10:29:25.829] [driver] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:29:25.829] [E/5] [info] [Task Finished] Resolve in 0.012135s
[2021-03-25 10:29:25.829] [E/2] [info] [Task Finished] Resolve in 0.011889s
[2021-03-25 10:29:25.829] [E/1] [info] [Task Finished] Resolve in 0.012036s
[2021-03-25 10:29:25.829] [E/4] [info] [Task Finished] Resolve in 0.011896s
[2021-03-25 10:29:25.829] [E/14] [info] [Task Finished] Resolve in 0.011890s
[2021-03-25 10:29:25.829] [E/13] [info] [Task Finished] Resolve in 0.012028s
[2021-03-25 10:29:25.829] [E/10] [info] [Task Finished] Resolve in 0.011828s
[2021-03-25 10:29:25.829] [E/7] [info] [Task Finished] Resolve in 0.012107s
[2021-03-25 10:29:25.829] [E/3] [info] [Task Finished] Resolve in 0.012006s
[2021-03-25 10:29:25.830] [E/6] [info] [Task Finished] Resolve in 0.011931s
[2021-03-25 10:29:25.840] [E/9] [info] [Task Finished] Resolve in 0.011694s
[2021-03-25 10:29:25.841] [E/12] [info] [Task Finished] Resolve in 0.011833s
[2021-03-25 10:29:25.841] [E/11] [info] [Task Finished] Resolve in 0.011755s
[2021-03-25 10:29:25.841] [E/15] [info] [Task Finished] Resolve in 0.011820s
[2021-03-25 10:29:25.841] [E/5] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:29:25.841] [E/1] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:29:25.841] [driver] [info] [Task Finished] Resolve in 0.011833s
[2021-03-25 10:29:25.841] [E/2] [info] [Task Finished] Resolve in 0.011825s
[2021-03-25 10:29:25.841] [E/14] [info] [Task Finished] Resolve in 0.011749s
[2021-03-25 10:29:25.841] [E/13] [info] [Task Finished] Resolve in 0.011779s
[2021-03-25 10:29:25.841] [E/7] [info] [Task Finished] Resolve in 0.011730s
[2021-03-25 10:29:25.841] [E/8] [info] [Task Finished] Resolve in 0.011996s
[2021-03-25 10:29:25.841] [E/3] [info] [Task Finished] Resolve in 0.011737s
[2021-03-25 10:29:25.841] [E/10] [info] [Task Finished] Resolve in 0.011837s
[2021-03-25 10:29:25.841] [E/4] [info] [Task Finished] Resolve in 0.012004s
[2021-03-25 10:29:25.841] [E/6] [info] [Task Finished] Resolve in 0.011877s
[2021-03-25 10:29:25.852] [E/9] [info] [Task Finished] Resolve in 0.011674s
[2021-03-25 10:29:25.852] [E/12] [info] [Task Finished] Resolve in 0.011734s
[2021-03-25 10:29:25.853] [E/15] [info] [Task Finished] Resolve in 0.011756s
[2021-03-25 10:29:25.853] [driver] [info] [Task Finished] Resolve in 0.011754s
[2021-03-25 10:29:25.853] [E/14] [info] [Task Finished] Resolve in 0.011683s
[2021-03-25 10:29:25.853] [E/1] [info] [Task Finished] Resolve in 0.011801s
[2021-03-25 10:29:25.853] [E/5] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:29:25.853] [E/11] [info] [Task Finished] Resolve in 0.012004s
[2021-03-25 10:29:25.853] [E/2] [info] [Task Finished] Resolve in 0.011802s
[2021-03-25 10:29:25.853] [E/7] [info] [Task Finished] Resolve in 0.011770s
[2021-03-25 10:29:25.853] [E/8] [info] [Task Finished] Resolve in 0.011855s
[2021-03-25 10:29:25.853] [E/10] [info] [Task Finished] Resolve in 0.011805s
[2021-03-25 10:29:25.853] [E/3] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:29:25.853] [E/4] [info] [Task Finished] Resolve in 0.011770s
[2021-03-25 10:29:25.853] [E/13] [info] [Task Finished] Resolve in 0.011998s
[2021-03-25 10:29:25.853] [E/6] [info] [Task Finished] Resolve in 0.011874s
[2021-03-25 10:29:25.864] [E/9] [info] [Task Finished] Resolve in 0.011654s
[2021-03-25 10:29:25.864] [E/12] [info] [Task Finished] Resolve in 0.011735s
[2021-03-25 10:29:25.864] [E/2] [info] [Task Finished] Resolve in 0.011674s
[2021-03-25 10:29:25.864] [E/5] [info] [Task Finished] Resolve in 0.011738s
[2021-03-25 10:29:25.864] [E/1] [info] [Task Finished] Resolve in 0.011754s
[2021-03-25 10:29:25.864] [E/15] [info] [Task Finished] Resolve in 0.011986s
[2021-03-25 10:29:25.865] [E/14] [info] [Task Finished] Resolve in 0.011800s
[2021-03-25 10:29:25.865] [E/11] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:29:25.865] [driver] [info] [Task Finished] Resolve in 0.011877s
[2021-03-25 10:29:25.865] [E/8] [info] [Task Finished] Resolve in 0.011786s
[2021-03-25 10:29:25.865] [E/10] [info] [Task Finished] Resolve in 0.011788s
[2021-03-25 10:29:25.865] [E/4] [info] [Task Finished] Resolve in 0.011770s
[2021-03-25 10:29:25.865] [E/7] [info] [Task Finished] Resolve in 0.011950s
[2021-03-25 10:29:25.865] [E/3] [info] [Task Finished] Resolve in 0.011889s
[2021-03-25 10:29:25.865] [E/13] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:29:25.865] [E/6] [info] [Task Finished] Resolve in 0.011876s
[2021-03-25 10:29:25.875] [E/9] [info] [Task Finished] Resolve in 0.011680s
[2021-03-25 10:29:25.876] [E/12] [info] [Task Finished] Resolve in 0.011888s
[2021-03-25 10:29:25.876] [E/15] [info] [Task Finished] Resolve in 0.011705s
[2021-03-25 10:29:25.876] [E/2] [info] [Task Finished] Resolve in 0.011807s
[2021-03-25 10:29:25.876] [E/5] [info] [Task Finished] Resolve in 0.011803s
[2021-03-25 10:29:25.876] [E/14] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:29:25.876] [E/1] [info] [Task Finished] Resolve in 0.011810s
[2021-03-25 10:29:25.876] [driver] [info] [Task Finished] Resolve in 0.011746s
[2021-03-25 10:29:25.876] [E/11] [info] [Task Finished] Resolve in 0.011842s
[2021-03-25 10:29:25.877] [E/4] [info] [Task Finished] Resolve in 0.011787s
[2021-03-25 10:29:25.877] [E/10] [info] [Task Finished] Resolve in 0.011845s
[2021-03-25 10:29:25.877] [E/8] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:29:25.877] [E/7] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:29:25.877] [E/13] [info] [Task Finished] Resolve in 0.011796s
[2021-03-25 10:29:25.877] [E/3] [info] [Task Finished] Resolve in 0.011897s
[2021-03-25 10:29:25.879] [E/6] [info] [Task Finished] Resolve in 0.013385s
[2021-03-25 10:29:25.879] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.126759s
[2021-03-25 10:29:25.879] [local ee] [info] slow path for Stage 0: total wall clock time: 1.89922s, time to process 1 row via slow path: 0.000275412ms
[2021-03-25 10:29:25.879] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.126785s

[2021-03-25 10:29:25.918] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:29:25.932] [E/9] [info] [Task Finished] write to file in 0.013896s (46082 rows, 7.02 MB)
[2021-03-25 10:29:25.950] [driver] [info] [Task Finished] write to file in 0.031828s (112573 rows, 17.14 MB)
[2021-03-25 10:29:25.950] [E/11] [info] [Task Finished] write to file in 0.031834s (112459 rows, 17.12 MB)
[2021-03-25 10:29:25.950] [E/10] [info] [Task Finished] write to file in 0.031867s (112421 rows, 17.11 MB)
[2021-03-25 10:29:25.950] [E/5] [info] [Task Finished] write to file in 0.031909s (112467 rows, 17.12 MB)
[2021-03-25 10:29:25.950] [E/4] [info] [Task Finished] write to file in 0.031941s (112425 rows, 17.11 MB)
[2021-03-25 10:29:25.950] [E/12] [info] [Task Finished] write to file in 0.032129s (112438 rows, 17.12 MB)
[2021-03-25 10:29:25.950] [E/3] [info] [Task Finished] write to file in 0.032141s (112583 rows, 17.14 MB)
[2021-03-25 10:29:25.950] [E/6] [info] [Task Finished] write to file in 0.032150s (112482 rows, 17.12 MB)
[2021-03-25 10:29:25.951] [E/14] [info] [Task Finished] write to file in 0.033419s (123251 rows, 18.76 MB)
[2021-03-25 10:29:25.951] [E/15] [info] [Task Finished] write to file in 0.033518s (123410 rows, 18.79 MB)
[2021-03-25 10:29:25.951] [E/1] [info] [Task Finished] write to file in 0.033611s (123389 rows, 18.78 MB)
[2021-03-25 10:29:25.951] [E/13] [info] [Task Finished] write to file in 0.033638s (123299 rows, 18.77 MB)
[2021-03-25 10:29:25.952] [E/8] [info] [Task Finished] write to file in 0.033712s (123377 rows, 18.78 MB)
[2021-03-25 10:29:25.952] [E/7] [info] [Task Finished] write to file in 0.033757s (123424 rows, 18.79 MB)
[2021-03-25 10:29:25.956] [E/2] [info] [Task Finished] write to file in 0.037993s (112411 rows, 17.11 MB)
[2021-03-25 10:29:25.956] [global] [info] writing output took 0.077093s
[2021-03-25 10:29:25.956] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.077181s
[2021-03-25 10:29:25.956] [global] [info] [Transform Stage] Stage 0 took 3.56588s
[2021-03-25 10:29:25.956] [global] [info] Query Execution took 3.64619s. (planning: 0.0802792s, execution: 3.56591s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.0059854984283447266
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 3.932016611099243 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0227894,"llvm_optimization_time_s":0.333339,"llvm_compilation_time_s":0.152488,"total_compilation_time_s":0.503483,"sampling_time_s":0.112482,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.8921,"fast_path_time_s":2.85841,"fast_path_per_row_time_ns":796.655,"slow_path_wall_time_s":1.89922,"slow_path_time_s":0.126759,"slow_path_per_row_time_ns":275.412}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.0059854984283447266, "jobTime": 3.932016611099243, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-25 10:29:25.980] [local execution engine] [info] Stopped local executor E/1
[2021-03-25 10:29:25.987] [local execution engine] [info] Stopped local executor E/2
[2021-03-25 10:29:25.993] [local execution engine] [info] Stopped local executor E/3
[2021-03-25 10:29:25.999] [local execution engine] [info] Stopped local executor E/4
[2021-03-25 10:29:26.006] [local execution engine] [info] Stopped local executor E/5
[2021-03-25 10:29:26.012] [local execution engine] [info] Stopped local executor E/6
[2021-03-25 10:29:26.018] [local execution engine] [info] Stopped local executor E/7
[2021-03-25 10:29:26.025] [local execution engine] [info] Stopped local executor E/8
[2021-03-25 10:29:26.031] [local execution engine] [info] Stopped local executor E/9
[2021-03-25 10:29:26.037] [local execution engine] [info] Stopped local executor E/10
[2021-03-25 10:29:26.043] [local execution engine] [info] Stopped local executor E/11
[2021-03-25 10:29:26.049] [local execution engine] [info] Stopped local executor E/12
[2021-03-25 10:29:26.055] [local execution engine] [info] Stopped local executor E/13
[2021-03-25 10:29:26.061] [local execution engine] [info] Stopped local executor E/14
[2021-03-25 10:29:26.067] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
