[2021-03-25 10:30:01.604] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:30:01.605] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:30:01.605] [local ee] [info] initializing LLVM backend
[2021-03-25 10:30:01.605] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:30:01.605] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/1] [info] starting detached process queue
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/2] [info] starting detached process queue
[2021-03-25 10:30:01.606] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [E/3] [info] starting detached process queue
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [E/4] [info] starting detached process queue
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [E/5] [info] starting detached process queue
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [E/6] [info] starting detached process queue
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/7] [info] starting detached process queue
[2021-03-25 10:30:01.606] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [E/8] [info] starting detached process queue
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [E/9] [info] starting detached process queue
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [E/10] [info] starting detached process queue
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [E/11] [info] starting detached process queue
[2021-03-25 10:30:01.606] [E/12] [info] starting detached process queue
[2021-03-25 10:30:01.606] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.606] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.606] [E/13] [info] starting detached process queue
[2021-03-25 10:30:01.606] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.607] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.607] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.607] [E/14] [info] starting detached process queue
[2021-03-25 10:30:01.607] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:30:01.607] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.607] [E/15] [info] starting detached process queue
[2021-03-25 10:30:01.607] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 10:30:01.607] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:30:01.607] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:30:01.607] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:30:01.607] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:30:01.742] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:30:01.749] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:30:01.765] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:30:01.773] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:30:01.800] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:30:01.821] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:30:01.834] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:30:01.867] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:30:01.873] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:30:01.889] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:30:01.891] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:30:01.892] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:30:01.893] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:30:01.894] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:30:01.895] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:30:01.896] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:30:01.898] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:30:01.899] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:30:01.899] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:30:01.916] [logical planner] [info] logical optimization took 0.022765ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:30:01.916] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:30:01.916] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:30:01.917] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:30:01.918] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:30:01.919] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:30:01.919] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:30:01.920] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:30:01.921] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:30:01.922] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:30:01.923] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:30:01.923] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:30:01.924] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:30:01.925] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:30:01.926] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:30:01.927] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:30:01.928] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:30:01.929] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:30:01.929] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:30:01.930] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:30:01.930] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:30:01.931] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:30:01.932] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:30:01.933] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:30:01.934] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:30:01.934] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:30:01.936] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:30:01.936] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:30:01.937] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:30:01.938] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:30:01.970] [global] [info] Stage0 depends on: 
[2021-03-25 10:30:02.319] [global] [info] Optimization via LLVM passes took 0.331454 ms
[2021-03-25 10:30:02.470] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:30:02.470] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.500761s
[2021-03-25 10:30:02.471] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:30:02.759] [E/13] [info] [Task Finished] Transform to mem in 0.287740s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:30:02.759] [driver] [info] [Task Finished] Transform to mem in 0.287902s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:30:02.759] [E/4] [info] [Task Finished] Transform to mem in 0.287980s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:30:02.759] [E/14] [info] [Task Finished] Transform to mem in 0.287988s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:30:02.759] [E/5] [info] [Task Finished] Transform to mem in 0.288063s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:30:02.759] [E/11] [info] [Task Finished] Transform to mem in 0.288119s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:30:02.759] [E/6] [info] [Task Finished] Transform to mem in 0.288220s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:30:02.759] [E/3] [info] [Task Finished] Transform to mem in 0.288253s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:30:02.759] [E/7] [info] [Task Finished] Transform to mem in 0.288312s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:30:02.759] [E/9] [info] [Task Finished] Transform to mem in 0.288360s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:30:02.759] [E/1] [info] [Task Finished] Transform to mem in 0.288572s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:30:02.760] [E/2] [info] [Task Finished] Transform to mem in 0.288763s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:30:02.760] [E/15] [info] [Task Finished] Transform to mem in 0.288844s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:30:02.760] [E/10] [info] [Task Finished] Transform to mem in 0.288889s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:30:02.760] [E/12] [info] [Task Finished] Transform to mem in 0.289174s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:30:02.760] [E/8] [info] [Task Finished] Transform to mem in 0.289282s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:30:03.040] [E/11] [info] [Task Finished] Transform to mem in 0.280649s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:30:03.040] [E/3] [info] [Task Finished] Transform to mem in 0.280535s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:30:03.040] [E/13] [info] [Task Finished] Transform to mem in 0.281417s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:30:03.040] [E/6] [info] [Task Finished] Transform to mem in 0.280992s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:30:03.040] [E/4] [info] [Task Finished] Transform to mem in 0.281268s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:30:03.040] [E/7] [info] [Task Finished] Transform to mem in 0.281070s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:30:03.040] [driver] [info] [Task Finished] Transform to mem in 0.281624s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:30:03.040] [E/14] [info] [Task Finished] Transform to mem in 0.281649s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:30:03.040] [E/2] [info] [Task Finished] Transform to mem in 0.280868s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:30:03.041] [E/5] [info] [Task Finished] Transform to mem in 0.281704s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:30:03.041] [E/9] [info] [Task Finished] Transform to mem in 0.281592s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:30:03.041] [E/10] [info] [Task Finished] Transform to mem in 0.281144s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:30:03.041] [E/1] [info] [Task Finished] Transform to mem in 0.281638s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:30:03.041] [E/15] [info] [Task Finished] Transform to mem in 0.281636s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:30:03.041] [E/8] [info] [Task Finished] Transform to mem in 0.281313s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:30:03.042] [E/12] [info] [Task Finished] Transform to mem in 0.281537s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:30:03.321] [E/11] [info] [Task Finished] Transform to mem in 0.280855s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:30:03.321] [E/6] [info] [Task Finished] Transform to mem in 0.280751s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:30:03.321] [E/13] [info] [Task Finished] Transform to mem in 0.281024s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:30:03.321] [E/3] [info] [Task Finished] Transform to mem in 0.281615s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:30:03.321] [E/2] [info] [Task Finished] Transform to mem in 0.280930s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:30:03.322] [E/4] [info] [Task Finished] Transform to mem in 0.281595s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:30:03.322] [E/7] [info] [Task Finished] Transform to mem in 0.281480s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:30:03.322] [E/5] [info] [Task Finished] Transform to mem in 0.281363s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:30:03.322] [driver] [info] [Task Finished] Transform to mem in 0.281675s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:30:03.322] [E/14] [info] [Task Finished] Transform to mem in 0.281600s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:30:03.322] [E/10] [info] [Task Finished] Transform to mem in 0.281475s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:30:03.322] [E/9] [info] [Task Finished] Transform to mem in 0.281565s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:30:03.323] [E/8] [info] [Task Finished] Transform to mem in 0.281403s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:30:03.323] [E/12] [info] [Task Finished] Transform to mem in 0.281662s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:30:03.323] [E/1] [info] [Task Finished] Transform to mem in 0.282179s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:30:03.324] [E/15] [info] [Task Finished] Transform to mem in 0.282508s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:30:03.602] [E/11] [info] [Task Finished] Transform to mem in 0.281211s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:30:03.602] [E/6] [info] [Task Finished] Transform to mem in 0.281477s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:30:03.602] [E/13] [info] [Task Finished] Transform to mem in 0.281325s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:30:03.602] [E/4] [info] [Task Finished] Transform to mem in 0.280708s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:30:03.603] [E/2] [info] [Task Finished] Transform to mem in 0.281144s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:30:03.603] [E/3] [info] [Task Finished] Transform to mem in 0.281421s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:30:03.603] [E/5] [info] [Task Finished] Transform to mem in 0.280895s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:30:03.603] [E/7] [info] [Task Finished] Transform to mem in 0.281448s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:30:03.603] [driver] [info] [Task Finished] Transform to mem in 0.281195s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:30:03.604] [E/9] [info] [Task Finished] Transform to mem in 0.281579s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:30:03.604] [E/10] [info] [Task Finished] Transform to mem in 0.281625s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:30:03.604] [E/14] [info] [Task Finished] Transform to mem in 0.282115s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:30:03.604] [E/12] [info] [Task Finished] Transform to mem in 0.281182s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:30:03.604] [E/1] [info] [Task Finished] Transform to mem in 0.281213s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:30:03.605] [E/8] [info] [Task Finished] Transform to mem in 0.281787s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:30:03.606] [E/15] [info] [Task Finished] Transform to mem in 0.282359s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:30:03.883] [E/11] [info] [Task Finished] Transform to mem in 0.281158s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:30:03.883] [E/13] [info] [Task Finished] Transform to mem in 0.280956s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:30:03.883] [E/2] [info] [Task Finished] Transform to mem in 0.280859s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:30:03.884] [E/4] [info] [Task Finished] Transform to mem in 0.281360s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:30:03.884] [E/6] [info] [Task Finished] Transform to mem in 0.281713s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:30:03.884] [E/7] [info] [Task Finished] Transform to mem in 0.281058s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:30:03.884] [E/3] [info] [Task Finished] Transform to mem in 0.281542s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:30:03.885] [driver] [info] [Task Finished] Transform to mem in 0.281368s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:30:03.885] [E/5] [info] [Task Finished] Transform to mem in 0.282463s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:30:03.886] [E/9] [info] [Task Finished] Transform to mem in 0.281507s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:30:03.886] [E/10] [info] [Task Finished] Transform to mem in 0.281795s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:30:03.886] [E/8] [info] [Task Finished] Transform to mem in 0.281210s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:30:03.886] [E/14] [info] [Task Finished] Transform to mem in 0.281751s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:30:03.886] [E/1] [info] [Task Finished] Transform to mem in 0.281585s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:30:03.886] [E/12] [info] [Task Finished] Transform to mem in 0.281712s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:30:03.888] [E/15] [info] [Task Finished] Transform to mem in 0.281593s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:30:04.164] [E/11] [info] [Task Finished] Transform to mem in 0.281276s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:30:04.165] [E/13] [info] [Task Finished] Transform to mem in 0.281321s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:30:04.165] [E/4] [info] [Task Finished] Transform to mem in 0.281057s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:30:04.165] [E/3] [info] [Task Finished] Transform to mem in 0.280707s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:30:04.165] [E/6] [info] [Task Finished] Transform to mem in 0.281047s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:30:04.165] [E/2] [info] [Task Finished] Transform to mem in 0.281656s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:30:04.166] [E/7] [info] [Task Finished] Transform to mem in 0.281426s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:30:04.166] [E/5] [info] [Task Finished] Transform to mem in 0.280873s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:30:04.166] [driver] [info] [Task Finished] Transform to mem in 0.281693s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:30:04.168] [E/12] [info] [Task Finished] Transform to mem in 0.281354s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:30:04.168] [E/10] [info] [Task Finished] Transform to mem in 0.281712s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:30:04.168] [E/8] [info] [Task Finished] Transform to mem in 0.281673s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:30:04.168] [E/9] [info] [Task Finished] Transform to mem in 0.282106s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:30:04.168] [E/14] [info] [Task Finished] Transform to mem in 0.281863s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:30:04.168] [E/1] [info] [Task Finished] Transform to mem in 0.282038s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:30:04.170] [E/15] [info] [Task Finished] Transform to mem in 0.281732s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:30:04.445] [E/11] [info] [Task Finished] Transform to mem in 0.280868s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:30:04.446] [E/6] [info] [Task Finished] Transform to mem in 0.281065s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:30:04.446] [E/3] [info] [Task Finished] Transform to mem in 0.281456s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:30:04.447] [E/4] [info] [Task Finished] Transform to mem in 0.281614s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:30:04.447] [E/13] [info] [Task Finished] Transform to mem in 0.281767s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:30:04.447] [E/7] [info] [Task Finished] Transform to mem in 0.280848s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:30:04.447] [E/2] [info] [Task Finished] Transform to mem in 0.281783s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:30:04.447] [driver] [info] [Task Finished] Transform to mem in 0.280959s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:30:04.448] [E/5] [info] [Task Finished] Transform to mem in 0.281225s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:30:04.449] [E/9] [info] [Task Finished] Transform to mem in 0.281317s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:30:04.449] [E/10] [info] [Task Finished] Transform to mem in 0.281541s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:30:04.449] [E/8] [info] [Task Finished] Transform to mem in 0.281533s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:30:04.450] [E/1] [info] [Task Finished] Transform to mem in 0.281497s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:30:04.450] [E/12] [info] [Task Finished] Transform to mem in 0.282235s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:30:04.450] [E/14] [info] [Task Finished] Transform to mem in 0.282132s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:30:04.452] [E/15] [info] [Task Finished] Transform to mem in 0.282454s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:30:04.727] [E/11] [info] [Task Finished] Transform to mem in 0.282247s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:30:04.729] [E/6] [info] [Task Finished] Transform to mem in 0.282563s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:30:04.729] [E/13] [info] [Task Finished] Transform to mem in 0.282315s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:30:04.729] [E/4] [info] [Task Finished] Transform to mem in 0.282439s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:30:04.729] [E/7] [info] [Task Finished] Transform to mem in 0.282568s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:30:04.729] [E/3] [info] [Task Finished] Transform to mem in 0.282895s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:30:04.730] [E/2] [info] [Task Finished] Transform to mem in 0.282612s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:30:04.730] [E/5] [info] [Task Finished] Transform to mem in 0.282145s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:30:04.730] [driver] [info] [Task Finished] Transform to mem in 0.282823s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:30:04.731] [E/9] [info] [Task Finished] Transform to mem in 0.282351s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:30:04.732] [E/8] [info] [Task Finished] Transform to mem in 0.282380s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:30:04.732] [E/1] [info] [Task Finished] Transform to mem in 0.282101s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:30:04.732] [E/10] [info] [Task Finished] Transform to mem in 0.282691s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:30:04.732] [E/14] [info] [Task Finished] Transform to mem in 0.281982s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:30:04.732] [E/12] [info] [Task Finished] Transform to mem in 0.282407s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:30:04.735] [E/15] [info] [Task Finished] Transform to mem in 0.282638s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:30:05.009] [E/11] [info] [Task Finished] Transform to mem in 0.281987s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:30:05.010] [E/6] [info] [Task Finished] Transform to mem in 0.281448s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:30:05.011] [E/7] [info] [Task Finished] Transform to mem in 0.281494s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:30:05.011] [E/2] [info] [Task Finished] Transform to mem in 0.281231s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:30:05.011] [E/13] [info] [Task Finished] Transform to mem in 0.281963s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:30:05.011] [E/4] [info] [Task Finished] Transform to mem in 0.282033s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:30:05.011] [E/3] [info] [Task Finished] Transform to mem in 0.281948s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:30:05.011] [E/5] [info] [Task Finished] Transform to mem in 0.281765s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:30:05.012] [driver] [info] [Task Finished] Transform to mem in 0.281334s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:30:05.013] [E/8] [info] [Task Finished] Transform to mem in 0.281518s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:30:05.014] [E/9] [info] [Task Finished] Transform to mem in 0.282238s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:30:05.014] [E/10] [info] [Task Finished] Transform to mem in 0.281844s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:30:05.014] [E/1] [info] [Task Finished] Transform to mem in 0.281886s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:30:05.014] [E/12] [info] [Task Finished] Transform to mem in 0.281505s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:30:05.014] [E/14] [info] [Task Finished] Transform to mem in 0.282289s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:30:05.017] [E/15] [info] [Task Finished] Transform to mem in 0.282391s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:30:05.292] [E/11] [info] [Task Finished] Transform to mem in 0.282171s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:30:05.292] [E/6] [info] [Task Finished] Transform to mem in 0.281792s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:30:05.293] [E/3] [info] [Task Finished] Transform to mem in 0.281411s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:30:05.293] [E/13] [info] [Task Finished] Transform to mem in 0.282162s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:30:05.293] [driver] [info] [Task Finished] Transform to mem in 0.281627s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:30:05.293] [E/7] [info] [Task Finished] Transform to mem in 0.282638s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:30:05.293] [E/4] [info] [Task Finished] Transform to mem in 0.282363s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:30:05.294] [E/5] [info] [Task Finished] Transform to mem in 0.282280s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:30:05.294] [E/2] [info] [Task Finished] Transform to mem in 0.282963s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:30:05.295] [E/8] [info] [Task Finished] Transform to mem in 0.282103s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:30:05.296] [E/9] [info] [Task Finished] Transform to mem in 0.282046s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:30:05.296] [E/10] [info] [Task Finished] Transform to mem in 0.282134s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:30:05.296] [E/1] [info] [Task Finished] Transform to mem in 0.282206s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:30:05.297] [E/12] [info] [Task Finished] Transform to mem in 0.283174s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:30:05.297] [E/14] [info] [Task Finished] Transform to mem in 0.282811s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:30:05.334] [E/15] [info] [Task Finished] Transform to mem in 0.316467s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:30:05.334] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.86323s
[2021-03-25 10:30:05.334] [global] [info] [Transform Stage] Stage 0 total wall clock time: 45.2113s, 56350770 input rows, time to process 1 row via fast path: 0.000802319ms
[2021-03-25 10:30:05.334] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:30:05.338] [local ee] [info] compiled pure python pipeline in 0.004318s
[2021-03-25 10:30:05.338] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:30:05.339] [local ee] [info] Created 160 resolve tasks in 0.001238s
[2021-03-25 10:30:05.339] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:30:05.352] [E/8] [info] [Task Finished] Resolve in 0.012062s
[2021-03-25 10:30:05.352] [E/14] [info] [Task Finished] Resolve in 0.012076s
[2021-03-25 10:30:05.352] [E/6] [info] [Task Finished] Resolve in 0.012066s
[2021-03-25 10:30:05.352] [E/2] [info] [Task Finished] Resolve in 0.012109s
[2021-03-25 10:30:05.352] [E/15] [info] [Task Finished] Resolve in 0.012103s
[2021-03-25 10:30:05.352] [E/9] [info] [Task Finished] Resolve in 0.012142s
[2021-03-25 10:30:05.352] [E/3] [info] [Task Finished] Resolve in 0.012098s
[2021-03-25 10:30:05.352] [E/13] [info] [Task Finished] Resolve in 0.012171s
[2021-03-25 10:30:05.352] [E/10] [info] [Task Finished] Resolve in 0.012176s
[2021-03-25 10:30:05.352] [E/5] [info] [Task Finished] Resolve in 0.012209s
[2021-03-25 10:30:05.352] [E/1] [info] [Task Finished] Resolve in 0.012198s
[2021-03-25 10:30:05.352] [E/7] [info] [Task Finished] Resolve in 0.012244s
[2021-03-25 10:30:05.352] [E/11] [info] [Task Finished] Resolve in 0.012167s
[2021-03-25 10:30:05.352] [E/4] [info] [Task Finished] Resolve in 0.012200s
[2021-03-25 10:30:05.352] [E/12] [info] [Task Finished] Resolve in 0.012315s
[2021-03-25 10:30:05.352] [driver] [info] [Task Finished] Resolve in 0.012458s
[2021-03-25 10:30:05.364] [E/8] [info] [Task Finished] Resolve in 0.011952s
[2021-03-25 10:30:05.364] [E/14] [info] [Task Finished] Resolve in 0.011947s
[2021-03-25 10:30:05.364] [E/15] [info] [Task Finished] Resolve in 0.011916s
[2021-03-25 10:30:05.364] [E/6] [info] [Task Finished] Resolve in 0.011993s
[2021-03-25 10:30:05.364] [E/5] [info] [Task Finished] Resolve in 0.011927s
[2021-03-25 10:30:05.364] [E/13] [info] [Task Finished] Resolve in 0.011983s
[2021-03-25 10:30:05.364] [E/10] [info] [Task Finished] Resolve in 0.011972s
[2021-03-25 10:30:05.364] [E/7] [info] [Task Finished] Resolve in 0.011931s
[2021-03-25 10:30:05.364] [E/11] [info] [Task Finished] Resolve in 0.011919s
[2021-03-25 10:30:05.364] [E/12] [info] [Task Finished] Resolve in 0.011886s
[2021-03-25 10:30:05.364] [E/4] [info] [Task Finished] Resolve in 0.011952s
[2021-03-25 10:30:05.364] [E/2] [info] [Task Finished] Resolve in 0.012126s
[2021-03-25 10:30:05.364] [E/9] [info] [Task Finished] Resolve in 0.012140s
[2021-03-25 10:30:05.364] [E/3] [info] [Task Finished] Resolve in 0.012231s
[2021-03-25 10:30:05.364] [E/1] [info] [Task Finished] Resolve in 0.012186s
[2021-03-25 10:30:05.364] [driver] [info] [Task Finished] Resolve in 0.012259s
[2021-03-25 10:30:05.376] [E/5] [info] [Task Finished] Resolve in 0.011903s
[2021-03-25 10:30:05.376] [E/15] [info] [Task Finished] Resolve in 0.012007s
[2021-03-25 10:30:05.376] [E/8] [info] [Task Finished] Resolve in 0.012066s
[2021-03-25 10:30:05.376] [E/10] [info] [Task Finished] Resolve in 0.011932s
[2021-03-25 10:30:05.376] [E/13] [info] [Task Finished] Resolve in 0.011966s
[2021-03-25 10:30:05.376] [E/14] [info] [Task Finished] Resolve in 0.012093s
[2021-03-25 10:30:05.376] [E/11] [info] [Task Finished] Resolve in 0.011986s
[2021-03-25 10:30:05.376] [E/4] [info] [Task Finished] Resolve in 0.011942s
[2021-03-25 10:30:05.376] [E/2] [info] [Task Finished] Resolve in 0.011951s
[2021-03-25 10:30:05.376] [E/12] [info] [Task Finished] Resolve in 0.012043s
[2021-03-25 10:30:05.376] [E/3] [info] [Task Finished] Resolve in 0.011894s
[2021-03-25 10:30:05.376] [E/9] [info] [Task Finished] Resolve in 0.012026s
[2021-03-25 10:30:05.376] [E/6] [info] [Task Finished] Resolve in 0.012276s
[2021-03-25 10:30:05.376] [E/1] [info] [Task Finished] Resolve in 0.011999s
[2021-03-25 10:30:05.376] [E/7] [info] [Task Finished] Resolve in 0.012273s
[2021-03-25 10:30:05.376] [driver] [info] [Task Finished] Resolve in 0.012215s
[2021-03-25 10:30:05.388] [E/10] [info] [Task Finished] Resolve in 0.012035s
[2021-03-25 10:30:05.388] [E/8] [info] [Task Finished] Resolve in 0.012092s
[2021-03-25 10:30:05.388] [E/5] [info] [Task Finished] Resolve in 0.012152s
[2021-03-25 10:30:05.388] [E/11] [info] [Task Finished] Resolve in 0.012005s
[2021-03-25 10:30:05.388] [E/4] [info] [Task Finished] Resolve in 0.012051s
[2021-03-25 10:30:05.388] [E/14] [info] [Task Finished] Resolve in 0.012119s
[2021-03-25 10:30:05.388] [E/2] [info] [Task Finished] Resolve in 0.012043s
[2021-03-25 10:30:05.388] [E/13] [info] [Task Finished] Resolve in 0.012153s
[2021-03-25 10:30:05.388] [E/3] [info] [Task Finished] Resolve in 0.012056s
[2021-03-25 10:30:05.388] [E/15] [info] [Task Finished] Resolve in 0.012309s
[2021-03-25 10:30:05.388] [E/12] [info] [Task Finished] Resolve in 0.012172s
[2021-03-25 10:30:05.388] [E/6] [info] [Task Finished] Resolve in 0.012079s
[2021-03-25 10:30:05.388] [E/1] [info] [Task Finished] Resolve in 0.012198s
[2021-03-25 10:30:05.388] [E/7] [info] [Task Finished] Resolve in 0.012194s
[2021-03-25 10:30:05.388] [E/9] [info] [Task Finished] Resolve in 0.012390s
[2021-03-25 10:30:05.389] [driver] [info] [Task Finished] Resolve in 0.012393s
[2021-03-25 10:30:05.400] [E/10] [info] [Task Finished] Resolve in 0.012007s
[2021-03-25 10:30:05.400] [E/8] [info] [Task Finished] Resolve in 0.011973s
[2021-03-25 10:30:05.400] [E/5] [info] [Task Finished] Resolve in 0.011978s
[2021-03-25 10:30:05.400] [E/14] [info] [Task Finished] Resolve in 0.011914s
[2021-03-25 10:30:05.400] [E/13] [info] [Task Finished] Resolve in 0.011897s
[2021-03-25 10:30:05.400] [E/11] [info] [Task Finished] Resolve in 0.011993s
[2021-03-25 10:30:05.400] [E/2] [info] [Task Finished] Resolve in 0.011962s
[2021-03-25 10:30:05.400] [E/3] [info] [Task Finished] Resolve in 0.011992s
[2021-03-25 10:30:05.400] [E/12] [info] [Task Finished] Resolve in 0.011952s
[2021-03-25 10:30:05.400] [E/6] [info] [Task Finished] Resolve in 0.011955s
[2021-03-25 10:30:05.400] [E/4] [info] [Task Finished] Resolve in 0.012173s
[2021-03-25 10:30:05.400] [E/15] [info] [Task Finished] Resolve in 0.012178s
[2021-03-25 10:30:05.400] [E/1] [info] [Task Finished] Resolve in 0.011965s
[2021-03-25 10:30:05.400] [E/7] [info] [Task Finished] Resolve in 0.011936s
[2021-03-25 10:30:05.400] [E/9] [info] [Task Finished] Resolve in 0.012015s
[2021-03-25 10:30:05.401] [driver] [info] [Task Finished] Resolve in 0.012183s
[2021-03-25 10:30:05.412] [E/10] [info] [Task Finished] Resolve in 0.011847s
[2021-03-25 10:30:05.412] [E/14] [info] [Task Finished] Resolve in 0.011910s
[2021-03-25 10:30:05.412] [E/5] [info] [Task Finished] Resolve in 0.011965s
[2021-03-25 10:30:05.412] [E/2] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:30:05.412] [E/11] [info] [Task Finished] Resolve in 0.011927s
[2021-03-25 10:30:05.412] [E/3] [info] [Task Finished] Resolve in 0.011843s
[2021-03-25 10:30:05.412] [E/13] [info] [Task Finished] Resolve in 0.011992s
[2021-03-25 10:30:05.412] [E/4] [info] [Task Finished] Resolve in 0.011854s
[2021-03-25 10:30:05.412] [E/6] [info] [Task Finished] Resolve in 0.011887s
[2021-03-25 10:30:05.412] [E/8] [info] [Task Finished] Resolve in 0.012161s
[2021-03-25 10:30:05.412] [E/12] [info] [Task Finished] Resolve in 0.011972s
[2021-03-25 10:30:05.412] [E/15] [info] [Task Finished] Resolve in 0.011935s
[2021-03-25 10:30:05.412] [E/7] [info] [Task Finished] Resolve in 0.012021s
[2021-03-25 10:30:05.412] [E/9] [info] [Task Finished] Resolve in 0.011947s
[2021-03-25 10:30:05.412] [E/1] [info] [Task Finished] Resolve in 0.012174s
[2021-03-25 10:30:05.413] [driver] [info] [Task Finished] Resolve in 0.012259s
[2021-03-25 10:30:05.423] [E/10] [info] [Task Finished] Resolve in 0.011821s
[2021-03-25 10:30:05.424] [E/3] [info] [Task Finished] Resolve in 0.011805s
[2021-03-25 10:30:05.424] [E/5] [info] [Task Finished] Resolve in 0.011886s
[2021-03-25 10:30:05.424] [E/2] [info] [Task Finished] Resolve in 0.011886s
[2021-03-25 10:30:05.424] [E/14] [info] [Task Finished] Resolve in 0.011967s
[2021-03-25 10:30:05.424] [E/4] [info] [Task Finished] Resolve in 0.011812s
[2021-03-25 10:30:05.424] [E/13] [info] [Task Finished] Resolve in 0.011914s
[2021-03-25 10:30:05.424] [E/6] [info] [Task Finished] Resolve in 0.011978s
[2021-03-25 10:30:05.424] [E/12] [info] [Task Finished] Resolve in 0.011944s
[2021-03-25 10:30:05.424] [E/11] [info] [Task Finished] Resolve in 0.012148s
[2021-03-25 10:30:05.424] [E/8] [info] [Task Finished] Resolve in 0.012003s
[2021-03-25 10:30:05.424] [E/15] [info] [Task Finished] Resolve in 0.011906s
[2021-03-25 10:30:05.424] [E/7] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:30:05.424] [E/1] [info] [Task Finished] Resolve in 0.011965s
[2021-03-25 10:30:05.424] [E/9] [info] [Task Finished] Resolve in 0.012139s
[2021-03-25 10:30:05.426] [driver] [info] [Task Finished] Resolve in 0.012280s
[2021-03-25 10:30:05.435] [E/10] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:30:05.435] [E/2] [info] [Task Finished] Resolve in 0.011877s
[2021-03-25 10:30:05.436] [E/4] [info] [Task Finished] Resolve in 0.011900s
[2021-03-25 10:30:05.436] [E/5] [info] [Task Finished] Resolve in 0.011966s
[2021-03-25 10:30:05.436] [E/14] [info] [Task Finished] Resolve in 0.011908s
[2021-03-25 10:30:05.436] [E/13] [info] [Task Finished] Resolve in 0.011992s
[2021-03-25 10:30:05.436] [E/3] [info] [Task Finished] Resolve in 0.012132s
[2021-03-25 10:30:05.436] [E/6] [info] [Task Finished] Resolve in 0.011869s
[2021-03-25 10:30:05.436] [E/8] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:30:05.436] [E/12] [info] [Task Finished] Resolve in 0.011999s
[2021-03-25 10:30:05.436] [E/15] [info] [Task Finished] Resolve in 0.011978s
[2021-03-25 10:30:05.436] [E/7] [info] [Task Finished] Resolve in 0.011940s
[2021-03-25 10:30:05.436] [E/11] [info] [Task Finished] Resolve in 0.012141s
[2021-03-25 10:30:05.436] [E/1] [info] [Task Finished] Resolve in 0.011924s
[2021-03-25 10:30:05.436] [E/9] [info] [Task Finished] Resolve in 0.011950s
[2021-03-25 10:30:05.438] [driver] [info] [Task Finished] Resolve in 0.012513s
[2021-03-25 10:30:05.447] [E/10] [info] [Task Finished] Resolve in 0.011888s
[2021-03-25 10:30:05.448] [E/5] [info] [Task Finished] Resolve in 0.011989s
[2021-03-25 10:30:05.448] [E/4] [info] [Task Finished] Resolve in 0.012071s
[2021-03-25 10:30:05.448] [E/14] [info] [Task Finished] Resolve in 0.012067s
[2021-03-25 10:30:05.448] [E/13] [info] [Task Finished] Resolve in 0.012030s
[2021-03-25 10:30:05.448] [E/3] [info] [Task Finished] Resolve in 0.012035s
[2021-03-25 10:30:05.448] [E/2] [info] [Task Finished] Resolve in 0.012255s
[2021-03-25 10:30:05.448] [E/8] [info] [Task Finished] Resolve in 0.011987s
[2021-03-25 10:30:05.448] [E/6] [info] [Task Finished] Resolve in 0.012152s
[2021-03-25 10:30:05.448] [E/12] [info] [Task Finished] Resolve in 0.012165s
[2021-03-25 10:30:05.448] [E/7] [info] [Task Finished] Resolve in 0.012152s
[2021-03-25 10:30:05.448] [E/11] [info] [Task Finished] Resolve in 0.012120s
[2021-03-25 10:30:05.448] [E/15] [info] [Task Finished] Resolve in 0.012316s
[2021-03-25 10:30:05.448] [E/1] [info] [Task Finished] Resolve in 0.012121s
[2021-03-25 10:30:05.448] [E/9] [info] [Task Finished] Resolve in 0.012160s
[2021-03-25 10:30:05.450] [driver] [info] [Task Finished] Resolve in 0.012239s
[2021-03-25 10:30:05.459] [E/10] [info] [Task Finished] Resolve in 0.011961s
[2021-03-25 10:30:05.460] [E/4] [info] [Task Finished] Resolve in 0.011921s
[2021-03-25 10:30:05.460] [E/13] [info] [Task Finished] Resolve in 0.011867s
[2021-03-25 10:30:05.460] [E/14] [info] [Task Finished] Resolve in 0.012019s
[2021-03-25 10:30:05.460] [E/2] [info] [Task Finished] Resolve in 0.011929s
[2021-03-25 10:30:05.460] [E/5] [info] [Task Finished] Resolve in 0.012134s
[2021-03-25 10:30:05.460] [E/3] [info] [Task Finished] Resolve in 0.011994s
[2021-03-25 10:30:05.460] [E/8] [info] [Task Finished] Resolve in 0.011997s
[2021-03-25 10:30:05.460] [E/6] [info] [Task Finished] Resolve in 0.011972s
[2021-03-25 10:30:05.460] [E/11] [info] [Task Finished] Resolve in 0.011913s
[2021-03-25 10:30:05.460] [E/12] [info] [Task Finished] Resolve in 0.012069s
[2021-03-25 10:30:05.460] [E/7] [info] [Task Finished] Resolve in 0.011993s
[2021-03-25 10:30:05.460] [E/15] [info] [Task Finished] Resolve in 0.011974s
[2021-03-25 10:30:05.460] [E/1] [info] [Task Finished] Resolve in 0.011951s
[2021-03-25 10:30:05.460] [E/9] [info] [Task Finished] Resolve in 0.011912s
[2021-03-25 10:30:05.464] [driver] [info] [Task Finished] Resolve in 0.013611s
[2021-03-25 10:30:05.464] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.130359s
[2021-03-25 10:30:05.464] [local ee] [info] slow path for Stage 0: total wall clock time: 1.92789s, time to process 1 row via slow path: 0.00027957ms
[2021-03-25 10:30:05.464] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.130384s

[2021-03-25 10:30:05.503] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:30:05.517] [E/15] [info] [Task Finished] write to file in 0.013988s (46082 rows, 7.02 MB)
[2021-03-25 10:30:05.535] [E/2] [info] [Task Finished] write to file in 0.031728s (112467 rows, 17.12 MB)
[2021-03-25 10:30:05.535] [E/14] [info] [Task Finished] write to file in 0.032169s (112583 rows, 17.14 MB)
[2021-03-25 10:30:05.535] [E/8] [info] [Task Finished] write to file in 0.032205s (112438 rows, 17.12 MB)
[2021-03-25 10:30:05.535] [E/11] [info] [Task Finished] write to file in 0.032328s (112459 rows, 17.12 MB)
[2021-03-25 10:30:05.535] [E/7] [info] [Task Finished] write to file in 0.032359s (112421 rows, 17.11 MB)
[2021-03-25 10:30:05.536] [E/10] [info] [Task Finished] write to file in 0.032531s (112482 rows, 17.12 MB)
[2021-03-25 10:30:05.536] [E/12] [info] [Task Finished] write to file in 0.032609s (112573 rows, 17.14 MB)
[2021-03-25 10:30:05.536] [E/9] [info] [Task Finished] write to file in 0.032670s (112425 rows, 17.11 MB)
[2021-03-25 10:30:05.537] [E/6] [info] [Task Finished] write to file in 0.033506s (123377 rows, 18.78 MB)
[2021-03-25 10:30:05.537] [E/13] [info] [Task Finished] write to file in 0.033762s (123251 rows, 18.76 MB)
[2021-03-25 10:30:05.537] [E/5] [info] [Task Finished] write to file in 0.033927s (123424 rows, 18.79 MB)
[2021-03-25 10:30:05.537] [E/3] [info] [Task Finished] write to file in 0.033985s (123389 rows, 18.78 MB)
[2021-03-25 10:30:05.537] [E/4] [info] [Task Finished] write to file in 0.034063s (123299 rows, 18.77 MB)
[2021-03-25 10:30:05.537] [driver] [info] [Task Finished] write to file in 0.034062s (123410 rows, 18.79 MB)
[2021-03-25 10:30:05.541] [E/1] [info] [Task Finished] write to file in 0.037952s (112411 rows, 17.11 MB)
[2021-03-25 10:30:05.541] [global] [info] writing output took 0.076926s
[2021-03-25 10:30:05.541] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0770134s
[2021-03-25 10:30:05.541] [global] [info] [Transform Stage] Stage 0 took 3.57143s
[2021-03-25 10:30:05.541] [global] [info] Query Execution took 3.65152s. (planning: 0.0800592s, execution: 3.57146s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.00598597526550293
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 3.935399293899536 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0227649,"llvm_optimization_time_s":0.331454,"llvm_compilation_time_s":0.151707,"total_compilation_time_s":0.500759,"sampling_time_s":0.110459,"stages":[{"stage_no":0,"fast_path_wall_time_s":45.2113,"fast_path_time_s":2.86325,"fast_path_per_row_time_ns":802.319,"slow_path_wall_time_s":1.92789,"slow_path_time_s":0.130359,"slow_path_per_row_time_ns":279.57}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.00598597526550293, "jobTime": 3.935399293899536, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-25 10:30:05.566] [local execution engine] [info] Stopped local executor E/1
[2021-03-25 10:30:05.572] [local execution engine] [info] Stopped local executor E/2
[2021-03-25 10:30:05.578] [local execution engine] [info] Stopped local executor E/3
[2021-03-25 10:30:05.585] [local execution engine] [info] Stopped local executor E/4
[2021-03-25 10:30:05.591] [local execution engine] [info] Stopped local executor E/5
[2021-03-25 10:30:05.597] [local execution engine] [info] Stopped local executor E/6
[2021-03-25 10:30:05.604] [local execution engine] [info] Stopped local executor E/7
[2021-03-25 10:30:05.610] [local execution engine] [info] Stopped local executor E/8
[2021-03-25 10:30:05.616] [local execution engine] [info] Stopped local executor E/9
[2021-03-25 10:30:05.622] [local execution engine] [info] Stopped local executor E/10
[2021-03-25 10:30:05.628] [local execution engine] [info] Stopped local executor E/11
[2021-03-25 10:30:05.634] [local execution engine] [info] Stopped local executor E/12
[2021-03-25 10:30:05.640] [local execution engine] [info] Stopped local executor E/13
[2021-03-25 10:30:05.646] [local execution engine] [info] Stopped local executor E/14
[2021-03-25 10:30:05.652] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
