[2021-03-25 10:29:26.424] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:29:26.424] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:29:26.424] [local ee] [info] initializing LLVM backend
[2021-03-25 10:29:26.424] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:29:26.424] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.425] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.425] [E/1] [info] starting detached process queue
[2021-03-25 10:29:26.425] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/2] [info] starting detached process queue
[2021-03-25 10:29:26.426] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [E/3] [info] starting detached process queue
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [E/4] [info] starting detached process queue
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/5] [info] starting detached process queue
[2021-03-25 10:29:26.426] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [E/6] [info] starting detached process queue
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/7] [info] starting detached process queue
[2021-03-25 10:29:26.426] [E/8] [info] starting detached process queue
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/9] [info] starting detached process queue
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [E/10] [info] starting detached process queue
[2021-03-25 10:29:26.426] [E/11] [info] starting detached process queue
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [E/12] [info] starting detached process queue
[2021-03-25 10:29:26.426] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [E/13] [info] starting detached process queue
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:26.426] [E/14] [info] starting detached process queue
[2021-03-25 10:29:26.426] [E/15] [info] starting detached process queue
[2021-03-25 10:29:26.426] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:26.426] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 10:29:26.426] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:29:26.426] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:29:26.427] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:29:26.562] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:26.568] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:26.584] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:26.592] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:26.619] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:26.640] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:26.653] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:26.686] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:26.692] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:26.708] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:26.710] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:26.711] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:26.711] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:26.713] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:26.714] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:26.715] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:26.716] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:26.718] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:26.718] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:26.734] [logical planner] [info] logical optimization took 0.022710ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:29:26.735] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:26.735] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:26.736] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:26.737] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:26.737] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:26.738] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:26.738] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:26.739] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:26.740] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:26.741] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:26.742] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:26.743] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:26.744] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:26.744] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:26.746] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:26.747] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:26.747] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:26.748] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:26.749] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:26.749] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:26.750] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:26.751] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:26.752] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:26.752] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:26.753] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:26.754] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:26.755] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:26.756] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:26.756] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:26.788] [global] [info] Stage0 depends on: 
[2021-03-25 10:29:27.139] [global] [info] Optimization via LLVM passes took 0.333013 ms
[2021-03-25 10:29:27.291] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:29:27.291] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.50269s
[2021-03-25 10:29:27.291] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:29:27.577] [E/11] [info] [Task Finished] Transform to mem in 0.285410s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:29:27.577] [E/12] [info] [Task Finished] Transform to mem in 0.285714s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:29:27.577] [E/14] [info] [Task Finished] Transform to mem in 0.285926s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:29:27.578] [E/10] [info] [Task Finished] Transform to mem in 0.286240s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:29:27.578] [E/5] [info] [Task Finished] Transform to mem in 0.286342s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:29:27.578] [E/4] [info] [Task Finished] Transform to mem in 0.286455s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:29:27.578] [E/9] [info] [Task Finished] Transform to mem in 0.286513s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:29:27.578] [E/8] [info] [Task Finished] Transform to mem in 0.286615s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:29:27.578] [driver] [info] [Task Finished] Transform to mem in 0.286846s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:29:27.579] [E/2] [info] [Task Finished] Transform to mem in 0.287201s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:29:27.579] [E/7] [info] [Task Finished] Transform to mem in 0.287211s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:29:27.579] [E/15] [info] [Task Finished] Transform to mem in 0.287741s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:29:27.579] [E/6] [info] [Task Finished] Transform to mem in 0.287882s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:29:27.580] [E/1] [info] [Task Finished] Transform to mem in 0.288546s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:29:27.580] [E/13] [info] [Task Finished] Transform to mem in 0.288560s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:29:27.582] [E/3] [info] [Task Finished] Transform to mem in 0.290489s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:29:27.857] [E/9] [info] [Task Finished] Transform to mem in 0.278784s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:29:27.857] [E/8] [info] [Task Finished] Transform to mem in 0.278741s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:29:27.857] [E/12] [info] [Task Finished] Transform to mem in 0.279866s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:29:27.857] [E/4] [info] [Task Finished] Transform to mem in 0.279175s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:29:27.857] [E/10] [info] [Task Finished] Transform to mem in 0.279573s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:29:27.857] [E/14] [info] [Task Finished] Transform to mem in 0.280085s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:29:27.857] [driver] [info] [Task Finished] Transform to mem in 0.279255s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:29:27.858] [E/11] [info] [Task Finished] Transform to mem in 0.280822s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:29:27.858] [E/5] [info] [Task Finished] Transform to mem in 0.280491s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:29:27.859] [E/7] [info] [Task Finished] Transform to mem in 0.280478s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:29:27.859] [E/2] [info] [Task Finished] Transform to mem in 0.280744s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:29:27.860] [E/6] [info] [Task Finished] Transform to mem in 0.280480s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:29:27.860] [E/13] [info] [Task Finished] Transform to mem in 0.279963s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:29:27.860] [E/15] [info] [Task Finished] Transform to mem in 0.281335s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:29:27.862] [E/1] [info] [Task Finished] Transform to mem in 0.282068s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:29:27.864] [E/3] [info] [Task Finished] Transform to mem in 0.282428s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:29:28.136] [E/9] [info] [Task Finished] Transform to mem in 0.279191s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:29:28.136] [E/11] [info] [Task Finished] Transform to mem in 0.278757s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:29:28.137] [E/4] [info] [Task Finished] Transform to mem in 0.279577s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:29:28.137] [E/8] [info] [Task Finished] Transform to mem in 0.280262s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:29:28.137] [E/5] [info] [Task Finished] Transform to mem in 0.278849s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:29:28.138] [driver] [info] [Task Finished] Transform to mem in 0.280225s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:29:28.138] [E/14] [info] [Task Finished] Transform to mem in 0.280418s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:29:28.138] [E/12] [info] [Task Finished] Transform to mem in 0.281479s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:29:28.139] [E/6] [info] [Task Finished] Transform to mem in 0.279248s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:29:28.139] [E/10] [info] [Task Finished] Transform to mem in 0.282062s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:29:28.140] [E/2] [info] [Task Finished] Transform to mem in 0.280246s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:29:28.140] [E/7] [info] [Task Finished] Transform to mem in 0.280706s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:29:28.140] [E/13] [info] [Task Finished] Transform to mem in 0.280057s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:29:28.142] [E/15] [info] [Task Finished] Transform to mem in 0.281801s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:29:28.145] [E/1] [info] [Task Finished] Transform to mem in 0.283537s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:29:28.146] [E/3] [info] [Task Finished] Transform to mem in 0.282230s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:29:28.415] [E/9] [info] [Task Finished] Transform to mem in 0.279549s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:29:28.416] [E/8] [info] [Task Finished] Transform to mem in 0.278917s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:29:28.416] [E/11] [info] [Task Finished] Transform to mem in 0.280056s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:29:28.417] [E/4] [info] [Task Finished] Transform to mem in 0.280086s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:29:28.417] [driver] [info] [Task Finished] Transform to mem in 0.279395s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:29:28.418] [E/5] [info] [Task Finished] Transform to mem in 0.280481s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:29:28.418] [E/12] [info] [Task Finished] Transform to mem in 0.279716s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:29:28.419] [E/14] [info] [Task Finished] Transform to mem in 0.280827s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:29:28.420] [E/7] [info] [Task Finished] Transform to mem in 0.280200s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:29:28.420] [E/13] [info] [Task Finished] Transform to mem in 0.280075s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:29:28.420] [E/10] [info] [Task Finished] Transform to mem in 0.280828s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:29:28.421] [E/6] [info] [Task Finished] Transform to mem in 0.281665s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:29:28.421] [E/2] [info] [Task Finished] Transform to mem in 0.281115s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:29:28.423] [E/15] [info] [Task Finished] Transform to mem in 0.280568s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:29:28.427] [E/3] [info] [Task Finished] Transform to mem in 0.280880s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:29:28.429] [E/1] [info] [Task Finished] Transform to mem in 0.283173s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:29:28.696] [E/9] [info] [Task Finished] Transform to mem in 0.280360s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:29:28.696] [E/11] [info] [Task Finished] Transform to mem in 0.279626s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:29:28.696] [E/4] [info] [Task Finished] Transform to mem in 0.279400s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:29:28.696] [E/8] [info] [Task Finished] Transform to mem in 0.280436s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:29:28.697] [driver] [info] [Task Finished] Transform to mem in 0.279591s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:29:28.698] [E/5] [info] [Task Finished] Transform to mem in 0.280748s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:29:28.698] [E/12] [info] [Task Finished] Transform to mem in 0.280216s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:29:28.698] [E/14] [info] [Task Finished] Transform to mem in 0.279817s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:29:28.700] [E/2] [info] [Task Finished] Transform to mem in 0.279169s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:29:28.701] [E/7] [info] [Task Finished] Transform to mem in 0.280571s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:29:28.701] [E/13] [info] [Task Finished] Transform to mem in 0.280593s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:29:28.701] [E/10] [info] [Task Finished] Transform to mem in 0.281193s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:29:28.702] [E/6] [info] [Task Finished] Transform to mem in 0.281386s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:29:28.704] [E/15] [info] [Task Finished] Transform to mem in 0.281539s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:29:28.709] [E/3] [info] [Task Finished] Transform to mem in 0.281380s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:29:28.711] [E/1] [info] [Task Finished] Transform to mem in 0.282241s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:29:28.976] [E/4] [info] [Task Finished] Transform to mem in 0.279501s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:29:28.976] [E/8] [info] [Task Finished] Transform to mem in 0.279629s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:29:28.976] [driver] [info] [Task Finished] Transform to mem in 0.279770s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:29:28.977] [E/11] [info] [Task Finished] Transform to mem in 0.280412s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:29:28.977] [E/9] [info] [Task Finished] Transform to mem in 0.280952s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:29:28.978] [E/14] [info] [Task Finished] Transform to mem in 0.279941s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:29:28.979] [E/5] [info] [Task Finished] Transform to mem in 0.280486s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:29:28.979] [E/12] [info] [Task Finished] Transform to mem in 0.280436s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:29:28.979] [E/2] [info] [Task Finished] Transform to mem in 0.279357s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:29:28.981] [E/13] [info] [Task Finished] Transform to mem in 0.280082s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:29:28.981] [E/7] [info] [Task Finished] Transform to mem in 0.280731s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:29:28.981] [E/10] [info] [Task Finished] Transform to mem in 0.280121s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:29:28.983] [E/6] [info] [Task Finished] Transform to mem in 0.280751s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:29:28.985] [E/15] [info] [Task Finished] Transform to mem in 0.280964s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:29:28.991] [E/3] [info] [Task Finished] Transform to mem in 0.281872s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:29:28.993] [E/1] [info] [Task Finished] Transform to mem in 0.282069s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:29:29.256] [E/8] [info] [Task Finished] Transform to mem in 0.279778s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:29:29.256] [E/4] [info] [Task Finished] Transform to mem in 0.280805s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:29:29.257] [E/11] [info] [Task Finished] Transform to mem in 0.280046s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:29:29.257] [driver] [info] [Task Finished] Transform to mem in 0.280806s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:29:29.257] [E/9] [info] [Task Finished] Transform to mem in 0.280521s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:29:29.259] [E/12] [info] [Task Finished] Transform to mem in 0.279676s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:29:29.259] [E/14] [info] [Task Finished] Transform to mem in 0.280599s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:29:29.259] [E/5] [info] [Task Finished] Transform to mem in 0.280534s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:29:29.260] [E/2] [info] [Task Finished] Transform to mem in 0.280290s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:29:29.261] [E/7] [info] [Task Finished] Transform to mem in 0.279378s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:29:29.261] [E/13] [info] [Task Finished] Transform to mem in 0.279950s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:29:29.262] [E/10] [info] [Task Finished] Transform to mem in 0.281046s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:29:29.263] [E/6] [info] [Task Finished] Transform to mem in 0.280128s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:29:29.266] [E/15] [info] [Task Finished] Transform to mem in 0.280491s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:29:29.273] [E/3] [info] [Task Finished] Transform to mem in 0.282551s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:29:29.275] [E/1] [info] [Task Finished] Transform to mem in 0.282001s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:29:29.537] [E/8] [info] [Task Finished] Transform to mem in 0.281043s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:29.538] [E/4] [info] [Task Finished] Transform to mem in 0.281901s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:29:29.538] [E/9] [info] [Task Finished] Transform to mem in 0.281062s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:29:29.539] [E/11] [info] [Task Finished] Transform to mem in 0.281991s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:29:29.539] [E/12] [info] [Task Finished] Transform to mem in 0.280591s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:29:29.539] [E/14] [info] [Task Finished] Transform to mem in 0.280294s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:29:29.540] [driver] [info] [Task Finished] Transform to mem in 0.282500s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:29:29.540] [E/2] [info] [Task Finished] Transform to mem in 0.280667s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:29.541] [E/13] [info] [Task Finished] Transform to mem in 0.280386s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:29:29.541] [E/5] [info] [Task Finished] Transform to mem in 0.281969s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:29:29.542] [E/7] [info] [Task Finished] Transform to mem in 0.280942s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:29:29.543] [E/6] [info] [Task Finished] Transform to mem in 0.280483s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:29:29.544] [E/10] [info] [Task Finished] Transform to mem in 0.281651s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:29:29.548] [E/15] [info] [Task Finished] Transform to mem in 0.281756s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:29:29.556] [E/3] [info] [Task Finished] Transform to mem in 0.282798s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:29:29.558] [E/1] [info] [Task Finished] Transform to mem in 0.282764s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:29:29.818] [E/8] [info] [Task Finished] Transform to mem in 0.280602s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:29:29.819] [E/4] [info] [Task Finished] Transform to mem in 0.280280s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:29:29.819] [E/12] [info] [Task Finished] Transform to mem in 0.279956s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:29:29.820] [E/14] [info] [Task Finished] Transform to mem in 0.280156s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:29:29.820] [E/11] [info] [Task Finished] Transform to mem in 0.281517s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:29:29.820] [driver] [info] [Task Finished] Transform to mem in 0.280332s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:29:29.820] [E/2] [info] [Task Finished] Transform to mem in 0.280197s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:29:29.821] [E/13] [info] [Task Finished] Transform to mem in 0.280248s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:29.822] [E/9] [info] [Task Finished] Transform to mem in 0.283539s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:29:29.822] [E/5] [info] [Task Finished] Transform to mem in 0.280858s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:29:29.823] [E/7] [info] [Task Finished] Transform to mem in 0.281086s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:29:29.824] [E/6] [info] [Task Finished] Transform to mem in 0.280437s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:29:29.826] [E/10] [info] [Task Finished] Transform to mem in 0.281646s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:29:29.830] [E/15] [info] [Task Finished] Transform to mem in 0.282411s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:29:29.838] [E/3] [info] [Task Finished] Transform to mem in 0.282024s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:29:29.841] [E/1] [info] [Task Finished] Transform to mem in 0.282774s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:29:30.098] [E/8] [info] [Task Finished] Transform to mem in 0.280266s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:30.100] [E/4] [info] [Task Finished] Transform to mem in 0.280819s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:29:30.100] [E/2] [info] [Task Finished] Transform to mem in 0.279418s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:29:30.100] [E/12] [info] [Task Finished] Transform to mem in 0.281010s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:29:30.101] [E/14] [info] [Task Finished] Transform to mem in 0.281598s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:29:30.102] [E/9] [info] [Task Finished] Transform to mem in 0.280402s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:29:30.103] [E/13] [info] [Task Finished] Transform to mem in 0.281776s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:29:30.104] [E/6] [info] [Task Finished] Transform to mem in 0.279675s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:29:30.104] [E/11] [info] [Task Finished] Transform to mem in 0.283470s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:29:30.104] [E/7] [info] [Task Finished] Transform to mem in 0.281294s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:29:30.104] [E/5] [info] [Task Finished] Transform to mem in 0.281838s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:29:30.107] [E/10] [info] [Task Finished] Transform to mem in 0.280838s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:29:30.111] [driver] [info] [Task Finished] Transform to mem in 0.290692s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:29:30.113] [E/15] [info] [Task Finished] Transform to mem in 0.282825s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:29:30.121] [E/3] [info] [Task Finished] Transform to mem in 0.282780s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:29:30.157] [E/1] [info] [Task Finished] Transform to mem in 0.316365s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:29:30.157] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.86615s
[2021-03-25 10:29:30.157] [global] [info] [Transform Stage] Stage 0 total wall clock time: 45.064s, 56350770 input rows, time to process 1 row via fast path: 0.000799706ms
[2021-03-25 10:29:30.157] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:29:30.162] [local ee] [info] compiled pure python pipeline in 0.004274s
[2021-03-25 10:29:30.162] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:29:30.163] [local ee] [info] Created 160 resolve tasks in 0.001250s
[2021-03-25 10:29:30.163] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:29:30.175] [E/1] [info] [Task Finished] Resolve in 0.011898s
[2021-03-25 10:29:30.175] [E/3] [info] [Task Finished] Resolve in 0.011915s
[2021-03-25 10:29:30.175] [E/5] [info] [Task Finished] Resolve in 0.011929s
[2021-03-25 10:29:30.175] [E/2] [info] [Task Finished] Resolve in 0.011985s
[2021-03-25 10:29:30.175] [E/4] [info] [Task Finished] Resolve in 0.011991s
[2021-03-25 10:29:30.175] [E/14] [info] [Task Finished] Resolve in 0.012004s
[2021-03-25 10:29:30.175] [driver] [info] [Task Finished] Resolve in 0.011991s
[2021-03-25 10:29:30.175] [E/11] [info] [Task Finished] Resolve in 0.012037s
[2021-03-25 10:29:30.175] [E/6] [info] [Task Finished] Resolve in 0.012057s
[2021-03-25 10:29:30.175] [E/9] [info] [Task Finished] Resolve in 0.012063s
[2021-03-25 10:29:30.175] [E/8] [info] [Task Finished] Resolve in 0.011990s
[2021-03-25 10:29:30.175] [E/7] [info] [Task Finished] Resolve in 0.012089s
[2021-03-25 10:29:30.175] [E/13] [info] [Task Finished] Resolve in 0.012089s
[2021-03-25 10:29:30.175] [E/10] [info] [Task Finished] Resolve in 0.012130s
[2021-03-25 10:29:30.175] [E/15] [info] [Task Finished] Resolve in 0.012153s
[2021-03-25 10:29:30.175] [E/12] [info] [Task Finished] Resolve in 0.012175s
[2021-03-25 10:29:30.186] [E/3] [info] [Task Finished] Resolve in 0.011743s
[2021-03-25 10:29:30.187] [E/2] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:29:30.187] [E/1] [info] [Task Finished] Resolve in 0.011925s
[2021-03-25 10:29:30.187] [E/9] [info] [Task Finished] Resolve in 0.011745s
[2021-03-25 10:29:30.187] [E/14] [info] [Task Finished] Resolve in 0.011803s
[2021-03-25 10:29:30.187] [E/11] [info] [Task Finished] Resolve in 0.011825s
[2021-03-25 10:29:30.187] [driver] [info] [Task Finished] Resolve in 0.011850s
[2021-03-25 10:29:30.187] [E/4] [info] [Task Finished] Resolve in 0.011895s
[2021-03-25 10:29:30.187] [E/5] [info] [Task Finished] Resolve in 0.011997s
[2021-03-25 10:29:30.187] [E/6] [info] [Task Finished] Resolve in 0.011913s
[2021-03-25 10:29:30.187] [E/7] [info] [Task Finished] Resolve in 0.011898s
[2021-03-25 10:29:30.187] [E/10] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:29:30.187] [E/13] [info] [Task Finished] Resolve in 0.011971s
[2021-03-25 10:29:30.187] [E/8] [info] [Task Finished] Resolve in 0.012067s
[2021-03-25 10:29:30.188] [E/15] [info] [Task Finished] Resolve in 0.011893s
[2021-03-25 10:29:30.188] [E/12] [info] [Task Finished] Resolve in 0.011952s
[2021-03-25 10:29:30.199] [E/3] [info] [Task Finished] Resolve in 0.012128s
[2021-03-25 10:29:30.199] [E/1] [info] [Task Finished] Resolve in 0.011982s
[2021-03-25 10:29:30.199] [driver] [info] [Task Finished] Resolve in 0.011936s
[2021-03-25 10:29:30.199] [E/4] [info] [Task Finished] Resolve in 0.011969s
[2021-03-25 10:29:30.199] [E/11] [info] [Task Finished] Resolve in 0.012008s
[2021-03-25 10:29:30.199] [E/14] [info] [Task Finished] Resolve in 0.012047s
[2021-03-25 10:29:30.199] [E/2] [info] [Task Finished] Resolve in 0.012140s
[2021-03-25 10:29:30.199] [E/7] [info] [Task Finished] Resolve in 0.012009s
[2021-03-25 10:29:30.199] [E/5] [info] [Task Finished] Resolve in 0.012085s
[2021-03-25 10:29:30.199] [E/9] [info] [Task Finished] Resolve in 0.012198s
[2021-03-25 10:29:30.199] [E/6] [info] [Task Finished] Resolve in 0.012087s
[2021-03-25 10:29:30.199] [E/13] [info] [Task Finished] Resolve in 0.012014s
[2021-03-25 10:29:30.199] [E/8] [info] [Task Finished] Resolve in 0.011960s
[2021-03-25 10:29:30.199] [E/10] [info] [Task Finished] Resolve in 0.012233s
[2021-03-25 10:29:30.200] [E/15] [info] [Task Finished] Resolve in 0.011879s
[2021-03-25 10:29:30.200] [E/12] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:29:30.210] [E/3] [info] [Task Finished] Resolve in 0.011773s
[2021-03-25 10:29:30.210] [E/1] [info] [Task Finished] Resolve in 0.011789s
[2021-03-25 10:29:30.210] [E/4] [info] [Task Finished] Resolve in 0.011764s
[2021-03-25 10:29:30.211] [E/11] [info] [Task Finished] Resolve in 0.011774s
[2021-03-25 10:29:30.211] [E/2] [info] [Task Finished] Resolve in 0.011765s
[2021-03-25 10:29:30.211] [E/14] [info] [Task Finished] Resolve in 0.011905s
[2021-03-25 10:29:30.211] [E/9] [info] [Task Finished] Resolve in 0.011834s
[2021-03-25 10:29:30.211] [driver] [info] [Task Finished] Resolve in 0.012061s
[2021-03-25 10:29:30.211] [E/13] [info] [Task Finished] Resolve in 0.011799s
[2021-03-25 10:29:30.211] [E/5] [info] [Task Finished] Resolve in 0.011878s
[2021-03-25 10:29:30.211] [E/8] [info] [Task Finished] Resolve in 0.011787s
[2021-03-25 10:29:30.211] [E/7] [info] [Task Finished] Resolve in 0.012015s
[2021-03-25 10:29:30.211] [E/10] [info] [Task Finished] Resolve in 0.011767s
[2021-03-25 10:29:30.211] [E/6] [info] [Task Finished] Resolve in 0.012085s
[2021-03-25 10:29:30.211] [E/15] [info] [Task Finished] Resolve in 0.011726s
[2021-03-25 10:29:30.211] [E/12] [info] [Task Finished] Resolve in 0.011809s
[2021-03-25 10:29:30.222] [E/3] [info] [Task Finished] Resolve in 0.011734s
[2021-03-25 10:29:30.222] [E/1] [info] [Task Finished] Resolve in 0.011739s
[2021-03-25 10:29:30.222] [E/4] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:29:30.222] [E/2] [info] [Task Finished] Resolve in 0.011860s
[2021-03-25 10:29:30.223] [driver] [info] [Task Finished] Resolve in 0.011731s
[2021-03-25 10:29:30.223] [E/9] [info] [Task Finished] Resolve in 0.011786s
[2021-03-25 10:29:30.223] [E/5] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:29:30.223] [E/14] [info] [Task Finished] Resolve in 0.011958s
[2021-03-25 10:29:30.223] [E/11] [info] [Task Finished] Resolve in 0.012129s
[2021-03-25 10:29:30.223] [E/13] [info] [Task Finished] Resolve in 0.011917s
[2021-03-25 10:29:30.223] [E/7] [info] [Task Finished] Resolve in 0.011849s
[2021-03-25 10:29:30.223] [E/10] [info] [Task Finished] Resolve in 0.011835s
[2021-03-25 10:29:30.223] [E/8] [info] [Task Finished] Resolve in 0.012078s
[2021-03-25 10:29:30.223] [E/6] [info] [Task Finished] Resolve in 0.011987s
[2021-03-25 10:29:30.223] [E/15] [info] [Task Finished] Resolve in 0.011782s
[2021-03-25 10:29:30.223] [E/12] [info] [Task Finished] Resolve in 0.011734s
[2021-03-25 10:29:30.234] [E/1] [info] [Task Finished] Resolve in 0.011733s
[2021-03-25 10:29:30.234] [E/3] [info] [Task Finished] Resolve in 0.011792s
[2021-03-25 10:29:30.234] [E/4] [info] [Task Finished] Resolve in 0.011839s
[2021-03-25 10:29:30.234] [driver] [info] [Task Finished] Resolve in 0.011690s
[2021-03-25 10:29:30.234] [E/9] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:29:30.234] [E/11] [info] [Task Finished] Resolve in 0.011725s
[2021-03-25 10:29:30.234] [E/5] [info] [Task Finished] Resolve in 0.011859s
[2021-03-25 10:29:30.235] [E/14] [info] [Task Finished] Resolve in 0.011840s
[2021-03-25 10:29:30.235] [E/2] [info] [Task Finished] Resolve in 0.012031s
[2021-03-25 10:29:30.235] [E/13] [info] [Task Finished] Resolve in 0.011859s
[2021-03-25 10:29:30.235] [E/10] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:29:30.235] [E/7] [info] [Task Finished] Resolve in 0.011997s
[2021-03-25 10:29:30.235] [E/8] [info] [Task Finished] Resolve in 0.011898s
[2021-03-25 10:29:30.235] [E/15] [info] [Task Finished] Resolve in 0.011733s
[2021-03-25 10:29:30.235] [E/6] [info] [Task Finished] Resolve in 0.011881s
[2021-03-25 10:29:30.235] [E/12] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:29:30.246] [E/3] [info] [Task Finished] Resolve in 0.011706s
[2021-03-25 10:29:30.246] [E/4] [info] [Task Finished] Resolve in 0.011744s
[2021-03-25 10:29:30.246] [E/1] [info] [Task Finished] Resolve in 0.011987s
[2021-03-25 10:29:30.246] [driver] [info] [Task Finished] Resolve in 0.011734s
[2021-03-25 10:29:30.246] [E/9] [info] [Task Finished] Resolve in 0.011831s
[2021-03-25 10:29:30.246] [E/2] [info] [Task Finished] Resolve in 0.011738s
[2021-03-25 10:29:30.246] [E/11] [info] [Task Finished] Resolve in 0.011864s
[2021-03-25 10:29:30.246] [E/14] [info] [Task Finished] Resolve in 0.011787s
[2021-03-25 10:29:30.246] [E/5] [info] [Task Finished] Resolve in 0.011883s
[2021-03-25 10:29:30.246] [E/13] [info] [Task Finished] Resolve in 0.011884s
[2021-03-25 10:29:30.247] [E/7] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:29:30.247] [E/15] [info] [Task Finished] Resolve in 0.011764s
[2021-03-25 10:29:30.247] [E/8] [info] [Task Finished] Resolve in 0.011904s
[2021-03-25 10:29:30.247] [E/6] [info] [Task Finished] Resolve in 0.011807s
[2021-03-25 10:29:30.247] [E/10] [info] [Task Finished] Resolve in 0.012095s
[2021-03-25 10:29:30.247] [E/12] [info] [Task Finished] Resolve in 0.011854s
[2021-03-25 10:29:30.258] [E/3] [info] [Task Finished] Resolve in 0.011810s
[2021-03-25 10:29:30.258] [driver] [info] [Task Finished] Resolve in 0.011913s
[2021-03-25 10:29:30.258] [E/1] [info] [Task Finished] Resolve in 0.011990s
[2021-03-25 10:29:30.258] [E/9] [info] [Task Finished] Resolve in 0.011950s
[2021-03-25 10:29:30.258] [E/4] [info] [Task Finished] Resolve in 0.012209s
[2021-03-25 10:29:30.258] [E/2] [info] [Task Finished] Resolve in 0.011974s
[2021-03-25 10:29:30.258] [E/11] [info] [Task Finished] Resolve in 0.011973s
[2021-03-25 10:29:30.258] [E/14] [info] [Task Finished] Resolve in 0.011976s
[2021-03-25 10:29:30.258] [E/5] [info] [Task Finished] Resolve in 0.012080s
[2021-03-25 10:29:30.259] [E/13] [info] [Task Finished] Resolve in 0.012108s
[2021-03-25 10:29:30.259] [E/15] [info] [Task Finished] Resolve in 0.012028s
[2021-03-25 10:29:30.259] [E/7] [info] [Task Finished] Resolve in 0.012183s
[2021-03-25 10:29:30.259] [E/8] [info] [Task Finished] Resolve in 0.012005s
[2021-03-25 10:29:30.259] [E/10] [info] [Task Finished] Resolve in 0.012022s
[2021-03-25 10:29:30.259] [E/6] [info] [Task Finished] Resolve in 0.012051s
[2021-03-25 10:29:30.259] [E/12] [info] [Task Finished] Resolve in 0.012097s
[2021-03-25 10:29:30.269] [E/3] [info] [Task Finished] Resolve in 0.011788s
[2021-03-25 10:29:30.270] [E/1] [info] [Task Finished] Resolve in 0.011825s
[2021-03-25 10:29:30.270] [E/9] [info] [Task Finished] Resolve in 0.011745s
[2021-03-25 10:29:30.270] [driver] [info] [Task Finished] Resolve in 0.011988s
[2021-03-25 10:29:30.270] [E/4] [info] [Task Finished] Resolve in 0.011746s
[2021-03-25 10:29:30.270] [E/2] [info] [Task Finished] Resolve in 0.011757s
[2021-03-25 10:29:30.270] [E/14] [info] [Task Finished] Resolve in 0.011782s
[2021-03-25 10:29:30.270] [E/11] [info] [Task Finished] Resolve in 0.011849s
[2021-03-25 10:29:30.270] [E/5] [info] [Task Finished] Resolve in 0.011962s
[2021-03-25 10:29:30.270] [E/7] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:29:30.271] [E/15] [info] [Task Finished] Resolve in 0.011902s
[2021-03-25 10:29:30.271] [E/8] [info] [Task Finished] Resolve in 0.011843s
[2021-03-25 10:29:30.271] [E/6] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:29:30.271] [E/10] [info] [Task Finished] Resolve in 0.011867s
[2021-03-25 10:29:30.271] [E/13] [info] [Task Finished] Resolve in 0.012035s
[2021-03-25 10:29:30.271] [E/12] [info] [Task Finished] Resolve in 0.011865s
[2021-03-25 10:29:30.281] [E/3] [info] [Task Finished] Resolve in 0.011724s
[2021-03-25 10:29:30.282] [E/4] [info] [Task Finished] Resolve in 0.011753s
[2021-03-25 10:29:30.282] [E/1] [info] [Task Finished] Resolve in 0.011919s
[2021-03-25 10:29:30.282] [driver] [info] [Task Finished] Resolve in 0.011849s
[2021-03-25 10:29:30.282] [E/2] [info] [Task Finished] Resolve in 0.011714s
[2021-03-25 10:29:30.282] [E/9] [info] [Task Finished] Resolve in 0.011861s
[2021-03-25 10:29:30.282] [E/11] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:29:30.282] [E/14] [info] [Task Finished] Resolve in 0.011892s
[2021-03-25 10:29:30.282] [E/7] [info] [Task Finished] Resolve in 0.011828s
[2021-03-25 10:29:30.282] [E/5] [info] [Task Finished] Resolve in 0.011897s
[2021-03-25 10:29:30.282] [E/8] [info] [Task Finished] Resolve in 0.011861s
[2021-03-25 10:29:30.282] [E/15] [info] [Task Finished] Resolve in 0.011910s
[2021-03-25 10:29:30.283] [E/6] [info] [Task Finished] Resolve in 0.011859s
[2021-03-25 10:29:30.283] [E/10] [info] [Task Finished] Resolve in 0.011849s
[2021-03-25 10:29:30.283] [E/13] [info] [Task Finished] Resolve in 0.011845s
[2021-03-25 10:29:30.284] [E/12] [info] [Task Finished] Resolve in 0.013232s
[2021-03-25 10:29:30.284] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.127073s
[2021-03-25 10:29:30.284] [local ee] [info] slow path for Stage 0: total wall clock time: 1.90578s, time to process 1 row via slow path: 0.000276363ms
[2021-03-25 10:29:30.284] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.127099s

[2021-03-25 10:29:30.323] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:29:30.337] [E/3] [info] [Task Finished] write to file in 0.013900s (46082 rows, 7.02 MB)
[2021-03-25 10:29:30.355] [E/7] [info] [Task Finished] write to file in 0.031653s (112482 rows, 17.12 MB)
[2021-03-25 10:29:30.355] [E/12] [info] [Task Finished] write to file in 0.031805s (112421 rows, 17.11 MB)
[2021-03-25 10:29:30.355] [E/8] [info] [Task Finished] write to file in 0.031877s (112438 rows, 17.12 MB)
[2021-03-25 10:29:30.355] [E/15] [info] [Task Finished] write to file in 0.031894s (112583 rows, 17.14 MB)
[2021-03-25 10:29:30.355] [E/4] [info] [Task Finished] write to file in 0.031915s (112467 rows, 17.12 MB)
[2021-03-25 10:29:30.355] [E/14] [info] [Task Finished] write to file in 0.031970s (112425 rows, 17.11 MB)
[2021-03-25 10:29:30.355] [E/11] [info] [Task Finished] write to file in 0.032034s (112573 rows, 17.14 MB)
[2021-03-25 10:29:30.355] [E/13] [info] [Task Finished] write to file in 0.032214s (112459 rows, 17.12 MB)
[2021-03-25 10:29:30.357] [E/9] [info] [Task Finished] write to file in 0.033343s (123299 rows, 18.77 MB)
[2021-03-25 10:29:30.357] [E/6] [info] [Task Finished] write to file in 0.033555s (123424 rows, 18.79 MB)
[2021-03-25 10:29:30.357] [E/1] [info] [Task Finished] write to file in 0.033635s (123389 rows, 18.78 MB)
[2021-03-25 10:29:30.357] [E/10] [info] [Task Finished] write to file in 0.033800s (123410 rows, 18.79 MB)
[2021-03-25 10:29:30.357] [driver] [info] [Task Finished] write to file in 0.033843s (123251 rows, 18.76 MB)
[2021-03-25 10:29:30.357] [E/5] [info] [Task Finished] write to file in 0.033835s (123377 rows, 18.78 MB)
[2021-03-25 10:29:30.361] [E/2] [info] [Task Finished] write to file in 0.037918s (112411 rows, 17.11 MB)
[2021-03-25 10:29:30.361] [global] [info] writing output took 0.076947s
[2021-03-25 10:29:30.361] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0770314s
[2021-03-25 10:29:30.361] [global] [info] [Transform Stage] Stage 0 took 3.573s
[2021-03-25 10:29:30.361] [global] [info] Query Execution took 3.65285s. (planning: 0.079815s, execution: 3.57304s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005970001220703125
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 3.935990333557129 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0227097,"llvm_optimization_time_s":0.333013,"llvm_compilation_time_s":0.152075,"total_compilation_time_s":0.502688,"sampling_time_s":0.110192,"stages":[{"stage_no":0,"fast_path_wall_time_s":45.064,"fast_path_time_s":2.86617,"fast_path_per_row_time_ns":799.706,"slow_path_wall_time_s":1.90578,"slow_path_time_s":0.127073,"slow_path_per_row_time_ns":276.363}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.005970001220703125, "jobTime": 3.935990333557129, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-25 10:29:30.386] [local execution engine] [info] Stopped local executor E/1
[2021-03-25 10:29:30.392] [local execution engine] [info] Stopped local executor E/2
[2021-03-25 10:29:30.398] [local execution engine] [info] Stopped local executor E/3
[2021-03-25 10:29:30.405] [local execution engine] [info] Stopped local executor E/4
[2021-03-25 10:29:30.411] [local execution engine] [info] Stopped local executor E/5
[2021-03-25 10:29:30.417] [local execution engine] [info] Stopped local executor E/6
[2021-03-25 10:29:30.424] [local execution engine] [info] Stopped local executor E/7
[2021-03-25 10:29:30.430] [local execution engine] [info] Stopped local executor E/8
[2021-03-25 10:29:30.436] [local execution engine] [info] Stopped local executor E/9
[2021-03-25 10:29:30.442] [local execution engine] [info] Stopped local executor E/10
[2021-03-25 10:29:30.448] [local execution engine] [info] Stopped local executor E/11
[2021-03-25 10:29:30.454] [local execution engine] [info] Stopped local executor E/12
[2021-03-25 10:29:30.461] [local execution engine] [info] Stopped local executor E/13
[2021-03-25 10:29:30.467] [local execution engine] [info] Stopped local executor E/14
[2021-03-25 10:29:30.473] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
