[2021-03-25 13:22:10.108] [global] [error] could not find backend, defaulting to local
[2021-03-25 13:22:10.109] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 13:22:10.109] [local ee] [info] initializing LLVM backend
[2021-03-25 13:22:10.109] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 13:22:10.109] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/1] [info] starting detached process queue
[2021-03-25 13:22:10.110] [E/2] [info] starting detached process queue
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [E/3] [info] starting detached process queue
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/4] [info] starting detached process queue
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [E/5] [info] starting detached process queue
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/6] [info] starting detached process queue
[2021-03-25 13:22:10.110] [E/7] [info] starting detached process queue
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/8] [info] starting detached process queue
[2021-03-25 13:22:10.110] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [E/9] [info] starting detached process queue
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/10] [info] starting detached process queue
[2021-03-25 13:22:10.110] [E/11] [info] starting detached process queue
[2021-03-25 13:22:10.110] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/12] [info] starting detached process queue
[2021-03-25 13:22:10.110] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.110] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.110] [E/13] [info] starting detached process queue
[2021-03-25 13:22:10.110] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.111] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:10.111] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.111] [E/14] [info] starting detached process queue
[2021-03-25 13:22:10.111] [E/15] [info] starting detached process queue
[2021-03-25 13:22:10.111] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 13:22:10.111] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.111] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:10.111] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 13:22:10.111] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 13:22:10.111] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 13:22:10.247] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:10.254] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:10.269] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:10.278] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:10.305] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:10.325] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:10.339] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:10.372] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:10.378] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:10.394] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:22:10.396] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:10.397] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:10.397] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:22:10.399] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:10.400] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:10.400] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:22:10.402] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:10.403] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:10.404] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:22:10.420] [logical planner] [info] logical optimization took 0.022645ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 13:22:10.420] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 13:22:10.421] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 13:22:10.422] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 13:22:10.422] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 13:22:10.423] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 13:22:10.423] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 13:22:10.424] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 13:22:10.425] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 13:22:10.426] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 13:22:10.427] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 13:22:10.428] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 13:22:10.429] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:22:10.429] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:22:10.430] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 13:22:10.432] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 13:22:10.433] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 13:22:10.433] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 13:22:10.434] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 13:22:10.434] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 13:22:10.435] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 13:22:10.435] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 13:22:10.436] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 13:22:10.437] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 13:22:10.438] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 13:22:10.439] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 13:22:10.440] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 13:22:10.441] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:22:10.441] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:22:10.442] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 13:22:10.474] [global] [info] Stage0 depends on: 
[2021-03-25 13:22:10.826] [global] [info] Optimization via LLVM passes took 0.334616 ms
[2021-03-25 13:22:10.979] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 13:22:10.979] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.504694s
[2021-03-25 13:22:10.979] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 13:22:11.262] [E/12] [info] [Task Finished] Transform to mem in 0.282971s (10997 normal rows, 42910 exceptions)
[2021-03-25 13:22:11.262] [E/4] [info] [Task Finished] Transform to mem in 0.282982s (11153 normal rows, 42968 exceptions)
[2021-03-25 13:22:11.262] [E/13] [info] [Task Finished] Transform to mem in 0.283077s (11036 normal rows, 43142 exceptions)
[2021-03-25 13:22:11.263] [E/11] [info] [Task Finished] Transform to mem in 0.283463s (11086 normal rows, 43015 exceptions)
[2021-03-25 13:22:11.263] [E/9] [info] [Task Finished] Transform to mem in 0.283542s (11026 normal rows, 43206 exceptions)
[2021-03-25 13:22:11.263] [E/7] [info] [Task Finished] Transform to mem in 0.283790s (11105 normal rows, 43095 exceptions)
[2021-03-25 13:22:11.263] [E/3] [info] [Task Finished] Transform to mem in 0.283957s (11005 normal rows, 42741 exceptions)
[2021-03-25 13:22:11.263] [E/2] [info] [Task Finished] Transform to mem in 0.284110s (11036 normal rows, 43139 exceptions)
[2021-03-25 13:22:11.264] [E/15] [info] [Task Finished] Transform to mem in 0.284612s (10997 normal rows, 42873 exceptions)
[2021-03-25 13:22:11.264] [E/8] [info] [Task Finished] Transform to mem in 0.284689s (11153 normal rows, 42970 exceptions)
[2021-03-25 13:22:11.264] [E/6] [info] [Task Finished] Transform to mem in 0.284709s (11005 normal rows, 42744 exceptions)
[2021-03-25 13:22:11.264] [E/5] [info] [Task Finished] Transform to mem in 0.285299s (11047 normal rows, 43210 exceptions)
[2021-03-25 13:22:11.265] [E/14] [info] [Task Finished] Transform to mem in 0.285986s (11008 normal rows, 43077 exceptions)
[2021-03-25 13:22:11.265] [driver] [info] [Task Finished] Transform to mem in 0.286292s (10987 normal rows, 43113 exceptions)
[2021-03-25 13:22:11.266] [E/1] [info] [Task Finished] Transform to mem in 0.286950s (11092 normal rows, 43495 exceptions)
[2021-03-25 13:22:11.267] [E/10] [info] [Task Finished] Transform to mem in 0.287838s (11073 normal rows, 43414 exceptions)
[2021-03-25 13:22:11.545] [E/12] [info] [Task Finished] Transform to mem in 0.282833s (11086 normal rows, 42996 exceptions)
[2021-03-25 13:22:11.545] [E/13] [info] [Task Finished] Transform to mem in 0.282861s (11153 normal rows, 42978 exceptions)
[2021-03-25 13:22:11.545] [E/4] [info] [Task Finished] Transform to mem in 0.282939s (11092 normal rows, 43505 exceptions)
[2021-03-25 13:22:11.546] [E/3] [info] [Task Finished] Transform to mem in 0.282447s (11036 normal rows, 43115 exceptions)
[2021-03-25 13:22:11.546] [E/9] [info] [Task Finished] Transform to mem in 0.282946s (10982 normal rows, 43059 exceptions)
[2021-03-25 13:22:11.546] [E/11] [info] [Task Finished] Transform to mem in 0.283687s (11026 normal rows, 43205 exceptions)
[2021-03-25 13:22:11.547] [E/2] [info] [Task Finished] Transform to mem in 0.283469s (11005 normal rows, 42772 exceptions)
[2021-03-25 13:22:11.547] [E/7] [info] [Task Finished] Transform to mem in 0.284218s (11023 normal rows, 42910 exceptions)
[2021-03-25 13:22:11.547] [E/8] [info] [Task Finished] Transform to mem in 0.283626s (11079 normal rows, 43539 exceptions)
[2021-03-25 13:22:11.548] [E/6] [info] [Task Finished] Transform to mem in 0.283696s (11111 normal rows, 42961 exceptions)
[2021-03-25 13:22:11.548] [E/14] [info] [Task Finished] Transform to mem in 0.282983s (10987 normal rows, 43068 exceptions)
[2021-03-25 13:22:11.548] [E/15] [info] [Task Finished] Transform to mem in 0.284512s (11086 normal rows, 42970 exceptions)
[2021-03-25 13:22:11.548] [E/5] [info] [Task Finished] Transform to mem in 0.283843s (11076 normal rows, 43220 exceptions)
[2021-03-25 13:22:11.548] [driver] [info] [Task Finished] Transform to mem in 0.282890s (11023 normal rows, 42880 exceptions)
[2021-03-25 13:22:11.550] [E/1] [info] [Task Finished] Transform to mem in 0.283475s (11036 normal rows, 43053 exceptions)
[2021-03-25 13:22:11.550] [E/10] [info] [Task Finished] Transform to mem in 0.283051s (10992 normal rows, 42864 exceptions)
[2021-03-25 13:22:11.824] [E/4] [info] [Task Finished] Transform to mem in 0.279316s (11127 normal rows, 42969 exceptions)
[2021-03-25 13:22:11.825] [E/3] [info] [Task Finished] Transform to mem in 0.279468s (11076 normal rows, 43221 exceptions)
[2021-03-25 13:22:11.825] [E/13] [info] [Task Finished] Transform to mem in 0.279937s (11063 normal rows, 43617 exceptions)
[2021-03-25 13:22:11.825] [E/9] [info] [Task Finished] Transform to mem in 0.279700s (10987 normal rows, 43063 exceptions)
[2021-03-25 13:22:11.826] [E/12] [info] [Task Finished] Transform to mem in 0.280726s (11099 normal rows, 42882 exceptions)
[2021-03-25 13:22:11.827] [E/7] [info] [Task Finished] Transform to mem in 0.279918s (11021 normal rows, 42887 exceptions)
[2021-03-25 13:22:11.827] [E/11] [info] [Task Finished] Transform to mem in 0.280870s (11004 normal rows, 42876 exceptions)
[2021-03-25 13:22:11.827] [E/8] [info] [Task Finished] Transform to mem in 0.279887s (11064 normal rows, 42832 exceptions)
[2021-03-25 13:22:11.828] [E/2] [info] [Task Finished] Transform to mem in 0.280797s (11026 normal rows, 43041 exceptions)
[2021-03-25 13:22:11.828] [E/6] [info] [Task Finished] Transform to mem in 0.279975s (11098 normal rows, 43603 exceptions)
[2021-03-25 13:22:11.828] [E/15] [info] [Task Finished] Transform to mem in 0.279848s (11076 normal rows, 43212 exceptions)
[2021-03-25 13:22:11.829] [E/1] [info] [Task Finished] Transform to mem in 0.279477s (11026 normal rows, 43037 exceptions)
[2021-03-25 13:22:11.829] [E/5] [info] [Task Finished] Transform to mem in 0.281100s (10987 normal rows, 43041 exceptions)
[2021-03-25 13:22:11.830] [E/14] [info] [Task Finished] Transform to mem in 0.282084s (11127 normal rows, 43028 exceptions)
[2021-03-25 13:22:11.832] [driver] [info] [Task Finished] Transform to mem in 0.283320s (11004 normal rows, 42913 exceptions)
[2021-03-25 13:22:11.832] [E/10] [info] [Task Finished] Transform to mem in 0.281763s (11012 normal rows, 42883 exceptions)
[2021-03-25 13:22:12.104] [E/4] [info] [Task Finished] Transform to mem in 0.279563s (11073 normal rows, 42820 exceptions)
[2021-03-25 13:22:12.105] [E/9] [info] [Task Finished] Transform to mem in 0.279135s (11076 normal rows, 43152 exceptions)
[2021-03-25 13:22:12.105] [E/13] [info] [Task Finished] Transform to mem in 0.279787s (11130 normal rows, 43084 exceptions)
[2021-03-25 13:22:12.105] [E/3] [info] [Task Finished] Transform to mem in 0.280022s (11095 normal rows, 43503 exceptions)
[2021-03-25 13:22:12.107] [E/12] [info] [Task Finished] Transform to mem in 0.280941s (10976 normal rows, 43110 exceptions)
[2021-03-25 13:22:12.107] [E/7] [info] [Task Finished] Transform to mem in 0.280014s (11015 normal rows, 42966 exceptions)
[2021-03-25 13:22:12.107] [E/2] [info] [Task Finished] Transform to mem in 0.279638s (11073 normal rows, 42754 exceptions)
[2021-03-25 13:22:12.107] [E/15] [info] [Task Finished] Transform to mem in 0.279327s (11130 normal rows, 43033 exceptions)
[2021-03-25 13:22:12.108] [E/11] [info] [Task Finished] Transform to mem in 0.281118s (11026 normal rows, 43035 exceptions)
[2021-03-25 13:22:12.108] [E/8] [info] [Task Finished] Transform to mem in 0.280941s (11012 normal rows, 42888 exceptions)
[2021-03-25 13:22:12.109] [E/6] [info] [Task Finished] Transform to mem in 0.281502s (11095 normal rows, 43552 exceptions)
[2021-03-25 13:22:12.109] [E/1] [info] [Task Finished] Transform to mem in 0.280105s (11069 normal rows, 43142 exceptions)
[2021-03-25 13:22:12.110] [E/5] [info] [Task Finished] Transform to mem in 0.280177s (10974 normal rows, 43172 exceptions)
[2021-03-25 13:22:12.111] [E/14] [info] [Task Finished] Transform to mem in 0.280955s (11008 normal rows, 42964 exceptions)
[2021-03-25 13:22:12.112] [E/10] [info] [Task Finished] Transform to mem in 0.279823s (11012 normal rows, 42911 exceptions)
[2021-03-25 13:22:12.112] [driver] [info] [Task Finished] Transform to mem in 0.280347s (11042 normal rows, 43023 exceptions)
[2021-03-25 13:22:12.384] [E/4] [info] [Task Finished] Transform to mem in 0.279553s (11063 normal rows, 42726 exceptions)
[2021-03-25 13:22:12.384] [E/9] [info] [Task Finished] Transform to mem in 0.279903s (11105 normal rows, 43555 exceptions)
[2021-03-25 13:22:12.384] [E/13] [info] [Task Finished] Transform to mem in 0.279554s (11081 normal rows, 43050 exceptions)
[2021-03-25 13:22:12.385] [E/3] [info] [Task Finished] Transform to mem in 0.279396s (11087 normal rows, 43150 exceptions)
[2021-03-25 13:22:12.386] [E/12] [info] [Task Finished] Transform to mem in 0.279509s (11005 normal rows, 43164 exceptions)
[2021-03-25 13:22:12.387] [E/15] [info] [Task Finished] Transform to mem in 0.279423s (11002 normal rows, 42964 exceptions)
[2021-03-25 13:22:12.387] [E/7] [info] [Task Finished] Transform to mem in 0.279875s (11008 normal rows, 42975 exceptions)
[2021-03-25 13:22:12.388] [E/2] [info] [Task Finished] Transform to mem in 0.280436s (11042 normal rows, 42959 exceptions)
[2021-03-25 13:22:12.388] [E/11] [info] [Task Finished] Transform to mem in 0.279963s (11073 normal rows, 42720 exceptions)
[2021-03-25 13:22:12.389] [E/1] [info] [Task Finished] Transform to mem in 0.279801s (11087 normal rows, 43044 exceptions)
[2021-03-25 13:22:12.389] [E/5] [info] [Task Finished] Transform to mem in 0.279701s (11005 normal rows, 43229 exceptions)
[2021-03-25 13:22:12.390] [E/6] [info] [Task Finished] Transform to mem in 0.280469s (11098 normal rows, 43112 exceptions)
[2021-03-25 13:22:12.390] [E/8] [info] [Task Finished] Transform to mem in 0.281298s (11088 normal rows, 43511 exceptions)
[2021-03-25 13:22:12.394] [E/14] [info] [Task Finished] Transform to mem in 0.282468s (11008 normal rows, 43017 exceptions)
[2021-03-25 13:22:12.395] [E/10] [info] [Task Finished] Transform to mem in 0.283221s (11024 normal rows, 42947 exceptions)
[2021-03-25 13:22:12.395] [driver] [info] [Task Finished] Transform to mem in 0.283101s (11020 normal rows, 42976 exceptions)
[2021-03-25 13:22:12.665] [E/4] [info] [Task Finished] Transform to mem in 0.281376s (11036 normal rows, 42710 exceptions)
[2021-03-25 13:22:12.666] [E/13] [info] [Task Finished] Transform to mem in 0.281556s (11098 normal rows, 43115 exceptions)
[2021-03-25 13:22:12.666] [E/3] [info] [Task Finished] Transform to mem in 0.281647s (11087 normal rows, 42938 exceptions)
[2021-03-25 13:22:12.667] [E/9] [info] [Task Finished] Transform to mem in 0.282383s (11125 normal rows, 43517 exceptions)
[2021-03-25 13:22:12.668] [E/12] [info] [Task Finished] Transform to mem in 0.282218s (10985 normal rows, 43336 exceptions)
[2021-03-25 13:22:12.669] [E/7] [info] [Task Finished] Transform to mem in 0.281689s (11052 normal rows, 42881 exceptions)
[2021-03-25 13:22:12.669] [E/15] [info] [Task Finished] Transform to mem in 0.281883s (11000 normal rows, 42999 exceptions)
[2021-03-25 13:22:12.669] [E/2] [info] [Task Finished] Transform to mem in 0.281390s (11020 normal rows, 43057 exceptions)
[2021-03-25 13:22:12.670] [E/11] [info] [Task Finished] Transform to mem in 0.281424s (10995 normal rows, 42708 exceptions)
[2021-03-25 13:22:12.671] [E/5] [info] [Task Finished] Transform to mem in 0.281486s (11098 normal rows, 43075 exceptions)
[2021-03-25 13:22:12.672] [E/8] [info] [Task Finished] Transform to mem in 0.282454s (10999 normal rows, 43334 exceptions)
[2021-03-25 13:22:12.672] [E/1] [info] [Task Finished] Transform to mem in 0.283240s (11166 normal rows, 43520 exceptions)
[2021-03-25 13:22:12.673] [E/6] [info] [Task Finished] Transform to mem in 0.283525s (11073 normal rows, 42970 exceptions)
[2021-03-25 13:22:12.676] [E/14] [info] [Task Finished] Transform to mem in 0.282442s (11000 normal rows, 43009 exceptions)
[2021-03-25 13:22:12.677] [E/10] [info] [Task Finished] Transform to mem in 0.282327s (11052 normal rows, 42764 exceptions)
[2021-03-25 13:22:12.678] [driver] [info] [Task Finished] Transform to mem in 0.282969s (11020 normal rows, 43138 exceptions)
[2021-03-25 13:22:12.944] [E/4] [info] [Task Finished] Transform to mem in 0.279257s (10995 normal rows, 42726 exceptions)
[2021-03-25 13:22:12.946] [E/13] [info] [Task Finished] Transform to mem in 0.279897s (11166 normal rows, 43508 exceptions)
[2021-03-25 13:22:12.946] [E/3] [info] [Task Finished] Transform to mem in 0.279965s (11091 normal rows, 43047 exceptions)
[2021-03-25 13:22:12.947] [E/9] [info] [Task Finished] Transform to mem in 0.280531s (11080 normal rows, 43031 exceptions)
[2021-03-25 13:22:12.949] [E/15] [info] [Task Finished] Transform to mem in 0.279965s (11036 normal rows, 42720 exceptions)
[2021-03-25 13:22:12.949] [E/2] [info] [Task Finished] Transform to mem in 0.279748s (11016 normal rows, 43165 exceptions)
[2021-03-25 13:22:12.949] [E/11] [info] [Task Finished] Transform to mem in 0.279361s (10995 normal rows, 42718 exceptions)
[2021-03-25 13:22:12.949] [E/12] [info] [Task Finished] Transform to mem in 0.280746s (10999 normal rows, 43300 exceptions)
[2021-03-25 13:22:12.949] [E/7] [info] [Task Finished] Transform to mem in 0.280575s (11000 normal rows, 43043 exceptions)
[2021-03-25 13:22:12.950] [E/5] [info] [Task Finished] Transform to mem in 0.279409s (11186 normal rows, 43465 exceptions)
[2021-03-25 13:22:12.952] [E/8] [info] [Task Finished] Transform to mem in 0.280204s (11001 normal rows, 43113 exceptions)
[2021-03-25 13:22:12.953] [E/1] [info] [Task Finished] Transform to mem in 0.280521s (11170 normal rows, 43024 exceptions)
[2021-03-25 13:22:12.954] [E/6] [info] [Task Finished] Transform to mem in 0.281348s (10989 normal rows, 43282 exceptions)
[2021-03-25 13:22:12.960] [E/10] [info] [Task Finished] Transform to mem in 0.282523s (11002 normal rows, 42755 exceptions)
[2021-03-25 13:22:12.960] [E/14] [info] [Task Finished] Transform to mem in 0.283643s (11010 normal rows, 43002 exceptions)
[2021-03-25 13:22:12.962] [driver] [info] [Task Finished] Transform to mem in 0.283354s (11050 normal rows, 43199 exceptions)
[2021-03-25 13:22:13.224] [E/4] [info] [Task Finished] Transform to mem in 0.280125s (10973 normal rows, 42686 exceptions)
[2021-03-25 13:22:13.226] [E/13] [info] [Task Finished] Transform to mem in 0.280341s (11160 normal rows, 43455 exceptions)
[2021-03-25 13:22:13.227] [E/3] [info] [Task Finished] Transform to mem in 0.281114s (11045 normal rows, 43148 exceptions)
[2021-03-25 13:22:13.229] [E/2] [info] [Task Finished] Transform to mem in 0.280200s (11005 normal rows, 42971 exceptions)
[2021-03-25 13:22:13.229] [E/9] [info] [Task Finished] Transform to mem in 0.281833s (11166 normal rows, 43023 exceptions)
[2021-03-25 13:22:13.230] [E/7] [info] [Task Finished] Transform to mem in 0.280481s (10973 normal rows, 42686 exceptions)
[2021-03-25 13:22:13.230] [E/15] [info] [Task Finished] Transform to mem in 0.281475s (10997 normal rows, 43283 exceptions)
[2021-03-25 13:22:13.231] [E/5] [info] [Task Finished] Transform to mem in 0.280368s (11160 normal rows, 43446 exceptions)
[2021-03-25 13:22:13.231] [E/11] [info] [Task Finished] Transform to mem in 0.281904s (11007 normal rows, 42795 exceptions)
[2021-03-25 13:22:13.231] [E/12] [info] [Task Finished] Transform to mem in 0.281943s (11050 normal rows, 43196 exceptions)
[2021-03-25 13:22:13.233] [E/8] [info] [Task Finished] Transform to mem in 0.280471s (11043 normal rows, 43153 exceptions)
[2021-03-25 13:22:13.234] [E/1] [info] [Task Finished] Transform to mem in 0.281299s (11168 normal rows, 43028 exceptions)
[2021-03-25 13:22:13.235] [E/6] [info] [Task Finished] Transform to mem in 0.280758s (10997 normal rows, 43277 exceptions)
[2021-03-25 13:22:13.240] [E/10] [info] [Task Finished] Transform to mem in 0.280624s (10997 normal rows, 42973 exceptions)
[2021-03-25 13:22:13.241] [E/14] [info] [Task Finished] Transform to mem in 0.281485s (11015 normal rows, 42799 exceptions)
[2021-03-25 13:22:13.242] [driver] [info] [Task Finished] Transform to mem in 0.280299s (11050 normal rows, 43170 exceptions)
[2021-03-25 13:22:13.506] [E/4] [info] [Task Finished] Transform to mem in 0.281822s (10973 normal rows, 42710 exceptions)
[2021-03-25 13:22:13.506] [E/13] [info] [Task Finished] Transform to mem in 0.280042s (11160 normal rows, 43431 exceptions)
[2021-03-25 13:22:13.508] [E/3] [info] [Task Finished] Transform to mem in 0.280579s (11043 normal rows, 43166 exceptions)
[2021-03-25 13:22:13.510] [E/9] [info] [Task Finished] Transform to mem in 0.280851s (10997 normal rows, 43237 exceptions)
[2021-03-25 13:22:13.511] [E/7] [info] [Task Finished] Transform to mem in 0.281090s (10997 normal rows, 43012 exceptions)
[2021-03-25 13:22:13.511] [E/2] [info] [Task Finished] Transform to mem in 0.281992s (11168 normal rows, 43027 exceptions)
[2021-03-25 13:22:13.511] [E/5] [info] [Task Finished] Transform to mem in 0.280409s (11021 normal rows, 43160 exceptions)
[2021-03-25 13:22:13.511] [E/15] [info] [Task Finished] Transform to mem in 0.280839s (11009 normal rows, 42805 exceptions)
[2021-03-25 13:22:13.512] [E/11] [info] [Task Finished] Transform to mem in 0.281320s (11003 normal rows, 42716 exceptions)
[2021-03-25 13:22:13.513] [E/8] [info] [Task Finished] Transform to mem in 0.280111s (11043 normal rows, 43217 exceptions)
[2021-03-25 13:22:13.513] [E/12] [info] [Task Finished] Transform to mem in 0.281944s (11165 normal rows, 43354 exceptions)
[2021-03-25 13:22:13.515] [E/1] [info] [Task Finished] Transform to mem in 0.280723s (11156 normal rows, 43044 exceptions)
[2021-03-25 13:22:13.517] [E/6] [info] [Task Finished] Transform to mem in 0.282080s (11009 normal rows, 43187 exceptions)
[2021-03-25 13:22:13.524] [E/10] [info] [Task Finished] Transform to mem in 0.283925s (10997 normal rows, 43067 exceptions)
[2021-03-25 13:22:13.524] [E/14] [info] [Task Finished] Transform to mem in 0.283052s (11009 normal rows, 42811 exceptions)
[2021-03-25 13:22:13.526] [driver] [info] [Task Finished] Transform to mem in 0.284405s (11021 normal rows, 43162 exceptions)
[2021-03-25 13:22:13.786] [E/4] [info] [Task Finished] Transform to mem in 0.279819s (11003 normal rows, 42716 exceptions)
[2021-03-25 13:22:13.787] [E/13] [info] [Task Finished] Transform to mem in 0.280234s (11165 normal rows, 43260 exceptions)
[2021-03-25 13:22:13.789] [E/3] [info] [Task Finished] Transform to mem in 0.280932s (11027 normal rows, 43245 exceptions)
[2021-03-25 13:22:13.791] [E/5] [info] [Task Finished] Transform to mem in 0.279485s (10999 normal rows, 42828 exceptions)
[2021-03-25 13:22:13.791] [E/9] [info] [Task Finished] Transform to mem in 0.280633s (11172 normal rows, 43107 exceptions)
[2021-03-25 13:22:13.791] [E/15] [info] [Task Finished] Transform to mem in 0.280119s (11031 normal rows, 43157 exceptions)
[2021-03-25 13:22:13.792] [E/7] [info] [Task Finished] Transform to mem in 0.280801s (10997 normal rows, 43177 exceptions)
[2021-03-25 13:22:13.793] [E/8] [info] [Task Finished] Transform to mem in 0.280164s (11091 normal rows, 43230 exceptions)
[2021-03-25 13:22:13.793] [E/11] [info] [Task Finished] Transform to mem in 0.280932s (11000 normal rows, 42726 exceptions)
[2021-03-25 13:22:13.794] [E/2] [info] [Task Finished] Transform to mem in 0.282575s (11009 normal rows, 43050 exceptions)
[2021-03-25 13:22:13.795] [E/12] [info] [Task Finished] Transform to mem in 0.282004s (11099 normal rows, 43272 exceptions)
[2021-03-25 13:22:13.796] [E/1] [info] [Task Finished] Transform to mem in 0.281120s (11177 normal rows, 43113 exceptions)
[2021-03-25 13:22:13.798] [E/6] [info] [Task Finished] Transform to mem in 0.281129s (10997 normal rows, 43174 exceptions)
[2021-03-25 13:22:13.806] [E/14] [info] [Task Finished] Transform to mem in 0.281884s (11020 normal rows, 42867 exceptions)
[2021-03-25 13:22:13.807] [E/10] [info] [Task Finished] Transform to mem in 0.282210s (10987 normal rows, 43020 exceptions)
[2021-03-25 13:22:13.841] [driver] [info] [Task Finished] Transform to mem in 0.315039s (12330 normal rows, 48094 exceptions)
[2021-03-25 13:22:13.841] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.86261s
[2021-03-25 13:22:13.841] [global] [info] [Transform Stage] Stage 0 total wall clock time: 45.081s, 56350770 input rows, time to process 1 row via fast path: 0.000800007ms
[2021-03-25 13:22:13.842] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 13:22:13.846] [local ee] [info] compiled pure python pipeline in 0.004283s
[2021-03-25 13:22:13.846] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 13:22:13.847] [local ee] [info] Created 160 resolve tasks in 0.001253s
[2021-03-25 13:22:13.847] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 13:22:13.863] [driver] [info] [Task Finished] Resolve in 0.015418s
[2021-03-25 13:22:13.863] [E/14] [info] [Task Finished] Resolve in 0.015512s
[2021-03-25 13:22:13.863] [E/5] [info] [Task Finished] Resolve in 0.015519s
[2021-03-25 13:22:13.863] [E/1] [info] [Task Finished] Resolve in 0.015559s
[2021-03-25 13:22:13.863] [E/4] [info] [Task Finished] Resolve in 0.015575s
[2021-03-25 13:22:13.863] [E/11] [info] [Task Finished] Resolve in 0.015579s
[2021-03-25 13:22:13.863] [E/2] [info] [Task Finished] Resolve in 0.015577s
[2021-03-25 13:22:13.863] [E/15] [info] [Task Finished] Resolve in 0.015597s
[2021-03-25 13:22:13.863] [E/13] [info] [Task Finished] Resolve in 0.015617s
[2021-03-25 13:22:13.863] [E/12] [info] [Task Finished] Resolve in 0.015630s
[2021-03-25 13:22:13.863] [E/9] [info] [Task Finished] Resolve in 0.015645s
[2021-03-25 13:22:13.863] [E/10] [info] [Task Finished] Resolve in 0.015597s
[2021-03-25 13:22:13.863] [E/7] [info] [Task Finished] Resolve in 0.015672s
[2021-03-25 13:22:13.863] [E/3] [info] [Task Finished] Resolve in 0.015648s
[2021-03-25 13:22:13.863] [E/8] [info] [Task Finished] Resolve in 0.015757s
[2021-03-25 13:22:13.863] [E/6] [info] [Task Finished] Resolve in 0.015778s
[2021-03-25 13:22:13.878] [driver] [info] [Task Finished] Resolve in 0.015628s
[2021-03-25 13:22:13.878] [E/14] [info] [Task Finished] Resolve in 0.015560s
[2021-03-25 13:22:13.878] [E/2] [info] [Task Finished] Resolve in 0.015506s
[2021-03-25 13:22:13.878] [E/4] [info] [Task Finished] Resolve in 0.015545s
[2021-03-25 13:22:13.878] [E/12] [info] [Task Finished] Resolve in 0.015531s
[2021-03-25 13:22:13.878] [E/1] [info] [Task Finished] Resolve in 0.015618s
[2021-03-25 13:22:13.878] [E/9] [info] [Task Finished] Resolve in 0.015527s
[2021-03-25 13:22:13.878] [E/3] [info] [Task Finished] Resolve in 0.015525s
[2021-03-25 13:22:13.878] [E/15] [info] [Task Finished] Resolve in 0.015613s
[2021-03-25 13:22:13.878] [E/11] [info] [Task Finished] Resolve in 0.015615s
[2021-03-25 13:22:13.878] [E/6] [info] [Task Finished] Resolve in 0.015451s
[2021-03-25 13:22:13.878] [E/10] [info] [Task Finished] Resolve in 0.015605s
[2021-03-25 13:22:13.878] [E/5] [info] [Task Finished] Resolve in 0.015742s
[2021-03-25 13:22:13.878] [E/7] [info] [Task Finished] Resolve in 0.015647s
[2021-03-25 13:22:13.878] [E/13] [info] [Task Finished] Resolve in 0.015699s
[2021-03-25 13:22:13.879] [E/8] [info] [Task Finished] Resolve in 0.015611s
[2021-03-25 13:22:13.894] [driver] [info] [Task Finished] Resolve in 0.015310s
[2021-03-25 13:22:13.894] [E/14] [info] [Task Finished] Resolve in 0.015348s
[2021-03-25 13:22:13.894] [E/4] [info] [Task Finished] Resolve in 0.015314s
[2021-03-25 13:22:13.894] [E/12] [info] [Task Finished] Resolve in 0.015289s
[2021-03-25 13:22:13.894] [E/9] [info] [Task Finished] Resolve in 0.015288s
[2021-03-25 13:22:13.894] [E/3] [info] [Task Finished] Resolve in 0.015285s
[2021-03-25 13:22:13.894] [E/1] [info] [Task Finished] Resolve in 0.015295s
[2021-03-25 13:22:13.894] [E/13] [info] [Task Finished] Resolve in 0.015286s
[2021-03-25 13:22:13.894] [E/6] [info] [Task Finished] Resolve in 0.015360s
[2021-03-25 13:22:13.894] [E/2] [info] [Task Finished] Resolve in 0.015539s
[2021-03-25 13:22:13.894] [E/15] [info] [Task Finished] Resolve in 0.015426s
[2021-03-25 13:22:13.894] [E/5] [info] [Task Finished] Resolve in 0.015369s
[2021-03-25 13:22:13.894] [E/8] [info] [Task Finished] Resolve in 0.015243s
[2021-03-25 13:22:13.894] [E/10] [info] [Task Finished] Resolve in 0.015387s
[2021-03-25 13:22:13.894] [E/7] [info] [Task Finished] Resolve in 0.015389s
[2021-03-25 13:22:13.894] [E/11] [info] [Task Finished] Resolve in 0.015623s
[2021-03-25 13:22:13.909] [driver] [info] [Task Finished] Resolve in 0.015531s
[2021-03-25 13:22:13.909] [E/14] [info] [Task Finished] Resolve in 0.015519s
[2021-03-25 13:22:13.909] [E/4] [info] [Task Finished] Resolve in 0.015506s
[2021-03-25 13:22:13.909] [E/3] [info] [Task Finished] Resolve in 0.015520s
[2021-03-25 13:22:13.909] [E/9] [info] [Task Finished] Resolve in 0.015555s
[2021-03-25 13:22:13.909] [E/1] [info] [Task Finished] Resolve in 0.015512s
[2021-03-25 13:22:13.909] [E/13] [info] [Task Finished] Resolve in 0.015496s
[2021-03-25 13:22:13.909] [E/2] [info] [Task Finished] Resolve in 0.015476s
[2021-03-25 13:22:13.909] [E/6] [info] [Task Finished] Resolve in 0.015534s
[2021-03-25 13:22:13.909] [E/5] [info] [Task Finished] Resolve in 0.015535s
[2021-03-25 13:22:13.909] [E/7] [info] [Task Finished] Resolve in 0.015507s
[2021-03-25 13:22:13.909] [E/8] [info] [Task Finished] Resolve in 0.015559s
[2021-03-25 13:22:13.909] [E/12] [info] [Task Finished] Resolve in 0.015782s
[2021-03-25 13:22:13.909] [E/10] [info] [Task Finished] Resolve in 0.015601s
[2021-03-25 13:22:13.910] [E/11] [info] [Task Finished] Resolve in 0.015566s
[2021-03-25 13:22:13.910] [E/15] [info] [Task Finished] Resolve in 0.015831s
[2021-03-25 13:22:13.924] [driver] [info] [Task Finished] Resolve in 0.015278s
[2021-03-25 13:22:13.924] [E/4] [info] [Task Finished] Resolve in 0.015321s
[2021-03-25 13:22:13.925] [E/13] [info] [Task Finished] Resolve in 0.015264s
[2021-03-25 13:22:13.925] [E/3] [info] [Task Finished] Resolve in 0.015361s
[2021-03-25 13:22:13.925] [E/9] [info] [Task Finished] Resolve in 0.015340s
[2021-03-25 13:22:13.925] [E/6] [info] [Task Finished] Resolve in 0.015295s
[2021-03-25 13:22:13.925] [E/2] [info] [Task Finished] Resolve in 0.015355s
[2021-03-25 13:22:13.925] [E/1] [info] [Task Finished] Resolve in 0.015410s
[2021-03-25 13:22:13.925] [E/8] [info] [Task Finished] Resolve in 0.015307s
[2021-03-25 13:22:13.925] [E/5] [info] [Task Finished] Resolve in 0.015347s
[2021-03-25 13:22:13.925] [E/14] [info] [Task Finished] Resolve in 0.015594s
[2021-03-25 13:22:13.925] [E/10] [info] [Task Finished] Resolve in 0.015398s
[2021-03-25 13:22:13.925] [E/7] [info] [Task Finished] Resolve in 0.015469s
[2021-03-25 13:22:13.925] [E/11] [info] [Task Finished] Resolve in 0.015368s
[2021-03-25 13:22:13.925] [E/12] [info] [Task Finished] Resolve in 0.015572s
[2021-03-25 13:22:13.925] [E/15] [info] [Task Finished] Resolve in 0.015347s
[2021-03-25 13:22:13.940] [driver] [info] [Task Finished] Resolve in 0.015501s
[2021-03-25 13:22:13.940] [E/4] [info] [Task Finished] Resolve in 0.015509s
[2021-03-25 13:22:13.940] [E/13] [info] [Task Finished] Resolve in 0.015573s
[2021-03-25 13:22:13.940] [E/8] [info] [Task Finished] Resolve in 0.015436s
[2021-03-25 13:22:13.940] [E/6] [info] [Task Finished] Resolve in 0.015542s
[2021-03-25 13:22:13.940] [E/9] [info] [Task Finished] Resolve in 0.015592s
[2021-03-25 13:22:13.940] [E/2] [info] [Task Finished] Resolve in 0.015542s
[2021-03-25 13:22:13.940] [E/1] [info] [Task Finished] Resolve in 0.015540s
[2021-03-25 13:22:13.940] [E/5] [info] [Task Finished] Resolve in 0.015517s
[2021-03-25 13:22:13.940] [E/3] [info] [Task Finished] Resolve in 0.015759s
[2021-03-25 13:22:13.940] [E/14] [info] [Task Finished] Resolve in 0.015585s
[2021-03-25 13:22:13.941] [E/7] [info] [Task Finished] Resolve in 0.015596s
[2021-03-25 13:22:13.941] [E/12] [info] [Task Finished] Resolve in 0.015472s
[2021-03-25 13:22:13.941] [E/11] [info] [Task Finished] Resolve in 0.015570s
[2021-03-25 13:22:13.941] [E/15] [info] [Task Finished] Resolve in 0.015596s
[2021-03-25 13:22:13.941] [E/10] [info] [Task Finished] Resolve in 0.015866s
[2021-03-25 13:22:13.955] [driver] [info] [Task Finished] Resolve in 0.015253s
[2021-03-25 13:22:13.955] [E/13] [info] [Task Finished] Resolve in 0.015303s
[2021-03-25 13:22:13.955] [E/6] [info] [Task Finished] Resolve in 0.015250s
[2021-03-25 13:22:13.956] [E/2] [info] [Task Finished] Resolve in 0.015275s
[2021-03-25 13:22:13.956] [E/8] [info] [Task Finished] Resolve in 0.015342s
[2021-03-25 13:22:13.956] [E/4] [info] [Task Finished] Resolve in 0.015592s
[2021-03-25 13:22:13.956] [E/5] [info] [Task Finished] Resolve in 0.015317s
[2021-03-25 13:22:13.956] [E/9] [info] [Task Finished] Resolve in 0.015412s
[2021-03-25 13:22:13.956] [E/1] [info] [Task Finished] Resolve in 0.015415s
[2021-03-25 13:22:13.956] [E/14] [info] [Task Finished] Resolve in 0.015321s
[2021-03-25 13:22:13.956] [E/11] [info] [Task Finished] Resolve in 0.015282s
[2021-03-25 13:22:13.956] [E/12] [info] [Task Finished] Resolve in 0.015367s
[2021-03-25 13:22:13.956] [E/7] [info] [Task Finished] Resolve in 0.015369s
[2021-03-25 13:22:13.956] [E/3] [info] [Task Finished] Resolve in 0.015628s
[2021-03-25 13:22:13.956] [E/15] [info] [Task Finished] Resolve in 0.015353s
[2021-03-25 13:22:13.956] [E/10] [info] [Task Finished] Resolve in 0.015444s
[2021-03-25 13:22:13.971] [driver] [info] [Task Finished] Resolve in 0.015478s
[2021-03-25 13:22:13.971] [E/6] [info] [Task Finished] Resolve in 0.015500s
[2021-03-25 13:22:13.971] [E/2] [info] [Task Finished] Resolve in 0.015466s
[2021-03-25 13:22:13.971] [E/4] [info] [Task Finished] Resolve in 0.015437s
[2021-03-25 13:22:13.971] [E/8] [info] [Task Finished] Resolve in 0.015543s
[2021-03-25 13:22:13.971] [E/1] [info] [Task Finished] Resolve in 0.015483s
[2021-03-25 13:22:13.971] [E/5] [info] [Task Finished] Resolve in 0.015602s
[2021-03-25 13:22:13.971] [E/13] [info] [Task Finished] Resolve in 0.015783s
[2021-03-25 13:22:13.971] [E/14] [info] [Task Finished] Resolve in 0.015598s
[2021-03-25 13:22:13.971] [E/11] [info] [Task Finished] Resolve in 0.015522s
[2021-03-25 13:22:13.971] [E/12] [info] [Task Finished] Resolve in 0.015567s
[2021-03-25 13:22:13.971] [E/9] [info] [Task Finished] Resolve in 0.015811s
[2021-03-25 13:22:13.971] [E/7] [info] [Task Finished] Resolve in 0.015577s
[2021-03-25 13:22:13.972] [E/3] [info] [Task Finished] Resolve in 0.015497s
[2021-03-25 13:22:13.972] [E/15] [info] [Task Finished] Resolve in 0.015555s
[2021-03-25 13:22:13.972] [E/10] [info] [Task Finished] Resolve in 0.015643s
[2021-03-25 13:22:13.986] [driver] [info] [Task Finished] Resolve in 0.015228s
[2021-03-25 13:22:13.986] [E/2] [info] [Task Finished] Resolve in 0.015310s
[2021-03-25 13:22:13.986] [E/4] [info] [Task Finished] Resolve in 0.015340s
[2021-03-25 13:22:13.986] [E/8] [info] [Task Finished] Resolve in 0.015293s
[2021-03-25 13:22:13.987] [E/13] [info] [Task Finished] Resolve in 0.015262s
[2021-03-25 13:22:13.987] [E/14] [info] [Task Finished] Resolve in 0.015213s
[2021-03-25 13:22:13.987] [E/6] [info] [Task Finished] Resolve in 0.015556s
[2021-03-25 13:22:13.987] [E/1] [info] [Task Finished] Resolve in 0.015386s
[2021-03-25 13:22:13.987] [E/5] [info] [Task Finished] Resolve in 0.015363s
[2021-03-25 13:22:13.987] [E/3] [info] [Task Finished] Resolve in 0.015343s
[2021-03-25 13:22:13.987] [E/9] [info] [Task Finished] Resolve in 0.015393s
[2021-03-25 13:22:13.987] [E/11] [info] [Task Finished] Resolve in 0.015440s
[2021-03-25 13:22:13.987] [E/7] [info] [Task Finished] Resolve in 0.015424s
[2021-03-25 13:22:13.987] [E/15] [info] [Task Finished] Resolve in 0.015393s
[2021-03-25 13:22:13.987] [E/12] [info] [Task Finished] Resolve in 0.015655s
[2021-03-25 13:22:13.987] [E/10] [info] [Task Finished] Resolve in 0.015558s
[2021-03-25 13:22:14.001] [driver] [info] [Task Finished] Resolve in 0.015471s
[2021-03-25 13:22:14.002] [E/8] [info] [Task Finished] Resolve in 0.015464s
[2021-03-25 13:22:14.002] [E/4] [info] [Task Finished] Resolve in 0.015566s
[2021-03-25 13:22:14.002] [E/2] [info] [Task Finished] Resolve in 0.015684s
[2021-03-25 13:22:14.002] [E/5] [info] [Task Finished] Resolve in 0.015454s
[2021-03-25 13:22:14.002] [E/13] [info] [Task Finished] Resolve in 0.015543s
[2021-03-25 13:22:14.002] [E/14] [info] [Task Finished] Resolve in 0.015563s
[2021-03-25 13:22:14.002] [E/6] [info] [Task Finished] Resolve in 0.015591s
[2021-03-25 13:22:14.002] [E/3] [info] [Task Finished] Resolve in 0.015455s
[2021-03-25 13:22:14.002] [E/1] [info] [Task Finished] Resolve in 0.015748s
[2021-03-25 13:22:14.002] [E/11] [info] [Task Finished] Resolve in 0.015538s
[2021-03-25 13:22:14.002] [E/7] [info] [Task Finished] Resolve in 0.015523s
[2021-03-25 13:22:14.002] [E/9] [info] [Task Finished] Resolve in 0.015584s
[2021-03-25 13:22:14.003] [E/15] [info] [Task Finished] Resolve in 0.015484s
[2021-03-25 13:22:14.003] [E/12] [info] [Task Finished] Resolve in 0.015426s
[2021-03-25 13:22:14.005] [E/10] [info] [Task Finished] Resolve in 0.017270s
[2021-03-25 13:22:14.005] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.163428s
[2021-03-25 13:22:14.005] [local ee] [info] slow path for Stage 0: total wall clock time: 2.48061s, time to process 1 row via slow path: 0.000359722ms
[2021-03-25 13:22:14.005] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.163458s

[2021-03-25 13:22:14.044] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 13:22:14.072] [E/12] [info] [Task Finished] write to file in 0.028331s (102395 rows, 15.59 MB)
[2021-03-25 13:22:14.076] [E/15] [info] [Task Finished] write to file in 0.032278s (112425 rows, 17.11 MB)
[2021-03-25 13:22:14.076] [E/1] [info] [Task Finished] write to file in 0.032596s (112421 rows, 17.11 MB)
[2021-03-25 13:22:14.077] [driver] [info] [Task Finished] write to file in 0.033405s (123413 rows, 18.79 MB)
[2021-03-25 13:22:14.077] [E/5] [info] [Task Finished] write to file in 0.033604s (123409 rows, 18.79 MB)
[2021-03-25 13:22:14.077] [E/7] [info] [Task Finished] write to file in 0.033692s (123508 rows, 18.80 MB)
[2021-03-25 13:22:14.078] [E/14] [info] [Task Finished] write to file in 0.033867s (123474 rows, 18.80 MB)
[2021-03-25 13:22:14.078] [E/9] [info] [Task Finished] write to file in 0.033952s (123704 rows, 18.83 MB)
[2021-03-25 13:22:14.078] [E/13] [info] [Task Finished] write to file in 0.034220s (123479 rows, 18.80 MB)
[2021-03-25 13:22:14.078] [E/4] [info] [Task Finished] write to file in 0.034384s (123458 rows, 18.80 MB)
[2021-03-25 13:22:14.078] [E/10] [info] [Task Finished] write to file in 0.034401s (123474 rows, 18.80 MB)
[2021-03-25 13:22:14.078] [E/3] [info] [Task Finished] write to file in 0.034399s (123570 rows, 18.81 MB)
[2021-03-25 13:22:14.078] [E/11] [info] [Task Finished] write to file in 0.034440s (123598 rows, 18.82 MB)
[2021-03-25 13:22:14.078] [E/6] [info] [Task Finished] write to file in 0.034483s (123752 rows, 18.84 MB)
[2021-03-25 13:22:14.081] [E/2] [info] [Task Finished] write to file in 0.036784s (112411 rows, 17.11 MB)
[2021-03-25 13:22:14.081] [global] [info] writing output took 0.075671s
[2021-03-25 13:22:14.081] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0757623s
[2021-03-25 13:22:14.081] [global] [info] [Transform Stage] Stage 0 took 3.60656s
[2021-03-25 13:22:14.081] [global] [info] Query Execution took 3.68639s. (planning: 0.0797934s, execution: 3.60659s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.0060994625091552734
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 3.9709436893463135 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'True', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.022645,"llvm_optimization_time_s":0.334616,"llvm_compilation_time_s":0.152493,"total_compilation_time_s":0.504691,"sampling_time_s":0.111715,"stages":[{"stage_no":0,"fast_path_wall_time_s":45.081,"fast_path_time_s":2.86263,"fast_path_per_row_time_ns":800.007,"slow_path_wall_time_s":2.48061,"slow_path_time_s":0.163428,"slow_path_per_row_time_ns":359.722}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": true, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.0060994625091552734, "jobTime": 3.9709436893463135, "mode": "resolve", "mergeExceptionsInOrder": true}
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.105] [local execution engine] [info] Stopped local executor E/1
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.113] [local execution engine] [info] Stopped local executor E/2
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.120] [local execution engine] [info] Stopped local executor E/3
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.127] [local execution engine] [info] Stopped local executor E/4
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.134] [local execution engine] [info] Stopped local executor E/5
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.141] [local execution engine] [info] Stopped local executor E/6
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.148] [local execution engine] [info] Stopped local executor E/7
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.155] [local execution engine] [info] Stopped local executor E/8
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.162] [local execution engine] [info] Stopped local executor E/9
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.169] [local execution engine] [info] Stopped local executor E/10
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.176] [local execution engine] [info] Stopped local executor E/11
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.183] [local execution engine] [info] Stopped local executor E/12
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.190] [local execution engine] [info] Stopped local executor E/13
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.197] [local execution engine] [info] Stopped local executor E/14
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:14.204] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 21 active partitions
