[2021-03-25 10:29:30.830] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:29:30.830] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:29:30.830] [local ee] [info] initializing LLVM backend
[2021-03-25 10:29:30.830] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:29:30.830] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.831] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.831] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.831] [E/1] [info] starting detached process queue
[2021-03-25 10:29:30.831] [E/2] [info] starting detached process queue
[2021-03-25 10:29:30.831] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.831] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.831] [E/3] [info] starting detached process queue
[2021-03-25 10:29:30.831] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.831] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.831] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.831] [E/4] [info] starting detached process queue
[2021-03-25 10:29:30.831] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.831] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.831] [E/5] [info] starting detached process queue
[2021-03-25 10:29:30.831] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.831] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.831] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.831] [E/6] [info] starting detached process queue
[2021-03-25 10:29:30.831] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.831] [E/7] [info] starting detached process queue
[2021-03-25 10:29:30.832] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.832] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [E/8] [info] starting detached process queue
[2021-03-25 10:29:30.832] [E/9] [info] starting detached process queue
[2021-03-25 10:29:30.832] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [E/10] [info] starting detached process queue
[2021-03-25 10:29:30.832] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.832] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.832] [E/11] [info] starting detached process queue
[2021-03-25 10:29:30.832] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.832] [E/12] [info] starting detached process queue
[2021-03-25 10:29:30.832] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.832] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [E/13] [info] starting detached process queue
[2021-03-25 10:29:30.832] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.832] [E/14] [info] starting detached process queue
[2021-03-25 10:29:30.832] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:30.832] [E/15] [info] starting detached process queue
[2021-03-25 10:29:30.832] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:30.832] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 10:29:30.832] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:29:30.832] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:29:30.832] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:29:30.968] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:30.974] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:30.990] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:30.998] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:31.025] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:31.046] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:31.060] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:31.092] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:31.099] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:31.115] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:31.117] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:31.118] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:31.118] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:31.120] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:31.121] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:31.121] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:31.123] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:31.124] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:31.125] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:31.141] [logical planner] [info] logical optimization took 0.022747ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:29:31.141] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:31.142] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:31.143] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:31.143] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:31.144] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:31.145] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:31.145] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:31.146] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:31.147] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:31.148] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:31.149] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:31.150] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:31.151] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:31.151] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:31.153] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:31.154] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:31.154] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:31.155] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:31.155] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:31.156] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:31.157] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:31.158] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:31.158] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:31.159] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:31.160] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:31.161] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:31.162] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:31.163] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:31.163] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:31.195] [global] [info] Stage0 depends on: 
[2021-03-25 10:29:31.545] [global] [info] Optimization via LLVM passes took 0.332336 ms
[2021-03-25 10:29:31.697] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:29:31.698] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.50271s
[2021-03-25 10:29:31.698] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:29:31.980] [E/5] [info] [Task Finished] Transform to mem in 0.281996s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:29:31.981] [E/14] [info] [Task Finished] Transform to mem in 0.282214s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:29:31.981] [E/10] [info] [Task Finished] Transform to mem in 0.282214s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:29:31.981] [E/8] [info] [Task Finished] Transform to mem in 0.282381s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:29:31.981] [E/3] [info] [Task Finished] Transform to mem in 0.282391s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:29:31.981] [E/12] [info] [Task Finished] Transform to mem in 0.282425s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:29:31.981] [E/13] [info] [Task Finished] Transform to mem in 0.282435s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:29:31.981] [E/15] [info] [Task Finished] Transform to mem in 0.282497s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:29:31.981] [E/7] [info] [Task Finished] Transform to mem in 0.282643s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:29:31.981] [E/6] [info] [Task Finished] Transform to mem in 0.282712s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:29:31.981] [E/4] [info] [Task Finished] Transform to mem in 0.282809s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:29:31.981] [E/2] [info] [Task Finished] Transform to mem in 0.283089s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:29:31.982] [E/1] [info] [Task Finished] Transform to mem in 0.283527s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:29:31.982] [driver] [info] [Task Finished] Transform to mem in 0.283591s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:29:31.983] [E/11] [info] [Task Finished] Transform to mem in 0.284808s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:29:31.984] [E/9] [info] [Task Finished] Transform to mem in 0.285746s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:29:32.259] [E/5] [info] [Task Finished] Transform to mem in 0.278616s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:29:32.260] [E/8] [info] [Task Finished] Transform to mem in 0.278937s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:29:32.260] [E/10] [info] [Task Finished] Transform to mem in 0.279084s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:29:32.260] [E/13] [info] [Task Finished] Transform to mem in 0.278897s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:29:32.260] [E/15] [info] [Task Finished] Transform to mem in 0.278906s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:29:32.260] [E/12] [info] [Task Finished] Transform to mem in 0.279059s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:29:32.260] [E/7] [info] [Task Finished] Transform to mem in 0.278857s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:29:32.260] [E/14] [info] [Task Finished] Transform to mem in 0.279377s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:29:32.260] [E/6] [info] [Task Finished] Transform to mem in 0.279001s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:29:32.260] [E/3] [info] [Task Finished] Transform to mem in 0.279610s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:29:32.261] [E/2] [info] [Task Finished] Transform to mem in 0.279091s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:29:32.261] [E/4] [info] [Task Finished] Transform to mem in 0.279789s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:29:32.262] [E/11] [info] [Task Finished] Transform to mem in 0.278404s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:29:32.262] [E/1] [info] [Task Finished] Transform to mem in 0.279891s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:29:32.262] [driver] [info] [Task Finished] Transform to mem in 0.279921s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:29:32.263] [E/9] [info] [Task Finished] Transform to mem in 0.278430s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:29:32.538] [E/5] [info] [Task Finished] Transform to mem in 0.279346s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:29:32.539] [E/13] [info] [Task Finished] Transform to mem in 0.278873s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:29:32.539] [E/6] [info] [Task Finished] Transform to mem in 0.278701s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:29:32.539] [E/10] [info] [Task Finished] Transform to mem in 0.279134s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:29:32.539] [E/7] [info] [Task Finished] Transform to mem in 0.279074s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:29:32.539] [E/14] [info] [Task Finished] Transform to mem in 0.279098s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:29:32.539] [E/12] [info] [Task Finished] Transform to mem in 0.279316s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:29:32.539] [E/8] [info] [Task Finished] Transform to mem in 0.279605s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:29:32.539] [E/4] [info] [Task Finished] Transform to mem in 0.278509s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:29:32.540] [E/15] [info] [Task Finished] Transform to mem in 0.279764s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:29:32.540] [E/3] [info] [Task Finished] Transform to mem in 0.279596s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:29:32.540] [E/2] [info] [Task Finished] Transform to mem in 0.279471s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:29:32.542] [driver] [info] [Task Finished] Transform to mem in 0.280061s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:29:32.542] [E/1] [info] [Task Finished] Transform to mem in 0.280287s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:29:32.543] [E/11] [info] [Task Finished] Transform to mem in 0.281588s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:29:32.544] [E/9] [info] [Task Finished] Transform to mem in 0.281654s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:29:32.817] [E/5] [info] [Task Finished] Transform to mem in 0.278760s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:29:32.817] [E/4] [info] [Task Finished] Transform to mem in 0.277903s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:29:32.817] [E/10] [info] [Task Finished] Transform to mem in 0.278604s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:29:32.818] [E/6] [info] [Task Finished] Transform to mem in 0.278827s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:29:32.818] [E/7] [info] [Task Finished] Transform to mem in 0.278758s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:29:32.818] [E/13] [info] [Task Finished] Transform to mem in 0.279244s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:29:32.818] [E/14] [info] [Task Finished] Transform to mem in 0.278799s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:29:32.818] [E/8] [info] [Task Finished] Transform to mem in 0.278889s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:29:32.818] [E/12] [info] [Task Finished] Transform to mem in 0.279148s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:29:32.819] [E/15] [info] [Task Finished] Transform to mem in 0.279341s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:29:32.819] [E/2] [info] [Task Finished] Transform to mem in 0.279184s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:29:32.819] [E/3] [info] [Task Finished] Transform to mem in 0.279450s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:29:32.822] [E/11] [info] [Task Finished] Transform to mem in 0.278473s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:29:32.822] [E/1] [info] [Task Finished] Transform to mem in 0.279603s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:29:32.822] [driver] [info] [Task Finished] Transform to mem in 0.280211s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:29:32.824] [E/9] [info] [Task Finished] Transform to mem in 0.279801s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:29:33.095] [E/5] [info] [Task Finished] Transform to mem in 0.278270s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:29:33.096] [E/4] [info] [Task Finished] Transform to mem in 0.278758s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:29:33.096] [E/6] [info] [Task Finished] Transform to mem in 0.278560s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:29:33.096] [E/10] [info] [Task Finished] Transform to mem in 0.278836s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:29:33.096] [E/13] [info] [Task Finished] Transform to mem in 0.278448s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:29:33.097] [E/14] [info] [Task Finished] Transform to mem in 0.278631s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:29:33.097] [E/12] [info] [Task Finished] Transform to mem in 0.278261s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:29:33.097] [E/7] [info] [Task Finished] Transform to mem in 0.279117s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:29:33.097] [E/8] [info] [Task Finished] Transform to mem in 0.278665s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:29:33.098] [E/2] [info] [Task Finished] Transform to mem in 0.279145s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:29:33.099] [E/15] [info] [Task Finished] Transform to mem in 0.279637s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:29:33.099] [E/3] [info] [Task Finished] Transform to mem in 0.279310s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:29:33.102] [E/1] [info] [Task Finished] Transform to mem in 0.279914s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:29:33.103] [driver] [info] [Task Finished] Transform to mem in 0.280360s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:29:33.103] [E/11] [info] [Task Finished] Transform to mem in 0.281055s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:29:33.105] [E/9] [info] [Task Finished] Transform to mem in 0.281394s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:29:33.374] [E/5] [info] [Task Finished] Transform to mem in 0.278628s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:29:33.375] [E/10] [info] [Task Finished] Transform to mem in 0.278566s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:29:33.375] [E/4] [info] [Task Finished] Transform to mem in 0.278855s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:29:33.375] [E/13] [info] [Task Finished] Transform to mem in 0.278742s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:29:33.375] [E/6] [info] [Task Finished] Transform to mem in 0.278941s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:29:33.375] [E/8] [info] [Task Finished] Transform to mem in 0.278440s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:29:33.375] [E/14] [info] [Task Finished] Transform to mem in 0.278828s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:29:33.376] [E/12] [info] [Task Finished] Transform to mem in 0.279116s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:29:33.376] [E/7] [info] [Task Finished] Transform to mem in 0.279021s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:29:33.378] [E/15] [info] [Task Finished] Transform to mem in 0.279431s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:29:33.378] [E/2] [info] [Task Finished] Transform to mem in 0.279593s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:29:33.380] [E/3] [info] [Task Finished] Transform to mem in 0.280798s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:29:33.381] [E/11] [info] [Task Finished] Transform to mem in 0.278220s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:29:33.381] [E/1] [info] [Task Finished] Transform to mem in 0.279677s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:29:33.387] [driver] [info] [Task Finished] Transform to mem in 0.284834s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:29:33.389] [E/9] [info] [Task Finished] Transform to mem in 0.283972s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:29:33.653] [E/5] [info] [Task Finished] Transform to mem in 0.278821s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:29:33.654] [E/14] [info] [Task Finished] Transform to mem in 0.278248s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:29:33.654] [E/4] [info] [Task Finished] Transform to mem in 0.278750s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:29:33.654] [E/6] [info] [Task Finished] Transform to mem in 0.279099s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:29:33.654] [E/10] [info] [Task Finished] Transform to mem in 0.279527s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:29:33.654] [E/13] [info] [Task Finished] Transform to mem in 0.279376s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:29:33.655] [E/12] [info] [Task Finished] Transform to mem in 0.279146s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:29:33.655] [E/7] [info] [Task Finished] Transform to mem in 0.279039s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:29:33.655] [E/8] [info] [Task Finished] Transform to mem in 0.279655s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:29:33.657] [E/2] [info] [Task Finished] Transform to mem in 0.279064s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:29:33.658] [E/15] [info] [Task Finished] Transform to mem in 0.279776s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:29:33.659] [E/3] [info] [Task Finished] Transform to mem in 0.279722s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:29:33.662] [E/1] [info] [Task Finished] Transform to mem in 0.280399s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:29:33.662] [E/11] [info] [Task Finished] Transform to mem in 0.281031s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:29:33.668] [driver] [info] [Task Finished] Transform to mem in 0.280236s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:29:33.672] [E/9] [info] [Task Finished] Transform to mem in 0.282542s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:29:33.932] [E/5] [info] [Task Finished] Transform to mem in 0.279341s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:33.933] [E/4] [info] [Task Finished] Transform to mem in 0.279617s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:29:33.934] [E/14] [info] [Task Finished] Transform to mem in 0.280089s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:29:33.934] [E/10] [info] [Task Finished] Transform to mem in 0.279675s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:29:33.934] [E/13] [info] [Task Finished] Transform to mem in 0.279682s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:29:33.934] [E/6] [info] [Task Finished] Transform to mem in 0.280179s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:29:33.935] [E/8] [info] [Task Finished] Transform to mem in 0.279548s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:33.935] [E/12] [info] [Task Finished] Transform to mem in 0.280244s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:29:33.936] [E/7] [info] [Task Finished] Transform to mem in 0.280620s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:29:33.938] [E/2] [info] [Task Finished] Transform to mem in 0.280539s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:29:33.938] [E/15] [info] [Task Finished] Transform to mem in 0.280435s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:29:33.939] [E/3] [info] [Task Finished] Transform to mem in 0.280088s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:29:33.941] [E/11] [info] [Task Finished] Transform to mem in 0.279233s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:29:33.942] [E/1] [info] [Task Finished] Transform to mem in 0.280435s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:29:33.948] [driver] [info] [Task Finished] Transform to mem in 0.280670s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:29:33.952] [E/9] [info] [Task Finished] Transform to mem in 0.279584s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:29:34.212] [E/5] [info] [Task Finished] Transform to mem in 0.280026s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:29:34.213] [E/4] [info] [Task Finished] Transform to mem in 0.279586s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:29:34.213] [E/14] [info] [Task Finished] Transform to mem in 0.279339s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:29:34.214] [E/13] [info] [Task Finished] Transform to mem in 0.279713s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:29:34.214] [E/8] [info] [Task Finished] Transform to mem in 0.279322s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:29:34.214] [E/10] [info] [Task Finished] Transform to mem in 0.280128s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:29:34.214] [E/6] [info] [Task Finished] Transform to mem in 0.279909s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:29:34.215] [E/12] [info] [Task Finished] Transform to mem in 0.279869s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:29:34.216] [E/7] [info] [Task Finished] Transform to mem in 0.279921s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:34.217] [E/2] [info] [Task Finished] Transform to mem in 0.279722s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:29:34.218] [E/15] [info] [Task Finished] Transform to mem in 0.280042s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:29:34.220] [E/3] [info] [Task Finished] Transform to mem in 0.280173s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:29:34.223] [E/1] [info] [Task Finished] Transform to mem in 0.280451s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:29:34.223] [E/11] [info] [Task Finished] Transform to mem in 0.281635s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:29:34.228] [driver] [info] [Task Finished] Transform to mem in 0.279889s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:29:34.234] [E/9] [info] [Task Finished] Transform to mem in 0.282519s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:29:34.492] [E/5] [info] [Task Finished] Transform to mem in 0.279694s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:34.492] [E/4] [info] [Task Finished] Transform to mem in 0.279272s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:29:34.493] [E/14] [info] [Task Finished] Transform to mem in 0.279782s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:29:34.494] [E/6] [info] [Task Finished] Transform to mem in 0.279167s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:29:34.494] [E/8] [info] [Task Finished] Transform to mem in 0.279771s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:29:34.494] [E/13] [info] [Task Finished] Transform to mem in 0.279913s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:29:34.495] [E/10] [info] [Task Finished] Transform to mem in 0.280310s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:29:34.495] [E/12] [info] [Task Finished] Transform to mem in 0.280206s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:29:34.495] [E/7] [info] [Task Finished] Transform to mem in 0.279835s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:29:34.497] [E/2] [info] [Task Finished] Transform to mem in 0.279755s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:29:34.499] [E/15] [info] [Task Finished] Transform to mem in 0.280254s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:29:34.500] [E/3] [info] [Task Finished] Transform to mem in 0.280386s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:29:34.503] [E/11] [info] [Task Finished] Transform to mem in 0.279962s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:29:34.503] [E/1] [info] [Task Finished] Transform to mem in 0.280492s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:29:34.510] [driver] [info] [Task Finished] Transform to mem in 0.281244s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:29:34.547] [E/9] [info] [Task Finished] Transform to mem in 0.313096s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:29:34.547] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.84936s
[2021-03-25 10:29:34.547] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.8262s, 56350770 input rows, time to process 1 row via fast path: 0.000795486ms
[2021-03-25 10:29:34.547] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:29:34.552] [local ee] [info] compiled pure python pipeline in 0.004321s
[2021-03-25 10:29:34.552] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:29:34.553] [local ee] [info] Created 160 resolve tasks in 0.001206s
[2021-03-25 10:29:34.553] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:29:34.565] [E/5] [info] [Task Finished] Resolve in 0.011893s
[2021-03-25 10:29:34.565] [driver] [info] [Task Finished] Resolve in 0.011901s
[2021-03-25 10:29:34.565] [E/10] [info] [Task Finished] Resolve in 0.011968s
[2021-03-25 10:29:34.565] [E/3] [info] [Task Finished] Resolve in 0.011985s
[2021-03-25 10:29:34.565] [E/4] [info] [Task Finished] Resolve in 0.011997s
[2021-03-25 10:29:34.565] [E/15] [info] [Task Finished] Resolve in 0.012060s
[2021-03-25 10:29:34.565] [E/2] [info] [Task Finished] Resolve in 0.012070s
[2021-03-25 10:29:34.565] [E/11] [info] [Task Finished] Resolve in 0.012063s
[2021-03-25 10:29:34.565] [E/14] [info] [Task Finished] Resolve in 0.012081s
[2021-03-25 10:29:34.565] [E/13] [info] [Task Finished] Resolve in 0.012100s
[2021-03-25 10:29:34.565] [E/8] [info] [Task Finished] Resolve in 0.012082s
[2021-03-25 10:29:34.565] [E/1] [info] [Task Finished] Resolve in 0.012068s
[2021-03-25 10:29:34.565] [E/9] [info] [Task Finished] Resolve in 0.012082s
[2021-03-25 10:29:34.565] [E/7] [info] [Task Finished] Resolve in 0.012103s
[2021-03-25 10:29:34.565] [E/6] [info] [Task Finished] Resolve in 0.012074s
[2021-03-25 10:29:34.565] [E/12] [info] [Task Finished] Resolve in 0.012252s
[2021-03-25 10:29:34.577] [E/4] [info] [Task Finished] Resolve in 0.011767s
[2021-03-25 10:29:34.577] [driver] [info] [Task Finished] Resolve in 0.011891s
[2021-03-25 10:29:34.577] [E/10] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:29:34.577] [E/5] [info] [Task Finished] Resolve in 0.012047s
[2021-03-25 10:29:34.577] [E/15] [info] [Task Finished] Resolve in 0.011894s
[2021-03-25 10:29:34.577] [E/2] [info] [Task Finished] Resolve in 0.011952s
[2021-03-25 10:29:34.577] [E/1] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:29:34.577] [E/3] [info] [Task Finished] Resolve in 0.012088s
[2021-03-25 10:29:34.577] [E/13] [info] [Task Finished] Resolve in 0.011985s
[2021-03-25 10:29:34.577] [E/8] [info] [Task Finished] Resolve in 0.012020s
[2021-03-25 10:29:34.577] [E/7] [info] [Task Finished] Resolve in 0.011995s
[2021-03-25 10:29:34.577] [E/12] [info] [Task Finished] Resolve in 0.011921s
[2021-03-25 10:29:34.577] [E/9] [info] [Task Finished] Resolve in 0.012042s
[2021-03-25 10:29:34.577] [E/14] [info] [Task Finished] Resolve in 0.012143s
[2021-03-25 10:29:34.577] [E/6] [info] [Task Finished] Resolve in 0.012076s
[2021-03-25 10:29:34.577] [E/11] [info] [Task Finished] Resolve in 0.012161s
[2021-03-25 10:29:34.589] [E/10] [info] [Task Finished] Resolve in 0.011996s
[2021-03-25 10:29:34.589] [E/4] [info] [Task Finished] Resolve in 0.012058s
[2021-03-25 10:29:34.589] [E/5] [info] [Task Finished] Resolve in 0.011973s
[2021-03-25 10:29:34.589] [E/15] [info] [Task Finished] Resolve in 0.012006s
[2021-03-25 10:29:34.589] [driver] [info] [Task Finished] Resolve in 0.012168s
[2021-03-25 10:29:34.589] [E/1] [info] [Task Finished] Resolve in 0.011976s
[2021-03-25 10:29:34.589] [E/12] [info] [Task Finished] Resolve in 0.011851s
[2021-03-25 10:29:34.589] [E/2] [info] [Task Finished] Resolve in 0.012014s
[2021-03-25 10:29:34.589] [E/13] [info] [Task Finished] Resolve in 0.012005s
[2021-03-25 10:29:34.589] [E/8] [info] [Task Finished] Resolve in 0.012017s
[2021-03-25 10:29:34.589] [E/14] [info] [Task Finished] Resolve in 0.011951s
[2021-03-25 10:29:34.589] [E/9] [info] [Task Finished] Resolve in 0.012022s
[2021-03-25 10:29:34.589] [E/11] [info] [Task Finished] Resolve in 0.011952s
[2021-03-25 10:29:34.589] [E/3] [info] [Task Finished] Resolve in 0.012231s
[2021-03-25 10:29:34.589] [E/6] [info] [Task Finished] Resolve in 0.012073s
[2021-03-25 10:29:34.589] [E/7] [info] [Task Finished] Resolve in 0.012180s
[2021-03-25 10:29:34.601] [E/10] [info] [Task Finished] Resolve in 0.011721s
[2021-03-25 10:29:34.601] [E/4] [info] [Task Finished] Resolve in 0.011841s
[2021-03-25 10:29:34.601] [E/5] [info] [Task Finished] Resolve in 0.011872s
[2021-03-25 10:29:34.601] [E/15] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:29:34.601] [E/12] [info] [Task Finished] Resolve in 0.011765s
[2021-03-25 10:29:34.601] [driver] [info] [Task Finished] Resolve in 0.011869s
[2021-03-25 10:29:34.601] [E/2] [info] [Task Finished] Resolve in 0.011875s
[2021-03-25 10:29:34.601] [E/13] [info] [Task Finished] Resolve in 0.011859s
[2021-03-25 10:29:34.601] [E/9] [info] [Task Finished] Resolve in 0.011828s
[2021-03-25 10:29:34.601] [E/7] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:29:34.601] [E/14] [info] [Task Finished] Resolve in 0.011908s
[2021-03-25 10:29:34.601] [E/3] [info] [Task Finished] Resolve in 0.011898s
[2021-03-25 10:29:34.601] [E/1] [info] [Task Finished] Resolve in 0.012194s
[2021-03-25 10:29:34.601] [E/11] [info] [Task Finished] Resolve in 0.012001s
[2021-03-25 10:29:34.601] [E/6] [info] [Task Finished] Resolve in 0.011975s
[2021-03-25 10:29:34.601] [E/8] [info] [Task Finished] Resolve in 0.012232s
[2021-03-25 10:29:34.612] [E/10] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:29:34.613] [E/15] [info] [Task Finished] Resolve in 0.011743s
[2021-03-25 10:29:34.613] [E/12] [info] [Task Finished] Resolve in 0.011771s
[2021-03-25 10:29:34.613] [E/5] [info] [Task Finished] Resolve in 0.011882s
[2021-03-25 10:29:34.613] [driver] [info] [Task Finished] Resolve in 0.011882s
[2021-03-25 10:29:34.613] [E/4] [info] [Task Finished] Resolve in 0.012123s
[2021-03-25 10:29:34.613] [E/2] [info] [Task Finished] Resolve in 0.011886s
[2021-03-25 10:29:34.613] [E/9] [info] [Task Finished] Resolve in 0.011822s
[2021-03-25 10:29:34.613] [E/7] [info] [Task Finished] Resolve in 0.011801s
[2021-03-25 10:29:34.613] [E/13] [info] [Task Finished] Resolve in 0.011984s
[2021-03-25 10:29:34.613] [E/1] [info] [Task Finished] Resolve in 0.011860s
[2021-03-25 10:29:34.613] [E/11] [info] [Task Finished] Resolve in 0.011844s
[2021-03-25 10:29:34.613] [E/3] [info] [Task Finished] Resolve in 0.011887s
[2021-03-25 10:29:34.613] [E/14] [info] [Task Finished] Resolve in 0.012102s
[2021-03-25 10:29:34.613] [E/8] [info] [Task Finished] Resolve in 0.011859s
[2021-03-25 10:29:34.613] [E/6] [info] [Task Finished] Resolve in 0.011975s
[2021-03-25 10:29:34.624] [E/10] [info] [Task Finished] Resolve in 0.011707s
[2021-03-25 10:29:34.624] [E/15] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:29:34.625] [driver] [info] [Task Finished] Resolve in 0.011861s
[2021-03-25 10:29:34.625] [E/5] [info] [Task Finished] Resolve in 0.011965s
[2021-03-25 10:29:34.625] [E/4] [info] [Task Finished] Resolve in 0.011841s
[2021-03-25 10:29:34.625] [E/7] [info] [Task Finished] Resolve in 0.011837s
[2021-03-25 10:29:34.625] [E/9] [info] [Task Finished] Resolve in 0.011860s
[2021-03-25 10:29:34.625] [E/2] [info] [Task Finished] Resolve in 0.011924s
[2021-03-25 10:29:34.625] [E/13] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:29:34.625] [E/12] [info] [Task Finished] Resolve in 0.012203s
[2021-03-25 10:29:34.625] [E/3] [info] [Task Finished] Resolve in 0.011825s
[2021-03-25 10:29:34.625] [E/11] [info] [Task Finished] Resolve in 0.011865s
[2021-03-25 10:29:34.625] [E/1] [info] [Task Finished] Resolve in 0.012003s
[2021-03-25 10:29:34.625] [E/8] [info] [Task Finished] Resolve in 0.011900s
[2021-03-25 10:29:34.625] [E/14] [info] [Task Finished] Resolve in 0.011987s
[2021-03-25 10:29:34.625] [E/6] [info] [Task Finished] Resolve in 0.011972s
[2021-03-25 10:29:34.636] [E/10] [info] [Task Finished] Resolve in 0.011730s
[2021-03-25 10:29:34.636] [E/15] [info] [Task Finished] Resolve in 0.011692s
[2021-03-25 10:29:34.637] [driver] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:29:34.637] [E/5] [info] [Task Finished] Resolve in 0.011942s
[2021-03-25 10:29:34.637] [E/7] [info] [Task Finished] Resolve in 0.011882s
[2021-03-25 10:29:34.637] [E/9] [info] [Task Finished] Resolve in 0.011927s
[2021-03-25 10:29:34.637] [E/12] [info] [Task Finished] Resolve in 0.011886s
[2021-03-25 10:29:34.637] [E/13] [info] [Task Finished] Resolve in 0.011913s
[2021-03-25 10:29:34.637] [E/2] [info] [Task Finished] Resolve in 0.011967s
[2021-03-25 10:29:34.637] [E/4] [info] [Task Finished] Resolve in 0.012158s
[2021-03-25 10:29:34.637] [E/1] [info] [Task Finished] Resolve in 0.011812s
[2021-03-25 10:29:34.637] [E/11] [info] [Task Finished] Resolve in 0.011963s
[2021-03-25 10:29:34.637] [E/14] [info] [Task Finished] Resolve in 0.011908s
[2021-03-25 10:29:34.637] [E/3] [info] [Task Finished] Resolve in 0.012200s
[2021-03-25 10:29:34.637] [E/8] [info] [Task Finished] Resolve in 0.012056s
[2021-03-25 10:29:34.637] [E/6] [info] [Task Finished] Resolve in 0.012056s
[2021-03-25 10:29:34.648] [E/10] [info] [Task Finished] Resolve in 0.011823s
[2021-03-25 10:29:34.648] [E/15] [info] [Task Finished] Resolve in 0.011985s
[2021-03-25 10:29:34.649] [E/7] [info] [Task Finished] Resolve in 0.011970s
[2021-03-25 10:29:34.649] [driver] [info] [Task Finished] Resolve in 0.012164s
[2021-03-25 10:29:34.649] [E/13] [info] [Task Finished] Resolve in 0.011914s
[2021-03-25 10:29:34.649] [E/12] [info] [Task Finished] Resolve in 0.011947s
[2021-03-25 10:29:34.649] [E/5] [info] [Task Finished] Resolve in 0.012133s
[2021-03-25 10:29:34.649] [E/9] [info] [Task Finished] Resolve in 0.012042s
[2021-03-25 10:29:34.649] [E/11] [info] [Task Finished] Resolve in 0.011914s
[2021-03-25 10:29:34.649] [E/2] [info] [Task Finished] Resolve in 0.012129s
[2021-03-25 10:29:34.649] [E/1] [info] [Task Finished] Resolve in 0.011961s
[2021-03-25 10:29:34.649] [E/14] [info] [Task Finished] Resolve in 0.011981s
[2021-03-25 10:29:34.649] [E/4] [info] [Task Finished] Resolve in 0.012256s
[2021-03-25 10:29:34.649] [E/8] [info] [Task Finished] Resolve in 0.011950s
[2021-03-25 10:29:34.649] [E/3] [info] [Task Finished] Resolve in 0.012047s
[2021-03-25 10:29:34.649] [E/6] [info] [Task Finished] Resolve in 0.012054s
[2021-03-25 10:29:34.660] [E/10] [info] [Task Finished] Resolve in 0.011741s
[2021-03-25 10:29:34.660] [E/15] [info] [Task Finished] Resolve in 0.012021s
[2021-03-25 10:29:34.660] [E/13] [info] [Task Finished] Resolve in 0.011730s
[2021-03-25 10:29:34.661] [driver] [info] [Task Finished] Resolve in 0.011825s
[2021-03-25 10:29:34.661] [E/12] [info] [Task Finished] Resolve in 0.011854s
[2021-03-25 10:29:34.661] [E/7] [info] [Task Finished] Resolve in 0.011961s
[2021-03-25 10:29:34.661] [E/5] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:29:34.661] [E/11] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:29:34.661] [E/1] [info] [Task Finished] Resolve in 0.011792s
[2021-03-25 10:29:34.661] [E/9] [info] [Task Finished] Resolve in 0.011980s
[2021-03-25 10:29:34.661] [E/14] [info] [Task Finished] Resolve in 0.011888s
[2021-03-25 10:29:34.661] [E/2] [info] [Task Finished] Resolve in 0.012113s
[2021-03-25 10:29:34.661] [E/4] [info] [Task Finished] Resolve in 0.011890s
[2021-03-25 10:29:34.661] [E/3] [info] [Task Finished] Resolve in 0.011847s
[2021-03-25 10:29:34.661] [E/8] [info] [Task Finished] Resolve in 0.011918s
[2021-03-25 10:29:34.661] [E/6] [info] [Task Finished] Resolve in 0.011979s
[2021-03-25 10:29:34.671] [E/10] [info] [Task Finished] Resolve in 0.011701s
[2021-03-25 10:29:34.672] [E/15] [info] [Task Finished] Resolve in 0.011895s
[2021-03-25 10:29:34.672] [E/13] [info] [Task Finished] Resolve in 0.011825s
[2021-03-25 10:29:34.672] [driver] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:29:34.673] [E/1] [info] [Task Finished] Resolve in 0.011684s
[2021-03-25 10:29:34.673] [E/12] [info] [Task Finished] Resolve in 0.011891s
[2021-03-25 10:29:34.673] [E/7] [info] [Task Finished] Resolve in 0.011895s
[2021-03-25 10:29:34.673] [E/5] [info] [Task Finished] Resolve in 0.011866s
[2021-03-25 10:29:34.673] [E/11] [info] [Task Finished] Resolve in 0.011956s
[2021-03-25 10:29:34.673] [E/9] [info] [Task Finished] Resolve in 0.012026s
[2021-03-25 10:29:34.673] [E/4] [info] [Task Finished] Resolve in 0.011802s
[2021-03-25 10:29:34.673] [E/2] [info] [Task Finished] Resolve in 0.011899s
[2021-03-25 10:29:34.673] [E/14] [info] [Task Finished] Resolve in 0.011950s
[2021-03-25 10:29:34.673] [E/8] [info] [Task Finished] Resolve in 0.011862s
[2021-03-25 10:29:34.673] [E/3] [info] [Task Finished] Resolve in 0.011924s
[2021-03-25 10:29:34.675] [E/6] [info] [Task Finished] Resolve in 0.013412s
[2021-03-25 10:29:34.675] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.127677s
[2021-03-25 10:29:34.675] [local ee] [info] slow path for Stage 0: total wall clock time: 1.91278s, time to process 1 row via slow path: 0.000277379ms
[2021-03-25 10:29:34.675] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.127704s

[2021-03-25 10:29:34.714] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:29:34.728] [E/15] [info] [Task Finished] write to file in 0.013610s (46082 rows, 7.02 MB)
[2021-03-25 10:29:34.746] [E/3] [info] [Task Finished] write to file in 0.031693s (112467 rows, 17.12 MB)
[2021-03-25 10:29:34.746] [E/11] [info] [Task Finished] write to file in 0.031827s (112421 rows, 17.11 MB)
[2021-03-25 10:29:34.746] [E/14] [info] [Task Finished] write to file in 0.031942s (112573 rows, 17.14 MB)
[2021-03-25 10:29:34.746] [E/6] [info] [Task Finished] write to file in 0.031981s (112583 rows, 17.14 MB)
[2021-03-25 10:29:34.746] [driver] [info] [Task Finished] write to file in 0.031981s (112425 rows, 17.11 MB)
[2021-03-25 10:29:34.746] [E/5] [info] [Task Finished] write to file in 0.032036s (112438 rows, 17.12 MB)
[2021-03-25 10:29:34.746] [E/7] [info] [Task Finished] write to file in 0.032180s (112482 rows, 17.12 MB)
[2021-03-25 10:29:34.746] [E/9] [info] [Task Finished] write to file in 0.032226s (112459 rows, 17.12 MB)
[2021-03-25 10:29:34.747] [E/12] [info] [Task Finished] write to file in 0.033380s (123251 rows, 18.76 MB)
[2021-03-25 10:29:34.748] [E/8] [info] [Task Finished] write to file in 0.033487s (123424 rows, 18.79 MB)
[2021-03-25 10:29:34.748] [E/4] [info] [Task Finished] write to file in 0.033625s (123377 rows, 18.78 MB)
[2021-03-25 10:29:34.748] [E/13] [info] [Task Finished] write to file in 0.033637s (123299 rows, 18.77 MB)
[2021-03-25 10:29:34.748] [E/2] [info] [Task Finished] write to file in 0.033657s (123389 rows, 18.78 MB)
[2021-03-25 10:29:34.748] [E/10] [info] [Task Finished] write to file in 0.033701s (123410 rows, 18.79 MB)
[2021-03-25 10:29:34.752] [E/1] [info] [Task Finished] write to file in 0.037601s (112411 rows, 17.11 MB)
[2021-03-25 10:29:34.752] [global] [info] writing output took 0.076606s
[2021-03-25 10:29:34.752] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0766976s
[2021-03-25 10:29:34.752] [global] [info] [Transform Stage] Stage 0 took 3.55651s
[2021-03-25 10:29:34.752] [global] [info] Query Execution took 3.63655s. (planning: 0.0800014s, execution: 3.55654s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.006104946136474609
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 3.9206326007843018 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0227473,"llvm_optimization_time_s":0.332336,"llvm_compilation_time_s":0.152217,"total_compilation_time_s":0.502706,"sampling_time_s":0.110547,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.8262,"fast_path_time_s":2.84938,"fast_path_per_row_time_ns":795.486,"slow_path_wall_time_s":1.91278,"slow_path_time_s":0.127677,"slow_path_per_row_time_ns":277.379}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.006104946136474609, "jobTime": 3.9206326007843018, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-25 10:29:34.776] [local execution engine] [info] Stopped local executor E/1
[2021-03-25 10:29:34.783] [local execution engine] [info] Stopped local executor E/2
[2021-03-25 10:29:34.789] [local execution engine] [info] Stopped local executor E/3
[2021-03-25 10:29:34.795] [local execution engine] [info] Stopped local executor E/4
[2021-03-25 10:29:34.802] [local execution engine] [info] Stopped local executor E/5
[2021-03-25 10:29:34.808] [local execution engine] [info] Stopped local executor E/6
[2021-03-25 10:29:34.814] [local execution engine] [info] Stopped local executor E/7
[2021-03-25 10:29:34.820] [local execution engine] [info] Stopped local executor E/8
[2021-03-25 10:29:34.827] [local execution engine] [info] Stopped local executor E/9
[2021-03-25 10:29:34.833] [local execution engine] [info] Stopped local executor E/10
[2021-03-25 10:29:34.839] [local execution engine] [info] Stopped local executor E/11
[2021-03-25 10:29:34.845] [local execution engine] [info] Stopped local executor E/12
[2021-03-25 10:29:34.851] [local execution engine] [info] Stopped local executor E/13
[2021-03-25 10:29:34.857] [local execution engine] [info] Stopped local executor E/14
[2021-03-25 10:29:34.863] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
