[2021-03-25 10:32:38.341] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:32:38.342] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:32:38.342] [local ee] [info] initializing LLVM backend
[2021-03-25 10:32:38.342] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:32:38.342] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/1] [info] starting detached process queue
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/2] [info] starting detached process queue
[2021-03-25 10:32:38.343] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [E/3] [info] starting detached process queue
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/4] [info] starting detached process queue
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [E/5] [info] starting detached process queue
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [E/6] [info] starting detached process queue
[2021-03-25 10:32:38.343] [E/7] [info] starting detached process queue
[2021-03-25 10:32:38.343] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/8] [info] starting detached process queue
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [E/9] [info] starting detached process queue
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/10] [info] starting detached process queue
[2021-03-25 10:32:38.343] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [E/11] [info] starting detached process queue
[2021-03-25 10:32:38.343] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/12] [info] starting detached process queue
[2021-03-25 10:32:38.343] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.343] [E/13] [info] starting detached process queue
[2021-03-25 10:32:38.343] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.343] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.344] [E/14] [info] starting detached process queue
[2021-03-25 10:32:38.344] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:32:38.344] [E/15] [info] starting detached process queue
[2021-03-25 10:32:38.344] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.344] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 10:32:38.344] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:32:38.344] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:32:38.344] [fileinputoperator] [info] found 1 file (10.61 GB) to process.
[2021-03-25 10:32:38.344] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty_synthetic@10G.csv on 256.00 KB
[2021-03-25 10:32:38.479] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:32:38.485] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:32:38.501] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:32:38.510] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:32:38.537] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:32:38.557] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:32:38.571] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:32:38.603] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:32:38.610] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:32:38.626] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:32:38.628] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:32:38.629] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:32:38.629] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:32:38.631] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:32:38.632] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:32:38.632] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:32:38.634] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:32:38.635] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:32:38.636] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:32:38.652] [logical planner] [info] logical optimization took 0.022685ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:32:38.652] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:32:38.653] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:32:38.654] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:32:38.654] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:32:38.655] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:32:38.655] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:32:38.656] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:32:38.657] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:32:38.658] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:32:38.659] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:32:38.660] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:32:38.661] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:32:38.661] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:32:38.662] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:32:38.664] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:32:38.665] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:32:38.665] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:32:38.666] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:32:38.666] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:32:38.667] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:32:38.667] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:32:38.668] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:32:38.669] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:32:38.670] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:32:38.671] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:32:38.672] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:32:38.673] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:32:38.673] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:32:38.674] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:32:38.706] [global] [info] Stage0 depends on: 
[2021-03-25 10:32:39.057] [global] [info] Optimization via LLVM passes took 0.333980 ms
[2021-03-25 10:32:39.209] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:32:39.209] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.503473s
[2021-03-25 10:32:39.210] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty_synthetic@10G.csv into 169 tasks
[2021-03-25 10:32:39.474] [E/9] [info] [Task Finished] Transform to mem in 0.263785s (10386 normal rows, 82651 exceptions)
[2021-03-25 10:32:39.474] [E/5] [info] [Task Finished] Transform to mem in 0.263804s (10378 normal rows, 82714 exceptions)
[2021-03-25 10:32:39.474] [E/10] [info] [Task Finished] Transform to mem in 0.263930s (10359 normal rows, 82920 exceptions)
[2021-03-25 10:32:39.474] [E/12] [info] [Task Finished] Transform to mem in 0.264300s (10514 normal rows, 82793 exceptions)
[2021-03-25 10:32:39.474] [E/3] [info] [Task Finished] Transform to mem in 0.264395s (10531 normal rows, 82507 exceptions)
[2021-03-25 10:32:39.474] [E/15] [info] [Task Finished] Transform to mem in 0.264590s (10505 normal rows, 82883 exceptions)
[2021-03-25 10:32:39.474] [E/13] [info] [Task Finished] Transform to mem in 0.264625s (10215 normal rows, 82926 exceptions)
[2021-03-25 10:32:39.475] [E/4] [info] [Task Finished] Transform to mem in 0.264988s (10252 normal rows, 83089 exceptions)
[2021-03-25 10:32:39.475] [driver] [info] [Task Finished] Transform to mem in 0.265002s (10512 normal rows, 83014 exceptions)
[2021-03-25 10:32:39.475] [E/6] [info] [Task Finished] Transform to mem in 0.265040s (10406 normal rows, 82712 exceptions)
[2021-03-25 10:32:39.475] [E/11] [info] [Task Finished] Transform to mem in 0.265323s (10396 normal rows, 83077 exceptions)
[2021-03-25 10:32:39.476] [E/8] [info] [Task Finished] Transform to mem in 0.265769s (10542 normal rows, 82535 exceptions)
[2021-03-25 10:32:39.476] [E/1] [info] [Task Finished] Transform to mem in 0.266385s (10532 normal rows, 83146 exceptions)
[2021-03-25 10:32:39.476] [E/2] [info] [Task Finished] Transform to mem in 0.266424s (10365 normal rows, 82838 exceptions)
[2021-03-25 10:32:39.478] [E/14] [info] [Task Finished] Transform to mem in 0.268099s (10243 normal rows, 83069 exceptions)
[2021-03-25 10:32:39.480] [E/7] [info] [Task Finished] Transform to mem in 0.269961s (10575 normal rows, 82724 exceptions)
[2021-03-25 10:32:39.733] [E/12] [info] [Task Finished] Transform to mem in 0.259332s (10288 normal rows, 83066 exceptions)
[2021-03-25 10:32:39.734] [E/4] [info] [Task Finished] Transform to mem in 0.259253s (10510 normal rows, 82396 exceptions)
[2021-03-25 10:32:39.734] [E/10] [info] [Task Finished] Transform to mem in 0.260312s (10510 normal rows, 82547 exceptions)
[2021-03-25 10:32:39.734] [E/5] [info] [Task Finished] Transform to mem in 0.260516s (10373 normal rows, 83047 exceptions)
[2021-03-25 10:32:39.734] [driver] [info] [Task Finished] Transform to mem in 0.259525s (10288 normal rows, 83177 exceptions)
[2021-03-25 10:32:39.735] [E/9] [info] [Task Finished] Transform to mem in 0.261155s (10378 normal rows, 82790 exceptions)
[2021-03-25 10:32:39.735] [E/15] [info] [Task Finished] Transform to mem in 0.260798s (10388 normal rows, 82649 exceptions)
[2021-03-25 10:32:39.735] [E/3] [info] [Task Finished] Transform to mem in 0.261042s (10514 normal rows, 82719 exceptions)
[2021-03-25 10:32:39.736] [E/13] [info] [Task Finished] Transform to mem in 0.261292s (10373 normal rows, 83312 exceptions)
[2021-03-25 10:32:39.736] [E/6] [info] [Task Finished] Transform to mem in 0.260978s (10514 normal rows, 82639 exceptions)
[2021-03-25 10:32:39.736] [E/11] [info] [Task Finished] Transform to mem in 0.261318s (10311 normal rows, 82729 exceptions)
[2021-03-25 10:32:39.737] [E/8] [info] [Task Finished] Transform to mem in 0.260947s (10450 normal rows, 83093 exceptions)
[2021-03-25 10:32:39.737] [E/1] [info] [Task Finished] Transform to mem in 0.260555s (10461 normal rows, 82531 exceptions)
[2021-03-25 10:32:39.737] [E/14] [info] [Task Finished] Transform to mem in 0.259577s (10522 normal rows, 82584 exceptions)
[2021-03-25 10:32:39.738] [E/2] [info] [Task Finished] Transform to mem in 0.261495s (10317 normal rows, 83176 exceptions)
[2021-03-25 10:32:39.739] [E/7] [info] [Task Finished] Transform to mem in 0.259208s (10323 normal rows, 82590 exceptions)
[2021-03-25 10:32:39.994] [E/12] [info] [Task Finished] Transform to mem in 0.260053s (10431 normal rows, 83410 exceptions)
[2021-03-25 10:32:39.994] [E/4] [info] [Task Finished] Transform to mem in 0.259484s (10480 normal rows, 82481 exceptions)
[2021-03-25 10:32:39.994] [E/10] [info] [Task Finished] Transform to mem in 0.259489s (10317 normal rows, 83180 exceptions)
[2021-03-25 10:32:39.994] [E/5] [info] [Task Finished] Transform to mem in 0.259624s (10522 normal rows, 82568 exceptions)
[2021-03-25 10:32:39.994] [driver] [info] [Task Finished] Transform to mem in 0.259477s (10304 normal rows, 82568 exceptions)
[2021-03-25 10:32:39.996] [E/6] [info] [Task Finished] Transform to mem in 0.259941s (10303 normal rows, 82500 exceptions)
[2021-03-25 10:32:39.996] [E/9] [info] [Task Finished] Transform to mem in 0.261506s (10434 normal rows, 83448 exceptions)
[2021-03-25 10:32:39.996] [E/13] [info] [Task Finished] Transform to mem in 0.260553s (10536 normal rows, 82412 exceptions)
[2021-03-25 10:32:39.996] [E/3] [info] [Task Finished] Transform to mem in 0.261114s (10353 normal rows, 83264 exceptions)
[2021-03-25 10:32:39.996] [E/15] [info] [Task Finished] Transform to mem in 0.261221s (10425 normal rows, 82382 exceptions)
[2021-03-25 10:32:39.997] [E/8] [info] [Task Finished] Transform to mem in 0.260233s (10421 normal rows, 82435 exceptions)
[2021-03-25 10:32:39.998] [E/1] [info] [Task Finished] Transform to mem in 0.261092s (10379 normal rows, 83209 exceptions)
[2021-03-25 10:32:39.999] [E/11] [info] [Task Finished] Transform to mem in 0.262030s (10428 normal rows, 83672 exceptions)
[2021-03-25 10:32:39.999] [E/14] [info] [Task Finished] Transform to mem in 0.261155s (10537 normal rows, 82448 exceptions)
[2021-03-25 10:32:39.999] [E/2] [info] [Task Finished] Transform to mem in 0.261551s (10295 normal rows, 82359 exceptions)
[2021-03-25 10:32:39.999] [E/7] [info] [Task Finished] Transform to mem in 0.260355s (10441 normal rows, 83814 exceptions)
[2021-03-25 10:32:40.253] [E/5] [info] [Task Finished] Transform to mem in 0.259186s (10285 normal rows, 82239 exceptions)
[2021-03-25 10:32:40.253] [E/12] [info] [Task Finished] Transform to mem in 0.259680s (10421 normal rows, 82390 exceptions)
[2021-03-25 10:32:40.253] [E/4] [info] [Task Finished] Transform to mem in 0.259862s (10366 normal rows, 83177 exceptions)
[2021-03-25 10:32:40.254] [E/10] [info] [Task Finished] Transform to mem in 0.259998s (10550 normal rows, 82536 exceptions)
[2021-03-25 10:32:40.254] [driver] [info] [Task Finished] Transform to mem in 0.260047s (10438 normal rows, 83705 exceptions)
[2021-03-25 10:32:40.256] [E/3] [info] [Task Finished] Transform to mem in 0.259247s (10207 normal rows, 82548 exceptions)
[2021-03-25 10:32:40.256] [E/13] [info] [Task Finished] Transform to mem in 0.259977s (10550 normal rows, 82245 exceptions)
[2021-03-25 10:32:40.256] [E/6] [info] [Task Finished] Transform to mem in 0.260597s (10413 normal rows, 82527 exceptions)
[2021-03-25 10:32:40.257] [E/8] [info] [Task Finished] Transform to mem in 0.259931s (10399 normal rows, 82487 exceptions)
[2021-03-25 10:32:40.258] [E/9] [info] [Task Finished] Transform to mem in 0.261602s (10387 normal rows, 83218 exceptions)
[2021-03-25 10:32:40.258] [E/1] [info] [Task Finished] Transform to mem in 0.260154s (10372 normal rows, 82987 exceptions)
[2021-03-25 10:32:40.259] [E/15] [info] [Task Finished] Transform to mem in 0.262231s (10516 normal rows, 83753 exceptions)
[2021-03-25 10:32:40.259] [E/7] [info] [Task Finished] Transform to mem in 0.259456s (10387 normal rows, 82745 exceptions)
[2021-03-25 10:32:40.259] [E/14] [info] [Task Finished] Transform to mem in 0.260574s (10225 normal rows, 82594 exceptions)
[2021-03-25 10:32:40.260] [E/11] [info] [Task Finished] Transform to mem in 0.261517s (10541 normal rows, 82369 exceptions)
[2021-03-25 10:32:40.262] [E/2] [info] [Task Finished] Transform to mem in 0.262182s (10536 normal rows, 83589 exceptions)
[2021-03-25 10:32:40.512] [E/4] [info] [Task Finished] Transform to mem in 0.258634s (10217 normal rows, 82839 exceptions)
[2021-03-25 10:32:40.513] [E/5] [info] [Task Finished] Transform to mem in 0.259570s (10384 normal rows, 82992 exceptions)
[2021-03-25 10:32:40.513] [driver] [info] [Task Finished] Transform to mem in 0.259146s (10380 normal rows, 82714 exceptions)
[2021-03-25 10:32:40.513] [E/12] [info] [Task Finished] Transform to mem in 0.259993s (10527 normal rows, 82110 exceptions)
[2021-03-25 10:32:40.514] [E/10] [info] [Task Finished] Transform to mem in 0.260548s (10536 normal rows, 83591 exceptions)
[2021-03-25 10:32:40.516] [E/13] [info] [Task Finished] Transform to mem in 0.259625s (10527 normal rows, 82391 exceptions)
[2021-03-25 10:32:40.516] [E/3] [info] [Task Finished] Transform to mem in 0.260476s (10413 normal rows, 82733 exceptions)
[2021-03-25 10:32:40.517] [E/6] [info] [Task Finished] Transform to mem in 0.260113s (10212 normal rows, 82864 exceptions)
[2021-03-25 10:32:40.518] [E/8] [info] [Task Finished] Transform to mem in 0.260892s (10541 normal rows, 83305 exceptions)
[2021-03-25 10:32:40.518] [E/1] [info] [Task Finished] Transform to mem in 0.259906s (10395 normal rows, 82884 exceptions)
[2021-03-25 10:32:40.519] [E/9] [info] [Task Finished] Transform to mem in 0.260613s (10380 normal rows, 82666 exceptions)
[2021-03-25 10:32:40.519] [E/7] [info] [Task Finished] Transform to mem in 0.259815s (10211 normal rows, 82855 exceptions)
[2021-03-25 10:32:40.520] [E/15] [info] [Task Finished] Transform to mem in 0.261471s (10537 normal rows, 82571 exceptions)
[2021-03-25 10:32:40.521] [E/14] [info] [Task Finished] Transform to mem in 0.261252s (10524 normal rows, 83296 exceptions)
[2021-03-25 10:32:40.521] [E/11] [info] [Task Finished] Transform to mem in 0.260693s (10403 normal rows, 82568 exceptions)
[2021-03-25 10:32:40.523] [E/2] [info] [Task Finished] Transform to mem in 0.261335s (10382 normal rows, 82778 exceptions)
[2021-03-25 10:32:40.772] [E/4] [info] [Task Finished] Transform to mem in 0.259656s (10541 normal rows, 82755 exceptions)
[2021-03-25 10:32:40.772] [E/5] [info] [Task Finished] Transform to mem in 0.259383s (10215 normal rows, 82861 exceptions)
[2021-03-25 10:32:40.773] [driver] [info] [Task Finished] Transform to mem in 0.259909s (10532 normal rows, 83104 exceptions)
[2021-03-25 10:32:40.773] [E/12] [info] [Task Finished] Transform to mem in 0.259935s (10386 normal rows, 82689 exceptions)
[2021-03-25 10:32:40.774] [E/10] [info] [Task Finished] Transform to mem in 0.259489s (10365 normal rows, 82841 exceptions)
[2021-03-25 10:32:40.776] [E/13] [info] [Task Finished] Transform to mem in 0.259799s (10575 normal rows, 82687 exceptions)
[2021-03-25 10:32:40.776] [E/3] [info] [Task Finished] Transform to mem in 0.260089s (10215 normal rows, 82938 exceptions)
[2021-03-25 10:32:40.778] [E/8] [info] [Task Finished] Transform to mem in 0.259941s (10406 normal rows, 82684 exceptions)
[2021-03-25 10:32:40.778] [E/7] [info] [Task Finished] Transform to mem in 0.258971s (10252 normal rows, 83088 exceptions)
[2021-03-25 10:32:40.778] [E/6] [info] [Task Finished] Transform to mem in 0.261704s (10512 normal rows, 83031 exceptions)
[2021-03-25 10:32:40.778] [E/1] [info] [Task Finished] Transform to mem in 0.260383s (10359 normal rows, 82956 exceptions)
[2021-03-25 10:32:40.779] [E/9] [info] [Task Finished] Transform to mem in 0.260038s (10531 normal rows, 82508 exceptions)
[2021-03-25 10:32:40.781] [E/14] [info] [Task Finished] Transform to mem in 0.260734s (10378 normal rows, 82714 exceptions)
[2021-03-25 10:32:40.781] [E/15] [info] [Task Finished] Transform to mem in 0.261111s (10505 normal rows, 82881 exceptions)
[2021-03-25 10:32:40.782] [E/11] [info] [Task Finished] Transform to mem in 0.261474s (10396 normal rows, 83080 exceptions)
[2021-03-25 10:32:40.784] [E/2] [info] [Task Finished] Transform to mem in 0.260731s (10542 normal rows, 82507 exceptions)
[2021-03-25 10:32:41.031] [E/4] [info] [Task Finished] Transform to mem in 0.259557s (10243 normal rows, 83097 exceptions)
[2021-03-25 10:32:41.032] [E/5] [info] [Task Finished] Transform to mem in 0.260118s (10514 normal rows, 82752 exceptions)
[2021-03-25 10:32:41.033] [driver] [info] [Task Finished] Transform to mem in 0.259523s (10378 normal rows, 82785 exceptions)
[2021-03-25 10:32:41.033] [E/10] [info] [Task Finished] Transform to mem in 0.259731s (10510 normal rows, 82546 exceptions)
[2021-03-25 10:32:41.034] [E/12] [info] [Task Finished] Transform to mem in 0.260361s (10373 normal rows, 83092 exceptions)
[2021-03-25 10:32:41.035] [E/13] [info] [Task Finished] Transform to mem in 0.259273s (10288 normal rows, 83067 exceptions)
[2021-03-25 10:32:41.038] [E/3] [info] [Task Finished] Transform to mem in 0.261480s (10514 normal rows, 82716 exceptions)
[2021-03-25 10:32:41.038] [E/7] [info] [Task Finished] Transform to mem in 0.260243s (10408 normal rows, 83285 exceptions)
[2021-03-25 10:32:41.038] [E/1] [info] [Task Finished] Transform to mem in 0.260049s (10288 normal rows, 83178 exceptions)
[2021-03-25 10:32:41.039] [E/9] [info] [Task Finished] Transform to mem in 0.260063s (10514 normal rows, 82630 exceptions)
[2021-03-25 10:32:41.039] [E/8] [info] [Task Finished] Transform to mem in 0.261283s (10353 normal rows, 82638 exceptions)
[2021-03-25 10:32:41.039] [E/6] [info] [Task Finished] Transform to mem in 0.261088s (10510 normal rows, 82399 exceptions)
[2021-03-25 10:32:41.042] [E/14] [info] [Task Finished] Transform to mem in 0.260575s (10311 normal rows, 82729 exceptions)
[2021-03-25 10:32:41.043] [E/15] [info] [Task Finished] Transform to mem in 0.261781s (10435 normal rows, 83133 exceptions)
[2021-03-25 10:32:41.044] [E/11] [info] [Task Finished] Transform to mem in 0.261338s (10476 normal rows, 82536 exceptions)
[2021-03-25 10:32:41.045] [E/2] [info] [Task Finished] Transform to mem in 0.261501s (10317 normal rows, 83177 exceptions)
[2021-03-25 10:32:41.291] [E/4] [info] [Task Finished] Transform to mem in 0.259852s (10522 normal rows, 82577 exceptions)
[2021-03-25 10:32:41.292] [E/5] [info] [Task Finished] Transform to mem in 0.259772s (10304 normal rows, 82572 exceptions)
[2021-03-25 10:32:41.293] [driver] [info] [Task Finished] Transform to mem in 0.260182s (10450 normal rows, 83434 exceptions)
[2021-03-25 10:32:41.294] [E/12] [info] [Task Finished] Transform to mem in 0.260169s (10317 normal rows, 83176 exceptions)
[2021-03-25 10:32:41.294] [E/10] [info] [Task Finished] Transform to mem in 0.260363s (10480 normal rows, 82448 exceptions)
[2021-03-25 10:32:41.295] [E/13] [info] [Task Finished] Transform to mem in 0.260194s (10522 normal rows, 82561 exceptions)
[2021-03-25 10:32:41.299] [E/7] [info] [Task Finished] Transform to mem in 0.260829s (10434 normal rows, 83503 exceptions)
[2021-03-25 10:32:41.299] [E/3] [info] [Task Finished] Transform to mem in 0.261449s (10304 normal rows, 82556 exceptions)
[2021-03-25 10:32:41.299] [E/9] [info] [Task Finished] Transform to mem in 0.260731s (10379 normal rows, 83265 exceptions)
[2021-03-25 10:32:41.300] [E/1] [info] [Task Finished] Transform to mem in 0.261794s (10399 normal rows, 82383 exceptions)
[2021-03-25 10:32:41.300] [E/8] [info] [Task Finished] Transform to mem in 0.261530s (10536 normal rows, 82412 exceptions)
[2021-03-25 10:32:41.301] [E/6] [info] [Task Finished] Transform to mem in 0.261765s (10290 normal rows, 82497 exceptions)
[2021-03-25 10:32:41.304] [E/14] [info] [Task Finished] Transform to mem in 0.261936s (10441 normal rows, 83672 exceptions)
[2021-03-25 10:32:41.305] [E/15] [info] [Task Finished] Transform to mem in 0.261521s (10421 normal rows, 82438 exceptions)
[2021-03-25 10:32:41.306] [E/11] [info] [Task Finished] Transform to mem in 0.262195s (10379 normal rows, 83209 exceptions)
[2021-03-25 10:32:41.309] [E/2] [info] [Task Finished] Transform to mem in 0.263979s (10537 normal rows, 82444 exceptions)
[2021-03-25 10:32:41.551] [E/4] [info] [Task Finished] Transform to mem in 0.259490s (10295 normal rows, 82316 exceptions)
[2021-03-25 10:32:41.552] [driver] [info] [Task Finished] Transform to mem in 0.259624s (10421 normal rows, 82414 exceptions)
[2021-03-25 10:32:41.553] [E/5] [info] [Task Finished] Transform to mem in 0.261166s (10441 normal rows, 83796 exceptions)
[2021-03-25 10:32:41.554] [E/10] [info] [Task Finished] Transform to mem in 0.259955s (10550 normal rows, 82481 exceptions)
[2021-03-25 10:32:41.554] [E/13] [info] [Task Finished] Transform to mem in 0.259131s (10285 normal rows, 82265 exceptions)
[2021-03-25 10:32:41.555] [E/12] [info] [Task Finished] Transform to mem in 0.260745s (10366 normal rows, 83213 exceptions)
[2021-03-25 10:32:41.560] [E/9] [info] [Task Finished] Transform to mem in 0.260048s (10387 normal rows, 83171 exceptions)
[2021-03-25 10:32:41.560] [E/8] [info] [Task Finished] Transform to mem in 0.259888s (10233 normal rows, 82572 exceptions)
[2021-03-25 10:32:41.561] [E/7] [info] [Task Finished] Transform to mem in 0.261878s (10438 normal rows, 83738 exceptions)
[2021-03-25 10:32:41.561] [E/3] [info] [Task Finished] Transform to mem in 0.261472s (10413 normal rows, 82527 exceptions)
[2021-03-25 10:32:41.561] [E/1] [info] [Task Finished] Transform to mem in 0.260766s (10524 normal rows, 82267 exceptions)
[2021-03-25 10:32:41.563] [E/6] [info] [Task Finished] Transform to mem in 0.262033s (10516 normal rows, 83709 exceptions)
[2021-03-25 10:32:41.565] [E/14] [info] [Task Finished] Transform to mem in 0.260884s (10387 normal rows, 82531 exceptions)
[2021-03-25 10:32:41.566] [E/15] [info] [Task Finished] Transform to mem in 0.260999s (10384 normal rows, 82987 exceptions)
[2021-03-25 10:32:41.568] [E/11] [info] [Task Finished] Transform to mem in 0.261943s (10541 normal rows, 82314 exceptions)
[2021-03-25 10:32:41.570] [E/2] [info] [Task Finished] Transform to mem in 0.261009s (10205 normal rows, 82633 exceptions)
[2021-03-25 10:32:41.812] [E/4] [info] [Task Finished] Transform to mem in 0.260693s (10534 normal rows, 83592 exceptions)
[2021-03-25 10:32:41.812] [driver] [info] [Task Finished] Transform to mem in 0.259570s (10406 normal rows, 82739 exceptions)
[2021-03-25 10:32:41.813] [E/13] [info] [Task Finished] Transform to mem in 0.258953s (10217 normal rows, 82840 exceptions)
[2021-03-25 10:32:41.814] [E/5] [info] [Task Finished] Transform to mem in 0.260878s (10387 normal rows, 82968 exceptions)
[2021-03-25 10:32:41.814] [E/10] [info] [Task Finished] Transform to mem in 0.260440s (10527 normal rows, 82155 exceptions)
[2021-03-25 10:32:41.816] [E/12] [info] [Task Finished] Transform to mem in 0.260933s (10536 normal rows, 83542 exceptions)
[2021-03-25 10:32:41.820] [E/9] [info] [Task Finished] Transform to mem in 0.260086s (10380 normal rows, 82709 exceptions)
[2021-03-25 10:32:41.821] [E/8] [info] [Task Finished] Transform to mem in 0.260403s (10395 normal rows, 82771 exceptions)
[2021-03-25 10:32:41.821] [E/3] [info] [Task Finished] Transform to mem in 0.260544s (10220 normal rows, 82876 exceptions)
[2021-03-25 10:32:41.821] [E/7] [info] [Task Finished] Transform to mem in 0.260694s (10537 normal rows, 82395 exceptions)
[2021-03-25 10:32:41.823] [E/1] [info] [Task Finished] Transform to mem in 0.261826s (10515 normal rows, 83284 exceptions)
[2021-03-25 10:32:41.825] [E/6] [info] [Task Finished] Transform to mem in 0.261731s (10403 normal rows, 82663 exceptions)
[2021-03-25 10:32:41.826] [E/14] [info] [Task Finished] Transform to mem in 0.261363s (10398 normal rows, 82849 exceptions)
[2021-03-25 10:32:41.828] [E/15] [info] [Task Finished] Transform to mem in 0.262068s (10537 normal rows, 82629 exceptions)
[2021-03-25 10:32:41.828] [E/11] [info] [Task Finished] Transform to mem in 0.260403s (10211 normal rows, 82855 exceptions)
[2021-03-25 10:32:41.833] [E/2] [info] [Task Finished] Transform to mem in 0.263188s (10524 normal rows, 83295 exceptions)
[2021-03-25 10:32:42.072] [driver] [info] [Task Finished] Transform to mem in 0.259730s (10382 normal rows, 82801 exceptions)
[2021-03-25 10:32:42.072] [E/4] [info] [Task Finished] Transform to mem in 0.260876s (10403 normal rows, 82520 exceptions)
[2021-03-25 10:32:42.073] [E/13] [info] [Task Finished] Transform to mem in 0.259863s (10541 normal rows, 82781 exceptions)
[2021-03-25 10:32:42.074] [E/5] [info] [Task Finished] Transform to mem in 0.260011s (10215 normal rows, 82861 exceptions)
[2021-03-25 10:32:42.075] [E/10] [info] [Task Finished] Transform to mem in 0.260398s (10532 normal rows, 83051 exceptions)
[2021-03-25 10:32:42.076] [E/12] [info] [Task Finished] Transform to mem in 0.260331s (10386 normal rows, 82742 exceptions)
[2021-03-25 10:32:42.079] [E/9] [info] [Task Finished] Transform to mem in 0.259658s (10365 normal rows, 82842 exceptions)
[2021-03-25 10:32:42.081] [E/8] [info] [Task Finished] Transform to mem in 0.259979s (10575 normal rows, 82639 exceptions)
[2021-03-25 10:32:42.294] [E/3] [info] [Task Finished] Transform to mem in 0.472376s (18692 normal rows, 150477 exceptions)
[2021-03-25 10:32:42.294] [global] [info] [Transform Stage] Stage 0 completed 169 load&transform tasks in 3.08428s
[2021-03-25 10:32:42.294] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.3205s, 56312200 input rows, time to process 1 row via fast path: 0.00078705ms
[2021-03-25 10:32:42.294] [global] [info] Exception details: 
+------------+------------+----------+
| OperatorID | Exception  | Count    |
+------------+------------+----------+
| 100001     | ValueError | 14067100 |
+------------+------------+----------+
[2021-03-25 10:32:42.298] [local ee] [info] compiled pure python pipeline in 0.004310s
[2021-03-25 10:32:42.298] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:32:42.299] [local ee] [info] Created 169 resolve tasks in 0.001241s
[2021-03-25 10:32:42.299] [local ee] [info] 169/169 tasks require executing the slow path.
[2021-03-25 10:32:42.410] [E/14] [info] [Task Finished] Resolve in 0.110385s
[2021-03-25 10:32:42.410] [E/13] [info] [Task Finished] Resolve in 0.110435s
[2021-03-25 10:32:42.410] [E/11] [info] [Task Finished] Resolve in 0.110548s
[2021-03-25 10:32:42.410] [E/15] [info] [Task Finished] Resolve in 0.110764s
[2021-03-25 10:32:42.410] [driver] [info] [Task Finished] Resolve in 0.110773s
[2021-03-25 10:32:42.410] [E/1] [info] [Task Finished] Resolve in 0.110861s
[2021-03-25 10:32:42.410] [E/2] [info] [Task Finished] Resolve in 0.110995s
[2021-03-25 10:32:42.410] [E/4] [info] [Task Finished] Resolve in 0.111014s
[2021-03-25 10:32:42.410] [E/12] [info] [Task Finished] Resolve in 0.110997s
[2021-03-25 10:32:42.410] [E/6] [info] [Task Finished] Resolve in 0.110995s
[2021-03-25 10:32:42.411] [E/9] [info] [Task Finished] Resolve in 0.111083s
[2021-03-25 10:32:42.411] [E/7] [info] [Task Finished] Resolve in 0.111232s
[2021-03-25 10:32:42.411] [E/5] [info] [Task Finished] Resolve in 0.111280s
[2021-03-25 10:32:42.411] [E/3] [info] [Task Finished] Resolve in 0.111283s
[2021-03-25 10:32:42.411] [E/8] [info] [Task Finished] Resolve in 0.111580s
[2021-03-25 10:32:42.413] [E/10] [info] [Task Finished] Resolve in 0.113512s
[2021-03-25 10:32:42.514] [E/6] [info] [Task Finished] Resolve in 0.103649s
[2021-03-25 10:32:42.514] [E/9] [info] [Task Finished] Resolve in 0.103786s
[2021-03-25 10:32:42.514] [E/3] [info] [Task Finished] Resolve in 0.103707s
[2021-03-25 10:32:42.515] [driver] [info] [Task Finished] Resolve in 0.104314s
[2021-03-25 10:32:42.515] [E/7] [info] [Task Finished] Resolve in 0.104258s
[2021-03-25 10:32:42.515] [E/5] [info] [Task Finished] Resolve in 0.104219s
[2021-03-25 10:32:42.515] [E/12] [info] [Task Finished] Resolve in 0.104597s
[2021-03-25 10:32:42.516] [E/8] [info] [Task Finished] Resolve in 0.104621s
[2021-03-25 10:32:42.517] [E/10] [info] [Task Finished] Resolve in 0.103637s
[2021-03-25 10:32:42.520] [E/13] [info] [Task Finished] Resolve in 0.109991s
[2021-03-25 10:32:42.520] [E/11] [info] [Task Finished] Resolve in 0.110089s
[2021-03-25 10:32:42.521] [E/14] [info] [Task Finished] Resolve in 0.110971s
[2021-03-25 10:32:42.521] [E/2] [info] [Task Finished] Resolve in 0.110432s
[2021-03-25 10:32:42.521] [E/15] [info] [Task Finished] Resolve in 0.110812s
[2021-03-25 10:32:42.521] [E/1] [info] [Task Finished] Resolve in 0.110756s
[2021-03-25 10:32:42.521] [E/4] [info] [Task Finished] Resolve in 0.110642s
[2021-03-25 10:32:42.618] [driver] [info] [Task Finished] Resolve in 0.103795s
[2021-03-25 10:32:42.619] [E/6] [info] [Task Finished] Resolve in 0.104857s
[2021-03-25 10:32:42.620] [E/8] [info] [Task Finished] Resolve in 0.103874s
[2021-03-25 10:32:42.623] [E/13] [info] [Task Finished] Resolve in 0.103417s
[2021-03-25 10:32:42.624] [E/11] [info] [Task Finished] Resolve in 0.103478s
[2021-03-25 10:32:42.624] [E/9] [info] [Task Finished] Resolve in 0.110058s
[2021-03-25 10:32:42.625] [E/15] [info] [Task Finished] Resolve in 0.103476s
[2021-03-25 10:32:42.625] [E/1] [info] [Task Finished] Resolve in 0.103654s
[2021-03-25 10:32:42.625] [E/7] [info] [Task Finished] Resolve in 0.110246s
[2021-03-25 10:32:42.625] [E/14] [info] [Task Finished] Resolve in 0.104607s
[2021-03-25 10:32:42.626] [E/3] [info] [Task Finished] Resolve in 0.111103s
[2021-03-25 10:32:42.626] [E/5] [info] [Task Finished] Resolve in 0.110624s
[2021-03-25 10:32:42.626] [E/2] [info] [Task Finished] Resolve in 0.105049s
[2021-03-25 10:32:42.626] [E/12] [info] [Task Finished] Resolve in 0.111379s
[2021-03-25 10:32:42.627] [E/4] [info] [Task Finished] Resolve in 0.105504s
[2021-03-25 10:32:42.628] [E/10] [info] [Task Finished] Resolve in 0.111218s
[2021-03-25 10:32:42.727] [E/13] [info] [Task Finished] Resolve in 0.103574s
[2021-03-25 10:32:42.728] [driver] [info] [Task Finished] Resolve in 0.109579s
[2021-03-25 10:32:42.728] [E/15] [info] [Task Finished] Resolve in 0.103437s
[2021-03-25 10:32:42.728] [E/9] [info] [Task Finished] Resolve in 0.103762s
[2021-03-25 10:32:42.729] [E/1] [info] [Task Finished] Resolve in 0.104022s
[2021-03-25 10:32:42.729] [E/11] [info] [Task Finished] Resolve in 0.105284s
[2021-03-25 10:32:42.729] [E/7] [info] [Task Finished] Resolve in 0.103763s
[2021-03-25 10:32:42.729] [E/6] [info] [Task Finished] Resolve in 0.109958s
[2021-03-25 10:32:42.730] [E/3] [info] [Task Finished] Resolve in 0.104431s
[2021-03-25 10:32:42.730] [E/2] [info] [Task Finished] Resolve in 0.104152s
[2021-03-25 10:32:42.730] [E/14] [info] [Task Finished] Resolve in 0.104756s
[2021-03-25 10:32:42.731] [E/4] [info] [Task Finished] Resolve in 0.103895s
[2021-03-25 10:32:42.731] [E/12] [info] [Task Finished] Resolve in 0.104053s
[2021-03-25 10:32:42.731] [E/8] [info] [Task Finished] Resolve in 0.111303s
[2021-03-25 10:32:42.731] [E/5] [info] [Task Finished] Resolve in 0.105558s
[2021-03-25 10:32:42.733] [E/10] [info] [Task Finished] Resolve in 0.105154s
[2021-03-25 10:32:42.831] [E/13] [info] [Task Finished] Resolve in 0.104215s
[2021-03-25 10:32:42.831] [E/9] [info] [Task Finished] Resolve in 0.103120s
[2021-03-25 10:32:42.832] [E/15] [info] [Task Finished] Resolve in 0.103806s
[2021-03-25 10:32:42.832] [driver] [info] [Task Finished] Resolve in 0.104130s
[2021-03-25 10:32:42.832] [E/11] [info] [Task Finished] Resolve in 0.103412s
[2021-03-25 10:32:42.833] [E/7] [info] [Task Finished] Resolve in 0.103857s
[2021-03-25 10:32:42.833] [E/6] [info] [Task Finished] Resolve in 0.103999s
[2021-03-25 10:32:42.834] [E/1] [info] [Task Finished] Resolve in 0.105165s
[2021-03-25 10:32:42.834] [E/14] [info] [Task Finished] Resolve in 0.103903s
[2021-03-25 10:32:42.834] [E/2] [info] [Task Finished] Resolve in 0.104039s
[2021-03-25 10:32:42.834] [E/12] [info] [Task Finished] Resolve in 0.103846s
[2021-03-25 10:32:42.835] [E/3] [info] [Task Finished] Resolve in 0.104608s
[2021-03-25 10:32:42.835] [E/4] [info] [Task Finished] Resolve in 0.104428s
[2021-03-25 10:32:42.835] [E/5] [info] [Task Finished] Resolve in 0.103895s
[2021-03-25 10:32:42.836] [E/8] [info] [Task Finished] Resolve in 0.104836s
[2021-03-25 10:32:42.837] [E/10] [info] [Task Finished] Resolve in 0.103837s
[2021-03-25 10:32:42.935] [E/13] [info] [Task Finished] Resolve in 0.103914s
[2021-03-25 10:32:42.935] [E/9] [info] [Task Finished] Resolve in 0.104042s
[2021-03-25 10:32:42.936] [driver] [info] [Task Finished] Resolve in 0.103751s
[2021-03-25 10:32:42.936] [E/15] [info] [Task Finished] Resolve in 0.104220s
[2021-03-25 10:32:42.936] [E/11] [info] [Task Finished] Resolve in 0.103946s
[2021-03-25 10:32:42.937] [E/7] [info] [Task Finished] Resolve in 0.103825s
[2021-03-25 10:32:42.937] [E/6] [info] [Task Finished] Resolve in 0.104183s
[2021-03-25 10:32:42.938] [E/1] [info] [Task Finished] Resolve in 0.104270s
[2021-03-25 10:32:42.939] [E/3] [info] [Task Finished] Resolve in 0.103906s
[2021-03-25 10:32:42.939] [E/2] [info] [Task Finished] Resolve in 0.104441s
[2021-03-25 10:32:42.939] [E/14] [info] [Task Finished] Resolve in 0.104555s
[2021-03-25 10:32:42.939] [E/12] [info] [Task Finished] Resolve in 0.104462s
[2021-03-25 10:32:42.939] [E/4] [info] [Task Finished] Resolve in 0.104387s
[2021-03-25 10:32:42.940] [E/5] [info] [Task Finished] Resolve in 0.104474s
[2021-03-25 10:32:42.941] [E/8] [info] [Task Finished] Resolve in 0.104771s
[2021-03-25 10:32:42.941] [E/10] [info] [Task Finished] Resolve in 0.103805s
[2021-03-25 10:32:43.040] [E/9] [info] [Task Finished] Resolve in 0.104221s
[2021-03-25 10:32:43.040] [E/13] [info] [Task Finished] Resolve in 0.104715s
[2021-03-25 10:32:43.040] [E/15] [info] [Task Finished] Resolve in 0.103911s
[2021-03-25 10:32:43.040] [driver] [info] [Task Finished] Resolve in 0.104269s
[2021-03-25 10:32:43.041] [E/11] [info] [Task Finished] Resolve in 0.104659s
[2021-03-25 10:32:43.041] [E/6] [info] [Task Finished] Resolve in 0.103990s
[2021-03-25 10:32:43.041] [E/7] [info] [Task Finished] Resolve in 0.104635s
[2021-03-25 10:32:43.043] [E/2] [info] [Task Finished] Resolve in 0.103957s
[2021-03-25 10:32:43.043] [E/12] [info] [Task Finished] Resolve in 0.103773s
[2021-03-25 10:32:43.043] [E/14] [info] [Task Finished] Resolve in 0.103996s
[2021-03-25 10:32:43.043] [E/1] [info] [Task Finished] Resolve in 0.104858s
[2021-03-25 10:32:43.043] [E/3] [info] [Task Finished] Resolve in 0.104577s
[2021-03-25 10:32:43.044] [E/4] [info] [Task Finished] Resolve in 0.104386s
[2021-03-25 10:32:43.044] [E/5] [info] [Task Finished] Resolve in 0.104775s
[2021-03-25 10:32:43.045] [E/8] [info] [Task Finished] Resolve in 0.104015s
[2021-03-25 10:32:43.045] [E/10] [info] [Task Finished] Resolve in 0.104478s
[2021-03-25 10:32:43.143] [E/9] [info] [Task Finished] Resolve in 0.103606s
[2021-03-25 10:32:43.144] [E/13] [info] [Task Finished] Resolve in 0.103701s
[2021-03-25 10:32:43.144] [E/11] [info] [Task Finished] Resolve in 0.103518s
[2021-03-25 10:32:43.145] [driver] [info] [Task Finished] Resolve in 0.104408s
[2021-03-25 10:32:43.145] [E/6] [info] [Task Finished] Resolve in 0.103644s
[2021-03-25 10:32:43.145] [E/15] [info] [Task Finished] Resolve in 0.105046s
[2021-03-25 10:32:43.146] [E/7] [info] [Task Finished] Resolve in 0.104776s
[2021-03-25 10:32:43.146] [E/2] [info] [Task Finished] Resolve in 0.103769s
[2021-03-25 10:32:43.146] [E/14] [info] [Task Finished] Resolve in 0.103659s
[2021-03-25 10:32:43.147] [E/3] [info] [Task Finished] Resolve in 0.103625s
[2021-03-25 10:32:43.147] [E/1] [info] [Task Finished] Resolve in 0.103708s
[2021-03-25 10:32:43.147] [E/12] [info] [Task Finished] Resolve in 0.104706s
[2021-03-25 10:32:43.148] [E/5] [info] [Task Finished] Resolve in 0.103963s
[2021-03-25 10:32:43.149] [E/10] [info] [Task Finished] Resolve in 0.103476s
[2021-03-25 10:32:43.149] [E/4] [info] [Task Finished] Resolve in 0.105591s
[2021-03-25 10:32:43.149] [E/8] [info] [Task Finished] Resolve in 0.104925s
[2021-03-25 10:32:43.247] [E/9] [info] [Task Finished] Resolve in 0.103320s
[2021-03-25 10:32:43.247] [E/13] [info] [Task Finished] Resolve in 0.103668s
[2021-03-25 10:32:43.248] [driver] [info] [Task Finished] Resolve in 0.103690s
[2021-03-25 10:32:43.248] [E/6] [info] [Task Finished] Resolve in 0.103454s
[2021-03-25 10:32:43.250] [E/15] [info] [Task Finished] Resolve in 0.104648s
[2021-03-25 10:32:43.250] [E/11] [info] [Task Finished] Resolve in 0.105362s
[2021-03-25 10:32:43.250] [E/2] [info] [Task Finished] Resolve in 0.103882s
[2021-03-25 10:32:43.251] [E/1] [info] [Task Finished] Resolve in 0.103713s
[2021-03-25 10:32:43.251] [E/3] [info] [Task Finished] Resolve in 0.103861s
[2021-03-25 10:32:43.251] [E/7] [info] [Task Finished] Resolve in 0.104623s
[2021-03-25 10:32:43.252] [E/14] [info] [Task Finished] Resolve in 0.105435s
[2021-03-25 10:32:43.252] [E/5] [info] [Task Finished] Resolve in 0.103818s
[2021-03-25 10:32:43.253] [E/12] [info] [Task Finished] Resolve in 0.105166s
[2021-03-25 10:32:43.253] [E/10] [info] [Task Finished] Resolve in 0.104015s
[2021-03-25 10:32:43.253] [E/4] [info] [Task Finished] Resolve in 0.103724s
[2021-03-25 10:32:43.254] [E/8] [info] [Task Finished] Resolve in 0.104018s
[2021-03-25 10:32:43.351] [E/13] [info] [Task Finished] Resolve in 0.103994s
[2021-03-25 10:32:43.352] [E/9] [info] [Task Finished] Resolve in 0.104996s
[2021-03-25 10:32:43.352] [driver] [info] [Task Finished] Resolve in 0.103895s
[2021-03-25 10:32:43.353] [E/6] [info] [Task Finished] Resolve in 0.104143s
[2021-03-25 10:32:43.353] [E/15] [info] [Task Finished] Resolve in 0.103098s
[2021-03-25 10:32:43.354] [E/2] [info] [Task Finished] Resolve in 0.103842s
[2021-03-25 10:32:43.354] [E/7] [info] [Task Finished] Resolve in 0.103526s
[2021-03-25 10:32:43.355] [E/1] [info] [Task Finished] Resolve in 0.104155s
[2021-03-25 10:32:43.355] [E/11] [info] [Task Finished] Resolve in 0.104899s
[2021-03-25 10:32:43.355] [E/3] [info] [Task Finished] Resolve in 0.104056s
[2021-03-25 10:32:43.356] [E/10] [info] [Task Finished] Resolve in 0.103504s
[2021-03-25 10:32:43.356] [E/5] [info] [Task Finished] Resolve in 0.104196s
[2021-03-25 10:32:43.357] [E/14] [info] [Task Finished] Resolve in 0.104783s
[2021-03-25 10:32:43.357] [E/12] [info] [Task Finished] Resolve in 0.104093s
[2021-03-25 10:32:43.358] [E/4] [info] [Task Finished] Resolve in 0.104517s
[2021-03-25 10:32:43.359] [E/8] [info] [Task Finished] Resolve in 0.105019s
[2021-03-25 10:32:43.455] [E/9] [info] [Task Finished] Resolve in 0.103440s
[2021-03-25 10:32:43.455] [E/13] [info] [Task Finished] Resolve in 0.103879s
[2021-03-25 10:32:43.456] [driver] [info] [Task Finished] Resolve in 0.103761s
[2021-03-25 10:32:43.456] [E/6] [info] [Task Finished] Resolve in 0.103947s
[2021-03-25 10:32:43.457] [E/15] [info] [Task Finished] Resolve in 0.104140s
[2021-03-25 10:32:43.458] [E/2] [info] [Task Finished] Resolve in 0.104079s
[2021-03-25 10:32:43.458] [E/7] [info] [Task Finished] Resolve in 0.104131s
[2021-03-25 10:32:43.459] [E/1] [info] [Task Finished] Resolve in 0.104086s
[2021-03-25 10:32:43.544] [E/11] [info] [Task Finished] Resolve in 0.189426s
[2021-03-25 10:32:43.544] [local ee] [info] slow path resolved 14067100/14067100 exceptions in 1.25057s
[2021-03-25 10:32:43.544] [local ee] [info] slow path for Stage 0: total wall clock time: 17.9026s, time to process 1 row via slow path: 0.00127266ms
[2021-03-25 10:32:43.544] [global] [info] [Transform Stage] Stage 0 completed 169 resolve tasks in 1.25061s

[2021-03-25 10:32:43.867] [global] [info] Writing 15835160 rows as output to file (2.34 GB)
[2021-03-25 10:32:43.998] [driver] [info] [Task Finished] write to file in 0.130680s (448718 rows, 67.90 MB)
[2021-03-25 10:32:44.151] [E/5] [info] [Task Finished] write to file in 0.284026s (1025448 rows, 155.17 MB)
[2021-03-25 10:32:44.152] [E/14] [info] [Task Finished] write to file in 0.284724s (1025220 rows, 155.14 MB)
[2021-03-25 10:32:44.152] [E/6] [info] [Task Finished] write to file in 0.285198s (1026134 rows, 155.28 MB)
[2021-03-25 10:32:44.152] [E/7] [info] [Task Finished] write to file in 0.285290s (1025556 rows, 155.19 MB)
[2021-03-25 10:32:44.153] [E/2] [info] [Task Finished] write to file in 0.285572s (1025433 rows, 155.17 MB)
[2021-03-25 10:32:44.154] [E/10] [info] [Task Finished] write to file in 0.286541s (1026182 rows, 155.29 MB)
[2021-03-25 10:32:44.154] [E/12] [info] [Task Finished] write to file in 0.287122s (1025564 rows, 155.19 MB)
[2021-03-25 10:32:44.154] [E/4] [info] [Task Finished] write to file in 0.287180s (1025530 rows, 155.19 MB)
[2021-03-25 10:32:44.155] [E/15] [info] [Task Finished] write to file in 0.287689s (1025063 rows, 155.12 MB)
[2021-03-25 10:32:44.155] [E/8] [info] [Task Finished] write to file in 0.287724s (1026250 rows, 155.30 MB)
[2021-03-25 10:32:44.156] [E/11] [info] [Task Finished] write to file in 0.288894s (1025762 rows, 155.22 MB)
[2021-03-25 10:32:44.156] [E/13] [info] [Task Finished] write to file in 0.288904s (1025917 rows, 155.24 MB)
[2021-03-25 10:32:44.156] [E/3] [info] [Task Finished] write to file in 0.289249s (1026137 rows, 155.28 MB)
[2021-03-25 10:32:44.157] [E/9] [info] [Task Finished] write to file in 0.289594s (1026198 rows, 155.29 MB)
[2021-03-25 10:32:44.211] [E/1] [info] [Task Finished] write to file in 0.343903s (1026048 rows, 155.26 MB)
[2021-03-25 10:32:44.211] [global] [info] writing output took 0.666683s
[2021-03-25 10:32:44.211] [global] [info] [Transform Stage] Stage 0 completed 169 sink tasks in 0.66679s
[2021-03-25 10:32:44.211] [global] [info] [Transform Stage] Stage 0 took 5.50519s
[2021-03-25 10:32:44.211] [global] [info] Query Execution took 5.58494s. (planning: 0.0797149s, execution: 5.50522s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty_synthetic@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.006059885025024414
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 5.868471384048462 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0226848,"llvm_optimization_time_s":0.33398,"llvm_compilation_time_s":0.151829,"total_compilation_time_s":0.503471,"sampling_time_s":0.110335,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.3205,"fast_path_time_s":3.0843,"fast_path_per_row_time_ns":787.05,"slow_path_wall_time_s":17.9026,"slow_path_time_s":1.25057,"slow_path_per_row_time_ns":1272.66}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.006059885025024414, "jobTime": 5.868471384048462, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-25 10:32:44.236] [local execution engine] [info] Stopped local executor E/1
[2021-03-25 10:32:44.249] [local execution engine] [info] Stopped local executor E/2
[2021-03-25 10:32:44.262] [local execution engine] [info] Stopped local executor E/3
[2021-03-25 10:32:44.277] [local execution engine] [info] Stopped local executor E/4
[2021-03-25 10:32:44.291] [local execution engine] [info] Stopped local executor E/5
[2021-03-25 10:32:44.305] [local execution engine] [info] Stopped local executor E/6
[2021-03-25 10:32:44.318] [local execution engine] [info] Stopped local executor E/7
[2021-03-25 10:32:44.331] [local execution engine] [info] Stopped local executor E/8
[2021-03-25 10:32:44.345] [local execution engine] [info] Stopped local executor E/9
[2021-03-25 10:32:44.359] [local execution engine] [info] Stopped local executor E/10
[2021-03-25 10:32:44.373] [local execution engine] [info] Stopped local executor E/11
[2021-03-25 10:32:44.385] [local execution engine] [info] Stopped local executor E/12
[2021-03-25 10:32:44.399] [local execution engine] [info] Stopped local executor E/13
[2021-03-25 10:32:44.413] [local execution engine] [info] Stopped local executor E/14
[2021-03-25 10:32:44.426] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
