[2021-03-25 13:22:14.564] [global] [error] could not find backend, defaulting to local
[2021-03-25 13:22:14.564] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 13:22:14.564] [local ee] [info] initializing LLVM backend
[2021-03-25 13:22:14.564] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 13:22:14.564] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.565] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.565] [E/1] [info] starting detached process queue
[2021-03-25 13:22:14.565] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.565] [E/2] [info] starting detached process queue
[2021-03-25 13:22:14.565] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.565] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.565] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.565] [E/3] [info] starting detached process queue
[2021-03-25 13:22:14.565] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.565] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.565] [E/4] [info] starting detached process queue
[2021-03-25 13:22:14.565] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/5] [info] starting detached process queue
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/6] [info] starting detached process queue
[2021-03-25 13:22:14.566] [E/7] [info] starting detached process queue
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [E/8] [info] starting detached process queue
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/9] [info] starting detached process queue
[2021-03-25 13:22:14.566] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [E/10] [info] starting detached process queue
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [E/11] [info] starting detached process queue
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/12] [info] starting detached process queue
[2021-03-25 13:22:14.566] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [E/13] [info] starting detached process queue
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [E/14] [info] starting detached process queue
[2021-03-25 13:22:14.566] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 13:22:14.566] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [E/15] [info] starting detached process queue
[2021-03-25 13:22:14.566] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 13:22:14.566] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 13:22:14.566] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 13:22:14.566] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 13:22:14.567] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 13:22:14.703] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:14.709] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:14.725] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:14.733] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:14.760] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:14.781] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:14.794] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:14.827] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:22:14.833] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:14.849] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:22:14.851] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:14.852] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:14.853] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:22:14.854] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:14.856] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:14.856] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:22:14.858] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:14.859] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:22:14.859] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:22:14.876] [logical planner] [info] logical optimization took 0.022620ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 13:22:14.876] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 13:22:14.876] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 13:22:14.877] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 13:22:14.878] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 13:22:14.879] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 13:22:14.879] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 13:22:14.880] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 13:22:14.881] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 13:22:14.882] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 13:22:14.883] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 13:22:14.883] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 13:22:14.884] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:22:14.885] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:22:14.886] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 13:22:14.887] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 13:22:14.888] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 13:22:14.889] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 13:22:14.889] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 13:22:14.890] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 13:22:14.890] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 13:22:14.891] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 13:22:14.892] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 13:22:14.893] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 13:22:14.894] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 13:22:14.894] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 13:22:14.896] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 13:22:14.896] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:22:14.897] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:22:14.898] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 13:22:14.930] [global] [info] Stage0 depends on: 
[2021-03-25 13:22:15.280] [global] [info] Optimization via LLVM passes took 0.332979 ms
[2021-03-25 13:22:15.433] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 13:22:15.433] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.503349s
[2021-03-25 13:22:15.434] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 13:22:15.716] [E/4] [info] [Task Finished] Transform to mem in 0.282620s (10997 normal rows, 42873 exceptions)
[2021-03-25 13:22:15.716] [E/15] [info] [Task Finished] Transform to mem in 0.282748s (10997 normal rows, 42910 exceptions)
[2021-03-25 13:22:15.717] [E/10] [info] [Task Finished] Transform to mem in 0.283185s (11036 normal rows, 43139 exceptions)
[2021-03-25 13:22:15.717] [E/6] [info] [Task Finished] Transform to mem in 0.283202s (11008 normal rows, 43077 exceptions)
[2021-03-25 13:22:15.717] [E/14] [info] [Task Finished] Transform to mem in 0.283217s (11005 normal rows, 42741 exceptions)
[2021-03-25 13:22:15.717] [E/12] [info] [Task Finished] Transform to mem in 0.283482s (11026 normal rows, 43206 exceptions)
[2021-03-25 13:22:15.717] [E/3] [info] [Task Finished] Transform to mem in 0.283529s (11047 normal rows, 43210 exceptions)
[2021-03-25 13:22:15.717] [E/5] [info] [Task Finished] Transform to mem in 0.283543s (11086 normal rows, 43015 exceptions)
[2021-03-25 13:22:15.717] [E/7] [info] [Task Finished] Transform to mem in 0.283635s (11153 normal rows, 42968 exceptions)
[2021-03-25 13:22:15.717] [E/8] [info] [Task Finished] Transform to mem in 0.283692s (10987 normal rows, 43113 exceptions)
[2021-03-25 13:22:15.717] [E/1] [info] [Task Finished] Transform to mem in 0.283756s (11105 normal rows, 43095 exceptions)
[2021-03-25 13:22:15.717] [driver] [info] [Task Finished] Transform to mem in 0.283861s (11036 normal rows, 43142 exceptions)
[2021-03-25 13:22:15.717] [E/9] [info] [Task Finished] Transform to mem in 0.283889s (11153 normal rows, 42970 exceptions)
[2021-03-25 13:22:15.718] [E/13] [info] [Task Finished] Transform to mem in 0.284276s (11005 normal rows, 42744 exceptions)
[2021-03-25 13:22:15.719] [E/2] [info] [Task Finished] Transform to mem in 0.285001s (11073 normal rows, 43414 exceptions)
[2021-03-25 13:22:15.719] [E/11] [info] [Task Finished] Transform to mem in 0.285232s (11092 normal rows, 43495 exceptions)
[2021-03-25 13:22:15.995] [E/4] [info] [Task Finished] Transform to mem in 0.279031s (11086 normal rows, 42996 exceptions)
[2021-03-25 13:22:15.996] [E/6] [info] [Task Finished] Transform to mem in 0.279379s (11026 normal rows, 43205 exceptions)
[2021-03-25 13:22:15.996] [E/15] [info] [Task Finished] Transform to mem in 0.280111s (11092 normal rows, 43505 exceptions)
[2021-03-25 13:22:15.997] [E/3] [info] [Task Finished] Transform to mem in 0.279514s (11036 normal rows, 43115 exceptions)
[2021-03-25 13:22:15.997] [E/5] [info] [Task Finished] Transform to mem in 0.279503s (11005 normal rows, 42772 exceptions)
[2021-03-25 13:22:15.997] [E/8] [info] [Task Finished] Transform to mem in 0.279490s (11079 normal rows, 43539 exceptions)
[2021-03-25 13:22:15.997] [E/12] [info] [Task Finished] Transform to mem in 0.279746s (11023 normal rows, 42910 exceptions)
[2021-03-25 13:22:15.997] [E/7] [info] [Task Finished] Transform to mem in 0.279861s (11086 normal rows, 42970 exceptions)
[2021-03-25 13:22:15.997] [E/10] [info] [Task Finished] Transform to mem in 0.280365s (11153 normal rows, 42978 exceptions)
[2021-03-25 13:22:15.997] [E/14] [info] [Task Finished] Transform to mem in 0.280408s (10982 normal rows, 43059 exceptions)
[2021-03-25 13:22:15.997] [E/9] [info] [Task Finished] Transform to mem in 0.279986s (10987 normal rows, 43068 exceptions)
[2021-03-25 13:22:15.998] [E/1] [info] [Task Finished] Transform to mem in 0.280314s (11111 normal rows, 42961 exceptions)
[2021-03-25 13:22:15.998] [driver] [info] [Task Finished] Transform to mem in 0.280533s (11076 normal rows, 43220 exceptions)
[2021-03-25 13:22:15.998] [E/13] [info] [Task Finished] Transform to mem in 0.280280s (11023 normal rows, 42880 exceptions)
[2021-03-25 13:22:15.999] [E/2] [info] [Task Finished] Transform to mem in 0.279935s (11036 normal rows, 43053 exceptions)
[2021-03-25 13:22:15.999] [E/11] [info] [Task Finished] Transform to mem in 0.280399s (10992 normal rows, 42864 exceptions)
[2021-03-25 13:22:16.275] [E/4] [info] [Task Finished] Transform to mem in 0.279373s (11099 normal rows, 42882 exceptions)
[2021-03-25 13:22:16.276] [E/12] [info] [Task Finished] Transform to mem in 0.278895s (11026 normal rows, 43041 exceptions)
[2021-03-25 13:22:16.276] [E/15] [info] [Task Finished] Transform to mem in 0.279986s (11127 normal rows, 42969 exceptions)
[2021-03-25 13:22:16.277] [E/8] [info] [Task Finished] Transform to mem in 0.279774s (11004 normal rows, 42876 exceptions)
[2021-03-25 13:22:16.277] [E/3] [info] [Task Finished] Transform to mem in 0.279991s (11076 normal rows, 43221 exceptions)
[2021-03-25 13:22:16.277] [E/6] [info] [Task Finished] Transform to mem in 0.280545s (11063 normal rows, 43617 exceptions)
[2021-03-25 13:22:16.277] [E/10] [info] [Task Finished] Transform to mem in 0.279732s (11064 normal rows, 42832 exceptions)
[2021-03-25 13:22:16.277] [E/5] [info] [Task Finished] Transform to mem in 0.280268s (10987 normal rows, 43063 exceptions)
[2021-03-25 13:22:16.277] [E/7] [info] [Task Finished] Transform to mem in 0.280109s (11021 normal rows, 42887 exceptions)
[2021-03-25 13:22:16.277] [E/1] [info] [Task Finished] Transform to mem in 0.279732s (11076 normal rows, 43212 exceptions)
[2021-03-25 13:22:16.278] [E/14] [info] [Task Finished] Transform to mem in 0.280428s (11098 normal rows, 43603 exceptions)
[2021-03-25 13:22:16.278] [E/9] [info] [Task Finished] Transform to mem in 0.280485s (11127 normal rows, 43028 exceptions)
[2021-03-25 13:22:16.278] [E/2] [info] [Task Finished] Transform to mem in 0.279964s (11026 normal rows, 43037 exceptions)
[2021-03-25 13:22:16.279] [E/13] [info] [Task Finished] Transform to mem in 0.280912s (11004 normal rows, 42913 exceptions)
[2021-03-25 13:22:16.280] [driver] [info] [Task Finished] Transform to mem in 0.281800s (10987 normal rows, 43041 exceptions)
[2021-03-25 13:22:16.280] [E/11] [info] [Task Finished] Transform to mem in 0.280665s (11012 normal rows, 42883 exceptions)
[2021-03-25 13:22:16.554] [E/4] [info] [Task Finished] Transform to mem in 0.279529s (11073 normal rows, 42820 exceptions)
[2021-03-25 13:22:16.556] [E/12] [info] [Task Finished] Transform to mem in 0.279782s (11095 normal rows, 43503 exceptions)
[2021-03-25 13:22:16.556] [E/10] [info] [Task Finished] Transform to mem in 0.278651s (11026 normal rows, 43035 exceptions)
[2021-03-25 13:22:16.556] [E/8] [info] [Task Finished] Transform to mem in 0.279461s (11076 normal rows, 43152 exceptions)
[2021-03-25 13:22:16.556] [E/15] [info] [Task Finished] Transform to mem in 0.279765s (11130 normal rows, 43084 exceptions)
[2021-03-25 13:22:16.556] [E/3] [info] [Task Finished] Transform to mem in 0.279777s (10976 normal rows, 43110 exceptions)
[2021-03-25 13:22:16.556] [E/5] [info] [Task Finished] Transform to mem in 0.279499s (11012 normal rows, 42888 exceptions)
[2021-03-25 13:22:16.557] [E/7] [info] [Task Finished] Transform to mem in 0.279408s (11073 normal rows, 42754 exceptions)
[2021-03-25 13:22:16.557] [E/6] [info] [Task Finished] Transform to mem in 0.280235s (11015 normal rows, 42966 exceptions)
[2021-03-25 13:22:16.558] [E/1] [info] [Task Finished] Transform to mem in 0.280422s (11095 normal rows, 43552 exceptions)
[2021-03-25 13:22:16.558] [E/9] [info] [Task Finished] Transform to mem in 0.280062s (11069 normal rows, 43142 exceptions)
[2021-03-25 13:22:16.559] [E/2] [info] [Task Finished] Transform to mem in 0.280313s (10974 normal rows, 43172 exceptions)
[2021-03-25 13:22:16.559] [E/14] [info] [Task Finished] Transform to mem in 0.281299s (11130 normal rows, 43033 exceptions)
[2021-03-25 13:22:16.560] [E/13] [info] [Task Finished] Transform to mem in 0.280568s (11008 normal rows, 42964 exceptions)
[2021-03-25 13:22:16.560] [driver] [info] [Task Finished] Transform to mem in 0.280467s (11042 normal rows, 43023 exceptions)
[2021-03-25 13:22:16.561] [E/11] [info] [Task Finished] Transform to mem in 0.280601s (11012 normal rows, 42911 exceptions)
[2021-03-25 13:22:16.834] [E/4] [info] [Task Finished] Transform to mem in 0.280060s (11063 normal rows, 42726 exceptions)
[2021-03-25 13:22:16.835] [E/8] [info] [Task Finished] Transform to mem in 0.279128s (11087 normal rows, 43150 exceptions)
[2021-03-25 13:22:16.836] [E/12] [info] [Task Finished] Transform to mem in 0.280063s (11105 normal rows, 43555 exceptions)
[2021-03-25 13:22:16.836] [E/15] [info] [Task Finished] Transform to mem in 0.279415s (11005 normal rows, 43164 exceptions)
[2021-03-25 13:22:16.836] [E/3] [info] [Task Finished] Transform to mem in 0.279611s (11008 normal rows, 42975 exceptions)
[2021-03-25 13:22:16.836] [E/10] [info] [Task Finished] Transform to mem in 0.280573s (11081 normal rows, 43050 exceptions)
[2021-03-25 13:22:16.836] [E/5] [info] [Task Finished] Transform to mem in 0.279755s (11042 normal rows, 42959 exceptions)
[2021-03-25 13:22:16.837] [E/6] [info] [Task Finished] Transform to mem in 0.279739s (11073 normal rows, 42720 exceptions)
[2021-03-25 13:22:16.837] [E/7] [info] [Task Finished] Transform to mem in 0.280127s (11002 normal rows, 42964 exceptions)
[2021-03-25 13:22:16.837] [E/1] [info] [Task Finished] Transform to mem in 0.279555s (11088 normal rows, 43511 exceptions)
[2021-03-25 13:22:16.838] [E/9] [info] [Task Finished] Transform to mem in 0.280107s (11098 normal rows, 43112 exceptions)
[2021-03-25 13:22:16.839] [E/2] [info] [Task Finished] Transform to mem in 0.279709s (11087 normal rows, 43044 exceptions)
[2021-03-25 13:22:16.839] [E/14] [info] [Task Finished] Transform to mem in 0.280423s (11005 normal rows, 43229 exceptions)
[2021-03-25 13:22:16.840] [E/13] [info] [Task Finished] Transform to mem in 0.280054s (11008 normal rows, 43017 exceptions)
[2021-03-25 13:22:16.841] [driver] [info] [Task Finished] Transform to mem in 0.280570s (11024 normal rows, 42947 exceptions)
[2021-03-25 13:22:16.841] [E/11] [info] [Task Finished] Transform to mem in 0.280544s (11020 normal rows, 42976 exceptions)
[2021-03-25 13:22:17.113] [E/4] [info] [Task Finished] Transform to mem in 0.278663s (11036 normal rows, 42710 exceptions)
[2021-03-25 13:22:17.115] [E/15] [info] [Task Finished] Transform to mem in 0.279332s (11087 normal rows, 42938 exceptions)
[2021-03-25 13:22:17.115] [E/5] [info] [Task Finished] Transform to mem in 0.278843s (11052 normal rows, 42881 exceptions)
[2021-03-25 13:22:17.115] [E/8] [info] [Task Finished] Transform to mem in 0.279986s (11125 normal rows, 43517 exceptions)
[2021-03-25 13:22:17.116] [E/12] [info] [Task Finished] Transform to mem in 0.279987s (11098 normal rows, 43115 exceptions)
[2021-03-25 13:22:17.116] [E/10] [info] [Task Finished] Transform to mem in 0.279598s (11000 normal rows, 42999 exceptions)
[2021-03-25 13:22:17.116] [E/3] [info] [Task Finished] Transform to mem in 0.280030s (10985 normal rows, 43336 exceptions)
[2021-03-25 13:22:17.116] [E/7] [info] [Task Finished] Transform to mem in 0.279679s (10995 normal rows, 42708 exceptions)
[2021-03-25 13:22:17.117] [E/6] [info] [Task Finished] Transform to mem in 0.280050s (11020 normal rows, 43057 exceptions)
[2021-03-25 13:22:17.118] [E/1] [info] [Task Finished] Transform to mem in 0.280139s (11166 normal rows, 43520 exceptions)
[2021-03-25 13:22:17.118] [E/9] [info] [Task Finished] Transform to mem in 0.279599s (11098 normal rows, 43075 exceptions)
[2021-03-25 13:22:17.119] [E/2] [info] [Task Finished] Transform to mem in 0.280069s (11073 normal rows, 42970 exceptions)
[2021-03-25 13:22:17.120] [E/13] [info] [Task Finished] Transform to mem in 0.279848s (11000 normal rows, 43009 exceptions)
[2021-03-25 13:22:17.121] [E/14] [info] [Task Finished] Transform to mem in 0.281418s (10999 normal rows, 43334 exceptions)
[2021-03-25 13:22:17.121] [driver] [info] [Task Finished] Transform to mem in 0.280066s (11052 normal rows, 42764 exceptions)
[2021-03-25 13:22:17.123] [E/11] [info] [Task Finished] Transform to mem in 0.282033s (11020 normal rows, 43138 exceptions)
[2021-03-25 13:22:17.393] [E/4] [info] [Task Finished] Transform to mem in 0.279530s (10995 normal rows, 42726 exceptions)
[2021-03-25 13:22:17.395] [E/8] [info] [Task Finished] Transform to mem in 0.279757s (11080 normal rows, 43031 exceptions)
[2021-03-25 13:22:17.395] [E/5] [info] [Task Finished] Transform to mem in 0.279983s (11091 normal rows, 43047 exceptions)
[2021-03-25 13:22:17.395] [E/15] [info] [Task Finished] Transform to mem in 0.280119s (11166 normal rows, 43508 exceptions)
[2021-03-25 13:22:17.395] [E/7] [info] [Task Finished] Transform to mem in 0.278948s (11016 normal rows, 43165 exceptions)
[2021-03-25 13:22:17.396] [E/3] [info] [Task Finished] Transform to mem in 0.279602s (11036 normal rows, 42720 exceptions)
[2021-03-25 13:22:17.396] [E/12] [info] [Task Finished] Transform to mem in 0.280123s (10999 normal rows, 43300 exceptions)
[2021-03-25 13:22:17.396] [E/10] [info] [Task Finished] Transform to mem in 0.280345s (11000 normal rows, 43043 exceptions)
[2021-03-25 13:22:17.396] [E/6] [info] [Task Finished] Transform to mem in 0.279361s (10995 normal rows, 42718 exceptions)
[2021-03-25 13:22:17.398] [E/9] [info] [Task Finished] Transform to mem in 0.279805s (11001 normal rows, 43113 exceptions)
[2021-03-25 13:22:17.398] [E/1] [info] [Task Finished] Transform to mem in 0.280415s (11186 normal rows, 43465 exceptions)
[2021-03-25 13:22:17.399] [E/2] [info] [Task Finished] Transform to mem in 0.280425s (11170 normal rows, 43024 exceptions)
[2021-03-25 13:22:17.400] [E/13] [info] [Task Finished] Transform to mem in 0.280529s (10989 normal rows, 43282 exceptions)
[2021-03-25 13:22:17.402] [driver] [info] [Task Finished] Transform to mem in 0.280517s (11002 normal rows, 42755 exceptions)
[2021-03-25 13:22:17.402] [E/14] [info] [Task Finished] Transform to mem in 0.280827s (11010 normal rows, 43002 exceptions)
[2021-03-25 13:22:17.405] [E/11] [info] [Task Finished] Transform to mem in 0.282204s (11050 normal rows, 43199 exceptions)
[2021-03-25 13:22:17.673] [E/4] [info] [Task Finished] Transform to mem in 0.280272s (10973 normal rows, 42686 exceptions)
[2021-03-25 13:22:17.676] [E/8] [info] [Task Finished] Transform to mem in 0.280912s (11160 normal rows, 43455 exceptions)
[2021-03-25 13:22:17.676] [E/3] [info] [Task Finished] Transform to mem in 0.280210s (11005 normal rows, 42971 exceptions)
[2021-03-25 13:22:17.676] [E/15] [info] [Task Finished] Transform to mem in 0.280830s (11166 normal rows, 43023 exceptions)
[2021-03-25 13:22:17.676] [E/5] [info] [Task Finished] Transform to mem in 0.280982s (11045 normal rows, 43148 exceptions)
[2021-03-25 13:22:17.676] [E/6] [info] [Task Finished] Transform to mem in 0.280284s (10973 normal rows, 42686 exceptions)
[2021-03-25 13:22:17.677] [E/12] [info] [Task Finished] Transform to mem in 0.280778s (11007 normal rows, 42795 exceptions)
[2021-03-25 13:22:17.677] [E/7] [info] [Task Finished] Transform to mem in 0.281293s (10997 normal rows, 43283 exceptions)
[2021-03-25 13:22:17.677] [E/10] [info] [Task Finished] Transform to mem in 0.281077s (11050 normal rows, 43196 exceptions)
[2021-03-25 13:22:17.679] [E/1] [info] [Task Finished] Transform to mem in 0.280528s (11043 normal rows, 43153 exceptions)
[2021-03-25 13:22:17.679] [E/9] [info] [Task Finished] Transform to mem in 0.281235s (11160 normal rows, 43446 exceptions)
[2021-03-25 13:22:17.680] [E/2] [info] [Task Finished] Transform to mem in 0.281128s (11168 normal rows, 43028 exceptions)
[2021-03-25 13:22:17.681] [E/13] [info] [Task Finished] Transform to mem in 0.281153s (10997 normal rows, 43277 exceptions)
[2021-03-25 13:22:17.683] [E/14] [info] [Task Finished] Transform to mem in 0.280923s (11015 normal rows, 42799 exceptions)
[2021-03-25 13:22:17.683] [driver] [info] [Task Finished] Transform to mem in 0.281150s (10997 normal rows, 42973 exceptions)
[2021-03-25 13:22:17.688] [E/11] [info] [Task Finished] Transform to mem in 0.282201s (11050 normal rows, 43170 exceptions)
[2021-03-25 13:22:17.954] [E/4] [info] [Task Finished] Transform to mem in 0.280613s (10973 normal rows, 42710 exceptions)
[2021-03-25 13:22:17.956] [E/3] [info] [Task Finished] Transform to mem in 0.280100s (11043 normal rows, 43166 exceptions)
[2021-03-25 13:22:17.956] [E/5] [info] [Task Finished] Transform to mem in 0.280377s (10997 normal rows, 43237 exceptions)
[2021-03-25 13:22:17.956] [E/15] [info] [Task Finished] Transform to mem in 0.280470s (11168 normal rows, 43027 exceptions)
[2021-03-25 13:22:17.957] [E/8] [info] [Task Finished] Transform to mem in 0.280602s (11160 normal rows, 43431 exceptions)
[2021-03-25 13:22:17.957] [E/12] [info] [Task Finished] Transform to mem in 0.280171s (11009 normal rows, 42805 exceptions)
[2021-03-25 13:22:17.957] [E/6] [info] [Task Finished] Transform to mem in 0.280846s (10997 normal rows, 43012 exceptions)
[2021-03-25 13:22:17.957] [E/7] [info] [Task Finished] Transform to mem in 0.280661s (11021 normal rows, 43160 exceptions)
[2021-03-25 13:22:17.958] [E/10] [info] [Task Finished] Transform to mem in 0.280405s (11003 normal rows, 42716 exceptions)
[2021-03-25 13:22:17.959] [E/1] [info] [Task Finished] Transform to mem in 0.279947s (11165 normal rows, 43354 exceptions)
[2021-03-25 13:22:17.959] [E/9] [info] [Task Finished] Transform to mem in 0.280230s (11043 normal rows, 43217 exceptions)
[2021-03-25 13:22:17.961] [E/2] [info] [Task Finished] Transform to mem in 0.280470s (11156 normal rows, 43044 exceptions)
[2021-03-25 13:22:17.963] [E/13] [info] [Task Finished] Transform to mem in 0.281346s (11009 normal rows, 43187 exceptions)
[2021-03-25 13:22:17.963] [driver] [info] [Task Finished] Transform to mem in 0.280623s (11009 normal rows, 42811 exceptions)
[2021-03-25 13:22:17.964] [E/14] [info] [Task Finished] Transform to mem in 0.281106s (10997 normal rows, 43067 exceptions)
[2021-03-25 13:22:17.969] [E/11] [info] [Task Finished] Transform to mem in 0.281556s (11021 normal rows, 43162 exceptions)
[2021-03-25 13:22:18.234] [E/4] [info] [Task Finished] Transform to mem in 0.280403s (11003 normal rows, 42716 exceptions)
[2021-03-25 13:22:18.236] [E/3] [info] [Task Finished] Transform to mem in 0.280393s (11165 normal rows, 43260 exceptions)
[2021-03-25 13:22:18.237] [E/8] [info] [Task Finished] Transform to mem in 0.280488s (10997 normal rows, 43177 exceptions)
[2021-03-25 13:22:18.237] [E/15] [info] [Task Finished] Transform to mem in 0.280650s (11172 normal rows, 43107 exceptions)
[2021-03-25 13:22:18.238] [E/5] [info] [Task Finished] Transform to mem in 0.281007s (11027 normal rows, 43245 exceptions)
[2021-03-25 13:22:18.238] [E/6] [info] [Task Finished] Transform to mem in 0.280348s (10999 normal rows, 42828 exceptions)
[2021-03-25 13:22:18.238] [E/10] [info] [Task Finished] Transform to mem in 0.280070s (11000 normal rows, 42726 exceptions)
[2021-03-25 13:22:18.238] [E/12] [info] [Task Finished] Transform to mem in 0.281481s (11009 normal rows, 43050 exceptions)
[2021-03-25 13:22:18.239] [E/7] [info] [Task Finished] Transform to mem in 0.281265s (11031 normal rows, 43157 exceptions)
[2021-03-25 13:22:18.239] [E/1] [info] [Task Finished] Transform to mem in 0.280471s (11091 normal rows, 43230 exceptions)
[2021-03-25 13:22:18.240] [E/9] [info] [Task Finished] Transform to mem in 0.280640s (11099 normal rows, 43272 exceptions)
[2021-03-25 13:22:18.242] [E/2] [info] [Task Finished] Transform to mem in 0.281065s (11177 normal rows, 43113 exceptions)
[2021-03-25 13:22:18.244] [E/13] [info] [Task Finished] Transform to mem in 0.281495s (10997 normal rows, 43174 exceptions)
[2021-03-25 13:22:18.245] [driver] [info] [Task Finished] Transform to mem in 0.281896s (10987 normal rows, 43020 exceptions)
[2021-03-25 13:22:18.245] [E/14] [info] [Task Finished] Transform to mem in 0.281470s (11020 normal rows, 42867 exceptions)
[2021-03-25 13:22:18.284] [E/11] [info] [Task Finished] Transform to mem in 0.315295s (12330 normal rows, 48094 exceptions)
[2021-03-25 13:22:18.285] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.85133s
[2021-03-25 13:22:18.285] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.9344s, 56350770 input rows, time to process 1 row via fast path: 0.000797405ms
[2021-03-25 13:22:18.285] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 13:22:18.289] [local ee] [info] compiled pure python pipeline in 0.004321s
[2021-03-25 13:22:18.289] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 13:22:18.290] [local ee] [info] Created 160 resolve tasks in 0.001211s
[2021-03-25 13:22:18.290] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 13:22:18.306] [E/12] [info] [Task Finished] Resolve in 0.015453s
[2021-03-25 13:22:18.306] [driver] [info] [Task Finished] Resolve in 0.015468s
[2021-03-25 13:22:18.306] [E/2] [info] [Task Finished] Resolve in 0.015541s
[2021-03-25 13:22:18.306] [E/1] [info] [Task Finished] Resolve in 0.015546s
[2021-03-25 13:22:18.306] [E/4] [info] [Task Finished] Resolve in 0.015587s
[2021-03-25 13:22:18.306] [E/9] [info] [Task Finished] Resolve in 0.015595s
[2021-03-25 13:22:18.306] [E/13] [info] [Task Finished] Resolve in 0.015566s
[2021-03-25 13:22:18.306] [E/7] [info] [Task Finished] Resolve in 0.015624s
[2021-03-25 13:22:18.306] [E/6] [info] [Task Finished] Resolve in 0.015636s
[2021-03-25 13:22:18.306] [E/3] [info] [Task Finished] Resolve in 0.015588s
[2021-03-25 13:22:18.306] [E/8] [info] [Task Finished] Resolve in 0.015661s
[2021-03-25 13:22:18.306] [E/10] [info] [Task Finished] Resolve in 0.015715s
[2021-03-25 13:22:18.306] [E/14] [info] [Task Finished] Resolve in 0.015711s
[2021-03-25 13:22:18.306] [E/5] [info] [Task Finished] Resolve in 0.015716s
[2021-03-25 13:22:18.306] [E/15] [info] [Task Finished] Resolve in 0.015761s
[2021-03-25 13:22:18.306] [E/11] [info] [Task Finished] Resolve in 0.015710s
[2021-03-25 13:22:18.321] [E/12] [info] [Task Finished] Resolve in 0.015656s
[2021-03-25 13:22:18.321] [driver] [info] [Task Finished] Resolve in 0.015690s
[2021-03-25 13:22:18.322] [E/13] [info] [Task Finished] Resolve in 0.015637s
[2021-03-25 13:22:18.322] [E/1] [info] [Task Finished] Resolve in 0.015694s
[2021-03-25 13:22:18.322] [E/7] [info] [Task Finished] Resolve in 0.015667s
[2021-03-25 13:22:18.322] [E/4] [info] [Task Finished] Resolve in 0.015711s
[2021-03-25 13:22:18.322] [E/6] [info] [Task Finished] Resolve in 0.015705s
[2021-03-25 13:22:18.322] [E/2] [info] [Task Finished] Resolve in 0.015817s
[2021-03-25 13:22:18.322] [E/3] [info] [Task Finished] Resolve in 0.015741s
[2021-03-25 13:22:18.322] [E/11] [info] [Task Finished] Resolve in 0.015616s
[2021-03-25 13:22:18.322] [E/8] [info] [Task Finished] Resolve in 0.015719s
[2021-03-25 13:22:18.322] [E/10] [info] [Task Finished] Resolve in 0.015693s
[2021-03-25 13:22:18.322] [E/5] [info] [Task Finished] Resolve in 0.015697s
[2021-03-25 13:22:18.322] [E/9] [info] [Task Finished] Resolve in 0.015911s
[2021-03-25 13:22:18.322] [E/15] [info] [Task Finished] Resolve in 0.015742s
[2021-03-25 13:22:18.322] [E/14] [info] [Task Finished] Resolve in 0.015822s
[2021-03-25 13:22:18.337] [E/12] [info] [Task Finished] Resolve in 0.015465s
[2021-03-25 13:22:18.337] [driver] [info] [Task Finished] Resolve in 0.015500s
[2021-03-25 13:22:18.337] [E/13] [info] [Task Finished] Resolve in 0.015486s
[2021-03-25 13:22:18.337] [E/1] [info] [Task Finished] Resolve in 0.015507s
[2021-03-25 13:22:18.337] [E/3] [info] [Task Finished] Resolve in 0.015472s
[2021-03-25 13:22:18.337] [E/6] [info] [Task Finished] Resolve in 0.015565s
[2021-03-25 13:22:18.337] [E/2] [info] [Task Finished] Resolve in 0.015575s
[2021-03-25 13:22:18.337] [E/7] [info] [Task Finished] Resolve in 0.015644s
[2021-03-25 13:22:18.337] [E/10] [info] [Task Finished] Resolve in 0.015618s
[2021-03-25 13:22:18.337] [E/11] [info] [Task Finished] Resolve in 0.015673s
[2021-03-25 13:22:18.337] [E/9] [info] [Task Finished] Resolve in 0.015611s
[2021-03-25 13:22:18.337] [E/5] [info] [Task Finished] Resolve in 0.015698s
[2021-03-25 13:22:18.337] [E/4] [info] [Task Finished] Resolve in 0.015863s
[2021-03-25 13:22:18.338] [E/15] [info] [Task Finished] Resolve in 0.015677s
[2021-03-25 13:22:18.338] [E/14] [info] [Task Finished] Resolve in 0.015651s
[2021-03-25 13:22:18.338] [E/8] [info] [Task Finished] Resolve in 0.015851s
[2021-03-25 13:22:18.352] [E/12] [info] [Task Finished] Resolve in 0.015554s
[2021-03-25 13:22:18.353] [E/13] [info] [Task Finished] Resolve in 0.015602s
[2021-03-25 13:22:18.353] [E/1] [info] [Task Finished] Resolve in 0.015620s
[2021-03-25 13:22:18.353] [E/3] [info] [Task Finished] Resolve in 0.015551s
[2021-03-25 13:22:18.353] [driver] [info] [Task Finished] Resolve in 0.015832s
[2021-03-25 13:22:18.353] [E/2] [info] [Task Finished] Resolve in 0.015613s
[2021-03-25 13:22:18.353] [E/7] [info] [Task Finished] Resolve in 0.015631s
[2021-03-25 13:22:18.353] [E/6] [info] [Task Finished] Resolve in 0.015679s
[2021-03-25 13:22:18.353] [E/10] [info] [Task Finished] Resolve in 0.015594s
[2021-03-25 13:22:18.353] [E/8] [info] [Task Finished] Resolve in 0.015432s
[2021-03-25 13:22:18.353] [E/4] [info] [Task Finished] Resolve in 0.015543s
[2021-03-25 13:22:18.353] [E/9] [info] [Task Finished] Resolve in 0.015637s
[2021-03-25 13:22:18.353] [E/14] [info] [Task Finished] Resolve in 0.015574s
[2021-03-25 13:22:18.353] [E/5] [info] [Task Finished] Resolve in 0.015630s
[2021-03-25 13:22:18.353] [E/15] [info] [Task Finished] Resolve in 0.015587s
[2021-03-25 13:22:18.353] [E/11] [info] [Task Finished] Resolve in 0.015858s
[2021-03-25 13:22:18.368] [E/12] [info] [Task Finished] Resolve in 0.015590s
[2021-03-25 13:22:18.368] [E/13] [info] [Task Finished] Resolve in 0.015670s
[2021-03-25 13:22:18.368] [E/3] [info] [Task Finished] Resolve in 0.015674s
[2021-03-25 13:22:18.368] [driver] [info] [Task Finished] Resolve in 0.015600s
[2021-03-25 13:22:18.369] [E/6] [info] [Task Finished] Resolve in 0.015599s
[2021-03-25 13:22:18.369] [E/1] [info] [Task Finished] Resolve in 0.015888s
[2021-03-25 13:22:18.369] [E/10] [info] [Task Finished] Resolve in 0.015614s
[2021-03-25 13:22:18.369] [E/2] [info] [Task Finished] Resolve in 0.015742s
[2021-03-25 13:22:18.369] [E/7] [info] [Task Finished] Resolve in 0.015740s
[2021-03-25 13:22:18.369] [E/4] [info] [Task Finished] Resolve in 0.015606s
[2021-03-25 13:22:18.369] [E/9] [info] [Task Finished] Resolve in 0.015741s
[2021-03-25 13:22:18.369] [E/14] [info] [Task Finished] Resolve in 0.015711s
[2021-03-25 13:22:18.369] [E/5] [info] [Task Finished] Resolve in 0.015688s
[2021-03-25 13:22:18.369] [E/15] [info] [Task Finished] Resolve in 0.015678s
[2021-03-25 13:22:18.369] [E/8] [info] [Task Finished] Resolve in 0.015904s
[2021-03-25 13:22:18.369] [E/11] [info] [Task Finished] Resolve in 0.015719s
[2021-03-25 13:22:18.383] [E/12] [info] [Task Finished] Resolve in 0.015332s
[2021-03-25 13:22:18.384] [E/13] [info] [Task Finished] Resolve in 0.015464s
[2021-03-25 13:22:18.384] [E/3] [info] [Task Finished] Resolve in 0.015515s
[2021-03-25 13:22:18.384] [E/6] [info] [Task Finished] Resolve in 0.015442s
[2021-03-25 13:22:18.384] [E/1] [info] [Task Finished] Resolve in 0.015436s
[2021-03-25 13:22:18.384] [driver] [info] [Task Finished] Resolve in 0.015698s
[2021-03-25 13:22:18.384] [E/2] [info] [Task Finished] Resolve in 0.015534s
[2021-03-25 13:22:18.384] [E/10] [info] [Task Finished] Resolve in 0.015599s
[2021-03-25 13:22:18.384] [E/7] [info] [Task Finished] Resolve in 0.015563s
[2021-03-25 13:22:18.384] [E/14] [info] [Task Finished] Resolve in 0.015455s
[2021-03-25 13:22:18.384] [E/9] [info] [Task Finished] Resolve in 0.015504s
[2021-03-25 13:22:18.384] [E/8] [info] [Task Finished] Resolve in 0.015387s
[2021-03-25 13:22:18.384] [E/5] [info] [Task Finished] Resolve in 0.015497s
[2021-03-25 13:22:18.384] [E/15] [info] [Task Finished] Resolve in 0.015550s
[2021-03-25 13:22:18.384] [E/4] [info] [Task Finished] Resolve in 0.015788s
[2021-03-25 13:22:18.385] [E/11] [info] [Task Finished] Resolve in 0.015646s
[2021-03-25 13:22:18.399] [E/12] [info] [Task Finished] Resolve in 0.015548s
[2021-03-25 13:22:18.399] [E/13] [info] [Task Finished] Resolve in 0.015647s
[2021-03-25 13:22:18.400] [E/3] [info] [Task Finished] Resolve in 0.015722s
[2021-03-25 13:22:18.400] [driver] [info] [Task Finished] Resolve in 0.015548s
[2021-03-25 13:22:18.400] [E/1] [info] [Task Finished] Resolve in 0.015696s
[2021-03-25 13:22:18.400] [E/7] [info] [Task Finished] Resolve in 0.015570s
[2021-03-25 13:22:18.400] [E/10] [info] [Task Finished] Resolve in 0.015636s
[2021-03-25 13:22:18.400] [E/6] [info] [Task Finished] Resolve in 0.015927s
[2021-03-25 13:22:18.400] [E/14] [info] [Task Finished] Resolve in 0.015653s
[2021-03-25 13:22:18.400] [E/2] [info] [Task Finished] Resolve in 0.015816s
[2021-03-25 13:22:18.400] [E/15] [info] [Task Finished] Resolve in 0.015575s
[2021-03-25 13:22:18.400] [E/8] [info] [Task Finished] Resolve in 0.015711s
[2021-03-25 13:22:18.400] [E/4] [info] [Task Finished] Resolve in 0.015621s
[2021-03-25 13:22:18.400] [E/5] [info] [Task Finished] Resolve in 0.015748s
[2021-03-25 13:22:18.400] [E/9] [info] [Task Finished] Resolve in 0.016021s
[2021-03-25 13:22:18.401] [E/11] [info] [Task Finished] Resolve in 0.015864s
[2021-03-25 13:22:18.414] [E/12] [info] [Task Finished] Resolve in 0.015318s
[2021-03-25 13:22:18.415] [E/3] [info] [Task Finished] Resolve in 0.015403s
[2021-03-25 13:22:18.415] [E/13] [info] [Task Finished] Resolve in 0.015692s
[2021-03-25 13:22:18.415] [E/7] [info] [Task Finished] Resolve in 0.015357s
[2021-03-25 13:22:18.415] [E/1] [info] [Task Finished] Resolve in 0.015457s
[2021-03-25 13:22:18.415] [driver] [info] [Task Finished] Resolve in 0.015535s
[2021-03-25 13:22:18.415] [E/10] [info] [Task Finished] Resolve in 0.015386s
[2021-03-25 13:22:18.415] [E/6] [info] [Task Finished] Resolve in 0.015488s
[2021-03-25 13:22:18.416] [E/14] [info] [Task Finished] Resolve in 0.015580s
[2021-03-25 13:22:18.416] [E/2] [info] [Task Finished] Resolve in 0.015551s
[2021-03-25 13:22:18.416] [E/5] [info] [Task Finished] Resolve in 0.015435s
[2021-03-25 13:22:18.416] [E/4] [info] [Task Finished] Resolve in 0.015502s
[2021-03-25 13:22:18.416] [E/8] [info] [Task Finished] Resolve in 0.015524s
[2021-03-25 13:22:18.416] [E/15] [info] [Task Finished] Resolve in 0.015707s
[2021-03-25 13:22:18.416] [E/9] [info] [Task Finished] Resolve in 0.015515s
[2021-03-25 13:22:18.416] [E/11] [info] [Task Finished] Resolve in 0.015690s
[2021-03-25 13:22:18.430] [E/12] [info] [Task Finished] Resolve in 0.015508s
[2021-03-25 13:22:18.431] [E/3] [info] [Task Finished] Resolve in 0.015658s
[2021-03-25 13:22:18.431] [E/10] [info] [Task Finished] Resolve in 0.015581s
[2021-03-25 13:22:18.431] [driver] [info] [Task Finished] Resolve in 0.015598s
[2021-03-25 13:22:18.431] [E/7] [info] [Task Finished] Resolve in 0.015700s
[2021-03-25 13:22:18.431] [E/13] [info] [Task Finished] Resolve in 0.015745s
[2021-03-25 13:22:18.431] [E/6] [info] [Task Finished] Resolve in 0.015712s
[2021-03-25 13:22:18.431] [E/14] [info] [Task Finished] Resolve in 0.015600s
[2021-03-25 13:22:18.431] [E/1] [info] [Task Finished] Resolve in 0.015926s
[2021-03-25 13:22:18.431] [E/15] [info] [Task Finished] Resolve in 0.015563s
[2021-03-25 13:22:18.431] [E/8] [info] [Task Finished] Resolve in 0.015673s
[2021-03-25 13:22:18.431] [E/4] [info] [Task Finished] Resolve in 0.015744s
[2021-03-25 13:22:18.431] [E/5] [info] [Task Finished] Resolve in 0.015784s
[2021-03-25 13:22:18.432] [E/2] [info] [Task Finished] Resolve in 0.015964s
[2021-03-25 13:22:18.432] [E/9] [info] [Task Finished] Resolve in 0.015733s
[2021-03-25 13:22:18.432] [E/11] [info] [Task Finished] Resolve in 0.015862s
[2021-03-25 13:22:18.445] [E/12] [info] [Task Finished] Resolve in 0.015335s
[2021-03-25 13:22:18.446] [driver] [info] [Task Finished] Resolve in 0.015446s
[2021-03-25 13:22:18.446] [E/10] [info] [Task Finished] Resolve in 0.015510s
[2021-03-25 13:22:18.446] [E/3] [info] [Task Finished] Resolve in 0.015632s
[2021-03-25 13:22:18.446] [E/7] [info] [Task Finished] Resolve in 0.015479s
[2021-03-25 13:22:18.446] [E/13] [info] [Task Finished] Resolve in 0.015434s
[2021-03-25 13:22:18.447] [E/6] [info] [Task Finished] Resolve in 0.015367s
[2021-03-25 13:22:18.447] [E/14] [info] [Task Finished] Resolve in 0.015479s
[2021-03-25 13:22:18.447] [E/1] [info] [Task Finished] Resolve in 0.015471s
[2021-03-25 13:22:18.447] [E/8] [info] [Task Finished] Resolve in 0.015558s
[2021-03-25 13:22:18.447] [E/15] [info] [Task Finished] Resolve in 0.015650s
[2021-03-25 13:22:18.447] [E/5] [info] [Task Finished] Resolve in 0.015596s
[2021-03-25 13:22:18.447] [E/4] [info] [Task Finished] Resolve in 0.015614s
[2021-03-25 13:22:18.447] [E/2] [info] [Task Finished] Resolve in 0.015482s
[2021-03-25 13:22:18.447] [E/9] [info] [Task Finished] Resolve in 0.015568s
[2021-03-25 13:22:18.450] [E/11] [info] [Task Finished] Resolve in 0.017608s
[2021-03-25 13:22:18.450] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.165291s
[2021-03-25 13:22:18.450] [local ee] [info] slow path for Stage 0: total wall clock time: 2.50178s, time to process 1 row via slow path: 0.000362792ms
[2021-03-25 13:22:18.450] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.16532s

[2021-03-25 13:22:18.489] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 13:22:18.517] [E/11] [info] [Task Finished] write to file in 0.028500s (102395 rows, 15.59 MB)
[2021-03-25 13:22:18.520] [E/13] [info] [Task Finished] write to file in 0.030961s (112421 rows, 17.11 MB)
[2021-03-25 13:22:18.520] [E/10] [info] [Task Finished] write to file in 0.031162s (112425 rows, 17.11 MB)
[2021-03-25 13:22:18.522] [E/4] [info] [Task Finished] write to file in 0.033416s (123474 rows, 18.80 MB)
[2021-03-25 13:22:18.522] [E/6] [info] [Task Finished] write to file in 0.033629s (123704 rows, 18.83 MB)
[2021-03-25 13:22:18.523] [E/2] [info] [Task Finished] write to file in 0.033685s (123752 rows, 18.84 MB)
[2021-03-25 13:22:18.523] [E/5] [info] [Task Finished] write to file in 0.033996s (123479 rows, 18.80 MB)
[2021-03-25 13:22:18.523] [driver] [info] [Task Finished] write to file in 0.034194s (123598 rows, 18.82 MB)
[2021-03-25 13:22:18.523] [E/12] [info] [Task Finished] write to file in 0.034241s (123413 rows, 18.79 MB)
[2021-03-25 13:22:18.523] [E/7] [info] [Task Finished] write to file in 0.034257s (123458 rows, 18.80 MB)
[2021-03-25 13:22:18.523] [E/9] [info] [Task Finished] write to file in 0.034298s (123508 rows, 18.80 MB)
[2021-03-25 13:22:18.523] [E/3] [info] [Task Finished] write to file in 0.034302s (123570 rows, 18.81 MB)
[2021-03-25 13:22:18.523] [E/14] [info] [Task Finished] write to file in 0.034427s (123474 rows, 18.80 MB)
[2021-03-25 13:22:18.523] [E/8] [info] [Task Finished] write to file in 0.034610s (123409 rows, 18.79 MB)
[2021-03-25 13:22:18.526] [E/1] [info] [Task Finished] write to file in 0.036677s (112411 rows, 17.11 MB)
[2021-03-25 13:22:18.526] [global] [info] writing output took 0.075642s
[2021-03-25 13:22:18.526] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0757273s
[2021-03-25 13:22:18.526] [global] [info] [Transform Stage] Stage 0 took 3.59576s
[2021-03-25 13:22:18.526] [global] [info] Query Execution took 3.67576s. (planning: 0.0799641s, execution: 3.5958s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.006060123443603516
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 3.9606876373291016 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'True', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0226196,"llvm_optimization_time_s":0.332979,"llvm_compilation_time_s":0.152774,"total_compilation_time_s":0.503347,"sampling_time_s":0.111665,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.9344,"fast_path_time_s":2.85135,"fast_path_per_row_time_ns":797.405,"slow_path_wall_time_s":2.50178,"slow_path_time_s":0.165291,"slow_path_per_row_time_ns":362.792}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": true, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.006060123443603516, "jobTime": 3.9606876373291016, "mode": "resolve", "mergeExceptionsInOrder": true}
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.551] [local execution engine] [info] Stopped local executor E/1
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.558] [local execution engine] [info] Stopped local executor E/2
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.565] [local execution engine] [info] Stopped local executor E/3
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.572] [local execution engine] [info] Stopped local executor E/4
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.579] [local execution engine] [info] Stopped local executor E/5
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.587] [local execution engine] [info] Stopped local executor E/6
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.594] [local execution engine] [info] Stopped local executor E/7
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.601] [local execution engine] [info] Stopped local executor E/8
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.608] [local execution engine] [info] Stopped local executor E/9
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.615] [local execution engine] [info] Stopped local executor E/10
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.622] [local execution engine] [info] Stopped local executor E/11
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.629] [local execution engine] [info] Stopped local executor E/12
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.636] [local execution engine] [info] Stopped local executor E/13
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.643] [local execution engine] [info] Stopped local executor E/14
[GLOBAL] releasing 20 active partitions
[2021-03-25 13:22:18.650] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 21 active partitions
