[2021-03-25 10:31:59.251] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:31:59.251] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:31:59.251] [local ee] [info] initializing LLVM backend
[2021-03-25 10:31:59.251] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:31:59.251] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.252] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.252] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.252] [E/1] [info] starting detached process queue
[2021-03-25 10:31:59.252] [E/2] [info] starting detached process queue
[2021-03-25 10:31:59.252] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.252] [E/3] [info] starting detached process queue
[2021-03-25 10:31:59.252] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.252] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.252] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.252] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.252] [E/4] [info] starting detached process queue
[2021-03-25 10:31:59.252] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.252] [E/5] [info] starting detached process queue
[2021-03-25 10:31:59.252] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.252] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.252] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.252] [E/6] [info] starting detached process queue
[2021-03-25 10:31:59.253] [E/7] [info] starting detached process queue
[2021-03-25 10:31:59.253] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.252] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.253] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.253] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.253] [E/8] [info] starting detached process queue
[2021-03-25 10:31:59.253] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.253] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.253] [E/9] [info] starting detached process queue
[2021-03-25 10:31:59.253] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.253] [E/10] [info] starting detached process queue
[2021-03-25 10:31:59.253] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.253] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.253] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.253] [E/11] [info] starting detached process queue
[2021-03-25 10:31:59.253] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.253] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.253] [E/12] [info] starting detached process queue
[2021-03-25 10:31:59.253] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.253] [E/13] [info] starting detached process queue
[2021-03-25 10:31:59.253] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.253] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.253] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.253] [E/14] [info] starting detached process queue
[2021-03-25 10:31:59.253] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:31:59.253] [E/15] [info] starting detached process queue
[2021-03-25 10:31:59.253] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.253] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 10:31:59.253] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:31:59.253] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:31:59.253] [fileinputoperator] [info] found 1 file (10.61 GB) to process.
[2021-03-25 10:31:59.253] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty_synthetic@10G.csv on 256.00 KB
[2021-03-25 10:31:59.389] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:31:59.395] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:31:59.411] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:31:59.419] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:31:59.446] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:31:59.467] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:31:59.481] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:31:59.514] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:31:59.520] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:31:59.536] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:31:59.538] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:31:59.539] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:31:59.539] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:31:59.541] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:31:59.542] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:31:59.543] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:31:59.544] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:31:59.545] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:31:59.546] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:31:59.562] [logical planner] [info] logical optimization took 0.022655ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:31:59.562] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:31:59.563] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:31:59.564] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:31:59.564] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:31:59.565] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:31:59.566] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:31:59.566] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:31:59.567] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:31:59.568] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:31:59.569] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:31:59.570] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:31:59.571] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:31:59.572] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:31:59.572] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:31:59.574] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:31:59.575] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:31:59.575] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:31:59.576] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:31:59.576] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:31:59.577] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:31:59.578] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:31:59.578] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:31:59.579] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:31:59.580] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:31:59.581] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:31:59.582] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:31:59.583] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:31:59.583] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:31:59.584] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:31:59.616] [global] [info] Stage0 depends on: 
[2021-03-25 10:31:59.966] [global] [info] Optimization via LLVM passes took 0.332758 ms
[2021-03-25 10:32:00.119] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:32:00.119] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.502863s
[2021-03-25 10:32:00.119] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty_synthetic@10G.csv into 169 tasks
[2021-03-25 10:32:00.382] [E/10] [info] [Task Finished] Transform to mem in 0.262985s (10531 normal rows, 82507 exceptions)
[2021-03-25 10:32:00.382] [E/14] [info] [Task Finished] Transform to mem in 0.263214s (10359 normal rows, 82920 exceptions)
[2021-03-25 10:32:00.382] [E/3] [info] [Task Finished] Transform to mem in 0.263287s (10406 normal rows, 82712 exceptions)
[2021-03-25 10:32:00.383] [E/7] [info] [Task Finished] Transform to mem in 0.263344s (10378 normal rows, 82714 exceptions)
[2021-03-25 10:32:00.383] [E/2] [info] [Task Finished] Transform to mem in 0.263429s (10386 normal rows, 82651 exceptions)
[2021-03-25 10:32:00.383] [driver] [info] [Task Finished] Transform to mem in 0.263529s (10215 normal rows, 82926 exceptions)
[2021-03-25 10:32:00.383] [E/9] [info] [Task Finished] Transform to mem in 0.263607s (10243 normal rows, 83069 exceptions)
[2021-03-25 10:32:00.383] [E/5] [info] [Task Finished] Transform to mem in 0.263625s (10252 normal rows, 83089 exceptions)
[2021-03-25 10:32:00.383] [E/6] [info] [Task Finished] Transform to mem in 0.263842s (10365 normal rows, 82838 exceptions)
[2021-03-25 10:32:00.383] [E/15] [info] [Task Finished] Transform to mem in 0.263920s (10396 normal rows, 83077 exceptions)
[2021-03-25 10:32:00.383] [E/11] [info] [Task Finished] Transform to mem in 0.264095s (10512 normal rows, 83014 exceptions)
[2021-03-25 10:32:00.384] [E/1] [info] [Task Finished] Transform to mem in 0.265028s (10532 normal rows, 83146 exceptions)
[2021-03-25 10:32:00.384] [E/12] [info] [Task Finished] Transform to mem in 0.265228s (10542 normal rows, 82535 exceptions)
[2021-03-25 10:32:00.385] [E/13] [info] [Task Finished] Transform to mem in 0.266147s (10505 normal rows, 82883 exceptions)
[2021-03-25 10:32:00.385] [E/4] [info] [Task Finished] Transform to mem in 0.266175s (10575 normal rows, 82724 exceptions)
[2021-03-25 10:32:00.386] [E/8] [info] [Task Finished] Transform to mem in 0.266374s (10514 normal rows, 82793 exceptions)
[2021-03-25 10:32:00.642] [E/10] [info] [Task Finished] Transform to mem in 0.259830s (10378 normal rows, 82790 exceptions)
[2021-03-25 10:32:00.642] [E/7] [info] [Task Finished] Transform to mem in 0.259596s (10288 normal rows, 83066 exceptions)
[2021-03-25 10:32:00.642] [E/3] [info] [Task Finished] Transform to mem in 0.259707s (10510 normal rows, 82547 exceptions)
[2021-03-25 10:32:00.643] [E/11] [info] [Task Finished] Transform to mem in 0.259581s (10311 normal rows, 82729 exceptions)
[2021-03-25 10:32:00.643] [E/2] [info] [Task Finished] Transform to mem in 0.260406s (10514 normal rows, 82719 exceptions)
[2021-03-25 10:32:00.643] [E/5] [info] [Task Finished] Transform to mem in 0.260325s (10510 normal rows, 82396 exceptions)
[2021-03-25 10:32:00.643] [driver] [info] [Task Finished] Transform to mem in 0.260499s (10388 normal rows, 82649 exceptions)
[2021-03-25 10:32:00.643] [E/14] [info] [Task Finished] Transform to mem in 0.260820s (10373 normal rows, 83047 exceptions)
[2021-03-25 10:32:00.644] [E/6] [info] [Task Finished] Transform to mem in 0.260636s (10288 normal rows, 83177 exceptions)
[2021-03-25 10:32:00.644] [E/15] [info] [Task Finished] Transform to mem in 0.260962s (10514 normal rows, 82639 exceptions)
[2021-03-25 10:32:00.644] [E/9] [info] [Task Finished] Transform to mem in 0.261467s (10373 normal rows, 83312 exceptions)
[2021-03-25 10:32:00.646] [E/12] [info] [Task Finished] Transform to mem in 0.261575s (10461 normal rows, 82531 exceptions)
[2021-03-25 10:32:00.646] [E/1] [info] [Task Finished] Transform to mem in 0.261809s (10450 normal rows, 83093 exceptions)
[2021-03-25 10:32:00.646] [E/8] [info] [Task Finished] Transform to mem in 0.260581s (10323 normal rows, 82590 exceptions)
[2021-03-25 10:32:00.647] [E/13] [info] [Task Finished] Transform to mem in 0.261604s (10317 normal rows, 83176 exceptions)
[2021-03-25 10:32:00.647] [E/4] [info] [Task Finished] Transform to mem in 0.261861s (10522 normal rows, 82584 exceptions)
[2021-03-25 10:32:00.902] [E/3] [info] [Task Finished] Transform to mem in 0.259968s (10317 normal rows, 83180 exceptions)
[2021-03-25 10:32:00.903] [E/11] [info] [Task Finished] Transform to mem in 0.259815s (10522 normal rows, 82568 exceptions)
[2021-03-25 10:32:00.903] [E/2] [info] [Task Finished] Transform to mem in 0.260004s (10304 normal rows, 82568 exceptions)
[2021-03-25 10:32:00.903] [E/7] [info] [Task Finished] Transform to mem in 0.261148s (10480 normal rows, 82481 exceptions)
[2021-03-25 10:32:00.904] [E/10] [info] [Task Finished] Transform to mem in 0.261646s (10431 normal rows, 83410 exceptions)
[2021-03-25 10:32:00.904] [E/14] [info] [Task Finished] Transform to mem in 0.260837s (10353 normal rows, 83264 exceptions)
[2021-03-25 10:32:00.904] [driver] [info] [Task Finished] Transform to mem in 0.260848s (10425 normal rows, 82382 exceptions)
[2021-03-25 10:32:00.905] [E/15] [info] [Task Finished] Transform to mem in 0.260449s (10303 normal rows, 82500 exceptions)
[2021-03-25 10:32:00.905] [E/5] [info] [Task Finished] Transform to mem in 0.261455s (10434 normal rows, 83448 exceptions)
[2021-03-25 10:32:00.906] [E/6] [info] [Task Finished] Transform to mem in 0.261920s (10536 normal rows, 82412 exceptions)
[2021-03-25 10:32:00.906] [E/9] [info] [Task Finished] Transform to mem in 0.261510s (10428 normal rows, 83672 exceptions)
[2021-03-25 10:32:00.906] [E/12] [info] [Task Finished] Transform to mem in 0.260430s (10421 normal rows, 82435 exceptions)
[2021-03-25 10:32:00.907] [E/1] [info] [Task Finished] Transform to mem in 0.261287s (10379 normal rows, 83209 exceptions)
[2021-03-25 10:32:00.909] [E/13] [info] [Task Finished] Transform to mem in 0.262212s (10295 normal rows, 82359 exceptions)
[2021-03-25 10:32:00.909] [E/8] [info] [Task Finished] Transform to mem in 0.263129s (10537 normal rows, 82448 exceptions)
[2021-03-25 10:32:00.910] [E/4] [info] [Task Finished] Transform to mem in 0.262620s (10441 normal rows, 83814 exceptions)
[2021-03-25 10:32:01.162] [E/3] [info] [Task Finished] Transform to mem in 0.260240s (10421 normal rows, 82390 exceptions)
[2021-03-25 10:32:01.164] [E/11] [info] [Task Finished] Transform to mem in 0.260895s (10366 normal rows, 83177 exceptions)
[2021-03-25 10:32:01.164] [E/2] [info] [Task Finished] Transform to mem in 0.260668s (10550 normal rows, 82536 exceptions)
[2021-03-25 10:32:01.164] [E/7] [info] [Task Finished] Transform to mem in 0.260525s (10285 normal rows, 82239 exceptions)
[2021-03-25 10:32:01.165] [driver] [info] [Task Finished] Transform to mem in 0.260364s (10387 normal rows, 83218 exceptions)
[2021-03-25 10:32:01.165] [E/14] [info] [Task Finished] Transform to mem in 0.260501s (10413 normal rows, 82527 exceptions)
[2021-03-25 10:32:01.165] [E/5] [info] [Task Finished] Transform to mem in 0.260709s (10207 normal rows, 82548 exceptions)
[2021-03-25 10:32:01.166] [E/10] [info] [Task Finished] Transform to mem in 0.262079s (10438 normal rows, 83705 exceptions)
[2021-03-25 10:32:01.166] [E/15] [info] [Task Finished] Transform to mem in 0.261372s (10550 normal rows, 82245 exceptions)
[2021-03-25 10:32:01.167] [E/9] [info] [Task Finished] Transform to mem in 0.260913s (10399 normal rows, 82487 exceptions)
[2021-03-25 10:32:01.168] [E/12] [info] [Task Finished] Transform to mem in 0.261451s (10372 normal rows, 82987 exceptions)
[2021-03-25 10:32:01.169] [E/6] [info] [Task Finished] Transform to mem in 0.262926s (10516 normal rows, 83753 exceptions)
[2021-03-25 10:32:01.169] [E/1] [info] [Task Finished] Transform to mem in 0.261508s (10541 normal rows, 82369 exceptions)
[2021-03-25 10:32:01.170] [E/13] [info] [Task Finished] Transform to mem in 0.261161s (10225 normal rows, 82594 exceptions)
[2021-03-25 10:32:01.171] [E/8] [info] [Task Finished] Transform to mem in 0.261598s (10536 normal rows, 83589 exceptions)
[2021-03-25 10:32:01.171] [E/4] [info] [Task Finished] Transform to mem in 0.261351s (10387 normal rows, 82745 exceptions)
[2021-03-25 10:32:01.423] [E/3] [info] [Task Finished] Transform to mem in 0.260514s (10384 normal rows, 82992 exceptions)
[2021-03-25 10:32:01.424] [E/2] [info] [Task Finished] Transform to mem in 0.260195s (10217 normal rows, 82839 exceptions)
[2021-03-25 10:32:01.424] [E/11] [info] [Task Finished] Transform to mem in 0.260774s (10527 normal rows, 82110 exceptions)
[2021-03-25 10:32:01.425] [E/14] [info] [Task Finished] Transform to mem in 0.260306s (10413 normal rows, 82733 exceptions)
[2021-03-25 10:32:01.425] [E/7] [info] [Task Finished] Transform to mem in 0.261470s (10536 normal rows, 83591 exceptions)
[2021-03-25 10:32:01.427] [E/5] [info] [Task Finished] Transform to mem in 0.261367s (10527 normal rows, 82391 exceptions)
[2021-03-25 10:32:01.427] [E/10] [info] [Task Finished] Transform to mem in 0.261328s (10212 normal rows, 82864 exceptions)
[2021-03-25 10:32:01.428] [E/9] [info] [Task Finished] Transform to mem in 0.261187s (10380 normal rows, 82666 exceptions)
[2021-03-25 10:32:01.429] [E/12] [info] [Task Finished] Transform to mem in 0.260549s (10395 normal rows, 82884 exceptions)
[2021-03-25 10:32:01.430] [E/1] [info] [Task Finished] Transform to mem in 0.260744s (10211 normal rows, 82855 exceptions)
[2021-03-25 10:32:01.431] [E/6] [info] [Task Finished] Transform to mem in 0.262130s (10537 normal rows, 82571 exceptions)
[2021-03-25 10:32:01.432] [driver] [info] [Task Finished] Transform to mem in 0.267119s (10380 normal rows, 82714 exceptions)
[2021-03-25 10:32:01.432] [E/13] [info] [Task Finished] Transform to mem in 0.262055s (10524 normal rows, 83296 exceptions)
[2021-03-25 10:32:01.433] [E/4] [info] [Task Finished] Transform to mem in 0.261602s (10382 normal rows, 82778 exceptions)
[2021-03-25 10:32:01.433] [E/8] [info] [Task Finished] Transform to mem in 0.262451s (10403 normal rows, 82568 exceptions)
[2021-03-25 10:32:01.434] [E/15] [info] [Task Finished] Transform to mem in 0.268513s (10541 normal rows, 83305 exceptions)
[2021-03-25 10:32:01.684] [E/2] [info] [Task Finished] Transform to mem in 0.259667s (10215 normal rows, 82861 exceptions)
[2021-03-25 10:32:01.684] [E/3] [info] [Task Finished] Transform to mem in 0.261221s (10541 normal rows, 82755 exceptions)
[2021-03-25 10:32:01.685] [E/14] [info] [Task Finished] Transform to mem in 0.260196s (10386 normal rows, 82689 exceptions)
[2021-03-25 10:32:01.686] [E/11] [info] [Task Finished] Transform to mem in 0.261145s (10532 normal rows, 83104 exceptions)
[2021-03-25 10:32:01.687] [E/7] [info] [Task Finished] Transform to mem in 0.261232s (10365 normal rows, 82841 exceptions)
[2021-03-25 10:32:01.688] [E/5] [info] [Task Finished] Transform to mem in 0.261638s (10575 normal rows, 82687 exceptions)
[2021-03-25 10:32:01.689] [E/10] [info] [Task Finished] Transform to mem in 0.261396s (10215 normal rows, 82938 exceptions)
[2021-03-25 10:32:01.689] [E/9] [info] [Task Finished] Transform to mem in 0.261222s (10512 normal rows, 83031 exceptions)
[2021-03-25 10:32:01.689] [E/12] [info] [Task Finished] Transform to mem in 0.260884s (10406 normal rows, 82684 exceptions)
[2021-03-25 10:32:01.690] [E/1] [info] [Task Finished] Transform to mem in 0.260773s (10359 normal rows, 82956 exceptions)
[2021-03-25 10:32:01.692] [driver] [info] [Task Finished] Transform to mem in 0.259877s (10252 normal rows, 83088 exceptions)
[2021-03-25 10:32:01.693] [E/6] [info] [Task Finished] Transform to mem in 0.261917s (10531 normal rows, 82508 exceptions)
[2021-03-25 10:32:01.694] [E/13] [info] [Task Finished] Transform to mem in 0.261675s (10505 normal rows, 82881 exceptions)
[2021-03-25 10:32:01.694] [E/4] [info] [Task Finished] Transform to mem in 0.261277s (10378 normal rows, 82714 exceptions)
[2021-03-25 10:32:01.695] [E/8] [info] [Task Finished] Transform to mem in 0.261338s (10396 normal rows, 83080 exceptions)
[2021-03-25 10:32:01.695] [E/15] [info] [Task Finished] Transform to mem in 0.260780s (10542 normal rows, 82507 exceptions)
[2021-03-25 10:32:01.944] [E/2] [info] [Task Finished] Transform to mem in 0.260073s (10243 normal rows, 83097 exceptions)
[2021-03-25 10:32:01.945] [E/3] [info] [Task Finished] Transform to mem in 0.261169s (10514 normal rows, 82752 exceptions)
[2021-03-25 10:32:01.946] [E/14] [info] [Task Finished] Transform to mem in 0.260809s (10378 normal rows, 82785 exceptions)
[2021-03-25 10:32:01.947] [E/11] [info] [Task Finished] Transform to mem in 0.261175s (10373 normal rows, 83092 exceptions)
[2021-03-25 10:32:01.948] [E/7] [info] [Task Finished] Transform to mem in 0.261287s (10510 normal rows, 82546 exceptions)
[2021-03-25 10:32:01.949] [E/5] [info] [Task Finished] Transform to mem in 0.260999s (10288 normal rows, 83067 exceptions)
[2021-03-25 10:32:01.950] [E/9] [info] [Task Finished] Transform to mem in 0.260698s (10353 normal rows, 82638 exceptions)
[2021-03-25 10:32:01.950] [E/10] [info] [Task Finished] Transform to mem in 0.261795s (10514 normal rows, 82716 exceptions)
[2021-03-25 10:32:01.951] [driver] [info] [Task Finished] Transform to mem in 0.259352s (10288 normal rows, 83178 exceptions)
[2021-03-25 10:32:01.952] [E/1] [info] [Task Finished] Transform to mem in 0.261192s (10510 normal rows, 82399 exceptions)
[2021-03-25 10:32:01.952] [E/12] [info] [Task Finished] Transform to mem in 0.262457s (10408 normal rows, 83285 exceptions)
[2021-03-25 10:32:01.954] [E/6] [info] [Task Finished] Transform to mem in 0.261690s (10514 normal rows, 82630 exceptions)
[2021-03-25 10:32:01.955] [E/13] [info] [Task Finished] Transform to mem in 0.261177s (10311 normal rows, 82729 exceptions)
[2021-03-25 10:32:01.956] [E/15] [info] [Task Finished] Transform to mem in 0.260567s (10317 normal rows, 83177 exceptions)
[2021-03-25 10:32:01.956] [E/4] [info] [Task Finished] Transform to mem in 0.261911s (10435 normal rows, 83133 exceptions)
[2021-03-25 10:32:01.957] [E/8] [info] [Task Finished] Transform to mem in 0.262584s (10476 normal rows, 82536 exceptions)
[2021-03-25 10:32:02.205] [E/2] [info] [Task Finished] Transform to mem in 0.260855s (10522 normal rows, 82577 exceptions)
[2021-03-25 10:32:02.207] [E/3] [info] [Task Finished] Transform to mem in 0.261034s (10304 normal rows, 82572 exceptions)
[2021-03-25 10:32:02.208] [E/14] [info] [Task Finished] Transform to mem in 0.261753s (10450 normal rows, 83434 exceptions)
[2021-03-25 10:32:02.209] [E/11] [info] [Task Finished] Transform to mem in 0.261907s (10480 normal rows, 82448 exceptions)
[2021-03-25 10:32:02.210] [E/7] [info] [Task Finished] Transform to mem in 0.261925s (10317 normal rows, 83176 exceptions)
[2021-03-25 10:32:02.211] [driver] [info] [Task Finished] Transform to mem in 0.260514s (10399 normal rows, 82383 exceptions)
[2021-03-25 10:32:02.212] [E/9] [info] [Task Finished] Transform to mem in 0.261672s (10304 normal rows, 82556 exceptions)
[2021-03-25 10:32:02.212] [E/5] [info] [Task Finished] Transform to mem in 0.262468s (10522 normal rows, 82561 exceptions)
[2021-03-25 10:32:02.213] [E/10] [info] [Task Finished] Transform to mem in 0.262942s (10434 normal rows, 83503 exceptions)
[2021-03-25 10:32:02.213] [E/12] [info] [Task Finished] Transform to mem in 0.261568s (10536 normal rows, 82412 exceptions)
[2021-03-25 10:32:02.214] [E/1] [info] [Task Finished] Transform to mem in 0.262592s (10379 normal rows, 83265 exceptions)
[2021-03-25 10:32:02.217] [E/6] [info] [Task Finished] Transform to mem in 0.262434s (10290 normal rows, 82497 exceptions)
[2021-03-25 10:32:02.217] [E/15] [info] [Task Finished] Transform to mem in 0.261279s (10421 normal rows, 82438 exceptions)
[2021-03-25 10:32:02.218] [E/8] [info] [Task Finished] Transform to mem in 0.260925s (10537 normal rows, 82444 exceptions)
[2021-03-25 10:32:02.219] [E/4] [info] [Task Finished] Transform to mem in 0.262711s (10379 normal rows, 83209 exceptions)
[2021-03-25 10:32:02.219] [E/13] [info] [Task Finished] Transform to mem in 0.263580s (10441 normal rows, 83672 exceptions)
[2021-03-25 10:32:02.466] [E/2] [info] [Task Finished] Transform to mem in 0.261097s (10295 normal rows, 82316 exceptions)
[2021-03-25 10:32:02.469] [E/3] [info] [Task Finished] Transform to mem in 0.262070s (10441 normal rows, 83796 exceptions)
[2021-03-25 10:32:02.469] [E/14] [info] [Task Finished] Transform to mem in 0.261346s (10421 normal rows, 82414 exceptions)
[2021-03-25 10:32:02.471] [E/11] [info] [Task Finished] Transform to mem in 0.261854s (10366 normal rows, 83213 exceptions)
[2021-03-25 10:32:02.472] [driver] [info] [Task Finished] Transform to mem in 0.260301s (10285 normal rows, 82265 exceptions)
[2021-03-25 10:32:02.474] [E/5] [info] [Task Finished] Transform to mem in 0.261681s (10413 normal rows, 82527 exceptions)
[2021-03-25 10:32:02.474] [E/9] [info] [Task Finished] Transform to mem in 0.261991s (10438 normal rows, 83738 exceptions)
[2021-03-25 10:32:02.474] [E/7] [info] [Task Finished] Transform to mem in 0.263877s (10550 normal rows, 82481 exceptions)
[2021-03-25 10:32:02.475] [E/12] [info] [Task Finished] Transform to mem in 0.261190s (10524 normal rows, 82267 exceptions)
[2021-03-25 10:32:02.475] [E/10] [info] [Task Finished] Transform to mem in 0.262027s (10387 normal rows, 83171 exceptions)
[2021-03-25 10:32:02.476] [E/1] [info] [Task Finished] Transform to mem in 0.261232s (10233 normal rows, 82572 exceptions)
[2021-03-25 10:32:02.477] [E/15] [info] [Task Finished] Transform to mem in 0.259951s (10387 normal rows, 82531 exceptions)
[2021-03-25 10:32:02.480] [E/6] [info] [Task Finished] Transform to mem in 0.263152s (10516 normal rows, 83709 exceptions)
[2021-03-25 10:32:02.480] [E/13] [info] [Task Finished] Transform to mem in 0.261103s (10205 normal rows, 82633 exceptions)
[2021-03-25 10:32:02.480] [E/8] [info] [Task Finished] Transform to mem in 0.261744s (10384 normal rows, 82987 exceptions)
[2021-03-25 10:32:02.482] [E/4] [info] [Task Finished] Transform to mem in 0.262999s (10541 normal rows, 82314 exceptions)
[2021-03-25 10:32:02.729] [E/2] [info] [Task Finished] Transform to mem in 0.262666s (10534 normal rows, 83592 exceptions)
[2021-03-25 10:32:02.731] [E/14] [info] [Task Finished] Transform to mem in 0.261471s (10387 normal rows, 82968 exceptions)
[2021-03-25 10:32:02.731] [E/3] [info] [Task Finished] Transform to mem in 0.262192s (10406 normal rows, 82739 exceptions)
[2021-03-25 10:32:02.732] [E/11] [info] [Task Finished] Transform to mem in 0.261074s (10527 normal rows, 82155 exceptions)
[2021-03-25 10:32:02.732] [driver] [info] [Task Finished] Transform to mem in 0.260048s (10217 normal rows, 82840 exceptions)
[2021-03-25 10:32:02.734] [E/9] [info] [Task Finished] Transform to mem in 0.260815s (10380 normal rows, 82709 exceptions)
[2021-03-25 10:32:02.735] [E/7] [info] [Task Finished] Transform to mem in 0.261207s (10395 normal rows, 82771 exceptions)
[2021-03-25 10:32:02.736] [E/5] [info] [Task Finished] Transform to mem in 0.262505s (10536 normal rows, 83542 exceptions)
[2021-03-25 10:32:02.737] [E/12] [info] [Task Finished] Transform to mem in 0.261827s (10537 normal rows, 82395 exceptions)
[2021-03-25 10:32:02.737] [E/10] [info] [Task Finished] Transform to mem in 0.261407s (10220 normal rows, 82876 exceptions)
[2021-03-25 10:32:02.737] [E/1] [info] [Task Finished] Transform to mem in 0.261384s (10515 normal rows, 83284 exceptions)
[2021-03-25 10:32:02.738] [E/15] [info] [Task Finished] Transform to mem in 0.261310s (10403 normal rows, 82663 exceptions)
[2021-03-25 10:32:02.741] [E/8] [info] [Task Finished] Transform to mem in 0.261119s (10211 normal rows, 82855 exceptions)
[2021-03-25 10:32:02.742] [E/6] [info] [Task Finished] Transform to mem in 0.261974s (10398 normal rows, 82849 exceptions)
[2021-03-25 10:32:02.743] [E/13] [info] [Task Finished] Transform to mem in 0.262529s (10537 normal rows, 82629 exceptions)
[2021-03-25 10:32:02.745] [E/4] [info] [Task Finished] Transform to mem in 0.263398s (10524 normal rows, 83295 exceptions)
[2021-03-25 10:32:02.990] [E/2] [info] [Task Finished] Transform to mem in 0.261049s (10403 normal rows, 82520 exceptions)
[2021-03-25 10:32:02.991] [E/14] [info] [Task Finished] Transform to mem in 0.260503s (10382 normal rows, 82801 exceptions)
[2021-03-25 10:32:02.992] [E/3] [info] [Task Finished] Transform to mem in 0.261252s (10541 normal rows, 82781 exceptions)
[2021-03-25 10:32:02.993] [E/11] [info] [Task Finished] Transform to mem in 0.260959s (10215 normal rows, 82861 exceptions)
[2021-03-25 10:32:02.993] [driver] [info] [Task Finished] Transform to mem in 0.260843s (10532 normal rows, 83051 exceptions)
[2021-03-25 10:32:02.995] [E/9] [info] [Task Finished] Transform to mem in 0.260575s (10386 normal rows, 82742 exceptions)
[2021-03-25 10:32:02.996] [E/7] [info] [Task Finished] Transform to mem in 0.260562s (10365 normal rows, 82842 exceptions)
[2021-03-25 10:32:02.997] [E/5] [info] [Task Finished] Transform to mem in 0.261043s (10575 normal rows, 82639 exceptions)
[2021-03-25 10:32:03.210] [E/12] [info] [Task Finished] Transform to mem in 0.473599s (18692 normal rows, 150477 exceptions)
[2021-03-25 10:32:03.210] [global] [info] [Transform Stage] Stage 0 completed 169 load&transform tasks in 3.09138s
[2021-03-25 10:32:03.210] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.4292s, 56312200 input rows, time to process 1 row via fast path: 0.00078898ms
[2021-03-25 10:32:03.210] [global] [info] Exception details: 
+------------+------------+----------+
| OperatorID | Exception  | Count    |
+------------+------------+----------+
| 100001     | ValueError | 14067100 |
+------------+------------+----------+
[2021-03-25 10:32:03.215] [local ee] [info] compiled pure python pipeline in 0.004250s
[2021-03-25 10:32:03.215] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:32:03.216] [local ee] [info] Created 169 resolve tasks in 0.001268s
[2021-03-25 10:32:03.216] [local ee] [info] 169/169 tasks require executing the slow path.
[2021-03-25 10:32:03.326] [E/14] [info] [Task Finished] Resolve in 0.110409s
[2021-03-25 10:32:03.326] [E/1] [info] [Task Finished] Resolve in 0.110499s
[2021-03-25 10:32:03.327] [driver] [info] [Task Finished] Resolve in 0.110655s
[2021-03-25 10:32:03.327] [E/5] [info] [Task Finished] Resolve in 0.110666s
[2021-03-25 10:32:03.327] [E/3] [info] [Task Finished] Resolve in 0.110715s
[2021-03-25 10:32:03.327] [E/10] [info] [Task Finished] Resolve in 0.110734s
[2021-03-25 10:32:03.327] [E/7] [info] [Task Finished] Resolve in 0.110763s
[2021-03-25 10:32:03.327] [E/2] [info] [Task Finished] Resolve in 0.110775s
[2021-03-25 10:32:03.327] [E/11] [info] [Task Finished] Resolve in 0.110902s
[2021-03-25 10:32:03.327] [E/12] [info] [Task Finished] Resolve in 0.111067s
[2021-03-25 10:32:03.327] [E/4] [info] [Task Finished] Resolve in 0.111095s
[2021-03-25 10:32:03.327] [E/9] [info] [Task Finished] Resolve in 0.111146s
[2021-03-25 10:32:03.327] [E/13] [info] [Task Finished] Resolve in 0.111180s
[2021-03-25 10:32:03.327] [E/6] [info] [Task Finished] Resolve in 0.111226s
[2021-03-25 10:32:03.327] [E/8] [info] [Task Finished] Resolve in 0.111322s
[2021-03-25 10:32:03.327] [E/15] [info] [Task Finished] Resolve in 0.111335s
[2021-03-25 10:32:03.430] [E/10] [info] [Task Finished] Resolve in 0.103597s
[2021-03-25 10:32:03.431] [E/7] [info] [Task Finished] Resolve in 0.104078s
[2021-03-25 10:32:03.431] [E/6] [info] [Task Finished] Resolve in 0.103733s
[2021-03-25 10:32:03.431] [E/12] [info] [Task Finished] Resolve in 0.104001s
[2021-03-25 10:32:03.431] [E/15] [info] [Task Finished] Resolve in 0.103927s
[2021-03-25 10:32:03.431] [E/2] [info] [Task Finished] Resolve in 0.104557s
[2021-03-25 10:32:03.431] [E/11] [info] [Task Finished] Resolve in 0.104661s
[2021-03-25 10:32:03.432] [E/13] [info] [Task Finished] Resolve in 0.104503s
[2021-03-25 10:32:03.432] [E/8] [info] [Task Finished] Resolve in 0.104666s
[2021-03-25 10:32:03.432] [E/4] [info] [Task Finished] Resolve in 0.104904s
[2021-03-25 10:32:03.437] [driver] [info] [Task Finished] Resolve in 0.109933s
[2021-03-25 10:32:03.437] [E/14] [info] [Task Finished] Resolve in 0.110652s
[2021-03-25 10:32:03.437] [E/5] [info] [Task Finished] Resolve in 0.110517s
[2021-03-25 10:32:03.437] [E/9] [info] [Task Finished] Resolve in 0.110241s
[2021-03-25 10:32:03.437] [E/3] [info] [Task Finished] Resolve in 0.110715s
[2021-03-25 10:32:03.438] [E/1] [info] [Task Finished] Resolve in 0.111078s
[2021-03-25 10:32:03.536] [E/4] [info] [Task Finished] Resolve in 0.103618s
[2021-03-25 10:32:03.536] [E/15] [info] [Task Finished] Resolve in 0.104912s
[2021-03-25 10:32:03.537] [E/8] [info] [Task Finished] Resolve in 0.104959s
[2021-03-25 10:32:03.541] [E/14] [info] [Task Finished] Resolve in 0.103663s
[2021-03-25 10:32:03.541] [E/6] [info] [Task Finished] Resolve in 0.110120s
[2021-03-25 10:32:03.541] [E/7] [info] [Task Finished] Resolve in 0.110361s
[2021-03-25 10:32:03.541] [E/9] [info] [Task Finished] Resolve in 0.103818s
[2021-03-25 10:32:03.541] [E/12] [info] [Task Finished] Resolve in 0.110199s
[2021-03-25 10:32:03.541] [E/10] [info] [Task Finished] Resolve in 0.110952s
[2021-03-25 10:32:03.541] [E/3] [info] [Task Finished] Resolve in 0.103847s
[2021-03-25 10:32:03.541] [E/11] [info] [Task Finished] Resolve in 0.109981s
[2021-03-25 10:32:03.542] [driver] [info] [Task Finished] Resolve in 0.104966s
[2021-03-25 10:32:03.542] [E/5] [info] [Task Finished] Resolve in 0.104599s
[2021-03-25 10:32:03.542] [E/13] [info] [Task Finished] Resolve in 0.110241s
[2021-03-25 10:32:03.543] [E/2] [info] [Task Finished] Resolve in 0.111329s
[2021-03-25 10:32:03.543] [E/1] [info] [Task Finished] Resolve in 0.105546s
[2021-03-25 10:32:03.644] [E/14] [info] [Task Finished] Resolve in 0.103291s
[2021-03-25 10:32:03.644] [E/10] [info] [Task Finished] Resolve in 0.103136s
[2021-03-25 10:32:03.645] [E/7] [info] [Task Finished] Resolve in 0.103643s
[2021-03-25 10:32:03.645] [E/9] [info] [Task Finished] Resolve in 0.103830s
[2021-03-25 10:32:03.645] [E/3] [info] [Task Finished] Resolve in 0.103790s
[2021-03-25 10:32:03.645] [E/5] [info] [Task Finished] Resolve in 0.103387s
[2021-03-25 10:32:03.645] [E/6] [info] [Task Finished] Resolve in 0.104431s
[2021-03-25 10:32:03.646] [E/4] [info] [Task Finished] Resolve in 0.110098s
[2021-03-25 10:32:03.646] [E/13] [info] [Task Finished] Resolve in 0.103816s
[2021-03-25 10:32:03.646] [E/11] [info] [Task Finished] Resolve in 0.104258s
[2021-03-25 10:32:03.646] [E/12] [info] [Task Finished] Resolve in 0.105109s
[2021-03-25 10:32:03.646] [driver] [info] [Task Finished] Resolve in 0.104852s
[2021-03-25 10:32:03.647] [E/1] [info] [Task Finished] Resolve in 0.104167s
[2021-03-25 10:32:03.647] [E/8] [info] [Task Finished] Resolve in 0.110341s
[2021-03-25 10:32:03.647] [E/15] [info] [Task Finished] Resolve in 0.111167s
[2021-03-25 10:32:03.648] [E/2] [info] [Task Finished] Resolve in 0.105436s
[2021-03-25 10:32:03.748] [E/7] [info] [Task Finished] Resolve in 0.103474s
[2021-03-25 10:32:03.749] [E/14] [info] [Task Finished] Resolve in 0.104481s
[2021-03-25 10:32:03.749] [E/10] [info] [Task Finished] Resolve in 0.104115s
[2021-03-25 10:32:03.749] [E/5] [info] [Task Finished] Resolve in 0.103582s
[2021-03-25 10:32:03.749] [E/9] [info] [Task Finished] Resolve in 0.104237s
[2021-03-25 10:32:03.750] [E/6] [info] [Task Finished] Resolve in 0.104265s
[2021-03-25 10:32:03.750] [E/4] [info] [Task Finished] Resolve in 0.104195s
[2021-03-25 10:32:03.750] [E/11] [info] [Task Finished] Resolve in 0.104225s
[2021-03-25 10:32:03.750] [E/13] [info] [Task Finished] Resolve in 0.104403s
[2021-03-25 10:32:03.750] [driver] [info] [Task Finished] Resolve in 0.103760s
[2021-03-25 10:32:03.750] [E/12] [info] [Task Finished] Resolve in 0.103877s
[2021-03-25 10:32:03.750] [E/3] [info] [Task Finished] Resolve in 0.105327s
[2021-03-25 10:32:03.751] [E/15] [info] [Task Finished] Resolve in 0.103889s
[2021-03-25 10:32:03.751] [E/8] [info] [Task Finished] Resolve in 0.104153s
[2021-03-25 10:32:03.752] [E/1] [info] [Task Finished] Resolve in 0.104923s
[2021-03-25 10:32:03.753] [E/2] [info] [Task Finished] Resolve in 0.104730s
[2021-03-25 10:32:03.852] [E/10] [info] [Task Finished] Resolve in 0.103869s
[2021-03-25 10:32:03.853] [E/7] [info] [Task Finished] Resolve in 0.104190s
[2021-03-25 10:32:03.853] [E/14] [info] [Task Finished] Resolve in 0.104061s
[2021-03-25 10:32:03.853] [E/5] [info] [Task Finished] Resolve in 0.104317s
[2021-03-25 10:32:03.854] [E/6] [info] [Task Finished] Resolve in 0.103733s
[2021-03-25 10:32:03.854] [E/9] [info] [Task Finished] Resolve in 0.104233s
[2021-03-25 10:32:03.854] [E/13] [info] [Task Finished] Resolve in 0.103916s
[2021-03-25 10:32:03.854] [driver] [info] [Task Finished] Resolve in 0.103989s
[2021-03-25 10:32:03.854] [E/4] [info] [Task Finished] Resolve in 0.104271s
[2021-03-25 10:32:03.854] [E/3] [info] [Task Finished] Resolve in 0.103800s
[2021-03-25 10:32:03.854] [E/11] [info] [Task Finished] Resolve in 0.104198s
[2021-03-25 10:32:03.855] [E/12] [info] [Task Finished] Resolve in 0.104439s
[2021-03-25 10:32:03.855] [E/15] [info] [Task Finished] Resolve in 0.104079s
[2021-03-25 10:32:03.855] [E/8] [info] [Task Finished] Resolve in 0.103964s
[2021-03-25 10:32:03.856] [E/2] [info] [Task Finished] Resolve in 0.103672s
[2021-03-25 10:32:03.857] [E/1] [info] [Task Finished] Resolve in 0.104705s
[2021-03-25 10:32:03.957] [E/7] [info] [Task Finished] Resolve in 0.104054s
[2021-03-25 10:32:03.957] [E/14] [info] [Task Finished] Resolve in 0.104016s
[2021-03-25 10:32:03.957] [E/10] [info] [Task Finished] Resolve in 0.104200s
[2021-03-25 10:32:03.957] [E/6] [info] [Task Finished] Resolve in 0.103694s
[2021-03-25 10:32:03.958] [E/5] [info] [Task Finished] Resolve in 0.104431s
[2021-03-25 10:32:03.958] [driver] [info] [Task Finished] Resolve in 0.103720s
[2021-03-25 10:32:03.958] [E/3] [info] [Task Finished] Resolve in 0.103779s
[2021-03-25 10:32:03.958] [E/13] [info] [Task Finished] Resolve in 0.104037s
[2021-03-25 10:32:03.958] [E/9] [info] [Task Finished] Resolve in 0.104845s
[2021-03-25 10:32:03.959] [E/12] [info] [Task Finished] Resolve in 0.103991s
[2021-03-25 10:32:03.959] [E/4] [info] [Task Finished] Resolve in 0.104761s
[2021-03-25 10:32:03.959] [E/11] [info] [Task Finished] Resolve in 0.104950s
[2021-03-25 10:32:03.959] [E/15] [info] [Task Finished] Resolve in 0.104174s
[2021-03-25 10:32:03.960] [E/8] [info] [Task Finished] Resolve in 0.104693s
[2021-03-25 10:32:03.961] [E/1] [info] [Task Finished] Resolve in 0.104126s
[2021-03-25 10:32:03.961] [E/2] [info] [Task Finished] Resolve in 0.104858s
[2021-03-25 10:32:04.061] [E/14] [info] [Task Finished] Resolve in 0.104081s
[2021-03-25 10:32:04.061] [E/7] [info] [Task Finished] Resolve in 0.104178s
[2021-03-25 10:32:04.061] [E/6] [info] [Task Finished] Resolve in 0.103782s
[2021-03-25 10:32:04.061] [driver] [info] [Task Finished] Resolve in 0.103402s
[2021-03-25 10:32:04.062] [E/10] [info] [Task Finished] Resolve in 0.105036s
[2021-03-25 10:32:04.062] [E/13] [info] [Task Finished] Resolve in 0.103864s
[2021-03-25 10:32:04.062] [E/3] [info] [Task Finished] Resolve in 0.103983s
[2021-03-25 10:32:04.062] [E/5] [info] [Task Finished] Resolve in 0.104824s
[2021-03-25 10:32:04.062] [E/12] [info] [Task Finished] Resolve in 0.103753s
[2021-03-25 10:32:04.063] [E/11] [info] [Task Finished] Resolve in 0.103747s
[2021-03-25 10:32:04.063] [E/15] [info] [Task Finished] Resolve in 0.103746s
[2021-03-25 10:32:04.064] [E/9] [info] [Task Finished] Resolve in 0.105130s
[2021-03-25 10:32:04.064] [E/4] [info] [Task Finished] Resolve in 0.104857s
[2021-03-25 10:32:04.064] [E/8] [info] [Task Finished] Resolve in 0.103760s
[2021-03-25 10:32:04.066] [E/1] [info] [Task Finished] Resolve in 0.105247s
[2021-03-25 10:32:04.067] [E/2] [info] [Task Finished] Resolve in 0.105334s
[2021-03-25 10:32:04.164] [E/14] [info] [Task Finished] Resolve in 0.103501s
[2021-03-25 10:32:04.164] [E/6] [info] [Task Finished] Resolve in 0.103423s
[2021-03-25 10:32:04.165] [E/10] [info] [Task Finished] Resolve in 0.103249s
[2021-03-25 10:32:04.166] [driver] [info] [Task Finished] Resolve in 0.104231s
[2021-03-25 10:32:04.166] [E/13] [info] [Task Finished] Resolve in 0.103630s
[2021-03-25 10:32:04.166] [E/12] [info] [Task Finished] Resolve in 0.103325s
[2021-03-25 10:32:04.166] [E/5] [info] [Task Finished] Resolve in 0.103552s
[2021-03-25 10:32:04.166] [E/7] [info] [Task Finished] Resolve in 0.105271s
[2021-03-25 10:32:04.167] [E/15] [info] [Task Finished] Resolve in 0.103778s
[2021-03-25 10:32:04.167] [E/9] [info] [Task Finished] Resolve in 0.103730s
[2021-03-25 10:32:04.167] [E/3] [info] [Task Finished] Resolve in 0.105402s
[2021-03-25 10:32:04.168] [E/11] [info] [Task Finished] Resolve in 0.104562s
[2021-03-25 10:32:04.168] [E/8] [info] [Task Finished] Resolve in 0.104052s
[2021-03-25 10:32:04.169] [E/4] [info] [Task Finished] Resolve in 0.105435s
[2021-03-25 10:32:04.170] [E/2] [info] [Task Finished] Resolve in 0.103654s
[2021-03-25 10:32:04.171] [E/1] [info] [Task Finished] Resolve in 0.104624s
[2021-03-25 10:32:04.268] [driver] [info] [Task Finished] Resolve in 0.102933s
[2021-03-25 10:32:04.269] [E/6] [info] [Task Finished] Resolve in 0.104272s
[2021-03-25 10:32:04.269] [E/10] [info] [Task Finished] Resolve in 0.104054s
[2021-03-25 10:32:04.269] [E/14] [info] [Task Finished] Resolve in 0.105090s
[2021-03-25 10:32:04.270] [E/12] [info] [Task Finished] Resolve in 0.104046s
[2021-03-25 10:32:04.270] [E/13] [info] [Task Finished] Resolve in 0.104236s
[2021-03-25 10:32:04.270] [E/5] [info] [Task Finished] Resolve in 0.104105s
[2021-03-25 10:32:04.271] [E/15] [info] [Task Finished] Resolve in 0.103635s
[2021-03-25 10:32:04.271] [E/7] [info] [Task Finished] Resolve in 0.105140s
[2021-03-25 10:32:04.272] [E/9] [info] [Task Finished] Resolve in 0.104266s
[2021-03-25 10:32:04.272] [E/11] [info] [Task Finished] Resolve in 0.104363s
[2021-03-25 10:32:04.272] [E/8] [info] [Task Finished] Resolve in 0.104124s
[2021-03-25 10:32:04.272] [E/3] [info] [Task Finished] Resolve in 0.104720s
[2021-03-25 10:32:04.274] [E/4] [info] [Task Finished] Resolve in 0.104257s
[2021-03-25 10:32:04.274] [E/2] [info] [Task Finished] Resolve in 0.103917s
[2021-03-25 10:32:04.276] [E/1] [info] [Task Finished] Resolve in 0.104741s
[2021-03-25 10:32:04.372] [driver] [info] [Task Finished] Resolve in 0.103310s
[2021-03-25 10:32:04.373] [E/6] [info] [Task Finished] Resolve in 0.103790s
[2021-03-25 10:32:04.373] [E/10] [info] [Task Finished] Resolve in 0.103990s
[2021-03-25 10:32:04.373] [E/14] [info] [Task Finished] Resolve in 0.104076s
[2021-03-25 10:32:04.374] [E/13] [info] [Task Finished] Resolve in 0.103939s
[2021-03-25 10:32:04.374] [E/5] [info] [Task Finished] Resolve in 0.103979s
[2021-03-25 10:32:04.374] [E/12] [info] [Task Finished] Resolve in 0.104292s
[2021-03-25 10:32:04.375] [E/15] [info] [Task Finished] Resolve in 0.103807s
[2021-03-25 10:32:04.461] [E/7] [info] [Task Finished] Resolve in 0.189604s
[2021-03-25 10:32:04.461] [local ee] [info] slow path resolved 14067100/14067100 exceptions in 1.25069s
[2021-03-25 10:32:04.461] [local ee] [info] slow path for Stage 0: total wall clock time: 17.9023s, time to process 1 row via slow path: 0.00127264ms
[2021-03-25 10:32:04.461] [global] [info] [Transform Stage] Stage 0 completed 169 resolve tasks in 1.25073s

[2021-03-25 10:32:04.787] [global] [info] Writing 15835160 rows as output to file (2.34 GB)
[2021-03-25 10:32:04.917] [E/1] [info] [Task Finished] write to file in 0.130323s (448718 rows, 67.90 MB)
[2021-03-25 10:32:05.074] [E/2] [info] [Task Finished] write to file in 0.286704s (1025530 rows, 155.19 MB)
[2021-03-25 10:32:05.074] [E/6] [info] [Task Finished] write to file in 0.286880s (1026198 rows, 155.29 MB)
[2021-03-25 10:32:05.074] [E/5] [info] [Task Finished] write to file in 0.287090s (1025556 rows, 155.19 MB)
[2021-03-25 10:32:05.075] [E/7] [info] [Task Finished] write to file in 0.287715s (1026137 rows, 155.28 MB)
[2021-03-25 10:32:05.075] [E/12] [info] [Task Finished] write to file in 0.287828s (1026182 rows, 155.29 MB)
[2021-03-25 10:32:05.075] [E/13] [info] [Task Finished] write to file in 0.288067s (1025063 rows, 155.12 MB)
[2021-03-25 10:32:05.076] [driver] [info] [Task Finished] write to file in 0.289351s (1025917 rows, 155.24 MB)
[2021-03-25 10:32:05.077] [E/14] [info] [Task Finished] write to file in 0.289959s (1026134 rows, 155.28 MB)
[2021-03-25 10:32:05.077] [E/8] [info] [Task Finished] write to file in 0.290010s (1025433 rows, 155.17 MB)
[2021-03-25 10:32:05.077] [E/15] [info] [Task Finished] write to file in 0.290310s (1025448 rows, 155.17 MB)
[2021-03-25 10:32:05.078] [E/11] [info] [Task Finished] write to file in 0.290861s (1025564 rows, 155.19 MB)
[2021-03-25 10:32:05.078] [E/3] [info] [Task Finished] write to file in 0.290948s (1025220 rows, 155.14 MB)
[2021-03-25 10:32:05.078] [E/10] [info] [Task Finished] write to file in 0.291500s (1025762 rows, 155.22 MB)
[2021-03-25 10:32:05.079] [E/9] [info] [Task Finished] write to file in 0.292330s (1026250 rows, 155.30 MB)
[2021-03-25 10:32:05.137] [E/4] [info] [Task Finished] write to file in 0.350089s (1026048 rows, 155.26 MB)
[2021-03-25 10:32:05.137] [global] [info] writing output took 0.675972s
[2021-03-25 10:32:05.137] [global] [info] [Transform Stage] Stage 0 completed 169 sink tasks in 0.676069s
[2021-03-25 10:32:05.137] [global] [info] [Transform Stage] Stage 0 took 5.52108s
[2021-03-25 10:32:05.137] [global] [info] Query Execution took 5.60072s. (planning: 0.0796064s, execution: 5.52111s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty_synthetic@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.006060600280761719
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 5.884985685348511 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0226546,"llvm_optimization_time_s":0.332758,"llvm_compilation_time_s":0.152486,"total_compilation_time_s":0.502861,"sampling_time_s":0.110487,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.4292,"fast_path_time_s":3.0914,"fast_path_per_row_time_ns":788.98,"slow_path_wall_time_s":17.9023,"slow_path_time_s":1.25069,"slow_path_per_row_time_ns":1272.64}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.006060600280761719, "jobTime": 5.884985685348511, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-25 10:32:05.161] [local execution engine] [info] Stopped local executor E/1
[2021-03-25 10:32:05.175] [local execution engine] [info] Stopped local executor E/2
[2021-03-25 10:32:05.189] [local execution engine] [info] Stopped local executor E/3
[2021-03-25 10:32:05.203] [local execution engine] [info] Stopped local executor E/4
[2021-03-25 10:32:05.216] [local execution engine] [info] Stopped local executor E/5
[2021-03-25 10:32:05.230] [local execution engine] [info] Stopped local executor E/6
[2021-03-25 10:32:05.243] [local execution engine] [info] Stopped local executor E/7
[2021-03-25 10:32:05.257] [local execution engine] [info] Stopped local executor E/8
[2021-03-25 10:32:05.270] [local execution engine] [info] Stopped local executor E/9
[2021-03-25 10:32:05.284] [local execution engine] [info] Stopped local executor E/10
[2021-03-25 10:32:05.297] [local execution engine] [info] Stopped local executor E/11
[2021-03-25 10:32:05.311] [local execution engine] [info] Stopped local executor E/12
[2021-03-25 10:32:05.325] [local execution engine] [info] Stopped local executor E/13
[2021-03-25 10:32:05.338] [local execution engine] [info] Stopped local executor E/14
[2021-03-25 10:32:05.352] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
