[2021-03-25 10:44:24.128] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:44:24.128] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:44:24.128] [local ee] [info] initializing LLVM backend
[2021-03-25 10:44:24.128] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:44:24.128] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:44:24.129] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 10:44:24.129] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:44:24.129] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:44:24.129] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:44:24.263] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:44:24.269] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:44:24.284] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:44:24.292] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:44:24.318] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:44:24.338] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:44:24.352] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:44:24.383] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:44:24.389] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:44:24.404] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:44:24.406] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:44:24.407] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:44:24.407] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:44:24.409] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:44:24.410] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:44:24.411] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:44:24.412] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:44:24.413] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:44:24.414] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:44:24.430] [logical planner] [info] logical optimization took 0.021936ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:44:24.430] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:44:24.430] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:44:24.431] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:44:24.432] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:44:24.432] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:44:24.433] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:44:24.434] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:44:24.435] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:44:24.436] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:44:24.436] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:44:24.437] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:44:24.438] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:44:24.439] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:44:24.439] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:44:24.441] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:44:24.442] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:44:24.443] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:44:24.443] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:44:24.444] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:44:24.444] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:44:24.445] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:44:24.446] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:44:24.447] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:44:24.447] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:44:24.448] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:44:24.449] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:44:24.450] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:44:24.451] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:44:24.451] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:44:24.483] [global] [info] Stage0 depends on: 
[2021-03-25 10:44:24.833] [global] [info] Optimization via LLVM passes took 0.332278 ms
[2021-03-25 10:44:24.984] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:44:24.984] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.501029s
[2021-03-25 10:44:24.984] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:44:25.266] [driver] [info] [Task Finished] Transform to mem in 0.281850s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:44:25.546] [driver] [info] [Task Finished] Transform to mem in 0.279994s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:44:25.827] [driver] [info] [Task Finished] Transform to mem in 0.280237s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:44:26.107] [driver] [info] [Task Finished] Transform to mem in 0.280104s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:44:26.386] [driver] [info] [Task Finished] Transform to mem in 0.279580s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:44:26.666] [driver] [info] [Task Finished] Transform to mem in 0.279396s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:44:26.946] [driver] [info] [Task Finished] Transform to mem in 0.280407s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:44:27.225] [driver] [info] [Task Finished] Transform to mem in 0.278583s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:44:27.504] [driver] [info] [Task Finished] Transform to mem in 0.279259s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:44:27.783] [driver] [info] [Task Finished] Transform to mem in 0.279365s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:44:28.062] [driver] [info] [Task Finished] Transform to mem in 0.278830s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:44:28.341] [driver] [info] [Task Finished] Transform to mem in 0.278630s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:44:28.620] [driver] [info] [Task Finished] Transform to mem in 0.278802s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:44:28.899] [driver] [info] [Task Finished] Transform to mem in 0.279521s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:44:29.179] [driver] [info] [Task Finished] Transform to mem in 0.279707s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:44:29.457] [driver] [info] [Task Finished] Transform to mem in 0.278203s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:44:29.736] [driver] [info] [Task Finished] Transform to mem in 0.278734s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:44:30.015] [driver] [info] [Task Finished] Transform to mem in 0.279175s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:44:30.295] [driver] [info] [Task Finished] Transform to mem in 0.279794s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:44:30.574] [driver] [info] [Task Finished] Transform to mem in 0.279443s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:44:30.854] [driver] [info] [Task Finished] Transform to mem in 0.279296s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:44:31.133] [driver] [info] [Task Finished] Transform to mem in 0.278939s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:44:31.412] [driver] [info] [Task Finished] Transform to mem in 0.279130s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:44:31.690] [driver] [info] [Task Finished] Transform to mem in 0.278564s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:44:31.969] [driver] [info] [Task Finished] Transform to mem in 0.278546s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:44:32.248] [driver] [info] [Task Finished] Transform to mem in 0.279315s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:44:32.527] [driver] [info] [Task Finished] Transform to mem in 0.278689s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:44:32.806] [driver] [info] [Task Finished] Transform to mem in 0.278667s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:44:33.085] [driver] [info] [Task Finished] Transform to mem in 0.279167s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:44:33.364] [driver] [info] [Task Finished] Transform to mem in 0.279123s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:44:33.643] [driver] [info] [Task Finished] Transform to mem in 0.278786s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:44:33.922] [driver] [info] [Task Finished] Transform to mem in 0.279006s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:44:34.201] [driver] [info] [Task Finished] Transform to mem in 0.278822s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:44:34.480] [driver] [info] [Task Finished] Transform to mem in 0.279604s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:44:34.759] [driver] [info] [Task Finished] Transform to mem in 0.279051s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:44:35.040] [driver] [info] [Task Finished] Transform to mem in 0.280262s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:44:35.320] [driver] [info] [Task Finished] Transform to mem in 0.279825s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:44:35.598] [driver] [info] [Task Finished] Transform to mem in 0.278380s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:44:35.877] [driver] [info] [Task Finished] Transform to mem in 0.278647s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:44:36.156] [driver] [info] [Task Finished] Transform to mem in 0.279773s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:44:36.435] [driver] [info] [Task Finished] Transform to mem in 0.278869s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:44:36.714] [driver] [info] [Task Finished] Transform to mem in 0.278955s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:44:36.993] [driver] [info] [Task Finished] Transform to mem in 0.278948s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:44:37.275] [driver] [info] [Task Finished] Transform to mem in 0.282075s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:44:37.555] [driver] [info] [Task Finished] Transform to mem in 0.279630s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:44:37.834] [driver] [info] [Task Finished] Transform to mem in 0.279111s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:44:38.113] [driver] [info] [Task Finished] Transform to mem in 0.279041s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:44:38.392] [driver] [info] [Task Finished] Transform to mem in 0.279178s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:44:38.671] [driver] [info] [Task Finished] Transform to mem in 0.279006s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:44:38.951] [driver] [info] [Task Finished] Transform to mem in 0.279265s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:44:39.230] [driver] [info] [Task Finished] Transform to mem in 0.279029s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:44:39.509] [driver] [info] [Task Finished] Transform to mem in 0.278972s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:44:39.787] [driver] [info] [Task Finished] Transform to mem in 0.278764s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:44:40.066] [driver] [info] [Task Finished] Transform to mem in 0.278791s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:44:40.345] [driver] [info] [Task Finished] Transform to mem in 0.278783s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:44:40.624] [driver] [info] [Task Finished] Transform to mem in 0.278786s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:44:40.902] [driver] [info] [Task Finished] Transform to mem in 0.278179s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:44:41.183] [driver] [info] [Task Finished] Transform to mem in 0.280710s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:44:41.462] [driver] [info] [Task Finished] Transform to mem in 0.279592s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:44:41.742] [driver] [info] [Task Finished] Transform to mem in 0.279305s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:44:42.021] [driver] [info] [Task Finished] Transform to mem in 0.278833s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:44:42.300] [driver] [info] [Task Finished] Transform to mem in 0.279308s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:44:42.581] [driver] [info] [Task Finished] Transform to mem in 0.280802s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:44:42.860] [driver] [info] [Task Finished] Transform to mem in 0.279020s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:44:43.138] [driver] [info] [Task Finished] Transform to mem in 0.278374s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:44:43.418] [driver] [info] [Task Finished] Transform to mem in 0.279656s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:44:43.698] [driver] [info] [Task Finished] Transform to mem in 0.279823s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:44:43.976] [driver] [info] [Task Finished] Transform to mem in 0.278644s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:44:44.255] [driver] [info] [Task Finished] Transform to mem in 0.278895s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:44:44.534] [driver] [info] [Task Finished] Transform to mem in 0.278799s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:44:44.813] [driver] [info] [Task Finished] Transform to mem in 0.278997s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:44:45.092] [driver] [info] [Task Finished] Transform to mem in 0.278717s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:44:45.370] [driver] [info] [Task Finished] Transform to mem in 0.278537s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:44:45.650] [driver] [info] [Task Finished] Transform to mem in 0.279271s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:44:45.929] [driver] [info] [Task Finished] Transform to mem in 0.278950s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:44:46.208] [driver] [info] [Task Finished] Transform to mem in 0.279523s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:44:46.487] [driver] [info] [Task Finished] Transform to mem in 0.279298s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:44:46.767] [driver] [info] [Task Finished] Transform to mem in 0.279905s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:44:47.046] [driver] [info] [Task Finished] Transform to mem in 0.278760s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:44:47.325] [driver] [info] [Task Finished] Transform to mem in 0.278651s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:44:47.603] [driver] [info] [Task Finished] Transform to mem in 0.278281s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:44:47.882] [driver] [info] [Task Finished] Transform to mem in 0.279281s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:44:48.161] [driver] [info] [Task Finished] Transform to mem in 0.279028s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:44:48.441] [driver] [info] [Task Finished] Transform to mem in 0.279026s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:44:48.720] [driver] [info] [Task Finished] Transform to mem in 0.279511s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:44:48.999] [driver] [info] [Task Finished] Transform to mem in 0.279046s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:44:49.277] [driver] [info] [Task Finished] Transform to mem in 0.278298s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:44:49.556] [driver] [info] [Task Finished] Transform to mem in 0.278866s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:44:49.835] [driver] [info] [Task Finished] Transform to mem in 0.278778s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:44:50.114] [driver] [info] [Task Finished] Transform to mem in 0.279143s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:44:50.393] [driver] [info] [Task Finished] Transform to mem in 0.278861s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:44:50.672] [driver] [info] [Task Finished] Transform to mem in 0.278780s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:44:50.951] [driver] [info] [Task Finished] Transform to mem in 0.279017s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:44:51.230] [driver] [info] [Task Finished] Transform to mem in 0.278924s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:44:51.509] [driver] [info] [Task Finished] Transform to mem in 0.278653s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:44:51.787] [driver] [info] [Task Finished] Transform to mem in 0.278473s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:44:52.066] [driver] [info] [Task Finished] Transform to mem in 0.278533s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:44:52.345] [driver] [info] [Task Finished] Transform to mem in 0.279283s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:44:52.624] [driver] [info] [Task Finished] Transform to mem in 0.278957s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:44:52.903] [driver] [info] [Task Finished] Transform to mem in 0.279055s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:44:53.182] [driver] [info] [Task Finished] Transform to mem in 0.278562s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:44:53.461] [driver] [info] [Task Finished] Transform to mem in 0.279210s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:44:53.739] [driver] [info] [Task Finished] Transform to mem in 0.278148s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:44:54.018] [driver] [info] [Task Finished] Transform to mem in 0.278630s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:44:54.296] [driver] [info] [Task Finished] Transform to mem in 0.278417s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:44:54.575] [driver] [info] [Task Finished] Transform to mem in 0.279401s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:44:54.855] [driver] [info] [Task Finished] Transform to mem in 0.279149s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:44:55.134] [driver] [info] [Task Finished] Transform to mem in 0.279207s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:44:55.413] [driver] [info] [Task Finished] Transform to mem in 0.278985s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:44:55.692] [driver] [info] [Task Finished] Transform to mem in 0.279637s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:44:55.972] [driver] [info] [Task Finished] Transform to mem in 0.279296s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:44:56.252] [driver] [info] [Task Finished] Transform to mem in 0.279758s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:44:56.531] [driver] [info] [Task Finished] Transform to mem in 0.279350s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:44:56.811] [driver] [info] [Task Finished] Transform to mem in 0.280261s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:44:57.092] [driver] [info] [Task Finished] Transform to mem in 0.280456s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:44:57.372] [driver] [info] [Task Finished] Transform to mem in 0.280731s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:44:57.652] [driver] [info] [Task Finished] Transform to mem in 0.279786s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:44:57.932] [driver] [info] [Task Finished] Transform to mem in 0.279678s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:44:58.212] [driver] [info] [Task Finished] Transform to mem in 0.279660s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:44:58.492] [driver] [info] [Task Finished] Transform to mem in 0.280611s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:44:58.772] [driver] [info] [Task Finished] Transform to mem in 0.279470s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:44:59.052] [driver] [info] [Task Finished] Transform to mem in 0.279978s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:44:59.332] [driver] [info] [Task Finished] Transform to mem in 0.280157s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:44:59.613] [driver] [info] [Task Finished] Transform to mem in 0.280870s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:44:59.892] [driver] [info] [Task Finished] Transform to mem in 0.279153s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:45:00.172] [driver] [info] [Task Finished] Transform to mem in 0.279784s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:45:00.451] [driver] [info] [Task Finished] Transform to mem in 0.279250s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:45:00.731] [driver] [info] [Task Finished] Transform to mem in 0.280047s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:45:01.012] [driver] [info] [Task Finished] Transform to mem in 0.280388s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:45:01.292] [driver] [info] [Task Finished] Transform to mem in 0.280026s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:45:01.571] [driver] [info] [Task Finished] Transform to mem in 0.279743s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:45:01.853] [driver] [info] [Task Finished] Transform to mem in 0.281273s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:45:02.132] [driver] [info] [Task Finished] Transform to mem in 0.279361s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:45:02.412] [driver] [info] [Task Finished] Transform to mem in 0.279559s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:45:02.691] [driver] [info] [Task Finished] Transform to mem in 0.279660s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:45:02.971] [driver] [info] [Task Finished] Transform to mem in 0.279546s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:45:03.250] [driver] [info] [Task Finished] Transform to mem in 0.279132s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:45:03.529] [driver] [info] [Task Finished] Transform to mem in 0.279197s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:45:03.808] [driver] [info] [Task Finished] Transform to mem in 0.278938s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:45:04.088] [driver] [info] [Task Finished] Transform to mem in 0.279429s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:45:04.367] [driver] [info] [Task Finished] Transform to mem in 0.279573s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:45:04.648] [driver] [info] [Task Finished] Transform to mem in 0.280504s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:45:04.927] [driver] [info] [Task Finished] Transform to mem in 0.278968s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:45:05.207] [driver] [info] [Task Finished] Transform to mem in 0.279928s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:45:05.486] [driver] [info] [Task Finished] Transform to mem in 0.279360s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:45:05.765] [driver] [info] [Task Finished] Transform to mem in 0.279261s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:45:06.045] [driver] [info] [Task Finished] Transform to mem in 0.279980s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:45:06.325] [driver] [info] [Task Finished] Transform to mem in 0.279839s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:45:06.605] [driver] [info] [Task Finished] Transform to mem in 0.279582s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:45:06.885] [driver] [info] [Task Finished] Transform to mem in 0.280671s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:45:07.165] [driver] [info] [Task Finished] Transform to mem in 0.279126s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:45:07.445] [driver] [info] [Task Finished] Transform to mem in 0.280434s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:45:07.725] [driver] [info] [Task Finished] Transform to mem in 0.279817s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:45:08.005] [driver] [info] [Task Finished] Transform to mem in 0.279700s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:45:08.285] [driver] [info] [Task Finished] Transform to mem in 0.280331s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:45:08.565] [driver] [info] [Task Finished] Transform to mem in 0.279810s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:45:08.845] [driver] [info] [Task Finished] Transform to mem in 0.279999s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:45:09.126] [driver] [info] [Task Finished] Transform to mem in 0.280795s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:45:09.406] [driver] [info] [Task Finished] Transform to mem in 0.280435s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:45:09.719] [driver] [info] [Task Finished] Transform to mem in 0.313185s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:45:09.719] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.7352s
[2021-03-25 10:45:09.719] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.7319s, 56350770 input rows, time to process 1 row via fast path: 0.000793813ms
[2021-03-25 10:45:09.719] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:45:09.724] [local ee] [info] compiled pure python pipeline in 0.004197s
[2021-03-25 10:45:09.724] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:45:09.725] [local ee] [info] Created 160 resolve tasks in 0.001173s
[2021-03-25 10:45:09.725] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:45:09.737] [driver] [info] [Task Finished] Resolve in 0.012181s
[2021-03-25 10:45:09.749] [driver] [info] [Task Finished] Resolve in 0.012241s
[2021-03-25 10:45:09.761] [driver] [info] [Task Finished] Resolve in 0.011848s
[2021-03-25 10:45:09.773] [driver] [info] [Task Finished] Resolve in 0.011928s
[2021-03-25 10:45:09.785] [driver] [info] [Task Finished] Resolve in 0.011935s
[2021-03-25 10:45:09.797] [driver] [info] [Task Finished] Resolve in 0.011831s
[2021-03-25 10:45:09.809] [driver] [info] [Task Finished] Resolve in 0.012095s
[2021-03-25 10:45:09.821] [driver] [info] [Task Finished] Resolve in 0.011792s
[2021-03-25 10:45:09.833] [driver] [info] [Task Finished] Resolve in 0.011936s
[2021-03-25 10:45:09.845] [driver] [info] [Task Finished] Resolve in 0.012037s
[2021-03-25 10:45:09.857] [driver] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:45:09.869] [driver] [info] [Task Finished] Resolve in 0.012081s
[2021-03-25 10:45:09.881] [driver] [info] [Task Finished] Resolve in 0.011896s
[2021-03-25 10:45:09.893] [driver] [info] [Task Finished] Resolve in 0.011845s
[2021-03-25 10:45:09.904] [driver] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:45:09.916] [driver] [info] [Task Finished] Resolve in 0.011791s
[2021-03-25 10:45:09.928] [driver] [info] [Task Finished] Resolve in 0.012058s
[2021-03-25 10:45:09.940] [driver] [info] [Task Finished] Resolve in 0.012046s
[2021-03-25 10:45:09.952] [driver] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:45:09.964] [driver] [info] [Task Finished] Resolve in 0.011843s
[2021-03-25 10:45:09.976] [driver] [info] [Task Finished] Resolve in 0.011890s
[2021-03-25 10:45:09.988] [driver] [info] [Task Finished] Resolve in 0.011982s
[2021-03-25 10:45:10.000] [driver] [info] [Task Finished] Resolve in 0.011962s
[2021-03-25 10:45:10.012] [driver] [info] [Task Finished] Resolve in 0.011808s
[2021-03-25 10:45:10.024] [driver] [info] [Task Finished] Resolve in 0.012123s
[2021-03-25 10:45:10.036] [driver] [info] [Task Finished] Resolve in 0.012071s
[2021-03-25 10:45:10.048] [driver] [info] [Task Finished] Resolve in 0.011948s
[2021-03-25 10:45:10.060] [driver] [info] [Task Finished] Resolve in 0.011931s
[2021-03-25 10:45:10.072] [driver] [info] [Task Finished] Resolve in 0.011889s
[2021-03-25 10:45:10.084] [driver] [info] [Task Finished] Resolve in 0.011868s
[2021-03-25 10:45:10.096] [driver] [info] [Task Finished] Resolve in 0.011881s
[2021-03-25 10:45:10.107] [driver] [info] [Task Finished] Resolve in 0.011878s
[2021-03-25 10:45:10.120] [driver] [info] [Task Finished] Resolve in 0.012020s
[2021-03-25 10:45:10.132] [driver] [info] [Task Finished] Resolve in 0.012107s
[2021-03-25 10:45:10.143] [driver] [info] [Task Finished] Resolve in 0.011831s
[2021-03-25 10:45:10.155] [driver] [info] [Task Finished] Resolve in 0.011893s
[2021-03-25 10:45:10.167] [driver] [info] [Task Finished] Resolve in 0.011931s
[2021-03-25 10:45:10.179] [driver] [info] [Task Finished] Resolve in 0.011998s
[2021-03-25 10:45:10.191] [driver] [info] [Task Finished] Resolve in 0.011900s
[2021-03-25 10:45:10.203] [driver] [info] [Task Finished] Resolve in 0.011812s
[2021-03-25 10:45:10.215] [driver] [info] [Task Finished] Resolve in 0.011842s
[2021-03-25 10:45:10.227] [driver] [info] [Task Finished] Resolve in 0.012075s
[2021-03-25 10:45:10.239] [driver] [info] [Task Finished] Resolve in 0.012038s
[2021-03-25 10:45:10.251] [driver] [info] [Task Finished] Resolve in 0.011930s
[2021-03-25 10:45:10.263] [driver] [info] [Task Finished] Resolve in 0.011884s
[2021-03-25 10:45:10.275] [driver] [info] [Task Finished] Resolve in 0.011885s
[2021-03-25 10:45:10.287] [driver] [info] [Task Finished] Resolve in 0.011896s
[2021-03-25 10:45:10.299] [driver] [info] [Task Finished] Resolve in 0.012011s
[2021-03-25 10:45:10.311] [driver] [info] [Task Finished] Resolve in 0.011819s
[2021-03-25 10:45:10.323] [driver] [info] [Task Finished] Resolve in 0.012065s
[2021-03-25 10:45:10.335] [driver] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:45:10.346] [driver] [info] [Task Finished] Resolve in 0.011834s
[2021-03-25 10:45:10.358] [driver] [info] [Task Finished] Resolve in 0.012051s
[2021-03-25 10:45:10.370] [driver] [info] [Task Finished] Resolve in 0.011863s
[2021-03-25 10:45:10.382] [driver] [info] [Task Finished] Resolve in 0.011892s
[2021-03-25 10:45:10.394] [driver] [info] [Task Finished] Resolve in 0.011800s
[2021-03-25 10:45:10.406] [driver] [info] [Task Finished] Resolve in 0.011782s
[2021-03-25 10:45:10.418] [driver] [info] [Task Finished] Resolve in 0.012214s
[2021-03-25 10:45:10.430] [driver] [info] [Task Finished] Resolve in 0.011878s
[2021-03-25 10:45:10.442] [driver] [info] [Task Finished] Resolve in 0.011864s
[2021-03-25 10:45:10.454] [driver] [info] [Task Finished] Resolve in 0.011870s
[2021-03-25 10:45:10.466] [driver] [info] [Task Finished] Resolve in 0.011820s
[2021-03-25 10:45:10.477] [driver] [info] [Task Finished] Resolve in 0.011914s
[2021-03-25 10:45:10.489] [driver] [info] [Task Finished] Resolve in 0.011914s
[2021-03-25 10:45:10.501] [driver] [info] [Task Finished] Resolve in 0.011905s
[2021-03-25 10:45:10.513] [driver] [info] [Task Finished] Resolve in 0.012050s
[2021-03-25 10:45:10.525] [driver] [info] [Task Finished] Resolve in 0.011809s
[2021-03-25 10:45:10.537] [driver] [info] [Task Finished] Resolve in 0.011848s
[2021-03-25 10:45:10.549] [driver] [info] [Task Finished] Resolve in 0.012102s
[2021-03-25 10:45:10.561] [driver] [info] [Task Finished] Resolve in 0.011821s
[2021-03-25 10:45:10.573] [driver] [info] [Task Finished] Resolve in 0.011835s
[2021-03-25 10:45:10.585] [driver] [info] [Task Finished] Resolve in 0.011792s
[2021-03-25 10:45:10.596] [driver] [info] [Task Finished] Resolve in 0.011795s
[2021-03-25 10:45:10.609] [driver] [info] [Task Finished] Resolve in 0.012268s
[2021-03-25 10:45:10.621] [driver] [info] [Task Finished] Resolve in 0.011808s
[2021-03-25 10:45:10.632] [driver] [info] [Task Finished] Resolve in 0.011845s
[2021-03-25 10:45:10.644] [driver] [info] [Task Finished] Resolve in 0.011904s
[2021-03-25 10:45:10.656] [driver] [info] [Task Finished] Resolve in 0.011853s
[2021-03-25 10:45:10.668] [driver] [info] [Task Finished] Resolve in 0.012006s
[2021-03-25 10:45:10.680] [driver] [info] [Task Finished] Resolve in 0.011839s
[2021-03-25 10:45:10.692] [driver] [info] [Task Finished] Resolve in 0.011785s
[2021-03-25 10:45:10.704] [driver] [info] [Task Finished] Resolve in 0.012068s
[2021-03-25 10:45:10.716] [driver] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:45:10.728] [driver] [info] [Task Finished] Resolve in 0.011904s
[2021-03-25 10:45:10.740] [driver] [info] [Task Finished] Resolve in 0.012016s
[2021-03-25 10:45:10.752] [driver] [info] [Task Finished] Resolve in 0.011840s
[2021-03-25 10:45:10.763] [driver] [info] [Task Finished] Resolve in 0.011829s
[2021-03-25 10:45:10.775] [driver] [info] [Task Finished] Resolve in 0.011852s
[2021-03-25 10:45:10.787] [driver] [info] [Task Finished] Resolve in 0.011773s
[2021-03-25 10:45:10.799] [driver] [info] [Task Finished] Resolve in 0.012274s
[2021-03-25 10:45:10.811] [driver] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:45:10.823] [driver] [info] [Task Finished] Resolve in 0.011813s
[2021-03-25 10:45:10.835] [driver] [info] [Task Finished] Resolve in 0.011972s
[2021-03-25 10:45:10.847] [driver] [info] [Task Finished] Resolve in 0.011843s
[2021-03-25 10:45:10.859] [driver] [info] [Task Finished] Resolve in 0.011982s
[2021-03-25 10:45:10.871] [driver] [info] [Task Finished] Resolve in 0.011880s
[2021-03-25 10:45:10.883] [driver] [info] [Task Finished] Resolve in 0.011773s
[2021-03-25 10:45:10.895] [driver] [info] [Task Finished] Resolve in 0.012069s
[2021-03-25 10:45:10.906] [driver] [info] [Task Finished] Resolve in 0.011818s
[2021-03-25 10:45:10.919] [driver] [info] [Task Finished] Resolve in 0.012037s
[2021-03-25 10:45:10.930] [driver] [info] [Task Finished] Resolve in 0.011886s
[2021-03-25 10:45:10.942] [driver] [info] [Task Finished] Resolve in 0.011872s
[2021-03-25 10:45:10.954] [driver] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:45:10.966] [driver] [info] [Task Finished] Resolve in 0.011851s
[2021-03-25 10:45:10.978] [driver] [info] [Task Finished] Resolve in 0.011832s
[2021-03-25 10:45:10.990] [driver] [info] [Task Finished] Resolve in 0.012130s
[2021-03-25 10:45:11.002] [driver] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:45:11.014] [driver] [info] [Task Finished] Resolve in 0.011812s
[2021-03-25 10:45:11.026] [driver] [info] [Task Finished] Resolve in 0.011919s
[2021-03-25 10:45:11.037] [driver] [info] [Task Finished] Resolve in 0.011881s
[2021-03-25 10:45:11.049] [driver] [info] [Task Finished] Resolve in 0.011935s
[2021-03-25 10:45:11.061] [driver] [info] [Task Finished] Resolve in 0.011865s
[2021-03-25 10:45:11.073] [driver] [info] [Task Finished] Resolve in 0.011752s
[2021-03-25 10:45:11.085] [driver] [info] [Task Finished] Resolve in 0.012060s
[2021-03-25 10:45:11.097] [driver] [info] [Task Finished] Resolve in 0.011840s
[2021-03-25 10:45:11.109] [driver] [info] [Task Finished] Resolve in 0.012035s
[2021-03-25 10:45:11.121] [driver] [info] [Task Finished] Resolve in 0.011884s
[2021-03-25 10:45:11.133] [driver] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:45:11.145] [driver] [info] [Task Finished] Resolve in 0.011808s
[2021-03-25 10:45:11.156] [driver] [info] [Task Finished] Resolve in 0.011918s
[2021-03-25 10:45:11.168] [driver] [info] [Task Finished] Resolve in 0.011927s
[2021-03-25 10:45:11.181] [driver] [info] [Task Finished] Resolve in 0.012113s
[2021-03-25 10:45:11.192] [driver] [info] [Task Finished] Resolve in 0.011837s
[2021-03-25 10:45:11.204] [driver] [info] [Task Finished] Resolve in 0.011839s
[2021-03-25 10:45:11.216] [driver] [info] [Task Finished] Resolve in 0.011921s
[2021-03-25 10:45:11.228] [driver] [info] [Task Finished] Resolve in 0.011966s
[2021-03-25 10:45:11.240] [driver] [info] [Task Finished] Resolve in 0.011862s
[2021-03-25 10:45:11.252] [driver] [info] [Task Finished] Resolve in 0.011896s
[2021-03-25 10:45:11.264] [driver] [info] [Task Finished] Resolve in 0.011785s
[2021-03-25 10:45:11.276] [driver] [info] [Task Finished] Resolve in 0.012065s
[2021-03-25 10:45:11.288] [driver] [info] [Task Finished] Resolve in 0.011915s
[2021-03-25 10:45:11.300] [driver] [info] [Task Finished] Resolve in 0.011931s
[2021-03-25 10:45:11.312] [driver] [info] [Task Finished] Resolve in 0.011909s
[2021-03-25 10:45:11.323] [driver] [info] [Task Finished] Resolve in 0.011831s
[2021-03-25 10:45:11.335] [driver] [info] [Task Finished] Resolve in 0.011792s
[2021-03-25 10:45:11.347] [driver] [info] [Task Finished] Resolve in 0.011882s
[2021-03-25 10:45:11.359] [driver] [info] [Task Finished] Resolve in 0.011917s
[2021-03-25 10:45:11.371] [driver] [info] [Task Finished] Resolve in 0.012068s
[2021-03-25 10:45:11.383] [driver] [info] [Task Finished] Resolve in 0.011864s
[2021-03-25 10:45:11.395] [driver] [info] [Task Finished] Resolve in 0.011855s
[2021-03-25 10:45:11.407] [driver] [info] [Task Finished] Resolve in 0.011887s
[2021-03-25 10:45:11.419] [driver] [info] [Task Finished] Resolve in 0.012060s
[2021-03-25 10:45:11.431] [driver] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:45:11.443] [driver] [info] [Task Finished] Resolve in 0.011891s
[2021-03-25 10:45:11.454] [driver] [info] [Task Finished] Resolve in 0.011731s
[2021-03-25 10:45:11.466] [driver] [info] [Task Finished] Resolve in 0.011966s
[2021-03-25 10:45:11.478] [driver] [info] [Task Finished] Resolve in 0.012047s
[2021-03-25 10:45:11.490] [driver] [info] [Task Finished] Resolve in 0.011853s
[2021-03-25 10:45:11.502] [driver] [info] [Task Finished] Resolve in 0.012002s
[2021-03-25 10:45:11.514] [driver] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:45:11.526] [driver] [info] [Task Finished] Resolve in 0.011767s
[2021-03-25 10:45:11.538] [driver] [info] [Task Finished] Resolve in 0.011981s
[2021-03-25 10:45:11.550] [driver] [info] [Task Finished] Resolve in 0.011826s
[2021-03-25 10:45:11.562] [driver] [info] [Task Finished] Resolve in 0.011954s
[2021-03-25 10:45:11.574] [driver] [info] [Task Finished] Resolve in 0.011899s
[2021-03-25 10:45:11.585] [driver] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:45:11.597] [driver] [info] [Task Finished] Resolve in 0.011891s
[2021-03-25 10:45:11.609] [driver] [info] [Task Finished] Resolve in 0.011984s
[2021-03-25 10:45:11.621] [driver] [info] [Task Finished] Resolve in 0.011800s
[2021-03-25 10:45:11.634] [driver] [info] [Task Finished] Resolve in 0.013207s
[2021-03-25 10:45:11.634] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 1.91511s
[2021-03-25 10:45:11.634] [local ee] [info] slow path for Stage 0: total wall clock time: 1.90732s, time to process 1 row via slow path: 0.000276586ms
[2021-03-25 10:45:11.634] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.91514s

[2021-03-25 10:45:11.667] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:45:11.976] [driver] [info] [Task Finished] write to file in 0.308564s (1798491 rows, 273.80 MB)
[2021-03-25 10:45:11.976] [global] [info] writing output took 0.341568s
[2021-03-25 10:45:11.976] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.341653s
[2021-03-25 10:45:11.976] [global] [info] [Transform Stage] Stage 0 took 47.493s
[2021-03-25 10:45:11.976] [global] [info] Query Execution took 47.5715s. (planning: 0.0784226s, execution: 47.4931s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.0050046443939208984
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 47.84819030761719 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0219356,"llvm_optimization_time_s":0.332278,"llvm_compilation_time_s":0.151373,"total_compilation_time_s":0.501027,"sampling_time_s":0.109645,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.7319,"fast_path_time_s":44.7352,"fast_path_per_row_time_ns":793.813,"slow_path_wall_time_s":1.90732,"slow_path_time_s":1.91511,"slow_path_per_row_time_ns":276.586}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.0050046443939208984, "jobTime": 47.84819030761719, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
