[2021-03-25 10:48:27.860] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:48:27.861] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:48:27.861] [local ee] [info] initializing LLVM backend
[2021-03-25 10:48:27.861] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:48:27.861] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:48:27.862] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 10:48:27.862] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:48:27.862] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:48:27.862] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:48:27.997] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:48:28.003] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:48:28.018] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:48:28.026] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:48:28.052] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:48:28.072] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:48:28.085] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:48:28.116] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:48:28.122] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:48:28.138] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:48:28.139] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:48:28.140] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:48:28.141] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:48:28.142] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:48:28.144] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:48:28.144] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:48:28.146] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:48:28.147] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:48:28.147] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:48:28.163] [logical planner] [info] logical optimization took 0.021891ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:48:28.163] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:48:28.164] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:48:28.165] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:48:28.165] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:48:28.166] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:48:28.166] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:48:28.167] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:48:28.168] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:48:28.169] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:48:28.170] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:48:28.170] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:48:28.172] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:48:28.172] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:48:28.173] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:48:28.174] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:48:28.175] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:48:28.176] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:48:28.176] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:48:28.177] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:48:28.177] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:48:28.178] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:48:28.179] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:48:28.180] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:48:28.181] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:48:28.181] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:48:28.183] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:48:28.183] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:48:28.184] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:48:28.184] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:48:28.216] [global] [info] Stage0 depends on: 
[2021-03-25 10:48:28.564] [global] [info] Optimization via LLVM passes took 0.330343 ms
[2021-03-25 10:48:28.715] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:48:28.715] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.498648s
[2021-03-25 10:48:28.715] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:48:28.998] [driver] [info] [Task Finished] Transform to mem in 0.282420s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:48:29.279] [driver] [info] [Task Finished] Transform to mem in 0.281550s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:48:29.561] [driver] [info] [Task Finished] Transform to mem in 0.281240s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:48:29.843] [driver] [info] [Task Finished] Transform to mem in 0.282260s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:48:30.125] [driver] [info] [Task Finished] Transform to mem in 0.282384s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:48:30.406] [driver] [info] [Task Finished] Transform to mem in 0.281021s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:48:30.687] [driver] [info] [Task Finished] Transform to mem in 0.280658s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:48:30.967] [driver] [info] [Task Finished] Transform to mem in 0.280019s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:48:31.247] [driver] [info] [Task Finished] Transform to mem in 0.279653s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:48:31.527] [driver] [info] [Task Finished] Transform to mem in 0.280210s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:48:31.807] [driver] [info] [Task Finished] Transform to mem in 0.280487s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:48:32.087] [driver] [info] [Task Finished] Transform to mem in 0.279666s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:48:32.367] [driver] [info] [Task Finished] Transform to mem in 0.280095s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:48:32.647] [driver] [info] [Task Finished] Transform to mem in 0.280283s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:48:32.928] [driver] [info] [Task Finished] Transform to mem in 0.280431s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:48:33.208] [driver] [info] [Task Finished] Transform to mem in 0.279822s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:48:33.489] [driver] [info] [Task Finished] Transform to mem in 0.280940s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:48:33.769] [driver] [info] [Task Finished] Transform to mem in 0.280054s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:48:34.049] [driver] [info] [Task Finished] Transform to mem in 0.280250s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:48:34.329] [driver] [info] [Task Finished] Transform to mem in 0.280228s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:48:34.610] [driver] [info] [Task Finished] Transform to mem in 0.280234s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:48:34.890] [driver] [info] [Task Finished] Transform to mem in 0.280160s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:48:35.171] [driver] [info] [Task Finished] Transform to mem in 0.281295s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:48:35.451] [driver] [info] [Task Finished] Transform to mem in 0.279593s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:48:35.730] [driver] [info] [Task Finished] Transform to mem in 0.279219s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:48:36.011] [driver] [info] [Task Finished] Transform to mem in 0.281143s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:48:36.292] [driver] [info] [Task Finished] Transform to mem in 0.280704s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:48:36.572] [driver] [info] [Task Finished] Transform to mem in 0.280293s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:48:36.852] [driver] [info] [Task Finished] Transform to mem in 0.279629s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:48:37.131] [driver] [info] [Task Finished] Transform to mem in 0.279159s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:48:37.410] [driver] [info] [Task Finished] Transform to mem in 0.279452s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:48:37.690] [driver] [info] [Task Finished] Transform to mem in 0.279631s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:48:37.969] [driver] [info] [Task Finished] Transform to mem in 0.279408s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:48:38.249] [driver] [info] [Task Finished] Transform to mem in 0.279836s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:48:38.529] [driver] [info] [Task Finished] Transform to mem in 0.279376s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:48:38.809] [driver] [info] [Task Finished] Transform to mem in 0.280421s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:48:39.090] [driver] [info] [Task Finished] Transform to mem in 0.280560s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:48:39.370] [driver] [info] [Task Finished] Transform to mem in 0.280722s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:48:39.649] [driver] [info] [Task Finished] Transform to mem in 0.278870s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:48:39.929] [driver] [info] [Task Finished] Transform to mem in 0.280034s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:48:40.210] [driver] [info] [Task Finished] Transform to mem in 0.280384s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:48:40.490] [driver] [info] [Task Finished] Transform to mem in 0.280537s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:48:40.769] [driver] [info] [Task Finished] Transform to mem in 0.279042s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:48:41.050] [driver] [info] [Task Finished] Transform to mem in 0.280474s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:48:41.331] [driver] [info] [Task Finished] Transform to mem in 0.279842s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:48:41.612] [driver] [info] [Task Finished] Transform to mem in 0.280879s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:48:41.892] [driver] [info] [Task Finished] Transform to mem in 0.279803s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:48:42.173] [driver] [info] [Task Finished] Transform to mem in 0.280542s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:48:42.453] [driver] [info] [Task Finished] Transform to mem in 0.280501s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:48:42.733] [driver] [info] [Task Finished] Transform to mem in 0.279780s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:48:43.012] [driver] [info] [Task Finished] Transform to mem in 0.279337s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:48:43.291] [driver] [info] [Task Finished] Transform to mem in 0.278884s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:48:43.571] [driver] [info] [Task Finished] Transform to mem in 0.279557s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:48:43.853] [driver] [info] [Task Finished] Transform to mem in 0.282162s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:48:44.133] [driver] [info] [Task Finished] Transform to mem in 0.280173s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:48:44.413] [driver] [info] [Task Finished] Transform to mem in 0.280124s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:48:44.693] [driver] [info] [Task Finished] Transform to mem in 0.279331s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:48:44.974] [driver] [info] [Task Finished] Transform to mem in 0.281127s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:48:45.254] [driver] [info] [Task Finished] Transform to mem in 0.280523s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:48:45.534] [driver] [info] [Task Finished] Transform to mem in 0.279318s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:48:45.813] [driver] [info] [Task Finished] Transform to mem in 0.279653s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:48:46.094] [driver] [info] [Task Finished] Transform to mem in 0.280748s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:48:46.373] [driver] [info] [Task Finished] Transform to mem in 0.279344s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:48:46.654] [driver] [info] [Task Finished] Transform to mem in 0.280965s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:48:46.934] [driver] [info] [Task Finished] Transform to mem in 0.279818s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:48:47.215] [driver] [info] [Task Finished] Transform to mem in 0.280740s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:48:47.495] [driver] [info] [Task Finished] Transform to mem in 0.280011s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:48:47.775] [driver] [info] [Task Finished] Transform to mem in 0.280405s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:48:48.055] [driver] [info] [Task Finished] Transform to mem in 0.279713s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:48:48.336] [driver] [info] [Task Finished] Transform to mem in 0.280289s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:48:48.615] [driver] [info] [Task Finished] Transform to mem in 0.279390s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:48:48.894] [driver] [info] [Task Finished] Transform to mem in 0.279229s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:48:49.174] [driver] [info] [Task Finished] Transform to mem in 0.279806s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:48:49.454] [driver] [info] [Task Finished] Transform to mem in 0.279875s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:48:49.734] [driver] [info] [Task Finished] Transform to mem in 0.279700s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:48:50.014] [driver] [info] [Task Finished] Transform to mem in 0.280111s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:48:50.294] [driver] [info] [Task Finished] Transform to mem in 0.280227s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:48:50.574] [driver] [info] [Task Finished] Transform to mem in 0.280197s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:48:50.854] [driver] [info] [Task Finished] Transform to mem in 0.279358s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:48:51.134] [driver] [info] [Task Finished] Transform to mem in 0.279995s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:48:51.412] [driver] [info] [Task Finished] Transform to mem in 0.278813s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:48:51.692] [driver] [info] [Task Finished] Transform to mem in 0.279339s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:48:51.972] [driver] [info] [Task Finished] Transform to mem in 0.280001s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:48:52.251] [driver] [info] [Task Finished] Transform to mem in 0.278900s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:48:52.532] [driver] [info] [Task Finished] Transform to mem in 0.281431s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:48:52.812] [driver] [info] [Task Finished] Transform to mem in 0.279605s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:48:53.092] [driver] [info] [Task Finished] Transform to mem in 0.280181s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:48:53.372] [driver] [info] [Task Finished] Transform to mem in 0.279998s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:48:53.652] [driver] [info] [Task Finished] Transform to mem in 0.280192s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:48:53.933] [driver] [info] [Task Finished] Transform to mem in 0.281189s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:48:54.214] [driver] [info] [Task Finished] Transform to mem in 0.280153s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:48:54.495] [driver] [info] [Task Finished] Transform to mem in 0.281289s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:48:54.775] [driver] [info] [Task Finished] Transform to mem in 0.280190s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:48:55.055] [driver] [info] [Task Finished] Transform to mem in 0.280317s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:48:55.335] [driver] [info] [Task Finished] Transform to mem in 0.279802s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:48:55.615] [driver] [info] [Task Finished] Transform to mem in 0.279902s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:48:55.895] [driver] [info] [Task Finished] Transform to mem in 0.279593s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:48:56.174] [driver] [info] [Task Finished] Transform to mem in 0.279225s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:48:56.454] [driver] [info] [Task Finished] Transform to mem in 0.279804s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:48:56.734] [driver] [info] [Task Finished] Transform to mem in 0.279898s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:48:57.014] [driver] [info] [Task Finished] Transform to mem in 0.280466s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:48:57.294] [driver] [info] [Task Finished] Transform to mem in 0.279796s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:48:57.573] [driver] [info] [Task Finished] Transform to mem in 0.278505s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:48:57.852] [driver] [info] [Task Finished] Transform to mem in 0.279003s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:48:58.131] [driver] [info] [Task Finished] Transform to mem in 0.278980s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:48:58.411] [driver] [info] [Task Finished] Transform to mem in 0.279969s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:48:58.690] [driver] [info] [Task Finished] Transform to mem in 0.279023s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:48:58.969] [driver] [info] [Task Finished] Transform to mem in 0.279593s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:48:59.249] [driver] [info] [Task Finished] Transform to mem in 0.279554s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:48:59.530] [driver] [info] [Task Finished] Transform to mem in 0.281024s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:48:59.810] [driver] [info] [Task Finished] Transform to mem in 0.279843s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:49:00.091] [driver] [info] [Task Finished] Transform to mem in 0.280878s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:49:00.370] [driver] [info] [Task Finished] Transform to mem in 0.279742s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:49:00.652] [driver] [info] [Task Finished] Transform to mem in 0.282063s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:49:00.933] [driver] [info] [Task Finished] Transform to mem in 0.280871s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:49:01.214] [driver] [info] [Task Finished] Transform to mem in 0.280307s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:49:01.495] [driver] [info] [Task Finished] Transform to mem in 0.280962s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:49:01.774] [driver] [info] [Task Finished] Transform to mem in 0.279737s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:49:02.055] [driver] [info] [Task Finished] Transform to mem in 0.280834s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:49:02.336] [driver] [info] [Task Finished] Transform to mem in 0.281202s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:49:02.617] [driver] [info] [Task Finished] Transform to mem in 0.281046s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:49:02.898] [driver] [info] [Task Finished] Transform to mem in 0.280898s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:49:03.179] [driver] [info] [Task Finished] Transform to mem in 0.280204s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:49:03.459] [driver] [info] [Task Finished] Transform to mem in 0.279951s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:49:03.739] [driver] [info] [Task Finished] Transform to mem in 0.279905s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:49:04.018] [driver] [info] [Task Finished] Transform to mem in 0.279645s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:49:04.298] [driver] [info] [Task Finished] Transform to mem in 0.279799s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:49:04.579] [driver] [info] [Task Finished] Transform to mem in 0.280990s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:49:04.860] [driver] [info] [Task Finished] Transform to mem in 0.281400s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:49:05.141] [driver] [info] [Task Finished] Transform to mem in 0.280754s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:49:05.422] [driver] [info] [Task Finished] Transform to mem in 0.280598s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:49:05.704] [driver] [info] [Task Finished] Transform to mem in 0.282008s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:49:05.984] [driver] [info] [Task Finished] Transform to mem in 0.279990s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:49:06.265] [driver] [info] [Task Finished] Transform to mem in 0.281485s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:49:06.546] [driver] [info] [Task Finished] Transform to mem in 0.280903s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:49:06.827] [driver] [info] [Task Finished] Transform to mem in 0.280568s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:49:07.108] [driver] [info] [Task Finished] Transform to mem in 0.281121s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:49:07.388] [driver] [info] [Task Finished] Transform to mem in 0.280318s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:49:07.669] [driver] [info] [Task Finished] Transform to mem in 0.280556s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:49:07.949] [driver] [info] [Task Finished] Transform to mem in 0.280425s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:49:08.231] [driver] [info] [Task Finished] Transform to mem in 0.281955s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:49:08.512] [driver] [info] [Task Finished] Transform to mem in 0.280319s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:49:08.791] [driver] [info] [Task Finished] Transform to mem in 0.279804s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:49:09.071] [driver] [info] [Task Finished] Transform to mem in 0.279622s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:49:09.351] [driver] [info] [Task Finished] Transform to mem in 0.279602s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:49:09.633] [driver] [info] [Task Finished] Transform to mem in 0.281927s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:49:09.913] [driver] [info] [Task Finished] Transform to mem in 0.280801s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:49:10.194] [driver] [info] [Task Finished] Transform to mem in 0.280874s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:49:10.475] [driver] [info] [Task Finished] Transform to mem in 0.280448s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:49:10.756] [driver] [info] [Task Finished] Transform to mem in 0.281400s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:49:11.036] [driver] [info] [Task Finished] Transform to mem in 0.279906s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:49:11.317] [driver] [info] [Task Finished] Transform to mem in 0.280640s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:49:11.597] [driver] [info] [Task Finished] Transform to mem in 0.279833s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:49:11.878] [driver] [info] [Task Finished] Transform to mem in 0.280904s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:49:12.159] [driver] [info] [Task Finished] Transform to mem in 0.281103s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:49:12.439] [driver] [info] [Task Finished] Transform to mem in 0.280570s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:49:12.720] [driver] [info] [Task Finished] Transform to mem in 0.280771s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:49:13.002] [driver] [info] [Task Finished] Transform to mem in 0.281552s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:49:13.283] [driver] [info] [Task Finished] Transform to mem in 0.281755s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:49:13.598] [driver] [info] [Task Finished] Transform to mem in 0.314605s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:49:13.598] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.8832s
[2021-03-25 10:49:13.598] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.8784s, 56350770 input rows, time to process 1 row via fast path: 0.000796412ms
[2021-03-25 10:49:13.598] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:49:13.603] [local ee] [info] compiled pure python pipeline in 0.004225s
[2021-03-25 10:49:13.603] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:49:13.604] [local ee] [info] Created 160 resolve tasks in 0.001185s
[2021-03-25 10:49:13.604] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:49:13.616] [driver] [info] [Task Finished] Resolve in 0.012072s
[2021-03-25 10:49:13.628] [driver] [info] [Task Finished] Resolve in 0.012011s
[2021-03-25 10:49:13.640] [driver] [info] [Task Finished] Resolve in 0.011852s
[2021-03-25 10:49:13.652] [driver] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:49:13.663] [driver] [info] [Task Finished] Resolve in 0.011824s
[2021-03-25 10:49:13.675] [driver] [info] [Task Finished] Resolve in 0.011730s
[2021-03-25 10:49:13.687] [driver] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:49:13.699] [driver] [info] [Task Finished] Resolve in 0.011884s
[2021-03-25 10:49:13.711] [driver] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:49:13.723] [driver] [info] [Task Finished] Resolve in 0.011923s
[2021-03-25 10:49:13.734] [driver] [info] [Task Finished] Resolve in 0.011732s
[2021-03-25 10:49:13.746] [driver] [info] [Task Finished] Resolve in 0.011783s
[2021-03-25 10:49:13.758] [driver] [info] [Task Finished] Resolve in 0.011940s
[2021-03-25 10:49:13.770] [driver] [info] [Task Finished] Resolve in 0.011804s
[2021-03-25 10:49:13.782] [driver] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:49:13.793] [driver] [info] [Task Finished] Resolve in 0.011683s
[2021-03-25 10:49:13.805] [driver] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:49:13.817] [driver] [info] [Task Finished] Resolve in 0.011919s
[2021-03-25 10:49:13.829] [driver] [info] [Task Finished] Resolve in 0.011952s
[2021-03-25 10:49:13.841] [driver] [info] [Task Finished] Resolve in 0.011804s
[2021-03-25 10:49:13.853] [driver] [info] [Task Finished] Resolve in 0.011786s
[2021-03-25 10:49:13.865] [driver] [info] [Task Finished] Resolve in 0.011734s
[2021-03-25 10:49:13.876] [driver] [info] [Task Finished] Resolve in 0.011813s
[2021-03-25 10:49:13.888] [driver] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:49:13.900] [driver] [info] [Task Finished] Resolve in 0.011850s
[2021-03-25 10:49:13.912] [driver] [info] [Task Finished] Resolve in 0.011947s
[2021-03-25 10:49:13.924] [driver] [info] [Task Finished] Resolve in 0.011725s
[2021-03-25 10:49:13.936] [driver] [info] [Task Finished] Resolve in 0.011796s
[2021-03-25 10:49:13.947] [driver] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:49:13.959] [driver] [info] [Task Finished] Resolve in 0.011903s
[2021-03-25 10:49:13.971] [driver] [info] [Task Finished] Resolve in 0.011818s
[2021-03-25 10:49:13.983] [driver] [info] [Task Finished] Resolve in 0.011725s
[2021-03-25 10:49:13.995] [driver] [info] [Task Finished] Resolve in 0.011772s
[2021-03-25 10:49:14.007] [driver] [info] [Task Finished] Resolve in 0.011985s
[2021-03-25 10:49:14.019] [driver] [info] [Task Finished] Resolve in 0.011936s
[2021-03-25 10:49:14.030] [driver] [info] [Task Finished] Resolve in 0.011803s
[2021-03-25 10:49:14.042] [driver] [info] [Task Finished] Resolve in 0.011797s
[2021-03-25 10:49:14.054] [driver] [info] [Task Finished] Resolve in 0.011735s
[2021-03-25 10:49:14.066] [driver] [info] [Task Finished] Resolve in 0.011796s
[2021-03-25 10:49:14.078] [driver] [info] [Task Finished] Resolve in 0.011803s
[2021-03-25 10:49:14.090] [driver] [info] [Task Finished] Resolve in 0.011893s
[2021-03-25 10:49:14.102] [driver] [info] [Task Finished] Resolve in 0.011985s
[2021-03-25 10:49:14.113] [driver] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:49:14.125] [driver] [info] [Task Finished] Resolve in 0.011775s
[2021-03-25 10:49:14.137] [driver] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:49:14.149] [driver] [info] [Task Finished] Resolve in 0.011973s
[2021-03-25 10:49:14.161] [driver] [info] [Task Finished] Resolve in 0.011794s
[2021-03-25 10:49:14.173] [driver] [info] [Task Finished] Resolve in 0.011741s
[2021-03-25 10:49:14.184] [driver] [info] [Task Finished] Resolve in 0.011725s
[2021-03-25 10:49:14.196] [driver] [info] [Task Finished] Resolve in 0.011971s
[2021-03-25 10:49:14.208] [driver] [info] [Task Finished] Resolve in 0.011888s
[2021-03-25 10:49:14.220] [driver] [info] [Task Finished] Resolve in 0.011854s
[2021-03-25 10:49:14.232] [driver] [info] [Task Finished] Resolve in 0.011841s
[2021-03-25 10:49:14.244] [driver] [info] [Task Finished] Resolve in 0.011781s
[2021-03-25 10:49:14.255] [driver] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:49:14.267] [driver] [info] [Task Finished] Resolve in 0.011717s
[2021-03-25 10:49:14.279] [driver] [info] [Task Finished] Resolve in 0.011912s
[2021-03-25 10:49:14.291] [driver] [info] [Task Finished] Resolve in 0.012005s
[2021-03-25 10:49:14.303] [driver] [info] [Task Finished] Resolve in 0.011743s
[2021-03-25 10:49:14.315] [driver] [info] [Task Finished] Resolve in 0.011791s
[2021-03-25 10:49:14.327] [driver] [info] [Task Finished] Resolve in 0.011808s
[2021-03-25 10:49:14.339] [driver] [info] [Task Finished] Resolve in 0.011951s
[2021-03-25 10:49:14.350] [driver] [info] [Task Finished] Resolve in 0.011835s
[2021-03-25 10:49:14.362] [driver] [info] [Task Finished] Resolve in 0.011727s
[2021-03-25 10:49:14.374] [driver] [info] [Task Finished] Resolve in 0.011721s
[2021-03-25 10:49:14.386] [driver] [info] [Task Finished] Resolve in 0.012003s
[2021-03-25 10:49:14.398] [driver] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:49:14.410] [driver] [info] [Task Finished] Resolve in 0.011915s
[2021-03-25 10:49:14.421] [driver] [info] [Task Finished] Resolve in 0.011822s
[2021-03-25 10:49:14.433] [driver] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:49:14.445] [driver] [info] [Task Finished] Resolve in 0.011815s
[2021-03-25 10:49:14.457] [driver] [info] [Task Finished] Resolve in 0.011743s
[2021-03-25 10:49:14.469] [driver] [info] [Task Finished] Resolve in 0.011927s
[2021-03-25 10:49:14.481] [driver] [info] [Task Finished] Resolve in 0.012022s
[2021-03-25 10:49:14.493] [driver] [info] [Task Finished] Resolve in 0.011746s
[2021-03-25 10:49:14.504] [driver] [info] [Task Finished] Resolve in 0.011908s
[2021-03-25 10:49:14.516] [driver] [info] [Task Finished] Resolve in 0.011820s
[2021-03-25 10:49:14.528] [driver] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:49:14.540] [driver] [info] [Task Finished] Resolve in 0.011866s
[2021-03-25 10:49:14.552] [driver] [info] [Task Finished] Resolve in 0.011732s
[2021-03-25 10:49:14.564] [driver] [info] [Task Finished] Resolve in 0.011735s
[2021-03-25 10:49:14.576] [driver] [info] [Task Finished] Resolve in 0.012003s
[2021-03-25 10:49:14.587] [driver] [info] [Task Finished] Resolve in 0.011764s
[2021-03-25 10:49:14.599] [driver] [info] [Task Finished] Resolve in 0.011932s
[2021-03-25 10:49:14.611] [driver] [info] [Task Finished] Resolve in 0.011843s
[2021-03-25 10:49:14.623] [driver] [info] [Task Finished] Resolve in 0.011774s
[2021-03-25 10:49:14.635] [driver] [info] [Task Finished] Resolve in 0.011766s
[2021-03-25 10:49:14.647] [driver] [info] [Task Finished] Resolve in 0.011777s
[2021-03-25 10:49:14.658] [driver] [info] [Task Finished] Resolve in 0.011876s
[2021-03-25 10:49:14.670] [driver] [info] [Task Finished] Resolve in 0.012022s
[2021-03-25 10:49:14.682] [driver] [info] [Task Finished] Resolve in 0.011757s
[2021-03-25 10:49:14.694] [driver] [info] [Task Finished] Resolve in 0.011759s
[2021-03-25 10:49:14.706] [driver] [info] [Task Finished] Resolve in 0.011856s
[2021-03-25 10:49:14.718] [driver] [info] [Task Finished] Resolve in 0.011867s
[2021-03-25 10:49:14.730] [driver] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:49:14.741] [driver] [info] [Task Finished] Resolve in 0.011824s
[2021-03-25 10:49:14.753] [driver] [info] [Task Finished] Resolve in 0.011699s
[2021-03-25 10:49:14.765] [driver] [info] [Task Finished] Resolve in 0.012000s
[2021-03-25 10:49:14.777] [driver] [info] [Task Finished] Resolve in 0.011772s
[2021-03-25 10:49:14.789] [driver] [info] [Task Finished] Resolve in 0.011948s
[2021-03-25 10:49:14.801] [driver] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:49:14.813] [driver] [info] [Task Finished] Resolve in 0.011797s
[2021-03-25 10:49:14.824] [driver] [info] [Task Finished] Resolve in 0.011688s
[2021-03-25 10:49:14.836] [driver] [info] [Task Finished] Resolve in 0.011820s
[2021-03-25 10:49:14.848] [driver] [info] [Task Finished] Resolve in 0.011795s
[2021-03-25 10:49:14.860] [driver] [info] [Task Finished] Resolve in 0.012093s
[2021-03-25 10:49:14.872] [driver] [info] [Task Finished] Resolve in 0.011777s
[2021-03-25 10:49:14.884] [driver] [info] [Task Finished] Resolve in 0.011755s
[2021-03-25 10:49:14.895] [driver] [info] [Task Finished] Resolve in 0.011819s
[2021-03-25 10:49:14.907] [driver] [info] [Task Finished] Resolve in 0.011757s
[2021-03-25 10:49:14.919] [driver] [info] [Task Finished] Resolve in 0.011914s
[2021-03-25 10:49:14.931] [driver] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:49:14.943] [driver] [info] [Task Finished] Resolve in 0.011671s
[2021-03-25 10:49:14.955] [driver] [info] [Task Finished] Resolve in 0.011994s
[2021-03-25 10:49:14.966] [driver] [info] [Task Finished] Resolve in 0.011766s
[2021-03-25 10:49:14.978] [driver] [info] [Task Finished] Resolve in 0.011911s
[2021-03-25 10:49:14.990] [driver] [info] [Task Finished] Resolve in 0.011897s
[2021-03-25 10:49:15.002] [driver] [info] [Task Finished] Resolve in 0.011732s
[2021-03-25 10:49:15.014] [driver] [info] [Task Finished] Resolve in 0.011718s
[2021-03-25 10:49:15.026] [driver] [info] [Task Finished] Resolve in 0.011825s
[2021-03-25 10:49:15.037] [driver] [info] [Task Finished] Resolve in 0.011678s
[2021-03-25 10:49:15.049] [driver] [info] [Task Finished] Resolve in 0.012181s
[2021-03-25 10:49:15.061] [driver] [info] [Task Finished] Resolve in 0.011777s
[2021-03-25 10:49:15.073] [driver] [info] [Task Finished] Resolve in 0.011769s
[2021-03-25 10:49:15.085] [driver] [info] [Task Finished] Resolve in 0.011868s
[2021-03-25 10:49:15.097] [driver] [info] [Task Finished] Resolve in 0.011756s
[2021-03-25 10:49:15.109] [driver] [info] [Task Finished] Resolve in 0.011926s
[2021-03-25 10:49:15.120] [driver] [info] [Task Finished] Resolve in 0.011858s
[2021-03-25 10:49:15.132] [driver] [info] [Task Finished] Resolve in 0.011674s
[2021-03-25 10:49:15.144] [driver] [info] [Task Finished] Resolve in 0.011994s
[2021-03-25 10:49:15.156] [driver] [info] [Task Finished] Resolve in 0.011767s
[2021-03-25 10:49:15.168] [driver] [info] [Task Finished] Resolve in 0.011831s
[2021-03-25 10:49:15.180] [driver] [info] [Task Finished] Resolve in 0.011951s
[2021-03-25 10:49:15.192] [driver] [info] [Task Finished] Resolve in 0.011757s
[2021-03-25 10:49:15.203] [driver] [info] [Task Finished] Resolve in 0.011719s
[2021-03-25 10:49:15.215] [driver] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:49:15.227] [driver] [info] [Task Finished] Resolve in 0.011674s
[2021-03-25 10:49:15.239] [driver] [info] [Task Finished] Resolve in 0.012137s
[2021-03-25 10:49:15.251] [driver] [info] [Task Finished] Resolve in 0.011811s
[2021-03-25 10:49:15.262] [driver] [info] [Task Finished] Resolve in 0.011746s
[2021-03-25 10:49:15.274] [driver] [info] [Task Finished] Resolve in 0.011808s
[2021-03-25 10:49:15.286] [driver] [info] [Task Finished] Resolve in 0.011782s
[2021-03-25 10:49:15.298] [driver] [info] [Task Finished] Resolve in 0.011819s
[2021-03-25 10:49:15.310] [driver] [info] [Task Finished] Resolve in 0.011898s
[2021-03-25 10:49:15.322] [driver] [info] [Task Finished] Resolve in 0.011662s
[2021-03-25 10:49:15.333] [driver] [info] [Task Finished] Resolve in 0.011900s
[2021-03-25 10:49:15.345] [driver] [info] [Task Finished] Resolve in 0.011825s
[2021-03-25 10:49:15.357] [driver] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:49:15.369] [driver] [info] [Task Finished] Resolve in 0.012015s
[2021-03-25 10:49:15.381] [driver] [info] [Task Finished] Resolve in 0.011767s
[2021-03-25 10:49:15.393] [driver] [info] [Task Finished] Resolve in 0.011738s
[2021-03-25 10:49:15.405] [driver] [info] [Task Finished] Resolve in 0.011840s
[2021-03-25 10:49:15.416] [driver] [info] [Task Finished] Resolve in 0.011698s
[2021-03-25 10:49:15.428] [driver] [info] [Task Finished] Resolve in 0.012089s
[2021-03-25 10:49:15.440] [driver] [info] [Task Finished] Resolve in 0.011891s
[2021-03-25 10:49:15.452] [driver] [info] [Task Finished] Resolve in 0.011766s
[2021-03-25 10:49:15.464] [driver] [info] [Task Finished] Resolve in 0.011810s
[2021-03-25 10:49:15.476] [driver] [info] [Task Finished] Resolve in 0.011755s
[2021-03-25 10:49:15.487] [driver] [info] [Task Finished] Resolve in 0.011744s
[2021-03-25 10:49:15.501] [driver] [info] [Task Finished] Resolve in 0.013448s
[2021-03-25 10:49:15.501] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 1.90272s
[2021-03-25 10:49:15.501] [local ee] [info] slow path for Stage 0: total wall clock time: 1.89487s, time to process 1 row via slow path: 0.000274781ms
[2021-03-25 10:49:15.501] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.90275s

[2021-03-25 10:49:15.534] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:49:15.840] [driver] [info] [Task Finished] write to file in 0.306526s (1798491 rows, 273.80 MB)
[2021-03-25 10:49:15.841] [global] [info] writing output took 0.339603s
[2021-03-25 10:49:15.841] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.339689s
[2021-03-25 10:49:15.841] [global] [info] [Transform Stage] Stage 0 took 47.6244s
[2021-03-25 10:49:15.841] [global] [info] Query Execution took 47.7026s. (planning: 0.0782192s, execution: 47.6244s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.00498509407043457
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 47.97999286651611 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0218914,"llvm_optimization_time_s":0.330343,"llvm_compilation_time_s":0.15094,"total_compilation_time_s":0.498646,"sampling_time_s":0.110778,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.8784,"fast_path_time_s":44.8833,"fast_path_per_row_time_ns":796.412,"slow_path_wall_time_s":1.89487,"slow_path_time_s":1.90272,"slow_path_per_row_time_ns":274.781}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.00498509407043457, "jobTime": 47.97999286651611, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
