[2021-03-25 10:50:04.914] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:50:04.915] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:50:04.915] [local ee] [info] initializing LLVM backend
[2021-03-25 10:50:04.915] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:50:04.915] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:50:04.916] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 10:50:04.916] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:50:04.916] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:50:04.916] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:50:05.055] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:05.061] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:05.076] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:05.084] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:05.110] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:05.130] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:05.143] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:05.175] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:05.181] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:05.196] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:50:05.198] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:05.199] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:05.200] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:50:05.201] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:05.202] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:05.203] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:50:05.204] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:05.205] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:05.206] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:50:05.222] [logical planner] [info] logical optimization took 0.021936ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:50:05.222] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:50:05.223] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:50:05.223] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:50:05.224] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:50:05.225] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:50:05.225] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:50:05.226] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:50:05.227] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:50:05.228] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:50:05.229] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:50:05.229] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:50:05.230] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:50:05.231] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:50:05.231] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:50:05.233] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:50:05.234] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:50:05.235] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:50:05.235] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:50:05.236] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:50:05.236] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:50:05.237] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:50:05.238] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:50:05.239] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:50:05.240] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:50:05.240] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:50:05.241] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:50:05.242] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:50:05.243] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:50:05.243] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:50:05.275] [global] [info] Stage0 depends on: 
[2021-03-25 10:50:05.622] [global] [info] Optimization via LLVM passes took 0.329855 ms
[2021-03-25 10:50:05.773] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:50:05.773] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.498279s
[2021-03-25 10:50:05.774] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:50:06.055] [driver] [info] [Task Finished] Transform to mem in 0.281736s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:50:06.335] [driver] [info] [Task Finished] Transform to mem in 0.279871s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:50:06.615] [driver] [info] [Task Finished] Transform to mem in 0.279339s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:50:06.895] [driver] [info] [Task Finished] Transform to mem in 0.280123s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:50:07.174] [driver] [info] [Task Finished] Transform to mem in 0.279473s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:50:07.454] [driver] [info] [Task Finished] Transform to mem in 0.279225s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:50:07.733] [driver] [info] [Task Finished] Transform to mem in 0.278993s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:50:08.011] [driver] [info] [Task Finished] Transform to mem in 0.278760s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:50:08.289] [driver] [info] [Task Finished] Transform to mem in 0.278138s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:50:08.569] [driver] [info] [Task Finished] Transform to mem in 0.279790s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:50:08.847] [driver] [info] [Task Finished] Transform to mem in 0.278178s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:50:09.126] [driver] [info] [Task Finished] Transform to mem in 0.278147s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:50:09.404] [driver] [info] [Task Finished] Transform to mem in 0.278140s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:50:09.682] [driver] [info] [Task Finished] Transform to mem in 0.278539s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:50:09.960] [driver] [info] [Task Finished] Transform to mem in 0.277912s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:50:10.239] [driver] [info] [Task Finished] Transform to mem in 0.278683s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:50:10.519] [driver] [info] [Task Finished] Transform to mem in 0.279775s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:50:10.797] [driver] [info] [Task Finished] Transform to mem in 0.278375s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:50:11.077] [driver] [info] [Task Finished] Transform to mem in 0.279428s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:50:11.355] [driver] [info] [Task Finished] Transform to mem in 0.278761s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:50:11.634] [driver] [info] [Task Finished] Transform to mem in 0.278435s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:50:11.913] [driver] [info] [Task Finished] Transform to mem in 0.278986s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:50:12.191] [driver] [info] [Task Finished] Transform to mem in 0.278451s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:50:12.470] [driver] [info] [Task Finished] Transform to mem in 0.278540s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:50:12.749] [driver] [info] [Task Finished] Transform to mem in 0.278798s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:50:13.027] [driver] [info] [Task Finished] Transform to mem in 0.278344s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:50:13.306] [driver] [info] [Task Finished] Transform to mem in 0.278593s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:50:13.584] [driver] [info] [Task Finished] Transform to mem in 0.278046s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:50:13.862] [driver] [info] [Task Finished] Transform to mem in 0.277922s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:50:14.140] [driver] [info] [Task Finished] Transform to mem in 0.278464s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:50:14.419] [driver] [info] [Task Finished] Transform to mem in 0.278402s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:50:14.697] [driver] [info] [Task Finished] Transform to mem in 0.278181s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:50:14.975] [driver] [info] [Task Finished] Transform to mem in 0.278506s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:50:15.254] [driver] [info] [Task Finished] Transform to mem in 0.278672s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:50:15.533] [driver] [info] [Task Finished] Transform to mem in 0.278503s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:50:15.811] [driver] [info] [Task Finished] Transform to mem in 0.278572s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:50:16.089] [driver] [info] [Task Finished] Transform to mem in 0.278259s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:50:16.368] [driver] [info] [Task Finished] Transform to mem in 0.278415s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:50:16.646] [driver] [info] [Task Finished] Transform to mem in 0.277982s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:50:16.924] [driver] [info] [Task Finished] Transform to mem in 0.278127s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:50:17.202] [driver] [info] [Task Finished] Transform to mem in 0.278419s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:50:17.481] [driver] [info] [Task Finished] Transform to mem in 0.278883s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:50:17.760] [driver] [info] [Task Finished] Transform to mem in 0.278592s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:50:18.038] [driver] [info] [Task Finished] Transform to mem in 0.278264s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:50:18.317] [driver] [info] [Task Finished] Transform to mem in 0.278582s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:50:18.595] [driver] [info] [Task Finished] Transform to mem in 0.278249s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:50:18.873] [driver] [info] [Task Finished] Transform to mem in 0.278219s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:50:19.152] [driver] [info] [Task Finished] Transform to mem in 0.278706s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:50:19.431] [driver] [info] [Task Finished] Transform to mem in 0.278724s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:50:19.710] [driver] [info] [Task Finished] Transform to mem in 0.279087s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:50:19.989] [driver] [info] [Task Finished] Transform to mem in 0.279122s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:50:20.269] [driver] [info] [Task Finished] Transform to mem in 0.279622s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:50:20.548] [driver] [info] [Task Finished] Transform to mem in 0.279023s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:50:20.826] [driver] [info] [Task Finished] Transform to mem in 0.278283s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:50:21.104] [driver] [info] [Task Finished] Transform to mem in 0.278206s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:50:21.382] [driver] [info] [Task Finished] Transform to mem in 0.278188s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:50:21.661] [driver] [info] [Task Finished] Transform to mem in 0.278793s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:50:21.939] [driver] [info] [Task Finished] Transform to mem in 0.278151s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:50:22.218] [driver] [info] [Task Finished] Transform to mem in 0.278702s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:50:22.497] [driver] [info] [Task Finished] Transform to mem in 0.279008s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:50:22.776] [driver] [info] [Task Finished] Transform to mem in 0.278603s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:50:23.054] [driver] [info] [Task Finished] Transform to mem in 0.278654s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:50:23.333] [driver] [info] [Task Finished] Transform to mem in 0.278877s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:50:23.612] [driver] [info] [Task Finished] Transform to mem in 0.278343s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:50:23.891] [driver] [info] [Task Finished] Transform to mem in 0.279089s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:50:24.169] [driver] [info] [Task Finished] Transform to mem in 0.278180s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:50:24.447] [driver] [info] [Task Finished] Transform to mem in 0.277724s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:50:24.725] [driver] [info] [Task Finished] Transform to mem in 0.277886s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:50:25.003] [driver] [info] [Task Finished] Transform to mem in 0.278512s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:50:25.281] [driver] [info] [Task Finished] Transform to mem in 0.278248s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:50:25.560] [driver] [info] [Task Finished] Transform to mem in 0.278794s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:50:25.838] [driver] [info] [Task Finished] Transform to mem in 0.277868s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:50:26.116] [driver] [info] [Task Finished] Transform to mem in 0.277485s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:50:26.395] [driver] [info] [Task Finished] Transform to mem in 0.279066s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:50:26.674] [driver] [info] [Task Finished] Transform to mem in 0.278804s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:50:26.952] [driver] [info] [Task Finished] Transform to mem in 0.278935s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:50:27.231] [driver] [info] [Task Finished] Transform to mem in 0.278229s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:50:27.509] [driver] [info] [Task Finished] Transform to mem in 0.278525s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:50:27.787] [driver] [info] [Task Finished] Transform to mem in 0.278009s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:50:28.066] [driver] [info] [Task Finished] Transform to mem in 0.278337s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:50:28.344] [driver] [info] [Task Finished] Transform to mem in 0.278325s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:50:28.623] [driver] [info] [Task Finished] Transform to mem in 0.278834s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:50:28.901] [driver] [info] [Task Finished] Transform to mem in 0.278581s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:50:29.180] [driver] [info] [Task Finished] Transform to mem in 0.278494s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:50:29.458] [driver] [info] [Task Finished] Transform to mem in 0.278101s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:50:29.740] [driver] [info] [Task Finished] Transform to mem in 0.281627s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:50:30.018] [driver] [info] [Task Finished] Transform to mem in 0.278545s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:50:30.297] [driver] [info] [Task Finished] Transform to mem in 0.278973s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:50:30.575] [driver] [info] [Task Finished] Transform to mem in 0.277839s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:50:30.854] [driver] [info] [Task Finished] Transform to mem in 0.279142s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:50:31.133] [driver] [info] [Task Finished] Transform to mem in 0.278824s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:50:31.412] [driver] [info] [Task Finished] Transform to mem in 0.278533s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:50:31.690] [driver] [info] [Task Finished] Transform to mem in 0.278573s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:50:31.969] [driver] [info] [Task Finished] Transform to mem in 0.278366s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:50:32.248] [driver] [info] [Task Finished] Transform to mem in 0.279009s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:50:32.528] [driver] [info] [Task Finished] Transform to mem in 0.279997s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:50:32.806] [driver] [info] [Task Finished] Transform to mem in 0.278202s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:50:33.085] [driver] [info] [Task Finished] Transform to mem in 0.278812s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:50:33.364] [driver] [info] [Task Finished] Transform to mem in 0.279402s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:50:33.643] [driver] [info] [Task Finished] Transform to mem in 0.278690s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:50:33.921] [driver] [info] [Task Finished] Transform to mem in 0.277972s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:50:34.200] [driver] [info] [Task Finished] Transform to mem in 0.278828s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:50:34.479] [driver] [info] [Task Finished] Transform to mem in 0.278857s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:50:34.757] [driver] [info] [Task Finished] Transform to mem in 0.278333s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:50:35.036] [driver] [info] [Task Finished] Transform to mem in 0.279078s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:50:35.315] [driver] [info] [Task Finished] Transform to mem in 0.279314s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:50:35.594] [driver] [info] [Task Finished] Transform to mem in 0.278596s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:50:35.873] [driver] [info] [Task Finished] Transform to mem in 0.279437s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:50:36.152] [driver] [info] [Task Finished] Transform to mem in 0.278582s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:50:36.431] [driver] [info] [Task Finished] Transform to mem in 0.279074s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:50:36.710] [driver] [info] [Task Finished] Transform to mem in 0.278721s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:50:36.989] [driver] [info] [Task Finished] Transform to mem in 0.279149s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:50:37.268] [driver] [info] [Task Finished] Transform to mem in 0.278464s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:50:37.547] [driver] [info] [Task Finished] Transform to mem in 0.279334s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:50:37.826] [driver] [info] [Task Finished] Transform to mem in 0.279402s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:50:38.108] [driver] [info] [Task Finished] Transform to mem in 0.282186s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:50:38.387] [driver] [info] [Task Finished] Transform to mem in 0.278829s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:50:38.666] [driver] [info] [Task Finished] Transform to mem in 0.279028s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:50:38.946] [driver] [info] [Task Finished] Transform to mem in 0.279353s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:50:39.225] [driver] [info] [Task Finished] Transform to mem in 0.279343s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:50:39.504] [driver] [info] [Task Finished] Transform to mem in 0.278477s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:50:39.783] [driver] [info] [Task Finished] Transform to mem in 0.279473s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:50:40.063] [driver] [info] [Task Finished] Transform to mem in 0.279750s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:50:40.342] [driver] [info] [Task Finished] Transform to mem in 0.279354s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:50:40.621] [driver] [info] [Task Finished] Transform to mem in 0.278846s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:50:40.901] [driver] [info] [Task Finished] Transform to mem in 0.279391s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:50:41.181] [driver] [info] [Task Finished] Transform to mem in 0.280609s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:50:41.460] [driver] [info] [Task Finished] Transform to mem in 0.278766s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:50:41.739] [driver] [info] [Task Finished] Transform to mem in 0.279493s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:50:42.019] [driver] [info] [Task Finished] Transform to mem in 0.279374s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:50:42.298] [driver] [info] [Task Finished] Transform to mem in 0.278889s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:50:42.578] [driver] [info] [Task Finished] Transform to mem in 0.280137s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:50:42.856] [driver] [info] [Task Finished] Transform to mem in 0.278177s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:50:43.135] [driver] [info] [Task Finished] Transform to mem in 0.278776s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:50:43.414] [driver] [info] [Task Finished] Transform to mem in 0.278816s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:50:43.692] [driver] [info] [Task Finished] Transform to mem in 0.278708s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:50:43.971] [driver] [info] [Task Finished] Transform to mem in 0.278568s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:50:44.250] [driver] [info] [Task Finished] Transform to mem in 0.278666s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:50:44.529] [driver] [info] [Task Finished] Transform to mem in 0.279098s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:50:44.807] [driver] [info] [Task Finished] Transform to mem in 0.278598s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:50:45.086] [driver] [info] [Task Finished] Transform to mem in 0.278783s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:50:45.366] [driver] [info] [Task Finished] Transform to mem in 0.279400s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:50:45.644] [driver] [info] [Task Finished] Transform to mem in 0.278149s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:50:45.924] [driver] [info] [Task Finished] Transform to mem in 0.279667s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:50:46.203] [driver] [info] [Task Finished] Transform to mem in 0.279740s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:50:46.483] [driver] [info] [Task Finished] Transform to mem in 0.279444s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:50:46.763] [driver] [info] [Task Finished] Transform to mem in 0.279933s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:50:47.042] [driver] [info] [Task Finished] Transform to mem in 0.279621s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:50:47.322] [driver] [info] [Task Finished] Transform to mem in 0.279335s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:50:47.602] [driver] [info] [Task Finished] Transform to mem in 0.280138s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:50:47.880] [driver] [info] [Task Finished] Transform to mem in 0.278412s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:50:48.160] [driver] [info] [Task Finished] Transform to mem in 0.279419s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:50:48.438] [driver] [info] [Task Finished] Transform to mem in 0.278397s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:50:48.717] [driver] [info] [Task Finished] Transform to mem in 0.279308s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:50:48.997] [driver] [info] [Task Finished] Transform to mem in 0.279604s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:50:49.277] [driver] [info] [Task Finished] Transform to mem in 0.279491s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:50:49.556] [driver] [info] [Task Finished] Transform to mem in 0.279254s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:50:49.836] [driver] [info] [Task Finished] Transform to mem in 0.279901s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:50:50.115] [driver] [info] [Task Finished] Transform to mem in 0.279529s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:50:50.428] [driver] [info] [Task Finished] Transform to mem in 0.312184s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:50:50.428] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.6543s
[2021-03-25 10:50:50.428] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.651s, 56350770 input rows, time to process 1 row via fast path: 0.000792376ms
[2021-03-25 10:50:50.428] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:50:50.432] [local ee] [info] compiled pure python pipeline in 0.004248s
[2021-03-25 10:50:50.432] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:50:50.433] [local ee] [info] Created 160 resolve tasks in 0.001168s
[2021-03-25 10:50:50.433] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:50:50.445] [driver] [info] [Task Finished] Resolve in 0.012030s
[2021-03-25 10:50:50.457] [driver] [info] [Task Finished] Resolve in 0.011881s
[2021-03-25 10:50:50.469] [driver] [info] [Task Finished] Resolve in 0.011922s
[2021-03-25 10:50:50.481] [driver] [info] [Task Finished] Resolve in 0.011745s
[2021-03-25 10:50:50.493] [driver] [info] [Task Finished] Resolve in 0.011835s
[2021-03-25 10:50:50.504] [driver] [info] [Task Finished] Resolve in 0.011728s
[2021-03-25 10:50:50.516] [driver] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:50:50.528] [driver] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:50:50.540] [driver] [info] [Task Finished] Resolve in 0.011906s
[2021-03-25 10:50:50.552] [driver] [info] [Task Finished] Resolve in 0.011934s
[2021-03-25 10:50:50.564] [driver] [info] [Task Finished] Resolve in 0.011772s
[2021-03-25 10:50:50.576] [driver] [info] [Task Finished] Resolve in 0.011811s
[2021-03-25 10:50:50.587] [driver] [info] [Task Finished] Resolve in 0.011791s
[2021-03-25 10:50:50.599] [driver] [info] [Task Finished] Resolve in 0.011942s
[2021-03-25 10:50:50.611] [driver] [info] [Task Finished] Resolve in 0.011810s
[2021-03-25 10:50:50.623] [driver] [info] [Task Finished] Resolve in 0.011692s
[2021-03-25 10:50:50.635] [driver] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:50:50.647] [driver] [info] [Task Finished] Resolve in 0.011927s
[2021-03-25 10:50:50.659] [driver] [info] [Task Finished] Resolve in 0.011926s
[2021-03-25 10:50:50.670] [driver] [info] [Task Finished] Resolve in 0.011795s
[2021-03-25 10:50:50.682] [driver] [info] [Task Finished] Resolve in 0.011801s
[2021-03-25 10:50:50.694] [driver] [info] [Task Finished] Resolve in 0.011729s
[2021-03-25 10:50:50.706] [driver] [info] [Task Finished] Resolve in 0.011808s
[2021-03-25 10:50:50.718] [driver] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:50:50.730] [driver] [info] [Task Finished] Resolve in 0.011957s
[2021-03-25 10:50:50.741] [driver] [info] [Task Finished] Resolve in 0.011939s
[2021-03-25 10:50:50.753] [driver] [info] [Task Finished] Resolve in 0.011753s
[2021-03-25 10:50:50.765] [driver] [info] [Task Finished] Resolve in 0.011797s
[2021-03-25 10:50:50.777] [driver] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:50:50.789] [driver] [info] [Task Finished] Resolve in 0.011923s
[2021-03-25 10:50:50.801] [driver] [info] [Task Finished] Resolve in 0.011809s
[2021-03-25 10:50:50.812] [driver] [info] [Task Finished] Resolve in 0.011729s
[2021-03-25 10:50:50.824] [driver] [info] [Task Finished] Resolve in 0.011757s
[2021-03-25 10:50:50.836] [driver] [info] [Task Finished] Resolve in 0.011995s
[2021-03-25 10:50:50.848] [driver] [info] [Task Finished] Resolve in 0.011839s
[2021-03-25 10:50:50.860] [driver] [info] [Task Finished] Resolve in 0.011880s
[2021-03-25 10:50:50.872] [driver] [info] [Task Finished] Resolve in 0.011792s
[2021-03-25 10:50:50.884] [driver] [info] [Task Finished] Resolve in 0.011762s
[2021-03-25 10:50:50.895] [driver] [info] [Task Finished] Resolve in 0.011813s
[2021-03-25 10:50:50.907] [driver] [info] [Task Finished] Resolve in 0.011730s
[2021-03-25 10:50:50.919] [driver] [info] [Task Finished] Resolve in 0.011917s
[2021-03-25 10:50:50.931] [driver] [info] [Task Finished] Resolve in 0.011990s
[2021-03-25 10:50:50.943] [driver] [info] [Task Finished] Resolve in 0.011746s
[2021-03-25 10:50:50.955] [driver] [info] [Task Finished] Resolve in 0.011811s
[2021-03-25 10:50:50.966] [driver] [info] [Task Finished] Resolve in 0.011802s
[2021-03-25 10:50:50.978] [driver] [info] [Task Finished] Resolve in 0.011933s
[2021-03-25 10:50:50.990] [driver] [info] [Task Finished] Resolve in 0.011863s
[2021-03-25 10:50:51.002] [driver] [info] [Task Finished] Resolve in 0.011708s
[2021-03-25 10:50:51.014] [driver] [info] [Task Finished] Resolve in 0.011719s
[2021-03-25 10:50:51.026] [driver] [info] [Task Finished] Resolve in 0.011982s
[2021-03-25 10:50:51.038] [driver] [info] [Task Finished] Resolve in 0.011976s
[2021-03-25 10:50:51.050] [driver] [info] [Task Finished] Resolve in 0.011902s
[2021-03-25 10:50:51.061] [driver] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:50:51.073] [driver] [info] [Task Finished] Resolve in 0.011759s
[2021-03-25 10:50:51.085] [driver] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:50:51.097] [driver] [info] [Task Finished] Resolve in 0.011739s
[2021-03-25 10:50:51.109] [driver] [info] [Task Finished] Resolve in 0.011930s
[2021-03-25 10:50:51.121] [driver] [info] [Task Finished] Resolve in 0.012002s
[2021-03-25 10:50:51.132] [driver] [info] [Task Finished] Resolve in 0.011725s
[2021-03-25 10:50:51.144] [driver] [info] [Task Finished] Resolve in 0.011795s
[2021-03-25 10:50:51.156] [driver] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:50:51.168] [driver] [info] [Task Finished] Resolve in 0.011882s
[2021-03-25 10:50:51.180] [driver] [info] [Task Finished] Resolve in 0.011900s
[2021-03-25 10:50:51.192] [driver] [info] [Task Finished] Resolve in 0.011762s
[2021-03-25 10:50:51.203] [driver] [info] [Task Finished] Resolve in 0.011742s
[2021-03-25 10:50:51.216] [driver] [info] [Task Finished] Resolve in 0.012036s
[2021-03-25 10:50:51.227] [driver] [info] [Task Finished] Resolve in 0.011759s
[2021-03-25 10:50:51.239] [driver] [info] [Task Finished] Resolve in 0.011998s
[2021-03-25 10:50:51.251] [driver] [info] [Task Finished] Resolve in 0.011855s
[2021-03-25 10:50:51.263] [driver] [info] [Task Finished] Resolve in 0.011775s
[2021-03-25 10:50:51.275] [driver] [info] [Task Finished] Resolve in 0.011823s
[2021-03-25 10:50:51.287] [driver] [info] [Task Finished] Resolve in 0.011777s
[2021-03-25 10:50:51.299] [driver] [info] [Task Finished] Resolve in 0.011904s
[2021-03-25 10:50:51.311] [driver] [info] [Task Finished] Resolve in 0.012057s
[2021-03-25 10:50:51.322] [driver] [info] [Task Finished] Resolve in 0.011787s
[2021-03-25 10:50:51.334] [driver] [info] [Task Finished] Resolve in 0.011797s
[2021-03-25 10:50:51.346] [driver] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:50:51.358] [driver] [info] [Task Finished] Resolve in 0.011876s
[2021-03-25 10:50:51.370] [driver] [info] [Task Finished] Resolve in 0.011879s
[2021-03-25 10:50:51.382] [driver] [info] [Task Finished] Resolve in 0.011755s
[2021-03-25 10:50:51.393] [driver] [info] [Task Finished] Resolve in 0.011746s
[2021-03-25 10:50:51.405] [driver] [info] [Task Finished] Resolve in 0.012033s
[2021-03-25 10:50:51.417] [driver] [info] [Task Finished] Resolve in 0.011795s
[2021-03-25 10:50:51.429] [driver] [info] [Task Finished] Resolve in 0.011968s
[2021-03-25 10:50:51.441] [driver] [info] [Task Finished] Resolve in 0.011875s
[2021-03-25 10:50:51.453] [driver] [info] [Task Finished] Resolve in 0.011807s
[2021-03-25 10:50:51.465] [driver] [info] [Task Finished] Resolve in 0.011791s
[2021-03-25 10:50:51.477] [driver] [info] [Task Finished] Resolve in 0.011823s
[2021-03-25 10:50:51.488] [driver] [info] [Task Finished] Resolve in 0.011902s
[2021-03-25 10:50:51.501] [driver] [info] [Task Finished] Resolve in 0.012073s
[2021-03-25 10:50:51.512] [driver] [info] [Task Finished] Resolve in 0.011789s
[2021-03-25 10:50:51.524] [driver] [info] [Task Finished] Resolve in 0.011787s
[2021-03-25 10:50:51.536] [driver] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:50:51.548] [driver] [info] [Task Finished] Resolve in 0.011918s
[2021-03-25 10:50:51.560] [driver] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:50:51.572] [driver] [info] [Task Finished] Resolve in 0.011869s
[2021-03-25 10:50:51.584] [driver] [info] [Task Finished] Resolve in 0.011745s
[2021-03-25 10:50:51.596] [driver] [info] [Task Finished] Resolve in 0.012023s
[2021-03-25 10:50:51.607] [driver] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:50:51.619] [driver] [info] [Task Finished] Resolve in 0.011982s
[2021-03-25 10:50:51.631] [driver] [info] [Task Finished] Resolve in 0.011860s
[2021-03-25 10:50:51.643] [driver] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:50:51.655] [driver] [info] [Task Finished] Resolve in 0.011727s
[2021-03-25 10:50:51.667] [driver] [info] [Task Finished] Resolve in 0.011867s
[2021-03-25 10:50:51.679] [driver] [info] [Task Finished] Resolve in 0.011928s
[2021-03-25 10:50:51.691] [driver] [info] [Task Finished] Resolve in 0.012044s
[2021-03-25 10:50:51.703] [driver] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:50:51.714] [driver] [info] [Task Finished] Resolve in 0.011762s
[2021-03-25 10:50:51.726] [driver] [info] [Task Finished] Resolve in 0.011847s
[2021-03-25 10:50:51.738] [driver] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:50:51.750] [driver] [info] [Task Finished] Resolve in 0.011791s
[2021-03-25 10:50:51.762] [driver] [info] [Task Finished] Resolve in 0.011834s
[2021-03-25 10:50:51.773] [driver] [info] [Task Finished] Resolve in 0.011706s
[2021-03-25 10:50:51.785] [driver] [info] [Task Finished] Resolve in 0.011982s
[2021-03-25 10:50:51.797] [driver] [info] [Task Finished] Resolve in 0.011802s
[2021-03-25 10:50:51.809] [driver] [info] [Task Finished] Resolve in 0.011969s
[2021-03-25 10:50:51.821] [driver] [info] [Task Finished] Resolve in 0.011840s
[2021-03-25 10:50:51.833] [driver] [info] [Task Finished] Resolve in 0.011764s
[2021-03-25 10:50:51.845] [driver] [info] [Task Finished] Resolve in 0.011738s
[2021-03-25 10:50:51.856] [driver] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:50:51.868] [driver] [info] [Task Finished] Resolve in 0.011828s
[2021-03-25 10:50:51.880] [driver] [info] [Task Finished] Resolve in 0.012036s
[2021-03-25 10:50:51.892] [driver] [info] [Task Finished] Resolve in 0.011781s
[2021-03-25 10:50:51.904] [driver] [info] [Task Finished] Resolve in 0.011773s
[2021-03-25 10:50:51.916] [driver] [info] [Task Finished] Resolve in 0.011862s
[2021-03-25 10:50:51.928] [driver] [info] [Task Finished] Resolve in 0.011808s
[2021-03-25 10:50:51.940] [driver] [info] [Task Finished] Resolve in 0.011932s
[2021-03-25 10:50:51.951] [driver] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:50:51.963] [driver] [info] [Task Finished] Resolve in 0.011676s
[2021-03-25 10:50:51.975] [driver] [info] [Task Finished] Resolve in 0.012003s
[2021-03-25 10:50:51.987] [driver] [info] [Task Finished] Resolve in 0.011815s
[2021-03-25 10:50:51.999] [driver] [info] [Task Finished] Resolve in 0.011981s
[2021-03-25 10:50:52.011] [driver] [info] [Task Finished] Resolve in 0.011861s
[2021-03-25 10:50:52.023] [driver] [info] [Task Finished] Resolve in 0.011777s
[2021-03-25 10:50:52.034] [driver] [info] [Task Finished] Resolve in 0.011876s
[2021-03-25 10:50:52.046] [driver] [info] [Task Finished] Resolve in 0.011819s
[2021-03-25 10:50:52.058] [driver] [info] [Task Finished] Resolve in 0.011824s
[2021-03-25 10:50:52.070] [driver] [info] [Task Finished] Resolve in 0.012060s
[2021-03-25 10:50:52.082] [driver] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:50:52.094] [driver] [info] [Task Finished] Resolve in 0.011791s
[2021-03-25 10:50:52.106] [driver] [info] [Task Finished] Resolve in 0.011845s
[2021-03-25 10:50:52.118] [driver] [info] [Task Finished] Resolve in 0.011868s
[2021-03-25 10:50:52.130] [driver] [info] [Task Finished] Resolve in 0.011898s
[2021-03-25 10:50:52.141] [driver] [info] [Task Finished] Resolve in 0.011859s
[2021-03-25 10:50:52.153] [driver] [info] [Task Finished] Resolve in 0.011723s
[2021-03-25 10:50:52.165] [driver] [info] [Task Finished] Resolve in 0.011957s
[2021-03-25 10:50:52.177] [driver] [info] [Task Finished] Resolve in 0.011857s
[2021-03-25 10:50:52.189] [driver] [info] [Task Finished] Resolve in 0.011988s
[2021-03-25 10:50:52.201] [driver] [info] [Task Finished] Resolve in 0.011835s
[2021-03-25 10:50:52.213] [driver] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:50:52.224] [driver] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:50:52.236] [driver] [info] [Task Finished] Resolve in 0.011849s
[2021-03-25 10:50:52.248] [driver] [info] [Task Finished] Resolve in 0.011852s
[2021-03-25 10:50:52.260] [driver] [info] [Task Finished] Resolve in 0.012000s
[2021-03-25 10:50:52.272] [driver] [info] [Task Finished] Resolve in 0.011876s
[2021-03-25 10:50:52.284] [driver] [info] [Task Finished] Resolve in 0.011763s
[2021-03-25 10:50:52.296] [driver] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:50:52.308] [driver] [info] [Task Finished] Resolve in 0.011797s
[2021-03-25 10:50:52.319] [driver] [info] [Task Finished] Resolve in 0.011902s
[2021-03-25 10:50:52.333] [driver] [info] [Task Finished] Resolve in 0.013146s
[2021-03-25 10:50:52.333] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 1.90507s
[2021-03-25 10:50:52.333] [local ee] [info] slow path for Stage 0: total wall clock time: 1.89719s, time to process 1 row via slow path: 0.000275118ms
[2021-03-25 10:50:52.333] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.90509s

[2021-03-25 10:50:52.366] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:50:52.672] [driver] [info] [Task Finished] write to file in 0.306650s (1798491 rows, 273.80 MB)
[2021-03-25 10:50:52.672] [global] [info] writing output took 0.339684s
[2021-03-25 10:50:52.672] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.339772s
[2021-03-25 10:50:52.672] [global] [info] [Transform Stage] Stage 0 took 47.3974s
[2021-03-25 10:50:52.672] [global] [info] Query Execution took 47.4758s. (planning: 0.0783533s, execution: 47.3975s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.0049076080322265625
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 47.75785517692566 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0219356,"llvm_optimization_time_s":0.329855,"llvm_compilation_time_s":0.151082,"total_compilation_time_s":0.498277,"sampling_time_s":0.114859,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.651,"fast_path_time_s":44.6543,"fast_path_per_row_time_ns":792.376,"slow_path_wall_time_s":1.89719,"slow_path_time_s":1.90507,"slow_path_per_row_time_ns":275.118}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.0049076080322265625, "jobTime": 47.75785517692566, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
