[2021-03-25 13:08:38.725] [global] [error] could not find backend, defaulting to local
[2021-03-25 13:08:38.725] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 13:08:38.725] [local ee] [info] initializing LLVM backend
[2021-03-25 13:08:38.725] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 13:08:38.726] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 13:08:38.726] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 13:08:38.726] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 13:08:38.727] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 13:08:38.727] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 13:08:38.867] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:08:38.873] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:08:38.889] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:08:38.897] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:08:38.923] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:08:38.943] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:08:38.956] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:08:38.987] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 13:08:38.993] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:08:39.008] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:08:39.010] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:08:39.011] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:08:39.011] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:08:39.013] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:08:39.014] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:08:39.015] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:08:39.016] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:08:39.017] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 13:08:39.018] [global] [info] performing static typing for UDF in operator map
[2021-03-25 13:08:39.034] [logical planner] [info] logical optimization took 0.021897ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 13:08:39.034] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 13:08:39.034] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 13:08:39.035] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 13:08:39.036] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 13:08:39.036] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 13:08:39.037] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 13:08:39.038] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 13:08:39.039] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 13:08:39.040] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 13:08:39.040] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 13:08:39.041] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 13:08:39.042] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:08:39.043] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:08:39.043] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 13:08:39.045] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 13:08:39.046] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 13:08:39.046] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 13:08:39.047] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 13:08:39.048] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 13:08:39.048] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 13:08:39.049] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 13:08:39.050] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 13:08:39.051] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 13:08:39.051] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 13:08:39.052] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 13:08:39.053] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 13:08:39.054] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:08:39.055] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 13:08:39.055] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 13:08:39.087] [global] [info] Stage0 depends on: 
[2021-03-25 13:08:39.434] [global] [info] Optimization via LLVM passes took 0.329588 ms
[2021-03-25 13:08:39.585] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 13:08:39.585] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.497764s
[2021-03-25 13:08:39.585] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 13:08:39.867] [driver] [info] [Task Finished] Transform to mem in 0.281661s (11105 normal rows, 43095 exceptions)
[2021-03-25 13:08:40.147] [driver] [info] [Task Finished] Transform to mem in 0.279770s (11073 normal rows, 43414 exceptions)
[2021-03-25 13:08:40.426] [driver] [info] [Task Finished] Transform to mem in 0.279738s (11153 normal rows, 42970 exceptions)
[2021-03-25 13:08:40.706] [driver] [info] [Task Finished] Transform to mem in 0.279576s (11047 normal rows, 43210 exceptions)
[2021-03-25 13:08:40.985] [driver] [info] [Task Finished] Transform to mem in 0.279257s (10987 normal rows, 43113 exceptions)
[2021-03-25 13:08:41.267] [driver] [info] [Task Finished] Transform to mem in 0.281322s (10997 normal rows, 42873 exceptions)
[2021-03-25 13:08:41.546] [driver] [info] [Task Finished] Transform to mem in 0.279021s (11036 normal rows, 43142 exceptions)
[2021-03-25 13:08:41.824] [driver] [info] [Task Finished] Transform to mem in 0.278338s (11005 normal rows, 42741 exceptions)
[2021-03-25 13:08:42.103] [driver] [info] [Task Finished] Transform to mem in 0.279377s (11086 normal rows, 43015 exceptions)
[2021-03-25 13:08:42.382] [driver] [info] [Task Finished] Transform to mem in 0.279150s (11092 normal rows, 43495 exceptions)
[2021-03-25 13:08:42.662] [driver] [info] [Task Finished] Transform to mem in 0.279200s (11153 normal rows, 42968 exceptions)
[2021-03-25 13:08:42.940] [driver] [info] [Task Finished] Transform to mem in 0.278735s (11026 normal rows, 43206 exceptions)
[2021-03-25 13:08:43.219] [driver] [info] [Task Finished] Transform to mem in 0.278960s (11008 normal rows, 43077 exceptions)
[2021-03-25 13:08:43.498] [driver] [info] [Task Finished] Transform to mem in 0.278750s (10997 normal rows, 42910 exceptions)
[2021-03-25 13:08:43.777] [driver] [info] [Task Finished] Transform to mem in 0.278367s (11036 normal rows, 43139 exceptions)
[2021-03-25 13:08:44.055] [driver] [info] [Task Finished] Transform to mem in 0.278730s (11005 normal rows, 42744 exceptions)
[2021-03-25 13:08:44.334] [driver] [info] [Task Finished] Transform to mem in 0.278734s (11086 normal rows, 42996 exceptions)
[2021-03-25 13:08:44.613] [driver] [info] [Task Finished] Transform to mem in 0.278685s (11092 normal rows, 43505 exceptions)
[2021-03-25 13:08:44.892] [driver] [info] [Task Finished] Transform to mem in 0.278805s (11153 normal rows, 42978 exceptions)
[2021-03-25 13:08:45.170] [driver] [info] [Task Finished] Transform to mem in 0.278613s (11026 normal rows, 43205 exceptions)
[2021-03-25 13:08:45.452] [driver] [info] [Task Finished] Transform to mem in 0.281359s (10982 normal rows, 43059 exceptions)
[2021-03-25 13:08:45.730] [driver] [info] [Task Finished] Transform to mem in 0.278198s (11023 normal rows, 42910 exceptions)
[2021-03-25 13:08:46.008] [driver] [info] [Task Finished] Transform to mem in 0.278595s (11036 normal rows, 43115 exceptions)
[2021-03-25 13:08:46.287] [driver] [info] [Task Finished] Transform to mem in 0.278534s (11005 normal rows, 42772 exceptions)
[2021-03-25 13:08:46.566] [driver] [info] [Task Finished] Transform to mem in 0.278576s (11086 normal rows, 42970 exceptions)
[2021-03-25 13:08:46.845] [driver] [info] [Task Finished] Transform to mem in 0.279554s (11079 normal rows, 43539 exceptions)
[2021-03-25 13:08:47.124] [driver] [info] [Task Finished] Transform to mem in 0.279007s (11111 normal rows, 42961 exceptions)
[2021-03-25 13:08:47.403] [driver] [info] [Task Finished] Transform to mem in 0.278764s (11076 normal rows, 43220 exceptions)
[2021-03-25 13:08:47.681] [driver] [info] [Task Finished] Transform to mem in 0.278353s (10987 normal rows, 43068 exceptions)
[2021-03-25 13:08:47.959] [driver] [info] [Task Finished] Transform to mem in 0.277954s (11023 normal rows, 42880 exceptions)
[2021-03-25 13:08:48.239] [driver] [info] [Task Finished] Transform to mem in 0.280101s (11036 normal rows, 43053 exceptions)
[2021-03-25 13:08:48.518] [driver] [info] [Task Finished] Transform to mem in 0.278136s (10992 normal rows, 42864 exceptions)
[2021-03-25 13:08:48.796] [driver] [info] [Task Finished] Transform to mem in 0.278396s (11099 normal rows, 42882 exceptions)
[2021-03-25 13:08:49.075] [driver] [info] [Task Finished] Transform to mem in 0.278968s (11063 normal rows, 43617 exceptions)
[2021-03-25 13:08:49.354] [driver] [info] [Task Finished] Transform to mem in 0.278622s (11127 normal rows, 42969 exceptions)
[2021-03-25 13:08:49.632] [driver] [info] [Task Finished] Transform to mem in 0.278691s (11076 normal rows, 43221 exceptions)
[2021-03-25 13:08:49.911] [driver] [info] [Task Finished] Transform to mem in 0.279027s (10987 normal rows, 43063 exceptions)
[2021-03-25 13:08:50.190] [driver] [info] [Task Finished] Transform to mem in 0.278296s (11004 normal rows, 42876 exceptions)
[2021-03-25 13:08:50.470] [driver] [info] [Task Finished] Transform to mem in 0.280124s (11026 normal rows, 43041 exceptions)
[2021-03-25 13:08:50.749] [driver] [info] [Task Finished] Transform to mem in 0.278804s (11021 normal rows, 42887 exceptions)
[2021-03-25 13:08:51.027] [driver] [info] [Task Finished] Transform to mem in 0.278714s (11064 normal rows, 42832 exceptions)
[2021-03-25 13:08:51.306] [driver] [info] [Task Finished] Transform to mem in 0.279086s (11098 normal rows, 43603 exceptions)
[2021-03-25 13:08:51.586] [driver] [info] [Task Finished] Transform to mem in 0.279070s (11127 normal rows, 43028 exceptions)
[2021-03-25 13:08:51.864] [driver] [info] [Task Finished] Transform to mem in 0.278582s (11076 normal rows, 43212 exceptions)
[2021-03-25 13:08:52.144] [driver] [info] [Task Finished] Transform to mem in 0.279515s (10987 normal rows, 43041 exceptions)
[2021-03-25 13:08:52.423] [driver] [info] [Task Finished] Transform to mem in 0.279408s (11004 normal rows, 42913 exceptions)
[2021-03-25 13:08:52.704] [driver] [info] [Task Finished] Transform to mem in 0.280596s (11026 normal rows, 43037 exceptions)
[2021-03-25 13:08:52.982] [driver] [info] [Task Finished] Transform to mem in 0.278716s (11012 normal rows, 42883 exceptions)
[2021-03-25 13:08:53.261] [driver] [info] [Task Finished] Transform to mem in 0.278783s (11073 normal rows, 42820 exceptions)
[2021-03-25 13:08:53.541] [driver] [info] [Task Finished] Transform to mem in 0.279392s (11095 normal rows, 43503 exceptions)
[2021-03-25 13:08:53.820] [driver] [info] [Task Finished] Transform to mem in 0.279072s (11130 normal rows, 43084 exceptions)
[2021-03-25 13:08:54.098] [driver] [info] [Task Finished] Transform to mem in 0.278640s (11076 normal rows, 43152 exceptions)
[2021-03-25 13:08:54.377] [driver] [info] [Task Finished] Transform to mem in 0.278973s (10976 normal rows, 43110 exceptions)
[2021-03-25 13:08:54.656] [driver] [info] [Task Finished] Transform to mem in 0.278736s (11015 normal rows, 42966 exceptions)
[2021-03-25 13:08:54.935] [driver] [info] [Task Finished] Transform to mem in 0.278461s (11026 normal rows, 43035 exceptions)
[2021-03-25 13:08:55.213] [driver] [info] [Task Finished] Transform to mem in 0.278648s (11012 normal rows, 42888 exceptions)
[2021-03-25 13:08:55.492] [driver] [info] [Task Finished] Transform to mem in 0.278543s (11073 normal rows, 42754 exceptions)
[2021-03-25 13:08:55.771] [driver] [info] [Task Finished] Transform to mem in 0.279321s (11095 normal rows, 43552 exceptions)
[2021-03-25 13:08:56.051] [driver] [info] [Task Finished] Transform to mem in 0.279445s (11130 normal rows, 43033 exceptions)
[2021-03-25 13:08:56.329] [driver] [info] [Task Finished] Transform to mem in 0.278355s (11069 normal rows, 43142 exceptions)
[2021-03-25 13:08:56.608] [driver] [info] [Task Finished] Transform to mem in 0.278848s (10974 normal rows, 43172 exceptions)
[2021-03-25 13:08:56.887] [driver] [info] [Task Finished] Transform to mem in 0.278589s (11008 normal rows, 42964 exceptions)
[2021-03-25 13:08:57.165] [driver] [info] [Task Finished] Transform to mem in 0.278777s (11042 normal rows, 43023 exceptions)
[2021-03-25 13:08:57.444] [driver] [info] [Task Finished] Transform to mem in 0.278480s (11012 normal rows, 42911 exceptions)
[2021-03-25 13:08:57.722] [driver] [info] [Task Finished] Transform to mem in 0.278591s (11063 normal rows, 42726 exceptions)
[2021-03-25 13:08:58.001] [driver] [info] [Task Finished] Transform to mem in 0.278873s (11105 normal rows, 43555 exceptions)
[2021-03-25 13:08:58.280] [driver] [info] [Task Finished] Transform to mem in 0.278738s (11081 normal rows, 43050 exceptions)
[2021-03-25 13:08:58.558] [driver] [info] [Task Finished] Transform to mem in 0.278100s (11087 normal rows, 43150 exceptions)
[2021-03-25 13:08:58.837] [driver] [info] [Task Finished] Transform to mem in 0.278815s (11005 normal rows, 43164 exceptions)
[2021-03-25 13:08:59.116] [driver] [info] [Task Finished] Transform to mem in 0.279013s (11008 normal rows, 42975 exceptions)
[2021-03-25 13:08:59.395] [driver] [info] [Task Finished] Transform to mem in 0.278983s (11042 normal rows, 42959 exceptions)
[2021-03-25 13:08:59.674] [driver] [info] [Task Finished] Transform to mem in 0.278831s (11002 normal rows, 42964 exceptions)
[2021-03-25 13:08:59.952] [driver] [info] [Task Finished] Transform to mem in 0.278400s (11073 normal rows, 42720 exceptions)
[2021-03-25 13:09:00.232] [driver] [info] [Task Finished] Transform to mem in 0.279294s (11088 normal rows, 43511 exceptions)
[2021-03-25 13:09:00.511] [driver] [info] [Task Finished] Transform to mem in 0.279320s (11098 normal rows, 43112 exceptions)
[2021-03-25 13:09:00.790] [driver] [info] [Task Finished] Transform to mem in 0.278890s (11087 normal rows, 43044 exceptions)
[2021-03-25 13:09:01.068] [driver] [info] [Task Finished] Transform to mem in 0.278421s (11005 normal rows, 43229 exceptions)
[2021-03-25 13:09:01.347] [driver] [info] [Task Finished] Transform to mem in 0.278735s (11008 normal rows, 43017 exceptions)
[2021-03-25 13:09:01.626] [driver] [info] [Task Finished] Transform to mem in 0.278493s (11024 normal rows, 42947 exceptions)
[2021-03-25 13:09:01.905] [driver] [info] [Task Finished] Transform to mem in 0.278919s (11020 normal rows, 42976 exceptions)
[2021-03-25 13:09:02.183] [driver] [info] [Task Finished] Transform to mem in 0.278826s (11036 normal rows, 42710 exceptions)
[2021-03-25 13:09:02.462] [driver] [info] [Task Finished] Transform to mem in 0.278997s (11125 normal rows, 43517 exceptions)
[2021-03-25 13:09:02.742] [driver] [info] [Task Finished] Transform to mem in 0.279419s (11098 normal rows, 43115 exceptions)
[2021-03-25 13:09:03.020] [driver] [info] [Task Finished] Transform to mem in 0.278396s (11087 normal rows, 42938 exceptions)
[2021-03-25 13:09:03.299] [driver] [info] [Task Finished] Transform to mem in 0.278657s (10985 normal rows, 43336 exceptions)
[2021-03-25 13:09:03.578] [driver] [info] [Task Finished] Transform to mem in 0.278778s (11000 normal rows, 42999 exceptions)
[2021-03-25 13:09:03.857] [driver] [info] [Task Finished] Transform to mem in 0.278830s (11052 normal rows, 42881 exceptions)
[2021-03-25 13:09:04.135] [driver] [info] [Task Finished] Transform to mem in 0.278769s (11020 normal rows, 43057 exceptions)
[2021-03-25 13:09:04.414] [driver] [info] [Task Finished] Transform to mem in 0.278279s (10995 normal rows, 42708 exceptions)
[2021-03-25 13:09:04.693] [driver] [info] [Task Finished] Transform to mem in 0.279221s (11166 normal rows, 43520 exceptions)
[2021-03-25 13:09:04.972] [driver] [info] [Task Finished] Transform to mem in 0.278657s (11098 normal rows, 43075 exceptions)
[2021-03-25 13:09:05.250] [driver] [info] [Task Finished] Transform to mem in 0.278950s (11073 normal rows, 42970 exceptions)
[2021-03-25 13:09:05.529] [driver] [info] [Task Finished] Transform to mem in 0.278685s (10999 normal rows, 43334 exceptions)
[2021-03-25 13:09:05.808] [driver] [info] [Task Finished] Transform to mem in 0.278368s (11000 normal rows, 43009 exceptions)
[2021-03-25 13:09:06.086] [driver] [info] [Task Finished] Transform to mem in 0.278475s (11052 normal rows, 42764 exceptions)
[2021-03-25 13:09:06.365] [driver] [info] [Task Finished] Transform to mem in 0.278458s (11020 normal rows, 43138 exceptions)
[2021-03-25 13:09:06.643] [driver] [info] [Task Finished] Transform to mem in 0.278580s (10995 normal rows, 42726 exceptions)
[2021-03-25 13:09:06.922] [driver] [info] [Task Finished] Transform to mem in 0.278990s (11166 normal rows, 43508 exceptions)
[2021-03-25 13:09:07.201] [driver] [info] [Task Finished] Transform to mem in 0.278956s (11091 normal rows, 43047 exceptions)
[2021-03-25 13:09:07.480] [driver] [info] [Task Finished] Transform to mem in 0.278869s (11080 normal rows, 43031 exceptions)
[2021-03-25 13:09:07.759] [driver] [info] [Task Finished] Transform to mem in 0.279006s (10999 normal rows, 43300 exceptions)
[2021-03-25 13:09:08.038] [driver] [info] [Task Finished] Transform to mem in 0.279214s (11000 normal rows, 43043 exceptions)
[2021-03-25 13:09:08.316] [driver] [info] [Task Finished] Transform to mem in 0.278174s (11036 normal rows, 42720 exceptions)
[2021-03-25 13:09:08.595] [driver] [info] [Task Finished] Transform to mem in 0.278233s (11016 normal rows, 43165 exceptions)
[2021-03-25 13:09:08.873] [driver] [info] [Task Finished] Transform to mem in 0.278063s (10995 normal rows, 42718 exceptions)
[2021-03-25 13:09:09.152] [driver] [info] [Task Finished] Transform to mem in 0.279061s (11186 normal rows, 43465 exceptions)
[2021-03-25 13:09:09.430] [driver] [info] [Task Finished] Transform to mem in 0.278511s (11001 normal rows, 43113 exceptions)
[2021-03-25 13:09:09.709] [driver] [info] [Task Finished] Transform to mem in 0.278825s (11170 normal rows, 43024 exceptions)
[2021-03-25 13:09:09.988] [driver] [info] [Task Finished] Transform to mem in 0.278699s (10989 normal rows, 43282 exceptions)
[2021-03-25 13:09:10.268] [driver] [info] [Task Finished] Transform to mem in 0.279532s (11010 normal rows, 43002 exceptions)
[2021-03-25 13:09:10.546] [driver] [info] [Task Finished] Transform to mem in 0.278759s (11002 normal rows, 42755 exceptions)
[2021-03-25 13:09:10.826] [driver] [info] [Task Finished] Transform to mem in 0.279425s (11050 normal rows, 43199 exceptions)
[2021-03-25 13:09:11.105] [driver] [info] [Task Finished] Transform to mem in 0.279260s (10973 normal rows, 42686 exceptions)
[2021-03-25 13:09:11.385] [driver] [info] [Task Finished] Transform to mem in 0.280118s (11160 normal rows, 43455 exceptions)
[2021-03-25 13:09:11.665] [driver] [info] [Task Finished] Transform to mem in 0.280190s (11045 normal rows, 43148 exceptions)
[2021-03-25 13:09:11.945] [driver] [info] [Task Finished] Transform to mem in 0.279678s (11166 normal rows, 43023 exceptions)
[2021-03-25 13:09:12.224] [driver] [info] [Task Finished] Transform to mem in 0.279184s (10997 normal rows, 43283 exceptions)
[2021-03-25 13:09:12.504] [driver] [info] [Task Finished] Transform to mem in 0.279466s (11005 normal rows, 42971 exceptions)
[2021-03-25 13:09:12.784] [driver] [info] [Task Finished] Transform to mem in 0.279740s (11007 normal rows, 42795 exceptions)
[2021-03-25 13:09:13.064] [driver] [info] [Task Finished] Transform to mem in 0.280097s (11050 normal rows, 43196 exceptions)
[2021-03-25 13:09:13.343] [driver] [info] [Task Finished] Transform to mem in 0.279283s (10973 normal rows, 42686 exceptions)
[2021-03-25 13:09:13.623] [driver] [info] [Task Finished] Transform to mem in 0.280344s (11160 normal rows, 43446 exceptions)
[2021-03-25 13:09:13.903] [driver] [info] [Task Finished] Transform to mem in 0.279728s (11043 normal rows, 43153 exceptions)
[2021-03-25 13:09:14.183] [driver] [info] [Task Finished] Transform to mem in 0.279816s (11168 normal rows, 43028 exceptions)
[2021-03-25 13:09:14.462] [driver] [info] [Task Finished] Transform to mem in 0.279599s (10997 normal rows, 43277 exceptions)
[2021-03-25 13:09:14.742] [driver] [info] [Task Finished] Transform to mem in 0.279297s (10997 normal rows, 42973 exceptions)
[2021-03-25 13:09:15.021] [driver] [info] [Task Finished] Transform to mem in 0.279220s (11015 normal rows, 42799 exceptions)
[2021-03-25 13:09:15.301] [driver] [info] [Task Finished] Transform to mem in 0.280122s (11050 normal rows, 43170 exceptions)
[2021-03-25 13:09:15.581] [driver] [info] [Task Finished] Transform to mem in 0.279458s (10973 normal rows, 42710 exceptions)
[2021-03-25 13:09:15.860] [driver] [info] [Task Finished] Transform to mem in 0.279500s (11160 normal rows, 43431 exceptions)
[2021-03-25 13:09:16.139] [driver] [info] [Task Finished] Transform to mem in 0.279290s (11043 normal rows, 43166 exceptions)
[2021-03-25 13:09:16.419] [driver] [info] [Task Finished] Transform to mem in 0.279814s (11168 normal rows, 43027 exceptions)
[2021-03-25 13:09:16.699] [driver] [info] [Task Finished] Transform to mem in 0.279215s (10997 normal rows, 43237 exceptions)
[2021-03-25 13:09:16.978] [driver] [info] [Task Finished] Transform to mem in 0.279157s (10997 normal rows, 43012 exceptions)
[2021-03-25 13:09:17.257] [driver] [info] [Task Finished] Transform to mem in 0.279391s (11009 normal rows, 42805 exceptions)
[2021-03-25 13:09:17.536] [driver] [info] [Task Finished] Transform to mem in 0.279335s (11021 normal rows, 43160 exceptions)
[2021-03-25 13:09:17.815] [driver] [info] [Task Finished] Transform to mem in 0.278970s (11003 normal rows, 42716 exceptions)
[2021-03-25 13:09:18.095] [driver] [info] [Task Finished] Transform to mem in 0.279608s (11165 normal rows, 43354 exceptions)
[2021-03-25 13:09:18.374] [driver] [info] [Task Finished] Transform to mem in 0.279120s (11043 normal rows, 43217 exceptions)
[2021-03-25 13:09:18.654] [driver] [info] [Task Finished] Transform to mem in 0.279431s (11156 normal rows, 43044 exceptions)
[2021-03-25 13:09:18.933] [driver] [info] [Task Finished] Transform to mem in 0.279416s (11009 normal rows, 43187 exceptions)
[2021-03-25 13:09:19.213] [driver] [info] [Task Finished] Transform to mem in 0.279748s (10997 normal rows, 43067 exceptions)
[2021-03-25 13:09:19.492] [driver] [info] [Task Finished] Transform to mem in 0.278817s (11009 normal rows, 42811 exceptions)
[2021-03-25 13:09:19.771] [driver] [info] [Task Finished] Transform to mem in 0.279556s (11021 normal rows, 43162 exceptions)
[2021-03-25 13:09:20.051] [driver] [info] [Task Finished] Transform to mem in 0.279265s (11003 normal rows, 42716 exceptions)
[2021-03-25 13:09:20.330] [driver] [info] [Task Finished] Transform to mem in 0.279584s (11165 normal rows, 43260 exceptions)
[2021-03-25 13:09:20.610] [driver] [info] [Task Finished] Transform to mem in 0.280174s (11027 normal rows, 43245 exceptions)
[2021-03-25 13:09:20.890] [driver] [info] [Task Finished] Transform to mem in 0.279708s (11172 normal rows, 43107 exceptions)
[2021-03-25 13:09:21.169] [driver] [info] [Task Finished] Transform to mem in 0.279360s (10997 normal rows, 43177 exceptions)
[2021-03-25 13:09:21.449] [driver] [info] [Task Finished] Transform to mem in 0.279961s (11009 normal rows, 43050 exceptions)
[2021-03-25 13:09:21.728] [driver] [info] [Task Finished] Transform to mem in 0.278865s (10999 normal rows, 42828 exceptions)
[2021-03-25 13:09:22.008] [driver] [info] [Task Finished] Transform to mem in 0.279590s (11031 normal rows, 43157 exceptions)
[2021-03-25 13:09:22.287] [driver] [info] [Task Finished] Transform to mem in 0.279178s (11000 normal rows, 42726 exceptions)
[2021-03-25 13:09:22.567] [driver] [info] [Task Finished] Transform to mem in 0.279604s (11091 normal rows, 43230 exceptions)
[2021-03-25 13:09:22.847] [driver] [info] [Task Finished] Transform to mem in 0.279997s (11099 normal rows, 43272 exceptions)
[2021-03-25 13:09:23.127] [driver] [info] [Task Finished] Transform to mem in 0.280062s (11177 normal rows, 43113 exceptions)
[2021-03-25 13:09:23.407] [driver] [info] [Task Finished] Transform to mem in 0.279683s (10997 normal rows, 43174 exceptions)
[2021-03-25 13:09:23.687] [driver] [info] [Task Finished] Transform to mem in 0.280455s (10987 normal rows, 43020 exceptions)
[2021-03-25 13:09:23.967] [driver] [info] [Task Finished] Transform to mem in 0.280055s (11020 normal rows, 42867 exceptions)
[2021-03-25 13:09:24.280] [driver] [info] [Task Finished] Transform to mem in 0.313324s (12330 normal rows, 48094 exceptions)
[2021-03-25 13:09:24.280] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.6958s
[2021-03-25 13:09:24.280] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.6925s, 56350770 input rows, time to process 1 row via fast path: 0.000793113ms
[2021-03-25 13:09:24.281] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 13:09:24.285] [local ee] [info] compiled pure python pipeline in 0.004203s
[2021-03-25 13:09:24.285] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 13:09:24.286] [local ee] [info] Created 160 resolve tasks in 0.001204s
[2021-03-25 13:09:24.286] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 13:09:28.609] [driver] [info] [Task Finished] Resolve in 4.322716s
[2021-03-25 13:09:33.037] [driver] [info] [Task Finished] Resolve in 4.428118s
[2021-03-25 13:09:37.365] [driver] [info] [Task Finished] Resolve in 4.327766s
[2021-03-25 13:09:41.833] [driver] [info] [Task Finished] Resolve in 4.468062s
[2021-03-25 13:09:46.247] [driver] [info] [Task Finished] Resolve in 4.413814s
[2021-03-25 13:09:50.501] [driver] [info] [Task Finished] Resolve in 4.253964s
[2021-03-25 13:09:54.954] [driver] [info] [Task Finished] Resolve in 4.453521s
[2021-03-25 13:09:59.400] [driver] [info] [Task Finished] Resolve in 4.445930s
[2021-03-25 13:10:03.677] [driver] [info] [Task Finished] Resolve in 4.276971s
[2021-03-25 13:10:08.258] [driver] [info] [Task Finished] Resolve in 4.580524s
[2021-03-25 13:10:12.514] [driver] [info] [Task Finished] Resolve in 4.255921s
[2021-03-25 13:10:16.789] [driver] [info] [Task Finished] Resolve in 4.275040s
[2021-03-25 13:10:21.397] [driver] [info] [Task Finished] Resolve in 4.608397s
[2021-03-25 13:10:25.661] [driver] [info] [Task Finished] Resolve in 4.263195s
[2021-03-25 13:10:29.950] [driver] [info] [Task Finished] Resolve in 4.289817s
[2021-03-25 13:10:34.599] [driver] [info] [Task Finished] Resolve in 4.648579s
[2021-03-25 13:10:38.876] [driver] [info] [Task Finished] Resolve in 4.277181s
[2021-03-25 13:10:43.199] [driver] [info] [Task Finished] Resolve in 4.322737s
[2021-03-25 13:10:47.459] [driver] [info] [Task Finished] Resolve in 4.260092s
[2021-03-25 13:10:52.242] [driver] [info] [Task Finished] Resolve in 4.782420s
[2021-03-25 13:10:56.514] [driver] [info] [Task Finished] Resolve in 4.272796s
[2021-03-25 13:11:00.768] [driver] [info] [Task Finished] Resolve in 4.253462s
[2021-03-25 13:11:05.047] [driver] [info] [Task Finished] Resolve in 4.279198s
[2021-03-25 13:11:09.286] [driver] [info] [Task Finished] Resolve in 4.238893s
[2021-03-25 13:11:14.182] [driver] [info] [Task Finished] Resolve in 4.896200s
[2021-03-25 13:11:18.509] [driver] [info] [Task Finished] Resolve in 4.327103s
[2021-03-25 13:11:22.764] [driver] [info] [Task Finished] Resolve in 4.254663s
[2021-03-25 13:11:27.042] [driver] [info] [Task Finished] Resolve in 4.277875s
[2021-03-25 13:11:31.320] [driver] [info] [Task Finished] Resolve in 4.277485s
[2021-03-25 13:11:36.355] [driver] [info] [Task Finished] Resolve in 5.035679s
[2021-03-25 13:11:40.632] [driver] [info] [Task Finished] Resolve in 4.276795s
[2021-03-25 13:11:44.881] [driver] [info] [Task Finished] Resolve in 4.249084s
[2021-03-25 13:11:49.141] [driver] [info] [Task Finished] Resolve in 4.259321s
[2021-03-25 13:11:53.481] [driver] [info] [Task Finished] Resolve in 4.340179s
[2021-03-25 13:11:57.736] [driver] [info] [Task Finished] Resolve in 4.255108s
[2021-03-25 13:12:02.013] [driver] [info] [Task Finished] Resolve in 4.276872s
[2021-03-25 13:12:06.288] [driver] [info] [Task Finished] Resolve in 4.274675s
[2021-03-25 13:12:11.511] [driver] [info] [Task Finished] Resolve in 5.223704s
[2021-03-25 13:12:15.785] [driver] [info] [Task Finished] Resolve in 4.273508s
[2021-03-25 13:12:20.034] [driver] [info] [Task Finished] Resolve in 4.249498s
[2021-03-25 13:12:24.289] [driver] [info] [Task Finished] Resolve in 4.254713s
[2021-03-25 13:12:28.629] [driver] [info] [Task Finished] Resolve in 4.339758s
[2021-03-25 13:12:32.889] [driver] [info] [Task Finished] Resolve in 4.259706s
[2021-03-25 13:12:37.167] [driver] [info] [Task Finished] Resolve in 4.278052s
[2021-03-25 13:12:41.444] [driver] [info] [Task Finished] Resolve in 4.276977s
[2021-03-25 13:12:45.702] [driver] [info] [Task Finished] Resolve in 4.258262s
[2021-03-25 13:12:51.181] [driver] [info] [Task Finished] Resolve in 5.479162s
[2021-03-25 13:12:55.431] [driver] [info] [Task Finished] Resolve in 4.249561s
[2021-03-25 13:12:59.681] [driver] [info] [Task Finished] Resolve in 4.250027s
[2021-03-25 13:13:04.016] [driver] [info] [Task Finished] Resolve in 4.334706s
[2021-03-25 13:13:08.285] [driver] [info] [Task Finished] Resolve in 4.269363s
[2021-03-25 13:13:12.559] [driver] [info] [Task Finished] Resolve in 4.274417s
[2021-03-25 13:13:16.840] [driver] [info] [Task Finished] Resolve in 4.280073s
[2021-03-25 13:13:21.104] [driver] [info] [Task Finished] Resolve in 4.264776s
[2021-03-25 13:13:25.382] [driver] [info] [Task Finished] Resolve in 4.277455s
[2021-03-25 13:13:29.635] [driver] [info] [Task Finished] Resolve in 4.252790s
[2021-03-25 13:13:33.880] [driver] [info] [Task Finished] Resolve in 4.245103s
[2021-03-25 13:13:39.710] [driver] [info] [Task Finished] Resolve in 5.829954s
[2021-03-25 13:13:43.973] [driver] [info] [Task Finished] Resolve in 4.262893s
[2021-03-25 13:13:48.249] [driver] [info] [Task Finished] Resolve in 4.276571s
[2021-03-25 13:13:52.533] [driver] [info] [Task Finished] Resolve in 4.283719s
[2021-03-25 13:13:56.798] [driver] [info] [Task Finished] Resolve in 4.264992s
[2021-03-25 13:14:01.076] [driver] [info] [Task Finished] Resolve in 4.278355s
[2021-03-25 13:14:05.330] [driver] [info] [Task Finished] Resolve in 4.253159s
[2021-03-25 13:14:09.576] [driver] [info] [Task Finished] Resolve in 4.245992s
[2021-03-25 13:14:13.918] [driver] [info] [Task Finished] Resolve in 4.342651s
[2021-03-25 13:14:18.183] [driver] [info] [Task Finished] Resolve in 4.264456s
[2021-03-25 13:14:22.455] [driver] [info] [Task Finished] Resolve in 4.271865s
[2021-03-25 13:14:26.738] [driver] [info] [Task Finished] Resolve in 4.282833s
[2021-03-25 13:14:31.002] [driver] [info] [Task Finished] Resolve in 4.264621s
[2021-03-25 13:14:35.272] [driver] [info] [Task Finished] Resolve in 4.269563s
[2021-03-25 13:14:41.380] [driver] [info] [Task Finished] Resolve in 6.107995s
[2021-03-25 13:14:45.620] [driver] [info] [Task Finished] Resolve in 4.240352s
[2021-03-25 13:14:49.962] [driver] [info] [Task Finished] Resolve in 4.342155s
[2021-03-25 13:14:54.228] [driver] [info] [Task Finished] Resolve in 4.265715s
[2021-03-25 13:14:58.500] [driver] [info] [Task Finished] Resolve in 4.271690s
[2021-03-25 13:15:02.787] [driver] [info] [Task Finished] Resolve in 4.287367s
[2021-03-25 13:15:07.054] [driver] [info] [Task Finished] Resolve in 4.266224s
[2021-03-25 13:15:11.325] [driver] [info] [Task Finished] Resolve in 4.271455s
[2021-03-25 13:15:15.583] [driver] [info] [Task Finished] Resolve in 4.257836s
[2021-03-25 13:15:19.822] [driver] [info] [Task Finished] Resolve in 4.239179s
[2021-03-25 13:15:24.159] [driver] [info] [Task Finished] Resolve in 4.336766s
[2021-03-25 13:15:28.426] [driver] [info] [Task Finished] Resolve in 4.266514s
[2021-03-25 13:15:32.682] [driver] [info] [Task Finished] Resolve in 4.256428s
[2021-03-25 13:15:36.980] [driver] [info] [Task Finished] Resolve in 4.297948s
[2021-03-25 13:15:41.248] [driver] [info] [Task Finished] Resolve in 4.267877s
[2021-03-25 13:15:45.508] [driver] [info] [Task Finished] Resolve in 4.260479s
[2021-03-25 13:15:49.778] [driver] [info] [Task Finished] Resolve in 4.269259s
[2021-03-25 13:15:54.017] [driver] [info] [Task Finished] Resolve in 4.239265s
[2021-03-25 13:16:00.666] [driver] [info] [Task Finished] Resolve in 6.648894s
[2021-03-25 13:16:04.928] [driver] [info] [Task Finished] Resolve in 4.261748s
[2021-03-25 13:16:09.186] [driver] [info] [Task Finished] Resolve in 4.258476s
[2021-03-25 13:16:13.480] [driver] [info] [Task Finished] Resolve in 4.294226s
[2021-03-25 13:16:17.745] [driver] [info] [Task Finished] Resolve in 4.264231s
[2021-03-25 13:16:21.989] [driver] [info] [Task Finished] Resolve in 4.243771s
[2021-03-25 13:16:26.267] [driver] [info] [Task Finished] Resolve in 4.278124s
[2021-03-25 13:16:30.505] [driver] [info] [Task Finished] Resolve in 4.238693s
[2021-03-25 13:16:34.844] [driver] [info] [Task Finished] Resolve in 4.338778s
[2021-03-25 13:16:39.107] [driver] [info] [Task Finished] Resolve in 4.262621s
[2021-03-25 13:16:43.368] [driver] [info] [Task Finished] Resolve in 4.260756s
[2021-03-25 13:16:47.657] [driver] [info] [Task Finished] Resolve in 4.289374s
[2021-03-25 13:16:51.929] [driver] [info] [Task Finished] Resolve in 4.271854s
[2021-03-25 13:16:56.168] [driver] [info] [Task Finished] Resolve in 4.238571s
[2021-03-25 13:17:00.449] [driver] [info] [Task Finished] Resolve in 4.281549s
[2021-03-25 13:17:04.684] [driver] [info] [Task Finished] Resolve in 4.235316s
[2021-03-25 13:17:09.021] [driver] [info] [Task Finished] Resolve in 4.336387s
[2021-03-25 13:17:13.287] [driver] [info] [Task Finished] Resolve in 4.266089s
[2021-03-25 13:17:17.548] [driver] [info] [Task Finished] Resolve in 4.260743s
[2021-03-25 13:17:21.837] [driver] [info] [Task Finished] Resolve in 4.289653s
[2021-03-25 13:17:26.097] [driver] [info] [Task Finished] Resolve in 4.259318s
[2021-03-25 13:17:30.343] [driver] [info] [Task Finished] Resolve in 4.246168s
[2021-03-25 13:17:37.468] [driver] [info] [Task Finished] Resolve in 7.124435s
[2021-03-25 13:17:41.703] [driver] [info] [Task Finished] Resolve in 4.235089s
[2021-03-25 13:17:46.038] [driver] [info] [Task Finished] Resolve in 4.334861s
[2021-03-25 13:17:50.308] [driver] [info] [Task Finished] Resolve in 4.270449s
[2021-03-25 13:17:54.570] [driver] [info] [Task Finished] Resolve in 4.261738s
[2021-03-25 13:17:58.858] [driver] [info] [Task Finished] Resolve in 4.288239s
[2021-03-25 13:18:03.116] [driver] [info] [Task Finished] Resolve in 4.257660s
[2021-03-25 13:18:07.364] [driver] [info] [Task Finished] Resolve in 4.248183s
[2021-03-25 13:18:11.652] [driver] [info] [Task Finished] Resolve in 4.287912s
[2021-03-25 13:18:15.887] [driver] [info] [Task Finished] Resolve in 4.234990s
[2021-03-25 13:18:20.221] [driver] [info] [Task Finished] Resolve in 4.334356s
[2021-03-25 13:18:24.490] [driver] [info] [Task Finished] Resolve in 4.268947s
[2021-03-25 13:18:28.750] [driver] [info] [Task Finished] Resolve in 4.260139s
[2021-03-25 13:18:33.040] [driver] [info] [Task Finished] Resolve in 4.289515s
[2021-03-25 13:18:37.299] [driver] [info] [Task Finished] Resolve in 4.258828s
[2021-03-25 13:18:41.551] [driver] [info] [Task Finished] Resolve in 4.252180s
[2021-03-25 13:18:45.839] [driver] [info] [Task Finished] Resolve in 4.287540s
[2021-03-25 13:18:50.074] [driver] [info] [Task Finished] Resolve in 4.235510s
[2021-03-25 13:18:54.409] [driver] [info] [Task Finished] Resolve in 4.334957s
[2021-03-25 13:18:58.684] [driver] [info] [Task Finished] Resolve in 4.274420s
[2021-03-25 13:19:02.946] [driver] [info] [Task Finished] Resolve in 4.262619s
[2021-03-25 13:19:07.233] [driver] [info] [Task Finished] Resolve in 4.286301s
[2021-03-25 13:19:11.496] [driver] [info] [Task Finished] Resolve in 4.263298s
[2021-03-25 13:19:15.746] [driver] [info] [Task Finished] Resolve in 4.249646s
[2021-03-25 13:19:20.034] [driver] [info] [Task Finished] Resolve in 4.288166s
[2021-03-25 13:19:24.270] [driver] [info] [Task Finished] Resolve in 4.235825s
[2021-03-25 13:19:28.592] [driver] [info] [Task Finished] Resolve in 4.322685s
[2021-03-25 13:19:36.416] [driver] [info] [Task Finished] Resolve in 7.823208s
[2021-03-25 13:19:40.679] [driver] [info] [Task Finished] Resolve in 4.262944s
[2021-03-25 13:19:44.962] [driver] [info] [Task Finished] Resolve in 4.283087s
[2021-03-25 13:19:49.228] [driver] [info] [Task Finished] Resolve in 4.266516s
[2021-03-25 13:19:53.479] [driver] [info] [Task Finished] Resolve in 4.250771s
[2021-03-25 13:19:57.765] [driver] [info] [Task Finished] Resolve in 4.286106s
[2021-03-25 13:20:02.000] [driver] [info] [Task Finished] Resolve in 4.234467s
[2021-03-25 13:20:06.309] [driver] [info] [Task Finished] Resolve in 4.309059s
[2021-03-25 13:20:10.597] [driver] [info] [Task Finished] Resolve in 4.288114s
[2021-03-25 13:20:14.866] [driver] [info] [Task Finished] Resolve in 4.268919s
[2021-03-25 13:20:19.147] [driver] [info] [Task Finished] Resolve in 4.281112s
[2021-03-25 13:20:23.415] [driver] [info] [Task Finished] Resolve in 4.267509s
[2021-03-25 13:20:27.663] [driver] [info] [Task Finished] Resolve in 4.248177s
[2021-03-25 13:20:31.947] [driver] [info] [Task Finished] Resolve in 4.283703s
[2021-03-25 13:20:36.183] [driver] [info] [Task Finished] Resolve in 4.236474s
[2021-03-25 13:20:40.486] [driver] [info] [Task Finished] Resolve in 4.303267s
[2021-03-25 13:20:44.780] [driver] [info] [Task Finished] Resolve in 4.293966s
[2021-03-25 13:20:49.051] [driver] [info] [Task Finished] Resolve in 4.270730s
[2021-03-25 13:20:53.332] [driver] [info] [Task Finished] Resolve in 4.280789s
[2021-03-25 13:20:57.595] [driver] [info] [Task Finished] Resolve in 4.262790s
[2021-03-25 13:21:01.852] [driver] [info] [Task Finished] Resolve in 4.257604s
[2021-03-25 13:21:06.625] [driver] [info] [Task Finished] Resolve in 4.772085s
[2021-03-25 13:21:06.625] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 702.344s
[2021-03-25 13:21:06.625] [local ee] [info] slow path for Stage 0: total wall clock time: 702.333s, time to process 1 row via slow path: 0.101848ms
[2021-03-25 13:21:06.625] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 702.344s

[2021-03-25 13:21:06.658] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-25 13:21:06.971] [driver] [info] [Task Finished] write to file in 0.312969s (1798491 rows, 273.61 MB)
[2021-03-25 13:21:06.971] [global] [info] writing output took 0.346162s
[2021-03-25 13:21:06.971] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.346253s
[2021-03-25 13:21:06.971] [global] [info] [Transform Stage] Stage 0 took 747.884s
[2021-03-25 13:21:06.971] [global] [info] Query Execution took 747.962s. (planning: 0.0782642s, execution: 747.884s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.00496673583984375
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 748.245637178421 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0218972,"llvm_optimization_time_s":0.329588,"llvm_compilation_time_s":0.150793,"total_compilation_time_s":0.497761,"sampling_time_s":0.116536,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.6925,"fast_path_time_s":44.6958,"fast_path_per_row_time_ns":793.113,"slow_path_wall_time_s":702.333,"slow_path_time_s":702.344,"slow_path_per_row_time_ns":101848}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.00496673583984375, "jobTime": 748.245637178421, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
