[2021-03-25 11:00:58.982] [global] [error] could not find backend, defaulting to local
[2021-03-25 11:00:58.982] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 11:00:58.982] [local ee] [info] initializing LLVM backend
[2021-03-25 11:00:58.982] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 11:00:58.982] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 11:00:58.983] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 11:00:58.983] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 11:00:58.983] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 11:00:58.983] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 11:00:59.123] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:00:59.129] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:00:59.144] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:00:59.153] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:00:59.179] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:00:59.198] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:00:59.211] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:00:59.243] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:00:59.249] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:00:59.264] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:00:59.266] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:00:59.267] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:00:59.267] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:00:59.269] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:00:59.270] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:00:59.270] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:00:59.272] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:00:59.273] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:00:59.274] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:00:59.290] [logical planner] [info] logical optimization took 0.021924ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 11:00:59.290] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:00:59.290] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:00:59.291] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 11:00:59.292] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 11:00:59.292] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 11:00:59.293] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 11:00:59.293] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 11:00:59.294] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 11:00:59.295] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 11:00:59.296] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 11:00:59.297] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:00:59.298] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:00:59.299] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:00:59.299] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:00:59.301] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:00:59.302] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:00:59.302] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 11:00:59.303] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 11:00:59.303] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 11:00:59.304] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 11:00:59.305] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 11:00:59.305] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 11:00:59.306] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 11:00:59.307] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 11:00:59.308] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:00:59.309] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:00:59.310] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:00:59.310] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:00:59.311] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:00:59.343] [global] [info] Stage0 depends on: 
[2021-03-25 11:00:59.691] [global] [info] Optimization via LLVM passes took 0.331300 ms
[2021-03-25 11:00:59.843] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 11:00:59.843] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.500283s
[2021-03-25 11:00:59.844] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 11:01:00.127] [driver] [info] [Task Finished] Transform to mem in 0.283221s (11105 normal rows, 43095 exceptions)
[2021-03-25 11:01:00.408] [driver] [info] [Task Finished] Transform to mem in 0.281176s (11073 normal rows, 43414 exceptions)
[2021-03-25 11:01:00.689] [driver] [info] [Task Finished] Transform to mem in 0.280721s (11153 normal rows, 42970 exceptions)
[2021-03-25 11:01:00.970] [driver] [info] [Task Finished] Transform to mem in 0.281250s (11047 normal rows, 43210 exceptions)
[2021-03-25 11:01:01.251] [driver] [info] [Task Finished] Transform to mem in 0.280953s (10987 normal rows, 43113 exceptions)
[2021-03-25 11:01:01.531] [driver] [info] [Task Finished] Transform to mem in 0.280316s (10997 normal rows, 42873 exceptions)
[2021-03-25 11:01:01.812] [driver] [info] [Task Finished] Transform to mem in 0.280499s (11036 normal rows, 43142 exceptions)
[2021-03-25 11:01:02.092] [driver] [info] [Task Finished] Transform to mem in 0.280459s (11005 normal rows, 42741 exceptions)
[2021-03-25 11:01:02.373] [driver] [info] [Task Finished] Transform to mem in 0.280243s (11086 normal rows, 43015 exceptions)
[2021-03-25 11:01:02.653] [driver] [info] [Task Finished] Transform to mem in 0.280384s (11092 normal rows, 43495 exceptions)
[2021-03-25 11:01:02.933] [driver] [info] [Task Finished] Transform to mem in 0.280219s (11153 normal rows, 42968 exceptions)
[2021-03-25 11:01:03.214] [driver] [info] [Task Finished] Transform to mem in 0.280355s (11026 normal rows, 43206 exceptions)
[2021-03-25 11:01:03.494] [driver] [info] [Task Finished] Transform to mem in 0.280473s (11008 normal rows, 43077 exceptions)
[2021-03-25 11:01:03.774] [driver] [info] [Task Finished] Transform to mem in 0.280374s (10997 normal rows, 42910 exceptions)
[2021-03-25 11:01:04.054] [driver] [info] [Task Finished] Transform to mem in 0.279796s (11036 normal rows, 43139 exceptions)
[2021-03-25 11:01:04.333] [driver] [info] [Task Finished] Transform to mem in 0.279006s (11005 normal rows, 42744 exceptions)
[2021-03-25 11:01:04.613] [driver] [info] [Task Finished] Transform to mem in 0.280032s (11086 normal rows, 42996 exceptions)
[2021-03-25 11:01:04.893] [driver] [info] [Task Finished] Transform to mem in 0.279940s (11092 normal rows, 43505 exceptions)
[2021-03-25 11:01:05.173] [driver] [info] [Task Finished] Transform to mem in 0.280101s (11153 normal rows, 42978 exceptions)
[2021-03-25 11:01:05.453] [driver] [info] [Task Finished] Transform to mem in 0.279611s (11026 normal rows, 43205 exceptions)
[2021-03-25 11:01:05.733] [driver] [info] [Task Finished] Transform to mem in 0.280051s (10982 normal rows, 43059 exceptions)
[2021-03-25 11:01:06.013] [driver] [info] [Task Finished] Transform to mem in 0.279758s (11023 normal rows, 42910 exceptions)
[2021-03-25 11:01:06.293] [driver] [info] [Task Finished] Transform to mem in 0.279724s (11036 normal rows, 43115 exceptions)
[2021-03-25 11:01:06.572] [driver] [info] [Task Finished] Transform to mem in 0.279556s (11005 normal rows, 42772 exceptions)
[2021-03-25 11:01:06.852] [driver] [info] [Task Finished] Transform to mem in 0.279793s (11086 normal rows, 42970 exceptions)
[2021-03-25 11:01:07.132] [driver] [info] [Task Finished] Transform to mem in 0.280169s (11079 normal rows, 43539 exceptions)
[2021-03-25 11:01:07.412] [driver] [info] [Task Finished] Transform to mem in 0.280192s (11111 normal rows, 42961 exceptions)
[2021-03-25 11:01:07.692] [driver] [info] [Task Finished] Transform to mem in 0.279916s (11076 normal rows, 43220 exceptions)
[2021-03-25 11:01:07.972] [driver] [info] [Task Finished] Transform to mem in 0.279991s (10987 normal rows, 43068 exceptions)
[2021-03-25 11:01:08.252] [driver] [info] [Task Finished] Transform to mem in 0.279922s (11023 normal rows, 42880 exceptions)
[2021-03-25 11:01:08.532] [driver] [info] [Task Finished] Transform to mem in 0.279983s (11036 normal rows, 43053 exceptions)
[2021-03-25 11:01:08.812] [driver] [info] [Task Finished] Transform to mem in 0.279912s (10992 normal rows, 42864 exceptions)
[2021-03-25 11:01:09.092] [driver] [info] [Task Finished] Transform to mem in 0.279926s (11099 normal rows, 42882 exceptions)
[2021-03-25 11:01:09.373] [driver] [info] [Task Finished] Transform to mem in 0.280583s (11063 normal rows, 43617 exceptions)
[2021-03-25 11:01:09.653] [driver] [info] [Task Finished] Transform to mem in 0.280032s (11127 normal rows, 42969 exceptions)
[2021-03-25 11:01:09.933] [driver] [info] [Task Finished] Transform to mem in 0.279899s (11076 normal rows, 43221 exceptions)
[2021-03-25 11:01:10.213] [driver] [info] [Task Finished] Transform to mem in 0.280627s (10987 normal rows, 43063 exceptions)
[2021-03-25 11:01:10.493] [driver] [info] [Task Finished] Transform to mem in 0.279566s (11004 normal rows, 42876 exceptions)
[2021-03-25 11:01:10.773] [driver] [info] [Task Finished] Transform to mem in 0.279891s (11026 normal rows, 43041 exceptions)
[2021-03-25 11:01:11.053] [driver] [info] [Task Finished] Transform to mem in 0.279759s (11021 normal rows, 42887 exceptions)
[2021-03-25 11:01:11.333] [driver] [info] [Task Finished] Transform to mem in 0.280029s (11064 normal rows, 42832 exceptions)
[2021-03-25 11:01:11.613] [driver] [info] [Task Finished] Transform to mem in 0.280307s (11098 normal rows, 43603 exceptions)
[2021-03-25 11:01:11.893] [driver] [info] [Task Finished] Transform to mem in 0.280252s (11127 normal rows, 43028 exceptions)
[2021-03-25 11:01:12.173] [driver] [info] [Task Finished] Transform to mem in 0.279788s (11076 normal rows, 43212 exceptions)
[2021-03-25 11:01:12.454] [driver] [info] [Task Finished] Transform to mem in 0.280669s (10987 normal rows, 43041 exceptions)
[2021-03-25 11:01:12.734] [driver] [info] [Task Finished] Transform to mem in 0.280317s (11004 normal rows, 42913 exceptions)
[2021-03-25 11:01:13.014] [driver] [info] [Task Finished] Transform to mem in 0.279939s (11026 normal rows, 43037 exceptions)
[2021-03-25 11:01:13.294] [driver] [info] [Task Finished] Transform to mem in 0.279803s (11012 normal rows, 42883 exceptions)
[2021-03-25 11:01:13.575] [driver] [info] [Task Finished] Transform to mem in 0.280845s (11073 normal rows, 42820 exceptions)
[2021-03-25 11:01:13.855] [driver] [info] [Task Finished] Transform to mem in 0.280150s (11095 normal rows, 43503 exceptions)
[2021-03-25 11:01:14.135] [driver] [info] [Task Finished] Transform to mem in 0.280384s (11130 normal rows, 43084 exceptions)
[2021-03-25 11:01:14.415] [driver] [info] [Task Finished] Transform to mem in 0.279972s (11076 normal rows, 43152 exceptions)
[2021-03-25 11:01:14.696] [driver] [info] [Task Finished] Transform to mem in 0.280236s (10976 normal rows, 43110 exceptions)
[2021-03-25 11:01:14.976] [driver] [info] [Task Finished] Transform to mem in 0.280275s (11015 normal rows, 42966 exceptions)
[2021-03-25 11:01:15.256] [driver] [info] [Task Finished] Transform to mem in 0.279915s (11026 normal rows, 43035 exceptions)
[2021-03-25 11:01:15.536] [driver] [info] [Task Finished] Transform to mem in 0.279843s (11012 normal rows, 42888 exceptions)
[2021-03-25 11:01:15.815] [driver] [info] [Task Finished] Transform to mem in 0.279699s (11073 normal rows, 42754 exceptions)
[2021-03-25 11:01:16.096] [driver] [info] [Task Finished] Transform to mem in 0.280396s (11095 normal rows, 43552 exceptions)
[2021-03-25 11:01:16.376] [driver] [info] [Task Finished] Transform to mem in 0.280345s (11130 normal rows, 43033 exceptions)
[2021-03-25 11:01:16.657] [driver] [info] [Task Finished] Transform to mem in 0.280507s (11069 normal rows, 43142 exceptions)
[2021-03-25 11:01:16.937] [driver] [info] [Task Finished] Transform to mem in 0.280255s (10974 normal rows, 43172 exceptions)
[2021-03-25 11:01:17.217] [driver] [info] [Task Finished] Transform to mem in 0.280290s (11008 normal rows, 42964 exceptions)
[2021-03-25 11:01:17.497] [driver] [info] [Task Finished] Transform to mem in 0.280059s (11042 normal rows, 43023 exceptions)
[2021-03-25 11:01:17.777] [driver] [info] [Task Finished] Transform to mem in 0.279935s (11012 normal rows, 42911 exceptions)
[2021-03-25 11:01:18.058] [driver] [info] [Task Finished] Transform to mem in 0.280575s (11063 normal rows, 42726 exceptions)
[2021-03-25 11:01:18.338] [driver] [info] [Task Finished] Transform to mem in 0.280581s (11105 normal rows, 43555 exceptions)
[2021-03-25 11:01:18.621] [driver] [info] [Task Finished] Transform to mem in 0.282347s (11081 normal rows, 43050 exceptions)
[2021-03-25 11:01:18.901] [driver] [info] [Task Finished] Transform to mem in 0.280104s (11087 normal rows, 43150 exceptions)
[2021-03-25 11:01:19.181] [driver] [info] [Task Finished] Transform to mem in 0.279955s (11005 normal rows, 43164 exceptions)
[2021-03-25 11:01:19.461] [driver] [info] [Task Finished] Transform to mem in 0.280054s (11008 normal rows, 42975 exceptions)
[2021-03-25 11:01:19.741] [driver] [info] [Task Finished] Transform to mem in 0.279801s (11042 normal rows, 42959 exceptions)
[2021-03-25 11:01:20.021] [driver] [info] [Task Finished] Transform to mem in 0.279925s (11002 normal rows, 42964 exceptions)
[2021-03-25 11:01:20.300] [driver] [info] [Task Finished] Transform to mem in 0.278984s (11073 normal rows, 42720 exceptions)
[2021-03-25 11:01:20.580] [driver] [info] [Task Finished] Transform to mem in 0.280067s (11088 normal rows, 43511 exceptions)
[2021-03-25 11:01:20.860] [driver] [info] [Task Finished] Transform to mem in 0.280265s (11098 normal rows, 43112 exceptions)
[2021-03-25 11:01:21.140] [driver] [info] [Task Finished] Transform to mem in 0.280293s (11087 normal rows, 43044 exceptions)
[2021-03-25 11:01:21.420] [driver] [info] [Task Finished] Transform to mem in 0.279664s (11005 normal rows, 43229 exceptions)
[2021-03-25 11:01:21.700] [driver] [info] [Task Finished] Transform to mem in 0.280090s (11008 normal rows, 43017 exceptions)
[2021-03-25 11:01:21.982] [driver] [info] [Task Finished] Transform to mem in 0.281738s (11024 normal rows, 42947 exceptions)
[2021-03-25 11:01:22.262] [driver] [info] [Task Finished] Transform to mem in 0.279617s (11020 normal rows, 42976 exceptions)
[2021-03-25 11:01:22.541] [driver] [info] [Task Finished] Transform to mem in 0.279012s (11036 normal rows, 42710 exceptions)
[2021-03-25 11:01:22.820] [driver] [info] [Task Finished] Transform to mem in 0.279798s (11125 normal rows, 43517 exceptions)
[2021-03-25 11:01:23.100] [driver] [info] [Task Finished] Transform to mem in 0.279393s (11098 normal rows, 43115 exceptions)
[2021-03-25 11:01:23.379] [driver] [info] [Task Finished] Transform to mem in 0.278979s (11087 normal rows, 42938 exceptions)
[2021-03-25 11:01:23.658] [driver] [info] [Task Finished] Transform to mem in 0.279201s (10985 normal rows, 43336 exceptions)
[2021-03-25 11:01:23.937] [driver] [info] [Task Finished] Transform to mem in 0.279367s (11000 normal rows, 42999 exceptions)
[2021-03-25 11:01:24.217] [driver] [info] [Task Finished] Transform to mem in 0.279831s (11052 normal rows, 42881 exceptions)
[2021-03-25 11:01:24.497] [driver] [info] [Task Finished] Transform to mem in 0.280042s (11020 normal rows, 43057 exceptions)
[2021-03-25 11:01:24.777] [driver] [info] [Task Finished] Transform to mem in 0.279310s (10995 normal rows, 42708 exceptions)
[2021-03-25 11:01:25.057] [driver] [info] [Task Finished] Transform to mem in 0.280517s (11166 normal rows, 43520 exceptions)
[2021-03-25 11:01:25.337] [driver] [info] [Task Finished] Transform to mem in 0.279886s (11098 normal rows, 43075 exceptions)
[2021-03-25 11:01:25.617] [driver] [info] [Task Finished] Transform to mem in 0.279879s (11073 normal rows, 42970 exceptions)
[2021-03-25 11:01:25.897] [driver] [info] [Task Finished] Transform to mem in 0.279854s (10999 normal rows, 43334 exceptions)
[2021-03-25 11:01:26.177] [driver] [info] [Task Finished] Transform to mem in 0.280208s (11000 normal rows, 43009 exceptions)
[2021-03-25 11:01:26.457] [driver] [info] [Task Finished] Transform to mem in 0.279873s (11052 normal rows, 42764 exceptions)
[2021-03-25 11:01:26.737] [driver] [info] [Task Finished] Transform to mem in 0.280282s (11020 normal rows, 43138 exceptions)
[2021-03-25 11:01:27.017] [driver] [info] [Task Finished] Transform to mem in 0.279910s (10995 normal rows, 42726 exceptions)
[2021-03-25 11:01:27.298] [driver] [info] [Task Finished] Transform to mem in 0.280598s (11166 normal rows, 43508 exceptions)
[2021-03-25 11:01:27.579] [driver] [info] [Task Finished] Transform to mem in 0.280987s (11091 normal rows, 43047 exceptions)
[2021-03-25 11:01:27.859] [driver] [info] [Task Finished] Transform to mem in 0.280153s (11080 normal rows, 43031 exceptions)
[2021-03-25 11:01:28.139] [driver] [info] [Task Finished] Transform to mem in 0.280115s (10999 normal rows, 43300 exceptions)
[2021-03-25 11:01:28.420] [driver] [info] [Task Finished] Transform to mem in 0.280378s (11000 normal rows, 43043 exceptions)
[2021-03-25 11:01:28.699] [driver] [info] [Task Finished] Transform to mem in 0.279671s (11036 normal rows, 42720 exceptions)
[2021-03-25 11:01:28.979] [driver] [info] [Task Finished] Transform to mem in 0.279805s (11016 normal rows, 43165 exceptions)
[2021-03-25 11:01:29.259] [driver] [info] [Task Finished] Transform to mem in 0.279443s (10995 normal rows, 42718 exceptions)
[2021-03-25 11:01:29.539] [driver] [info] [Task Finished] Transform to mem in 0.280149s (11186 normal rows, 43465 exceptions)
[2021-03-25 11:01:29.819] [driver] [info] [Task Finished] Transform to mem in 0.279915s (11001 normal rows, 43113 exceptions)
[2021-03-25 11:01:30.099] [driver] [info] [Task Finished] Transform to mem in 0.280365s (11170 normal rows, 43024 exceptions)
[2021-03-25 11:01:30.379] [driver] [info] [Task Finished] Transform to mem in 0.279910s (10989 normal rows, 43282 exceptions)
[2021-03-25 11:01:30.660] [driver] [info] [Task Finished] Transform to mem in 0.280800s (11010 normal rows, 43002 exceptions)
[2021-03-25 11:01:30.940] [driver] [info] [Task Finished] Transform to mem in 0.279837s (11002 normal rows, 42755 exceptions)
[2021-03-25 11:01:31.221] [driver] [info] [Task Finished] Transform to mem in 0.280985s (11050 normal rows, 43199 exceptions)
[2021-03-25 11:01:31.502] [driver] [info] [Task Finished] Transform to mem in 0.281377s (10973 normal rows, 42686 exceptions)
[2021-03-25 11:01:31.782] [driver] [info] [Task Finished] Transform to mem in 0.280393s (11160 normal rows, 43455 exceptions)
[2021-03-25 11:01:32.063] [driver] [info] [Task Finished] Transform to mem in 0.280794s (11045 normal rows, 43148 exceptions)
[2021-03-25 11:01:32.344] [driver] [info] [Task Finished] Transform to mem in 0.281169s (11166 normal rows, 43023 exceptions)
[2021-03-25 11:01:32.625] [driver] [info] [Task Finished] Transform to mem in 0.280982s (10997 normal rows, 43283 exceptions)
[2021-03-25 11:01:32.906] [driver] [info] [Task Finished] Transform to mem in 0.280724s (11005 normal rows, 42971 exceptions)
[2021-03-25 11:01:33.187] [driver] [info] [Task Finished] Transform to mem in 0.281110s (11007 normal rows, 42795 exceptions)
[2021-03-25 11:01:33.469] [driver] [info] [Task Finished] Transform to mem in 0.281314s (11050 normal rows, 43196 exceptions)
[2021-03-25 11:01:33.749] [driver] [info] [Task Finished] Transform to mem in 0.280414s (10973 normal rows, 42686 exceptions)
[2021-03-25 11:01:34.031] [driver] [info] [Task Finished] Transform to mem in 0.281505s (11160 normal rows, 43446 exceptions)
[2021-03-25 11:01:34.312] [driver] [info] [Task Finished] Transform to mem in 0.280956s (11043 normal rows, 43153 exceptions)
[2021-03-25 11:01:34.592] [driver] [info] [Task Finished] Transform to mem in 0.280705s (11168 normal rows, 43028 exceptions)
[2021-03-25 11:01:34.873] [driver] [info] [Task Finished] Transform to mem in 0.280673s (10997 normal rows, 43277 exceptions)
[2021-03-25 11:01:35.154] [driver] [info] [Task Finished] Transform to mem in 0.281405s (10997 normal rows, 42973 exceptions)
[2021-03-25 11:01:35.435] [driver] [info] [Task Finished] Transform to mem in 0.280476s (11015 normal rows, 42799 exceptions)
[2021-03-25 11:01:35.716] [driver] [info] [Task Finished] Transform to mem in 0.280794s (11050 normal rows, 43170 exceptions)
[2021-03-25 11:01:35.997] [driver] [info] [Task Finished] Transform to mem in 0.280991s (10973 normal rows, 42710 exceptions)
[2021-03-25 11:01:36.277] [driver] [info] [Task Finished] Transform to mem in 0.280664s (11160 normal rows, 43431 exceptions)
[2021-03-25 11:01:36.558] [driver] [info] [Task Finished] Transform to mem in 0.280580s (11043 normal rows, 43166 exceptions)
[2021-03-25 11:01:36.839] [driver] [info] [Task Finished] Transform to mem in 0.281189s (11168 normal rows, 43027 exceptions)
[2021-03-25 11:01:37.120] [driver] [info] [Task Finished] Transform to mem in 0.280507s (10997 normal rows, 43237 exceptions)
[2021-03-25 11:01:37.400] [driver] [info] [Task Finished] Transform to mem in 0.280676s (10997 normal rows, 43012 exceptions)
[2021-03-25 11:01:37.681] [driver] [info] [Task Finished] Transform to mem in 0.280494s (11009 normal rows, 42805 exceptions)
[2021-03-25 11:01:37.961] [driver] [info] [Task Finished] Transform to mem in 0.280375s (11021 normal rows, 43160 exceptions)
[2021-03-25 11:01:38.242] [driver] [info] [Task Finished] Transform to mem in 0.280405s (11003 normal rows, 42716 exceptions)
[2021-03-25 11:01:38.523] [driver] [info] [Task Finished] Transform to mem in 0.280855s (11165 normal rows, 43354 exceptions)
[2021-03-25 11:01:38.803] [driver] [info] [Task Finished] Transform to mem in 0.280284s (11043 normal rows, 43217 exceptions)
[2021-03-25 11:01:39.083] [driver] [info] [Task Finished] Transform to mem in 0.280205s (11156 normal rows, 43044 exceptions)
[2021-03-25 11:01:39.363] [driver] [info] [Task Finished] Transform to mem in 0.280003s (11009 normal rows, 43187 exceptions)
[2021-03-25 11:01:39.643] [driver] [info] [Task Finished] Transform to mem in 0.279734s (10997 normal rows, 43067 exceptions)
[2021-03-25 11:01:39.922] [driver] [info] [Task Finished] Transform to mem in 0.279122s (11009 normal rows, 42811 exceptions)
[2021-03-25 11:01:40.203] [driver] [info] [Task Finished] Transform to mem in 0.280426s (11021 normal rows, 43162 exceptions)
[2021-03-25 11:01:40.483] [driver] [info] [Task Finished] Transform to mem in 0.280399s (11003 normal rows, 42716 exceptions)
[2021-03-25 11:01:40.764] [driver] [info] [Task Finished] Transform to mem in 0.280542s (11165 normal rows, 43260 exceptions)
[2021-03-25 11:01:41.045] [driver] [info] [Task Finished] Transform to mem in 0.281069s (11027 normal rows, 43245 exceptions)
[2021-03-25 11:01:41.325] [driver] [info] [Task Finished] Transform to mem in 0.280719s (11172 normal rows, 43107 exceptions)
[2021-03-25 11:01:41.606] [driver] [info] [Task Finished] Transform to mem in 0.280647s (10997 normal rows, 43177 exceptions)
[2021-03-25 11:01:41.887] [driver] [info] [Task Finished] Transform to mem in 0.281277s (11009 normal rows, 43050 exceptions)
[2021-03-25 11:01:42.168] [driver] [info] [Task Finished] Transform to mem in 0.280479s (10999 normal rows, 42828 exceptions)
[2021-03-25 11:01:42.449] [driver] [info] [Task Finished] Transform to mem in 0.280910s (11031 normal rows, 43157 exceptions)
[2021-03-25 11:01:42.729] [driver] [info] [Task Finished] Transform to mem in 0.280412s (11000 normal rows, 42726 exceptions)
[2021-03-25 11:01:43.011] [driver] [info] [Task Finished] Transform to mem in 0.281530s (11091 normal rows, 43230 exceptions)
[2021-03-25 11:01:43.292] [driver] [info] [Task Finished] Transform to mem in 0.281097s (11099 normal rows, 43272 exceptions)
[2021-03-25 11:01:43.573] [driver] [info] [Task Finished] Transform to mem in 0.280967s (11177 normal rows, 43113 exceptions)
[2021-03-25 11:01:43.854] [driver] [info] [Task Finished] Transform to mem in 0.280886s (10997 normal rows, 43174 exceptions)
[2021-03-25 11:01:44.136] [driver] [info] [Task Finished] Transform to mem in 0.282449s (10987 normal rows, 43020 exceptions)
[2021-03-25 11:01:44.418] [driver] [info] [Task Finished] Transform to mem in 0.281885s (11020 normal rows, 42867 exceptions)
[2021-03-25 11:01:44.733] [driver] [info] [Task Finished] Transform to mem in 0.314707s (12330 normal rows, 48094 exceptions)
[2021-03-25 11:01:44.733] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.8896s
[2021-03-25 11:01:44.733] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.8864s, 56350770 input rows, time to process 1 row via fast path: 0.000796553ms
[2021-03-25 11:01:44.733] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 11:01:44.737] [local ee] [info] compiled pure python pipeline in 0.004223s
[2021-03-25 11:01:44.737] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 11:01:44.739] [local ee] [info] Created 160 resolve tasks in 0.001241s
[2021-03-25 11:01:44.739] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 11:01:49.046] [driver] [info] [Task Finished] Resolve in 4.307659s
[2021-03-25 11:01:53.461] [driver] [info] [Task Finished] Resolve in 4.414482s
[2021-03-25 11:01:57.771] [driver] [info] [Task Finished] Resolve in 4.309894s
[2021-03-25 11:02:02.221] [driver] [info] [Task Finished] Resolve in 4.450339s
[2021-03-25 11:02:06.617] [driver] [info] [Task Finished] Resolve in 4.395714s
[2021-03-25 11:02:10.852] [driver] [info] [Task Finished] Resolve in 4.235492s
[2021-03-25 11:02:15.294] [driver] [info] [Task Finished] Resolve in 4.441481s
[2021-03-25 11:02:19.732] [driver] [info] [Task Finished] Resolve in 4.438025s
[2021-03-25 11:02:23.998] [driver] [info] [Task Finished] Resolve in 4.266351s
[2021-03-25 11:02:28.570] [driver] [info] [Task Finished] Resolve in 4.571616s
[2021-03-25 11:02:32.814] [driver] [info] [Task Finished] Resolve in 4.243570s
[2021-03-25 11:02:37.074] [driver] [info] [Task Finished] Resolve in 4.260323s
[2021-03-25 11:02:41.659] [driver] [info] [Task Finished] Resolve in 4.584749s
[2021-03-25 11:02:45.900] [driver] [info] [Task Finished] Resolve in 4.240898s
[2021-03-25 11:02:50.166] [driver] [info] [Task Finished] Resolve in 4.265933s
[2021-03-25 11:02:54.791] [driver] [info] [Task Finished] Resolve in 4.625584s
[2021-03-25 11:02:59.049] [driver] [info] [Task Finished] Resolve in 4.258069s
[2021-03-25 11:03:03.350] [driver] [info] [Task Finished] Resolve in 4.300856s
[2021-03-25 11:03:07.589] [driver] [info] [Task Finished] Resolve in 4.239221s
[2021-03-25 11:03:12.348] [driver] [info] [Task Finished] Resolve in 4.758811s
[2021-03-25 11:03:16.607] [driver] [info] [Task Finished] Resolve in 4.258296s
[2021-03-25 11:03:20.846] [driver] [info] [Task Finished] Resolve in 4.238913s
[2021-03-25 11:03:25.109] [driver] [info] [Task Finished] Resolve in 4.262936s
[2021-03-25 11:03:29.333] [driver] [info] [Task Finished] Resolve in 4.224256s
[2021-03-25 11:03:34.208] [driver] [info] [Task Finished] Resolve in 4.874829s
[2021-03-25 11:03:38.515] [driver] [info] [Task Finished] Resolve in 4.306923s
[2021-03-25 11:03:42.748] [driver] [info] [Task Finished] Resolve in 4.232907s
[2021-03-25 11:03:47.005] [driver] [info] [Task Finished] Resolve in 4.257017s
[2021-03-25 11:03:51.261] [driver] [info] [Task Finished] Resolve in 4.256510s
[2021-03-25 11:03:56.275] [driver] [info] [Task Finished] Resolve in 5.014082s
[2021-03-25 11:04:00.536] [driver] [info] [Task Finished] Resolve in 4.260947s
[2021-03-25 11:04:04.765] [driver] [info] [Task Finished] Resolve in 4.229100s
[2021-03-25 11:04:09.009] [driver] [info] [Task Finished] Resolve in 4.243566s
[2021-03-25 11:04:13.330] [driver] [info] [Task Finished] Resolve in 4.321284s
[2021-03-25 11:04:17.569] [driver] [info] [Task Finished] Resolve in 4.238658s
[2021-03-25 11:04:21.827] [driver] [info] [Task Finished] Resolve in 4.258270s
[2021-03-25 11:04:26.082] [driver] [info] [Task Finished] Resolve in 4.254448s
[2021-03-25 11:04:31.290] [driver] [info] [Task Finished] Resolve in 5.207896s
[2021-03-25 11:04:35.548] [driver] [info] [Task Finished] Resolve in 4.258448s
[2021-03-25 11:04:39.779] [driver] [info] [Task Finished] Resolve in 4.231041s
[2021-03-25 11:04:44.011] [driver] [info] [Task Finished] Resolve in 4.231767s
[2021-03-25 11:04:48.333] [driver] [info] [Task Finished] Resolve in 4.321879s
[2021-03-25 11:04:52.574] [driver] [info] [Task Finished] Resolve in 4.241387s
[2021-03-25 11:04:56.833] [driver] [info] [Task Finished] Resolve in 4.258611s
[2021-03-25 11:05:01.089] [driver] [info] [Task Finished] Resolve in 4.255476s
[2021-03-25 11:05:05.324] [driver] [info] [Task Finished] Resolve in 4.235497s
[2021-03-25 11:05:10.786] [driver] [info] [Task Finished] Resolve in 5.462062s
[2021-03-25 11:05:15.015] [driver] [info] [Task Finished] Resolve in 4.228785s
[2021-03-25 11:05:19.247] [driver] [info] [Task Finished] Resolve in 4.231746s
[2021-03-25 11:05:23.556] [driver] [info] [Task Finished] Resolve in 4.309220s
[2021-03-25 11:05:27.801] [driver] [info] [Task Finished] Resolve in 4.245057s
[2021-03-25 11:05:32.052] [driver] [info] [Task Finished] Resolve in 4.250340s
[2021-03-25 11:05:36.307] [driver] [info] [Task Finished] Resolve in 4.255105s
[2021-03-25 11:05:40.551] [driver] [info] [Task Finished] Resolve in 4.244647s
[2021-03-25 11:05:44.807] [driver] [info] [Task Finished] Resolve in 4.255729s
[2021-03-25 11:05:49.037] [driver] [info] [Task Finished] Resolve in 4.229428s
[2021-03-25 11:05:53.260] [driver] [info] [Task Finished] Resolve in 4.223401s
[2021-03-25 11:05:59.068] [driver] [info] [Task Finished] Resolve in 5.807517s
[2021-03-25 11:06:03.308] [driver] [info] [Task Finished] Resolve in 4.239892s
[2021-03-25 11:06:07.557] [driver] [info] [Task Finished] Resolve in 4.249154s
[2021-03-25 11:06:11.815] [driver] [info] [Task Finished] Resolve in 4.258665s
[2021-03-25 11:06:16.055] [driver] [info] [Task Finished] Resolve in 4.239566s
[2021-03-25 11:06:20.307] [driver] [info] [Task Finished] Resolve in 4.252358s
[2021-03-25 11:06:24.537] [driver] [info] [Task Finished] Resolve in 4.229878s
[2021-03-25 11:06:28.757] [driver] [info] [Task Finished] Resolve in 4.220097s
[2021-03-25 11:06:33.073] [driver] [info] [Task Finished] Resolve in 4.315752s
[2021-03-25 11:06:37.312] [driver] [info] [Task Finished] Resolve in 4.238439s
[2021-03-25 11:06:41.560] [driver] [info] [Task Finished] Resolve in 4.248494s
[2021-03-25 11:06:45.817] [driver] [info] [Task Finished] Resolve in 4.256945s
[2021-03-25 11:06:50.057] [driver] [info] [Task Finished] Resolve in 4.240169s
[2021-03-25 11:06:54.305] [driver] [info] [Task Finished] Resolve in 4.247749s
[2021-03-25 11:07:00.393] [driver] [info] [Task Finished] Resolve in 6.087308s
[2021-03-25 11:07:04.619] [driver] [info] [Task Finished] Resolve in 4.226097s
[2021-03-25 11:07:08.944] [driver] [info] [Task Finished] Resolve in 4.325164s
[2021-03-25 11:07:13.196] [driver] [info] [Task Finished] Resolve in 4.252397s
[2021-03-25 11:07:17.445] [driver] [info] [Task Finished] Resolve in 4.249005s
[2021-03-25 11:07:21.717] [driver] [info] [Task Finished] Resolve in 4.271949s
[2021-03-25 11:07:25.967] [driver] [info] [Task Finished] Resolve in 4.249835s
[2021-03-25 11:07:30.221] [driver] [info] [Task Finished] Resolve in 4.253366s
[2021-03-25 11:07:34.459] [driver] [info] [Task Finished] Resolve in 4.238196s
[2021-03-25 11:07:38.686] [driver] [info] [Task Finished] Resolve in 4.227312s
[2021-03-25 11:07:43.009] [driver] [info] [Task Finished] Resolve in 4.323054s
[2021-03-25 11:07:47.260] [driver] [info] [Task Finished] Resolve in 4.250646s
[2021-03-25 11:07:51.501] [driver] [info] [Task Finished] Resolve in 4.240601s
[2021-03-25 11:07:55.779] [driver] [info] [Task Finished] Resolve in 4.278850s
[2021-03-25 11:08:00.030] [driver] [info] [Task Finished] Resolve in 4.250764s
[2021-03-25 11:08:04.273] [driver] [info] [Task Finished] Resolve in 4.242313s
[2021-03-25 11:08:08.526] [driver] [info] [Task Finished] Resolve in 4.253588s
[2021-03-25 11:08:12.750] [driver] [info] [Task Finished] Resolve in 4.223743s
[2021-03-25 11:08:19.354] [driver] [info] [Task Finished] Resolve in 6.604377s
[2021-03-25 11:08:23.597] [driver] [info] [Task Finished] Resolve in 4.242693s
[2021-03-25 11:08:27.840] [driver] [info] [Task Finished] Resolve in 4.242605s
[2021-03-25 11:08:32.120] [driver] [info] [Task Finished] Resolve in 4.280272s
[2021-03-25 11:08:36.369] [driver] [info] [Task Finished] Resolve in 4.249247s
[2021-03-25 11:08:40.595] [driver] [info] [Task Finished] Resolve in 4.226016s
[2021-03-25 11:08:44.856] [driver] [info] [Task Finished] Resolve in 4.260564s
[2021-03-25 11:08:49.078] [driver] [info] [Task Finished] Resolve in 4.221862s
[2021-03-25 11:08:53.402] [driver] [info] [Task Finished] Resolve in 4.324051s
[2021-03-25 11:08:57.653] [driver] [info] [Task Finished] Resolve in 4.250548s
[2021-03-25 11:09:01.899] [driver] [info] [Task Finished] Resolve in 4.246429s
[2021-03-25 11:09:06.175] [driver] [info] [Task Finished] Resolve in 4.275456s
[2021-03-25 11:09:10.429] [driver] [info] [Task Finished] Resolve in 4.254606s
[2021-03-25 11:09:14.649] [driver] [info] [Task Finished] Resolve in 4.219730s
[2021-03-25 11:09:18.912] [driver] [info] [Task Finished] Resolve in 4.262531s
[2021-03-25 11:09:23.129] [driver] [info] [Task Finished] Resolve in 4.217928s
[2021-03-25 11:09:27.447] [driver] [info] [Task Finished] Resolve in 4.317603s
[2021-03-25 11:09:31.697] [driver] [info] [Task Finished] Resolve in 4.249519s
[2021-03-25 11:09:35.941] [driver] [info] [Task Finished] Resolve in 4.244271s
[2021-03-25 11:09:40.213] [driver] [info] [Task Finished] Resolve in 4.271584s
[2021-03-25 11:09:44.458] [driver] [info] [Task Finished] Resolve in 4.245316s
[2021-03-25 11:09:48.685] [driver] [info] [Task Finished] Resolve in 4.226576s
[2021-03-25 11:09:55.826] [driver] [info] [Task Finished] Resolve in 7.140977s
[2021-03-25 11:10:00.042] [driver] [info] [Task Finished] Resolve in 4.216746s
[2021-03-25 11:10:04.362] [driver] [info] [Task Finished] Resolve in 4.319127s
[2021-03-25 11:10:08.616] [driver] [info] [Task Finished] Resolve in 4.254798s
[2021-03-25 11:10:12.862] [driver] [info] [Task Finished] Resolve in 4.245899s
[2021-03-25 11:10:17.135] [driver] [info] [Task Finished] Resolve in 4.273120s
[2021-03-25 11:10:21.379] [driver] [info] [Task Finished] Resolve in 4.243029s
[2021-03-25 11:10:25.613] [driver] [info] [Task Finished] Resolve in 4.234532s
[2021-03-25 11:10:29.883] [driver] [info] [Task Finished] Resolve in 4.269848s
[2021-03-25 11:10:34.100] [driver] [info] [Task Finished] Resolve in 4.217137s
[2021-03-25 11:10:38.417] [driver] [info] [Task Finished] Resolve in 4.316523s
[2021-03-25 11:10:42.668] [driver] [info] [Task Finished] Resolve in 4.251010s
[2021-03-25 11:10:46.911] [driver] [info] [Task Finished] Resolve in 4.242968s
[2021-03-25 11:10:51.180] [driver] [info] [Task Finished] Resolve in 4.269652s
[2021-03-25 11:10:55.418] [driver] [info] [Task Finished] Resolve in 4.237706s
[2021-03-25 11:10:59.647] [driver] [info] [Task Finished] Resolve in 4.229217s
[2021-03-25 11:11:03.911] [driver] [info] [Task Finished] Resolve in 4.263761s
[2021-03-25 11:11:08.127] [driver] [info] [Task Finished] Resolve in 4.216037s
[2021-03-25 11:11:12.442] [driver] [info] [Task Finished] Resolve in 4.314319s
[2021-03-25 11:11:16.698] [driver] [info] [Task Finished] Resolve in 4.256382s
[2021-03-25 11:11:20.944] [driver] [info] [Task Finished] Resolve in 4.246184s
[2021-03-25 11:11:25.213] [driver] [info] [Task Finished] Resolve in 4.268848s
[2021-03-25 11:11:29.460] [driver] [info] [Task Finished] Resolve in 4.246478s
[2021-03-25 11:11:33.691] [driver] [info] [Task Finished] Resolve in 4.231585s
[2021-03-25 11:11:37.960] [driver] [info] [Task Finished] Resolve in 4.269087s
[2021-03-25 11:11:42.177] [driver] [info] [Task Finished] Resolve in 4.216866s
[2021-03-25 11:11:46.481] [driver] [info] [Task Finished] Resolve in 4.303262s
[2021-03-25 11:11:54.299] [driver] [info] [Task Finished] Resolve in 7.818132s
[2021-03-25 11:11:58.542] [driver] [info] [Task Finished] Resolve in 4.243548s
[2021-03-25 11:12:02.804] [driver] [info] [Task Finished] Resolve in 4.261991s
[2021-03-25 11:12:07.049] [driver] [info] [Task Finished] Resolve in 4.244945s
[2021-03-25 11:12:11.277] [driver] [info] [Task Finished] Resolve in 4.227567s
[2021-03-25 11:12:15.542] [driver] [info] [Task Finished] Resolve in 4.264905s
[2021-03-25 11:12:19.759] [driver] [info] [Task Finished] Resolve in 4.217395s
[2021-03-25 11:12:24.048] [driver] [info] [Task Finished] Resolve in 4.288497s
[2021-03-25 11:12:28.317] [driver] [info] [Task Finished] Resolve in 4.269369s
[2021-03-25 11:12:32.565] [driver] [info] [Task Finished] Resolve in 4.247488s
[2021-03-25 11:12:36.828] [driver] [info] [Task Finished] Resolve in 4.262765s
[2021-03-25 11:12:41.076] [driver] [info] [Task Finished] Resolve in 4.248215s
[2021-03-25 11:12:45.309] [driver] [info] [Task Finished] Resolve in 4.232684s
[2021-03-25 11:12:49.578] [driver] [info] [Task Finished] Resolve in 4.269398s
[2021-03-25 11:12:53.796] [driver] [info] [Task Finished] Resolve in 4.217587s
[2021-03-25 11:12:58.081] [driver] [info] [Task Finished] Resolve in 4.285141s
[2021-03-25 11:13:02.354] [driver] [info] [Task Finished] Resolve in 4.273623s
[2021-03-25 11:13:06.608] [driver] [info] [Task Finished] Resolve in 4.253239s
[2021-03-25 11:13:10.869] [driver] [info] [Task Finished] Resolve in 4.261206s
[2021-03-25 11:13:15.112] [driver] [info] [Task Finished] Resolve in 4.243209s
[2021-03-25 11:13:19.352] [driver] [info] [Task Finished] Resolve in 4.239906s
[2021-03-25 11:13:24.104] [driver] [info] [Task Finished] Resolve in 4.751619s
[2021-03-25 11:13:24.104] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 699.371s
[2021-03-25 11:13:24.104] [local ee] [info] slow path for Stage 0: total wall clock time: 699.36s, time to process 1 row via slow path: 0.101416ms
[2021-03-25 11:13:24.104] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 699.371s

[2021-03-25 11:13:24.137] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-25 11:13:24.448] [driver] [info] [Task Finished] write to file in 0.310505s (1798491 rows, 273.61 MB)
[2021-03-25 11:13:24.448] [global] [info] writing output took 0.343649s
[2021-03-25 11:13:24.448] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.343738s
[2021-03-25 11:13:24.448] [global] [info] [Transform Stage] Stage 0 took 745.105s
[2021-03-25 11:13:24.448] [global] [info] Query Execution took 745.183s. (planning: 0.078433s, execution: 745.105s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.0049190521240234375
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 745.465772151947 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0219239,"llvm_optimization_time_s":0.3313,"llvm_compilation_time_s":0.151566,"total_compilation_time_s":0.500281,"sampling_time_s":0.116085,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.8864,"fast_path_time_s":44.8896,"fast_path_per_row_time_ns":796.553,"slow_path_wall_time_s":699.36,"slow_path_time_s":699.371,"slow_path_per_row_time_ns":101416}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.0049190521240234375, "jobTime": 745.465772151947, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
