[2021-03-25 10:45:12.433] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:45:12.433] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:45:12.433] [local ee] [info] initializing LLVM backend
[2021-03-25 10:45:12.433] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:45:12.433] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:45:12.434] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 10:45:12.434] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:45:12.434] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:45:12.434] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:45:12.568] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:45:12.574] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:45:12.589] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:45:12.597] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:45:12.623] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:45:12.643] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:45:12.656] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:45:12.687] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:45:12.693] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:45:12.709] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:45:12.711] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:45:12.712] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:45:12.712] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:45:12.714] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:45:12.715] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:45:12.715] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:45:12.717] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:45:12.718] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:45:12.718] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:45:12.734] [logical planner] [info] logical optimization took 0.021910ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:45:12.735] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:45:12.735] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:45:12.736] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:45:12.736] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:45:12.737] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:45:12.738] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:45:12.738] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:45:12.739] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:45:12.740] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:45:12.741] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:45:12.742] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:45:12.743] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:45:12.744] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:45:12.744] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:45:12.746] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:45:12.747] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:45:12.747] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:45:12.748] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:45:12.748] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:45:12.749] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:45:12.749] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:45:12.750] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:45:12.751] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:45:12.752] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:45:12.753] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:45:12.754] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:45:12.755] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:45:12.755] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:45:12.756] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:45:12.788] [global] [info] Stage0 depends on: 
[2021-03-25 10:45:13.136] [global] [info] Optimization via LLVM passes took 0.330975 ms
[2021-03-25 10:45:13.288] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:45:13.288] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.49996s
[2021-03-25 10:45:13.288] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:45:13.570] [driver] [info] [Task Finished] Transform to mem in 0.281467s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:45:13.849] [driver] [info] [Task Finished] Transform to mem in 0.279058s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:45:14.127] [driver] [info] [Task Finished] Transform to mem in 0.278763s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:45:14.407] [driver] [info] [Task Finished] Transform to mem in 0.279178s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:45:14.686] [driver] [info] [Task Finished] Transform to mem in 0.279179s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:45:14.965] [driver] [info] [Task Finished] Transform to mem in 0.278825s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:45:15.243] [driver] [info] [Task Finished] Transform to mem in 0.278405s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:45:15.522] [driver] [info] [Task Finished] Transform to mem in 0.278813s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:45:15.800] [driver] [info] [Task Finished] Transform to mem in 0.278287s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:45:16.079] [driver] [info] [Task Finished] Transform to mem in 0.278755s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:45:16.357] [driver] [info] [Task Finished] Transform to mem in 0.278534s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:45:16.636] [driver] [info] [Task Finished] Transform to mem in 0.278638s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:45:16.914] [driver] [info] [Task Finished] Transform to mem in 0.278264s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:45:17.193] [driver] [info] [Task Finished] Transform to mem in 0.278469s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:45:17.471] [driver] [info] [Task Finished] Transform to mem in 0.278322s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:45:17.750] [driver] [info] [Task Finished] Transform to mem in 0.278232s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:45:18.028] [driver] [info] [Task Finished] Transform to mem in 0.278593s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:45:18.307] [driver] [info] [Task Finished] Transform to mem in 0.278656s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:45:18.585] [driver] [info] [Task Finished] Transform to mem in 0.278664s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:45:18.863] [driver] [info] [Task Finished] Transform to mem in 0.277933s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:45:19.142] [driver] [info] [Task Finished] Transform to mem in 0.278230s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:45:19.420] [driver] [info] [Task Finished] Transform to mem in 0.278614s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:45:19.698] [driver] [info] [Task Finished] Transform to mem in 0.278164s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:45:19.976] [driver] [info] [Task Finished] Transform to mem in 0.277909s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:45:20.255] [driver] [info] [Task Finished] Transform to mem in 0.278589s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:45:20.534] [driver] [info] [Task Finished] Transform to mem in 0.278803s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:45:20.812] [driver] [info] [Task Finished] Transform to mem in 0.278328s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:45:21.090] [driver] [info] [Task Finished] Transform to mem in 0.278058s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:45:21.369] [driver] [info] [Task Finished] Transform to mem in 0.278447s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:45:21.647] [driver] [info] [Task Finished] Transform to mem in 0.278359s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:45:21.926] [driver] [info] [Task Finished] Transform to mem in 0.278578s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:45:22.205] [driver] [info] [Task Finished] Transform to mem in 0.279262s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:45:22.483] [driver] [info] [Task Finished] Transform to mem in 0.278314s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:45:22.762] [driver] [info] [Task Finished] Transform to mem in 0.279044s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:45:23.041] [driver] [info] [Task Finished] Transform to mem in 0.278963s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:45:23.320] [driver] [info] [Task Finished] Transform to mem in 0.278659s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:45:23.599] [driver] [info] [Task Finished] Transform to mem in 0.278848s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:45:23.877] [driver] [info] [Task Finished] Transform to mem in 0.277717s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:45:24.155] [driver] [info] [Task Finished] Transform to mem in 0.278248s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:45:24.433] [driver] [info] [Task Finished] Transform to mem in 0.278293s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:45:24.711] [driver] [info] [Task Finished] Transform to mem in 0.278182s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:45:24.990] [driver] [info] [Task Finished] Transform to mem in 0.278300s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:45:25.268] [driver] [info] [Task Finished] Transform to mem in 0.277990s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:45:25.546] [driver] [info] [Task Finished] Transform to mem in 0.278161s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:45:25.825] [driver] [info] [Task Finished] Transform to mem in 0.278678s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:45:26.104] [driver] [info] [Task Finished] Transform to mem in 0.279730s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:45:26.383] [driver] [info] [Task Finished] Transform to mem in 0.278478s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:45:26.661] [driver] [info] [Task Finished] Transform to mem in 0.278447s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:45:26.940] [driver] [info] [Task Finished] Transform to mem in 0.278297s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:45:27.218] [driver] [info] [Task Finished] Transform to mem in 0.278631s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:45:27.497] [driver] [info] [Task Finished] Transform to mem in 0.278368s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:45:27.775] [driver] [info] [Task Finished] Transform to mem in 0.278295s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:45:28.054] [driver] [info] [Task Finished] Transform to mem in 0.278539s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:45:28.332] [driver] [info] [Task Finished] Transform to mem in 0.278326s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:45:28.610] [driver] [info] [Task Finished] Transform to mem in 0.278533s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:45:28.889] [driver] [info] [Task Finished] Transform to mem in 0.278344s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:45:29.166] [driver] [info] [Task Finished] Transform to mem in 0.277608s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:45:29.445] [driver] [info] [Task Finished] Transform to mem in 0.278543s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:45:29.724] [driver] [info] [Task Finished] Transform to mem in 0.278536s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:45:30.002] [driver] [info] [Task Finished] Transform to mem in 0.278028s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:45:30.281] [driver] [info] [Task Finished] Transform to mem in 0.279220s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:45:30.563] [driver] [info] [Task Finished] Transform to mem in 0.281692s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:45:30.841] [driver] [info] [Task Finished] Transform to mem in 0.278192s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:45:31.119] [driver] [info] [Task Finished] Transform to mem in 0.278326s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:45:31.397] [driver] [info] [Task Finished] Transform to mem in 0.278011s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:45:31.676] [driver] [info] [Task Finished] Transform to mem in 0.278863s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:45:31.955] [driver] [info] [Task Finished] Transform to mem in 0.278625s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:45:32.233] [driver] [info] [Task Finished] Transform to mem in 0.278203s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:45:32.513] [driver] [info] [Task Finished] Transform to mem in 0.280020s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:45:32.791] [driver] [info] [Task Finished] Transform to mem in 0.278317s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:45:33.069] [driver] [info] [Task Finished] Transform to mem in 0.278075s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:45:33.347] [driver] [info] [Task Finished] Transform to mem in 0.278152s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:45:33.625] [driver] [info] [Task Finished] Transform to mem in 0.277855s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:45:33.904] [driver] [info] [Task Finished] Transform to mem in 0.278645s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:45:34.183] [driver] [info] [Task Finished] Transform to mem in 0.278905s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:45:34.461] [driver] [info] [Task Finished] Transform to mem in 0.278334s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:45:34.740] [driver] [info] [Task Finished] Transform to mem in 0.278414s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:45:35.020] [driver] [info] [Task Finished] Transform to mem in 0.280224s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:45:35.298] [driver] [info] [Task Finished] Transform to mem in 0.277917s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:45:35.576] [driver] [info] [Task Finished] Transform to mem in 0.278103s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:45:35.854] [driver] [info] [Task Finished] Transform to mem in 0.278236s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:45:36.133] [driver] [info] [Task Finished] Transform to mem in 0.278710s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:45:36.412] [driver] [info] [Task Finished] Transform to mem in 0.278858s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:45:36.690] [driver] [info] [Task Finished] Transform to mem in 0.278276s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:45:36.969] [driver] [info] [Task Finished] Transform to mem in 0.278399s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:45:37.247] [driver] [info] [Task Finished] Transform to mem in 0.278462s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:45:37.525] [driver] [info] [Task Finished] Transform to mem in 0.278087s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:45:37.804] [driver] [info] [Task Finished] Transform to mem in 0.279116s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:45:38.085] [driver] [info] [Task Finished] Transform to mem in 0.281150s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:45:38.364] [driver] [info] [Task Finished] Transform to mem in 0.278652s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:45:38.643] [driver] [info] [Task Finished] Transform to mem in 0.278801s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:45:38.921] [driver] [info] [Task Finished] Transform to mem in 0.278012s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:45:39.199] [driver] [info] [Task Finished] Transform to mem in 0.278378s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:45:39.477] [driver] [info] [Task Finished] Transform to mem in 0.277787s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:45:39.755] [driver] [info] [Task Finished] Transform to mem in 0.278060s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:45:40.034] [driver] [info] [Task Finished] Transform to mem in 0.278779s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:45:40.312] [driver] [info] [Task Finished] Transform to mem in 0.278117s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:45:40.591] [driver] [info] [Task Finished] Transform to mem in 0.278825s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:45:40.870] [driver] [info] [Task Finished] Transform to mem in 0.278458s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:45:41.150] [driver] [info] [Task Finished] Transform to mem in 0.280616s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:45:41.429] [driver] [info] [Task Finished] Transform to mem in 0.278974s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:45:41.708] [driver] [info] [Task Finished] Transform to mem in 0.278846s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:45:41.986] [driver] [info] [Task Finished] Transform to mem in 0.277566s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:45:42.264] [driver] [info] [Task Finished] Transform to mem in 0.278553s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:45:42.542] [driver] [info] [Task Finished] Transform to mem in 0.277673s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:45:42.820] [driver] [info] [Task Finished] Transform to mem in 0.278399s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:45:43.098] [driver] [info] [Task Finished] Transform to mem in 0.277916s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:45:43.376] [driver] [info] [Task Finished] Transform to mem in 0.278093s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:45:43.655] [driver] [info] [Task Finished] Transform to mem in 0.278246s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:45:43.933] [driver] [info] [Task Finished] Transform to mem in 0.278776s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:45:44.212] [driver] [info] [Task Finished] Transform to mem in 0.278705s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:45:44.491] [driver] [info] [Task Finished] Transform to mem in 0.279209s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:45:44.770] [driver] [info] [Task Finished] Transform to mem in 0.278648s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:45:45.050] [driver] [info] [Task Finished] Transform to mem in 0.279835s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:45:45.330] [driver] [info] [Task Finished] Transform to mem in 0.280117s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:45:45.609] [driver] [info] [Task Finished] Transform to mem in 0.279359s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:45:45.888] [driver] [info] [Task Finished] Transform to mem in 0.278759s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:45:46.167] [driver] [info] [Task Finished] Transform to mem in 0.279149s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:45:46.447] [driver] [info] [Task Finished] Transform to mem in 0.279371s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:45:46.726] [driver] [info] [Task Finished] Transform to mem in 0.279292s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:45:47.005] [driver] [info] [Task Finished] Transform to mem in 0.278752s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:45:47.285] [driver] [info] [Task Finished] Transform to mem in 0.279802s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:45:47.564] [driver] [info] [Task Finished] Transform to mem in 0.279735s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:45:47.844] [driver] [info] [Task Finished] Transform to mem in 0.279302s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:45:48.123] [driver] [info] [Task Finished] Transform to mem in 0.278874s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:45:48.402] [driver] [info] [Task Finished] Transform to mem in 0.279066s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:45:48.681] [driver] [info] [Task Finished] Transform to mem in 0.279159s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:45:48.960] [driver] [info] [Task Finished] Transform to mem in 0.278901s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:45:49.238] [driver] [info] [Task Finished] Transform to mem in 0.278725s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:45:49.518] [driver] [info] [Task Finished] Transform to mem in 0.279432s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:45:49.797] [driver] [info] [Task Finished] Transform to mem in 0.278930s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:45:50.081] [driver] [info] [Task Finished] Transform to mem in 0.284291s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:45:50.361] [driver] [info] [Task Finished] Transform to mem in 0.279908s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:45:50.640] [driver] [info] [Task Finished] Transform to mem in 0.279160s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:45:50.919] [driver] [info] [Task Finished] Transform to mem in 0.279001s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:45:51.198] [driver] [info] [Task Finished] Transform to mem in 0.278693s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:45:51.477] [driver] [info] [Task Finished] Transform to mem in 0.278497s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:45:51.756] [driver] [info] [Task Finished] Transform to mem in 0.279114s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:45:52.035] [driver] [info] [Task Finished] Transform to mem in 0.278854s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:45:52.313] [driver] [info] [Task Finished] Transform to mem in 0.278854s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:45:52.592] [driver] [info] [Task Finished] Transform to mem in 0.278916s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:45:52.872] [driver] [info] [Task Finished] Transform to mem in 0.279343s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:45:53.150] [driver] [info] [Task Finished] Transform to mem in 0.278567s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:45:53.430] [driver] [info] [Task Finished] Transform to mem in 0.279543s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:45:53.709] [driver] [info] [Task Finished] Transform to mem in 0.279549s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:45:53.989] [driver] [info] [Task Finished] Transform to mem in 0.279037s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:45:54.268] [driver] [info] [Task Finished] Transform to mem in 0.279425s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:45:54.547] [driver] [info] [Task Finished] Transform to mem in 0.278789s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:45:54.826] [driver] [info] [Task Finished] Transform to mem in 0.279014s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:45:55.106] [driver] [info] [Task Finished] Transform to mem in 0.279945s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:45:55.385] [driver] [info] [Task Finished] Transform to mem in 0.279095s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:45:55.664] [driver] [info] [Task Finished] Transform to mem in 0.279165s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:45:55.943] [driver] [info] [Task Finished] Transform to mem in 0.278868s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:45:56.222] [driver] [info] [Task Finished] Transform to mem in 0.279074s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:45:56.502] [driver] [info] [Task Finished] Transform to mem in 0.279483s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:45:56.781] [driver] [info] [Task Finished] Transform to mem in 0.279336s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:45:57.060] [driver] [info] [Task Finished] Transform to mem in 0.279457s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:45:57.340] [driver] [info] [Task Finished] Transform to mem in 0.279736s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:45:57.620] [driver] [info] [Task Finished] Transform to mem in 0.279617s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:45:57.932] [driver] [info] [Task Finished] Transform to mem in 0.312550s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:45:57.932] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.6447s
[2021-03-25 10:45:57.932] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.6414s, 56350770 input rows, time to process 1 row via fast path: 0.000792206ms
[2021-03-25 10:45:57.933] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:45:57.937] [local ee] [info] compiled pure python pipeline in 0.004193s
[2021-03-25 10:45:57.937] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:45:57.938] [local ee] [info] Created 160 resolve tasks in 0.001236s
[2021-03-25 10:45:57.938] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:45:57.950] [driver] [info] [Task Finished] Resolve in 0.012238s
[2021-03-25 10:45:57.962] [driver] [info] [Task Finished] Resolve in 0.011999s
[2021-03-25 10:45:57.974] [driver] [info] [Task Finished] Resolve in 0.011858s
[2021-03-25 10:45:57.986] [driver] [info] [Task Finished] Resolve in 0.011876s
[2021-03-25 10:45:57.998] [driver] [info] [Task Finished] Resolve in 0.012047s
[2021-03-25 10:45:58.010] [driver] [info] [Task Finished] Resolve in 0.011863s
[2021-03-25 10:45:58.022] [driver] [info] [Task Finished] Resolve in 0.012140s
[2021-03-25 10:45:58.034] [driver] [info] [Task Finished] Resolve in 0.011747s
[2021-03-25 10:45:58.046] [driver] [info] [Task Finished] Resolve in 0.011978s
[2021-03-25 10:45:58.058] [driver] [info] [Task Finished] Resolve in 0.012114s
[2021-03-25 10:45:58.070] [driver] [info] [Task Finished] Resolve in 0.011927s
[2021-03-25 10:45:58.082] [driver] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:45:58.094] [driver] [info] [Task Finished] Resolve in 0.011894s
[2021-03-25 10:45:58.106] [driver] [info] [Task Finished] Resolve in 0.011812s
[2021-03-25 10:45:58.118] [driver] [info] [Task Finished] Resolve in 0.011964s
[2021-03-25 10:45:58.129] [driver] [info] [Task Finished] Resolve in 0.011896s
[2021-03-25 10:45:58.141] [driver] [info] [Task Finished] Resolve in 0.011887s
[2021-03-25 10:45:58.153] [driver] [info] [Task Finished] Resolve in 0.012015s
[2021-03-25 10:45:58.165] [driver] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:45:58.177] [driver] [info] [Task Finished] Resolve in 0.011857s
[2021-03-25 10:45:58.189] [driver] [info] [Task Finished] Resolve in 0.012067s
[2021-03-25 10:45:58.201] [driver] [info] [Task Finished] Resolve in 0.011809s
[2021-03-25 10:45:58.213] [driver] [info] [Task Finished] Resolve in 0.011885s
[2021-03-25 10:45:58.225] [driver] [info] [Task Finished] Resolve in 0.011765s
[2021-03-25 10:45:58.237] [driver] [info] [Task Finished] Resolve in 0.011851s
[2021-03-25 10:45:58.249] [driver] [info] [Task Finished] Resolve in 0.012267s
[2021-03-25 10:45:58.261] [driver] [info] [Task Finished] Resolve in 0.011779s
[2021-03-25 10:45:58.272] [driver] [info] [Task Finished] Resolve in 0.011861s
[2021-03-25 10:45:58.284] [driver] [info] [Task Finished] Resolve in 0.011843s
[2021-03-25 10:45:58.296] [driver] [info] [Task Finished] Resolve in 0.011804s
[2021-03-25 10:45:58.308] [driver] [info] [Task Finished] Resolve in 0.011988s
[2021-03-25 10:45:58.320] [driver] [info] [Task Finished] Resolve in 0.011857s
[2021-03-25 10:45:58.332] [driver] [info] [Task Finished] Resolve in 0.011839s
[2021-03-25 10:45:58.344] [driver] [info] [Task Finished] Resolve in 0.012041s
[2021-03-25 10:45:58.356] [driver] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:45:58.368] [driver] [info] [Task Finished] Resolve in 0.011987s
[2021-03-25 10:45:58.380] [driver] [info] [Task Finished] Resolve in 0.012003s
[2021-03-25 10:45:58.392] [driver] [info] [Task Finished] Resolve in 0.011868s
[2021-03-25 10:45:58.404] [driver] [info] [Task Finished] Resolve in 0.011887s
[2021-03-25 10:45:58.415] [driver] [info] [Task Finished] Resolve in 0.011809s
[2021-03-25 10:45:58.427] [driver] [info] [Task Finished] Resolve in 0.011833s
[2021-03-25 10:45:58.440] [driver] [info] [Task Finished] Resolve in 0.012259s
[2021-03-25 10:45:58.451] [driver] [info] [Task Finished] Resolve in 0.011831s
[2021-03-25 10:45:58.463] [driver] [info] [Task Finished] Resolve in 0.011857s
[2021-03-25 10:45:58.475] [driver] [info] [Task Finished] Resolve in 0.011877s
[2021-03-25 10:45:58.487] [driver] [info] [Task Finished] Resolve in 0.011824s
[2021-03-25 10:45:58.499] [driver] [info] [Task Finished] Resolve in 0.012066s
[2021-03-25 10:45:58.511] [driver] [info] [Task Finished] Resolve in 0.011791s
[2021-03-25 10:45:58.523] [driver] [info] [Task Finished] Resolve in 0.011822s
[2021-03-25 10:45:58.535] [driver] [info] [Task Finished] Resolve in 0.012062s
[2021-03-25 10:45:58.547] [driver] [info] [Task Finished] Resolve in 0.011828s
[2021-03-25 10:45:58.559] [driver] [info] [Task Finished] Resolve in 0.012067s
[2021-03-25 10:45:58.571] [driver] [info] [Task Finished] Resolve in 0.011914s
[2021-03-25 10:45:58.582] [driver] [info] [Task Finished] Resolve in 0.011849s
[2021-03-25 10:45:58.594] [driver] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:45:58.606] [driver] [info] [Task Finished] Resolve in 0.011788s
[2021-03-25 10:45:58.618] [driver] [info] [Task Finished] Resolve in 0.011938s
[2021-03-25 10:45:58.630] [driver] [info] [Task Finished] Resolve in 0.012142s
[2021-03-25 10:45:58.642] [driver] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:45:58.654] [driver] [info] [Task Finished] Resolve in 0.011829s
[2021-03-25 10:45:58.666] [driver] [info] [Task Finished] Resolve in 0.011899s
[2021-03-25 10:45:58.678] [driver] [info] [Task Finished] Resolve in 0.011964s
[2021-03-25 10:45:58.690] [driver] [info] [Task Finished] Resolve in 0.011959s
[2021-03-25 10:45:58.702] [driver] [info] [Task Finished] Resolve in 0.011823s
[2021-03-25 10:45:58.713] [driver] [info] [Task Finished] Resolve in 0.011790s
[2021-03-25 10:45:58.726] [driver] [info] [Task Finished] Resolve in 0.012088s
[2021-03-25 10:45:58.737] [driver] [info] [Task Finished] Resolve in 0.011913s
[2021-03-25 10:45:58.750] [driver] [info] [Task Finished] Resolve in 0.012035s
[2021-03-25 10:45:58.761] [driver] [info] [Task Finished] Resolve in 0.011915s
[2021-03-25 10:45:58.773] [driver] [info] [Task Finished] Resolve in 0.011866s
[2021-03-25 10:45:58.785] [driver] [info] [Task Finished] Resolve in 0.011880s
[2021-03-25 10:45:58.797] [driver] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:45:58.809] [driver] [info] [Task Finished] Resolve in 0.011994s
[2021-03-25 10:45:58.821] [driver] [info] [Task Finished] Resolve in 0.012077s
[2021-03-25 10:45:58.833] [driver] [info] [Task Finished] Resolve in 0.011862s
[2021-03-25 10:45:58.845] [driver] [info] [Task Finished] Resolve in 0.011819s
[2021-03-25 10:45:58.857] [driver] [info] [Task Finished] Resolve in 0.011893s
[2021-03-25 10:45:58.869] [driver] [info] [Task Finished] Resolve in 0.012062s
[2021-03-25 10:45:58.881] [driver] [info] [Task Finished] Resolve in 0.011878s
[2021-03-25 10:45:58.893] [driver] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:45:58.904] [driver] [info] [Task Finished] Resolve in 0.011782s
[2021-03-25 10:45:58.916] [driver] [info] [Task Finished] Resolve in 0.012043s
[2021-03-25 10:45:58.928] [driver] [info] [Task Finished] Resolve in 0.011994s
[2021-03-25 10:45:58.940] [driver] [info] [Task Finished] Resolve in 0.011807s
[2021-03-25 10:45:58.952] [driver] [info] [Task Finished] Resolve in 0.011912s
[2021-03-25 10:45:58.964] [driver] [info] [Task Finished] Resolve in 0.011826s
[2021-03-25 10:45:58.976] [driver] [info] [Task Finished] Resolve in 0.011826s
[2021-03-25 10:45:58.988] [driver] [info] [Task Finished] Resolve in 0.011939s
[2021-03-25 10:45:59.000] [driver] [info] [Task Finished] Resolve in 0.011873s
[2021-03-25 10:45:59.012] [driver] [info] [Task Finished] Resolve in 0.012098s
[2021-03-25 10:45:59.024] [driver] [info] [Task Finished] Resolve in 0.011828s
[2021-03-25 10:45:59.035] [driver] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:45:59.047] [driver] [info] [Task Finished] Resolve in 0.011957s
[2021-03-25 10:45:59.059] [driver] [info] [Task Finished] Resolve in 0.012020s
[2021-03-25 10:45:59.071] [driver] [info] [Task Finished] Resolve in 0.011758s
[2021-03-25 10:45:59.083] [driver] [info] [Task Finished] Resolve in 0.011863s
[2021-03-25 10:45:59.095] [driver] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:45:59.107] [driver] [info] [Task Finished] Resolve in 0.012072s
[2021-03-25 10:45:59.119] [driver] [info] [Task Finished] Resolve in 0.012068s
[2021-03-25 10:45:59.131] [driver] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:45:59.143] [driver] [info] [Task Finished] Resolve in 0.011916s
[2021-03-25 10:45:59.155] [driver] [info] [Task Finished] Resolve in 0.011868s
[2021-03-25 10:45:59.166] [driver] [info] [Task Finished] Resolve in 0.011752s
[2021-03-25 10:45:59.179] [driver] [info] [Task Finished] Resolve in 0.012080s
[2021-03-25 10:45:59.190] [driver] [info] [Task Finished] Resolve in 0.011769s
[2021-03-25 10:45:59.202] [driver] [info] [Task Finished] Resolve in 0.012050s
[2021-03-25 10:45:59.214] [driver] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:45:59.226] [driver] [info] [Task Finished] Resolve in 0.011799s
[2021-03-25 10:45:59.238] [driver] [info] [Task Finished] Resolve in 0.012011s
[2021-03-25 10:45:59.250] [driver] [info] [Task Finished] Resolve in 0.011884s
[2021-03-25 10:45:59.262] [driver] [info] [Task Finished] Resolve in 0.011748s
[2021-03-25 10:45:59.274] [driver] [info] [Task Finished] Resolve in 0.011915s
[2021-03-25 10:45:59.285] [driver] [info] [Task Finished] Resolve in 0.011748s
[2021-03-25 10:45:59.298] [driver] [info] [Task Finished] Resolve in 0.012120s
[2021-03-25 10:45:59.310] [driver] [info] [Task Finished] Resolve in 0.011937s
[2021-03-25 10:45:59.321] [driver] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:45:59.333] [driver] [info] [Task Finished] Resolve in 0.011901s
[2021-03-25 10:45:59.345] [driver] [info] [Task Finished] Resolve in 0.011840s
[2021-03-25 10:45:59.357] [driver] [info] [Task Finished] Resolve in 0.011822s
[2021-03-25 10:45:59.369] [driver] [info] [Task Finished] Resolve in 0.012097s
[2021-03-25 10:45:59.381] [driver] [info] [Task Finished] Resolve in 0.011729s
[2021-03-25 10:45:59.393] [driver] [info] [Task Finished] Resolve in 0.012068s
[2021-03-25 10:45:59.405] [driver] [info] [Task Finished] Resolve in 0.011850s
[2021-03-25 10:45:59.417] [driver] [info] [Task Finished] Resolve in 0.011823s
[2021-03-25 10:45:59.429] [driver] [info] [Task Finished] Resolve in 0.012074s
[2021-03-25 10:45:59.440] [driver] [info] [Task Finished] Resolve in 0.011825s
[2021-03-25 10:45:59.452] [driver] [info] [Task Finished] Resolve in 0.011805s
[2021-03-25 10:45:59.464] [driver] [info] [Task Finished] Resolve in 0.011892s
[2021-03-25 10:45:59.476] [driver] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:45:59.488] [driver] [info] [Task Finished] Resolve in 0.012188s
[2021-03-25 10:45:59.500] [driver] [info] [Task Finished] Resolve in 0.011908s
[2021-03-25 10:45:59.512] [driver] [info] [Task Finished] Resolve in 0.011848s
[2021-03-25 10:45:59.524] [driver] [info] [Task Finished] Resolve in 0.011889s
[2021-03-25 10:45:59.536] [driver] [info] [Task Finished] Resolve in 0.011849s
[2021-03-25 10:45:59.548] [driver] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:45:59.560] [driver] [info] [Task Finished] Resolve in 0.012033s
[2021-03-25 10:45:59.571] [driver] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:45:59.584] [driver] [info] [Task Finished] Resolve in 0.012029s
[2021-03-25 10:45:59.595] [driver] [info] [Task Finished] Resolve in 0.011888s
[2021-03-25 10:45:59.607] [driver] [info] [Task Finished] Resolve in 0.011870s
[2021-03-25 10:45:59.619] [driver] [info] [Task Finished] Resolve in 0.012031s
[2021-03-25 10:45:59.631] [driver] [info] [Task Finished] Resolve in 0.011872s
[2021-03-25 10:45:59.643] [driver] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:45:59.655] [driver] [info] [Task Finished] Resolve in 0.011890s
[2021-03-25 10:45:59.667] [driver] [info] [Task Finished] Resolve in 0.011744s
[2021-03-25 10:45:59.679] [driver] [info] [Task Finished] Resolve in 0.012173s
[2021-03-25 10:45:59.691] [driver] [info] [Task Finished] Resolve in 0.011863s
[2021-03-25 10:45:59.703] [driver] [info] [Task Finished] Resolve in 0.011837s
[2021-03-25 10:45:59.715] [driver] [info] [Task Finished] Resolve in 0.011875s
[2021-03-25 10:45:59.726] [driver] [info] [Task Finished] Resolve in 0.011865s
[2021-03-25 10:45:59.738] [driver] [info] [Task Finished] Resolve in 0.011998s
[2021-03-25 10:45:59.750] [driver] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:45:59.762] [driver] [info] [Task Finished] Resolve in 0.011765s
[2021-03-25 10:45:59.774] [driver] [info] [Task Finished] Resolve in 0.011983s
[2021-03-25 10:45:59.786] [driver] [info] [Task Finished] Resolve in 0.011914s
[2021-03-25 10:45:59.798] [driver] [info] [Task Finished] Resolve in 0.011958s
[2021-03-25 10:45:59.810] [driver] [info] [Task Finished] Resolve in 0.011956s
[2021-03-25 10:45:59.822] [driver] [info] [Task Finished] Resolve in 0.011823s
[2021-03-25 10:45:59.834] [driver] [info] [Task Finished] Resolve in 0.011821s
[2021-03-25 10:45:59.847] [driver] [info] [Task Finished] Resolve in 0.013223s
[2021-03-25 10:45:59.847] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 1.91458s
[2021-03-25 10:45:59.847] [local ee] [info] slow path for Stage 0: total wall clock time: 1.90675s, time to process 1 row via slow path: 0.000276505ms
[2021-03-25 10:45:59.847] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.9146s

[2021-03-25 10:45:59.880] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:46:00.192] [driver] [info] [Task Finished] write to file in 0.312367s (1798491 rows, 273.80 MB)
[2021-03-25 10:46:00.192] [global] [info] writing output took 0.345443s
[2021-03-25 10:46:00.192] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.34553s
[2021-03-25 10:46:00.193] [global] [info] [Transform Stage] Stage 0 took 47.4048s
[2021-03-25 10:46:00.193] [global] [info] Query Execution took 47.4834s. (planning: 0.0783867s, execution: 47.405s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.004957437515258789
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 47.7596755027771 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0219097,"llvm_optimization_time_s":0.330975,"llvm_compilation_time_s":0.151562,"total_compilation_time_s":0.499958,"sampling_time_s":0.109689,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.6414,"fast_path_time_s":44.6447,"fast_path_per_row_time_ns":792.206,"slow_path_wall_time_s":1.90675,"slow_path_time_s":1.91458,"slow_path_per_row_time_ns":276.505}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.004957437515258789, "jobTime": 47.7596755027771, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
