[2021-03-25 11:52:13.577] [global] [error] could not find backend, defaulting to local
[2021-03-25 11:52:13.577] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 11:52:13.577] [local ee] [info] initializing LLVM backend
[2021-03-25 11:52:13.577] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 11:52:13.577] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 11:52:13.578] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 11:52:13.578] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 11:52:13.578] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 11:52:13.578] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 11:52:13.719] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:52:13.725] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:52:13.740] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:52:13.748] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:52:13.774] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:52:13.794] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:52:13.807] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:52:13.839] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:52:13.845] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:52:13.860] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:52:13.862] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:52:13.863] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:52:13.863] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:52:13.865] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:52:13.866] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:52:13.867] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:52:13.868] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:52:13.869] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:52:13.870] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:52:13.886] [logical planner] [info] logical optimization took 0.021895ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 11:52:13.886] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:52:13.886] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:52:13.887] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 11:52:13.888] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 11:52:13.888] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 11:52:13.889] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 11:52:13.890] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 11:52:13.891] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 11:52:13.891] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 11:52:13.892] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 11:52:13.893] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:52:13.894] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:52:13.895] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:52:13.895] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:52:13.897] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:52:13.898] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:52:13.898] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 11:52:13.899] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 11:52:13.900] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 11:52:13.900] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 11:52:13.901] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 11:52:13.902] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 11:52:13.902] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 11:52:13.903] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 11:52:13.904] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:52:13.905] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:52:13.906] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:52:13.906] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:52:13.907] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:52:13.939] [global] [info] Stage0 depends on: 
[2021-03-25 11:52:14.286] [global] [info] Optimization via LLVM passes took 0.329400 ms
[2021-03-25 11:52:14.437] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 11:52:14.437] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.497901s
[2021-03-25 11:52:14.437] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 11:52:14.719] [driver] [info] [Task Finished] Transform to mem in 0.282046s (11105 normal rows, 43095 exceptions)
[2021-03-25 11:52:14.999] [driver] [info] [Task Finished] Transform to mem in 0.279711s (11073 normal rows, 43414 exceptions)
[2021-03-25 11:52:15.280] [driver] [info] [Task Finished] Transform to mem in 0.280505s (11153 normal rows, 42970 exceptions)
[2021-03-25 11:52:15.560] [driver] [info] [Task Finished] Transform to mem in 0.280339s (11047 normal rows, 43210 exceptions)
[2021-03-25 11:52:15.839] [driver] [info] [Task Finished] Transform to mem in 0.279489s (10987 normal rows, 43113 exceptions)
[2021-03-25 11:52:16.118] [driver] [info] [Task Finished] Transform to mem in 0.278812s (10997 normal rows, 42873 exceptions)
[2021-03-25 11:52:16.399] [driver] [info] [Task Finished] Transform to mem in 0.280206s (11036 normal rows, 43142 exceptions)
[2021-03-25 11:52:16.677] [driver] [info] [Task Finished] Transform to mem in 0.278546s (11005 normal rows, 42741 exceptions)
[2021-03-25 11:52:16.956] [driver] [info] [Task Finished] Transform to mem in 0.278558s (11086 normal rows, 43015 exceptions)
[2021-03-25 11:52:17.236] [driver] [info] [Task Finished] Transform to mem in 0.279983s (11092 normal rows, 43495 exceptions)
[2021-03-25 11:52:17.515] [driver] [info] [Task Finished] Transform to mem in 0.279595s (11153 normal rows, 42968 exceptions)
[2021-03-25 11:52:17.795] [driver] [info] [Task Finished] Transform to mem in 0.279394s (11026 normal rows, 43206 exceptions)
[2021-03-25 11:52:18.074] [driver] [info] [Task Finished] Transform to mem in 0.279172s (11008 normal rows, 43077 exceptions)
[2021-03-25 11:52:18.353] [driver] [info] [Task Finished] Transform to mem in 0.279118s (10997 normal rows, 42910 exceptions)
[2021-03-25 11:52:18.632] [driver] [info] [Task Finished] Transform to mem in 0.279298s (11036 normal rows, 43139 exceptions)
[2021-03-25 11:52:18.911] [driver] [info] [Task Finished] Transform to mem in 0.279106s (11005 normal rows, 42744 exceptions)
[2021-03-25 11:52:19.191] [driver] [info] [Task Finished] Transform to mem in 0.279059s (11086 normal rows, 42996 exceptions)
[2021-03-25 11:52:19.470] [driver] [info] [Task Finished] Transform to mem in 0.278973s (11092 normal rows, 43505 exceptions)
[2021-03-25 11:52:19.748] [driver] [info] [Task Finished] Transform to mem in 0.278567s (11153 normal rows, 42978 exceptions)
[2021-03-25 11:52:20.026] [driver] [info] [Task Finished] Transform to mem in 0.278287s (11026 normal rows, 43205 exceptions)
[2021-03-25 11:52:20.305] [driver] [info] [Task Finished] Transform to mem in 0.278589s (10982 normal rows, 43059 exceptions)
[2021-03-25 11:52:20.583] [driver] [info] [Task Finished] Transform to mem in 0.278429s (11023 normal rows, 42910 exceptions)
[2021-03-25 11:52:20.862] [driver] [info] [Task Finished] Transform to mem in 0.278554s (11036 normal rows, 43115 exceptions)
[2021-03-25 11:52:21.140] [driver] [info] [Task Finished] Transform to mem in 0.278245s (11005 normal rows, 42772 exceptions)
[2021-03-25 11:52:21.419] [driver] [info] [Task Finished] Transform to mem in 0.278585s (11086 normal rows, 42970 exceptions)
[2021-03-25 11:52:21.698] [driver] [info] [Task Finished] Transform to mem in 0.278984s (11079 normal rows, 43539 exceptions)
[2021-03-25 11:52:21.976] [driver] [info] [Task Finished] Transform to mem in 0.278367s (11111 normal rows, 42961 exceptions)
[2021-03-25 11:52:22.255] [driver] [info] [Task Finished] Transform to mem in 0.278626s (11076 normal rows, 43220 exceptions)
[2021-03-25 11:52:22.534] [driver] [info] [Task Finished] Transform to mem in 0.278806s (10987 normal rows, 43068 exceptions)
[2021-03-25 11:52:22.812] [driver] [info] [Task Finished] Transform to mem in 0.278359s (11023 normal rows, 42880 exceptions)
[2021-03-25 11:52:23.091] [driver] [info] [Task Finished] Transform to mem in 0.278494s (11036 normal rows, 43053 exceptions)
[2021-03-25 11:52:23.369] [driver] [info] [Task Finished] Transform to mem in 0.278404s (10992 normal rows, 42864 exceptions)
[2021-03-25 11:52:23.648] [driver] [info] [Task Finished] Transform to mem in 0.278490s (11099 normal rows, 42882 exceptions)
[2021-03-25 11:52:23.927] [driver] [info] [Task Finished] Transform to mem in 0.279216s (11063 normal rows, 43617 exceptions)
[2021-03-25 11:52:24.206] [driver] [info] [Task Finished] Transform to mem in 0.279054s (11127 normal rows, 42969 exceptions)
[2021-03-25 11:52:24.484] [driver] [info] [Task Finished] Transform to mem in 0.278622s (11076 normal rows, 43221 exceptions)
[2021-03-25 11:52:24.763] [driver] [info] [Task Finished] Transform to mem in 0.278824s (10987 normal rows, 43063 exceptions)
[2021-03-25 11:52:25.042] [driver] [info] [Task Finished] Transform to mem in 0.278343s (11004 normal rows, 42876 exceptions)
[2021-03-25 11:52:25.321] [driver] [info] [Task Finished] Transform to mem in 0.279216s (11026 normal rows, 43041 exceptions)
[2021-03-25 11:52:25.600] [driver] [info] [Task Finished] Transform to mem in 0.278640s (11021 normal rows, 42887 exceptions)
[2021-03-25 11:52:25.878] [driver] [info] [Task Finished] Transform to mem in 0.278200s (11064 normal rows, 42832 exceptions)
[2021-03-25 11:52:26.157] [driver] [info] [Task Finished] Transform to mem in 0.278885s (11098 normal rows, 43603 exceptions)
[2021-03-25 11:52:26.436] [driver] [info] [Task Finished] Transform to mem in 0.278906s (11127 normal rows, 43028 exceptions)
[2021-03-25 11:52:26.714] [driver] [info] [Task Finished] Transform to mem in 0.278572s (11076 normal rows, 43212 exceptions)
[2021-03-25 11:52:26.993] [driver] [info] [Task Finished] Transform to mem in 0.279164s (10987 normal rows, 43041 exceptions)
[2021-03-25 11:52:27.272] [driver] [info] [Task Finished] Transform to mem in 0.278934s (11004 normal rows, 42913 exceptions)
[2021-03-25 11:52:27.551] [driver] [info] [Task Finished] Transform to mem in 0.279096s (11026 normal rows, 43037 exceptions)
[2021-03-25 11:52:27.830] [driver] [info] [Task Finished] Transform to mem in 0.278556s (11012 normal rows, 42883 exceptions)
[2021-03-25 11:52:28.109] [driver] [info] [Task Finished] Transform to mem in 0.278635s (11073 normal rows, 42820 exceptions)
[2021-03-25 11:52:28.388] [driver] [info] [Task Finished] Transform to mem in 0.278898s (11095 normal rows, 43503 exceptions)
[2021-03-25 11:52:28.667] [driver] [info] [Task Finished] Transform to mem in 0.279003s (11130 normal rows, 43084 exceptions)
[2021-03-25 11:52:28.945] [driver] [info] [Task Finished] Transform to mem in 0.278498s (11076 normal rows, 43152 exceptions)
[2021-03-25 11:52:29.224] [driver] [info] [Task Finished] Transform to mem in 0.278505s (10976 normal rows, 43110 exceptions)
[2021-03-25 11:52:29.502] [driver] [info] [Task Finished] Transform to mem in 0.278656s (11015 normal rows, 42966 exceptions)
[2021-03-25 11:52:29.781] [driver] [info] [Task Finished] Transform to mem in 0.278449s (11026 normal rows, 43035 exceptions)
[2021-03-25 11:52:30.059] [driver] [info] [Task Finished] Transform to mem in 0.278419s (11012 normal rows, 42888 exceptions)
[2021-03-25 11:52:30.337] [driver] [info] [Task Finished] Transform to mem in 0.277894s (11073 normal rows, 42754 exceptions)
[2021-03-25 11:52:30.616] [driver] [info] [Task Finished] Transform to mem in 0.278983s (11095 normal rows, 43552 exceptions)
[2021-03-25 11:52:30.895] [driver] [info] [Task Finished] Transform to mem in 0.278810s (11130 normal rows, 43033 exceptions)
[2021-03-25 11:52:31.173] [driver] [info] [Task Finished] Transform to mem in 0.278303s (11069 normal rows, 43142 exceptions)
[2021-03-25 11:52:31.452] [driver] [info] [Task Finished] Transform to mem in 0.278880s (10974 normal rows, 43172 exceptions)
[2021-03-25 11:52:31.731] [driver] [info] [Task Finished] Transform to mem in 0.278846s (11008 normal rows, 42964 exceptions)
[2021-03-25 11:52:32.009] [driver] [info] [Task Finished] Transform to mem in 0.278227s (11042 normal rows, 43023 exceptions)
[2021-03-25 11:52:32.288] [driver] [info] [Task Finished] Transform to mem in 0.279148s (11012 normal rows, 42911 exceptions)
[2021-03-25 11:52:32.567] [driver] [info] [Task Finished] Transform to mem in 0.278255s (11063 normal rows, 42726 exceptions)
[2021-03-25 11:52:32.846] [driver] [info] [Task Finished] Transform to mem in 0.278904s (11105 normal rows, 43555 exceptions)
[2021-03-25 11:52:33.125] [driver] [info] [Task Finished] Transform to mem in 0.279453s (11081 normal rows, 43050 exceptions)
[2021-03-25 11:52:33.404] [driver] [info] [Task Finished] Transform to mem in 0.278425s (11087 normal rows, 43150 exceptions)
[2021-03-25 11:52:33.682] [driver] [info] [Task Finished] Transform to mem in 0.278568s (11005 normal rows, 43164 exceptions)
[2021-03-25 11:52:33.961] [driver] [info] [Task Finished] Transform to mem in 0.278614s (11008 normal rows, 42975 exceptions)
[2021-03-25 11:52:34.240] [driver] [info] [Task Finished] Transform to mem in 0.278825s (11042 normal rows, 42959 exceptions)
[2021-03-25 11:52:34.518] [driver] [info] [Task Finished] Transform to mem in 0.278780s (11002 normal rows, 42964 exceptions)
[2021-03-25 11:52:34.798] [driver] [info] [Task Finished] Transform to mem in 0.279707s (11073 normal rows, 42720 exceptions)
[2021-03-25 11:52:35.078] [driver] [info] [Task Finished] Transform to mem in 0.280267s (11088 normal rows, 43511 exceptions)
[2021-03-25 11:52:35.357] [driver] [info] [Task Finished] Transform to mem in 0.278717s (11098 normal rows, 43112 exceptions)
[2021-03-25 11:52:35.636] [driver] [info] [Task Finished] Transform to mem in 0.278984s (11087 normal rows, 43044 exceptions)
[2021-03-25 11:52:35.915] [driver] [info] [Task Finished] Transform to mem in 0.278718s (11005 normal rows, 43229 exceptions)
[2021-03-25 11:52:36.194] [driver] [info] [Task Finished] Transform to mem in 0.279133s (11008 normal rows, 43017 exceptions)
[2021-03-25 11:52:36.472] [driver] [info] [Task Finished] Transform to mem in 0.278310s (11024 normal rows, 42947 exceptions)
[2021-03-25 11:52:36.751] [driver] [info] [Task Finished] Transform to mem in 0.278617s (11020 normal rows, 42976 exceptions)
[2021-03-25 11:52:37.029] [driver] [info] [Task Finished] Transform to mem in 0.278272s (11036 normal rows, 42710 exceptions)
[2021-03-25 11:52:37.309] [driver] [info] [Task Finished] Transform to mem in 0.279504s (11125 normal rows, 43517 exceptions)
[2021-03-25 11:52:37.588] [driver] [info] [Task Finished] Transform to mem in 0.279101s (11098 normal rows, 43115 exceptions)
[2021-03-25 11:52:37.866] [driver] [info] [Task Finished] Transform to mem in 0.278450s (11087 normal rows, 42938 exceptions)
[2021-03-25 11:52:38.148] [driver] [info] [Task Finished] Transform to mem in 0.281153s (10985 normal rows, 43336 exceptions)
[2021-03-25 11:52:38.426] [driver] [info] [Task Finished] Transform to mem in 0.278544s (11000 normal rows, 42999 exceptions)
[2021-03-25 11:52:38.704] [driver] [info] [Task Finished] Transform to mem in 0.278179s (11052 normal rows, 42881 exceptions)
[2021-03-25 11:52:38.983] [driver] [info] [Task Finished] Transform to mem in 0.278916s (11020 normal rows, 43057 exceptions)
[2021-03-25 11:52:39.261] [driver] [info] [Task Finished] Transform to mem in 0.278186s (10995 normal rows, 42708 exceptions)
[2021-03-25 11:52:39.541] [driver] [info] [Task Finished] Transform to mem in 0.279179s (11166 normal rows, 43520 exceptions)
[2021-03-25 11:52:39.820] [driver] [info] [Task Finished] Transform to mem in 0.278967s (11098 normal rows, 43075 exceptions)
[2021-03-25 11:52:40.099] [driver] [info] [Task Finished] Transform to mem in 0.279013s (11073 normal rows, 42970 exceptions)
[2021-03-25 11:52:40.377] [driver] [info] [Task Finished] Transform to mem in 0.278461s (10999 normal rows, 43334 exceptions)
[2021-03-25 11:52:40.656] [driver] [info] [Task Finished] Transform to mem in 0.278641s (11000 normal rows, 43009 exceptions)
[2021-03-25 11:52:40.935] [driver] [info] [Task Finished] Transform to mem in 0.278656s (11052 normal rows, 42764 exceptions)
[2021-03-25 11:52:41.213] [driver] [info] [Task Finished] Transform to mem in 0.278829s (11020 normal rows, 43138 exceptions)
[2021-03-25 11:52:41.492] [driver] [info] [Task Finished] Transform to mem in 0.278424s (10995 normal rows, 42726 exceptions)
[2021-03-25 11:52:41.771] [driver] [info] [Task Finished] Transform to mem in 0.279460s (11166 normal rows, 43508 exceptions)
[2021-03-25 11:52:42.050] [driver] [info] [Task Finished] Transform to mem in 0.278941s (11091 normal rows, 43047 exceptions)
[2021-03-25 11:52:42.329] [driver] [info] [Task Finished] Transform to mem in 0.278898s (11080 normal rows, 43031 exceptions)
[2021-03-25 11:52:42.609] [driver] [info] [Task Finished] Transform to mem in 0.279750s (10999 normal rows, 43300 exceptions)
[2021-03-25 11:52:42.888] [driver] [info] [Task Finished] Transform to mem in 0.278762s (11000 normal rows, 43043 exceptions)
[2021-03-25 11:52:43.166] [driver] [info] [Task Finished] Transform to mem in 0.278206s (11036 normal rows, 42720 exceptions)
[2021-03-25 11:52:43.444] [driver] [info] [Task Finished] Transform to mem in 0.278369s (11016 normal rows, 43165 exceptions)
[2021-03-25 11:52:43.723] [driver] [info] [Task Finished] Transform to mem in 0.278300s (10995 normal rows, 42718 exceptions)
[2021-03-25 11:52:44.001] [driver] [info] [Task Finished] Transform to mem in 0.278728s (11186 normal rows, 43465 exceptions)
[2021-03-25 11:52:44.280] [driver] [info] [Task Finished] Transform to mem in 0.278649s (11001 normal rows, 43113 exceptions)
[2021-03-25 11:52:44.559] [driver] [info] [Task Finished] Transform to mem in 0.278789s (11170 normal rows, 43024 exceptions)
[2021-03-25 11:52:44.837] [driver] [info] [Task Finished] Transform to mem in 0.278342s (10989 normal rows, 43282 exceptions)
[2021-03-25 11:52:45.117] [driver] [info] [Task Finished] Transform to mem in 0.279283s (11010 normal rows, 43002 exceptions)
[2021-03-25 11:52:45.397] [driver] [info] [Task Finished] Transform to mem in 0.280444s (11002 normal rows, 42755 exceptions)
[2021-03-25 11:52:45.677] [driver] [info] [Task Finished] Transform to mem in 0.279543s (11050 normal rows, 43199 exceptions)
[2021-03-25 11:52:45.955] [driver] [info] [Task Finished] Transform to mem in 0.278912s (10973 normal rows, 42686 exceptions)
[2021-03-25 11:52:46.236] [driver] [info] [Task Finished] Transform to mem in 0.280550s (11160 normal rows, 43455 exceptions)
[2021-03-25 11:52:46.516] [driver] [info] [Task Finished] Transform to mem in 0.279631s (11045 normal rows, 43148 exceptions)
[2021-03-25 11:52:46.795] [driver] [info] [Task Finished] Transform to mem in 0.279687s (11166 normal rows, 43023 exceptions)
[2021-03-25 11:52:47.075] [driver] [info] [Task Finished] Transform to mem in 0.279224s (10997 normal rows, 43283 exceptions)
[2021-03-25 11:52:47.354] [driver] [info] [Task Finished] Transform to mem in 0.279600s (11005 normal rows, 42971 exceptions)
[2021-03-25 11:52:47.634] [driver] [info] [Task Finished] Transform to mem in 0.279693s (11007 normal rows, 42795 exceptions)
[2021-03-25 11:52:47.914] [driver] [info] [Task Finished] Transform to mem in 0.279931s (11050 normal rows, 43196 exceptions)
[2021-03-25 11:52:48.193] [driver] [info] [Task Finished] Transform to mem in 0.279062s (10973 normal rows, 42686 exceptions)
[2021-03-25 11:52:48.473] [driver] [info] [Task Finished] Transform to mem in 0.280097s (11160 normal rows, 43446 exceptions)
[2021-03-25 11:52:48.753] [driver] [info] [Task Finished] Transform to mem in 0.279664s (11043 normal rows, 43153 exceptions)
[2021-03-25 11:52:49.032] [driver] [info] [Task Finished] Transform to mem in 0.279469s (11168 normal rows, 43028 exceptions)
[2021-03-25 11:52:49.312] [driver] [info] [Task Finished] Transform to mem in 0.279200s (10997 normal rows, 43277 exceptions)
[2021-03-25 11:52:49.591] [driver] [info] [Task Finished] Transform to mem in 0.279312s (10997 normal rows, 42973 exceptions)
[2021-03-25 11:52:49.870] [driver] [info] [Task Finished] Transform to mem in 0.279048s (11015 normal rows, 42799 exceptions)
[2021-03-25 11:52:50.150] [driver] [info] [Task Finished] Transform to mem in 0.279789s (11050 normal rows, 43170 exceptions)
[2021-03-25 11:52:50.429] [driver] [info] [Task Finished] Transform to mem in 0.279605s (10973 normal rows, 42710 exceptions)
[2021-03-25 11:52:50.709] [driver] [info] [Task Finished] Transform to mem in 0.279258s (11160 normal rows, 43431 exceptions)
[2021-03-25 11:52:50.987] [driver] [info] [Task Finished] Transform to mem in 0.278805s (11043 normal rows, 43166 exceptions)
[2021-03-25 11:52:51.267] [driver] [info] [Task Finished] Transform to mem in 0.279915s (11168 normal rows, 43027 exceptions)
[2021-03-25 11:52:51.547] [driver] [info] [Task Finished] Transform to mem in 0.279348s (10997 normal rows, 43237 exceptions)
[2021-03-25 11:52:51.826] [driver] [info] [Task Finished] Transform to mem in 0.279219s (10997 normal rows, 43012 exceptions)
[2021-03-25 11:52:52.105] [driver] [info] [Task Finished] Transform to mem in 0.279187s (11009 normal rows, 42805 exceptions)
[2021-03-25 11:52:52.384] [driver] [info] [Task Finished] Transform to mem in 0.279051s (11021 normal rows, 43160 exceptions)
[2021-03-25 11:52:52.663] [driver] [info] [Task Finished] Transform to mem in 0.279180s (11003 normal rows, 42716 exceptions)
[2021-03-25 11:52:52.943] [driver] [info] [Task Finished] Transform to mem in 0.279726s (11165 normal rows, 43354 exceptions)
[2021-03-25 11:52:53.222] [driver] [info] [Task Finished] Transform to mem in 0.279140s (11043 normal rows, 43217 exceptions)
[2021-03-25 11:52:53.502] [driver] [info] [Task Finished] Transform to mem in 0.279188s (11156 normal rows, 43044 exceptions)
[2021-03-25 11:52:53.781] [driver] [info] [Task Finished] Transform to mem in 0.279244s (11009 normal rows, 43187 exceptions)
[2021-03-25 11:52:54.061] [driver] [info] [Task Finished] Transform to mem in 0.280020s (10997 normal rows, 43067 exceptions)
[2021-03-25 11:52:54.340] [driver] [info] [Task Finished] Transform to mem in 0.278893s (11009 normal rows, 42811 exceptions)
[2021-03-25 11:52:54.619] [driver] [info] [Task Finished] Transform to mem in 0.279266s (11021 normal rows, 43162 exceptions)
[2021-03-25 11:52:54.898] [driver] [info] [Task Finished] Transform to mem in 0.279190s (11003 normal rows, 42716 exceptions)
[2021-03-25 11:52:55.178] [driver] [info] [Task Finished] Transform to mem in 0.279605s (11165 normal rows, 43260 exceptions)
[2021-03-25 11:52:55.458] [driver] [info] [Task Finished] Transform to mem in 0.279692s (11027 normal rows, 43245 exceptions)
[2021-03-25 11:52:55.737] [driver] [info] [Task Finished] Transform to mem in 0.279459s (11172 normal rows, 43107 exceptions)
[2021-03-25 11:52:56.016] [driver] [info] [Task Finished] Transform to mem in 0.279242s (10997 normal rows, 43177 exceptions)
[2021-03-25 11:52:56.297] [driver] [info] [Task Finished] Transform to mem in 0.280175s (11009 normal rows, 43050 exceptions)
[2021-03-25 11:52:56.576] [driver] [info] [Task Finished] Transform to mem in 0.279690s (10999 normal rows, 42828 exceptions)
[2021-03-25 11:52:56.856] [driver] [info] [Task Finished] Transform to mem in 0.279523s (11031 normal rows, 43157 exceptions)
[2021-03-25 11:52:57.135] [driver] [info] [Task Finished] Transform to mem in 0.279276s (11000 normal rows, 42726 exceptions)
[2021-03-25 11:52:57.414] [driver] [info] [Task Finished] Transform to mem in 0.279221s (11091 normal rows, 43230 exceptions)
[2021-03-25 11:52:57.694] [driver] [info] [Task Finished] Transform to mem in 0.279829s (11099 normal rows, 43272 exceptions)
[2021-03-25 11:52:57.974] [driver] [info] [Task Finished] Transform to mem in 0.279445s (11177 normal rows, 43113 exceptions)
[2021-03-25 11:52:58.253] [driver] [info] [Task Finished] Transform to mem in 0.279377s (10997 normal rows, 43174 exceptions)
[2021-03-25 11:52:58.533] [driver] [info] [Task Finished] Transform to mem in 0.280120s (10987 normal rows, 43020 exceptions)
[2021-03-25 11:52:58.813] [driver] [info] [Task Finished] Transform to mem in 0.279721s (11020 normal rows, 42867 exceptions)
[2021-03-25 11:52:59.126] [driver] [info] [Task Finished] Transform to mem in 0.312751s (12330 normal rows, 48094 exceptions)
[2021-03-25 11:52:59.126] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.6888s
[2021-03-25 11:52:59.126] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.6855s, 56350770 input rows, time to process 1 row via fast path: 0.000792989ms
[2021-03-25 11:52:59.126] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 11:52:59.130] [local ee] [info] compiled pure python pipeline in 0.004274s
[2021-03-25 11:52:59.130] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 11:52:59.131] [local ee] [info] Created 160 resolve tasks in 0.001174s
[2021-03-25 11:52:59.131] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 11:53:03.459] [driver] [info] [Task Finished] Resolve in 4.328042s
[2021-03-25 11:53:07.899] [driver] [info] [Task Finished] Resolve in 4.439385s
[2021-03-25 11:53:12.234] [driver] [info] [Task Finished] Resolve in 4.334760s
[2021-03-25 11:53:16.701] [driver] [info] [Task Finished] Resolve in 4.467697s
[2021-03-25 11:53:21.115] [driver] [info] [Task Finished] Resolve in 4.413767s
[2021-03-25 11:53:25.367] [driver] [info] [Task Finished] Resolve in 4.252219s
[2021-03-25 11:53:29.821] [driver] [info] [Task Finished] Resolve in 4.453167s
[2021-03-25 11:53:34.267] [driver] [info] [Task Finished] Resolve in 4.446279s
[2021-03-25 11:53:38.544] [driver] [info] [Task Finished] Resolve in 4.276812s
[2021-03-25 11:53:43.126] [driver] [info] [Task Finished] Resolve in 4.581683s
[2021-03-25 11:53:47.383] [driver] [info] [Task Finished] Resolve in 4.257606s
[2021-03-25 11:53:51.659] [driver] [info] [Task Finished] Resolve in 4.275355s
[2021-03-25 11:53:56.263] [driver] [info] [Task Finished] Resolve in 4.603921s
[2021-03-25 11:54:00.517] [driver] [info] [Task Finished] Resolve in 4.254926s
[2021-03-25 11:54:04.797] [driver] [info] [Task Finished] Resolve in 4.279761s
[2021-03-25 11:54:09.439] [driver] [info] [Task Finished] Resolve in 4.642029s
[2021-03-25 11:54:13.715] [driver] [info] [Task Finished] Resolve in 4.275152s
[2021-03-25 11:54:18.034] [driver] [info] [Task Finished] Resolve in 4.319094s
[2021-03-25 11:54:22.290] [driver] [info] [Task Finished] Resolve in 4.256686s
[2021-03-25 11:54:27.069] [driver] [info] [Task Finished] Resolve in 4.778598s
[2021-03-25 11:54:31.346] [driver] [info] [Task Finished] Resolve in 4.276617s
[2021-03-25 11:54:35.603] [driver] [info] [Task Finished] Resolve in 4.257051s
[2021-03-25 11:54:39.887] [driver] [info] [Task Finished] Resolve in 4.284137s
[2021-03-25 11:54:44.133] [driver] [info] [Task Finished] Resolve in 4.246567s
[2021-03-25 11:54:49.035] [driver] [info] [Task Finished] Resolve in 4.901764s
[2021-03-25 11:54:53.361] [driver] [info] [Task Finished] Resolve in 4.326022s
[2021-03-25 11:54:57.617] [driver] [info] [Task Finished] Resolve in 4.255789s
[2021-03-25 11:55:01.898] [driver] [info] [Task Finished] Resolve in 4.280464s
[2021-03-25 11:55:06.176] [driver] [info] [Task Finished] Resolve in 4.278296s
[2021-03-25 11:55:11.209] [driver] [info] [Task Finished] Resolve in 5.032706s
[2021-03-25 11:55:15.487] [driver] [info] [Task Finished] Resolve in 4.278442s
[2021-03-25 11:55:19.735] [driver] [info] [Task Finished] Resolve in 4.248171s
[2021-03-25 11:55:23.997] [driver] [info] [Task Finished] Resolve in 4.261847s
[2021-03-25 11:55:28.341] [driver] [info] [Task Finished] Resolve in 4.343855s
[2021-03-25 11:55:32.600] [driver] [info] [Task Finished] Resolve in 4.258631s
[2021-03-25 11:55:36.881] [driver] [info] [Task Finished] Resolve in 4.280945s
[2021-03-25 11:55:41.158] [driver] [info] [Task Finished] Resolve in 4.277150s
[2021-03-25 11:55:46.381] [driver] [info] [Task Finished] Resolve in 5.222810s
[2021-03-25 11:55:50.655] [driver] [info] [Task Finished] Resolve in 4.274439s
[2021-03-25 11:55:54.907] [driver] [info] [Task Finished] Resolve in 4.251452s
[2021-03-25 11:55:59.157] [driver] [info] [Task Finished] Resolve in 4.249940s
[2021-03-25 11:56:03.502] [driver] [info] [Task Finished] Resolve in 4.345131s
[2021-03-25 11:56:07.765] [driver] [info] [Task Finished] Resolve in 4.262543s
[2021-03-25 11:56:12.044] [driver] [info] [Task Finished] Resolve in 4.279050s
[2021-03-25 11:56:16.317] [driver] [info] [Task Finished] Resolve in 4.273411s
[2021-03-25 11:56:20.575] [driver] [info] [Task Finished] Resolve in 4.258099s
[2021-03-25 11:56:26.063] [driver] [info] [Task Finished] Resolve in 5.487772s
[2021-03-25 11:56:30.311] [driver] [info] [Task Finished] Resolve in 4.248289s
[2021-03-25 11:56:34.561] [driver] [info] [Task Finished] Resolve in 4.249734s
[2021-03-25 11:56:38.893] [driver] [info] [Task Finished] Resolve in 4.332289s
[2021-03-25 11:56:43.162] [driver] [info] [Task Finished] Resolve in 4.268239s
[2021-03-25 11:56:47.436] [driver] [info] [Task Finished] Resolve in 4.274477s
[2021-03-25 11:56:51.715] [driver] [info] [Task Finished] Resolve in 4.279121s
[2021-03-25 11:56:55.980] [driver] [info] [Task Finished] Resolve in 4.264240s
[2021-03-25 11:57:00.257] [driver] [info] [Task Finished] Resolve in 4.277379s
[2021-03-25 11:57:04.508] [driver] [info] [Task Finished] Resolve in 4.250907s
[2021-03-25 11:57:08.753] [driver] [info] [Task Finished] Resolve in 4.245106s
[2021-03-25 11:57:14.581] [driver] [info] [Task Finished] Resolve in 5.827641s
[2021-03-25 11:57:18.841] [driver] [info] [Task Finished] Resolve in 4.259840s
[2021-03-25 11:57:23.112] [driver] [info] [Task Finished] Resolve in 4.271600s
[2021-03-25 11:57:27.394] [driver] [info] [Task Finished] Resolve in 4.282156s
[2021-03-25 11:57:31.656] [driver] [info] [Task Finished] Resolve in 4.261000s
[2021-03-25 11:57:35.928] [driver] [info] [Task Finished] Resolve in 4.272852s
[2021-03-25 11:57:40.179] [driver] [info] [Task Finished] Resolve in 4.250127s
[2021-03-25 11:57:44.419] [driver] [info] [Task Finished] Resolve in 4.240757s
[2021-03-25 11:57:48.758] [driver] [info] [Task Finished] Resolve in 4.338892s
[2021-03-25 11:57:53.020] [driver] [info] [Task Finished] Resolve in 4.261406s
[2021-03-25 11:57:57.292] [driver] [info] [Task Finished] Resolve in 4.271846s
[2021-03-25 11:58:01.575] [driver] [info] [Task Finished] Resolve in 4.283741s
[2021-03-25 11:58:05.843] [driver] [info] [Task Finished] Resolve in 4.267282s
[2021-03-25 11:58:10.117] [driver] [info] [Task Finished] Resolve in 4.273840s
[2021-03-25 11:58:16.233] [driver] [info] [Task Finished] Resolve in 6.116084s
[2021-03-25 11:58:20.476] [driver] [info] [Task Finished] Resolve in 4.242869s
[2021-03-25 11:58:24.817] [driver] [info] [Task Finished] Resolve in 4.341154s
[2021-03-25 11:58:29.084] [driver] [info] [Task Finished] Resolve in 4.266928s
[2021-03-25 11:58:33.352] [driver] [info] [Task Finished] Resolve in 4.268325s
[2021-03-25 11:58:37.641] [driver] [info] [Task Finished] Resolve in 4.288858s
[2021-03-25 11:58:41.908] [driver] [info] [Task Finished] Resolve in 4.267080s
[2021-03-25 11:58:46.182] [driver] [info] [Task Finished] Resolve in 4.273453s
[2021-03-25 11:58:50.441] [driver] [info] [Task Finished] Resolve in 4.259011s
[2021-03-25 11:58:54.683] [driver] [info] [Task Finished] Resolve in 4.242120s
[2021-03-25 11:58:59.025] [driver] [info] [Task Finished] Resolve in 4.342341s
[2021-03-25 11:59:03.296] [driver] [info] [Task Finished] Resolve in 4.270520s
[2021-03-25 11:59:07.555] [driver] [info] [Task Finished] Resolve in 4.258828s
[2021-03-25 11:59:11.855] [driver] [info] [Task Finished] Resolve in 4.300244s
[2021-03-25 11:59:16.125] [driver] [info] [Task Finished] Resolve in 4.270539s
[2021-03-25 11:59:20.384] [driver] [info] [Task Finished] Resolve in 4.259037s
[2021-03-25 11:59:24.655] [driver] [info] [Task Finished] Resolve in 4.270099s
[2021-03-25 11:59:28.895] [driver] [info] [Task Finished] Resolve in 4.240351s
[2021-03-25 11:59:35.536] [driver] [info] [Task Finished] Resolve in 6.640613s
[2021-03-25 11:59:39.800] [driver] [info] [Task Finished] Resolve in 4.263884s
[2021-03-25 11:59:44.061] [driver] [info] [Task Finished] Resolve in 4.261629s
[2021-03-25 11:59:48.362] [driver] [info] [Task Finished] Resolve in 4.300394s
[2021-03-25 11:59:52.633] [driver] [info] [Task Finished] Resolve in 4.271097s
[2021-03-25 11:59:56.880] [driver] [info] [Task Finished] Resolve in 4.247653s
[2021-03-25 12:00:01.164] [driver] [info] [Task Finished] Resolve in 4.283736s
[2021-03-25 12:00:05.406] [driver] [info] [Task Finished] Resolve in 4.241778s
[2021-03-25 12:00:09.747] [driver] [info] [Task Finished] Resolve in 4.340837s
[2021-03-25 12:00:14.017] [driver] [info] [Task Finished] Resolve in 4.270196s
[2021-03-25 12:00:18.282] [driver] [info] [Task Finished] Resolve in 4.264536s
[2021-03-25 12:00:22.576] [driver] [info] [Task Finished] Resolve in 4.293903s
[2021-03-25 12:00:26.851] [driver] [info] [Task Finished] Resolve in 4.275202s
[2021-03-25 12:00:31.095] [driver] [info] [Task Finished] Resolve in 4.244400s
[2021-03-25 12:00:35.382] [driver] [info] [Task Finished] Resolve in 4.286552s
[2021-03-25 12:00:39.620] [driver] [info] [Task Finished] Resolve in 4.238378s
[2021-03-25 12:00:43.960] [driver] [info] [Task Finished] Resolve in 4.339845s
[2021-03-25 12:00:48.234] [driver] [info] [Task Finished] Resolve in 4.273986s
[2021-03-25 12:00:52.500] [driver] [info] [Task Finished] Resolve in 4.265559s
[2021-03-25 12:00:56.793] [driver] [info] [Task Finished] Resolve in 4.293497s
[2021-03-25 12:01:01.058] [driver] [info] [Task Finished] Resolve in 4.264996s
[2021-03-25 12:01:05.310] [driver] [info] [Task Finished] Resolve in 4.251621s
[2021-03-25 12:01:12.445] [driver] [info] [Task Finished] Resolve in 7.134835s
[2021-03-25 12:01:16.680] [driver] [info] [Task Finished] Resolve in 4.235531s
[2021-03-25 12:01:21.016] [driver] [info] [Task Finished] Resolve in 4.335997s
[2021-03-25 12:01:25.289] [driver] [info] [Task Finished] Resolve in 4.272083s
[2021-03-25 12:01:29.553] [driver] [info] [Task Finished] Resolve in 4.263944s
[2021-03-25 12:01:33.846] [driver] [info] [Task Finished] Resolve in 4.293445s
[2021-03-25 12:01:38.111] [driver] [info] [Task Finished] Resolve in 4.264630s
[2021-03-25 12:01:42.363] [driver] [info] [Task Finished] Resolve in 4.251868s
[2021-03-25 12:01:46.655] [driver] [info] [Task Finished] Resolve in 4.291969s
[2021-03-25 12:01:50.890] [driver] [info] [Task Finished] Resolve in 4.235155s
[2021-03-25 12:01:55.227] [driver] [info] [Task Finished] Resolve in 4.337619s
[2021-03-25 12:01:59.502] [driver] [info] [Task Finished] Resolve in 4.274998s
[2021-03-25 12:02:03.766] [driver] [info] [Task Finished] Resolve in 4.263579s
[2021-03-25 12:02:08.061] [driver] [info] [Task Finished] Resolve in 4.295075s
[2021-03-25 12:02:12.322] [driver] [info] [Task Finished] Resolve in 4.260799s
[2021-03-25 12:02:16.573] [driver] [info] [Task Finished] Resolve in 4.250742s
[2021-03-25 12:02:20.861] [driver] [info] [Task Finished] Resolve in 4.288543s
[2021-03-25 12:02:25.100] [driver] [info] [Task Finished] Resolve in 4.238239s
[2021-03-25 12:02:29.435] [driver] [info] [Task Finished] Resolve in 4.335158s
[2021-03-25 12:02:33.711] [driver] [info] [Task Finished] Resolve in 4.276118s
[2021-03-25 12:02:37.979] [driver] [info] [Task Finished] Resolve in 4.267559s
[2021-03-25 12:02:42.265] [driver] [info] [Task Finished] Resolve in 4.285927s
[2021-03-25 12:02:46.530] [driver] [info] [Task Finished] Resolve in 4.265659s
[2021-03-25 12:02:50.784] [driver] [info] [Task Finished] Resolve in 4.254003s
[2021-03-25 12:02:55.074] [driver] [info] [Task Finished] Resolve in 4.290053s
[2021-03-25 12:02:59.312] [driver] [info] [Task Finished] Resolve in 4.237778s
[2021-03-25 12:03:03.636] [driver] [info] [Task Finished] Resolve in 4.324063s
[2021-03-25 12:03:11.467] [driver] [info] [Task Finished] Resolve in 7.830730s
[2021-03-25 12:03:15.733] [driver] [info] [Task Finished] Resolve in 4.265690s
[2021-03-25 12:03:20.019] [driver] [info] [Task Finished] Resolve in 4.286072s
[2021-03-25 12:03:24.288] [driver] [info] [Task Finished] Resolve in 4.269201s
[2021-03-25 12:03:28.541] [driver] [info] [Task Finished] Resolve in 4.253115s
[2021-03-25 12:03:32.832] [driver] [info] [Task Finished] Resolve in 4.290288s
[2021-03-25 12:03:37.069] [driver] [info] [Task Finished] Resolve in 4.237436s
[2021-03-25 12:03:41.382] [driver] [info] [Task Finished] Resolve in 4.313185s
[2021-03-25 12:03:45.673] [driver] [info] [Task Finished] Resolve in 4.290712s
[2021-03-25 12:03:49.945] [driver] [info] [Task Finished] Resolve in 4.271995s
[2021-03-25 12:03:54.228] [driver] [info] [Task Finished] Resolve in 4.283249s
[2021-03-25 12:03:58.502] [driver] [info] [Task Finished] Resolve in 4.273431s
[2021-03-25 12:04:02.758] [driver] [info] [Task Finished] Resolve in 4.256638s
[2021-03-25 12:04:07.047] [driver] [info] [Task Finished] Resolve in 4.288939s
[2021-03-25 12:04:11.288] [driver] [info] [Task Finished] Resolve in 4.241052s
[2021-03-25 12:04:15.594] [driver] [info] [Task Finished] Resolve in 4.305723s
[2021-03-25 12:04:19.891] [driver] [info] [Task Finished] Resolve in 4.297066s
[2021-03-25 12:04:24.166] [driver] [info] [Task Finished] Resolve in 4.274282s
[2021-03-25 12:04:28.451] [driver] [info] [Task Finished] Resolve in 4.285018s
[2021-03-25 12:04:32.718] [driver] [info] [Task Finished] Resolve in 4.267016s
[2021-03-25 12:04:36.977] [driver] [info] [Task Finished] Resolve in 4.258864s
[2021-03-25 12:04:41.754] [driver] [info] [Task Finished] Resolve in 4.776994s
[2021-03-25 12:04:41.754] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 702.628s
[2021-03-25 12:04:41.754] [local ee] [info] slow path for Stage 0: total wall clock time: 702.617s, time to process 1 row via slow path: 0.101889ms
[2021-03-25 12:04:41.754] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 702.628s

[2021-03-25 12:04:41.787] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-25 12:04:42.098] [driver] [info] [Task Finished] write to file in 0.311362s (1798491 rows, 273.61 MB)
[2021-03-25 12:04:42.098] [global] [info] writing output took 0.344454s
[2021-03-25 12:04:42.098] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.344541s
[2021-03-25 12:04:42.098] [global] [info] [Transform Stage] Stage 0 took 748.159s
[2021-03-25 12:04:42.098] [global] [info] Query Execution took 748.238s. (planning: 0.0784185s, execution: 748.159s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.004988193511962891
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 748.5217854976654 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.021895,"llvm_optimization_time_s":0.3294,"llvm_compilation_time_s":0.151237,"total_compilation_time_s":0.497899,"sampling_time_s":0.116684,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.6855,"fast_path_time_s":44.6888,"fast_path_per_row_time_ns":792.989,"slow_path_wall_time_s":702.617,"slow_path_time_s":702.628,"slow_path_per_row_time_ns":101889}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.004988193511962891, "jobTime": 748.5217854976654, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
